26 to 50 of 60 PySpark Jobs in London

DataBricks, Snowflake or MS Fabric. Comfortable engaging directly with stakeholders, taking ownership of technical decisions, and contributing to the broader data strategy. Essential SQL PySpark/Python DBT Azure knowledge (i.e. Logic apps) Power BI/Fabric Semantic Models Ability to work with stakeholders with their own operational pressures. ...

/or algorithms Our technology stack 💻 Python and associated ML/DS libraries (scikit-learn, numpy, LightlGBM, Pandas, LangChain/LangGraph, TensorFlow, etc..) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc. MLOps: Terraform, Docker, Airflow, MLFlow More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work ...

travel to Leeds/Newcastle) Clearance: Active SC Clearance required Rate: Up to £425/day (Inside IR35) Tech Stack: AWS (EMR, S3, Lambda), PySpark, Python, SQL, CI/CD Focus: Building scalable pipelines, modernising ETL, supporting MI/Power BI Level: Mid to Senior - mentoring & architectural input expected ...

tools, and emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building curated ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

lifecycle Collaborating across squads and upskilling within the Databricks ecosystem YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development Databricks Azure PySpark Understanding of data engineering principles A proactive, growth-mindset approach with strong collaboration skills THE BENEFITS: You will receive a salary ...

methodology. Platforms & Tools Experience with Databricks (preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers ...

questions. Person Specification Qualifications Essential Degree or equivalent experience. Knowledge Essential Awareness of cloud platforms and data tools including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable Skills and Experience Essential Delivers tasks with guidance Writes maintainable ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

workflow orchestration, and machine learning operations.Excellent communication skills with the ability to influence cross-functional teams and stakeholders.Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferredWell-versed in design thinking principlesGreat problem solving and analytical skills#LI-GM1The total cash range for this position in Seattle ...

complex technical architectures. Essential Skills Clearance: Active UK Government Security Check (SC). GenAI: Expertise in LLMs and RAG architectures. Python: Strong proficiency alongside PySpark for data engineering. Azure: Deep familiarity with native tools (AI Search, Document Intelligence). MLOps: Understanding of LLMOps frameworks for production deployment. 6 Months ...

impact. Key Responsibilities Design and deliver end-to-end technical solutions across complex data environments Build and maintain applications using technologies such as Python, PySpark, TypeScript, and React Develop AI-driven workflows and operational tooling Work directly with client stakeholders in fast-paced delivery environments Present demos, gather feedback ...

tools such as Grafana, Dynatrace, Prometheus, Datadog, and Splunk. Strong understanding of SLI/SLO/SLA and Error Budgets. Proficient in Python or PySpark for AI/ML modeling. Able to reduce toil by building automation tools for repeated tasks. Hands‐on experience in system design, resiliency, testing ...

similarly complex digital platforms Our technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More ...

connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions. ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

tools such as Grafana, Dynatrace, Prometheus, Datadog, and Splunk Strong understanding of SLI/SLO/SLA and Error Budgets Proficient in Python or PySpark for AI/ML modeling Able to reduce toil by building automation tools for repeated tasks Hands‐on experience in system design, resiliency, testing ...

individual ownership of client problems, handling everything from deep data engineering that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos – to building user‐facing front‐end applications and widgets in TypeScript or React Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

Databricks, APIs, and integration platforms Strong understanding of MLOps and productionizing machine learning Experience leading and scaling engineering teams Tech stack: Azure, Databricks, Python, PySpark, SQL, JavaScript, Node, Bash THE ROLE: You’ll own the technical vision and delivery of our core platforms: Build world‐class platforms Architect cloud … technical leadership where required Define and own the engineering roadmap and align to resource needs Work with: Azure, Databricks, Bash, JavaScript, Node, Python, PySpark, SQL Integration & Ecosystem Enablement Own the strategy and delivery of integration services, including public and private APIs, event‐driven and asynchronous integrations, and authentication/ ...

Job Title: Technical Delivery Lead - Data Engineering Lead (Hands-on Python/Databricks) Contract: 6 months - Potentially extension. Location: London Hybrid (5 days in 10 in the office) Rate: Highly competitive Status: Inside IR35 Working ...

Data Engineering Lead Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 ...

salary of up to £120,000. The successful candidate will engage with clients, focusing on architecture and data solutions while leveraging expertise in Spark, PySpark, and Delta Lake. You'll lead workshops, translate complex requirements, and contribute to modernizing enterprise data platforms. #J-18808-Ljbffr ...

requirements into technical solutions and actionable data initiatives Provide hands-on technical leadership across a Microsoft data stack, leveraging tools such as Databricks and PySpark Oversee end-to-end delivery of data solutions, ensuring designs are effectively implemented by engineering teams If this role sounds of interest ...

join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark , who can take ownership of data engineering delivery from design through to implementation. This is a hybrid role requiring the candidate … data processing in a cloud environment. Key Responsibilities Design and build scalable data pipelines using Azure technologies Develop and optimise solutions in Databricks using PySpark Work with large and complex datasets, including streaming and batch data Build and maintain data platforms and data warehouses Implement ETL/ELT processes ...