126 to 150 of 342 PySpark Jobs in the UK

Databricks Solution Architect

Hiring Organisation
GIS Recruiter Ltd
Location
London, United Kingdom
Employment Type
Permanent
Salary
£90000 - £120000/annum Hybrid Working
design, technical implementation and engineering leadership. Essential Technical Skills 5+ years of hands-on Databricks platform experience. Extensive Azure Databricks architecture experience. Expert-level PySpark, Spark SQL and Python knowledge. Deep understanding of Apache Spark processing architecture. Extensive Delta Lake and Lakehouse architecture experience. Strong experience designing Medallion Architecture. ...

CRM Technical Lead - MarTech

Location
United Kingdom
Ensure GDPR, PECR, consent management and data governance requirements are met. Essential Skills: Hands-on experience with mParticle and Braze. Strong Databricks, SQL, Python, PySpark and Delta Lake. Experience with dbt and workflow orchestration tools. API, webhook and event-driven integrations. Technical leadership within MarTech or data engineering environments. ...

CRM Technical Lead - MarTech

Hiring Organisation
Gazelle Global Consulting Ltd
Location
South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Negotiable
Ensure GDPR, PECR, consent management and data governance requirements are met. Essential Skills: Hands-on experience with mParticle and Braze. Strong Databricks, SQL, Python, PySpark and Delta Lake. Experience with dbt and workflow orchestration tools. API, webhook and event-driven integrations. Technical leadership within MarTech or data engineering environments. ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
knowledge (you don't need everything) Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/ ...

Azure Data Engineer: Build Data Pipelines (Hybrid, London)

Location
Greater London, England, United Kingdom
based hybrid setup. The role focuses on designing, building, and optimizing scalable data pipelines and data products using Azure Databricks, Azure Data Factory, Python, PySpark and SQL. You will work with modern data architectures, including medallion architecture and Unity Catalog, ensuring data governance, security, and accessibility while driving ...

Lead Data Platform Engineer

Location
Greater London, England, United Kingdom
management, network design and access control; Databricks and OCI, or comparable platforms Strong Python and SQL, and experience building and monitoring production pipelines using PySpark or Spark Experience with infrastructure as code, CI/CD and a Git and GitHub workflow A track record of setting engineering standards ...

Analytics Solutions Consultant

Hiring Organisation
Source & Connect
Location
Leeds, West Yorkshire, United Kingdom
Employment Type
Permanent
Salary
£45000 - £60000/annum
cost management. Build strong client relationships and provide trusted advice. Skills & Experience Essential Commercial Microsoft Fabric experience. Strong Power BI, SQL and Python/PySpark skills. Experience delivering client-facing analytics projects. Excellent communication and stakeholder management skills. Ability to lead workshops and gather business requirements. Desirable ...

Advanced Data Analytics – Health & Life Sciences

Location
Belfast, Northern Ireland, United Kingdom
that deeply cares about its values. To use a range of different tools and technologies depending on the specific task, these include: Databricks, Python, PySpark, R, Excel, Palantir Foundry, SQL and PowerBI. Qualifications Even if you don’t meet every requirement below, feel free to still apply ...

Principal Developer

Location
Liverpool, England, United Kingdom
Python for data processing, pipelines and model serving, alongside the libraries and tooling used by our data science team (such as pandas, Polars and PySpark) What we’re looking for: Significant experience as a senior or principal engineer leading the design and delivery of data‐intensive systems A track ...

Data Engineering Consultant

Location
City Of London, England, United Kingdom
Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL Confident communicator who is able to explain technical terms to non‐technical audiences and mentor junior colleagues Leads ...

Advanced Data Analytics

Location
Greater London, England, United Kingdom
week on a client site. We use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI. Qualifications Essential requirements Even if you don’t meet every requirement below, feel free to still apply ...

Head of Data Platform

Location
Greater London, England, United Kingdom
software or computer engineering, applied math, physics, statistics, or a related field or equivalent experience Technical Skills: Strong knowledge of distributed data processing (Spark, PySpark, SQL) Expertise in data governance, metadata management, lineage, and data modeling Experience with AI/ML platforms and AI‐driven architecture Proven ability ...

Head of Data Platform

Hiring Organisation
SCOR Global Life
Location
London, England, United Kingdom
equivalent experienceTechnical Skills: Deep expertise in modern data platforms specifically Palantir Foundry and (Databricks Lakehouse, cloud ecosystems) Strong knowledge of distributed data processing (Spark, PySpark, SQL) Expertise in data governance, metadata management, lineage, and data modeling Experience with AI/ML platforms and AI-driven architecture Proven ability ...

Engagement Manager (Personal Line Insurance)

Location
Greater London, England, United Kingdom
/CD, monitoring, deployment patterns such as blue-green and canary) Cloud and data platforms (Azure, AWS or GCP; Databricks, Snowflake); Python, SQL, PySpark Experience leading proposals, solution architecture and commercial estimation in a consulting or services environment Confident communicator able to explain complex AI concepts to senior business ...

Azure Data Engineer: Fabric Pipelines & Data Quality

Location
Manchester, England, United Kingdom
Arrow Global Group in Manchester seeks an experienced Data Engineer to design and implement robust data pipelines using Microsoft Fabric, PySpark, and SQL across multiple data sources in a financial services setting. The role focuses on building scalable data ingestion, transformation, and validation workflows, while collaborating with Data Stewards ...

Data Engineer: Databricks & Fabric Lakehouse Automation

Location
United Kingdom
Databricks Workflows. You will deliver clean, production-ready data for enterprise analytics and support real-time Power BI reporting. The role requires strong PySpark, Databricks SQL, T-SQL, and Delta Lake expertise with hands-on Databricks and Fabric experience. A UK-based, enterprise-scale environment offers challenging projects ...

Principal Data Engineer

Hiring Organisation
IO Associates
Location
South East, United Kingdom
Employment Type
Temporary Contract, On-site
Salary
£400 - 600 per day + Depending on experience
Proven experience in a principal engineering role Extensive experience with cloud data platforms such as Azure or AWS, with a focus on Databricks Strong PySpark and SparkSQL skills Solid understanding of data modelling across relational and non-relational databases Proficiency in SQL, with experience in data integration ...

Principal Data Engineer

Location
United Kingdom
experience with cloud data platforms such as Azure or AWS, with a focus on Databricks. Highly skilled with Pythonic data processing tools such as Pyspark and SparkSQL. Strong understanding of data modelling concepts relational and non-relational databases. Proficiency in SQL and experience with data integration and ETL tools. ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
experience with cloud data platforms such as Azure or AWS, with a focus on Databricks. Highly skilled with Pythonic data processing tools such as Pyspark and SparkSQL. Strong understanding of data modelling concepts relational and non-relational databases. Proficiency in SQL and experience with data integration and ETL tools. ...

Data Warehouse Modeler/Engineer

Hiring Organisation
Randstad Technologies Recruitment
Location
Basildon, Essex, United Kingdom
Employment Type
Permanent
Salary
£75000 - £80000/annum
patterns. Proficiency in data quality assurance, data governance, and query optimization. Nice to have: Familiarity with the AWS data ecosystem (S3, Glue, EMR/PySpark, Apache Iceberg). Non-Technical Skills & Competencies Proven sense of ownership, commitment, and personal accountability. Meticulous attention to detail with a proactive problem-solving ...

Azure Databricks Developer

Location
United Kingdom
quality data products while ensuring compliance with security, governance, and operational standards. Key Responsibilities: Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake. Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads. Integrate data from multiple … engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support. Skills we can’t do without: Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience with Azure ...

Azure Databricks Developer (Remote) - Data Engineering & AI

Location
United Kingdom
quality data products while ensuring compliance with security, governance, and operational standards. Key Responsibilities: Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake. Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads. Integrate data from multiple … engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support. Skills we can’t do without: Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience with Azure ...

London Data & Analytics Senior Manager

Location
Greater London, England, United Kingdom
pipelines using modern cloud-native data engineering technologies. Provide technical direction across data modelling, ingestion, transformation, orchestration and integration. Apply practical experience of Spark, PySpark, Python and SQL within enterprise data environments. Governance, Security & Quality Embed effective data governance, security, quality and access controls within cloud data environments. Ensure … Fabric or another cloud data platform. Strong understanding of modern data architecture patterns, data modelling and ETL/ELT approaches. Practical experience with Spark, PySpark, Python and SQL and the design of scalable batch and real-time data pipelines. Experience designing appropriate data governance, security and data quality controls. ...

Data Engineer

Location
Cardiff, Wales, United Kingdom
analytics and data science across Veezu. Reporting into the Director of Data Engineering, you’ll work hands‐on with Microsoft Fabric, SQL, Python/PySpark and Power BI, bringing data in from our booking systems, databases and third‐party APIs and shaping it into trusted, well‐modelled datasets that … more! What you’ll do: Design, build and maintain ETL/ELT pipelines in Microsoft Fabric using Pipelines, Notebooks, Lakehouses, Warehouses and OneLake. Write PySpark notebooks to ingest and transform data from SQL Server databases, REST APIs, SaaS applications and file‐based exports. Develop and optimise SQL transformations, stored ...

Data Engineer

Location
Cardiff, Wales, United Kingdom
analytics and data science across Veezu. Reporting into the Director of Data Engineering, you'll work hands‐on with Microsoft Fabric, SQL, Python/PySpark and Power BI, bringing data in from our booking systems, databases and third‐party APIs and shaping it into trusted, well‐modelled datasets that … more! What you’ll do: Design, build and maintain ETL/ELT pipelines in Microsoft Fabric using Pipelines, Notebooks, Lakehouses, Warehouses and OneLake. Write PySpark notebooks to ingest and transform data from SQL Server databases, REST APIs, SaaS applications and file‐based exports. Develop and optimise SQL transformations, stored ...