26 to 50 of 143 PySpark Jobs in the UK

Data Architect

Hiring Organisation
Charles Simon Associates Ltd
Location
Reading, Berkshire, South East, United Kingdom
Employment Type
Permanent
Salary
£90,000
Databricks Defining data models and Databricks architecture standards Establishing data governance and security frameworks Aligning data architecture with enterprise cloud strategy Supporting development using PySpark, SQL and Python within Databricks Working within CI/CD and DevOps environments (Git-based) About You: Strong technical background in Databricks and Azure ...

Azure Databricks Engineer

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £95,000 per annum
Lloyd's of London or London Market insurance sector Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns and data modelling. Strong Python, PySpark and Spark SQL capability Solid understanding of data governance Proven track record of ownership, delivery and operating effectively in fast-paced environments. What ...

Data Engineer

Hiring Organisation
Express Recruitment
Location
Nottingham, England, United Kingdom
similar Demonstrable experience in programming full scale data and analytic pipelines, storage solutions and process automation functions Highly proficient coding skills in SQL, Python & PySpark Proven knowledge in at least one of the following big data technologies – HIVE, Hadoop, MongoDB, Spark Experience within the Life Science, Medical Research ...

Junior Data Enigneer

Hiring Organisation
hireful
Location
London, United Kingdom
Employment Type
Permanent
Salary
£40000 - £45000/annum Up to £45K Basic + 10% bonus + Exten
exposure to enterprise-level data platforms and best practices. The role will involve developing and maintaining data pipelines, transforming data using Python, SQL and PySpark , integrating data from various internal and external sources, and supporting day-to-day data operations. You’ll also contribute to data quality initiatives, documentation ...

Head of Data Engineering

Hiring Organisation
McGregor Boyall Associates Limited
Location
Manchester, North West, United Kingdom
Employment Type
Permanent
data projects Key Requirements Proven leadership of multiple engineering teams Strong Data Engineering/DataOps background Experience in large, dataheavy environments Python/PySpark for endto-end pipelines Strong AWS experience (design & deployment) Deep knowledge of data modelling, warehousing & lakehouse concepts Strong stakeholder management and communication skills Agile delivery ...

Data Delivery Lead

Hiring Organisation
VIQU IT
Location
London, Clerkenwell, United Kingdom
Employment Type
Permanent
Salary
£90000 - £100000/annum Benefits
Hands-on experience with Microsoft Purview • Strong Azure Data Platform experience: ADLS Gen2, Azure Databricks, Data Factory • Hands-on data engineering experience (Spark/PySpark, Delta Lake) • Knowledge of security and compliance controls, GDPR, PII/DLP, RBAC/ABAC • Experience leading Agile teams and managing risks, dependencies ...

Data/Machine Learning Ops Engineer

Hiring Organisation
DXC Technology
Location
Erskine, Renfrewshire, United Kingdom
Employment Type
Full Time
Salary
45000-75000
Required Skills & Experience Proven experience in MLOps or DevOps roles within machine learning environments Strong programming skills in Python, with hands-on experience in PySpark and SQL Deep understanding of ML lifecycle management and CI/CD best practices Familiarity with cloud-native ML platforms and scalable deployment strategies ...

MLOps Engineer

Hiring Organisation
Optima Partners
Location
London Area, United Kingdom
/Ansible Work closely with engineering teams to deliver real-world ML systems across multiple sectors. Tech Stack You’ll Work With Python, SQL, PySpark PyTorch, TensorFlow, Scikit‐learn MLflow (core focus), Databricks, Azure IaC: Terraform, ARM, Ansible Git, Azure DevOps, Jenkins What We’re Looking For ✔️ 3+ years ...

(111) Senior Data Engineer

Hiring Organisation
Harnham
Location
United Kingdom
making Your Skills and Experience Strong commercial experience as a data engineer in modern, cloud based environments Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience ...

(111) Senior Data Engineer

Hiring Organisation
Harnham
Location
Manchester Area, United Kingdom
making Your Skills and Experience Strong commercial experience as a data engineer in modern, cloud based environments Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience ...

Senior Data Engineer

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
Edinburgh, Midlothian, Scotland, United Kingdom
Employment Type
Full-Time
Salary
£90,000 - £100,000 per annum
making Your Skills and Experience Strong commercial experience as a data engineer in modern, cloud based environments Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience ...

Data Engineer

Hiring Organisation
Fimador
Location
London, UK
ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark). Ensure performance, scalability, and compliance (GxP and other standards). Collaborate on requirements, design, and backlog refinement. Promote engineering best practices including ...

Data Engineer/Scientist - Life Sciences

Hiring Organisation
Data Science Talent
Location
Reading, England, United Kingdom
start up, but with resources and business opportunities that start ups can rarely match. What you’ll need Strong SQL, Python, and Spark/PySpark skills Experience in data pipeline design A quantitative degree - Maths, Stats, Physics, Operations research About the company You'll be working ...

Senior Data Engineer

Hiring Organisation
develop
Location
London, UK
Responsibilities Build and maintain Databricks Delta Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling ...

Principal Data Scientist

Hiring Organisation
Jobleads-UK
Location
Greater London, England, United Kingdom
financial modelling Knowledge graph experience Probabilistic programming experience (e.g. PyMC, Stan). Causal Inference knowledge/experience. Our technology stack Python and Jupyter Notebooks. PySpark for processing big data. Databricks: Workflows, Asset Bundles, MLFlow. About Us Who we are: PEI Group is a subscriber‐focused business intelligence company. With ...

Lead Data Engineer

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
Edinburgh, Midlothian, Scotland, United Kingdom
Employment Type
Full-Time
Salary
£90,000 - £100,000 per annum
making Your Skills and Experience Strong commercial experience as a data engineer in modern, cloud based environments Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience ...

Data / Machine Learning Ops Engineer

Hiring Organisation
DXC Technology
Location
Newcastle upon Tyne, Tyne and Wear, United Kingdom
Employment Type
Full Time
Salary
60000-90000
TensorFlow Serving, TorchServe). Familiarity with ML lifecycle tools such as MLflow, Kubeflow, or Azure ML Pipelines. Experience working with distributed data processing (e.g., PySpark) and SQL. Understanding of software engineering best practices, including version control (Git). Knowledge of CI/CD principles in ML environments. Experience with ...

51576240 DXC Academic Programme – Modern Apprenticeship in Data & AI

Hiring Organisation
DXC Technology
Location
Newcastle, Newry, Mourne and Down, United Kingdom
Employment Type
Full Time
Salary
5000-35000
pipelines using Snowflake and Databricks Manage and optimise data platforms for performance and reliability Develop modular ETL workflows and orchestrate data processes Write efficient PySpark code, including UDFs and Pandas UDFs Ensure high data quality and collaborate across teams to deliver impactful data solutions What we are looking ...

DXC Academic Programme – Degree Apprenticeship in Data & AI

Hiring Organisation
DXC Technology
Location
Newcastle upon Tyne, Tyne and Wear, United Kingdom
Employment Type
Full Time
Salary
10000-40000
pipelines using Snowflake and Databricks Manage and optimise data platforms for performance and reliability Develop modular ETL workflows and orchestrate data processes Write efficient PySpark code, including UDFs and Pandas UDFs Ensure high data quality and collaborate across teams to deliver impactful data solutions What we are looking ...

Lead Data Engineer

Hiring Organisation
Canada Life
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
Salary negotiable
data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … influence within the team and communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous). Experience contributing ...

Platform Engineer

Hiring Organisation
Halian Technology Limited
Location
Central London, London, United Kingdom
Employment Type
Contract, Work From Home
RBAC and governance controls across Azure services Tech stack Azure Azure Databricks Terraform Azure DevOps/CI/CD Python SQL Apache Spark/PySpark Entra ID/RBAC/governance Networking/platform security/automation What were looking for Strong experience in Azure platform engineering Strong hands ...

AWS Data Engineer

Hiring Organisation
Bis Henderson
Location
Leicestershire, East Midlands, United Kingdom
Employment Type
Permanent
Salary
£80,000
ideally in a multi-site business environment Strong proficiency in Python and SQL, with hands-on experience in Spark/PySpark and modern table formats (e.g. Delta Lake, Iceberg, Hudi) Expertise in AWS data services (e.g. S3, Glue, Redshift, Lambda, Step Functions, Kinesis) and infrastructure-as-code (Terraform ...

Data Science Consultant

Hiring Organisation
Datatech Analytics
Location
London Area, United Kingdom
Working closely with data engineering and platform teams • Translating complex outputs into clear, actionable insight • Agile, cross-functional delivery Tech Python, SQL, R, Databricks, PySpark, GIS tools, optimisation frameworks, cloud platforms Requirements Degree or higher in Data Science, Mathematics, Operational Research, Engineering, Physics, Geography, or similar Experience working with ...

Machine Learning Ops Engineer

Hiring Organisation
DXC
Location
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Employment Type
Permanent
TensorFlow Serving, TorchServe). Familiarity with ML lifecycle tools such as MLflow, Kubeflow, or Azure ML Pipelines. Experience working with distributed data processing (e.g., PySpark) and SQL. Understanding of software engineering best practices, including version control (Git). Knowledge of CI/CD principles in ML environments. Experience with ...

Data Engineers - AWS

Hiring Organisation
Coventry Building Society
Location
Coventry, West Midlands, England, United Kingdom
Employment Type
Contractor
Contract Rate
£41,430 - £55,470 per annum
commercial or Agile environment.To be successful in this role it’s essential that you will: Have significant experience of AWS , Python, SQL, Git and PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation ...