201 to 225 of 265 PySpark Jobs in England

using modern data engineering patterns Develop robust orchestration workflows for dependable data ingestion, transformation, quality checks, and downstream consumption Apply strong SQL, Python, and PySpark skills to transform complex data into reliable, reusable, and performant data products SQL, Data Modelling & Analytics Enablement Create well-modelled, trusted datasets that support … analytics foundations Advanced SQL skills with the ability to design performant queries, data models, and transformation logic Hands‐on knowledge of Python and PySpark for large‐scale data processing and automation Curious, hands‐on problem solver who can engage with business stakeholders to understand the real requirement and deliver ...

Senior Data Engineer (Data and AI Operations) “It feels good to have a career with real purpose.” Job Description Senior Data Engineer (Data and AI Operations) Hours Per Week: 35 Contract Type: Full Time Contract ...

Cognizant in London is seeking a Lead Developer to design, implement and optimize Python and cloud-based solutions using AWS and PySpark for data-intensive, regulatory-focused applications. Hybrid day shift model in Stratford London (3 days a week). You will own end-to-end technical delivery, ensure ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

onsite capacity in Sheffield. You will focus on robust data pipelines and back-end data plumbing. You will work with Databricks and PySpark to ingest, transform and structure raw data into high-quality Delta tables for enterprise use, delivering scalable data infrastructure to support business decisions. Candidates must ...

Hybrid, 3 days onsite). This 12-month fixed-term contract role focuses on building and supporting modern cloud-based data platforms using AWS, PySpark, and IaC. You will work with Terraform, GitLab CI/CD, and collaborate with engineers to deliver secure, scalable cloud solutions. You’ll join ...

Engineer to build and scale modern data platforms, focusing on robust data pipelines and Back End data plumbing. You'll work with Databricks and PySpark to ingest, transform, and structure raw data into high-quality Delta tables for enterprise use. We endeavour to process your personal data ...

existing pipelines. Working within a growing data team, you'll design scalable data models, build robust ELT pipelines in Databricks using SQL, Python and PySpark, and integrate data from multiple internal and third-party systems. You'll collaborate closely with Analytics Engineers to ensure data is reliable, well-governed … architecture and help define long-term data standards, rather than simply delivering against predefined requirements. You’ll need experience with: Databricks, SQL, Python and PySpark Building and optimising ELT/data pipelines Data modelling, lakehouse architecture and modern data platforms Azure data services API and third-party system integration ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

DV Cleared Data Engineer Location: West Midlands - Hybrid working Rate: Up to £600 per day Inside IR35 Contract: Until 31 March 2027, with extensions expected Clearance: Active DV Clearance essential The Role We are seeking ...

engineering, or a related field Experience analysing gambling marketing activities The ability to write clear, well-structured code Hands‐on experience with Python, SQL, PySpark, or similar tools A flair for problem‐solving and storytelling with data — and the confidence to present findings to clients Sound like ...

facing team in London. You will mentor data scientists, oversee complex data products, and ensure analytical excellence. The ideal candidate has strong SQL and PySpark experience, excellent communication skills, and a Bachelor’s degree in a related field. This position offers a collaborative environment, competitive benefits, and a chance ...

Engineer role. They aren't looking for someone who wants to move away from development into pure management. You'll work across: Python/PySpark Microsoft Fabric Spark and notebook engineering Lakehouse/Medallion architecture Delta SQL Azure Git/CI/CD Automated testing Data quality and observability … Reusable engineering patterns They're particularly interested in people coming from Databricks/PySpark environments, so extensive Fabric experience isn't essential. At Senior level, you'll also have the opportunity to influence architecture, technical design, coding standards, CI/CD, testing and engineering best practice, while supporting other ...

data exploration skills Experience of working in Agile methodology Good knowledge and hands-on experience of developing Stored Procedures Experience of working with PySpark Notebooks for data ingestion and provision Practical experience of improving data quality and efficiency in data pipelines Solid understanding of DevOps and CI/… Understanding of compliance and lifecycle of data management Desirable Skills: Coding experience in any relevant language (Python, Pyspark etc.) Experience working with other Azure technologies such as Fabric, Power Automate Experience of working with non-relational databases (CosmosDB, MongoDB, etc.) and handling unstructured data in ETL pipelines Our values ...

operational decisions. Applying statistical and machine learning techniques to build predictive and prescriptive models, test hypotheses and solve real business problems. Using Python, PySpark and SQL to analyse data and develop high-quality, maintainable solutions. Creating and maintaining data pipelines and automated workflows, following agreed ETL and data governance … domain. Proven expertise in using data, statistical analysis and machine learning to solve business challenges and generate actionable insight. Strong technical capability across Python, PySpark and SQL, with experience working with complex datasets. Strong knowledge of machine learning algorithms, including classification, regression, supervised learning and unsupervised learning. Proven expertise ...

operational decisions. Applying statistical and machine learning techniques to build predictive and prescriptive models, test hypotheses and solve real business problems. Using Python, PySpark and SQL to analyse data and develop high‐quality, maintainable solutions. Creating and maintaining data pipelines and automated workflows, following agreed ETL and data governance … domain. Proven expertise in using data, statistical analysis and machine learning to solve business challenges and generate actionable insight. Strong technical capability across Python, PySpark and SQL, with experience working with complex datasets. Strong knowledge of machine learning algorithms, including classification, regression, supervised learning and unsupervised learning. Proven expertise ...

Senior Data Engineer - PySpark/Databricks/Airflow Location: London Salary: Up to £140,000 basic Working Arrangement: 5 days per week in the office An established specialist insurance business is looking for a Senior Data Engineer to join its growing analytics and data engineering function. This … improving existing processes and translating business requirements into effective technical solutions. Key Responsibilities Design, build and maintain scalable data pipelines and data products. Use PySpark and modern data engineering technologies to transform raw data into reliable, analysis-ready datasets. Develop and improve data orchestration and transformation processes. Work directly ...

Lakes*** Experience with **Apache Airflow/MWAA** for workflow orchestration* Strong knowledge of **dbt (data build tool)** for data transformation* Experience with **EMR/PySpark** for large-scale data processing* Ability to create **Architecture Design Documents (ADDs)*** Deep understanding of **cloud-native design patterns*** Experience in **performance tuning** across ...

best practices and CI/CD within an agile, hybrid setup that supports collaboration across Haywards Heath, Salford Quays, and Guernsey. You’ll use PySpark, Python, SQL, and Azure-based tools to implement end-to-end data solutions, mentor junior engineers, and #J-18808-Ljbffr ...

Data Engineer - Python/PySpark/Microsoft Fabric £55,000 - £65,000 + Benefits St Helens - 1-2 days per week This is an opportunity to join an organisation at a particularly interesting point in the development of its data capability. The business has invested heavily in modernising … procedures and drag-and-drop development. The team is deliberately moving towards a more code-led engineering approach, with a strong emphasis on Python, PySpark and notebook-based development. What you’ll be working with The environment includes: Python/PySpark Microsoft Fabric Spark and notebook development Lakehouse ...

Data Engineer (Databricks) Leeds (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Engineer needed with strong hands-on Databricks, PySpark, AWS, SQL + Python experience. 6 Month Contract based in Leeds (Hybrid). Start ASAP in October 2026. Hybrid Working Model - primarily working from home … month. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark + SQL skills. Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS. Keeping scheduled data processing reliable, resolve ...

2026. A chance to work with a leading global IT transformation on a large-scale Government project: Data Engineer with strong Databricks, AWS, Python, PySpark and SQL skills. Hands-on Data Engineer to run + maintain production data pipelines on Databricks and AWS. Keeping scheduled data processing reliable, resolve … understanding of role-based access, KMS encryption + diagnosing data access failures. Owning incidents from investigation through recovery and closure. Diagnosing issues in Python, PySpark, SQL, Databricks jobs and AWS integrations + providing clear progress updates and timely escalation. Working knowledge of Git, code reviews, CI/ ...

team. Nice to have: A PhD or equivalent research training in a quantitative field, and/or familiarity with Databricks, dbt, Spark/PySpark, or similar large-scale data platforms. Experience modifying infrastructure-as-code (e.g. Terraform) or contributing to production data pipelines. Experience building shared tools or platforms … them. Experience with UTXO, EVM, or other blockchain data, graph computation, and/or the cryptocurrency ecosystem. Technologies we use: Python SQL Databricks Dbt PySpark/Spark Terraform AWS Postgres AI at Chainalysis AI is not a feature at Chainalysis - it is a new way of working. One that ...

scalable, secure, and high-performance data platforms.Key Responsibilities Design and implement scalable AWS Data Lakehouse solutions Develop and maintain data pipelines using Python and PySpark Work with AWS services including: S3, EMR, Lambda, IAM, EKS, MWAA Build and manage Apache Iceberg tables for efficient data storage and querying Implement … engineersRequired Skills & Experience Strong experience in AWS Data Engineering Hands-on expertise with: AWS services: IAM, Lambda, EKS, S3, EMR, MWAA Apache Iceberg Python & PySpark Solid understanding of data lakehouse architecture principles Experience with CI/CD pipelines and Terraform Knowledge of data quality frameworks and data security standards ...