PySpark Jobs in England

1 to 25 of 105 PySpark Jobs in England

Senior Data Engineer

London, United Kingdom
Hybrid / WFH Options
Youngs Employment Services
on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in Python, Pyspark, Scala or Java. Experience operating in a cloud-native environment (e.g. Fabric, AWS, GCP, or Azure). Excellent stakeholder management and communication skills. A strategic mindset, with a practical More ❯
Employment Type: Permanent
Salary: £80000 - £95000/annum Attractive Bonus and Benefits
Posted:

Data Engineer Manager

West London, London, United Kingdom
Hybrid / WFH Options
Young's Employment Services Ltd
on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in Python, Pyspark, Scala or Java. Experience operating in a cloud-native environment (e.g. Fabric, AWS, GCP, or Azure). Excellent stakeholder management and communication skills. A strategic mindset, with a practical More ❯
Employment Type: Permanent, Work From Home
Posted:

Senior Data Engineer

West London, London, United Kingdom
Hybrid / WFH Options
Young's Employment Services Ltd
on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in Python, Pyspark, Scala or Java. Experience operating in a cloud-native environment (e.g. Fabric, AWS, GCP, or Azure). Excellent stakeholder management and communication skills. A strategic mindset, with a practical More ❯
Employment Type: Permanent, Work From Home
Salary: £95,000
Posted:

Data Engineering Manager

West London, London, United Kingdom
Hybrid / WFH Options
Young's Employment Services Ltd
on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in Python, Pyspark, Scala or Java. Experience operating in a cloud-native environment (e.g. Fabric, AWS, GCP, or Azure). Excellent stakeholder management and communication skills. A strategic mindset, with a practical More ❯
Employment Type: Permanent, Work From Home
Posted:

Senior AWS Data Engineer

City of London, London, United Kingdom
Tenth Revolution Group
on data strategy, risk mitigation, and platform evolution. Mentor and develop data engineering talent, fostering a high-performance culture. Requirements: Extensive hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong proficiency in Python and SQL. Proven leadership in data engineering strategy and execution. Deep understanding of market data and its business applications. Experience with More ❯
Employment Type: Permanent
Salary: £120000 - £130000/annum
Posted:

Senior AWS Data Engineer

London, South East, England, United Kingdom
Tenth Revolution Group
on data strategy, risk mitigation, and platform evolution. Mentor and develop data engineering talent, fostering a high-performance culture. Requirements: Extensive hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong proficiency in Python and SQL. Proven leadership in data engineering strategy and execution. Deep understanding of market data and its business applications. Experience with More ❯
Employment Type: Full-Time
Salary: £120,000 - £130,000 per annum
Posted:

Freelance Senior Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Publicis Production
data modeling, data warehousing concepts, and distributed systems. Excellent problem-solving skills and ability to progress with design, build and validate output data independently. Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools. Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure. Strong background in database technologies (SQL Server More ❯
Posted:

Freelance Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Publicis Production
data modeling, data warehousing concepts, and distributed systems. Excellent problem-solving skills and ability to progress with design, build and validate output data independently. Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools. Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure. Strong background in database technologies (SQL Server More ❯
Posted:

Freelance Senior Data Engineer

slough, south east england, united kingdom
Hybrid / WFH Options
Publicis Production
data modeling, data warehousing concepts, and distributed systems. Excellent problem-solving skills and ability to progress with design, build and validate output data independently. Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools. Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure. Strong background in database technologies (SQL Server More ❯
Posted:

Freelance Senior Data Engineer

london, south east england, united kingdom
Hybrid / WFH Options
Publicis Production
data modeling, data warehousing concepts, and distributed systems. Excellent problem-solving skills and ability to progress with design, build and validate output data independently. Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools. Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure. Strong background in database technologies (SQL Server More ❯
Posted:

Freelance Senior Data Engineer

london (city of london), south east england, united kingdom
Hybrid / WFH Options
Publicis Production
data modeling, data warehousing concepts, and distributed systems. Excellent problem-solving skills and ability to progress with design, build and validate output data independently. Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools. Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure. Strong background in database technologies (SQL Server More ❯
Posted:

Lead AWS Data Engineer / Architect - Databricks - London

City of London, London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
an impact, get in touch ASAP as interviews are already taking place. Don't miss out! Key Skills: AWS, Data, Architecture, Data Engineering, Data Warehousing, Data Lakes, Databricks, Glue, Pyspark, Athena, Python, SQL, Machine Learning, London More ❯
Employment Type: Permanent
Salary: £100000 - £130000/annum Bonus, Pension, Healthcare
Posted:

Lead AWS Data Engineer / Architect - Databricks - London

London, South East, England, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
an impact, get in touch ASAP as interviews are already taking place. Don't miss out! Key Skills: AWS, Data, Architecture, Data Engineering, Data Warehousing, Data Lakes, Databricks, Glue, Pyspark, Athena, Python, SQL, Machine Learning, London More ❯
Employment Type: Full-Time
Salary: £100,000 - £130,000 per annum
Posted:

Lead Cloud Data Engineer

Liverpool, Merseyside, North West, United Kingdom
Hybrid / WFH Options
Forward Role
regular company events What you'll need: Solid experience in data engineering, management and analysis Strong experience with Azure Data Warehouse solutions and AWS Databricks platforms Exceptional Python/PySpark + additional languages for data processing Strong SQL with experience across both relational databases (SQL Server, MySQL) and NoSQL solutions (MongoDB, Cassandra) Hands-on knowledge of AWS S3 and More ❯
Employment Type: Permanent, Work From Home
Salary: £70,000
Posted:

Infrastructure/ Platform Engineer Apache

London, United Kingdom
Experis
handling to support monitoring and incident response. ? Align implementations with InfoSum's privacy, security, and compliance practices. Required Skills and Experience: ? Proven experience with Apache Spark (Scala, Java, or PySpark), including performance optimization and advanced tuning techniques. ? Strong troubleshooting skills in production Spark environments, including diagnosing memory usage, shuffles, skew, and executor behavior. ? Experience deploying and managing Spark jobs More ❯
Employment Type: Contract
Posted:

Contract Data Engineer

Rochdale, Greater Manchester, North West, United Kingdom
Hybrid / WFH Options
Footasylum Ltd
knowledge sharing sessions and self-development. About You Experience with finance/financial systems and concepts Azure Databricks Azure Data Factory Excellent SQL skills Good Python/Spark/pyspark skills Experience of Kimball Methodology and star schemas (dimensional model). Experience of working with enterprise data warehouse solutions. Experience of working with structured and unstructured data Experience of More ❯
Employment Type: Contract, Work From Home
Posted:

Lead Azure Data Engineer

London, United Kingdom
Tenth Revolution Group
Drive automation and CI/CD practices across the data platform Explore new technologies to improve data ingestion and self-service Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance More ❯
Employment Type: Contract
Rate: £500 - £600/day
Posted:

Lead Azure Data Engineer

London, South East, England, United Kingdom
Tenth Revolution Group
Drive automation and CI/CD practices across the data platform Explore new technologies to improve data ingestion and self-service Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance More ❯
Employment Type: Contractor
Rate: £500 - £600 per day
Posted:

Data Engineer, Commodities, £135k Extensive Benefits

London, South East, England, United Kingdom
Harvey Nash
It is entering a phase of hardening and re-engineering to enhance the speed, ease, and quality of ingestion across the portfolio. Key Requirements: Strong proficiency in Python and PySpark Successful track history in a Data Engineering role including Database Management (ideally SQL), Data Orchestration (ideally Apache Airflow or Dagster), Containerisation (ideally Kubernetes and Docker) .Data Pipelines (big data More ❯
Employment Type: Full-Time
Salary: £135,000 per annum
Posted:

Azure Data Engineer

Greater London, England, United Kingdom
DVF Recruitment
Microsoft Azure data services (Azure Data Factory, Azure Data Fabric, Azure Synapse Analytics, Azure SQL Database). Experience building ELT/ETL pipelines and managing data workflows. Proficiency in PySpark, Python, SQL, or Scala. Strong data modelling and relational database knowledge. Solid understanding of GDPR and UK data protection. Preferred Power BI experience. Familiarity with legal industry platforms. Awareness More ❯
Posted:

Azure Data Engineer

london, south east england, united kingdom
DVF Recruitment
Microsoft Azure data services (Azure Data Factory, Azure Data Fabric, Azure Synapse Analytics, Azure SQL Database). Experience building ELT/ETL pipelines and managing data workflows. Proficiency in PySpark, Python, SQL, or Scala. Strong data modelling and relational database knowledge. Solid understanding of GDPR and UK data protection. Preferred Power BI experience. Familiarity with legal industry platforms. Awareness More ❯
Posted:

Azure Data Engineer

slough, south east england, united kingdom
DVF Recruitment
Microsoft Azure data services (Azure Data Factory, Azure Data Fabric, Azure Synapse Analytics, Azure SQL Database). Experience building ELT/ETL pipelines and managing data workflows. Proficiency in PySpark, Python, SQL, or Scala. Strong data modelling and relational database knowledge. Solid understanding of GDPR and UK data protection. Preferred Power BI experience. Familiarity with legal industry platforms. Awareness More ❯
Posted:

Data Engineer

Leeds, West Yorkshire, Yorkshire, United Kingdom
Hybrid / WFH Options
Forward Role
financial datasets Python experience, particularly for data processing and ETL workflows Hands-on experience with cloud platforms- Azure Experience designing and maintaining data pipelines using tools like Databricks and PySpark Knowledge of data warehousing solutions - Snowflake experience would be brilliant Understanding of CI/CD processes for deploying data solutions Some exposure to big data technologies and distributed processing More ❯
Employment Type: Permanent, Work From Home
Salary: £55,000
Posted:

Senior Data Engineer

City of London, London, United Kingdom
KDR Talent Solutions
within Microsoft Azure data tools (Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling expertise for analytics use cases. ✅ Strong ETL/ELT development skills. ✅ Python/Pyspark experience ✅ Experience with CI/CD methodologies for data platforms. ✅ Deep knowledge of SQL ✅ Extensive London Markets experience Why Join? 🚀 New Projects – Work on a new data platform, shaping More ❯
Posted:

Senior Data Engineer

London Area, United Kingdom
KDR Talent Solutions
within Microsoft Azure data tools (Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling expertise for analytics use cases. ✅ Strong ETL/ELT development skills. ✅ Python/Pyspark experience ✅ Experience with CI/CD methodologies for data platforms. ✅ Deep knowledge of SQL ✅ Extensive London Markets experience Why Join? 🚀 New Projects – Work on a new data platform, shaping More ❯
Posted:
PySpark
England
10th Percentile
£42,500
25th Percentile
£51,250
Median
£67,500
75th Percentile
£87,500
90th Percentile
£110,500