PySpark Jobs in the North of England

1 to 25 of 102 PySpark Jobs in the North of England

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics

Wakefield, Yorkshire, United Kingdom
Hybrid / WFH Options
Flippa.com
/CD) automation, rigorous code reviews, documentation as communication. Preferred Qualifications Familiar with data manipulation and experience with Python libraries like Flask, FastAPI, Pandas, PySpark, PyTorch, to name a few. Proficiency in statistics and/or machine learning libraries like NumPy, matplotlib, seaborn, scikit-learn, etc. Experience in building More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior DataOps Engineer

Leeds, West Yorkshire, Yorkshire, United Kingdom
Peregrine
Delta Lake, Azure SQL, Purview and APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline More ❯
Employment Type: Permanent
Posted:

Senior DataOps Engineer

bradford, yorkshire and the humber, united kingdom
Peregrine
Delta Lake, Azure SQL, Purview and APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline More ❯
Posted:

Principal Data Engineer (Closing Date - 30 May 2025)

Leeds, United Kingdom
慨正橡扯
architectures with a focus on automation, performance tuning, cost optimisation, and system reliability. Proven proficiency in programming languages such as Python, T-SQL, and PySpark, with practical knowledge of test-driven development. Demonstrated capability in building secure, scalable data solutions on Azure with an in-depth understanding of data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Engineer

Manchester, United Kingdom
Adria Solutions Ltd
Experience: Strong proficiency in SQL and Python. Experience in cloud data solutions (AWS, GCP, or Azure). Experience in AI/ML. Experience with PySpark or equivalent. Strong problem-solving and analytical skills. Excellent attention to detail. Ability to manage stakeholder relationships effectively. Strong communication skills and a collaborative More ❯
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Senior Data Engineer

Wigan, England, United Kingdom
G.Digital
backend development focused on data platforms. Strong hands-on experience with AWS services, especially Glue, Athena, Lambda, and S3 . Proficient in Python (ideally PySpark) and modular SQL for transformations and orchestration. Solid grasp of data modeling (partitioning, file formats like Parquet, etc.). Comfort with CI/CD More ❯
Posted:

Senior Data Engineer

manchester, north west england, united kingdom
G.Digital
backend development focused on data platforms. Strong hands-on experience with AWS services, especially Glue, Athena, Lambda, and S3 . Proficient in Python (ideally PySpark) and modular SQL for transformations and orchestration. Solid grasp of data modeling (partitioning, file formats like Parquet, etc.). Comfort with CI/CD More ❯
Posted:

Senior Data Engineer (Wigan)

Wigan, Greater Manchester, UK
G.Digital
backend development focused on data platforms. Strong hands-on experience with AWS services, especially Glue, Athena, Lambda, and S3 . Proficient in Python (ideally PySpark) and modular SQL for transformations and orchestration. Solid grasp of data modeling (partitioning, file formats like Parquet, etc.). Comfort with CI/CD More ❯
Posted:

Senior Data Engineer (Wigan)

Pemberton, Greater Manchester, UK
G.Digital
backend development focused on data platforms. Strong hands-on experience with AWS services, especially Glue, Athena, Lambda, and S3 . Proficient in Python (ideally PySpark) and modular SQL for transformations and orchestration. Solid grasp of data modeling (partitioning, file formats like Parquet, etc.). Comfort with CI/CD More ❯
Employment Type: Part-time
Posted:

Data Engineer (Leeds)

Leeds, UK
iO Associates - UK/EU
e.g., Synapse, Data Lakes, ADF) Strong background in data modelling, ETL/ELT processes, and data integration Proficiency in SQL and Python (ideally with PySpark) Familiarity with Power BI, Microsoft Fabric, and CI/CD tools like Azure DevOps Experience working with enterprise data sources and APIs (e.g., Salesforce More ❯
Posted:

Data Engineer

Leeds, England, United Kingdom
iO Associates - UK/EU
e.g., Synapse, Data Lakes, ADF) Strong background in data modelling, ETL/ELT processes, and data integration Proficiency in SQL and Python (ideally with PySpark) Familiarity with Power BI, Microsoft Fabric, and CI/CD tools like Azure DevOps Experience working with enterprise data sources and APIs (e.g., Salesforce More ❯
Posted:

Data Engineer

bradford, yorkshire and the humber, united kingdom
iO Associates - UK/EU
e.g., Synapse, Data Lakes, ADF) Strong background in data modelling, ETL/ELT processes, and data integration Proficiency in SQL and Python (ideally with PySpark) Familiarity with Power BI, Microsoft Fabric, and CI/CD tools like Azure DevOps Experience working with enterprise data sources and APIs (e.g., Salesforce More ❯
Posted:

Senior Data Engineer

doncaster, yorkshire and the humber, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

bradford, yorkshire and the humber, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

wakefield, yorkshire and the humber, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

york, yorkshire and the humber, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

manchester, north west england, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

chester, north west england, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

aberdeen, north east scotland, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

liverpool, north west england, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

sheffield, south yorkshire, yorkshire and the humber, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

leeds, west yorkshire, yorkshire and the humber, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

stockport, north west england, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

warrington, cheshire, north west england, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:

Senior Data Engineer

preston, lancashire, north west england, united kingdom
Insight Global
Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient with SQL Proven More ❯
Posted:
PySpark
the North of England
10th Percentile
£58,250
25th Percentile
£61,250
Median
£70,000
75th Percentile
£77,500
90th Percentile
£80,500