PySpark Jobs in Manchester

21 of 21 PySpark Jobs in Manchester

Test Engineer

Manchester, Lancashire, England, United Kingdom
True North Group
data services – Databricks, ADF, ADLS, Power BI. Proficiency in SQL and data profiling for test design and validation. Hands-on experience with test automation frameworks such as Python/PySpark, Great Expectations, Pytest, or dbt tests. Practical understanding of CI/CD integration (Azure DevOps, GitHub Actions, or similar). Strong problem-solving skills and the ability to work More ❯
Employment Type: Contractor
Rate: Competitive salary
Posted:

Senior Data Engineer

Manchester Area, United Kingdom
Scrumconnect Consulting
Experience Active SC Clearance (mandatory at application stage). Proven expertise in: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure ecosystem Power BI (including semantic models) Python (incl. PySpark) and advanced SQL dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Strong experience with both structured and unstructured data. Delivery track More ❯
Posted:

Senior Data Engineer

bolton, greater manchester, north west england, united kingdom
Scrumconnect Consulting
Experience Active SC Clearance (mandatory at application stage). Proven expertise in: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure ecosystem Power BI (including semantic models) Python (incl. PySpark) and advanced SQL dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Strong experience with both structured and unstructured data. Delivery track More ❯
Posted:

Senior Data Engineer - UK based - Remote/Hybrid - £75-95k DOE + Equity

Altrincham, Greater Manchester, United Kingdom
Hybrid / WFH Options
Futureheads Recruitment | B Corp™
while establishing and maintaining best practices for data governance, security, and reliability. What we’re looking for: 5+ years’ experience in data engineering and cloud infrastructure Expertise in Python (PySpark), SQL, and dbt (or similar) Strong DevOps skills: Terraform, Docker, CI/CD, monitoring/logging tools AWS experience: S3, ECS/Fargate, RDS, Lambda Data warehousing experience (PostgreSQL More ❯
Posted:

Senior Data Engineer - UK based - Remote/Hybrid - £75-95k DOE + Equity

Leigh, Greater Manchester, United Kingdom
Hybrid / WFH Options
Futureheads Recruitment | B Corp™
while establishing and maintaining best practices for data governance, security, and reliability. What we’re looking for: 5+ years’ experience in data engineering and cloud infrastructure Expertise in Python (PySpark), SQL, and dbt (or similar) Strong DevOps skills: Terraform, Docker, CI/CD, monitoring/logging tools AWS experience: S3, ECS/Fargate, RDS, Lambda Data warehousing experience (PostgreSQL More ❯
Posted:

Senior Data Engineer - UK based - Remote/Hybrid - £75-95k DOE + Equity

Bolton, Greater Manchester, United Kingdom
Hybrid / WFH Options
Futureheads Recruitment | B Corp™
while establishing and maintaining best practices for data governance, security, and reliability. What we’re looking for: 5+ years’ experience in data engineering and cloud infrastructure Expertise in Python (PySpark), SQL, and dbt (or similar) Strong DevOps skills: Terraform, Docker, CI/CD, monitoring/logging tools AWS experience: S3, ECS/Fargate, RDS, Lambda Data warehousing experience (PostgreSQL More ❯
Posted:

Senior Data Engineer - UK based - Remote/Hybrid - £75-95k DOE + Equity

Bury, Greater Manchester, United Kingdom
Hybrid / WFH Options
Futureheads Recruitment | B Corp™
while establishing and maintaining best practices for data governance, security, and reliability. What we’re looking for: 5+ years’ experience in data engineering and cloud infrastructure Expertise in Python (PySpark), SQL, and dbt (or similar) Strong DevOps skills: Terraform, Docker, CI/CD, monitoring/logging tools AWS experience: S3, ECS/Fargate, RDS, Lambda Data warehousing experience (PostgreSQL More ❯
Posted:

Senior Data Engineer - UK based - Remote/Hybrid - £75-95k DOE + Equity

Ashton-Under-Lyne, Greater Manchester, United Kingdom
Hybrid / WFH Options
Futureheads Recruitment | B Corp™
while establishing and maintaining best practices for data governance, security, and reliability. What we’re looking for: 5+ years’ experience in data engineering and cloud infrastructure Expertise in Python (PySpark), SQL, and dbt (or similar) Strong DevOps skills: Terraform, Docker, CI/CD, monitoring/logging tools AWS experience: S3, ECS/Fargate, RDS, Lambda Data warehousing experience (PostgreSQL More ❯
Posted:

Senior Data Engineer - Manchester Hybrid / £50,000

Manchester, Lancashire, England, United Kingdom
Hybrid / WFH Options
Oliver James
Deliver end-to-end BI solutions using Azure Synapse, ADF, and Power BI (Datasets & Reports) Design and implement scalable data models and architectures Develop robust pipelines using SQL, Python (PySpark), and ideally other OOP languages Manage CI/CD processes using Git and modern deployment tools Debug, monitor, and optimize BI solutions across Microsoft's stack, including legacy tools More ❯
Employment Type: Full-Time
Salary: Salary negotiable
Posted:

Senior AWS Data Engineer

Manchester, Lancashire, England, United Kingdom
Hybrid / WFH Options
Lorien
Excellent understanding of AWS Data Platforms, with services such as AWS Glue, S3, Lambda, Redshift, etc. Good understanding of management principles for data pipelines and ETL Good Python and PySpark Use of SQL Data platforms If you have experience migrating from an on-premise to cloud based solution this would be a bonus Excellent cross-team collaboration skills Ability More ❯
Employment Type: Full-Time
Salary: £70,000 - £80,000 per annum
Posted:

Data Engineer

Manchester, England, United Kingdom
Capgemini
front-end development (HTML, Stream-lit, Flask.) Familiarity with model deployment and monitoring in cloud environments (AWS). Understanding of machine learning lifecycle and data pipelines. Proficiency with Python, Pyspark, Big-data ecosystems Hands-on experience with MLOps tools (e.g., MLflow, Airflow, Docker, Kubernetes) Secondary Skill : Experience with RESTful APIs and integrating backend services ABOUT CAPGEMINI Capgemini is a More ❯
Posted:

Data Engineer

bolton, greater manchester, north west england, united kingdom
Capgemini
front-end development (HTML, Stream-lit, Flask.) Familiarity with model deployment and monitoring in cloud environments (AWS). Understanding of machine learning lifecycle and data pipelines. Proficiency with Python, Pyspark, Big-data ecosystems Hands-on experience with MLOps tools (e.g., MLflow, Airflow, Docker, Kubernetes) Secondary Skill : Experience with RESTful APIs and integrating backend services ABOUT CAPGEMINI Capgemini is a More ❯
Posted:

Technical Lead - AWS Engineering

Manchester, North West, United Kingdom
Hybrid / WFH Options
Hays
within a cross-functional environment. Experience in line management or team leadership, with a track record of developing and supporting engineers. AWS (Lambda, Glue, ECS, S3, etc.) Python and PySpark (data pipelines, APIs, automation) TypeScript and React (frontend development) Excellent communication and stakeholder management skills. Demonstrated expertise in technical design and architecture of distributed systems. Familiarity with fraud detection More ❯
Employment Type: Permanent, Work From Home
Posted:

Technical Lead - AWS Engineering

Manchester, Lancashire, England, United Kingdom
Hybrid / WFH Options
Hays Specialist Recruitment Limited
within a cross-functional environment. Experience in line management or team leadership, with a track record of developing and supporting engineers. AWS?(Lambda, Glue, ECS, S3, etc.) Python and PySpark?(data pipelines, APIs, automation) TypeScript and React?(frontend development) Excellent communication and stakeholder management skills. Demonstrated expertise in technical design and architecture of distributed systems. Familiarity with fraud detection More ❯
Employment Type: Full-Time
Salary: £90,000 - £110,000 per annum
Posted:

Lead Data Science (Bangkok based, Relocation provided, Visa Sponsorship Available)

Manchester, Lancashire, United Kingdom
Techwaka
understanding of AI/ML/DL and Statistics, as well as coding proficiency using related open source libraries and frameworks. Significant proficiency in SQL and languages like Python, PySpark and/or Scala. Can lead, work independently as well as play a key role in a team. Good communication and interpersonal skills for working in a multicultural work More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Pricing Manager

Manchester, Lancashire, England, United Kingdom
Hybrid / WFH Options
Vermelo RPO
Knowledge of the technical differences between different packages for some of these model types would be an advantage. Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software is preferred Proficient at communicating results in a concise More ❯
Employment Type: Full-Time
Salary: Salary negotiable
Posted:

Pricing Manager

Manchester, North West, United Kingdom
Hybrid / WFH Options
Gerrard White
Knowledge of the technical differences between different packages for some of these model types would be an advantage. Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW's Radar software is preferred Proficient at communicating results in a concise More ❯
Employment Type: Permanent, Work From Home
Posted:

Pricing Manager

bolton, greater manchester, north west england, united kingdom
Hybrid / WFH Options
Gerrard White
Knowledge of the technical differences between different packages for some of these model types would be an advantage. Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW's Radar software is preferred Proficient at communicating results in a concise More ❯
Posted:

AWS Data Engineer

Manchester, Lancashire, England, United Kingdom
Hybrid / WFH Options
Lorien
s passionate about building scalable, cloud-native data platforms. You'll be a key player in a growing team, helping to shape the future of data infrastructure using AWS, PySpark, Iceberg, and more. From designing high-performance pipelines to supporting a full-scale migration from SQL Server to AWS, this role offers the chance to work on real-time … practices Staying ahead of the curve with emerging data technologies What You'll Bring: Solid hands-on experience with AWS (Glue, Lambda, S3, Redshift, EMR) Strong Python, SQL, and PySpark skills Deep understanding of data warehousing and lakehouse concepts Problem-solving mindset with a focus on performance and scalability Excellent communication skills across technical and non-technical teams Familiarity More ❯
Employment Type: Full-Time
Salary: £45,000 - £55,000 per annum
Posted:

Platform Engineer

Manchester Area, United Kingdom
TalkTalk
source of truth. Develop and optimise CI/CD pipelines in Azure DevOps to automate deployment of workspaces, Unity Catalog, networking, and security. Work with Databricks (Spark/Scala, PySpark) to support ingestion frameworks, data processing, and platform-level libraries. Implement secure connectivity (VNET injection, Private Link, firewall, DNS, RBAC). Monitor, troubleshoot, and optimise platform reliability and performance. … processes, and standards for wider engineering adoption. Must Have: Proven expertise with Microsoft Azure (networking, security, storage, compute). Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark . Deep experience with Terraform for Azure resource deployment and governance. Hands-on with Azure DevOps pipelines (YAML, agents, service connections). Understanding of Azure Active Directory/Entra More ❯
Posted:

Platform Engineer

bolton, greater manchester, north west england, united kingdom
TalkTalk
source of truth. Develop and optimise CI/CD pipelines in Azure DevOps to automate deployment of workspaces, Unity Catalog, networking, and security. Work with Databricks (Spark/Scala, PySpark) to support ingestion frameworks, data processing, and platform-level libraries. Implement secure connectivity (VNET injection, Private Link, firewall, DNS, RBAC). Monitor, troubleshoot, and optimise platform reliability and performance. … processes, and standards for wider engineering adoption. Must Have: Proven expertise with Microsoft Azure (networking, security, storage, compute). Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark . Deep experience with Terraform for Azure resource deployment and governance. Hands-on with Azure DevOps pipelines (YAML, agents, service connections). Understanding of Azure Active Directory/Entra More ❯
Posted:
PySpark
Manchester
25th Percentile
£47,500
Median
£60,000
75th Percentile
£67,500
90th Percentile
£69,000