51 to 75 of 92 PySpark Jobs in England

Senior Data Engineer

Hiring Organisation
Adecco
Location
Solihull, West Midlands, West Midlands (County), United Kingdom
Employment Type
Contract
Contract Rate
£550 - £650/day Inside IR35
assure enterprise-aligned data integration architectures Optimise cloud platforms (Azure, AWS, Databricks) for performance and cost Build and own ETL/ELT pipelines using PySpark, SQL and orchestration frameworks Automate and modernise legacy data processes with reusable patterns Design robust data models (Delta Lake, schema evolution, metadata, lineage) Ensure … reviews Collaborate with stakeholders to translate complex technical decisions clearly Support strategic roadmap, tooling and continuous improvement initiatives Core Skills & Expertise Data Engineering Advanced PySpark and SQL, performance tuning and best practice coding Data modelling (conceptual, logical, physical) and integration design Data quality, testing frameworks and automated validation Strong ...

QA Engineer

Hiring Organisation
Sagacity
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
experience with Databricks — running queries, navigating Unity Catalog, reading Spark job outputs and understanding what they mean for data quality Working knowledge of PySpark or Spark SQL — enough to read pipeline code, understand transformations, and trace where data issues originate Understanding of Lakehouse/medallion architecture (bronze-silver-gold ...

Principal Data Engineer

Hiring Organisation
WRK DIGITAL LTD
Location
Leeds, West Yorkshire, Yorkshire, United Kingdom
Employment Type
Permanent
Salary
£85,000
architectures with a focus on automation, performance tuning, cost optimisation, and system reliability. Proven proficiency in programming languages such as Python, T-SQL, and PySpark, with practical knowledge of test-driven development. Demonstrated capability in building secure, scalable data solutions on Azure with an in-depth understanding of data ...

Data Engineer

Hiring Organisation
IMServ Europe Ltd
Location
MK14, Great Linford, Milton Keynes, Buckinghamshire, United Kingdom
Employment Type
Permanent
Salary
£55000 - £60000/annum
ongoing basis. Contribute to the planning, research, recommendation, and implementation of current and future IT strategies. PERSON SPECIFICATION: Essential Demonstrable experience of Spark (PySpark) and SQL. Demonstrable experience of Fabric components. Demonstrable experience of working on enterprise environments. Experience of designing architectural Fabric processes. Experience of Azure Data Factory. ...

Staff Machine Learning Scientist - Core ML

Hiring Organisation
Jobleads-UK
Location
Greater London, England, United Kingdom
experiment design and conducting A/B tests Bonus Points – Experience building shared or platform‐style ML systems Bonus Points – Experience with Databricks and PySpark Bonus Points – Experience working with AWS or another cloud platform (GCP/Azure) Additional Information Health + Mental Wellbeing: PMI and cash plan healthcare ...

AI Instructor

Hiring Organisation
Multiverse
Location
London, United Kingdom
Employment Type
Permanent, Work From Home
qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

AI Instructor

Hiring Organisation
Multiverse
Location
Manchester, North West, United Kingdom
Employment Type
Permanent, Work From Home
qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

AI Instructor

Hiring Organisation
Multiverse
Location
Leeds, West Yorkshire, Yorkshire, United Kingdom
Employment Type
Permanent, Work From Home
qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

AI Instructor

Hiring Organisation
Multiverse
Location
Bristol, Avon, South West, United Kingdom
Employment Type
Permanent, Work From Home
qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

Senior Consulting Engineer

Hiring Organisation
Anson Mccade
Location
City of London, London, United Kingdom
Employment Type
Permanent
Salary
£65,000
impact. Key Responsibilities Design and deliver end-to-end technical solutions across complex data environments Build and maintain applications using technologies such as Python, PySpark, TypeScript, and React Develop AI-driven workflows and operational tooling Work directly with client stakeholders in fast-paced delivery environments Present demos, gather feedback ...

Data Analyst - Customer & Product Analytics

Hiring Organisation
Randstad Technologies Recruitment
Location
Manchester, United Kingdom
Employment Type
Contract
Contract Rate
£50 - £66/hour
team What We're Looking For Proven experience in Data Analytics or a similar role Strong SQL skills and experience with Python/PySpark Experience with data visualisation tools (e.g. Tableau, Power BI) Hands-on experience with A/B testing and experimentation Familiarity with customer analytics tools (e.g. ...

Machine Learning Engineer

Hiring Organisation
Vermelo RPO
Location
Manchester, Lancashire, England, United Kingdom
Employment Type
Full-Time
Salary
Salary negotiable
Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

Machine Learning Scientist

Hiring Organisation
Jobleads-UK
Location
Greater London, England, United Kingdom
recommendation models Experience with deep learning & large language models Experience with experiment design and conducting A/B tests Experience with Databricks and PySpark Experience working with AWS or another cloud platform (GCP/Azure) Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with Bupa ...

Head of Machine Learning Engineering

Hiring Organisation
Jobleads-UK
Location
Greater London, England, United Kingdom
similarly complex digital platforms Our technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More ...

Senior Threat Hunter

Hiring Organisation
Sky
Location
Middlesex, south east england, united kingdom
between security and broader technology teams to demonstrably improve the overall security posture. Desirable skills and experience: Scripting and automation capabilities, particularly utilising Python, PySpark, and SQL to streamline analytical workflows. Experience navigating cloud-native security environments (AWS, Azure, or GCP) alongside familiarity with the Microsoft 365 ecosystem. Advanced ...

Data Platform Manager

Hiring Organisation
Deerfoot Recruitment Solutions Ltd
Location
Luton, Bedfordshire, England, United Kingdom
Employment Type
Full-Time
Salary
£65,000 - £75,000 per annum
datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planningProvide hands-on data engineering expertise, building and optimising PySpark pipelinesEnsure data is secure, high-quality, accessible, and structured for maximum business valueDrive best practice in data governance, cataloguing, lineage, and standards across … operations, analytics, and reporting teamsEnsure compliance with data protection regulations and internal policiesWhat you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelinesExperience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS)Proven ability to design and manage scalable data pipelines ...

Data Platform Manager

Hiring Organisation
Deerfoot Recruitment Solutions
Location
Luton, Bedfordshire, South East, United Kingdom
Employment Type
Permanent
Salary
£75,000
migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise, building and optimising PySpark pipelines Ensure data is secure, high-quality, accessible, and structured for maximum business value Drive best practice in data governance, cataloguing, lineage, and standards … reporting teams Ensure compliance with data protection regulations and internal policies What you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelines Experience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS) Proven ability to design and manage scalable data pipelines ...

AI Technical Architect

Hiring Organisation
Randstad Digital
Location
City of London, London, United Kingdom
Employment Type
Contract, Work From Home
Contract Rate
£500 - £600 per day
complex technical architectures. Essential Skills Clearance: Active UK Government Security Check (SC). GenAI: Expertise in LLMs and RAG architectures. Python: Strong proficiency alongside PySpark for data engineering. Azure: Deep familiarity with native tools (AI Search, Document Intelligence). MLOps: Understanding of LLMOps frameworks for production deployment. 6 Months ...

Platform Engineer (AWS / Databricks)

Hiring Organisation
Syntax Consultancy Ltd
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£600/day 600/day (Inside IR35)
connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions. ...

Staff Data Engineer

Hiring Organisation
Data Idols
Location
London, United Kingdom
Employment Type
Permanent
Salary
£85000 - £95000/annum
engineering is done across the organisation. Skills & Experience Strong hands-on experience with Azure data platforms Advanced SQL skills Commercial experience using Databricks and PySpark Proven background building and maintaining scalable data pipelines If you're looking for a role where you can combine technical depth, ownership, and influence ...

Data Engineer

Hiring Organisation
Talent Smart
Location
S1, Sheffield, South Yorkshire, United Kingdom
Employment Type
Contract
Contract Rate
£500 - £600/day
Inside IR35 Initial 6-month engagement Sheffield-based, 3 days per week on-site Key Requirements: Strong hands-on experience with PySpark and Databricks Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions Proven ability to troubleshoot and resolve Spark job performance ...

Data Engineer

Hiring Organisation
Gold Group
Location
City, London, United Kingdom
Employment Type
Contract
Contract Rate
GBP 55,000 - 60,000 Annual
ownership of data pipelines and automation of data workflows. Finally have 5 years Strong programming experience at an advanced level in Python, PySpark, and SQL scripting. Benefits Salary: 55,000 - 60,000 per annum 25 day's holiday Company car/Allowance Private medical insurance Variable annual bonus based … leveraging tools such as Foundry Code Workbooks, Pipelines, and Object Explorer for efficient data processing and integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability ...

Remote AI Technical Architect - Azure OpenAI, PySpark Lead

Hiring Organisation
Jobleads-UK
Location
Greater London, England, United Kingdom
Sivara GmbH is seeking a Lead AI Technical Architect for a remote 6-month contract in the UK, with high potential for extension. This role emphasizes technical governance and mentoring in AI solutions within the ...

Lead Data Engineering (Hands-on Python / Databricks)

Hiring Organisation
Adecco
Location
London, United Kingdom
Employment Type
Contract
Job Title: Technical Delivery Lead - Data Engineering Lead (Hands-on Python/Databricks) Contract: 6 months - Potentially extension. Location: London Hybrid (5 days in 10 in the office) Rate: Highly competitive Status: Inside IR35 Working ...

Senior Data Platform Engineer - HYBRID

Hiring Organisation
Proactive Appointments
Location
Surrey, England, United Kingdom
Employment Type
Full-Time
Salary
£70,000 - £80,000 per annum
Azure platform — including infrastructure-as-code (Pulumi), CI/CD automation, monitoring, security, and Databricks workspace administration. The ideal candidate combines strong Python/PySpark engineering skills with deep Azure platform knowledge and a service-excellence mindset. Duties and Responsibilities Lead solution design activities, collaborating with peers and mentoring … Databricks: hands-on experience building and optimizing pipelines, managing Delta Lake, and administering workspaces (cluster policies, Unity Catalog, Secret Scopes, Workflows). Python/PySpark: strong programming skills for data processing, automation, and scripting. Azure data stack: Synapse, Databricks, ADLS Gen2, Key Vault — including Linked Services, Managed Identity ...