126 to 150 of 151 PySpark Jobs in England

**Take the lead on meaningful, high-impact projects as a Senior Data Engineer.** We are seeking a Senior Data Engineer to join a growing organisation based in London, offering a hybrid work model. This role ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

Principal Consultant - Lead Data Analyst/Data Modeller Company: Transform Together Contract: 6-month Fixed Term Contract, with option to extend or become a permanent member of the team Compensation: OTE £90,000 Location: Hybrid ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

adoption of modern data mesh principles across complex enterprise environments. What You'll Be Doing Architect and deliver modern data solutions using Databricks, Spark, PySpark and SQL Design scalable batch and real-time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based … making Provide technical leadership and architectural direction on large-scale transformation programmes Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good ...

environment Technical SkillsYou’ll have experience with some of the following:Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you’ve held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

grounding in applied statistics (hypothesis testing, experiment design, uncertainty analysis)Proven experience with both static and time series modellingAdvanced skills in Python, SQL, and PySpark, with a focus on clean, testable, reproducible codeExperience deploying models in cloud environments (Azure preferred), including CI/CD and monitoringStrong communication skills—able … grounding in applied statistics (hypothesis testing, experiment design, uncertainty analysis)Proven experience with both static and time series modellingAdvanced skills in Python, SQL, and PySpark, with a focus on clean, testable, reproducible codeExperience deploying models in cloud environments (Azure preferred), including CI/CD and monitoringStrong communication skills—able ...

grounding in applied statistics (hypothesis testing, experiment design, uncertainty analysis)Proven experience with both static and time series modellingAdvanced skills in Python, SQL, and PySpark, with a focus on clean, testable, reproducible codeExperience deploying models in cloud environments (Azure preferred), including CI/CD and monitoringStrong communication skills—able … grounding in applied statistics (hypothesis testing, experiment design, uncertainty analysis)Proven experience with both static and time series modellingAdvanced skills in Python, SQL, and PySpark, with a focus on clean, testable, reproducible codeExperience deploying models in cloud environments (Azure preferred), including CI/CD and monitoringStrong communication skills—able ...

grounding in applied statistics (hypothesis testing, experiment design, uncertainty analysis)Proven experience with both static and time series modellingAdvanced skills in Python, SQL, and PySpark, with a focus on clean, testable, reproducible codeExperience deploying models in cloud environments (Azure preferred), including CI/CD and monitoringStrong communication skills—able … grounding in applied statistics (hypothesis testing, experiment design, uncertainty analysis)Proven experience with both static and time series modellingAdvanced skills in Python, SQL, and PySpark, with a focus on clean, testable, reproducible codeExperience deploying models in cloud environments (Azure preferred), including CI/CD and monitoringStrong communication skills—able ...

within the Lloyd’s marketplace Good understanding of tools and platforms used across the Lloyd’s insurance ecosystem Architect and optimize data solutions using PySpark and Datamart (GOS – Oracle as a Service). Develop and maintain data platforms leveraging Snowflake and Azure services (Blob Storage, Data Lake, Synapse Analytics … standards and best practices. Requirements: Proven experience in data engineering and architecture with strong expertise in ETL/ELT processes. Hands-on experience with PySpark, Snowflake, and Oracle-based data solutions. Proficiency in Azure ecosystem: Blob Storage, Data Lake, Synapse Analytics, Databricks, Functions, and Monitor. Strong understanding of data ...

required for the domain's data products, using the tools and guardrails provided by the Enablement team. Expected Skills : Advanced coding in Python and PySpark, strong SQL, expertise in building declarative pipelines (eg; Delta Live Tables), version control (Git), automated testing (eg; Pytest), and CI/CD deployment practices … automate data pipelines to ingest, transform, and model data specific to the squad's use cases. Write structured, scalable code (eg; Python/PySpark/SQL) and apply software engineering best practices, including version control (Git) and automated testing. Work closely with the Platform Enablement team to package their ...

data setsProgramming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-haveStrong understanding of machine learning methods and experience applying them … technologies into production or applied business environments is a plusWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

Data Scientist Slough - 2 days per week Up to £520 per day - inside IR35 Initial 6 month contract SQL/Python/PySpark/NLP/Gen AI/Azure This is a hands-on Data Scientist role within the Journey Insights team, focused on building and delivering data … techniques, including text classification, summarisation, entity extraction, embeddings, retrieval-augmented generation (RAG) and LLM-enabled workflows Strong programming expertise in SQL, Python and PySpark, applying software engineering best practices such as code readability, version control, testing and reproducibility Experience deploying data science models and products in cloud environments, ideally ...

Data Scientist (Python, PySpark, Healthcare Analytics) Contract: Initial 2 Months (Mid-September – Mid-November) Location: Remote (UK) with 1 day per week in London (2–3 days preferred) We are seeking an experienced Data Scientist to join a high-profile digital transformation programme focused on building innovative products … Work with large and complex datasets to generate actionable insights. Required Skills Strong commercial experience as a Data Scientist. Expert knowledge of Python and PySpark (essential). Experience designing and building analytics/data pipelines. Strong SQL skills and experience working with large datasets. Experience developing and deploying machine ...

Logging, tracking and managing defects through to resolution Contributing to testing strategies, quality frameworks and continuous improvement initiatives Supporting testing activities within Databricks and PySpark environments SKILLS AND EXPERIENCE The successful Data QA Engineer will have the following skills and experience: Experience in a Data QA, Software Testing … Quality Assurance role Strong experience testing data platforms, pipelines and data products Hands-on experience with Databricks, SQL, Python and PySpark Strong stakeholder communication and collaboration skills Able to work independently and take ownership of testing activities and quality standards BENEFITS The successful Data QA Engineer will receive ...

Logging, tracking and managing defects through to resolution Contributing to testing strategies, quality frameworks and continuous improvement initiatives Supporting testing activities within Databricks and PySpark environments SKILLS AND EXPERIENCE The successful Data QA Engineer will have the following skills and experience: Experience in a Data QA, Software Testing … Quality Assurance role Strong experience testing data platforms, pipelines and data products Hands-on experience with Databricks, SQL, Python and PySpark Strong stakeholder communication and collaboration skills Able to work independently and take ownership of testing activities and quality standards BENEFITS The successful Data QA Engineer will receive ...

Logging, tracking and managing defects through to resolution Contributing to testing strategies, quality frameworks and continuous improvement initiatives Supporting testing activities within Databricks and PySpark environments SKILLS AND EXPERIENCE The successful Data QA Engineer will have the following skills and experience: Experience in a Data QA, Software Testing … Quality Assurance role Strong experience testing data platforms, pipelines and data products Hands-on experience with Databricks, SQL, Python and PySpark Strong stakeholder communication and collaboration skills Able to work independently and take ownership of testing activities and quality standards BENEFITS The successful Data QA Engineer will receive ...

Logging, tracking and managing defects through to resolution Contributing to testing strategies, quality frameworks and continuous improvement initiatives Supporting testing activities within Databricks and PySpark environments SKILLS AND EXPERIENCE The successful Data QA Engineer will have the following skills and experience: Experience in a Data QA, Software Testing … Quality Assurance role Strong experience testing data platforms, pipelines and data products Hands-on experience with Databricks, SQL, Python and PySpark Strong stakeholder communication and collaboration skills Able to work independently and take ownership of testing activities and quality standards BENEFITS The successful Data QA Engineer will receive ...

pricing models with advanced data science techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers … Street Pricing. What we’re looking for: Experience in general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics ...

structured investigations or prototypes.Curiosity and a learning mindset — tracking state-of-the-art advancements and evaluating their relevance.Strong data manipulation and engineering skills (e.g., PySpark, SQL, cloud-based data tooling).Strong communication skills, capable of explaining complex ideas to technical and non-technical audiences.Collaborative approach to working with … publications, workshops, industry collaborations).Familiarity with vector databases, embeddings, and retrieval techniques.Experience Working on large datasets (efficient loading, batching, and streaming) and related tooling (PySpark preferred).What you can expect from usWe won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards ...

prototypes. Curiosity and a learning mindset - tracking state-of-the-art advancements and evaluating their relevance. Strong data manipulation and engineering skills (e.g., PySpark, SQL, cloud-based data tooling). Strong communication skills, capable of explaining complex ideas to technical and non-technical audiences. Collaborative approach to working with … industry collaborations). Familiarity with vector databases, embeddings, and retrieval techniques. Experience Working on large datasets (efficient loading, batching, and streaming) and related tooling (PySpark preferred). What you can expect from us We won't just meet your expectations. We'll defy them. So you'll enjoy ...

well as familiarity with software engineering best practices (such as version control, unit testing, CI/CD) and big data and cloud technologies (PySpark preferred). Experience training and deploying deep learning models in cloud environments (including GPU-enabled workflows) is a strong advantage.About us: Our vision at Tesco … well as familiarity with software engineering best practices (such as version control, unit testing, CI/CD) and big data and cloud technologies (PySpark preferred). Experience training and deploying deep learning models in cloud environments (including GPU-enabled workflows) is a strong advantage. About us Our vision ...

champion best practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … insurance pricing. Strong technical expertise in predictive modelling techniques (e.g. GLMs and machine learning models). Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software and optimisation tools. A quantitative degree ...

custom data products — from client scoping and solution design to execution and ongoing delivery.Ensure high analytical and technical standards across the team, including SQL, PySpark, Python, and data validation best practices.Act as an escalation point for complex analytical challenges, providing hands-on guidance where needed.Partner closely with Engineering … perfect job for someone who has:Proven experience managing and mentoring data analysts or analytics teams.Strong hands-on experience with SQL and PySpark for data analysis — Must.Strong Python scripting experience — Must.Excellent communication skills in English, with the ability to translate complex analysis into clear business insights.Experience working directly with ...