301 to 325 of 334 PySpark Jobs in the UK

Lead Engineer - Data / Java / Python

Location
Glasgow, Scotland, United Kingdom
contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

Senior Data Scientist

Location
Greater London, England, United Kingdom
verbal communication skills, including the ability to explain complex methodology to diverse audiences. You might also have Familiarity with Databricks, DBT, Spark/PySpark, or similar large‐scale data platforms. Modified infrastructure‐as‐code (e.g. Terraform) or contributing to production data pipelines. Mentored junior data scientists or engineers. Knowledge … passion for, the cryptocurrency and blockchain space. Technologies we use Python SQL Databricks DBT PySpark/Spark Terraform AWS Postgres We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. If you need any accommodations to make our interview process more accessible ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions If you're looking ...

Data Science & AI Senior Consultant

Hiring Organisation
Deerfoot Recruitment Solutions
Location
United Kingdom
Employment Type
Permanent, Work From Home
Salary
£80,000
Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

Senior Data Science Consultant

Hiring Organisation
Deerfoot Recruitment Solutions Limited
Location
London, United Kingdom
Employment Type
Permanent
Salary
£60000 - £70000/annum Bonus and Benefits
Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

Data Engineer

Location
Lancashire, England, United Kingdom
purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

Data Engineer

Location
Leeds, England, United Kingdom
purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

Cloud Data Engineer - ETL Pipelines & PySpark

Location
Manchester, England, United Kingdom
engineers, analysts and client stakeholders to deliver robust data solutions for government, defence and regulated sectors. You’ll work with AWS and Azure services, PySpark, SQL and Java/Python, implement data quality and monitoring, and contribute to runbooks, data dictionaries and scalable #J-18808-Ljbffr ...

Data Scientist II - QuantumBlack, AI by McKinsey

Location
Greater London, England, United Kingdom
sets Programming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-have Strong understanding of machine learning methods and experience applying them … into production or applied business environments is a plus While we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

Senior Data Engineer | Python, PySpark & SQL

Location
Greater London, England, United Kingdom
Capgemini in Northampton is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL. You will work with large datasets and distributed computing frameworks, delivering data-driven solutions for business needs. The role requires 7–9 years in data engineering, strong … Python, PySpark and SQL skills, and exposure to Scala; cloud platform experience and DevOps practices are a plus. #J-18808-Ljbffr ...

Data Engineer: Python, PySpark & SQL (Hybrid)

Location
Northampton, England, United Kingdom
Capgemini is seeking an experienced Data Engineer in Northampton to design, develop and optimize scalable data pipelines using Python, PySpark and SQL. You will work across big data technologies, collaborate with stakeholders, and help modernize data platforms in a hybrid environment. Ideal candidates will have 7–9 years … data engineering, strong Python and PySpark skills, expert SQL, and exposure to Scala and cloud platforms such as Azure, AWS, or GCP. #J-18808-Ljbffr ...

Spark AWS Data Engineer in Glasgow: UK-Based Applicants Only

Location
Glasgow, Scotland, United Kingdom
data warehouse solutions specifically on AWS. You will be at the forefront of developing high-performance data engineering solutions. The focus is on utilising PySpark, Spark, Python, and various AWS services to enable secure, reliable, and efficient data processing and analytics across enterprise platforms. This position is crucial … enhancing data capabilities within Capgemini's extensive operations. Requirements Proven experience in designing, building, and maintaining scalable data pipelines. Strong proficiency with PySpark, Spark, and Python. Extensive experience with AWS services, particularly those related to data engineering. Ability to develop high-performance data solutions for enterprise platforms. Understanding ...

Forward Deployed Engineer

Location
Greater London, England, United Kingdom
deploying the STRATOS platform to their needs Design and implement scalable generative AI workflows using platforms like Palantir AIP Execute complex data integration using PySpark and other distributed technologies Collaborate directly with clients to understand context, priorities, and key outcome Requirements Minimum 2-4 years of solid experience … tier consultancy. The ability to translate complex and sometimes ambiguous business requirements into clean and maintainable data pipelines Excellent knowledge of PySpark, Python and SQL fundamentals The ability to get to grips with new technologies quickly Preferred Skills and Qualifications Experience in dashboarding tools, Typescript and API development Familiarity ...

Lead Data Scientist - Marketing Sciences

Hiring Organisation
Hackajob Ltd
Location
Leicester, Leicestershire, East Midlands, United Kingdom
Employment Type
Permanent
Salary
£80,000
expertise in marketing analytics, building MMM model via Meridian, Robynand/or PyMc, multi touch attribution, customer lifecycle modelling. Proficiency in SQL, Python, R, PySpark and dashboarding in PowerBI/Looker. Experienced running Geolift test, causal inference model, and other forms of experimental design. Solid foundation in machine learning … strategies. Preferred experience in the eCommerce, technology or marketing industry. So if youre an expert in Data Science, have strong Python/SQL/Pyspark skills and considerable knowledge in test design, implementation and reporting, can work with initiative and can build great working relationships within the business, this ...

ML Engineer

Hiring Organisation
VIQU Limited
Location
London, UK
Employment Type
Full-time
scoring and deploymentProductionise models developed by Data Scientists, transforming notebooks and prototypes into modular, tested and production-ready codeDevelop scalable ML solutions using Python, PySpark, Databricks and MLflowDeploy machine learning models into batch and real-time environments through APIs, scheduled workflows and production pipelinesManage model versioning, promotion and rollback … Strong commercial experience as an ML Engineer, with a clear focus on engineering and productionising machine learning modelsStrong hands-on development skills across Python, PySpark and SQLCommercial experience working with Databricks, MLflow and Delta LakeProven experience building and operating distributed data and machine learning pipelinesExperience taking Data Science models ...

Data Scientist II - QuantumBlack, AI by McKinsey

Hiring Organisation
McKinsey & Company
Location
London, UK
Employment Type
Full-time
data setsProgramming experience (focus on machine learning): SQL and Python's Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-haveStrong understanding of machine learning methods and experience applying them … technologies into production or applied business environments is a plusWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

BI Development Manager

Hiring Organisation
Integrity Recruitment Solutions Ltd
Location
Birmingham, West Midlands, United Kingdom
Employment Type
Permanent, Work From Home
blend of experience is expected as the business transitions to Microsoft Fabric, with key skills and core technologies including: SQL, Microsoft Fabric, Python/PySpark, Data Factory, etc. Exposure to and working with AI based tools such as Microsoft Copilot will certainly enhance candidate applications. Managerial and leadership experience … forward your most recent CV for consideration. BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/ ...

Machine Learning Engineer

Location
Horsham, England, United Kingdom
Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...

Machine Learning Engineer

Location
Greater London, England, United Kingdom
Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...

Integrated Financial Crime - Model Developer

Location
London, United Kingdom
Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

Integrated Financial Crime - Model Developer

Hiring Organisation
Hackajob Ltd
Location
South West London, London, United Kingdom
Employment Type
Permanent
Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

Integrated Financial Crime - Model Developer

Location
Westminster, West End, United Kingdom
Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

Data Engineer - Python/PySpark on Fabric

Location
Liverpool City Region, England, United Kingdom
help shape its modern data platform in St Helens, with a hybrid model requiring 1–2 days on site. The role focuses on Python, PySpark and Microsoft Fabric to build pipelines and data products on top of a growing Fabric/Azure environment. You’ll contribute to a team ...

Snowflake Data Engineer

Location
Slough, England, United Kingdom
this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...