301 to 325 of 335 PySpark Jobs in the UK

seeking an experienced Senior Data Engineer to design, build, and maintain scalable data pipelines and distributed data processing solutions. You will use Python, PySpark, AWS, and SQL to ingest, transform, and analyze large datasets from multiple sources, ensuring data quality, performance, and reliability. The role requires ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

verbal communication skills, including the ability to explain complex methodology to diverse audiences. You might also have Familiarity with Databricks, DBT, Spark/PySpark, or similar large‐scale data platforms. Modified infrastructure‐as‐code (e.g. Terraform) or contributing to production data pipelines. Mentored junior data scientists or engineers. Knowledge … passion for, the cryptocurrency and blockchain space. Technologies we use Python SQL Databricks DBT PySpark/Spark Terraform AWS Postgres We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. If you need any accommodations to make our interview process more accessible ...

contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions If you're looking ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

engineers, analysts and client stakeholders to deliver robust data solutions for government, defence and regulated sectors. You’ll work with AWS and Azure services, PySpark, SQL and Java/Python, implement data quality and monitoring, and contribute to runbooks, data dictionaries and scalable #J-18808-Ljbffr ...

sets Programming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-have Strong understanding of machine learning methods and experience applying them … into production or applied business environments is a plus While we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

Capgemini in Northampton is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL. You will work with large datasets and distributed computing frameworks, delivering data-driven solutions for business needs. The role requires 7–9 years in data engineering, strong … Python, PySpark and SQL skills, and exposure to Scala; cloud platform experience and DevOps practices are a plus. #J-18808-Ljbffr ...

Capgemini is seeking an experienced Data Engineer in Northampton to design, develop and optimize scalable data pipelines using Python, PySpark and SQL. You will work across big data technologies, collaborate with stakeholders, and help modernize data platforms in a hybrid environment. Ideal candidates will have 7–9 years … data engineering, strong Python and PySpark skills, expert SQL, and exposure to Scala and cloud platforms such as Azure, AWS, or GCP. #J-18808-Ljbffr ...

data warehouse solutions specifically on AWS. You will be at the forefront of developing high-performance data engineering solutions. The focus is on utilising PySpark, Spark, Python, and various AWS services to enable secure, reliable, and efficient data processing and analytics across enterprise platforms. This position is crucial … enhancing data capabilities within Capgemini's extensive operations. Requirements Proven experience in designing, building, and maintaining scalable data pipelines. Strong proficiency with PySpark, Spark, and Python. Extensive experience with AWS services, particularly those related to data engineering. Ability to develop high-performance data solutions for enterprise platforms. Understanding ...

deploying the STRATOS platform to their needs Design and implement scalable generative AI workflows using platforms like Palantir AIP Execute complex data integration using PySpark and other distributed technologies Collaborate directly with clients to understand context, priorities, and key outcome Requirements Minimum 2-4 years of solid experience … tier consultancy. The ability to translate complex and sometimes ambiguous business requirements into clean and maintainable data pipelines Excellent knowledge of PySpark, Python and SQL fundamentals The ability to get to grips with new technologies quickly Preferred Skills and Qualifications Experience in dashboarding tools, Typescript and API development Familiarity ...

expertise in marketing analytics, building MMM model via Meridian, Robynand/or PyMc, multi touch attribution, customer lifecycle modelling. Proficiency in SQL, Python, R, PySpark and dashboarding in PowerBI/Looker. Experienced running Geolift test, causal inference model, and other forms of experimental design. Solid foundation in machine learning … strategies. Preferred experience in the eCommerce, technology or marketing industry. So if youre an expert in Data Science, have strong Python/SQL/Pyspark skills and considerable knowledge in test design, implementation and reporting, can work with initiative and can build great working relationships within the business, this ...

scoring and deploymentProductionise models developed by Data Scientists, transforming notebooks and prototypes into modular, tested and production-ready codeDevelop scalable ML solutions using Python, PySpark, Databricks and MLflowDeploy machine learning models into batch and real-time environments through APIs, scheduled workflows and production pipelinesManage model versioning, promotion and rollback … Strong commercial experience as an ML Engineer, with a clear focus on engineering and productionising machine learning modelsStrong hands-on development skills across Python, PySpark and SQLCommercial experience working with Databricks, MLflow and Delta LakeProven experience building and operating distributed data and machine learning pipelinesExperience taking Data Science models ...

data setsProgramming experience (focus on machine learning): SQL and Python's Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-haveStrong understanding of machine learning methods and experience applying them … technologies into production or applied business environments is a plusWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

Description About us Analytium is a boutique UK data and analytics consultancy - 14 people, 150 projects delivered for 50 clients. We are embedded in a UK tier-one bank, modernising one of the largest SAS ...

blend of experience is expected as the business transitions to Microsoft Fabric, with key skills and core technologies including: SQL, Microsoft Fabric, Python/PySpark, Data Factory, etc. Exposure to and working with AI based tools such as Microsoft Copilot will certainly enhance candidate applications. Managerial and leadership experience … forward your most recent CV for consideration. BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/ ...

Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...

Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...

Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

help shape its modern data platform in St Helens, with a hybrid model requiring 1–2 days on site. The role focuses on Python, PySpark and Microsoft Fabric to build pipelines and data products on top of a growing Fabric/Azure environment. You’ll contribute to a team ...