126 to 145 of 145 PySpark Jobs in the UK excluding London

helping to raise the bar on engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines … that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling ...

helping to raise the bar on engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines … that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling ...

helping to raise the bar on engineering practice. The foundations still matter: this is a data engineering role at heart, built on Python, PySpark, and platforms like Databricks, Snowflake, or AWS. What you'll be doing: Take ownership of designing, building, and maintaining the production data and feature pipelines … that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling ...

scalable, secure, and high-performance data platforms.Key Responsibilities Design and implement scalable AWS Data Lakehouse solutions Develop and maintain data pipelines using Python and PySpark Work with AWS services including: S3, EMR, Lambda, IAM, EKS, MWAA Build and manage Apache Iceberg tables for efficient data storage and querying Implement … engineersRequired Skills & Experience Strong experience in AWS Data Engineering Hands-on expertise with: AWS services: IAM, Lambda, EKS, S3, EMR, MWAA Apache Iceberg Python & PySpark Solid understanding of data lakehouse architecture principles Experience with CI/CD pipelines and Terraform Knowledge of data quality frameworks and data security standards ...

develop, and maintain cloud‐native data solutions that ensure data is accurate, accessible, and trusted. Designing and developing scalable data pipelines using Python and PySpark Building and optimising data workflows using AWS Glue, Athena, Redshift , and related AWS services Supporting modern lakehouse architectures, including Apache Iceberg Working with relational … solutions. Essential experience Experience as a Data Engineer, ETL Developer, Data Platform Engineer, or a similar role Strong hands‐on experience with Python and PySpark Experience with AWS Glue, Amazon Athena, Amazon Redshift , and cloud‐based data platforms Strong SQL skills and experience working with both relational and NoSQL ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Snowflake – Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning. Snowpark and end‐to‐end pipeline development. Experience with PySpark, Polars or Dask is also valuable. Python, including testing, build tooling and engineering best practices. SQL, including Snowflake‐optimised SQL. dbt, including Jinja templating … champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great opportunity to join a collaborative ...

Remote - United Kingdom JOB ID: FEQ427R333 Location: The customer is based in Leeds or Manchester, United Kingdom Industry: Enterprise Retail or CPG (UKI Enterprise) - The customer is based in Leeds. You will be visiting the ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

expertise in marketing analytics, building MMM model via Meridian, Robynand/or PyMc, multi touch attribution, customer lifecycle modelling. Proficiency in SQL, Python, R, PySpark and dashboarding in PowerBI/Looker. Experienced running Geolift test, causal inference model, and other forms of experimental design. Solid foundation in machine learning … strategies. Preferred experience in the eCommerce, technology or marketing industry. So if youre an expert in Data Science, have strong Python/SQL/Pyspark skills and considerable knowledge in test design, implementation and reporting, can work with initiative and can build great working relationships within the business, this ...

Description About us Analytium is a boutique UK data and analytics consultancy - 14 people, 150 projects delivered for 50 clients. We are embedded in a UK tier-one bank, modernising one of the largest SAS ...

Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...

Our client is a leading British bank. Join us at our client as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high quality financial crime ...

Job Description Purpose of the role To design, develop, implement, and support mathematical, statistical, and machine learning models and analytics used in business decision-making Accountabilities Design analytics and modelling solutions to complex business problems ...

help shape its modern data platform in St Helens, with a hybrid model requiring 1–2 days on site. The role focuses on Python, PySpark and Microsoft Fabric to build pipelines and data products on top of a growing Fabric/Azure environment. You’ll contribute to a team ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...

Ceox in the United Kingdom is seeking a hands-on Senior Data Engineer to join a growing Data & Analytics practice. You will design, build, optimise and maintain enterprise-scale data solutions across the full data ...