1 to 25 of 954 Data Pipeline Jobs in England

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

continue to expand throughout the UK Main duties of the job The role holder will be accountable for designing, building, and maintaining the data infrastructure and pipelines that enable efficient and accurate data collection, storage, processing, and analysis. The role holder will collaborate with cross-functional … data pipelines and optimise data processing and query performance. Implement monitoring systems and processes to track data pipeline health, identify issues and ensure timely resolution. Document data engineering processes, data flows, and system configurations to facilitate knowledge sharing ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into ...

developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 5 + ...

developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You’ll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks’ front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 10 + ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You’ll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks’ front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + ...

execution. Automation & Performance Optimization • Drive the automation of data workflows, reducing manual intervention and improving efficiency. • Monitor and optimize data pipeline performance, ensuring minimal downtime and maximum reliability. • Implement best practices for data engineering, including version control, testing, and documentation. Data … values Essential • Proven experience in managing data operations, integrations, and engineering teams. • Strong expertise in Databricks, including Delta Lake, Spark, and automated pipeline development. • Hands-on experience with ETL/ELT processes, data governance, and cloud-based data platforms. • Proficiency in SQL, Python ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration … software engineers to ensure data is clean, accessible, and optimised for large-scale processing and analysis. Your Responsibilities Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead ...

Role: Senior Data Engineer Salary: £65,000 Location: York (Hybrid) Purpose of the Role The purpose of this role is to design, build, and maintain a modern data platform that enables high-quality analytics and reporting. Working as part of a Data Insights function … Drive continuous improvement across data engineering practices to enhance scalability, performance, and maintainability. Implement data observability and monitoring to ensure pipeline health and early issue detection. Manage metadata and lineage tracking to improve transparency, governance, and compliance across the data ecosystem. Key Responsibilities ...