1 to 25 of 1,010 Data Pipeline Jobs in the UK

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … data warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data ...

Location: London, Potters Bar or Bristol (Hybrid working options available) The Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate … guiding and upskilling more junior data engineers and setting data standards and guidelines. What you'll do Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process, and present data. Ensure data quality, accuracy ...

Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing products and services. Working closely with experienced developers, data analysts, data scientists … instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of scalable data pipelines • Implement ETL (Extract, Transform, Load) processes to ingest data ...

continue to expand throughout the UK. Main duties of the job The role holder will be accountable for designing, building, and maintaining the data infrastructure and pipelines that enable efficient and accurate data collection, storage, processing, and analysis. The role holder will collaborate with cross-functional … data pipelines and optimise data processing and query performance. Implement monitoring systems and processes to track data pipeline health, identify issues and ensure timely resolution. Document data engineering processes, data flows, and system configurations to facilitate knowledge sharing ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Robert Half Technology are assisting a market leading AI-driven data platform organisation to recruit a Data Platform Engineer paying c£125 - £150k per annum. Remote working (UK based). Role The Data Platform Engineer will be an expert level engineer within Snowflake … build scalable solutions within the Data Platform Perform root cause analysis on often complex errors to help ensure data pipeline availability Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data ...

summary Our Data Engineers will provide support to the Data Services department's data integration work, including developing data models, supporting the Trust's analytics environment, and writing scripts and packages for data integration and data analysis. … role will work closely and collaboratively with members of the Analytic Services team who together, make up the Data and Analytic Services function. This will involve defining requirements, surfacing and analysing data, integrating data from a variety of sources (structured and semi-structured ...

high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing … lookout for performance bottlenecks and working to optimise data processing and query performance. This will help make sure your data pipeline is scalable and ready to handle big loads. You'll also be setting up monitoring frameworks to keep an eye on how your data ...

Data Pipeline Engineer (On prem to AWS migration)UtilitiesPredominantly remote: occasional travel to Bristol6 months+£700 - £750 per day In short: We require 3 Data Engineers to join a large on prem to AWS migration programme in replicating data pipelines in readiness … data engineering lifecycle, delivering robust, scalable, and cost-effective solutions on time and within budget. Monitor and drive data pipeline lifecycle, from design and implementation through to optimisation and post-deployment performance analysis. Support operational resilience, ensuring data solutions are maintainable, supportable ...

high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemes and dictionaries, develop data integration solutions, lead data cleansing, validation … lookout for performance bottlenecks and working to optimise data processing and query performance. This will help make sure your data pipeline is scalable and ready to handle big loads. Also be setting up monitoring frameworks to keep an eye on how your data ...

high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing … lookout for performance bottlenecks and working to optimise data processing and query performance. This will help make sure your data pipeline is scalable and ready to handle big loads. You'll also be setting up monitoring frameworks to keep an eye on how your data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Enterprise Data Architect Edinburgh or Glasgow Hybrid A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will … provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the execution of the Data Transformation roadmap. ...

Enterprise Data Architect Edinburgh or Glasgow Hybrid A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will … provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the execution of the Data Transformation roadmap. ...

Enterprise Data Architect Edinburgh or Glasgow Hybrid A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will … provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the execution of the Data Transformation roadmap. ...

Enterprise Data Architect Edinburgh or Glasgow Hybrid A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will … provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the execution of the Data Transformation roadmap. ...

Databricks Engineer (SC Cleared) London (Hybrid) 6 Month Contract £550-600/day (Inside IR35) Data Engineer needed with strong Databricks expertise and active SC Security Clearance. 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data … techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL ...

Databricks Engineer (SC Cleared) London (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Engineer needed with strong Databricks expertise and active SC Security Clearance. 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data … techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL ...