76 to 100 of 6,732 Data Pipeline Jobs in the UK

life-changing impact on Customers, there's nowhere better to develop your career. Main Purpose of Role The role is crucial in transforming data by bridging data warehousing and business analysis into robust data solutions for analytical consumption for key stakeholders. The role will … be responsible for working to build out and improve the company's data ingestion, transformation, transactional and data warehousing needs directly supporting the data science and analyst teams. This role is essential to building and scaling new and existing local data streams … analytics guidelines and utilize appropriate tooling. Skills, Experience and Competencies Required 8 years+ SME experience Strong skills in data architecture and pipeline development, with extensive experience in SQL and Python; PowerBI knowledge is a plus. Experience with ETL/ELT tools (e.g., Matillion, DBT). Strong More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and Machine Learning Understanding of machine learning More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix we’re making healthcare safer, together. … makes it all possible. As a team, we collaborate globally to reach our ultimate goal—helping people. We’re searching for a Senior Data Engineer to join our Data Platform team, so that we can build and maintain robust infrastructure for handling large-scale data … governance and security policies within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to More ❯

at LSEG (London Stock Exchange Group) Role Description As a Senior Lead within Software Engineering, you’ll design and implement functionalities, focusing on Data Engineering tasks. You’ll be working with semi-structured data to ingest and distribute it on a Microsoft Fabric-based platform, modernizing … data products and distribution channels. You’ll drive the software development lifecycle for continuous data delivery and lead the evaluation and adoption of emerging technologies. Key Responsibilities Build and maintain secure and compliant production data processing pipelines on Microsoft Fabric and Azure to ingest … reliable, given business requirements and constraints. Design, implement, monitor, and optimize data platforms to meet functional and non-functional data pipeline requirements. Handle data-related implementation tasks including provisioning storage, ingesting streaming and batch data, transforming data, security, data More ❯

Scope & Key Interfaces Deliver the data engineering roadmap for ‘Group Data’ ensuring delivery of demonstratable real value to Greene King Own the end-to-end data engineering lifecycle from data ingestion to data transformation to data serving for … new data sources Support and input to the development and optimisation of data engineering tools/processes/environments Own the ongoing maintenance and optimisation of existing data pipelines Own the documentation of all existing and new data pipelines and processes Manage … the testing of all deployed solutions to ensure all solutions are accurate and fault tolerant Ensure adherence to all regulation so that data engineering solutions and resulting business usage is compliant Act as a technical data steward to review and optimise the data quality More ❯

The Data Quality Engineer plays a crucial role in ensuring the integrity, accuracy, and reliability of our organization's data assets. This position combines technical expertise with strong collaborative skills to implement and maintain data quality standards across the enterprise. Key Responsibilities: Data Quality Framework: Develop and implement a comprehensive data quality framework, including defining data quality metrics, setting up data quality checks, and automating quality monitoring. SLA and Data Contract Enforcement: Work with domain data owners and DPOs to ensure … adherence to SLAs and data contracts, and monitor data quality against these agreements. Data Analysis: Conduct in-depth data analysis to identify data quality issues, anomalies, and inconsistencies. Data Validation: Develop and execute data validation rules More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … culture makes it all possible. As a team, we collaborate globally to reach our ultimate goalhelping people. Were searching for aLondon-based Principal Data Engineer to join our Data and Reporting Platform team, so that we can design and implement a robust data strategy … warehousing, and ETL/ELT architecture at scale; Advanced programming skills in SQL and Python; experience with orchestration and data pipeline tools; Demonstrated success delivering complex data architectures in support of cross-functional business needs; Experience with implementing data governance frameworks More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business … problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. … Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business … problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. … Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business … problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. … Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data More ❯

Job Description Job Number: Data Engineer (78002584D20240801) Data Engineer – Data Sourcing & Solutions London, UK The Data Sourcing & Solutions team is a growing group inside of AXA XL, responsible for designing and implementing data structures that will enable AXA XL to … harness the potential of advanced analytics in the decision-making process. Data is vital to analytics. In order to ensure that we are achieving our potential under this discipline, we need to make certain our data has the right context, granularity, and quality. The Data … have experience working with data from a raw, unprocessed state and organizing it in an intuitive way. Building this data pipeline enables our partners to analyze data better and faster – ultimately leading the organization in optimizing the decision-making process. What will your More ❯

RLDatix Greater London, England, United Kingdom Join or sign in to find your next job Join to apply for the Principal Data Engineer role at RLDatix RLDatix Greater London, England, United Kingdom Join to apply for the Principal Data Engineer role at RLDatix RLDatix is on … to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix we’re making healthcare safer, together. … warehousing, and ETL/ELT architecture at scale; Advanced programming skills in SQL and Python; experience with orchestration and data pipeline tools; Demonstrated success delivering complex data architectures in support of cross-functional business needs; Experience with implementing data governance frameworks More ❯

Technologies: Data Architect ETL/ELT Data Lake data warehousing data pipelines SQL Calling for a Data Architect who can understand and appreciate code to transform noisy real-world data into high-signal models that stand the test … of time. The role will be FULLY REMOTE. Role Requirements: Having thoughtful discussions with Product Manager to understand Customer’s data engineering requirements. Breaking complex requirements into smaller tasks for execution. Ability to work efficiently with a solid sense for setting priorities; ability to guide your own learning … domain knowledge building. Mentoring and guiding team members on ETL/ELT processes in the cloud using tools like AirFlow, Glue, Stitch, Cloud Data Fusion, DataFlow. Ability to work at an abstract level and build consensus; ability to see from and sell to multiple viewpoints. Designing and implementing More ❯

Principal Data Engineer for Data Asset & Provisioning Technology Join to apply for the Principal Data Engineer for Data Asset & Provisioning Technology role at HSBC Principal Data Engineer for Data Asset & Provisioning Technology Join to apply for the Principal … Data Engineer for Data Asset & Provisioning Technology role at HSBC Brand: HSBC Area of Interest: Technology Location: London, GB, E14 5HQ Work style: Office Worker Date: 28 May 2025 Join a digital first bank that’s powered by people. Our technology team builds innovative digital solutions … services for our customers around the world. We are looking for an exceptional Principal Engineer to serve as the technical anchor for the Data Asset and Provisioning Technology domain, covering platforms and capabilities including Enterprise Data Assets (EDA), Reference Data, Big Data More ❯

Join to apply for the Data Architect role at Somerset Bridge Group 1 week ago Be among the first 25 applicants Join to apply for the Data Architect role at Somerset Bridge Group Get AI-powered advice on this job and more exclusive features. Application Deadline … June 2025 Department: [SBSS] Enterprise Data Management Location: Newcastle Compensation: £82,500 - £98,000/year Description Are you ready to shape the data backbone of an ambitious insurance business? We're on the lookout for a Data Architect to help us build a … modelling (conceptual, logical, and physical). Data warehousing and data lake architecture for high-performance analytics. ETL/ELT pipeline development and optimisation to support large-scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata More ❯

platform for the + business community. Please do not contact the recruiter directly. Summary Location: London, UK; Dublin, Ireland About the Role: Complex data are integral to our work in clinical studies. This position will be part of a newly established AI & Data Engineering team within … the Advanced Quantitative Sciences function at Novartis. Our mission is to leverage automation and artificial intelligence to unlock the potential of complex scientific data sources. By accelerating quantitative decision-making in clinical trials through high-quality data assets and tools, we aim to bring innovative medicines … to patients faster. The Data Engineering Lead guides and drives the development of robust data assets from both internal and external sources to support data interrogation, research, development efforts, and external collaborations. Collaborating with our quantitative science community, TSC, Statistical Programming colleagues, IT, QA More ❯

data architectures for our Customer Data Platform (CDP). The ideal candidate will be responsible for data integration, pipeline development, and optimization, ensuring data accuracy and compliance. Responsibilities Data Architecture: Assist in designing and managing end-to-end CDP … Mapping & Integration: Define XDM schemas and facilitate seamless data integration from Azure, CRM, marketing platforms, and other databases. Data Pipeline Development: Build, maintain, and optimize ETL processes to extract, transform, and load data efficiently. ETL Optimization: Enhance data flow efficiency … with data integration tools (e.g., Azure, CRM systems). Proficiency in ETL processes, data transformation techniques, and data pipeline optimization. Familiarity with XDM schema design and data governance best practices. Strong problem-solving skills and ability to work in cross-functional More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Lead Data Engineer Reporting to: Head of Data/AI Location: London, Manchester, hybrid DEPT/DATA DEPT/AI has a single mission: to make the best work in the industry using Data & AI to enhance everything we do. This role … sits within our Data & AI practice, which has deep expertise in leveraging AI. The team includes data strategists, consultants, data scientists and analysts that work alongside DEPT teams around the world across different services – from commerce, to full-funnel media, content engineering to internal … some of the best loved brands in the world – and doing this alongside an experienced team. This role is part of our EMEA Data craft team, an integrated craft across Europe driving data engineering, data science, and AI initiatives. We combine our expertise in More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix we’re making healthcare safer, together. … it all possible. As a team, we collaborate globally to reach our ultimate goal—helping people. We’re searching for aLondon-based Principal Data Engineer to join our Data and Reporting Platform team, so that we can design and implement a robust data strategy … warehousing, and ETL/ELT architecture at scale; Advanced programming skills in SQL and Python; experience with orchestration and data pipeline tools; Demonstrated success delivering complex data architectures in support of cross-functional business needs; Experience with implementing data governance frameworks More ❯

The Role: DataOps Engineer We are seeking a senior DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role, you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft Azure environment. Your work will be centred on proactive system monitoring, error resolution, and continuous improvements …/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards More ❯