1 to 25 of 1,495 Data Pipeline Jobs in the UK

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must … solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing, validation, and enrichment processes. Duties … You'll be on the lookout for performance bottlenecks and working to optimise data processing and query performance. This will help make sure your data pipeline is scalable and ready to handle big loads. You'll also be setting up monitoring frameworks to keep an eye on how your data pipeline is More ❯

Role Title: Senior Data Engineer Department: IT and Business Change Reports To: Lead Stack Azure BI Developer Contract Type: Permanent Working Arrangements/Pattern: Full Time, 35 hours Working Location: FatFace HQ, Havant Who are we? For over 30 years, we’ve travelled, we’ve laughed, we’ve grown. We believe life is for living and more fun … environment free from prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary This role requires an experienced and technically skilled Senior Data Engineer to play a key role in our Data & Reporting team and drive the transformation of reporting services and data infrastructure, whilst acting as a … data into useful, actionable information. Key Contacts and Relationships: Data & Reporting Team : Collaborate closely with team members to support ETL processes, troubleshoot data pipeline issues, and improve data architecture. Internal Stakeholders : Work with various departments (e.g., finance, operations, marketing) to understand data requirements and provide fit-for-purpose analytical More ❯

Role Title: Senior Data Engineer Department: IT and Business Change Reports To: Lead Stack Azure BI Developer Contract Type: Permanent Working Arrangements/Pattern: Full Time, 35 hours Working Location: FatFace HQ, Havant Who are we? For over 30 years, we’ve travelled, we’ve laughed, we’ve grown. We believe life is for living and more fun … environment free from prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary This role requires an experienced and technically skilled Senior Data Engineer to play a key role in our Data & Reporting team and drive the transformation of reporting services and data infrastructure, whilst acting as a … data into useful, actionable information. Key Contacts and Relationships: Data & Reporting Team : Collaborate closely with team members to support ETL processes, troubleshoot data pipeline issues, and improve data architecture. Internal Stakeholders : Work with various departments (e.g., finance, operations, marketing) to understand data requirements and provide fit-for-purpose analytical More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce More ❯

Product Manager – Data & Data Science Remote (UK) Up to £90,000 + Benefits About the Company Our client is an award-winning search intelligence platform that helps global brands, marketers, and agencies gain an unparalleled understanding of the paid search landscape. Powered by patented AI technology, they enable clients to optimise spend, increase ROI, and stay … they’ve been redefining search intelligence for over a decade. In 2024, they secured multiple industry awards including Best AI Search Software Solution , Best Use of AI for Data , and Best PPC Management Software Suite . You’ll be joining a business that combines the maturity and stability of an established company with the agility, autonomy, and growth … a strong, people-first culture with a 93% approval rating and high employee satisfaction. About the Role You’ll join the Product function, working alongside leading AI and data specialists. The team is focused on delivering innovative, data-driven products that make a measurable difference to customers and the business. As the Product Manager for the More ❯

we're proud to be consumer champions in the automotive space. We're constantly exploring smarter ways to connect people with the right cars - and that's where data engineering plays a key role. You'll join a focused data team of 4 professionals (2 Data Scientists, 1 BI Developer, and yourself as Data … CI/CD pipelines for our data infrastructure, ensuring automated testing and smooth deployments. Participating in code reviews and contributing to team standards for data pipeline development. Keeping on top of the latest datasets available within the automotive space and making recommendations about new data sources. Supporting and expanding our Microsoft Azure infrastructure … optimising it for data pipeline performance. Writing comprehensive data documentation for analytics-focused entities, accelerating your colleagues' understanding of available data. What You'll Need to Succeed Essential Requirements: 2-4 years of experience building robust data pipelines in a commercial environment or through complex personal projects. Strong Python skills including experience with More ❯

uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive. What You'll Do Join the Data Layer Team, a global portfolio transforming our organization into a data-driven enterprise! The Data Layer Team is a portfolio of 30 people who build … essential data platforms, products, and capabilities to empower our clients and colleagues with high-quality, actionable insights. Our focus is on creating scalable data solutions and advancing our data infrastructure to drive informed decision-making across the company. As Use Case Enablement Product Analyst within BCG's Data Layer Team, you will … collaborate with Use Case Enablement Product Owner and cross-functional teams to gather and analyze business and data requirements. Your role is critical to bridging the gap between business stakeholders and technical teams, ensuring that new GenAI use cases are well-scoped, feasible, and aligned with user needs. You will work with various Gen AI use cases and More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … opportunity with Mars before December 31, 2026 . What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … opportunity with Mars before December 31, 2026 . What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

and health security Detect: use cutting edge environmental and biological surveillance to proactively detect and monitor infectious diseases and threats to health Analyse: use world-class science and data analytics to assess and continually monitor threats to health, identifying how best to control and mitigate the risks Respond: take rapid, collaborative and effective actions nationally and locally to … lead strong and sustainable global, national, regional and local partnerships designed to save lives, protect the nation from public health threats and reduce inequalities. Job overview The UKHSA Data Design & Architecture (DD&A) team is responsible for supporting data architecture and data solutions across the organisation. We are a small team of solution architects … data architects, and data modellers. We also work closely with other parts of the organisation who also are involved in development and maintenance of infrastructure and software, including Programme Teams, Engineering & Enablement, Surveillance Systems, Data Services & Quality, Genomics, Enterprise Architecture and the Development and Operations team. The DD&A team supervises and actively develops More ❯

IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start ASAP in Nov/Dec 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the … Central London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing … including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data More ❯

IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start ASAP in Nov/Dec 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the … Central London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing … including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data More ❯

Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the team optimize … workflows and feature delivery. You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will work closely … warehouse, data lake) systems. Ability to partner with less technical business users to understand, document, and optimize data flows between systems. Data Pipeline Design and Implementation: Experienced in designing and implementing data pipelines (ETL/ELT/streaming) for robust data ingestion, transformation, and distribution, ensuring access to More ❯

Job description Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the … team optimize workflows and feature delivery. You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will … warehouse, data lake) systems. Ability to partner with less technical business users to understand, document, and optimize data flows between systems. Data Pipeline Design and Implementation: Experienced in designing and implementing data pipelines (ETL/ELT/streaming) for robust data ingestion, transformation, and distribution, ensuring access to More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯