101 to 125 of 576 Data Pipeline Jobs in the UK

AWS Data Engineer – Leeds/Hybrid - Upto £65K We’re looking for a Data Engineer to join a growing data team and play a key role in designing, building, and maintaining cloud-native data platforms. The role is based in Leeds (2 days per week on-site) with flexibility for hybrid working. … The role: Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. Mentor data engineers and contribute to … best practices across the team. Key skills: Strong experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation). Proficiency in SQL, Python (Pandas), Spark or Iceberg. Experience with data warehouse design, ETL/ELT, and CI/CD pipelines (GitHub, CodeBuild). Knowledge of infrastructure as code, performance tuning, and data More ❯

Job Title: Staff Data Engineer Location: London, Hybrid Salary: c.£140,000 + bonus + share options Why Apply? This is a unique opportunity to take a leading role in shaping the data strategy of a fast growing Insurtech scale-up. The role combines hands on technical work with strategic influence, allowing you to develop both … systems and people. You'll lead a small but high impact team, work across multiple business functions, and help deliver a modern, scalable data platform that drives business decisions. Responsibilities: Lead, mentor, and develop a high performing team of Data Engineers, fostering a culture of learning and excellence. Define and execute the data engineering … roadmap aligned with business goals. Own and evolve the end-to-end data platform, including ingestion, transformation, governance, and real time processing. Design, build, and maintain scalable data pipelines, warehouses, and models to support product and analytics teams. Introduce and enforce best practices in testing, CI/CD, infrastructure as code, and observability. Write and review More ❯

Data QA Engineer – Remote-first - £55-65,000 Overview: As a Data QA Engineer, you will ensure the reliability, accuracy and performance of our client’s data solutions. Operating remotely, you will work closely with Data Engineers, Architects and Analysts to design and execute automated testing strategies that validate data pipelines, integrations and transformations across cloud platforms. Your work will underpin data quality and ensure that insights are built on trusted, consistent data. Key Responsibilities: Design and implement automated tests for data pipelines, ETL processes and APIs across AWS and Azure environments. Develop and maintain test frameworks that validate data quality, completeness … and integrity. Collaborate with engineering teams to identify data defects, root causes and performance issues. Support continuous integration and deployment by embedding automated testing into CI/CD pipelines. Validate source-to-target data mapping, transformations and business logic. Produce clear test documentation and communicate test results to technical and non-technical stakeholders. Monitor data More ❯

Data Engineer (Talend/Snowflake)Goole – Hybrid (1-2 days in the office)PermanentCompetitive salary Elevation IT are looking for a skilled Data Engineer with proven expertise in ETL, data warehousing, and modern cloud platforms. In this role, you’ll design and optimise data pipelines that power decision-making across the business. … You’ll work hands-on with Talend, Snowflake, SQL, and Python to build scalable solutions, ensure data quality and enable seamless integration across systems. Duties & Responsibilities: Extract, transform, and load (ETL) data from diverse sources, including ERP and cloud-based systems Automate processes using scripting and integration tool Ensure data quality, integrity, and consistency … and project stakeholders to understand data structures and requirements Provide technical leadership and mentoring to fellow data engineers Troubleshoot data issues and optimize pipeline performance Document ETL processes and develop best practices for scalability and reuse Key Skills & Experience Proven experience in data engineering projects and data warehousing Strong More ❯

Test Engineer Data Platforms (FTC-6months Hybrid | London or Manchester) My client is looking for an experienced Test Engineer to take ownership of testing across modern data platforms. This is a hands-on role where you’ll design, implement, and execute test strategies for data pipelines, models, and reporting solutions built on Azure technologies. … Key Responsibilities Define and own the overall testing strategy for data pipelines, data models, and BI solutions. Develop and implement automated testing frameworks integrated with CI/CD pipelines. Design and execute test cases across data ingestion, transformation, storage, and presentation layers. Validate data accuracy, performance, and usability within Azure Databricks, Azure … Data Factory, Azure Data Lake Storage, and Power BI. Establish and monitor data quality checks, reconciliation, and compliance processes. Collaborate closely with data engineers, BI developers, architects, and product owners to embed testing best practices across delivery. Essential Skills & Experience Proven experience as a Test Engineer within data engineering or More ❯

in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Analytics & AI - Data Science - Senior Consultant At EY, you'll have the chance to build a career as unique as you are, with the global scale, support … ability to work closely with cross-functional teams to develop, test, and deploy advanced machine learning models, ensuring alignment with business objectives and seamless integration into client operations. Data Analysis: The capability to … analyse large and complex datasets to extract actionable insights. Your analytical skills will be key in identifying trends, patterns, and anomalies that can inform business strategies. Data Pipeline Management: Be able to design, implement, and maintain data pipelines that are critical for model training and deployment. Your expertise will ensure the reliability and efficiency of More ❯

Reports to: Data Director/Executive Sponsor Location: Remote with occasional travel to London (2 times a month) Contract: Full-time, permanent Base Salary: £60,000 £75,000 dependent on location and experience + 10% bonus scheme Why This Role Exists Serve Legal is forging new ground: transforming operational data into market-ready products, algorithms, and … insights that redefine client value. As a driver of our Innovation Labs, you will experiment, prototype, and build compelling data solutions in a startup-within-a-business environmentboldly iterating and owning proofs-of-concept that scale. This is a position with a balance between data science and engineering. Besides exploring and analysing datasets, you will help … to establish a cloud native data foundations, with a data warehouse and supporting data pipelines. You will be expected to use AI tools where possible to help explore, analyse and transform data. What Youll Do Build Data Products & Algorithms: Prototype and refine predictive models (e.g., compliance forecasting, anomaly detection, NLP-based feedback More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis - Hybrid working - London based Looking for a highly skilled Data Engineer to join our growing data platform team. You will be responsible for designing, building, and optimising large-scale data pipelines and … services that power analytics, reporting, and data-driven decision-making across the business. This role is heavily cloud-focused (AWS) and requires strong expertise in Python, Spark, and relational databases. Role Design, build, and maintain scalable, reliable, and high-performance data pipelines and workflows. Develop clean, maintainable, and testable code in Python for data ingestion, transformation, and processing. Optimise and fine-tune query performance on Aurora Postgres and other relational databases. Architect and manage data solutions on AWS using serverless technologies such as Lambda, Glue, Glue Data Catalog, EMR serverless, and API Gateway. Implement and manage large-scale data processing with Spark (Iceberg tables in S3 More ❯

AWS Data Engineer - Contract Duration: 6 months Location: Mostly remote (occasional office visits) Rate: £500-£550 per day (Outside IR35) I'm partnering with a global consultancy that is looking for a Data Engineer to enhance its evolving data infrastructure and drive operational excellence. This is a hands-on role where you'll play … a key part in business-critical operations, tackling complex data challenges, supporting cross-functional initiatives, and improving core data systems. As a central member of the data team, you'll be responsible for building and maintaining scalable data pipelines, resolving data quality issues, and collaborating closely with analysts, engineers, and … stakeholders. If you thrive in a fast-paced environment and enjoy optimising data systems, this could be a great match. Key Responsibilities: Design, develop, and maintain scalable data pipelines for both operational and analytical needs Ensure high data integrity through best practices in validation and quality assurance Investigate and resolve data issues More ❯

Data Engineer Gloucester | up to £54,500 + benefits | Hybrid: 2 days on site We’re supporting a Gloucester-based organisation as they continue to invest in their data capability. They’ve recently implemented Microsoft Fabric, creating an opportunity for a Data Engineer to join at the start of the journey and help shape … how the platform evolves. The role Build and maintain data pipelines using Azure Data Services (Data Factory, Synapse, Databricks). Work in a newly implemented Fabric environment, with the chance to learn and influence best practice from the outset. Collaborate with analysts and business teams to deliver clean, reliable data for reporting … and insight. Contribute to the design and development of the wider data platform. About you Experience with Azure Data Services (Data Factory, Synapse, Databricks or similar). An interest in or exposure to Microsoft Fabric. Strong SQL skills and experience building data pipelines. Comfortable working with stakeholders to understand requirements and deliver More ❯

Data Engineer £70,000 - £110,000 GBP Onsite WORKING Location: Manchester, North West - United Kingdom Type: Permanent Role: Lead or Senior Data Engineer Salary: £70,000 - £110,000 per annum (multiple grades - depending on experience) + Benefits Location: Open to UK-wide candidates (Remote/Hybrid options available) Overview We are looking for a Data Engineer with a strong foundation in software engineering and experience working in consultancy environments. This role involves designing and developing large-scale data processing solutions within Agile teams, contributing to impactful digital transformation projects across sectors. You'll work across the full software lifecycle, from design and development to testing and deployment, while collaborating with colleagues … and stakeholders to ensure high-quality, maintainable, and scalable data solutions. Key Responsibilities Design and develop data processing software for deployment in Big Data technologies Build and maintain ETL/ELT pipelines using modern data platforms Collaborate with team members to resolve implementation challenges and ensure code quality Work with operations teams More ❯

Technical Data Architect (Azure) Milton Keynes/WFH to £90k Are you a Data technologist with data architecture experience looking for an opportunity to take ownership and make an impact? You could be progressing your career at a well known household name within the fast food space as they invest heavily in their data strategy. As the Technical Data Architect you'll be instrumental in delivering a modern cloud based data infrastructure, they have 16 million customer data points across the UK and Ireland that they're looking to use this to optimise customer retention, product quality and speedy and efficient delivery to the customer. Initially … you'll be responsible for migrating the current on-premise data platform to Azure using Databricks; you'll collaborate with the Head of Digital and AI to modernise the current Data infrastructure and monetise the data available, working with senior business stakeholders to deliver tangible business value. Location/WFH: There's a hybrid More ❯

We are looking for a Data Engineer to play a key role in advancing FDM’s enterprise data platform and business intelligence capabilities. This is a hands-on, technical position focused on designing, building, and maintaining robust data pipelines and developing interactive visualisations that deliver impactful, data-driven insights across the business. … This is a hybrid role based in Brighton . You’ll collaborate closely with a team of analysts to develop scalable solutions using Microsoft Fabric components such as Data Pipelines, Lakehouse, and Power BI. You will also gain deep expertise in our data ecosystem, integrating data from systems like Salesforce, SAP, and other internal … platforms to enable end-to-end data visibility. This role is ideal for someone who thrives in a fast-paced, agile environment and enjoys creating high-quality data solutions that empower decision-making across the organisation. Key Responsibilities Design, build, and maintain data pipelines and ETL processes to deliver analytics and reporting. Develop and More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on … role, where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on … role, where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data More ❯

About the role As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous … improvement. Working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What Youll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that … supports our data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an More ❯

About the role As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous … improvement. Working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What Youll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that … supports our data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an More ❯

As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous improvement. Working alongside … domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What You'll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that supports our … data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an agile environment More ❯

As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous improvement. Working alongside … domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What You'll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that supports our … data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an agile environment More ❯

As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous improvement. Working alongside … domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What You'll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that supports our … data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an agile environment More ❯

As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous improvement. Working alongside … domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What You'll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that supports our … data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an agile environment More ❯

Data Engineer £500 - £560 per day London - 1 day per week in office We're working with a leading global healthcare technology company who are building out their next-generation data platform, with a strong emphasis on automation, testing, and cloud-native engineering, and are looking for an experienced Data Engineer to join their … team. The Role You'll be part of a modern data engineering function that's implementing best-in-class data practices across ingestion, transformation, and orchestration layers. The environment is highly technical, collaborative, and fast-paced, giving you the opportunity to work across a wide variety of data sources and tools. Day-to-day … responsibilities include: Designing and developing DBT models and Airflow pipelines within a modern data stack. Building robust data ingestion pipelines across multiple sources - including external partners, internal platforms, and APIs. Implementing automated testing and CI/CD pipelines for data workflows. Performing data extraction and enrichment, including web scraping and parsing of More ❯

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle and … are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer, you will take responsibility for the development of high-quality pipelines that process and manage large volumes of data from a range of external and internal sources. You'll play a key role in enhancing and maintaining their central data platform, ensuring the smooth delivery of information that supports investment decision-making. Working closely with stakeholders across the business, you'll help shape how data is accessed, tested, and leveraged to maximise value. More ❯

About the Role As the founding Data Architect for our new venture, you will define and build our entire data ecosystem from the ground up. You will design, implement, and operate the production-grade infrastructure that becomes the backbone of our AI-native SaaS product. Your mission is to turn complex business requirements into scalable data … and robust ELT pipelines to observable workflows that power our AI systems. Partnering closely with product and AI engineering teams, you will own the full lifecycle of the data platform, making a direct and visible impact on what we deliver to clients. This is a remote role and a rare opportunity to shape a global product at its … earliest stage while working hands-on as part of a small, high-performing team. Key Responsibilities Data Platform Architecture and Engineering Architect and implement a secure, multi-tenant data platform using cloud technologies to support SaaS delivery models Design and build scalable ETL/ELT pipelines integrating diverse sources including e-commerce platforms, CRM systems, marketing More ❯

DV Cleared Data Engineers – Manchester – AWS or Azure – Senior/Principal We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in Manchester. If you hold active DV clearance and want to work on cutting … edge, mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. They are considering Data Engineers at all levels from Junior up to Principal Data Engineer. What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯