126 to 150 of 966 Data Pipeline Jobs in the UK excluding London

enforce compliance. Customers from different business sectors and levels of government trust our team of 1,250 people for their expertise in R&D, security design, engineering and data-driven insights. We are an integral part of Crane NXT , a $2 billion dollar business with over 5,000 associates Position Summary & Objective The BI & Data Analyst … is responsible for collecting, analyzing, and presenting data to support decision-making across the organization. This role develops and maintains reporting solutions, dashboards, and KPIs, ensuring data accuracy, consistency and is compliant with data governance principles. The Analyst works closely with internal/external stakeholders to understand requirements and deliver actionable insights, helping the … Design, develop, and maintain regular reports and dashboards to support functions across the organization (creating prototypes where practicable) Gather and document reporting requirements from business stakeholders; proactively challenge data owners/data users as appropriate and support them during testing Ensure data accuracy, integrity, and consistency across solutions developed within the team Perform data More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … to best practices for data quality, integrity, and security Integrate modern data engineering tools and technologies into cloud-native infrastructure Develop tools and solutions to support sports data modeling, analytics, and predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of More ❯

Data Engineer Hereford £50,000 to £70,000 Clearance: minimum SC clearance, eligible for DV We're seeking an experienced Data Engineer to work with an established consultancy providing advanced cybersecurity, data, and technology solutions to clients in government, defence, and critical sectors. The team works on high-impact digital and security transformation projects … culture that values innovation, integrity, and technical excellence. Key Responsibilities Design and develop user-facing applications with a focus on functionality and user experience. Build and maintain custom data pipelines to support end-to-end data processing and integration. Collaborate closely with data scientists, analysts, product owners, and engineers to deliver robust data … all project stages. About You Strong proficiency in Python (or similar programming languages) with experience integrating data through APIs and relational databases. Skilled in data pipeline development, including scheduling, monitoring, and ensuring system reliability and digital continuity. Experienced in stakeholder engagement, gathering requirements, and translating them into effective technical solutions. Familiar with front-end application More ❯

Data Engineer Hereford £50,000 to £70,000 Clearance: minimum SC clearance, eligible for DV We're seeking an experienced Data Engineer to work with an established consultancy providing advanced cybersecurity, data, and technology solutions to clients in government, defence, and critical sectors. The team works on high-impact digital and security transformation projects … culture that values innovation, integrity, and technical excellence. Key Responsibilities Design and develop user-facing applications with a focus on functionality and user experience. Build and maintain custom data pipelines to support end-to-end data processing and integration. Collaborate closely with data scientists, analysts, product owners, and engineers to deliver robust data … all project stages. About You Strong proficiency in Python (or similar programming languages) with experience integrating data through APIs and relational databases. Skilled in data pipeline development, including scheduling, monitoring, and ensuring system reliability and digital continuity. Experienced in stakeholder engagement, gathering requirements, and translating them into effective technical solutions. Familiar with front-end application More ❯

Data Engineer – Cardiff/Hybrid – £40,000 - £50,000 + benefits Yolk Recruitment are excited to be working with a global technology business that’s continuing to expand its data capability and invest in modern cloud solutions. Known for their collaborative culture and commitment to innovation, they’re offering an excellent opportunity for a Data Engineer to make a real impact. We’re looking for a Data Engineer to help design, build, and maintain scalable data pipelines and systems that power analytics and business intelligence across the organisation. You’ll play a key role in ensuring data is accurate, accessible, and high-quality — driving data-led decision making at every level. What you’ll be doing: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and operations. Develop and optimise data models and storage solutions for performance and reliability. Ensure data quality, integrity, and security throughout the data lifecycle. Collaborate with More ❯

Data Engineer - Cardiff/Hybrid - £45,000 - £50,000 + benefits Yolk Recruitment are excited to be working with a global technology business that's continuing to expand its data capability and invest in modern cloud solutions. Known for their collaborative culture and commitment to innovation, they're offering an excellent opportunity for a Data Engineer to make a real impact. We're looking for a Data Engineer to help design, build, and maintain scalable data pipelines and systems that power analytics and business intelligence across the organisation. You'll play a key role in ensuring data is accurate, accessible, and high-quality - driving data-led decision making at every level. What you'll be doing: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and operations. Develop and optimise data models and storage solutions for performance and reliability. Ensure data quality, integrity, and security throughout the data lifecycle. Collaborate with More ❯

Databricks Data Engineer £500 - £600 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions … of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, real-time data pipelines that power analytics, machine learning, and operational systems across the business. You … ll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or More ❯

Databricks Data Engineer £500 - £600 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create personalised journeys for millions … of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining large-scale, real-time data pipelines that power analytics, machine learning, and operational systems across the business. You … ll collaborate with software engineers, data scientists, and analytics teams to ensure the platform delivers reliable, high-quality, and compliant data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … data governance, quality, and compliance across all assets · Experience developing and deploying data intensive application across multiple projects · Involve in Discovery/solution planning discussions to define the solution roadmap. · Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required · Should have hands on experience in Information Technology More ❯

Lead Data Engineer Hybrid (London/Reading - 1-2 days per week) Up to £90,000 + Benefits Are you ready to take the lead in shaping world-class data infrastructure at one of the most influential analytics companies on the planet? We're partnering with a global leader in marketing data and insights … that's seeking a Lead Data Engineer to help scale and evolve its cloud-based data ecosystem. This is an opportunity to work on high-impact global datasets , enabling better analytics, stronger fraud prevention, and smarter decision-making across 90+ markets. Why this role? Play a key role in building and optimising global data pipelines supporting over 50 consumer panels worldwide. Lead the technical strategy for data architecture, quality, and scalability. Collaborate closely with data scientists, analysts, and software engineers to drive innovation in data engineering. Hybrid flexibility: 1-2 days per week in London, Reading, or Southbank office , balance remotely. Join a global organisation with More ❯

Lead Data Engineer Hybrid (London/Reading – 1–2 days per week) Up to £90,000 + Benefits Are you ready to take the lead in shaping world-class data infrastructure at one of the most influential analytics companies on the planet? We’re partnering with a global leader in marketing data and insights … that’s seeking a Lead Data Engineer to help scale and evolve its cloud-based data ecosystem. This is an opportunity to work on high-impact global datasets , enabling better analytics, stronger fraud prevention, and smarter decision-making across 90+ markets. 💡 Why this role? Play a key role in building and optimising global data pipelines supporting over 50 consumer panels worldwide. Lead the technical strategy for data architecture, quality, and scalability. Collaborate closely with data scientists, analysts, and software engineers to drive innovation in data engineering. Hybrid flexibility: 1–2 days per week in London, Reading, or Southbank office , balance remotely. Join a global organisation with More ❯

Lead Data Engineer Hybrid (London/Reading – 1–2 days per week) Up to £90,000 + Benefits Are you ready to take the lead in shaping world-class data infrastructure at one of the most influential analytics companies on the planet? We’re partnering with a global leader in marketing data and insights … that’s seeking a Lead Data Engineer to help scale and evolve its cloud-based data ecosystem. This is an opportunity to work on high-impact global datasets , enabling better analytics, stronger fraud prevention, and smarter decision-making across 90+ markets. 💡 Why this role? Play a key role in building and optimising global data pipelines supporting over 50 consumer panels worldwide. Lead the technical strategy for data architecture, quality, and scalability. Collaborate closely with data scientists, analysts, and software engineers to drive innovation in data engineering. Hybrid flexibility: 1–2 days per week in London, Reading, or Southbank office , balance remotely. Join a global organisation with More ❯

Position: Senior Data Engineer Hybrid - Birmingham 6 months - Outside IR35 Overview: Join a leading UK company as a Senior Data Engineer and play a key role in a major data transformation project. You will have the opportunity to design and deliver a new Azure-based data platform, modernising the organisation's data … management and reporting processes. This hands-on role offers architectural influence and is ideal for an experienced engineer with a strong background in setting up new environments, creating data pipelines, and enabling self-service analytics through Power BI. Key Responsibilities: Design, build, and maintain Azure data pipelines using Azure Data Factory, Synapse, or Fabric. … Implement a data lakehouse architecture (Bronze/Silver/Gold) and establish best-practise ETL/ELT frameworks. Ingest and integrate data from multiple core systems, including ERP, finance, supply chain, and CRM platforms. Develop and optimise SQL data models and support the creation of Power BI-ready datasets. Apply and document data More ❯

Position: Senior Data Engineer Hybrid - Birmingham 6 months - Outside IR35 Overview: Join a leading UK company as a Senior Data Engineer and play a key role in a major data transformation project. You will have the opportunity to design and deliver a new Azure-based data platform, modernising the organisation's data … management and reporting processes. This hands-on role offers architectural influence and is ideal for an experienced engineer with a strong background in setting up new environments, creating data pipelines, and enabling self-service analytics through Power BI. Key Responsibilities: Design, build, and maintain Azure data pipelines using Azure Data Factory, Synapse, or Fabric. … Implement a data lakehouse architecture (Bronze/Silver/Gold) and establish best-practise ETL/ELT frameworks. Ingest and integrate data from multiple core systems, including ERP, finance, supply chain, and CRM platforms. Develop and optimise SQL data models and support the creation of Power BI-ready datasets. Apply and document data More ❯

Data Engineer - Azure, Databricks, Microsoft Fabric | Hybrid | £60,000 - £70,000 We're working with a leading financial services organisation that is investing heavily in its data transformation and analytics capabilities. They are looking for a Data Engineer to join their growing Data and Analytics team. This is ideal for someone with … a solid foundation in data engineering who wants to develop deeper skills in Azure Databricks and Microsoft Fabric . You will play a key role in developing and maintaining modern data pipelines, shaping the medallion architecture, and building high-quality data models that power reporting and advanced analytics across the business. What You'll … Do Build and maintain scalable data pipelines in Azure Databricks and Microsoft Fabric using PySpark and Python Support the medallion architecture (bronze, silver, gold layers) to ensure a clean separation of raw, refined, and curated data Design and implement dimensional models such as star schemas and slowly changing dimensions Work closely with analysts, governance, and engineering More ❯

Fast Track and published in The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for the development of data engineering processes within a customer-facing data … delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. You will build predictive models and work with the engineering team to provide further insights to our … customers. You will be able to design and develop end-to-end data pipelines to handle complex transformations and large-scale processing. You will have experience improving data reliability and quality through automated testing, monitoring and validation frameworks. This is a great opportunity for you to join a growing and investing product and customer centric business More ❯

Fast Track and published in The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for the development of data engineering processes within a customer-facing data … delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. You will build predictive models and work with the engineering team to provide further insights to our … customers. You will be able to design and develop end-to-end data pipelines to handle complex transformations and large-scale processing. You will have experience improving data reliability and quality through automated testing, monitoring and validation frameworks. This is a great opportunity for you to join a growing and investing product and customer centric business More ❯

Fast Track and published in The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for the development of data engineering processes within a customer-facing data … delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. You will build predictive models and work with the engineering team to provide further insights to our … customers. You will be able to design and develop end-to-end data pipelines to handle complex transformations and large-scale processing. You will have experience improving data reliability and quality through automated testing, monitoring and validation frameworks. This is a great opportunity for you to join a growing and investing product and customer centric business More ❯

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and … excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance … and best-in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … data governance, quality, and compliance across all assets Experience developing and deploying data intensive application across multiple projects Involve in Discovery/solution planning discussions to define the solution roadmap. Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required Should have minimum 14-15 years of experience More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … data governance, quality, and compliance across all assets Experience developing and deploying data intensive application across multiple projects Involve in Discovery/solution planning discussions to define the solution roadmap. Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required Should have minimum 14-15 years of experience More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … data governance, quality, and compliance across all assets Experience developing and deploying data intensive application across multiple projects Involve in Discovery/solution planning discussions to define the solution roadmap. Guide the integration of legacy systems with new data pipelines and reporting/Analytics tools Required Should have minimum 14-15 years of experience More ❯

Data Engineer £45,000–£70,000 London (3 days per week on-site) A fast-growing entertainment company is expanding its data engineering team to build a modern, scalable data foundation that powers analytics, experimentation, and machine learning across the business. Data plays a key role in how the company grows, innovates … and delivers great experiences for its users. You’ll work alongside experienced engineers and data scientists to shape and evolve the platform that underpins all data-driven decisions — including the development of real-time streaming capabilities using tools like Kafka. This is a great opportunity for someone with early career experience in data engineering … who’s ready to deepen their technical expertise and make a tangible impact in a creative, fast-paced environment. Key Responsibilities: Build and maintain reliable, scalable data pipelines for structured, semi-structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data More ❯