151 to 175 of 970 Data Pipeline Jobs in the UK excluding London

Data Engineer £45,000–£70,000 London (3 days per week on-site) A fast-growing entertainment company is expanding its data engineering team to build a modern, scalable data foundation that powers analytics, experimentation, and machine learning across the business. Data plays a key role in how the company grows, innovates … and delivers great experiences for its users. You’ll work alongside experienced engineers and data scientists to shape and evolve the platform that underpins all data-driven decisions — including the development of real-time streaming capabilities using tools like Kafka. This is a great opportunity for someone with early career experience in data engineering … who’s ready to deepen their technical expertise and make a tangible impact in a creative, fast-paced environment. Key Responsibilities: Build and maintain reliable, scalable data pipelines for structured, semi-structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data More ❯

Data Engineer £45,000–£70,000 London (3 days per week on-site) A fast-growing entertainment company is expanding its data engineering team to build a modern, scalable data foundation that powers analytics, experimentation, and machine learning across the business. Data plays a key role in how the company grows, innovates … and delivers great experiences for its users. You’ll work alongside experienced engineers and data scientists to shape and evolve the platform that underpins all data-driven decisions — including the development of real-time streaming capabilities using tools like Kafka. This is a great opportunity for someone with early career experience in data engineering … who’s ready to deepen their technical expertise and make a tangible impact in a creative, fast-paced environment. Key Responsibilities: Build and maintain reliable, scalable data pipelines for structured, semi-structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data More ❯

Job Title: Data Product Manager - Fully Remote About the Company: Join a leading AI-driven company that helps enterprise brands and agencies optimise paid search and ads. Role Overview: We are looking for a technically strong, hands-on Data Product Manager to drive the evolution of our data platform and machine learning ecosystem. This … is a platform-focused role, deeply technical but not architectural, working across high-volume data pipelines and predictive ML models to improve data quality, scale, and performance. Key Responsibilities: Own the data product roadmap and define the vision for the data platform. Manage internal data projects with high customer impact. … Ensure integrity, quality, and performance of data models and pipelines. Collaborate closely with Data Engineering, Data Science and PMs Contribute to AI and GenAI initiatives in search intelligence. Key Requirements: 5-10 years of experience in data roles, with at least 3 years in Data Engineering or Data More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data initiatives within Azure Data Factory, Synapse Analytics, and the ongoing migration to Microsoft Fabric. This is a hands-on delivery role suited to a mid-level engineer with strong technical ability and a desire to grow within a modern cloud data environment. Key Responsibilities Build and maintain Power BI reports and dashboards that deliver More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data initiatives within Azure Data Factory, Synapse Analytics, and the ongoing migration to Microsoft Fabric. This is a hands-on delivery role suited to a mid-level engineer with strong technical ability and a desire to grow within a modern cloud data environment. Key Responsibilities Build and maintain Power BI reports and dashboards that deliver More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data initiatives within Azure Data Factory, Synapse Analytics, and the ongoing migration to Microsoft Fabric. This is a hands-on delivery role suited to a mid-level engineer with strong technical ability and a desire to grow within a modern cloud data environment. Key Responsibilities Build and maintain Power BI reports and dashboards that deliver More ❯

Senior Data Scientist Paying up to £85,000 + bonus Hybrid in London AI/ML-Driven PropTech I am currently working with start/scale up within the PropTech sector looking to hire a Data Scientist to work on high-impact predictive modelling projects in a fast-growing company. This role offers the opportunity to … work end-to-end on ML models, helping to revolutionise the property industry by leveraging data-driven insights. As a Data Scientist, you’ll be building and optimising predictive models to understand trends in the property market, such as likelihood of sale and customer retention. You’ll work closely with Data Engineers and Product … predictive models to forecast property trends and customer behavior. Leveraging MLOps best practices to ensure efficient model deployment and monitoring. Working end-to-end across the data pipeline – from data extraction to model evaluation. Collaborating with cross-functional teams to turn insights into actionable business decisions. Tech Stack & requirements: Python | SQL | Snowflake | DBT | Tableau | Dataiku More ❯

Senior Data Scientist Paying up to £85,000 + bonus Hybrid in London AI/ML-Driven PropTech I am currently working with start/scale up within the PropTech sector looking to hire a Data Scientist to work on high-impact predictive modelling projects in a fast-growing company. This role offers the opportunity to … work end-to-end on ML models, helping to revolutionise the property industry by leveraging data-driven insights. As a Data Scientist, you’ll be building and optimising predictive models to understand trends in the property market, such as likelihood of sale and customer retention. You’ll work closely with Data Engineers and Product … predictive models to forecast property trends and customer behavior. Leveraging MLOps best practices to ensure efficient model deployment and monitoring. Working end-to-end across the data pipeline – from data extraction to model evaluation. Collaborating with cross-functional teams to turn insights into actionable business decisions. Tech Stack & requirements: Python | SQL | Snowflake | DBT | Tableau | Dataiku More ❯

Role: Snowflake Data Architect Location: Hove, UK Type: Permanent Role Work Mode: Hybrid Role & Responsibilities Define and implement the end-to-end architecture of Data warehouse on Snowflake. Create and maintain conceptual, logical, and physical data models in Snowflake. Design data pipelines and ingestion frameworks using Snowflake native tools. Collaborate with Data Governance teams to establish data lineage, data quality, and access control mechanisms. Engage with data stewards and stakeholders to build a comprehensive and scalable data warehouse. Implement RBAC, data masking, and encryption practices to ensure compliance with data security policies. Qualifications & Skills 10+ years of experience … in designing enterprise data platforms, with at least 5+ years in Snowflake. Strong expertise in SQL and data warehousing. Hands-on experience working in the insurance industry; prior experience with L&G is an advantage. 3+ years of experience with DBT for data transformation. Deep understanding of agile methodologies in data environments. More ❯

Part-Time Data Engineer/Power BI Developer (Fully Remote) 3-Month Contract | 3 Days per Week | Outside IR35 We’re looking for a hands-on Data Engineer/Power BI Developer to deliver a new Azure-based reporting solution for a London-based organisation. This is a part-time contract (3 days per week) and … can be completed fully remotely. The Project You’ll be building an end-to-end data reporting solution on Azure, pulling data from multiple third-party systems (initially Sona) into an Azure SQL environment, transforming it with Azure Data Factory, and surfacing insights through Power BI dashboards. This setup will evolve into a full … Looking For Proven experience with Azure SQL, Azure Data Factory, and Power BI (integration + dashboard design). Strong understanding of end-to-end data pipeline development. Experience automating and streamlining reporting workflows. Able to work independently and deliver remotely with minimal supervision. If you’re a self-sufficient Data Engineer/Power More ❯

Job Title: Staff Data Engineer Location: London, Hybrid Salary: c.£140,000 + bonus + share options Why Apply? This is a unique opportunity to take a leading role in shaping the data strategy of a fast growing Insurtech scale-up. The role combines hands on technical work with strategic influence, allowing you to develop both … systems and people. You'll lead a small but high impact team, work across multiple business functions, and help deliver a modern, scalable data platform that drives business decisions. Responsibilities: Lead, mentor, and develop a high performing team of Data Engineers, fostering a culture of learning and excellence. Define and execute the data engineering … roadmap aligned with business goals. Own and evolve the end-to-end data platform, including ingestion, transformation, governance, and real time processing. Design, build, and maintain scalable data pipelines, warehouses, and models to support product and analytics teams. Introduce and enforce best practices in testing, CI/CD, infrastructure as code, and observability. Write and review More ❯

Job Title: Staff Data Engineer Location: London, Hybrid Salary: c.£140,000 + bonus + share options Why Apply? This is a unique opportunity to take a leading role in shaping the data strategy of a fast growing Insurtech scale-up. The role combines hands on technical work with strategic influence, allowing you to develop both … systems and people. You'll lead a small but high impact team, work across multiple business functions, and help deliver a modern, scalable data platform that drives business decisions. Responsibilities: Lead, mentor, and develop a high performing team of Data Engineers, fostering a culture of learning and excellence. Define and execute the data engineering … roadmap aligned with business goals. Own and evolve the end-to-end data platform, including ingestion, transformation, governance, and real time processing. Design, build, and maintain scalable data pipelines, warehouses, and models to support product and analytics teams. Introduce and enforce best practices in testing, CI/CD, infrastructure as code, and observability. Write and review More ❯

Data QA Engineer – Remote-first - £55-65,000 Overview: As a Data QA Engineer, you will ensure the reliability, accuracy and performance of our client’s data solutions. Operating remotely, you will work closely with Data Engineers, Architects and Analysts to design and execute automated testing strategies that validate data pipelines, integrations and transformations across cloud platforms. Your work will underpin data quality and ensure that insights are built on trusted, consistent data. Key Responsibilities: Design and implement automated tests for data pipelines, ETL processes and APIs across AWS and Azure environments. Develop and maintain test frameworks that validate data quality, completeness … and integrity. Collaborate with engineering teams to identify data defects, root causes and performance issues. Support continuous integration and deployment by embedding automated testing into CI/CD pipelines. Validate source-to-target data mapping, transformations and business logic. Produce clear test documentation and communicate test results to technical and non-technical stakeholders. Monitor data More ❯

an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry … vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage … and compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). More ❯

an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry … vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage … and compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). More ❯

an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry … vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage … and compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). More ❯

accommodate the delivery of our expanding workload in support of the broader growth of the business. Linked to the steady growth of the business, we are evolving our data architecture to offer a modern data service with new data sources coming online and redeveloping our data warehouse to align with our projected … growth. The current team is small so the role will have exposure to colleagues across Ridge, representing the Data and Analytics team in conversations across the entire business' data estate. Therefore, the role has a broad scope of responsibility, requiring the individual to own projects themselves and deliver end-to-end solutions, with support and discussion … shared across the team. Responsibilities: Integrating new data sources into the data warehouse, and building in best-practice warehouse design Staging & shaping data from multiple data sources into reporting and analytical schemas Experience with data warehouse modelling, designed to accommodate future growth Creation of technical documentation, capturing development, processes & DW More ❯

Your Company: NET Recruit is assisting a distribution company in their search for an Apprentice Data Engineer based in the Kent area. Established over 40 years ago, this company has grown to become a leader in sourcing, producing, and distributing fresh produce to some of the UK’s top retailers. Known for its focus on quality, integrity, and … that its ongoing success depends on its people.As part of its ongoing investment in technology and digital innovation, the business is looking for an enthusiastic and motivated Apprentice Data Engineer to join its IT team, working five days per week. This position represents an exceptional opportunity for an individual with a passion for data, analytics, and … are actively encouraged. Your Role and Responsibilities While in this position your duties may include but are not limited to: Support the design, development, and maintenance of scalable data pipelines using tools such as Apache Airflow, dbt, or Azure Data Factory. Learn how to ingest, transform, and load data from a variety of sources More ❯

Test Engineer Data Platforms (FTC-6months Hybrid | London or Manchester) My client is looking for an experienced Test Engineer to take ownership of testing across modern data platforms. This is a hands-on role where you’ll design, implement, and execute test strategies for data pipelines, models, and reporting solutions built on Azure technologies. … Key Responsibilities Define and own the overall testing strategy for data pipelines, data models, and BI solutions. Develop and implement automated testing frameworks integrated with CI/CD pipelines. Design and execute test cases across data ingestion, transformation, storage, and presentation layers. Validate data accuracy, performance, and usability within Azure Databricks, Azure … Data Factory, Azure Data Lake Storage, and Power BI. Establish and monitor data quality checks, reconciliation, and compliance processes. Collaborate closely with data engineers, BI developers, architects, and product owners to embed testing best practices across delivery. Essential Skills & Experience Proven experience as a Test Engineer within data engineering or More ❯

Data Architect (SQL Azure) Milton Keynes/WFH to £90k Are you a Data technologist with data architecture experience looking for an opportunity to take ownership and make an impact? You could be progressing your career at a well known household name within the fast food space as they invest heavily in their data strategy. As the Data Architect you'll be instrumental in delivering a modern cloud based data infrastructure, they have 16 million customer data points across the UK and Ireland that they're looking to use this to optimise customer retention, product quality and speedy and efficient delivery to the customer. Initially you … ll be responsible for migrating the current on-premise data platform to Azure using Databricks; you'll collaborate with the Head of Digital and AI to modernise the current Data infrastructure and monetise the data available, working with senior business stakeholders to deliver tangible business value. Location/WFH: There's a hybrid work More ❯

Data Architect (SQL Azure) Milton Keynes/WFH to £90k Are you a Data technologist with data architecture experience looking for an opportunity to take ownership and make an impact? You could be progressing your career at a well known household name within the fast food space as they invest heavily in their data strategy. As the Data Architect you'll be instrumental in delivering a modern cloud based data infrastructure, they have 16 million customer data points across the UK and Ireland that they're looking to use this to optimise customer retention, product quality and speedy and efficient delivery to the customer. Initially you … ll be responsible for migrating the current on-premise data platform to Azure using Databricks; you'll collaborate with the Head of Digital and AI to modernise the current Data infrastructure and monetise the data available, working with senior business stakeholders to deliver tangible business value. Location/WFH: There's a hybrid work More ❯

Data Architect (SQL Azure) Milton Keynes/WFH to £90k Are you a Data technologist with data architecture experience looking for an opportunity to take ownership and make an impact? You could be progressing your career at a well known household name within the fast food space as they invest heavily in their data strategy. As the Data Architect you'll be instrumental in delivering a modern cloud based data infrastructure, they have 16 million customer data points across the UK and Ireland that they're looking to use this to optimise customer retention, product quality and speedy and efficient delivery to the customer. Initially you … ll be responsible for migrating the current on-premise data platform to Azure using Databricks; you'll collaborate with the Head of Digital and AI to modernise the current Data infrastructure and monetise the data available, working with senior business stakeholders to deliver tangible business value. Location/WFH: There's a hybrid work More ❯

Data Engineer, Azure London/Hybrid £competitive + bonus + excellent benefits Azure, Fabric, Python Data Engineer with extensive cloud experience is sought by thriving financial services organisation in the City of London. As part of the central data platform team, you will be responsible for developing the Data Engineering standards to … be followed by federated data teams across the business. Within these standards our client is looking to create a Data Engineering development environment that has the flexibility to ensure engineers work as efficiently as possible while operating within the security constraints outlined by the business. Responsibilities Work with Product Owners to establish product requirements. Design and … develop observable and secure data pipelines. Source, integrate and clean data using medallion architecture. Ensure data completeness, integrity and validity. Create Lakehouses and Warehouses. Optimise data pipelines, processing workflows and Fabric warehouses for performance. Maintain Data Catalogue and ensure data duplication does not occur. Ensure data More ❯

Data Scientist Location: Hybrid (Greater Bristol Area) Salary: £54,000 Python - PySpark - Azure - Pandas - Scikit-learn - TensorFlow - PyStats - Data Science - Power BI We're supporting a growing, forward-thinking organisation in their search for an experienced Data Specialist. This is an exciting opportunity to join a dynamic team at a pivotal point in its … growth, helping shape data strategy, deliver insightful analytics, and drive intelligent decision-making across the business. You'll work closely with stakeholders to uncover challenges, identify opportunities, and deliver actionable, measurable solutions through advanced machine learning models, statistical methods, and high-performance data pipelines. Skills & Experience Required To be considered, you will need: Strong proficiency in … real-world performance trade-offs. Experience building and maintaining end-to-end machine learning applications. Hands-on experience with Azure cloud technologies: Synapse, Fabric, AzureML, ADX, ADF, Azure Data Lake Storage, Event Hubs. Experience with visualisation tools such as Power BI and Streamlit. Familiarity with Parquet and Delta Parquet formats. Strong data modelling and architecture knowledge More ❯

Data Engineer Gloucester | up to £54,500 + benefits | Hybrid: 2 days on site We’re supporting a Gloucester-based organisation as they continue to invest in their data capability. They’ve recently implemented Microsoft Fabric, creating an opportunity for a Data Engineer to join at the start of the journey and help shape … how the platform evolves. The role Build and maintain data pipelines using Azure Data Services (Data Factory, Synapse, Databricks). Work in a newly implemented Fabric environment, with the chance to learn and influence best practice from the outset. Collaborate with analysts and business teams to deliver clean, reliable data for reporting … and insight. Contribute to the design and development of the wider data platform. About you Experience with Azure Data Services (Data Factory, Synapse, Databricks or similar). An interest in or exposure to Microsoft Fabric. Strong SQL skills and experience building data pipelines. Comfortable working with stakeholders to understand requirements and deliver More ❯