1 to 25 of 378 Data Pipeline Jobs in the UK excluding London

Our OEM Client based in Whitley, Coventry, is searching for a Data Quality & Management Engineer (Test Data) to join their team, Inside IR35. This is a contract position until 31st March 2026. Umbrella Pay Rate: £28.06 per hour. Be a part of the team testing the next generation of electrified propulsion systems for our client s … Performance Index. DV Delivery Burndown. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python). Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

Our OEM Client based in Whitley, Coventry, is searching for a Data Quality & Management Engineer (Test Data) to join their team, Inside IR35. This is a contract position until 31st March 2026. Umbrella Pay Rate: £28.06 per hour. Be a part of the team testing the next generation of electrified propulsion systems for our client's … Performance Index. DV Delivery Burndown. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python). Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

Job summary Are you looking for a pivotal role, where you can leverage your extensive experience in data engineering and architecture to design and implement robust data solutions that drive business insights and decision-making? We are looking for a Principal Data Engineer to lead a growing team and to own and help deliver … our Digital and Data strategy. Your leadership will be instrumental in setting technical direction and mentoring engineers to optimize our data pipelines and infrastructure. You will collaboratively develop and maintain data models, architecture, and integration strategies so that the organisation can use its data well and safely. You are equally as comfortable …/ELT architecture at scale. Advanced programming skills in SQL and Python and a collaborative, CI/CD approach to pushing code; experience with orchestration and data pipeline tools. Experience with implementing data governance frameworks and ensuring compliance with regulatory standards. Familiarity with ML/LLM data needs and setup Effective communication and More ❯

Job summary We are looking for an experienced Senior Data Engineer with … strong technical expertise and innovative mindset to drive our team forward. Main duties of the job Data Engineer will be involved in the entire data pipeline from data acquisition to data extraction, ensuring that the data is accurate, reliable, and accessible, and fit-for-purpose for business intelligence, analytics … and data science functions. Data Engineer will be collaborating with cross-functional teams to support the delivery of impactful analytics work for our clients. About us We are the official research support team for the NHS Benchmarking Network, working with over 300 healthcare organisations across the UK to identify opportunities for service development and quality improvement. More ❯

Our premium brand Automotive client is currently recruiting for the following role: Data Management and Validation Engineer - 28/hr (Inside IR35) - Coventry (hybrid potential) - 9 Months (potential for yearly renewal) The Opportunity Be a part of the team testing the next generation of electrified propulsion systems for luxury automotive products. Our client is at the forefront of … quality produced by the team. Key Accountabilities and Responsibilities - Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. - Delivering data quality reviews to support programme targets and prove out chosen technologies. - Develop … Experience - Educated to degree level in a natural science, mathematical or engineering or computing discipline. - Designing applications in different programming languages (preferable Python) - Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). - Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. - Ability to work closely with More ❯

Our premium brand Automotive client is currently recruiting for the following role: Data Management and Validation Engineer - £28/hr (Inside IR35) - Coventry (hybrid potential) - 9 Months (potential for yearly renewal) The Opportunity Be a part of the team testing the next generation of electrified propulsion systems for luxury automotive products. Our client is at the forefront of … quality produced by the team. Key Accountabilities and Responsibilities - Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. - Delivering data quality reviews to support programme targets and prove out chosen technologies. - Develop … Experience - Educated to degree level in a natural science, mathematical or engineering or computing discipline. - Designing applications in different programming languages (preferable Python) - Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). - Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. - Ability to work closely with More ❯

the forefront of development in hybrid and full electric powertrains, aiming to deliver electrifying performance and peerless refinement. We are looking for individuals who are excited about our data management and validation and can bring their passion and experience to our growing team. This role will work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power … quality produced by the team. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Essential: Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python) Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

the forefront of development in hybrid and full electric powertrains, aiming to deliver electrifying performance and peerless refinement. We are looking for individuals who are excited about our data management and validation and can bring their passion and experience to our growing team. This role will work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power … quality produced by the team. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Essential: Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python) Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

We're undertaking a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, and we are growing our data engineering capability within the Data Team. As part of our journey we're looking for a data architect to help bring our vision … to life to design and review data models, iterate on data architecture, and ensure data is efficiently stored and managed within our enterprise data lakehouse. Here's a taste of what you'll be doing You will work with the various data team families in designing, reviewing, and approving or … useful formats. Able to explain data storage concepts and logical data structures i.e. data warehousing. Able to make recommendations for data pipeline design based on business requirements. Be open to new ways of working, and open to working with new technologies. Be able to set your own goals and take the More ❯

Content Link Select how often (in days) to receive an alert: Create Alert Competitive salary UK/Glasgow: hybrid working model (2-3 days on site) At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market … within a dynamically evolving technical stack. Collaborate seamlessly across diverse technical stacks, including Databricks, Snowflake, etc. Developing various components in Python as part of a unified data pipeline framework. Contributing towards the establishment of best practices for the optimal and efficient usage of data across various on-prem and cloud platforms. Assisting with the testing … and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling. Monitoring the performance of queries and data loads and perform tuning as necessary. Providing assistance and guidance during QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of More ❯

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯

Key Responsibilities: Data Pipelines and … ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools … recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure's suite of services. Collaboration More ❯

Senior Data Ops Data EngineerLeeds 2/3 days per week£55,000-£67,000+ Excellent Benefits18 Months FTC with long term potential Your New Company Our large public sector organisation are seeking a senior Data Platform DataOps Engineer to serve as our clients first DataOps specialist in a growing team of Data Engineers and DevOps professionals.In this pivotal role, you will focus on operationalising and automating their data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft Azure … APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards, ensuring high data More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

Data Quality & Management Engineer (Automotive: Testing and Data Validation)Certain Advantage are recruiting on behalf of a globally renowned automotive brand for a Data Quality & Management Engineer to take responsibility for providing timely, accurate, secured and accessible test data for the wider engineering group to enable efficient engineering decisions to be made. … The engineering group need world class test and data management and validation. The role will require you to work cross functionally to deploy a common approach to data piping, data validation tools as well to build a federated data platform.This is a contract inside IR35 until 31st … March (initially) based in Coventry. Key Accountabilities and Responsibilities Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen More ❯

that adventure. Our employees are at the heart of delivering impactful and meaningful work for our clients and helping them to reach for and realise their vision. Snowflake Data Architect Slalom is seeking an experienced Snowflake Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in … designing, developing, validating and communicating enterprise data solutions using Snowflake. Deep experience in developing enterprise data management strategies including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. What will you do? Lead as a hands-on architect … and governance concepts such as data quality, metadata management, etc. Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools Experience in leading data platform development teams Knowledge of data science and visualisation Must have Snowflake SnowPro Core Certification and ideally SnowPro Advanced too More ❯

and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You … ll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and … Guide: Provide technical leadership to data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. What You'll Be Responsible For: The More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Data Engineer will include: Understand the business/… Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve … diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms, data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the … chance to elevate how the Home Office exploits data for maximum public impact. In this role, you will translate strategic data vision into tangible designs and solutions, ensuring data assets are secure, well-structured, and aligned with evolving Home Office priorities. Partnering with Technical Architects, Principal Data Architects, and various data More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust, scalable data pipelines using best-fit technologies. What … s in it for you? - Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering. - Greenfield deployment -- minimal legacy constraints, just innovation. - Critical role -- influence architecture, tooling, and best practices from day one. - Technology-first environment -- work with modern cloud and data technologies to build something that lasts. What you'll be … doing - Designing and implementing high-performance data pipelines for real time and batch processing. - Architecting a future-proof data platform, leveraging Microsoft Fabric and other best-in-class tools. - Collaborating with cross-functional teams to drive data strategy and governance.- Optimising performance, ensuring scalability, security, and reliability. What we're looking for - Proven experience More ❯

DEPT/AI has a single mission: to make the best work in the industry using Data & AI to enhance everything we do. This role sits within our Data & AI practice, which has deep expertise in leveraging AI. The team includes data strategists, consultants, data scientists and analysts that work alongside DEPT … and most challenging problems facing some of the best loved brands in the world - and doing this alongside an experienced team. This role is part of our EMEA Data craft team, an integrated craft across Europe driving data engineering, data science, and AI initiatives. We combine our expertise in data architecture, analytics … and AI to deliver exceptional data-driven solutions that build lasting relationships with our clients like Footlocker, Nikon, Rituals, and Philips ROLE OVERVIEW The Lead Data Engineer is responsible for building and leading our data engineering capabilities across EMEA and setting technical standards. This senior technical leadership role will drive the strategic vision for More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. … day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into … such as data warehousing. * Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. * Can make data pipeline design recommendations based on business requirements. * Experience with data migration is a plus. * Open to new ways of working and new technologies. * Self-motivated with the ability More ❯