1 to 25 of 42 Data Pipeline Jobs in the Thames Valley

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Looking at our current pipeline of work, we can also consider those with an Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry More ❯

Role: Head of Data Management Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £55,000 - £70,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data Management to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data management team, drive technical delivery across enterprise data platforms, and ensure compliance, scalability, and performance within a global standards-based ecosystem. Reporting to the Head of IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake … Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum, Kanban). Demonstrated ability to More ❯

Role: Data Team Lead Location: Milton Keynes (Hybrid 3 Days On-site Weekly) Salary: £55,000 - £65,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Data Team Lead to join a leading organisations UK IT function. This role will see you managing and developing a high-performing data team, while ensuring the delivery of effective and scalable data solutions. Youll play a key role in setting direction, building capability, and aligning data initiatives with business priorities. The role requires strong leadership, stakeholder management, and the ability to oversee data programmes from strategy through to delivery. Key Responsibilities: Lead, mentor, and … data leadership roles within complex organisations. Proven track record of leading and developing technical teams. Good understanding of data warehousing, ETL, and data pipeline solutions. Experience with data governance, compliance, and security frameworks. Strong stakeholder engagement, vendor management, and planning skills. Experience managing budgets and resources effectively. Excellent communication, leadership, and More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … optimization. Hands-on experience migrating data from Mainframes to AWS, including transformation and validation of legacy formats. Proficiency in reading and processing VSAM data using Copybooks and the Cobrix library. Experience implementing data retention and archival strategies in cloud environments. Strong understanding and practical implementation of Medallion Architecture (Bronze, Silver, Gold layers) for structured More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms More ❯

VCCP are looking for a Head of Data to build our data function from the ground up, architect our MS Fabric warehouse, stand up secure pipelines across our internal systems/TM1/Sage/ATS/HubSpot, lead a lean team, and deliver high-impact dashboards for senior leadership. Role Overview: We are seeking a … hands-on Head of Data to architect and lead the data function from the ground up. This is a newly created role in a fast-paced environment, where data is central to unlocking operational efficiency, commercial insight, and strategic decision-making. The successful candidate will be responsible for building the data warehouse … integrating strategic data sources, and delivering high-impact dashboards and analytics to senior leadership. They must be confident operating in a high-pressure, fast-evolving environment and capable of influencing senior stakeholders across the business. Key Responsibilities: Build and deploy a centralised data warehouse using Microsoft Fabric, integrating key systems including (some of these are internal More ❯

edge connectivity solutions and technologies to ensure a vast array of devices stay seamlessly connected. Overview: Wireless Logic is on the lookout for a skilled, driven, forward thinking Data Engineer to step into our world and take full ownership of all data engineering activities. You will be joining a Data Team at a high … growth technology IoT connectivity provider who are driving and shaping a data vision and strategy across the group. This role is pivotal in designing, building, and maintaining scalable data pipelines and infrastructure mainly using the Microsoft technology stack. Reporting into the Group Head of Data, you will drive the group towards a data rich and data hungry business by capitalising on the strong foundations the data team has built, continuing to build roads that will unlock data as a superpower so that our teams can gain the competitive edge and make informed decisions. Key Responsibilities: Own the full lifecycle of data engineering tasks More ❯

Thames Water is seeking a Metering Data Scientist to join our Smart Metering Operations Centre (SMOC) in an exciting new role. You’ll have the opportunity to work with data from over a million smart meters monitoring, supporting and creating processes to ensure accuracy, integrity, security and accessibility of data in upstream and downstream … applications integrated to the Thames Water Meter data management system (MDMS). What you’ll be doing as a Metering Data Scientist As a Metering Data Scientist at Thames Water, you'll play a crucial role in the SMOC Meter Data Strategy and … Insights team. Ensuring that the smart metering programme data processes and pipelines are working efficiently and accurately. Providing support to the SMOC and Digital IT teams.Key Responsibilities Pipeline Management – Create and maintain robust data pipelines for reliable reporting. Data Analysis & Modelling – Identify trends, forecast water demand, and improve business processes. To align the More ❯

Our client is looking for an experienced and forward-thinking Data Engineer to join their Digital Services team. This is a key role in shaping and delivering the enterprise data engineering strategy, ensuring that our data infrastructure is robust, secure, and ready for the future. You will be responsible for designing, building, and optimising … data pipelines and database systems that support their administrative and research activities. Working collaboratively across the business you’ll ensure their data is high-quality, accessible, and compliant with governance and cybersecurity standards.Key Responsibilities • Design, build, and maintain efficient data pipelines and ETL workflows.• Develop and optimise relational and non-relational database systems.• Collaborate … with analysts, researchers, and IT teams to deliver tailored data solutions.• Implement and maintain data governance and metadata frameworks.• Ensure data security, integrity, and compliance with regulations such as GDPR.• Contribute to data architecture design and enterprise data strategy.• Lead technical data planning within change programmes.• Explore and More ❯

every decision wemake and action we take, guiding us to deliver impact how and where it mattersmost . Connect to your opportunity We're looking for a skilled Data Lake Reporting Assistant Manager to join our team and play a key role in developing and maintaining our data lake reporting environment. You'll work closely with … experienced data analysts and engineers to deliver impactful reports that help us understand our business better. Key responsibilities include: Collaborate closely with senior data analysts and engineers, contributing to the development and implementation of our reporting strategy. Learn and apply industry best practices for data warehousing, reporting, and visualization. Data Lake Reporting … Environment: Become proficient in navigating and understanding data lake architecture. Assist in implementing data quality checks and validation processes to ensure accurate and reliable reporting. Work alongside data engineers to understand and optimize data pipelines for reporting needs. Translate business requirements into technical specifications for reports and dashboards, working with senior team More ❯

AI. We’re looking for a highly skilled Backend Engineer to help us make this vision a reality. The ideal candidate will have a track record of shipping data products derived from complex sources, responsible for the process from conceptual data pipelines to production scale. We have a commitment to quality, so the person in this … role will be able to use modern cloud tooling and techniques to deliver reliable data pipelines and continuously improve them. This role requires a passion for solving challenging problems aligned to exciting Artificial Intelligence and Machine Learning applications. Educational or professional background in the biological sciences is a plus but is not necessary; passion to help therapies for … as the wider team and product. Liaise with other technical staff and data engineers in the team and across allied teams, to build an end-to-end pipeline consuming other data products. Minimum Requirements 2+ years of data engineering experience with a Bachelors degree in a relevant field (including computational, numerate or life More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll … be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from … the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data More ❯

team on a long-term contract. This role will focus on developing and maintaining ETL processes, supporting cloud migration initiatives, and ensuring the delivery of accurate and reliable data solutions. Key Responsibilities * Design, develop, and optimise ETL processes to extract, transform, and load data into data warehouses or data marts. * Support the … setup and cloud migration of Informatica IDMC. * Write efficient SQL queries, including joins and data comparisons across multiple tables. * Collaborate with business and technical teams to gather requirements and translate them into robust technical solutions. * Maintain and enhance existing ETL processes, ensuring accuracy, performance, and reliability. * Perform data quality checks and resolve issues across data pipelines. * Participate in code reviews and recommend improvements. * Document workflows and processes to ensure clarity and maintainability. * Apply and share best practices in ETL development and data integration. * Leverage scripting languages such as Python or Shell scripting (advantageous). Skills & Experience * Strong experience in Informatica development and IDMC cloud migration. * Solid understanding of data More ❯

team on a long-term contract. This role will focus on developing and maintaining ETL processes, supporting cloud migration initiatives, and ensuring the delivery of accurate and reliable data solutions. Key Responsibilities * Design, develop, and optimise ETL processes to extract, transform, and load data into data warehouses or data marts. * Support the … setup and cloud migration of Informatica IDMC. * Write efficient SQL queries, including joins and data comparisons across multiple tables. * Collaborate with business and technical teams to gather requirements and translate them into robust technical solutions. * Maintain and enhance existing ETL processes, ensuring accuracy, performance, and reliability. * Perform data quality checks and resolve issues across data pipelines. * Participate in code reviews and recommend improvements. * Document workflows and processes to ensure clarity and maintainability. * Apply and share best practices in ETL development and data integration. * Leverage scripting languages such as Python or Shell scripting (advantageous). Skills & Experience * Strong experience in Informatica development and IDMC cloud migration. * Solid understanding of data More ❯

We are hiring a Lead Data Engineer: Exciting role in the Financial Services Space Location: UK-based | Flexible/Hybrid Working Options Contract Type: Permanent/Full-Time Overview I'm currently recruiting on behalf of a prestigious UK financial services organisation that is expanding its Retail Data Operations team . Following a strategic internal merger … they are hiring three Lead Data Engineers to support the build-out of new data capabilities focused on retirement solutions. This is a fantastic opportunity to join a forward-thinking team working with cutting-edge technologies in a collaborative and inclusive environment. Key Responsibilities Design, develop, and maintain scalable data pipelines using Snowflake, Azure … business and technical requirements Lead Agile delivery within Scrum teams, translating user stories into actionable engineering tasks Collaborate with architects, product owners, and stakeholders to deliver high-impact data solutions Drive continuous improvement in engineering standards and release management processes Mentor and support junior and mid-level engineers, fostering a culture of learning and excellence Ideal Candidate Profile More ❯

Data Consultant - ETL Projects UK - Remote | Permanent Up to £55,000 + Benefits Are you a Data Consultant with a strong background in hands-on ETL development and data transformation? Are you looking to lead technically complex data migration projects that genuinely impact digital services across Local Government? We're hiring for … an experienced Data Consultant to join a growing team delivering mission-critical data migration projects. You'll be part of an expert unit supporting onboarding for a new cloud platform - working directly with raw datasets from legacy systems and transforming them into future-ready digital infrastructure. What You'll Be Doing: Leading data migration … and ETL projects for UK public sector software implementations Analysing and mapping legacy database schemas (Oracle, SQL Server, Postgres) Extracting raw data from legacy systems, often with limited documentation Writing and executing SQL scripts and/or using ETL tools to build data pipelines Creating transformation logic and performing reconciliation and validation Working closely with customers More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

Job Title: Data Engineer Job Description We are seeking a skilled Data Engineer to join an existing Market Access project. You will play a key part in building scalable data solutions that empower market readiness. 3 months initial contract Remote working ( UK based) Inside IR35 Responsibilities Design, develop, and maintain data pipelines … using Palantir Foundry, PySpark, and TypeScript. Collaborate with cross-functional teams to integrate data sources and ensure data quality and consistency. Implement robust integration and unit testing strategies to validate data workflows. Engage with business stakeholders to understand requirements and translate them into technical solutions. Contribute to product-oriented thinking and help shape the … data engineering roadmap. Essential Skills Strong experience with Palantir Foundry. Proficiency in TypeScript and PySpark. Understanding of data integration and unit testing practices. Excellent communication skills and ability to work with non-technical stakeholders. Additional Skills & Qualifications Experience with OpenTelemetry is desired and beneficial but not needed Location Bracknell, UK Trading as TEKsystems. Allegis Group Limited More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 07-Aug-2025 20282 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Engineer & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Engineer & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity As an AI Engineer & Data Scientist, you will be expected to: Build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such as machine More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 07-Aug-2025 20282 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Engineer & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Engineer & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity As an AI Engineer & Data Scientist, you will be expected to: Build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such as machine More ❯

the development and implementation of robust Lab/digital infrastructure within our R&D laboratories for the UK and US locations. This is pivotal in enabling efficient, automated data exchange between laboratory instruments and enterprise informatics systems such as Electronic Lab notebooks (ELN)s, Laboratory Information Management Systems (LIMS) and other relevant data setups. The ideal … implement, and maintain secure, scalable IT/OT interfaces between lab instruments (e.g., bioreactors, plate readers, liquid handlers) and informatics systems (ELN, LIMS, SDMS, etc.) Collaborate with IT, Data science and scientific teams in R&D to identify integration needs and define architecture for real-time or scheduled automated data transfer. Develop or configure middleware, APIs … and custom connectorseither in-house or in collaboration with external vendorsto enable automated data capture, contextualization, and storage. Manage instrument network connectivity (e.g., OPC-UA, MQTT, REST APIs, TCP/IP) and data pipelines from edge devices to cloud/on-premise environments. Support system validation efforts (e.g., CSV, 21 CFR Part 11 compliance) in partnership More ❯