25 of 25 Data Pipeline Jobs in the East of England

Evaro is looking to do for health care what online banking has done for finance, and we're looking for a Head of Data Science to help us that through data-driven insights and innovations. Our mission? To increase accessibility to prescription medications and improve health outcomes by providing a seamless, technology-driven solution that empowers … brands to integrate digital health services effortlessly, Evaro strives to build the online banking for UK healthcare. About the job We're looking to hire a Head of Data Science to build out and lead the data science capabilities across the organisation. You'll have a background in analytics, machine learning, and leading data teams. You'll be joining the company at an exciting time, working to build out a data team to help drive the company's direction. Ensuring that data isn't just analyzed but transformed into actionable insights that directly improve patient outcomes. Join Evaro as Head of Data Science to harness the More ❯

We're looking for a technical steward of enterprise metadata assets , ensuring governance, quality, and regulatory compliance across complex data landscapes. You will be the subject matter expert for data cataloguing, metadata synchronisation, and stewardship best practices. helping us build a trusted foundation for AI, analytics, and digital transformation. What You'll Do Metadata Curation & Governance … Define and implement enterprise metadata standards, business glossaries, and classification schemas. Establish data quality KPIs, SLAs, and governance metrics. Build automated discovery workflows to enable self-service analytics. Champion adoption of governed data assets across business and technical teams. Technical Stewardship Configure cross-platform metadata synchronisation between Alation, Databricks (Unity Catalog) , and downstream systems. Implement schema … BI spaces. Hands-on with data quality tools such as Great Expectations, Ataccama, Monte Carlo (or similar). Experience with metadata orchestration and modern data pipeline tools. More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working … treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and … responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role More ❯

Data Engineers ?? Cambridge/Hybrid 2x per week onsite | ?? £60,000£75,000 | ?? SC or DV Clearance Required Were working with a specialist technology consultancy delivering cutting-edge solutions into the UKs most secure government environments. Due to continued growth, theyre looking for a talented Data Engineer to join their secure data team and … help solve complex, high-impact challenges. The role Youll design and develop secure data pipelines and platforms, working on projects that process sensitive, mission-critical information. This is an opportunity to apply your technical skills in an environment where your work has a direct impact on national security. What youll be doing: Build and optimise scalable data pipelines, sourcing from APIs and external datasets, and merging them with other data sources to create unified models Produce geospatial datasets for integration with visualisation tools, helping Analysts and End Users interpret complex information Define and maintain data retention strategies in line with governance requirements Work with varied data formats to unify More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

We are excited to offer a new opportunity for an Enterprise Data Architect to join our community of Solution, Data and Infrastructure Architects. Reporting to the Director of Technology Office , you will shape and drive our enterprise-wide data strategy, to establish best practices and guidelines for data management, integration and insights. … with a strong culture of authenticity and innovation. This is a great time to join a growing business, to be part of a new technology team. The Enterprise Data Architect will work closely with our product owners and product/project managers to ensure a robust architectural runway that can support future business requirements throughout the product life … cycle. Key Responsibilities You will be accountable for the data architecture & design, and you will oversee the implementation of enterprise-wide data models, governance frameworks, and architectural standards. You'll guide the design & development of scalable data pipelines and solutions that support our retail operations across the customer journey and channels. With excellent communication More ❯

AI/ML and Data Science Developer Hybrid - Stevenage 3/4dpw £70,000 - £80,000 About the Role: We are looking for an AI/ML and Data Science Developer to join a growing team working on cutting-edge Generative AI and Data Science solutions. This role offers the opportunity to design, develop … AI/Machine Learning models, including Large Language Models (LLMs) and GenAI, while working with diverse datasets and modern deployment technologies. You'll play a key role in data processing, model fine-tuning, and deployment , helping to shape innovative solutions that make a tangible impact. Key Responsibilities: Design, develop, and deploy AI/Machine learning models and solutions … prompt engineering and model re-tuning. Work with a variety of structured and unstructured datasets, handling preprocessing, cleaning, and feature engineering. Develop pipelines for creating, preparing, and optimising data for modelling. Deploy models to production using containerisation tools (Docker, Kubernetes) and ensure scalability, robustness, and monitoring. Research and apply the latest advancements in Generative AI and data More ❯

AI/ML and Data Science Developer Hybrid - Stevenage 3/4dpw £70,000 - £80,000 About the Role: We are looking for an AI/ML and Data Science Developer to join a growing team working on cutting-edge Generative AI and Data Science solutions. This role offers the opportunity to design, develop … AI/Machine Learning models, including Large Language Models (LLMs) and GenAI, while working with diverse datasets and modern deployment technologies. You’ll play a key role in data processing, model fine-tuning, and deployment , helping to shape innovative solutions that make a tangible impact. Key Responsibilities: Design, develop, and deploy AI/Machine learning models and solutions … prompt engineering and model re-tuning. Work with a variety of structured and unstructured datasets, handling preprocessing, cleaning, and feature engineering. Develop pipelines for creating, preparing, and optimising data for modelling. Deploy models to production using containerisation tools (Docker, Kubernetes) and ensure scalability, robustness, and monitoring. Research and apply the latest advancements in Generative AI and data More ❯

AI/ML and Data Science Developer Hybrid - Stevenage 3/4dpw £70,000 - £80,000 About the Role: We are looking for an AI/ML and Data Science Developer to join a growing team working on cutting-edge Generative AI and Data Science solutions. This role offers the opportunity to design, develop … AI/Machine Learning models, including Large Language Models (LLMs) and GenAI, while working with diverse datasets and modern deployment technologies. You’ll play a key role in data processing, model fine-tuning, and deployment , helping to shape innovative solutions that make a tangible impact. Key Responsibilities: Design, develop, and deploy AI/Machine learning models and solutions … prompt engineering and model re-tuning. Work with a variety of structured and unstructured datasets, handling preprocessing, cleaning, and feature engineering. Develop pipelines for creating, preparing, and optimising data for modelling. Deploy models to production using containerisation tools (Docker, Kubernetes) and ensure scalability, robustness, and monitoring. Research and apply the latest advancements in Generative AI and data More ❯

Data Engineer (Generative AI) - Defence & Technology - British Citizens only Are you a Data Engineer ready to build and secure the next generation of data pipelines for cutting-edge Generative AI projects? We're working with a highly respected, multinational defence and technology company looking for a skilled Data Engineer to join a … a unique opportunity to directly shape the technology roadmap and deliver critical, high-impact solutions. In this role, you will be responsible for evaluating, designing, and maintaining resilient data sets, collaborating with internal customers to optimise their data for security and performance. A key part of your work will involve staying ahead of new technology trends … the company remains at the forefront of Generative AI. What we're looking for: Expertise in SQL and noSQL technologies (e.g., MS SQL, Oracle, MongoDB). Experience with data processing and exchange (ETL, ESB, API). Strong development skills, particularly with Python. Big data experience/knowledge (hadoop etc) Advantageous to have knowledge of Generative AI More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance … data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge More ❯

Data Engineer - Generative AI Projects 📍 Hybrid | 2-3 Days On-Site | Up to £55,000 + Bonus + Package 🔒 British Citizens Only | BPSS Clearance Required We're hiring a Data Engineer with a passion for automation, clean pipelines, and the future of AI. This is your chance to shape how data powers Generative AI … on innovative internal use-cases - from AI assistants to intelligent search and document automation - this is the perfect next step. 🔧 What You'll Be Doing Building and maintaining data pipelines across structured & unstructured sources Collaborating with internal teams to support Generative AI and NLP projects Ensuring data is secure, compliant, high-quality, and easy to access … customers across multiple teams and functions 🧠 What You'll Bring Experience with SQL & NoSQL databases (e.g. MS SQL, MongoDB, Neo4J) Python skills for scripting and automation ETL and data exchange experience (e.g. APIs, ESB tools) Knowledge of Big Data (e.g. Hadoop) Curiosity about AI, particularly NLP, OCR or Generative AI 🌟 Bonus Points For Docker/containerisation More ❯

Data Engineer - Generative AI Projects 📍 Hybrid | 2-3 Days On-Site | Up to £55,000 + Bonus + Package 🔒 British Citizens Only | BPSS Clearance Required We're hiring a Data Engineer with a passion for automation, clean pipelines, and the future of AI. This is your chance to shape how data powers Generative AI … on innovative internal use-cases - from AI assistants to intelligent search and document automation - this is the perfect next step. 🔧 What You'll Be Doing Building and maintaining data pipelines across structured & unstructured sources Collaborating with internal teams to support Generative AI and NLP projects Ensuring data is secure, compliant, high-quality, and easy to access … customers across multiple teams and functions 🧠 What You'll Bring Experience with SQL & NoSQL databases (e.g. MS SQL, MongoDB, Neo4J) Python skills for scripting and automation ETL and data exchange experience (e.g. APIs, ESB tools) Knowledge of Big Data (e.g. Hadoop) Curiosity about AI, particularly NLP, OCR or Generative AI 🌟 Bonus Points For Docker/containerisation More ❯

Data Engineer - Generative AI Projects 📍 Hybrid | 2-3 Days On-Site | Up to £55,000 + Bonus + Package 🔒 British Citizens Only | BPSS Clearance Required We're hiring a Data Engineer with a passion for automation, clean pipelines, and the future of AI. This is your chance to shape how data powers Generative AI … on innovative internal use-cases - from AI assistants to intelligent search and document automation - this is the perfect next step. 🔧 What You'll Be Doing Building and maintaining data pipelines across structured & unstructured sources Collaborating with internal teams to support Generative AI and NLP projects Ensuring data is secure, compliant, high-quality, and easy to access … customers across multiple teams and functions 🧠 What You'll Bring Experience with SQL & NoSQL databases (e.g. MS SQL, MongoDB, Neo4J) Python skills for scripting and automation ETL and data exchange experience (e.g. APIs, ESB tools) Knowledge of Big Data (e.g. Hadoop) Curiosity about AI, particularly NLP, OCR or Generative AI 🌟 Bonus Points For Docker/containerisation More ❯

Data Engineer - Generative AI Projects ?? Hybrid | 2-3 Days On-Site | Up to £55,000 + Bonus + Package ?? British Citizens Only | BPSS Clearance Required We're hiring a Data Engineer with a passion for automation, clean pipelines, and the future of AI. This is your chance to shape how data powers Generative AI … on innovative internal use-cases - from AI assistants to intelligent search and document automation - this is the perfect next step. ?? What You'll Be Doing Building and maintaining data pipelines across structured & unstructured sources Collaborating with internal teams to support Generative AI and NLP projects Ensuring data is secure, compliant, high-quality, and easy to access … customers across multiple teams and functions ?? What You'll Bring Experience with SQL & NoSQL databases (e.g. MS SQL, MongoDB, Neo4J) Python skills for scripting and automation ETL and data exchange experience (e.g. APIs, ESB tools) Knowledge of Big Data (e.g. Hadoop) Curiosity about AI, particularly NLP, OCR or Generative AI ?? Bonus Points For Docker/containerisation More ❯

Senior Software Engineer/Architect - £80,000-£100,000 (Hybrid - Cambridge HQ) An emerging startup at the forefront of drone data systems for commercial and government use is looking for a Senior Software Engineer/Architect to join their growing team. This is a unique opportunity to shape cloud-native platforms that convert multi-sensor drone data into real-time insights. You'll work closely with ML engineers and systems architects to design secure, scalable backend systems and data infrastructure from the ground up. Key Responsibilities: Design and build robust, cloud-native backend systems using C++, Python, or Go Develop scalable, secure infrastructure on AWS Collaborate with cross-functional teams including ML and … data engineers Contribute to the architecture of data pipelines and system integrations Lead backend development best practices in a fast-paced startup environment Support the evolution of systems from prototype to production-ready platforms Required Skills & Experience: Strong backend development skills in C++, Python, or Go Proven experience with AWS and cloud infrastructure Expertise in building More ❯

innovator that is not afraid to challenge the norms and innovate. - Execute against project plans and delivery commitments. - Solve complex business and technical problems by diving deep, collecting data to make well informed decisions, and using sound judgement in the face of insufficient data. - Work with multiple cross functional teams to gather requirements, design, develop, deploy, and operate … infrastructure and set best practices for software development processes. - Design and develop code, build CI/CD pipelines, test automation, and dashboards for monitoring health of systems and data pipelines. - Develop and mentor junior and new team members. - Lead engineering excellence initiatives for the org A day in the life As an SDE you'll spearhead Amazon's More ❯

with enterprise platforms (SAP, Salesforce, ServiceNow, CI/CD, Databricks), with human-in-the-loop controls, observability, and auditability. Hybrid Skillset : Strong grounding in traditional machine learning and data workflows (forecasting, scoring models, risk detection, NLP etc) alongside Gen AI/LLM-based architectures. Able to select the right approach (ML vs LLM vs hybrid) for each problem. … Expertise across RAG also, and experience with RPA/automation for understanding/awareness. Security & Risk by Design : Deep understanding of Gen AI risks, including prompt injection, data leakage, model misuse, and adversarial attacks. Build transparent, auditable solutionswith traceability of agent decisions and data lineage. Apply threat modelling and compliance thinkingfrom the start, not as an … afterthought. Enterprise Engineering : Hands on experience in building data pipelines, secure API integrations, and scaling MVPs into stable, reusable services. Translational Ability : Can communicate effectively across technical and business domains, ensuring solutions align to ROI and strategy. More ❯

with enterprise platforms (SAP, Salesforce, ServiceNow, CI/CD, Databricks), with human-in-the-loop controls, observability, and auditability. Hybrid Skillset : Strong grounding in traditional machine learning and data workflows (forecasting, scoring models, risk detection, NLP etc) alongside Gen AI/LLM-based architectures. Able to select the right approach (ML vs LLM vs hybrid) for each problem. … Expertise across RAG also, and experience with RPA/automation for understanding/awareness. Security & Risk by Design : Deep understanding of Gen AI risks, including prompt injection, data leakage, model misuse, and adversarial attacks. Build transparent, auditable solutions with traceability of agent decisions and data lineage. Apply threat modelling and compliance thinking from the start, not … as an afterthought. Enterprise Engineering : Hands on experience in building data pipelines, secure API integrations, and scaling MVPs into stable, reusable services. Translational Ability : Can communicate effectively across technical and business domains, ensuring solutions align to ROI and strategy. More ❯

integration as well as software to support and assist the manufacturing process.The successful candidate will join the development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real-time data … delivery capabilities. Responsibilities: Design and develop real-time test and capture software on Linux systems using C++. Integrate and interface with high-speed SFPDP cards across multi-channel data pipelines. Architect and implement robust, scalable, and maintainable multi-threaded applications. Define and implement data sequencing and synchronisation logic to support deterministic capture and replay. Work with … required: Extensive experience in C++ development in a Linux environment. Proficiency in C# for tooling, test interfaces, or Windows components as needed. Proven experience working with real-time data systems, preferably involving SFPDP or other high-speed digital protocols. Demonstrable skills in multi-threaded and concurrent programming. Experience with low-level I/O, DMA, or driver-level More ❯

as well as software to support and assist the manufacturing process. The successful candidate will join the development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real-time data … delivery capabilities. Responsibilities: Design and develop real-time test and capture software on Linux systems using C++. Integrate and interface with high-speed SFPDP cards across multi-channel data pipelines. Architect and implement robust, scalable, and maintainable multi-threaded applications. Define and implement data sequencing and synchronisation logic to support deterministic capture and replay. Work with … required: Extensive experience in C++ development in a Linux environment. Proficiency in C# for tooling, test interfaces, or Windows components as needed. Proven experience working with real-time data systems, preferably involving SFPDP or other high-speed digital protocols. Demonstrable skills in multi-threaded and concurrent programming. Experience with low-level I/O, DMA, or driver-level More ❯

as a C++ Software Engineer for 12 months. As an C++ Software Engineer, you will join them development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real-time data … only project Responsibilities Design and develop real-time test and capture software on Linux systems using C++. Integrate and interface with high-speed SFPDP cards across multi-channel data pipelines. Architect and implement robust, scalable, and maintainable multi-threaded applications. Define and implement data sequencing and synchronisation logic to support deterministic capture and replay. Work with … Experience Extensive experience in C++ development in a Linux environment. Proficiency in C# for tooling, test interfaces, or Windows components as needed. Proven experience working with real-time data systems, preferably involving SFPDP or other high-speed digital protocols. Demonstrable skills in multi-threaded and concurrent programming. Experience with low-level I/O, DMA, or driver-level More ❯