24 of 24 Data Pipeline Jobs in the East of England

Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern … software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that supports Computacenters combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to … deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. What youll do As a Senior Data Consultant, you will play a key role in shaping and delivering data solutions that support business strategy. You will lead More ❯

Senior Data Architect is required by this leading organisation in their field as they look to improve their enterprise and information architectures, ensuring they are robust, future-ready with a capability to support current and future business needs. The focus will be to empower data-led and AI-enhanced decision making across the organisation. You will … be required to deliver a clear, scalable data framework aligned with the overall enterprise data strategy, with an emphasis on data mesh, enabling the use of AI/GenAI within the business. Responsibilities include - Communicating the enterprise data strategy and operating model to various teams across the business Roadmap definition/strategic … GCP Data mesh Data Governance Data Lakehouse, warehouse and virtualisation concepts MDM/Metadata management ETL/ELT processes and data pipeline builds Data readiness for AI Strong understanding of business architecture Be part of a team shaping the future of data-driven technology within the organisation. More ❯

Senior Data Architect is required by this leading organisation in their field as they look to improve their enterprise and information architectures, ensuring they are robust, future-ready with a capability to support current and future business needs. The focus will be to empower data-led and AI-enhanced decision making across the organisation. You will … be required to deliver a clear, scalable data framework aligned with the overall enterprise data strategy, with an emphasis on data mesh, enabling the use of AI/GenAI within the business. Responsibilities include - Communicating the enterprise data strategy and operating model to various teams across the business Roadmap definition/strategic … GCP Data mesh Data Governance Data Lakehouse, warehouse and virtualisation concepts MDM/Metadata management ETL/ELT processes and data pipeline builds Data readiness for AI Strong understanding of business architecture Be part of a team shaping the future of data-driven technology within the organisation. More ❯

therapies for sleep disorders and epilepsy, and a growing portfolio of cancer treatments. Our patient-focused and science-driven approach powers pioneering research and development advancements across our robust pipeline of innovative therapeutics in oncology and neuroscience. Jazz is headquartered in Dublin, Ireland with research and development laboratories, manufacturing facilities and employees in multiple countries committed to serving patients … worldwide. Please visit www.jazzpharmaceuticals.com for more information. The Senior Principal will be responsible for leading projects related to data engineering requirements and initiatives across Jazz Research and Development. The Senior Principal will lead data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD and Omics. Essential Functions Lead the design, development and … maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and other tools. Build and maintain More ❯

Lead Data Engineer, based Waltham Abbey (Hybrid role). Salary £60-80k p.a. + many benefits. An exciting time to join an award-winning business in a phase of growth, in a newly created role to lead a team and be hands on in replacing old tech systems and create ETL pipelines. We’re a small high … in Waltham Abbey (Essex) and up to 2 x days per week from home (or other Jollyes location as preferred). 37.5 hours per week. The Role – Lead Data Engineer This role sits within our IT team. Success measures will include project delivery and impact, data quality and management, innovation and technology, stakeholder engagement, financial impact … key responsibilities: Backend Development : Design, build, and maintain serverless and traditional backend architectures using best practices. (We build on AWS using Lambdas and ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Security Engagement Consultant - Data Insights Daily Rate: Up to £500 (inside IR35 via umbrella) Contract Length: 6 months initially Location: Welwyn Garden City (Hybrid Working) 3 DAYS ONSITE PW REQUIRED About the Role: Our client is seeking a dedicated Security Engagement Consultant specialising in Data Insights to join their team for a temporary contract. In this … By designing and maintaining scalable systems that track activity, engagement, and coverage, you'll ensure alignment with assurance standards and campaign objectives. This position merges technical expertise in data visualisation and automation with strategic insights into engagement dynamics, empowering leadership to make informed decisions and improve outreach effectiveness continuously. Key Responsibilities: Design and maintain activity logging systems utilising … based metrics. Support skills matrix tracking, enabling visibility into training needs and development progress. Collaborate with the Cyber Data Platform team to ensure seamless data pipeline integration and metric consistency. Required Skills & Experience: Proficiency in SQL, Tableau, Excel, and other data visualisation tools. Experience with Microsoft Forms, automated surveys, and structured logging/ More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working … treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and … responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role More ❯

Data Engineering Lead - Hybrid - Azure/Databricks - London Permanent Salary: £90,000 Are you a seasoned Data Engineering professional ready to lead the charge in building scalable, high-performance data platforms? An industry leading, global firm is seeking a Data Engineering Lead to drive innovation across their hybrid Azure/Databricks environment. … About the role: Shape data strategy for global projects Lead a talented team of BI Developers Enjoy a flexible working culture and industry-leading benefits Work with cutting-edge tech in a collaborative, inclusive environment Key Responsibilities: Architect and optimize robust data pipelines for large-scale ingestion, transformation, and delivery Leverage Azure and Databricks to enable … seamless data integration and enrichment Implement best practices for orchestration, monitoring, and error handling Lead and mentor a BI team, ensuring timely delivery of dashboards and data products Champion data governance, quality, and security across platforms Requirements: Proven expertise in Azure, SQL, Databricks, and Azure Data Factory Experience implementing medallion architecture frameworks More ❯

our stakeholders across the UK property market. You'll be at the heart of a greenfield opportunity - building, deploying, and operating machine learning systems that leverage Rightmove's data at large scale. You'll have the opportunity to shape best practices, own and grow the ML Ops discipline, and help us move from first launches to robust, sustainable … role, you will work in a cross-functional team to productionise machine learning and AI models, ensuring they are robust, scalable, and measurable. You'll collaborate closely with data scientists, engineers, and product teams to automate workflows, monitor performance, and retrain models as needed. You'll bring a passion for building reliable ML infrastructure, a strong technical foundation … at scale. Working with data scientists to take models from development to production-grade systems, ensuring scalability, reproducibility, and robustness. Automating feature engineering and data pipeline processes, ensuring reproducibility and auditability. Implementing monitoring and observability to detect drift, bias, and performance degradation, and setting up rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines More ❯

Senior Data Engineer (SQL Python AWS) Cheshire to £100k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cyber Security technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Here at the Mick George Group, we are currently recruiting a Data Engineer (T-SQL, Python) to join the Technology department. Location: Mick George Head Office - Huntingdon Working Hours: Monday – Friday 8am – 5pm Pay: To be discussed during interview. Benefits: Company Pension, Employee Assistance Programme, 28-Days holiday inclusive of bank holidays, Company benefit platform, Cycle to work … with any aspect of our business, whether that be as an employee, supplier, customer or other. Role Purpose As part of our continued growth, we are seeking a Data Engineer with expertise in T-SQL, Python, and some SQL Database Administration (DBA) to join our dynamic team. You will play a pivotal role in the reporting, design, development … and optimisation of our data infrastructure. You will be responsible for managing and reporting on our databases, building robust data pipelines, and ensuring the integrity and performance of critical systems and data warehouses. This is an excellent opportunity for someone who is passionate about data and wants to work in a fast More ❯

Data Engineer Watford | £85,000 + Excellent Benefits | Office-Based The Opportunity An excellent opportunity for a talented Data Engineer to join a well-established and growing financial services organisation based in Watford . Offering a salary of £85,000 plus a superb benefits package , this role is ideal for someone seeking a technically hands-on … position within a forward-thinking and data-driven environment. The company has been operating successfully for over 20 years, employs more than 300 staff, and is recognised as a market leader in specialist financial services. You'll be joining a collaborative data team where innovation, accuracy, and analytical thinking are highly valued. Duties & Responsibilities Design, build … and maintain robust data pipelines and reporting solutions using modern cloud technologies. Work closely with senior leadership to shape data and reporting strategies. Develop and enhance MI & BI reports, ensuring accuracy and integrity across all data outputs. Collaborate with Product Owners, Developers, and other technical teams to support business goals. Mentor junior members of More ❯

backed by cutting-edge science from the University of Cambridge, transforms how companies understand and reduce their emissions. By leveraging decades of research in resource and emissions flow data mapping, we identify the most impactful areas for emissions reduction, enabling companies to make strategic, data-driven decisions. Working alongside leading sustainability scientists from the IPCC and … development of intelligent systems that power our emissions and decarbonisation capabilities. Working at the cutting edge of machine learning and sustainability, you'll build platforms that transform complex data into actionable insights for thousands of companies globally. Your innovations will directly power breakthrough solutions that identify critical decarbonisation opportunities across entire industries and supply chains. You'll push … the boundaries of what's possible with AI-driven climate tech developing advanced models that process vast amounts of unstructured data to reveal hidden patterns in global emissions. You'll collaborate with our climate science team to translate cutting-edge research into production-ready ML solutions, leveraging our graph-structured emissions models to understand complex supply chain relationships. More ❯

backed by cutting-edge science from the University of Cambridge, transforms how companies understand and reduce their emissions. By leveraging decades of research in resource and emissions flow data mapping, we identify the most impactful areas for emissions reduction, enabling companies to make strategic, data-driven decisions. Working alongside leading sustainability scientists from the IPCC and … development of intelligent systems that power our emissions and decarbonisation capabilities. Working at the cutting edge of machine learning and sustainability, you'll build platforms that transform complex data into actionable insights for thousands of companies globally. Your innovations will directly power breakthrough solutions that identify critical decarbonisation opportunities across entire industries and supply chains. You'll push … the boundaries of what's possible with AI-driven climate tech developing advanced models that process vast amounts of unstructured data to reveal hidden patterns in global emissions. You'll collaborate with our climate science team to translate cutting-edge research into production-ready ML solutions, leveraging our graph-structured emissions models to understand complex supply chain relationships. More ❯

Data Engineer - Generative AI Projects ?? Hybrid | 2-3 Days On-Site | Up to £55,000 + Bonus + Package ?? British Citizens Only | BPSS Clearance Required We're hiring a Data Engineer with a passion for automation, clean pipelines, and the future of AI. This is your chance to shape how data powers Generative AI … on innovative internal use-cases - from AI assistants to intelligent search and document automation - this is the perfect next step. ?? What You'll Be Doing Building and maintaining data pipelines across structured & unstructured sources Collaborating with internal teams to support Generative AI and NLP projects Ensuring data is secure, compliant, high-quality, and easy to access … customers across multiple teams and functions ?? What You'll Bring Experience with SQL & NoSQL databases (e.g. MS SQL, MongoDB, Neo4J) Python skills for scripting and automation ETL and data exchange experience (e.g. APIs, ESB tools) Knowledge of Big Data (e.g. Hadoop) Curiosity about AI, particularly NLP, OCR or Generative AI ?? Bonus Points For Docker/containerisation More ❯

clearly. Key Responsibilities: Design and implement test plans for AI/ML applications, APIs, and pipelines.Validate machine learning models, ensuring accuracy, fairness, and robustness.Develop automated testing frameworks for data pipelines, model training, and inference.Perform functional, integration, regression, and performance testing on AI systems.Work closely with Data Scientists and AI Engineers to identify and resolve issues. More ❯

Responsibilities: Design and implement test plans for AI/ML applications, APIs, and pipelines. Validate machine learning models, ensuring accuracy, fairness, and robustness. Develop automated testing frameworks for data pipelines, model training, and inference. Perform functional, integration, regression, and performance testing on AI systems. Work closely with Data Scientists and AI Engineers to identify and resolve More ❯

to take ownership of an ongoing NLP project for a long-standing client in the utilities sector. The Project The utilities client handles large volumes of unstructured text data, including maintenance logs, customer feedback, and technical documentation. The goal is to derive insights and automate intelligence extraction through advanced NLP techniques.You'll play a key role in … maintaining and extending the current solution, introducing new features and optimising model performance for production use. Key challenges include: Improving entity recognition and topic classification accuracy. Scaling the NLP pipeline to handle new data sources and formats. Designing efficient model retraining and deployment workflows. Integrating model outputs into the client's existing data stack and … reporting tools. Core Responsibilities Develop, fine-tune, and deploy transformer-based NLP models (LLMs, BERT, RoBERTa, GPT-family). Design and implement scalable data pipelines using Python, spaCy, Pandas, and Hugging Face Transformers. Build or enhance retrieval-augmented generation (RAG) systems using LangChain and vector databases like FAISS, Weaviate, or Pinecone. Package and deploy solutions via Docker, Kubernetes More ❯

AI to automate workflows, enhance decision-making, and unlock productivity across business functions like Finance, HR, and Operations. This is a client-facing delivery role within a leading Data & AI transformation consultancy, working alongside world-class data scientists, engineers, and strategists to move ideas from concept to production. 🔍 The Role Lead the definition and delivery of … Partner with business and technical stakeholders to identify high-value AI opportunities and shape product roadmaps. Translate requirements into actionable user stories and acceptance criteria for engineering and data teams. Collaborate closely with teams building solutions using RAG pipelines, LLMs, embeddings, and API integrations. Define and track KPIs such as accuracy, latency, adoption, and ROI — iterating based on … governance, and responsible AI. Foster agile, transparent, and outcome-driven ways of working across mixed client-consultancy teams. 💡 About You Proven experience as a Product Manager in AI, data, or enterprise technology environments. Hands-on exposure to AI MVPs, LLM applications, or applied ML use cases (e.g. RAG, copilots, generative search). Strong technical grounding in vector search More ❯

Engineer Location: Cambridge (Hybrid) Salary: £60,000 – £70,000 + Share Options A growing AI company is developing intelligent imaging software that applies advanced machine learning to medical data, improving diagnostic accuracy and speed. As a Senior Machine Learning Engineer, you’ll design, train and deploy ML models for medical image analysis, working with a highly skilled team … AI, healthcare and software engineering. Responsibilities Develop and optimise ML models for medical image processing and analysis Build and integrate AI pipelines within scalable production environments Collaborate with data, clinical and software teams to ensure robust, validated outputs Skills & Experience MSc/PhD in Computer Science, Machine Learning or related discipline 3+ years’ experience developing ML models, with … on medical imaging Proven track record using deep learning frameworks (PyTorch/TensorFlow) Solid Python skills and familiarity with cloud or MLOps tools (Docker, Kubernetes, MLFlow) Understanding of data pipelines and image analysis techniques (segmentation, registration, feature extraction) Benefits Share options and private healthcare Flexible hybrid working 28 days’ holiday + bank holidays If this position seems like More ❯

Engineer Location: Cambridge (Hybrid) Salary: £60,000 – £70,000 + Share Options A growing AI company is developing intelligent imaging software that applies advanced machine learning to medical data, improving diagnostic accuracy and speed. As a Senior Machine Learning Engineer, you’ll design, train and deploy ML models for medical image analysis, working with a highly skilled team … AI, healthcare and software engineering. Responsibilities Develop and optimise ML models for medical image processing and analysis Build and integrate AI pipelines within scalable production environments Collaborate with data, clinical and software teams to ensure robust, validated outputs Skills & Experience MSc/PhD in Computer Science, Machine Learning or related discipline 3+ years’ experience developing ML models, with … on medical imaging Proven track record using deep learning frameworks (PyTorch/TensorFlow) Solid Python skills and familiarity with cloud or MLOps tools (Docker, Kubernetes, MLFlow) Understanding of data pipelines and image analysis techniques (segmentation, registration, feature extraction) Benefits Share options and private healthcare Flexible hybrid working 28 days’ holiday + bank holidays If this position seems like More ❯