1 to 25 of 33 Data Pipeline Jobs in the East of England

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern … software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that supports Computacenters combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to … deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. What youll do As a Senior Data Consultant, you will play a key role in shaping and delivering data solutions that support business strategy. You will lead More ❯

Senior Data Architect is required by this leading organisation in their field as they look to improve their enterprise and information architectures, ensuring they are robust, future-ready with a capability to support current and future business needs. The focus will be to empower data-led and AI-enhanced decision making across the organisation. You will … be required to deliver a clear, scalable data framework aligned with the overall enterprise data strategy, with an emphasis on data mesh, enabling the use of AI/GenAI within the business. Responsibilities include - Communicating the enterprise data strategy and operating model to various teams across the business Roadmap definition/strategic … GCP Data mesh Data Governance Data Lakehouse, warehouse and virtualisation concepts MDM/Metadata management ETL/ELT processes and data pipeline builds Data readiness for AI Strong understanding of business architecture Be part of a team shaping the future of data-driven technology within the organisation. More ❯

Data Platform Engineer Luton/Hybrid Company When it comes to innovation and achievement there are few organisations with a better track record. Join us and you’ll be able to play a big part in the success of our highly successful, fast-paced business that opens up Europe so that people can exercise their get-up-and … employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Data Platform Engineer joining a team of committed data specialists. As our data strategy begins to take shape, we aim to become the most data driven airline in the world. To achieve this goal, we want to use our data to improve all More ❯

As a Data Engineer at MM Flowers, you’ll help drive our digital transformation by expanding and improving our data infrastructure that powers financial and operational insight. The role will be a key enabler on the delivery of significant technology focused projects, and the continual development of the digital landscape across the business. We’re looking … to grow our data team with a skilled, proactive Data Engineer who is keen to establish strong data governance, observability practices-ensuring datasets are versioned, catalogued and fully traceable from source to output while sharing their knowledge within the data team. Working closely with the IT Team, vendors and business stakeholders, the … Data Engineer will implement a data warehousing solution that will enable better use of data and reporting driving business benefits in alignment with the wider business strategy. The ideal candidate will bring experience working with complex, datasets, a strong grasp of modern data engineering tools and best practices, and the curiosity to More ❯

Data Engineering AnalystHybrid – Ipswich (3 days onsite, Tuesday & Wednesday mandatory) Salary: £35,000–£50,000 (depending on experience) REED Technology are working with a client who have created two positions at different levels to be a key part of an exciting transition: the organisation is moving its data warehouse from Netezza to Snowflake , and building an … in-house data engineering capability for the first time. If you want to help shape a modern data platform, support critical migrations, and work closely with BI and Analytics teams to deliver high-quality data products, this role offers significant technical growth and hands-on experience. Responsibilities Supporting the migration of data … engineering, ETL/ELT development, or data warehousing. Strong SQL skills and experience with Snowflake, Netezza, or similar DW platforms. Understanding of data modelling and pipeline design. Ability to articulate technical concepts clearly. A collaborative approach—this team values people who work with others, not in isolation. Desirable Experience with cloud platforms (AWS, Azure, GCP More ❯

Data Engineering Analyst Hybrid - Ipswich (3 days onsite, Tuesday & Wednesday mandatory) Salary: £35,000-£50,000 (depending on experience) REED Technology are working with a client who have created two positions at different levels to be a key part of an exciting transition: the organisation is moving its data warehouse from Netezza to Snowflake , and building … an in-house data engineering capability for the first time. If you want to help shape a modern data platform, support critical migrations, and work closely with BI and Analytics teams to deliver high-quality data products, this role offers significant technical growth and hands-on experience. Responsibilities Supporting the migration of data … engineering, ETL/ELT development, or data warehousing. Strong SQL skills and experience with Snowflake, Netezza, or similar DW platforms. Understanding of data modelling and pipeline design. Ability to articulate technical concepts clearly. A collaborative approach-this team values people who work with others, not in isolation. Desirable Experience with cloud platforms (AWS, Azure, GCP More ❯

Senior Data Engineer – Hybrid (Hertfordshire, 1 day/week) Salary: £65,000–£75,000 + 10% discretionary bonus We’re partnering with a Private Equity–backed FMCG company. They are looking for a technically strong Senior Data Engineer to help shape and scale their data platform. The Role: You’ll play a key role … Maintain documentation, contribute to architectural decisions, and drive best practices Essential Requirements: Strong SQL skills and experience with modern cloud data warehouses (Snowflake preferred) ELT pipeline development and modern data stack understanding Solid software engineering practices (Git, testing, CI/CD) Own pipeline health, monitoring, and optimisations. API integration experience (REST APIs … Azure, or GCP Ability to work autonomously and make strong technical decisions Desirable Skills: dbt Python PostgreSQL or similar relational databases BI tools (QuickSight, Tableau, etc.) Reverse ETL, ML pipeline support, agile environment experience About You: You’re a technically strong data engineer who enjoys both hands-on implementation and the broader architectural picture. You take ownership More ❯

three-time gold investor in people award winner, an advocate of supporting women in engineering and developing their people to be the best they can be? As a data engineer specialising in generative AI; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. The opportunity: The business is looking for a Data Engineer to join an Information Management GenAI delivery Office, who will be able to evaluate design, deploy, improve and support the companies data sets. The Data Engineer will ensure data pipelines … are designed to be resilient, secure and responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. The Data Engineer will provide knowledge in data management and data quality to guarantee compliance to company More ❯

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Operations Lead Location: Watford - 3 days per week Salary: up to £83,000 + up to 15% bonus My client is seeking a hands-on Technical Lead to take ownership of data operations for a large-scale cloud-based reporting environment. You'll oversee offshore engineers, manage end-to-end data workflows, and … ensure the smooth delivery of daily data loads across multiple systems. Key Responsibilities Lead daily data operations and ensure end-to-end completion of data loads. Monitor and debug Airflow workflows, resolving issues efficiently. Manage a team of offshore data engineers, providing technical direction and support. Collaborate with stakeholders to troubleshoot data discrepancies and root-cause issues in reports. Maintain and improve data lineage and flow across AWS and Power BI reporting stacks. Work closely with business and technical stakeholders to improve data reliability and transparency. Identify opportunities for automation and process optimisation once BAU stability is achieved. Technical Environment AWS (data storage and More ❯

We’re partnering with a leading entertainment company seeking to hire a Data Engineering Manager to play a key role in their data operations and business intelligence initiatives. Key Responsibilities: Design & maintain AWS BI infrastructure (Redshift, S3, EMR) using Terraform and IaC best practices. Develop CI/CD pipelines (Jenkins, GitHub Actions) to automate ETL and … Power BI code deployments. Manage environments (Dev, QA, UAT) and automate data refreshes for accuracy and consistency. Oversee data pipelines and big data workflows (EMR, Spark) for high-performance analytics. Optimize code for ETL and Power BI (DAX, data models, refresh scheduling) to enhance performance. Implement observability and logging (CloudWatch, Grafana, ELK … for proactive system monitoring. Collaborate cross-functionally with BI, Platform, and Data teams on releases and issue resolution. Enforce security & compliance (RBAC, encryption, GDPR/HIPAA) across AWS services. Monitor performance & costs in AWS, driving optimisation and efficiency. Champion automation & innovation through new tools, frameworks, and cloud-native solutions. Key Skills: AWS Cloud: Expert in Redshift, S3, Lambda More ❯

BI Developer - London - 65,000 Are you passionate about building scalable BI solutions and working with cutting-edge data technologies? We are seeking a BI Developer to join a dynamic team and help shape the future of data analytics within a global organisation. About the role: Design and develop BI solutions using Microsoft Fabric and related … technologies. Build and manage data pipelines leveraging Data Factory. Develop semantic models in Power BI Collaborate with data architects, analysts, and stakeholders to deliver actionable insights. Optimise data models for performance and reusability. Support governance, security, and compliance best practices. Key Responsibilities Deliver scalable Azure-based data platforms, including Data Warehouses and reporting tools. Provide technical support and manage a modern technology stack (Azure Synapse, SSIS, SQL, Data Lake). Assist with migration and reconciliation of data from legacy systems or acquisitions. Act as a hands-on Data Engineer across the full stack. Requirements: Strong expertise in SQL, Power BI, and cloud More ❯

BI Developer - London - £65,000 Are you passionate about building scalable BI solutions and working with cutting-edge data technologies? We are seeking a BI Developer to join a dynamic team and help shape the future of data analytics within a global organisation. About the role: Design and develop BI solutions using Microsoft Fabric and related … technologies. Build and manage data pipelines leveraging Data Factory. Develop semantic models in Power BI Collaborate with data architects, analysts, and stakeholders to deliver actionable insights. Optimise data models for performance and reusability. Support governance, security, and compliance best practices. Key Responsibilities Deliver scalable Azure-based data platforms, including Data Warehouses and reporting tools. Provide technical support and manage a modern technology stack (Azure Synapse, SSIS, SQL, Data Lake). Assist with migration and reconciliation of data from legacy systems or acquisitions. Act as a hands-on Data Engineer across the full stack. Requirements: Strong expertise in SQL, Power BI, and cloud More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working … treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and … responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working … treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and … responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role More ❯

Data Engineering Lead - Hybrid - Azure/Databricks - London Permanent Salary: £90,000 Are you a seasoned Data Engineering professional ready to lead the charge in building scalable, high-performance data platforms? An industry leading, global firm is seeking a Data Engineering Lead to drive innovation across their hybrid Azure/Databricks environment. … About the role: Shape data strategy for global projects Lead a talented team of BI Developers Enjoy a flexible working culture and industry-leading benefits Work with cutting-edge tech in a collaborative, inclusive environment Key Responsibilities: Architect and optimize robust data pipelines for large-scale ingestion, transformation, and delivery Leverage Azure and Databricks to enable … seamless data integration and enrichment Implement best practices for orchestration, monitoring, and error handling Lead and mentor a BI team, ensuring timely delivery of dashboards and data products Champion data governance, quality, and security across platforms Requirements: Proven expertise in Azure, SQL, Databricks, and Azure Data Factory Experience implementing medallion architecture frameworks More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Robotics Software Design Engineer - C PostgreSQL Are you an experienced Software Engineer with a strong background in C++ development and data systems for robotics? Are you based in the Cambridge area, or keen to join one of the UK's leading hubs for robotics and technology innovation? If so, our client an innovative "tech for good" start-up … Developing and optimising C++ code to acquire, report, and aggregate data in real time on constrained robotics hardware platforms Taking full ownership of the data pipeline from robot to cloud PostgreSQL databases Defining and implementing strategies for data ingestion and analysis including how, when, and where data is stored and transferred … Designing and maintaining the cloud interface for robotic data system Collaborating with robotics, electronics, and software teams in an Agile environment To apply for this Robotics Software Design Engineer - C PostgreSQL you should have: A degree or master's in Software Engineering, Computer Science, Robotics, or a related field Proven experience developing in modern C++ (C++14 or later More ❯

Robotics Software Design Engineer - C++/PostgreSQL Are you an experienced Software Engineer with a strong background in C++ development and data systems for robotics? Are you based in the Cambridge area, or keen to join one of the UK's leading hubs for robotics and technology innovation? If so, our client an innovative 'tech for good' start … Developing and optimising C++ code to acquire, report, and aggregate data in real time on constrained robotics hardware platforms Taking full ownership of the data pipeline from robot to cloud PostgreSQL databases Defining and implementing strategies for data ingestion and analysis including how, when, and where data is stored and transferred … Designing and maintaining the cloud interface for robotic data system Collaborating with robotics, electronics, and software teams in an Agile environment To apply for this Robotics Software Design Engineer - C++/PostgreSQL you should have: A degree or master's in Software Engineering, Computer Science, Robotics, or a related field Proven experience developing in modern C++ (C++14 or More ❯

emissions for a cleaner, brighter future. The role: As a Senior SAP Functional Business Analyst, you will help drive our goals by: Acting as a bridge between the data team (e.g., SAP BW, data engineering, and BI reporting colleagues), the business, and the SAP technical team by helping to build the data foundation and … develop reporting solutions based on SAP processes and data flows. Engaging directly with business stakeholders to understand and clarify reporting and analytics requirements, primarily in the finance (Record-to-Report) domain, and translating them into technical specifications aligned with SAP Business Warehouse (BW/4HANA) and SAP Analytics Cloud (SAC) architecture and development standards. Analysing SAP ERP (ECC … transactions to identify relevant extractors, tables, and logic for reporting, while acting as a subject matter expert in Financial and other SAP processes, transaction flows, and data structures. Collaborating with data team to design, develop, and validate robust data pipelines and models, ensuring data integrity, consistency, and completeness through validation against ECC More ❯

emissions for a cleaner, brighter future. The role: As a Senior SAP Functional Business Analyst, you will help drive our goals by: Acting as a bridge between the data team (e.g., SAP BW, data engineering, and BI reporting colleagues), the business, and the SAP technical team by helping to build the data foundation and … develop reporting solutions based on SAP processes and data flows. Engaging directly with business stakeholders to understand and clarify reporting and analytics requirements, primarily in the finance (Record-to-Report) domain, and translating them into technical specifications aligned with SAP Business Warehouse (BW/4HANA) and SAP Analytics Cloud (SAC) architecture and development standards. Analysing SAP ERP (ECC … transactions to identify relevant extractors, tables, and logic for reporting, while acting as a subject matter expert in Financial and other SAP processes, transaction flows, and data structures. Collaborating with data team to design, develop, and validate robust data pipelines and models, ensuring data integrity, consistency, and completeness through validation against ECC More ❯

A fantastic opportunity has arisen for a Data Engineer specialising in Generative AI to join a developing international and transversal structure, supporting the design, build, and maintenance of data sets for internal customers across the organisation. Please note that due to the nature of the client’s business, only candidates who currently hold full sole British … Citizenship (without limitations) will be considered. This role performs the duties of a Data Engineer and reports to the IM GenAI Delivery Office Lead. Key Responsibilities: Evaluate, design, deploy, and support data pipelines and data sets to ensure they are resilient, secure, and responsive. Collaborate with internal customers to optimise and secure data for their specific needs. Provide expertise in data management, quality, and governance to ensure compliance with organisational standards. Stay up to date with new technologies, contributing to the technology roadmap and delivering innovative solutions. Support and maintain data sets for internal customers, ensuring sustainability and long-term usability. The ideal candidate would have: Experience More ❯

Data Engineer Watford | £85,000 + Excellent Benefits | Office-Based The Opportunity An excellent opportunity for a talented Data Engineer to join a well-established and growing financial services organisation based in Watford . Offering a salary of £85,000 plus a superb benefits package , this role is ideal for someone seeking a technically hands-on … position within a forward-thinking and data-driven environment. The company has been operating successfully for over 20 years, employs more than 300 staff, and is recognised as a market leader in specialist financial services. You'll be joining a collaborative data team where innovation, accuracy, and analytical thinking are highly valued. Duties & Responsibilities Design, build … and maintain robust data pipelines and reporting solutions using modern cloud technologies. Work closely with senior leadership to shape data and reporting strategies. Develop and enhance MI & BI reports, ensuring accuracy and integrity across all data outputs. Collaborate with Product Owners, Developers, and other technical teams to support business goals. Mentor junior members of More ❯