17 of 17 Data Pipeline Jobs in the East of England

efficient data processing, storage and retrieval. You will work closely with cross-functional teams to analyse requirements, propose new data pipeline architectures, and implement solutions to improve performance and scalability. The tasks for this post include the following: Analyse existing data pipelines … optimisation, and scalability. Work closely with Bioinformaticians and annotators to integrate data pipelines with existing systems and applications. Monitor data pipeline performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency. Stay current with industry trends and best practices in data engineering ...

Data Engineer Long Stratton, Norwich, Norfolk £56,000 per annum Full Time: 37hrs per week Saffron is looking for a talented Data Engineer to help drive the next stage of our data transformation. This role is all about building and optimising our Azure-based … Pipelines). Apply CI/CD practices (e.g., Azure DevOps) for version control, deployment automation, and environment management. Implement data quality checks, pipeline observability, alerting, and automated monitoring to ensure consistent platform reliability. Work collaboratively with data owners and the wider data team ...

Data Engineer Long Stratton, Norwich, Norfolk £56,000 per annum Full Time: 37hrs per week Saffron is looking for a talented Data Engineer to help drive the next stage of our data transformation. This role is all about building and optimising our Azure-based … Engineering, Pipelines). Apply CI/CD practices (e.g., Azure DevOps) for version control, deploymentautomation, and environment management. Implement data quality checks, pipeline observability, alerting, and automatedmonitoring to ensure consistent platform reliability. Work collaboratively with data owners and the wider data team ...

Conduct detailed business and process analysis, identifying current-state challenges and defining future-state processes Translate business needs into clear, structured functional and data requirements Support the design and implementation of MDM solutions, including data domains such as products, suppliers, recipes, and locations Collaborate with data, technical, and integration teams to ensure requirements are feasible and correctly implemented Develop process maps, data flows, and business documentation (BRDs, user stories, etc.) Facilitate workshops, stakeholder interviews, and playback sessions Support data governance initiatives, including data standards, definitions, and quality rules ...

client, a prominent entity in the Defence and Security sector, is currently seeking a dedicated Data Engineer to join their team in a permanent capacity. Key Responsibilities: Build, configure, and maintain a modern cloud-based data platform in alignment with architectural blueprints and design standards. Develop … robust data pipelines that ingest, transform, and publish data from multiple source systems into trusted reporting layers. Ensure solutions support financial reporting requirements including accuracy, completeness, auditability, and traceability. Collaboration & Technical Input: Work closely with Data Architects to refine designs, challenge assumptions, and contribute ...

Data Engineer - Huntingdon - Attractive package ALH Recruitment are looking to recruit a Data Engineer with immediate effect for our industry leading client, based in the Huntingdon area of Cambridgeshire. Data Engineer - Role Purpose As part of their continued growth, we are seeking a Data … Database Administration (DBA) to join their dynamic team. You will play a pivotal role in the reporting, design, development, and optimisation of their data infrastructure. You will be responsible for managing and reporting on the databases, building robust data pipelines, and ensuring the integrity and performance ...

work with some of the most recognised brands in travel as well as major insurance aggregators. About the role The Head of Data Science will lead Pikl’s data science strategy, advanced analytics capability, and decision intelligence roadmap. This is a technical leadership role with … oversee the end-to-end development and deployment of machine learning models and predictive analytics, while also managing the Business Intelligence (BI) and Data Analysis functions. This is a high-impact role requiring a balance of rigorous technical execution and strategic leadership to ensure Pikl harnesses data ...

complex environments. Support and develop capability in Elastic Stack/Elastic Security, with training and upskilling provided as needed. Design, implement and maintain data pipelines, including log ingestion, enrichment and schema standardisation. Develop and tune security detection content, translating threat intelligence and TTPs aligned to MITRE … designing and optimising detection content, including MITRE ATT&CK-aligned use cases and alert tuning to reduce noise. Good understanding of data pipeline engineering, log enrichment, data quality and large-scale ingestion architectures. Strong knowledge of SPL; experience with KQL and EQL would be beneficial ...

Data Engineer Hertfordshire (Hybrid, 2 days in the office) £45,000 - £55,000 + benefits I’m working with a well-established travel business, who are looking to hire a Data Engineer to support their growing digital and marketing function. This is a unique opportunity … join a lean, high-impact team where you’ll play a key role in shaping how data is used across the business. You’ll work closely with marketing stakeholders to extract, transform, and automate data from multiple sources, helping drive performance improvements and better decision-making. ...

observability and cloud infrastructure across the organisation Lead architecture across metrics, logs, and tracing systems Design and optimise high-throughput data pipelines and storage layers Implement strategies such as sampling, aggregation, and down-sampling Extend and enhance open-source observability tools at scale Partner with engineering teams ...

observability and cloud infrastructure across the organisation Lead architecture across metrics, logs, and tracing systems Design and optimise high-throughput data pipelines and storage layers Implement strategies such as sampling, aggregation, and down-sampling Extend and enhance open-source observability tools at scale Partner with engineering teams ...

Overview We are seeking an experienced Data Platform Solution Architect to lead the design and implementation of scalable, cloud-native data platforms in Basildon . This role will focus on building modern lakehouse architectures leveraging AWS and Snowflake, ensuring high performance, reliability, and governance across enterprise … data ecosystems. Key Responsibilities Design and deliver end-to-end data platform architecture using Snowflake, AWS, and modern lakehouse principles Produce high-quality Architecture Design Documents (ADDs) and technical blueprints Architect and optimise data pipelines using Airflow/MWAA and dbt Define and implement ...

require a minimum of 3 days per week on site in central Cambridge. The key experience required for this Bioinformatician position is: CRISPR Data pipelines Python or R Support lab scientists If you do have the relevant skills for this Bioinformatician Engineer contract position, please do apply. ...

within Birketts’ core ecosystem, including Microsoft 365 (Copilot), iManage (Document Management), Aderant Expert (Practice Management), Intapp Intake (new client onboarding) and Microsoft Fabric (data platform). Azure is a likely hosting platform for any future ‘Birketts-approved AI environment’, subject to requirements and build vs buy decisions. … repeatable AI-enabled workflows. This role is delivery-oriented: you will design, build and ship incremental improvements, partnering with colleagues across Development, Data, Security, Knowledge Management and Learning & Development to drive adoption, skills sharing and effective change management. You will also support evidence-based build vs buy decisions ...

building production-ready AI systems using LLMs, this role offers high ownership and the chance to shape how AI is applied in critical, data-intensive domains. The Role: Design, build, and deploy agentic AI systems within a scalable, production environment. This is a hands-on engineering role with … Strong experience building production AI/ML systems Experience with LLMs and agentic AI frameworks Proficiency in Python and working with APIs/data pipelines Experience working with structured or enterprise data Ability to operate in a fast-paced, high-ownership environment If this role ...

role is 100% on site. The successful candidate will join our development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real … time data flows, and complex multi-threaded processing pipelines. Proficient in C++ and with knowledge of C#, you will play a critical part in the design, development, integration, and verification of test software solutions that are central to our system validation and delivery capabilities. Responsibilities: Design and develop ...

highly applied role where you'll move quickly from concept to production, building systems that automate complex knowledge work such as literature review, data extraction, and target identification, while working closely with ML researchers, engineers, and scientists in a fast-paced, collaborative environment. You'll be responsible … development, testing, and deployment processes. You'll work across Python, LLMs, LangGraph, Pydantic AI, Crew AI, APIs, cloud platforms (GCP preferred), microservices, and data pipelines, contributing to scalable, high-performance AI solutions. We're looking for strong engineers with experience building production-grade systems in Python, integrating ...