1 to 25 of 29 Data Pipeline Jobs in the East of England

Head of Data & AI Permanent Opportunity Ipswich, UK (Hybrid 3 days in office) Visa Sponsorship not available We are partnering with a well-established organisation based in Ipswich, UK , undergoing a major data and AI transformation. They are seeking a highly skilled and visionary Head … Architecture, Platforms & Engineering Lead transition to modern, scalable, and resilient data platforms. Oversee secure, reliable, and scalable data pipeline architecture. Ensure robust implementation and operation of secure data infrastructure. Data Governance Implement strong governance frameworks covering stewardship, metadata ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

DevOps practices to deliver reliable, high quality, and timely data for analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability … platform operations using DataOps/DevOps practices Ensure high availability and reliability of data platforms (cloud or on prem) Troubleshoot pipeline failures and perform root cause analysis (RCA) 3. Automation & CI/CD Implement CI/CD pipelines for data workflows Automate testing ...

data engineering by providing insights, feedback, and technical recommendations that align with organisational goals.* Troubleshooting issues related to data integration, pipeline performance, and platform dependencies.* Working closely with other engineers and business users to understand requirements, translate them into technical specifications, and deliver effective solutions. … mindset enable you to address technical challenges efficiently while considering broader business impacts.* Demonstrated ability to design lakehouse architectures.* Experience implementing CI/CD pipeline management for reliable solution delivery. Robert Walters are proud to specialise in BI & Data recruitment across the UK, offering amazing opportunities ...

Title: Data Engineer Location: Cambridge (Hybrid - 2-3 days per week in office) Industry: SaaS/Technology Salary: £55,000 - £65,000 DOE The Opportunity I'm working with a fast-growing SaaS company in Cambridge that is looking to hire a Data Engineer to join … their expanding data and analytics team. This role is ideal for someone who enjoys building scalable data pipelines, designing ETL processes, and ensuring high-quality, reliable data for analytics and reporting . You'll work with product, engineering, and analytics teams to deliver data ...

client, a prominent entity in the Defence and Security sector, is currently seeking a dedicated Data Engineer to join their team in a permanent capacity. Key Responsibilities: Build, configure, and maintain a modern cloud-based data platform in alignment with architectural blueprints and design standards. Develop … robust data pipelines that ingest, transform, and publish data from multiple source systems into trusted reporting layers. Ensure solutions support financial reporting requirements including accuracy, completeness, auditability, and traceability. Collaboration & Technical Input: Work closely with Data Architects to refine designs, challenge assumptions, and contribute ...

Data Engineer | Ipswich (Once a month onsite) | £65,000-£80,000 Peaple Talent have partnered with a fast-growing, award-winning SaaS organisation operating in the secure payments and customer engagement space. Due to continued growth, they’re now looking for an AWS Data Engineer … driven solutions Key Requirements Strong AWS experience (S3, Glue, Lambda, Athena, Redshift, DynamoDB) Python and SQL expertise Knowledge of ETL and data pipeline design Familiarity with GitLab and Infrastructure as Code (Terraform/CloudFormation) What’s on Offer 💰 Salary: £65,000-£80,000 📍 Location: Ipswich (Once ...

Senior Data Analyst Location: Peterborough (HQ) Company: Trade Mastermind & Valente Consulting Employment: Full-Time Salary: £50 000-£60 000 We are seeking a highly capable Senior Data Analyst/Data & Insights Manager to take full ownership of our data function across … opportunities, and identify operational inefficiencies. You will support senior leaders with data-driven recommendations, forecast models, LTV analysis, CAC optimisation, and sales pipeline projections. You will also be responsible for segmentation, data list management, CRM uploads, dialler data operations, and ensuring all activity ...

Data Engineer Hertfordshire (Hybrid, 2 days in the office) £45,000 - £55,000 + benefits I'm working with a well-established travel business, who are looking to hire a Data Engineer to support their growing digital and marketing function. This is a unique opportunity … join a lean, high-impact team where you'll play a key role in shaping how data is used across the business. You'll work closely with marketing stakeholders to extract, transform, and automate data from multiple sources, helping drive performance improvements and better decision-making. ...

delivery of enterprise-scale business intelligence solutions. This role combines deep technical expertise with leadership responsibility, playing a key part in modernising data platforms and delivering high-quality analytics across global operations. Key Responsibilities Architect, design, develop, and maintain enterprise-level Power BI reports and datasets Build … govern advanced data models (star schema, dimensional modelling, enterprise structures) Optimise datasets, composite models, and DAX performance for scalability Lead ETL/ELT design within Microsoft Fabric Lakehouse architecture Develop and orchestrate data pipelines across ingestion, transformation, and modelling layers Optimise and monitor data ...

observability and cloud infrastructure across the organisation Lead architecture across metrics, logs, and tracing systems Design and optimise high-throughput data pipelines and storage layers Implement strategies such as sampling, aggregation, and down-sampling Extend and enhance open-source observability tools at scale Partner with engineering teams ...

observability and cloud infrastructure across the organisation Lead architecture across metrics, logs, and tracing systems Design and optimise high-throughput data pipelines and storage layers Implement strategies such as sampling, aggregation, and down-sampling Extend and enhance open-source observability tools at scale Partner with engineering teams ...

travel to travel to the Dunstable office when required to. Key Responsibilities Architect, develop, and maintain Power BI dashboards, datasets, and advanced data models Be the key point of contact for all PowerBI, MS Fabric, SQL and other BI Development issues Mentor and train junior BI Developers … best practices and methodologies Lead ETL/ELT development within a modern cloud-based data platform Build and optimise data pipelines across ingestion, transformation, and modelling layers Ensure data quality, governance, and performance across BI solutions Collaborate with cross-functional teams ...

Role: Data Engineer Location: Ipswich/London - (1 day a fortnight) Salary: Up to £80,000 DOE We're partnering with a growing, tech-driven business that's investing heavily in its data platform and looking for an AWS Data Engineer to play … role in its evolution. This is a genuinely exciting opportunity to take ownership of an existing AWS data environment and shape it into a scalable, best-in-class platform that supports real business decisions across Product, Finance, and Operations. You'll be working hands-on with tools like ...

Overview We are seeking an experienced Data Platform Solution Architect to lead the design and implementation of scalable, cloud-native data platforms in Basildon . This role will focus on building modern lakehouse architectures leveraging AWS and Snowflake, ensuring high performance, reliability, and governance across enterprise … data ecosystems. Key Responsibilities Design and deliver end-to-end data platform architecture using Snowflake, AWS, and modern lakehouse principles Produce high-quality Architecture Design Documents (ADDs) and technical blueprints Architect and optimise data pipelines using Airflow/MWAA and dbt Define and implement ...

require a minimum of 3 days per week on site in central Cambridge. The key experience required for this Bioinformatician position is: CRISPR Data pipelines Python or R Support lab scientists If you do have the relevant skills for this Bioinformatician Engineer contract position, please do apply. ...

reporting tools. Some of the main responsibilities of the Power BI Analyst will include: Develop, maintain, and enhance Power BI dashboards and data models to support Quality performance monitoring and informed project decision-making. Produce weekly, monthly, and quarterly performance reports that deliver clear, actionable insights to Quality … Leadership. Ensure the integrity, accuracy, and validation of all Quality data, guaranteeing alignment with actual project progress and performance. Lead the analysis, interpretation, and presentation of complex datasets across multiple Quality reporting disciplines. Identify trends, anomalies, and root causes, supporting the development and implementation of improvement action plans ...

Implement monitoring using CloudWatch, Grafana, Prometheus, or OpenTelemetry. Enforce integration security practices: Authentication/Authorization IAM policies Encryption at rest/in transit Data governance & lineage Ensure solutions meet RPO, RTO, resiliency, disaster recovery, and failover requirements. Establish observability using tracing, logging, alerting, and dashboards. Collaborate with product … consumer groups Kafka Streams, ksqlDB Schema Registry & Avro/JSON/Protobuf Kafka Connect connectors Deep expertise in AWS streaming & messaging: Amazon Kinesis Data Streams, Firehose EventBridge (rules, event buses, routing) SQS/SNS with dead letter queues AWS Lambda event-based integrations Experience designing event-driven ...

through to clinical development. They are looking for an Informatics Specialist (2-year FTC) to play a key role in shaping how scientific data is captured, structured, and shared across research teams. This backend-focused role will centre on database systems, APIs, and data pipelines, with … particular emphasis on integrating Electronic Lab Notebook (ELN) platforms—building solutions to extract, transform, and transfer data between systems to support collaboration and downstream research. In this role, you’ll collaborate closely with scientists and technical teams to design and deliver scalable data solutions, helping ...

Role/Job Title: Data Ops Engineer Work Location: Norwich 3 Days (Flexible) Duration of Assignment: 06 Months The Role A Data Ops Engineer is responsible for designing, automating, and optimizing data pipelines and ensuring smooth data flow across the organization. … role bridges data engineering, operations, and DevOps practices to deliver reliable, high quality, and timely data for analytics, reporti click apply for full job details ...

provide Role Summary The successful candidate will own day-to-day technical work spanning research platform development, evaluation pipelines, human-study support, data readiness for downstream research and development, and the effective use of agentic coding workflows to improve research quality and pace. The role is central … next phase of the project, ensuring that community input can be collected, evaluated, processed, and incorporated into the wider ML research and engineering pipeline while working closely with researchers, engineers, and community partners in an inclusive, multidisciplinary environment. Key Responsibilities Lead development and maintenance of the Community Library Creator ...

within Birketts’ core ecosystem, including Microsoft 365 (Copilot), iManage (Document Management), Aderant Expert (Practice Management), Intapp Intake (new client onboarding) and Microsoft Fabric (data platform). Azure is a likely hosting platform for any future ‘Birketts-approved AI environment’, subject to requirements and build vs buy decisions. … repeatable AI-enabled workflows. This role is delivery-oriented: you will design, build and ship incremental improvements, partnering with colleagues across Development, Data, Security, Knowledge Management and Learning & Development to drive adoption, skills sharing and effective change management. You will also support evidence-based build vs buy decisions ...

ensuring robust device compliance aligned with Zero Trust principles. Harden AKS clusters through RBAC, secrets management, and runtime protection. Secure AI/ML data pipelines and models, implementing guardrails for model integrity and protection against prompt-injection threats. Cloud & Network Security Engineer secure configurations across Cisco Meraki infrastructure … Security, Defender, Sentinel, and AKS. Strong background in cloud security engineering, automation, and IaC. Experience with Zero Trust, endpoint security, CI/CD pipeline security, and modern cloud-native controls. Ability to lead through influence and technical authority rather than traditional line management. A problem-solver who thrives ...

decision-making, and unlock productivity across business functions like Finance, HR, and Operations. This is a client-facing delivery role within a leading Data & AI transformation consultancy, working alongside world-class data scientists, engineers, and strategists to move ideas from concept to production. The Role Lead … stakeholders to identify high-value AI opportunities and shape product roadmaps. Translate requirements into actionable user stories and acceptance criteria for engineering and data teams. Collaborate closely with teams building solutions using RAG pipelines, LLMs, embeddings, and API integrations. Define and track KPIs such as accuracy, latency, adoption ...

devices in the field. Key Responsibilities Develop and maintain scalable backend services using Python (Django) and AWS Design and build robust APIs and data models for both internal and customer-facing applications Work with IoT communication protocols (e.g. MQTT, HTTP) to integrate with field devices Contribute … development of frontend interfaces using React Build and optimise pipelines for ingesting and querying large-scale time-series data Collaborate with cross-functional teams including hardware and edge engineering Troubleshoot and resolve production issues in a fast-paced environment Contribute to system design, architecture discussions, and technical decision ...