1,901 to 1,925 of 2,759 Data Pipeline Jobs in the UK

Hometrack is seeking a Senior Data Engineer to join our Data Services product team in London. You will help deliver data platforms and datasets powering our market-leading AVM, serving mortgage lenders, builders and utilities alike. The role emphasizes scalable data products … collaboration, and robust data governance. Hybrid working with 2 days per week in the London Bridge office; you will write maintainable code, review peers, and optimize ETL and data pipelines to ensure accuracy, #J-18808-Ljbffr ...

measure and monitor system performance, accuracy, and reliability Build and maintain production‐grade AI applications with clean code, appropriate error handling, APIs, and data pipelines Experience implementing, maintaining and evaluating retrieval systems (vector/graph databases, ingestion pipelines, chunking strategies, retrieval techniques such as HyDE) Implement feedback loops … testing frameworks, and deployment pipelines Solid foundations and understanding of production‐grade, cloud‐native platform and infrastructure requirements, design, and implementation. Strong data manipulation skills (pandas, SQL) and understanding of evaluation strategies for LLM‐based systems Ability to work with ambiguity and optimise non‐deterministic systems through ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

This role will focus on enhancing and maintaining data pipelines to process financial and ESG data.What this role will do:• Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines … agile framework to prioritize tasks, manage time effectively, and align with team goals. Act as a proactive contributor to cross-functional collaboration with data scientists, analysts, and other stakeholders.Skills required:• Degree in computer science, engineering, mathematics, quantitative methods or related field.• Substantial experience in developing and maintaining production ...

Carnall-Farrar is seeking a Lead Platform Engineer in the UK to steer the data platform architecture and delivery. The role entails mentoring the data engineering team, translating architectural direction into implementable designs, and ensuring security and regulatory compliance across NHS data pipelines. … will collaborate with the Director of Data, Analytics and Intelligence, support partnerships with Databricks and other data organisations, and drive platform standards while delivering #J-18808-Ljbffr ...

catalogue of capability The orchestrator, and the resource model that tracks consumables and instruments as a live digital twin of the lab The capture pipeline that structures the data coming off the floor, with audit logging on every action and edit so nothing is unaccounted … what the lab produces. Your first 90 days FIRST 30 DAYS Get productive in the codebase and ship your first change into the execution pipeline, following the team’s review and deployment practices. Take ownership of a service or surface within the team. DAYS 30 TO 60 Ship ...

with research staff to advance our quantitative trading strategies. You will translate novel research ideas into production-quality code, build and maintain the data pipelines and modeling infrastructure that underpin our strategies, and apply your own strong mathematical intuition to solve open-ended technical challenges. This role lives … standard. Responsibilities Partner with PhD researchers to design, implement, and productize machine learning models that drive quantitative trading strategies Develop and maintain complex data pipelines, including data ingestion, feature engineering, validation, and quality monitoring Translate research prototypes and novel ideas into performant, well-tested, production-ready ...

experience and will be assessed in line with the candidate’s skills, knowledge, and relevant expertiseThe Role...We’re looking for an Audience Data Growth Manager to drive the expansion of Hearst UK’s contactable audience database. This role is focused on acquiring high-quality, permissioned consumer data … wider marketing activity across our portfolio of brands.You’ll sit at the intersection of marketing, partnerships, and performance, identifying, testing, and scaling new data acquisition opportunities while balancing volume, quality, and cost-efficiency. You’ll own the roadmap for audience growth initiatives and ensure alignment with downstream conversion ...

product - talk to customers and align directly on what success looks like and how it’s measured. You’ll use raw, real-world data to form clear, actionable insights. Directly optimise the performance of our agent, tuning and improving it against those metrics for every customer we onboard. … optimisation flow end to end - you’ll use data to translate opportunities into tangible improvements in our agent, and close the loop by delivering and demonstrating that value. Get obsessive with the data: understand the data at the lowest level, then leverage this ...

maintaining existing solutions. Working closely with developers, business analysts and stakeholders across the business, you'll help transform business requirements into practical, data-driven solutions that support decision making and drive operational improvements. As a Lead SQL Developer, You Will Analyse business requirements and translate them into database … maintain SQL queries, stored procedures, scripts and database objects. Build and support integrations between internal and third-party systems. Integrate, transform and validate data for reporting and operational processes. Investigate and resolve data, reporting, performance and integration issues. Document data flows and technical changes. ...

looking for an Azure Full Stack Engineer - Cosmos DB to join a major cloud and data engineering programme in London. This is a 6-month contract with a hybrid working model, requiring 1-3 days onsite. The role combines full stack development with modern Azure data engineering, giving you the opportunity to work on scalable applications and critical data components. You'll work closely with solution architects and DevOps teams, helping integrate Cosmos DB into cloud-native and microservices-based solutions while maintaining strong performance, security and data standards. ...

global financial institution based in London seeks a Data Engineer for the Lakehouse and AI Data Platform. In this role, you'll design, build, and support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with ...

OrderYOYO is seeking a Senior Data & AI Platform Engineer to own the modern data platform, migrating to a governed Microsoft Fabric layer, and to lead data engineering with AI-enabled capabilities. You will mentor engineers, design semantic models, and ensure reliable data pipelines across CRM and analytics reporting. The role focuses on data governance, scalable architecture, and senior leadership for data delivery during a critical growth phase. #J-18808-Ljbffr ...

Cleared Data Engineers Wanted - Mid to Senior | AWS/Data Platforms | UK (Hybrid) £55,000 – £70,000 + bonus + benefits | Bristol/Manchester (hybrid) Active SC or DV Clearance Required I'm working with a successful multinational tech consultancy that has secured a number … long-term client programmes and is now looking to bring in several DV Cleared Data Engineers, from mid to senior level, to meet that demand. If you're SC or DV cleared and have built your career on AWS, this is one where that depth gets used properly. ...

with plenty of scope to improve automation, Infrastructure as Code and engineering standards. You'll also get exposure to Microsoft Fabric and modern data platforms as they become an increasingly important part of the organisation's technology estate. What you'll be doing Taking ownership of engineering across … security controls Working with technologies including Azure Policy, Key Vault, Private Endpoints and Defender Supporting the engineering platform behind Microsoft Fabric and modern data workloads Leading technical projects and influencing cloud architecture decisions Helping replace legacy and manual processes with modern, automated solutions Acting as a senior technical ...

with research staff to advance our quantitative trading strategies. You will translate novel research ideas into production-quality code, build and maintain the data pipelines and modeling infrastructure that underpin our strategies, and apply your own strong mathematical intuition to solve open-ended technical challenges.This role lives … high engineering standard.ResponsibilitiesPartner with PhD researchers to design, implement, and productize machine learning models that drive quantitative trading strategiesDevelop and maintain complex data pipelines, including data ingestion, feature engineering, validation, and quality monitoringTranslate research prototypes and novel ideas into performant, well-tested, production-ready codeBuild extensible ...

Jobtailor in London is seeking an experienced Data Engineer to build and maintain ingestion pipelines into the data warehouse, orchestrate data flows, and manage AWS infrastructure as code with Terraform. You will connect HR and payroll data pipelines, ensure secure, reliable data ...

Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team. The ideal ...

Senior Azure Data Engineer Thatcham (Hybrid, Minimum 2 Days Per Week Onsite) Commutable from Reading, Basingstoke, Newbury, Andover and surrounding areas. Up to £67,000 + 10% Non-Contributory Pension + 29 Days Holiday + Bank Holidays + Hybrid Working + Excellent Benefits Are you an experienced Azure … cloud projects, the opportunity to shape technical direction, and the chance to help upskill a growing team within an ambitious and rapidly expanding data division? This is an excellent opportunity to join a collaborative and fast-growing data team within an established research organisation that ...

Senior Azure Data Engineer Thatcham (Hybrid, Minimum 2 Days Per Week Onsite) Commutable from Reading, Basingstoke, Newbury, Andover and surrounding areas. Up to £67,000 + 10% Non-Contributory Pension + 29 Days Holiday + Bank Holidays + Hybrid Working + Excellent Benefits Are you an experienced Azure … cloud projects, the opportunity to shape technical direction, and the chance to help upskill a growing team within an ambitious and rapidly expanding data division? This is an excellent opportunity to join a collaborative and fast-growing data team within an established research organisation that ...

discovery, Digital Asset Management (DAM), Product Information Management (PIM), and internal SAP/HANA systems. The role will design and develop APIs, services, data flows, and integrations that allow these platforms to work together reliably at scale. A defining requirement for this position is an AI-native development … ready E-commerce Systems Integration: Integrate key e-commerce capabilities including personalization platforms, semantic/LLM search and discovery, DAM, PIM, analytics and data services, and other modular components as the e-commerce ecosystem evolves Enterprise Data & ERP Integration: Build and maintain reliable integrations between ...

AtkinsRéalis is seeking an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines on the Microsoft Azure platform. You will optimise data storage, processing, and enable data-driven decision-making for diverse client projects. The role requires expertise … Azure data services, ETL/ELT patterns, and collaborating with stakeholders to deliver robust solutions in a fast-paced agile environment. Some on-site work at client sites is required. #J-18808-Ljbffr ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...