1,676 to 1,700 of 2,479 Data Pipeline Jobs in the UK

approach allows our clients to enjoy benefits such as rapid innovation and development cycles. Our focus areas are both application workload migration and data migrations into platforms engineered on GCP. Go Reply is a Google Cloud Premier Partner with over 100 GCP engineers across our European practice. … with Cloud Architects and delivery teams, you will translate architectural designs into production‐ready solutions on Google Cloud Platform. The role spans infrastructure, data, and AI workloads, with a primary focus on engineering while also contributing to solution design discussions and supporting client engagements with technical expertise. ...

bodies and academia can share resources and knowledge, to codevelop and grow businesses, fast. We support technology-focused start ups, each with unique data management challenges, and are seeking an experienced Storage Architect to help them design, deploy and maintain high-performance storage systems for their … data-driven workloads. The successful candidate will combine deep experience architecting and managing distributed, cloud, and tiered storage solutions with strong Linux and automation skills. In this role you will: Design, implement, and maintain storage platforms that support large-scale AI and data pipelines Manage distributed ...

NextGenEnergyJobs is seeking a full-time data engineer to establish the flexibility team's data capability and set its technical direction within an AWS-based environment. You will upskill data-literate backend engineers, act as the team's data expert, and drive … scalable, reusable data pipelines and APIs using Django/FastAPI where appropriate. You'll maintain and evolve the data warehouse with Databricks, champion DataOps practices, and ensure robust, globally scalable data applications across #J-18808-Ljbffr ...

looking for a Staff Engineer to lead the technical delivery of complex software, data, and AI projects, focusing on the Defence sector. This role combines deep technical expertise with project leadership and client engagement. You will quickly grasp new problem spaces, work with domain experts, and deliver robust … projects, making sound engineering decisions. Oversee the delivery of high-quality, maintainable and production-ready code. Design and develop backend services, APIs, data pipelines and integrations. Build AI systems, including solutions using Large Language Models and machine learning. Review code and technical designs Apply software engineering best practice ...

Unisys in Milton Keynes is seeking a Senior Data Engineer to design and implement data pipelines, develop ML models, and translate business needs into technical solutions. You will work with stakeholders to understand requirements and leverage AI/LM technologies to deliver actionable insights. The role … involves collaborating with data scientists and engineers, and communicating findings to varied audiences while staying aligned with enterprise data governance and quality practices. #J-18808-Ljbffr ...

DATA, Inc. is seeking a senior data engineer in the United Kingdom to lead client engagements, design and implement data pipelines on the Databricks platform, and shape cloud-native data architectures for enterprise-scale solutions. You will own data modelling … governance, and security, mentor engineers, and collaborate with architects and analytics leadership to deliver scalable, lakehouse-based data solutions. #J-18808-Ljbffr ...

Hometrack is seeking a Senior Data Engineer to join our Data Services product team in London. You will help deliver data platforms and datasets powering our market-leading AVM, serving mortgage lenders, builders and utilities alike. The role emphasizes scalable data products … collaboration, and robust data governance. Hybrid working with 2 days per week in the London Bridge office; you will write maintainable code, review peers, and optimize ETL and data pipelines to ensure accuracy, #J-18808-Ljbffr ...

measure and monitor system performance, accuracy, and reliability Build and maintain production‐grade AI applications with clean code, appropriate error handling, APIs, and data pipelines Experience implementing, maintaining and evaluating retrieval systems (vector/graph databases, ingestion pipelines, chunking strategies, retrieval techniques such as HyDE) Implement feedback loops … testing frameworks, and deployment pipelines Solid foundations and understanding of production‐grade, cloud‐native platform and infrastructure requirements, design, and implementation. Strong data manipulation skills (pandas, SQL) and understanding of evaluation strategies for LLM‐based systems Ability to work with ambiguity and optimise non‐deterministic systems through ...

Bedrock, LangChain, HuggingFace Transformers, or OpenAI API. Design prompt templates and implement retrieval strategies to increase answer precision and factuality. Assist in creating data pipelines for training and testing, including annotation and evaluation tooling. Collaborate with product managers to translate user requirements into technical features. Participate in error … planning, reasoning, and tool use. Extend Microsoft 365 Copilot by building custom plugins and declarative agents within Microsoft Copilot Studio to surface enterprise data in Teams and Office apps. Operationalize AI solutions using Microsoft AI Foundry for model catalog management, Prompt Flow evaluation, and lifecycle governance. Architect scalable ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Carnall-Farrar is seeking a Lead Platform Engineer in the UK to steer the data platform architecture and delivery. The role entails mentoring the data engineering team, translating architectural direction into implementable designs, and ensuring security and regulatory compliance across NHS data pipelines. … will collaborate with the Director of Data, Analytics and Intelligence, support partnerships with Databricks and other data organisations, and drive platform standards while delivering #J-18808-Ljbffr ...

catalogue of capability The orchestrator, and the resource model that tracks consumables and instruments as a live digital twin of the lab The capture pipeline that structures the data coming off the floor, with audit logging on every action and edit so nothing is unaccounted … what the lab produces. Your first 90 days FIRST 30 DAYS Get productive in the codebase and ship your first change into the execution pipeline, following the team’s review and deployment practices. Take ownership of a service or surface within the team. DAYS 30 TO 60 Ship ...

with research staff to advance our quantitative trading strategies. You will translate novel research ideas into production-quality code, build and maintain the data pipelines and modeling infrastructure that underpin our strategies, and apply your own strong mathematical intuition to solve open-ended technical challenges. This role lives … standard. Responsibilities Partner with PhD researchers to design, implement, and productize machine learning models that drive quantitative trading strategies Develop and maintain complex data pipelines, including data ingestion, feature engineering, validation, and quality monitoring Translate research prototypes and novel ideas into performant, well-tested, production-ready ...

product - talk to customers and align directly on what success looks like and how it’s measured. You’ll use raw, real-world data to form clear, actionable insights. Directly optimise the performance of our agent, tuning and improving it against those metrics for every customer we onboard. … optimisation flow end to end - you’ll use data to translate opportunities into tangible improvements in our agent, and close the loop by delivering and demonstrating that value. Get obsessive with the data: understand the data at the lowest level, then leverage this ...

This role will focus on enhancing and maintaining data pipelines to process financial and ESG data. What this role will do: Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines … agile framework to prioritize tasks, manage time effectively, and align with team goals. Act as a proactive contributor to cross-functional collaboration with data scientists, analysts, and other stakeholders. Skills required: Degree in computer science, engineering, mathematics, quantitative methods or related field. Substantial experience in developing and maintaining ...

maintaining existing solutions. Working closely with developers, business analysts and stakeholders across the business, you'll help transform business requirements into practical, data-driven solutions that support decision making and drive operational improvements. As a Lead SQL Developer, You Will Analyse business requirements and translate them into database … maintain SQL queries, stored procedures, scripts and database objects. Build and support integrations between internal and third-party systems. Integrate, transform and validate data for reporting and operational processes. Investigate and resolve data, reporting, performance and integration issues. Document data flows and technical changes. ...

looking for an Azure Full Stack Engineer - Cosmos DB to join a major cloud and data engineering programme in London. This is a 6-month contract with a hybrid working model, requiring 1-3 days onsite. The role combines full stack development with modern Azure data engineering, giving you the opportunity to work on scalable applications and critical data components. You'll work closely with solution architects and DevOps teams, helping integrate Cosmos DB into cloud-native and microservices-based solutions while maintaining strong performance, security and data standards. ...

global financial institution based in London seeks a Data Engineer for the Lakehouse and AI Data Platform. In this role, you'll design, build, and support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with ...

OrderYOYO is seeking a Senior Data & AI Platform Engineer to own the modern data platform, migrating to a governed Microsoft Fabric layer, and to lead data engineering with AI-enabled capabilities. You will mentor engineers, design semantic models, and ensure reliable data pipelines across CRM and analytics reporting. The role focuses on data governance, scalable architecture, and senior leadership for data delivery during a critical growth phase. #J-18808-Ljbffr ...

Cleared Data Engineers Wanted - Mid to Senior | AWS/Data Platforms | UK (Hybrid) £55,000 – £70,000 + bonus + benefits | Bristol/Manchester (hybrid) Active SC or DV Clearance Required I'm working with a successful multinational tech consultancy that has secured a number … long-term client programmes and is now looking to bring in several DV Cleared Data Engineers, from mid to senior level, to meet that demand. If you're SC or DV cleared and have built your career on AWS, this is one where that depth gets used properly. ...

with plenty of scope to improve automation, Infrastructure as Code and engineering standards. You'll also get exposure to Microsoft Fabric and modern data platforms as they become an increasingly important part of the organisation's technology estate. What you'll be doing Taking ownership of engineering across … security controls Working with technologies including Azure Policy, Key Vault, Private Endpoints and Defender Supporting the engineering platform behind Microsoft Fabric and modern data workloads Leading technical projects and influencing cloud architecture decisions Helping replace legacy and manual processes with modern, automated solutions Acting as a senior technical ...

Jobtailor in London is seeking an experienced Data Engineer to build and maintain ingestion pipelines into the data warehouse, orchestrate data flows, and manage AWS infrastructure as code with Terraform. You will connect HR and payroll data pipelines, ensure secure, reliable data ...

Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team. The ideal ...

Senior Azure Data Engineer Thatcham (Hybrid, Minimum 2 Days Per Week Onsite) Commutable from Reading, Basingstoke, Newbury, Andover and surrounding areas. Up to £67,000 + 10% Non-Contributory Pension + 29 Days Holiday + Bank Holidays + Hybrid Working + Excellent Benefits Are you an experienced Azure … cloud projects, the opportunity to shape technical direction, and the chance to help upskill a growing team within an ambitious and rapidly expanding data division? This is an excellent opportunity to join a collaborative and fast-growing data team within an established research organisation that ...