2,026 to 2,050 of 2,984 Data Pipeline Jobs in the UK

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates …/ML platforms and workloads on AWS (or multi-cloud with strong AWS depth). Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates …/ML platforms and workloads on AWS (or multi-cloud with strong AWS depth). Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data ...

Cloud Data EngineerHybrid130,000-160,000 + benefits and bonusQuant Capital is urgently looking for a Cloud Data Engineer to join our high profile client. My client is a prestigious quantitative trading firm renowned for combining cutting-edge technology with exceptional talent, my client operates globally … Responsibilities: Oversee multiple AWS environments, promoting collaboration among teams and providing support for their development initiatives. Integrate services and access routes within a data-intensive hybrid cloud environment. Develop, enhance, and fully automate CI/CD development cycles. Gather business and technical requirements to propose solutions that consolidate ...

TRIA is seeking a Senior Data Engineer to join its growing technology function at a pivotal stage of its data transformation journey. You will build, extend and operate data pipelines on a Microsoft Fabric platform, leveraging Azure and SQL with Power … analytics layer. The role is hands-on and shaping how the data platform evolves, offering influence over standards, patterns and best practices across the environment. #J-18808-Ljbffr ...

migration into operational use across the enterprise. The role owns the long‐term roadmap for CMDB/AMDB/xMDB, including service modeling, data quality, integrations, adoption, and the transition from fragmented configuration sources to a coherent, trusted platform. The ideal candidate has deep practical experience building … AMDB/xMDB in Atlassian JSM Assets and understands the complexities of operating at Expedia's scale: multiple domains, diverse data sources, distributed ownership, inconsistent legacy data, and complex service dependencies. They will lead the creation of CI and service models, migration and onboarding patterns, relationship ...

experience deploying and operating integrations in production across these environmentsStrong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, and data pipelines, including batch ingestion, streaming, and connector frameworks for enterprise data deliveryProven experience delivering technical proofs of concept, live demonstrations, and prototype … responsible for building and deploying intelligent, AI-powered solutions that drive innovation across products and platforms. We shape the product ecosystem through AI, data, and strategic partnerships—embedding large language models, agentic platforms, and advanced analytics into how insight and value are delivered. We partner with leading ...

area. Device & Embedded Software Systems Embedded Linux, C++/Python, embedded systems, multi-sensor and camera-based devices (including thermal and line-scan), data acquisition and edge processing, device-to-cloud pipelines, networking, system integration, hardware/software collaboration, field diagnostics, performance optimisation, secure and robust systems, Linux … build systems (e.g. Yocto), media pipelines (e.g. GStreamer), FFMPEG, IoT devices, sensor data processing, signal conditioning, computer vision, FPGA exposure, electronics fundamentals. Platform Engineering Cloud infrastructure, AWS, distributed systems, backend services, RESTful APIs, microservices architecture, service integration, data pipelines, storage systems, relational databases (MySQL), scalability, system ...

embedded with the business, working alongside key users and domain leads to take working prototypes through to production: integrating them with the Enterprise Data Platform and core Trafigura systems; deploying agentic AI workflows; and taking radical ownership of live production. The focus is practical delivery in the field. … continuous backlog of business requests using ticket- and feedback-driven workflows.**Solution Design & Implementation*** Architect and build production-grade custom integrations, APIs, data pipelines and workflow automations between engagement-layer applications and core Trafigura systems.* Transform proof-of-concept prototypes into secure, scalable and compliant production systems – building ...

company where people truly BELIEVE in what they are doing! We're committed to bringing passion and customer focus to the business. Senior Data Analytics Consultant London – Hybrid (On client site 2/3 days per week) Fractal is a strategic AI partner to Fortune 500 companies with … identify opportunities for growth and scale the engagement Communicate with the clients and understand their business needs Technical: Work with large, complex data sets to solve difficult, non-routine analysis problems, applying advanced analytical methods as needed Candidate must be well experienced with Google tools and publicly available ...

approach allows our clients to enjoy benefits such as rapid innovation and development cycles. Our focus areas are both application workload migration and data migrations into platforms engineered on GCP. Go Reply is a Google Cloud Premier Partner with over 100 GCP engineers across our European practice. … with Cloud Architects and delivery teams, you will translate architectural designs into production‐ready solutions on Google Cloud Platform. The role spans infrastructure, data, and AI workloads, with a primary focus on engineering while also contributing to solution design discussions and supporting client engagements with technical expertise. ...

bodies and academia can share resources and knowledge, to codevelop and grow businesses, fast. We support technology-focused start ups, each with unique data management challenges, and are seeking an experienced Storage Architect to help them design, deploy and maintain high-performance storage systems for their … data-driven workloads. The successful candidate will combine deep experience architecting and managing distributed, cloud, and tiered storage solutions with strong Linux and automation skills. In this role you will: Design, implement, and maintain storage platforms that support large-scale AI and data pipelines Manage distributed ...

with Cloud Architects and delivery teams, you will translate architectural designs into production-ready solutions on Google Cloud Platform. The role spans infrastructure, data, and AI workloads, with a primary focus on engineering while also contributing to solution design discussions and supporting client engagements with technical expertise. … will deliver end-to-end solutions, from building data pipelines and deploying AI/ML workloads to provisioning infrastructure and automating deployments through CI/CD. This is a London-based role.Responsibilities:Implement, deploy, and maintain Google Cloud infrastructure using Infrastructure as Code (primarily Terraform), ensuring repeatable ...

NextGenEnergyJobs is seeking a full-time data engineer to establish the flexibility team's data capability and set its technical direction within an AWS-based environment. You will upskill data-literate backend engineers, act as the team's data expert, and drive … scalable, reusable data pipelines and APIs using Django/FastAPI where appropriate. You'll maintain and evolve the data warehouse with Databricks, champion DataOps practices, and ensure robust, globally scalable data applications across #J-18808-Ljbffr ...

looking for a Staff Engineer to lead the technical delivery of complex software, data, and AI projects, focusing on the Defence sector. This role combines deep technical expertise with project leadership and client engagement. You will quickly grasp new problem spaces, work with domain experts, and deliver robust … projects, making sound engineering decisions. Oversee the delivery of high-quality, maintainable and production-ready code. Design and develop backend services, APIs, data pipelines and integrations. Build AI systems, including solutions using Large Language Models and machine learning. Review code and technical designs Apply software engineering best practice ...

Engineer Are you excited about building intelligent systems powered by cutting-edge AI technologies Do you enjoy designing models that turn complex data into impactful solutions About the team:Embedded Innovation Teams are cross-functional squads embedded within our segments to rapidly turn internal AI experimentation into validated … patterns, reference implementations and starter kits so work done in one function can be picked up by another.Instrument solutions to capture outcome data against baselines.Work alongside host-function stakeholders to ensure the build fits real workflows, not assumed ones.Support handover and capability-building in the host function ...

Unisys in Milton Keynes is seeking a Senior Data Engineer to design and implement data pipelines, develop ML models, and translate business needs into technical solutions. You will work with stakeholders to understand requirements and leverage AI/LM technologies to deliver actionable insights. The role … involves collaborating with data scientists and engineers, and communicating findings to varied audiences while staying aligned with enterprise data governance and quality practices. #J-18808-Ljbffr ...

DATA, Inc. is seeking a senior data engineer in the United Kingdom to lead client engagements, design and implement data pipelines on the Databricks platform, and shape cloud-native data architectures for enterprise-scale solutions. You will own data modelling … governance, and security, mentor engineers, and collaborate with architects and analytics leadership to deliver scalable, lakehouse-based data solutions. #J-18808-Ljbffr ...

Hometrack is seeking a Senior Data Engineer to join our Data Services product team in London. You will help deliver data platforms and datasets powering our market-leading AVM, serving mortgage lenders, builders and utilities alike. The role emphasizes scalable data products … collaboration, and robust data governance. Hybrid working with 2 days per week in the London Bridge office; you will write maintainable code, review peers, and optimize ETL and data pipelines to ensure accuracy, #J-18808-Ljbffr ...

measure and monitor system performance, accuracy, and reliability Build and maintain production‐grade AI applications with clean code, appropriate error handling, APIs, and data pipelines Experience implementing, maintaining and evaluating retrieval systems (vector/graph databases, ingestion pipelines, chunking strategies, retrieval techniques such as HyDE) Implement feedback loops … testing frameworks, and deployment pipelines Solid foundations and understanding of production‐grade, cloud‐native platform and infrastructure requirements, design, and implementation. Strong data manipulation skills (pandas, SQL) and understanding of evaluation strategies for LLM‐based systems Ability to work with ambiguity and optimise non‐deterministic systems through ...

Bedrock, LangChain, HuggingFace Transformers, or OpenAI API. Design prompt templates and implement retrieval strategies to increase answer precision and factuality. Assist in creating data pipelines for training and testing, including annotation and evaluation tooling. Collaborate with product managers to translate user requirements into technical features. Participate in error … planning, reasoning, and tool use. Extend Microsoft 365 Copilot by building custom plugins and declarative agents within Microsoft Copilot Studio to surface enterprise data in Teams and Office apps. Operationalize AI solutions using Microsoft AI Foundry for model catalog management, Prompt Flow evaluation, and lifecycle governance. Architect scalable ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

This role will focus on enhancing and maintaining data pipelines to process financial and ESG data.What this role will do:• Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines … agile framework to prioritize tasks, manage time effectively, and align with team goals. Act as a proactive contributor to cross-functional collaboration with data scientists, analysts, and other stakeholders.Skills required:• Degree in computer science, engineering, mathematics, quantitative methods or related field.• Substantial experience in developing and maintaining production ...

Carnall-Farrar is seeking a Lead Platform Engineer in the UK to steer the data platform architecture and delivery. The role entails mentoring the data engineering team, translating architectural direction into implementable designs, and ensuring security and regulatory compliance across NHS data pipelines. … will collaborate with the Director of Data, Analytics and Intelligence, support partnerships with Databricks and other data organisations, and drive platform standards while delivering #J-18808-Ljbffr ...

catalogue of capability The orchestrator, and the resource model that tracks consumables and instruments as a live digital twin of the lab The capture pipeline that structures the data coming off the floor, with audit logging on every action and edit so nothing is unaccounted … what the lab produces. Your first 90 days FIRST 30 DAYS Get productive in the codebase and ship your first change into the execution pipeline, following the team’s review and deployment practices. Take ownership of a service or surface within the team. DAYS 30 TO 60 Ship ...