1,151 to 1,175 of 1,710 Data Pipeline Jobs in the UK

identify architectural patternsMonitor compliance of cloud resources to see if they fit industry guardrails and best practicesResearch and propose solutions for AWS data transformation, data connections, operational frameworks, and application integrationWork closely with lead architects and engineers to create and maintain architectural templates and build/…/ML platforms and workloads on AWS (or multi‐cloud with strong AWS depth).Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake ...

identify architectural patternsMonitor compliance of cloud resources to see if they fit industry guardrails and best practicesResearch and propose solutions for AWS data transformation, data connections, operational frameworks, and application integrationWork closely with lead architects and engineers to create and maintain architectural templates and build/…/ML platforms and workloads on AWS (or multi‐cloud with strong AWS depth).Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates …/ML platforms and workloads on AWS (or multi-cloud with strong AWS depth). Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data ...

architectural patterns Monitor compliance of cloud resources to see if they fit industry guardrails and best practices Research and propose solutions for AWS data transformation, data connections, operational frameworks, and application integration Work closely with lead architects and engineers to create and maintain architectural templates …/ML platforms and workloads on AWS (or multi-cloud with strong AWS depth). Deep understanding of AI/ML solution patterns (data pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data ...

Cloud Data EngineerHybrid130,000-160,000 + benefits and bonusQuant Capital is urgently looking for a Cloud Data Engineer to join our high profile client. My client is a prestigious quantitative trading firm renowned for combining cutting-edge technology with exceptional talent, my client operates globally … Responsibilities: Oversee multiple AWS environments, promoting collaboration among teams and providing support for their development initiatives. Integrate services and access routes within a data-intensive hybrid cloud environment. Develop, enhance, and fully automate CI/CD development cycles. Gather business and technical requirements to propose solutions that consolidate ...

migration into operational use across the enterprise. The role owns the long‐term roadmap for CMDB/AMDB/xMDB, including service modeling, data quality, integrations, adoption, and the transition from fragmented configuration sources to a coherent, trusted platform. The ideal candidate has deep practical experience building … AMDB/xMDB in Atlassian JSM Assets and understands the complexities of operating at Expedia's scale: multiple domains, diverse data sources, distributed ownership, inconsistent legacy data, and complex service dependencies. They will lead the creation of CI and service models, migration and onboarding patterns, relationship ...

than they are likely to get inside a large technology company, bank or established AI business. You will work directly with experienced engineers, data scientists and our founder, taking problems from experimentation through to production. Your models will not sit in notebooks. They will become part of live … processing and information extraction Agentic and automated research workflows Retrieval, embeddings and semantic search Narrative detection and clustering Multilingual text intelligence Large-scale data and model pipelines Model evaluation, observability and monitoring Production ML infrastructure on AWS The problems are often open-ended. You might be evaluating ...

experience deploying and operating integrations in production across these environmentsStrong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, and data pipelines, including batch ingestion, streaming, and connector frameworks for enterprise data deliveryProven experience delivering technical proofs of concept, live demonstrations, and prototype … responsible for building and deploying intelligent, AI-powered solutions that drive innovation across products and platforms. We shape the product ecosystem through AI, data, and strategic partnerships—embedding large language models, agentic platforms, and advanced analytics into how insight and value are delivered. We partner with leading ...

area. Device & Embedded Software Systems Embedded Linux, C++/Python, embedded systems, multi-sensor and camera-based devices (including thermal and line-scan), data acquisition and edge processing, device-to-cloud pipelines, networking, system integration, hardware/software collaboration, field diagnostics, performance optimisation, secure and robust systems, Linux … build systems (e.g. Yocto), media pipelines (e.g. GStreamer), FFMPEG, IoT devices, sensor data processing, signal conditioning, computer vision, FPGA exposure, electronics fundamentals. Platform Engineering Cloud infrastructure, AWS, distributed systems, backend services, RESTful APIs, microservices architecture, service integration, data pipelines, storage systems, relational databases (MySQL), scalability, system ...

embedded with the business, working alongside key users and domain leads to take working prototypes through to production: integrating them with the Enterprise Data Platform and core Trafigura systems; deploying agentic AI workflows; and taking radical ownership of live production. The focus is practical delivery in the field. … continuous backlog of business requests using ticket- and feedback-driven workflows.**Solution Design & Implementation*** Architect and build production-grade custom integrations, APIs, data pipelines and workflow automations between engagement-layer applications and core Trafigura systems.* Transform proof-of-concept prototypes into secure, scalable and compliant production systems – building ...

Unisys in Milton Keynes is seeking a Senior Data Engineer to design and implement data pipelines, develop ML models, and translate business needs into technical solutions. You will work with stakeholders to understand requirements and leverage AI/LM technologies to deliver actionable insights. The role … involves collaborating with data scientists and engineers, and communicating findings to varied audiences while staying aligned with enterprise data governance and quality practices. #J-18808-Ljbffr ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Searchability is seeking a Data Engineer to join an enterprise data and AI transformation programme. You will design and build scalable data pipelines in GCP, develop cloud-native solutions, and support AI/LLM and RAG initiatives across a large-scale environment. You will … work on event-driven architectures with Kafka, write robust Python and SQL, and help ensure data quality, governance and scalable data platforms. This hybrid role is based in Manchester or Leeds, with on-site 2 days per week. #J-18808-Ljbffr ...

Carnall-Farrar is seeking a Lead Platform Engineer in the UK to steer the data platform architecture and delivery. The role entails mentoring the data engineering team, translating architectural direction into implementable designs, and ensuring security and regulatory compliance across NHS data pipelines. … will collaborate with the Director of Data, Analytics and Intelligence, support partnerships with Databricks and other data organisations, and drive platform standards while delivering #J-18808-Ljbffr ...

catalogue of capability The orchestrator, and the resource model that tracks consumables and instruments as a live digital twin of the lab The capture pipeline that structures the data coming off the floor, with audit logging on every action and edit so nothing is unaccounted … what the lab produces. Your first 90 days FIRST 30 DAYS Get productive in the codebase and ship your first change into the execution pipeline, following the team’s review and deployment practices. Take ownership of a service or surface within the team. DAYS 30 TO 60 Ship ...

with research staff to advance our quantitative trading strategies. You will translate novel research ideas into production-quality code, build and maintain the data pipelines and modeling infrastructure that underpin our strategies, and apply your own strong mathematical intuition to solve open-ended technical challenges. This role lives … standard. Responsibilities Partner with PhD researchers to design, implement, and productize machine learning models that drive quantitative trading strategies Develop and maintain complex data pipelines, including data ingestion, feature engineering, validation, and quality monitoring Translate research prototypes and novel ideas into performant, well-tested, production-ready ...

This role will focus on enhancing and maintaining data pipelines to process financial and ESG data. What this role will do: Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines … agile framework to prioritize tasks, manage time effectively, and align with team goals. Act as a proactive contributor to cross-functional collaboration with data scientists, analysts, and other stakeholders. Skills required: Degree in computer science, engineering, mathematics, quantitative methods or related field. Substantial experience in developing and maintaining ...

Cleared Data Engineers Wanted - Mid to Senior | AWS/Data Platforms | UK (Hybrid) £55,000 – £70,000 + bonus + benefits | Bristol/Manchester (hybrid) Active SC or DV Clearance Required I'm working with a successful multinational tech consultancy that has secured a number … long-term client programmes and is now looking to bring in several DV Cleared Data Engineers, from mid to senior level, to meet that demand. If you're SC or DV cleared and have built your career on AWS, this is one where that depth gets used properly. ...

with plenty of scope to improve automation, Infrastructure as Code and engineering standards. You'll also get exposure to Microsoft Fabric and modern data platforms as they become an increasingly important part of the organisation's technology estate. What you'll be doing Taking ownership of engineering across … security controls Working with technologies including Azure Policy, Key Vault, Private Endpoints and Defender Supporting the engineering platform behind Microsoft Fabric and modern data workloads Leading technical projects and influencing cloud architecture decisions Helping replace legacy and manual processes with modern, automated solutions Acting as a senior technical ...

Jobtailor in London is seeking an experienced Data Engineer to build and maintain ingestion pipelines into the data warehouse, orchestrate data flows, and manage AWS infrastructure as code with Terraform. You will connect HR and payroll data pipelines, ensure secure, reliable data ...

Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team. The ideal ...

Senior Azure Data Engineer Thatcham (Hybrid, Minimum 2 Days Per Week Onsite) Commutable from Reading, Basingstoke, Newbury, Andover and surrounding areas. Up to £67,000 + 10% Non-Contributory Pension + 29 Days Holiday + Bank Holidays + Hybrid Working + Excellent Benefits Are you an experienced Azure … cloud projects, the opportunity to shape technical direction, and the chance to help upskill a growing team within an ambitious and rapidly expanding data division? This is an excellent opportunity to join a collaborative and fast-growing data team within an established research organisation that ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Hippo Digital Limited in Leeds is seeking a Senior Data Engineer to lead the delivery of data systems for public and private sector clients. You will work within a multi-disciplinary team spanning data, design, product and engineering to build secure, scalable data … mentor engineers, design and optimize ETL/ELT pipelines, and promote engineering best practices across projects while collaborating with clients to solve complex data problems. #J-18808-Ljbffr ...