926 to 950 of 1,426 Data Pipeline Jobs in London

TRIA is seeking a Senior Data Engineer to join its growing technology function at a pivotal stage of its data transformation journey. You will build, extend and operate data pipelines on a Microsoft Fabric platform, leveraging Azure and SQL with Power … analytics layer. The role is hands-on and shaping how the data platform evolves, offering influence over standards, patterns and best practices across the environment. #J-18808-Ljbffr ...

migration into operational use across the enterprise. The role owns the long‐term roadmap for CMDB/AMDB/xMDB, including service modeling, data quality, integrations, adoption, and the transition from fragmented configuration sources to a coherent, trusted platform. The ideal candidate has deep practical experience building … AMDB/xMDB in Atlassian JSM Assets and understands the complexities of operating at Expedia's scale: multiple domains, diverse data sources, distributed ownership, inconsistent legacy data, and complex service dependencies. They will lead the creation of CI and service models, migration and onboarding patterns, relationship ...

than they are likely to get inside a large technology company, bank or established AI business. You will work directly with experienced engineers, data scientists and our founder, taking problems from experimentation through to production. Your models will not sit in notebooks. They will become part of live … processing and information extraction Agentic and automated research workflows Retrieval, embeddings and semantic search Narrative detection and clustering Multilingual text intelligence Large-scale data and model pipelines Model evaluation, observability and monitoring Production ML infrastructure on AWS The problems are often open-ended. You might be evaluating ...

experience deploying and operating integrations in production across these environmentsStrong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, and data pipelines, including batch ingestion, streaming, and connector frameworks for enterprise data deliveryProven experience delivering technical proofs of concept, live demonstrations, and prototype … responsible for building and deploying intelligent, AI-powered solutions that drive innovation across products and platforms. We shape the product ecosystem through AI, data, and strategic partnerships—embedding large language models, agentic platforms, and advanced analytics into how insight and value are delivered. We partner with leading ...

embedded with the business, working alongside key users and domain leads to take working prototypes through to production: integrating them with the Enterprise Data Platform and core Trafigura systems; deploying agentic AI workflows; and taking radical ownership of live production. The focus is practical delivery in the field. … continuous backlog of business requests using ticket- and feedback-driven workflows.**Solution Design & Implementation*** Architect and build production-grade custom integrations, APIs, data pipelines and workflow automations between engagement-layer applications and core Trafigura systems.* Transform proof-of-concept prototypes into secure, scalable and compliant production systems – building ...

approach allows our clients to enjoy benefits such as rapid innovation and development cycles. Our focus areas are both application workload migration and data migrations into platforms engineered on GCP. Go Reply is a Google Cloud Premier Partner with over 100 GCP engineers across our European practice. … with Cloud Architects and delivery teams, you will translate architectural designs into production‐ready solutions on Google Cloud Platform. The role spans infrastructure, data, and AI workloads, with a primary focus on engineering while also contributing to solution design discussions and supporting client engagements with technical expertise. ...

NextGenEnergyJobs is seeking a full-time data engineer to establish the flexibility team's data capability and set its technical direction within an AWS-based environment. You will upskill data-literate backend engineers, act as the team's data expert, and drive … scalable, reusable data pipelines and APIs using Django/FastAPI where appropriate. You'll maintain and evolve the data warehouse with Databricks, champion DataOps practices, and ensure robust, globally scalable data applications across #J-18808-Ljbffr ...

/ML frameworks and tooling such as LangChain, LangGraph, vector databases, and MCP‐based orchestration Expertise in relational and/or NoSQL databases, data pipelines, and ETL processes Experience with microservices architecture and web development Knowledge of data visualisation tools (e.g., PowerBI, Tableau) and dashboard development ...

looking for a Staff Engineer to lead the technical delivery of complex software, data, and AI projects, focusing on the Defence sector. This role combines deep technical expertise with project leadership and client engagement. You will quickly grasp new problem spaces, work with domain experts, and deliver robust … projects, making sound engineering decisions. Oversee the delivery of high-quality, maintainable and production-ready code. Design and develop backend services, APIs, data pipelines and integrations. Build AI systems, including solutions using Large Language Models and machine learning. Review code and technical designs Apply software engineering best practice ...

Hometrack is seeking a Senior Data Engineer to join our Data Services product team in London. You will help deliver data platforms and datasets powering our market-leading AVM, serving mortgage lenders, builders and utilities alike. The role emphasizes scalable data products … collaboration, and robust data governance. Hybrid working with 2 days per week in the London Bridge office; you will write maintainable code, review peers, and optimize ETL and data pipelines to ensure accuracy, #J-18808-Ljbffr ...

measure and monitor system performance, accuracy, and reliability Build and maintain production‐grade AI applications with clean code, appropriate error handling, APIs, and data pipelines Experience implementing, maintaining and evaluating retrieval systems (vector/graph databases, ingestion pipelines, chunking strategies, retrieval techniques such as HyDE) Implement feedback loops … testing frameworks, and deployment pipelines Solid foundations and understanding of production‐grade, cloud‐native platform and infrastructure requirements, design, and implementation. Strong data manipulation skills (pandas, SQL) and understanding of evaluation strategies for LLM‐based systems Ability to work with ambiguity and optimise non‐deterministic systems through ...

Bedrock, LangChain, HuggingFace Transformers, or OpenAI API. Design prompt templates and implement retrieval strategies to increase answer precision and factuality. Assist in creating data pipelines for training and testing, including annotation and evaluation tooling. Collaborate with product managers to translate user requirements into technical features. Participate in error … planning, reasoning, and tool use. Extend Microsoft 365 Copilot by building custom plugins and declarative agents within Microsoft Copilot Studio to surface enterprise data in Teams and Office apps. Operationalize AI solutions using Microsoft AI Foundry for model catalog management, Prompt Flow evaluation, and lifecycle governance. Architect scalable ...

Carnall-Farrar is seeking a Lead Platform Engineer in the UK to steer the data platform architecture and delivery. The role entails mentoring the data engineering team, translating architectural direction into implementable designs, and ensuring security and regulatory compliance across NHS data pipelines. … will collaborate with the Director of Data, Analytics and Intelligence, support partnerships with Databricks and other data organisations, and drive platform standards while delivering #J-18808-Ljbffr ...

catalogue of capability The orchestrator, and the resource model that tracks consumables and instruments as a live digital twin of the lab The capture pipeline that structures the data coming off the floor, with audit logging on every action and edit so nothing is unaccounted … what the lab produces. Your first 90 days FIRST 30 DAYS Get productive in the codebase and ship your first change into the execution pipeline, following the team’s review and deployment practices. Take ownership of a service or surface within the team. DAYS 30 TO 60 Ship ...

with research staff to advance our quantitative trading strategies. You will translate novel research ideas into production-quality code, build and maintain the data pipelines and modeling infrastructure that underpin our strategies, and apply your own strong mathematical intuition to solve open-ended technical challenges. This role lives … standard. Responsibilities Partner with PhD researchers to design, implement, and productize machine learning models that drive quantitative trading strategies Develop and maintain complex data pipelines, including data ingestion, feature engineering, validation, and quality monitoring Translate research prototypes and novel ideas into performant, well-tested, production-ready ...

looking for an Azure Full Stack Engineer - Cosmos DB to join a major cloud and data engineering programme in London. This is a 6-month contract with a hybrid working model, requiring 1-3 days onsite. The role combines full stack development with modern Azure data engineering, giving you the opportunity to work on scalable applications and critical data components. You'll work closely with solution architects and DevOps teams, helping integrate Cosmos DB into cloud-native and microservices-based solutions while maintaining strong performance, security and data standards. ...

global financial institution based in London seeks a Data Engineer for the Lakehouse and AI Data Platform. In this role, you'll design, build, and support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with ...

Jobtailor in London is seeking an experienced Data Engineer to build and maintain ingestion pipelines into the data warehouse, orchestrate data flows, and manage AWS infrastructure as code with Terraform. You will connect HR and payroll data pipelines, ensure secure, reliable data ...

Principal Machine Learning Engineer, AI & Data Platforms (AiDP) London, England, United Kingdom Corporate Functions At Apple, we build AI systems that define experiences for billions of people and we do it with an unwavering commitment to privacy, performance, and craft. The AI & Data Platforms (AiDP) team … Swift, and Java, with the ability to contribute production‐quality code across Apple's technology stack Experience building and operating enterprise‐grade ML pipelines (data preparation, distributed training, model optimisation, serving, and monitoring) in cloud (AWS, GCP, Azure) or on‐prem environments Preferred Qualifications Demonstrated ability to deliver ...

leading Data Management consultancy is seeking skilled professionals to join their team. This role involves delivering innovative data solutions and optimizing data pipelines within Databricks environments. Candidates should excel in data management, engineering, and analytics while demonstrating strong programming skills in Python … SQL. The position requires travel and on-site client work, appealing to those passionate about leveraging data for business insights. An attractive benefits package is offered, including private health insurance and a performance bonus. #J-18808-Ljbffr ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

organisation’s mission of advancing the mobile ecosystem and enabling innovation across global digital infrastructure. This role sits within GSMA’s data and technology function and focuses on designing, developing, and deploying advanced artificial intelligence solutions to support internal operations, member services, and industry initiatives. The successful candidate … systems, working closely with cross-functional teams to translate business requirements into technical solutions. Responsibilities include developing and optimising machine learning models, implementing data pipelines, and ensuring the robustness and scalability of AI-driven applications. The role also involves contributing to AI strategy, evaluating emerging technologies, and promoting ...

SDET Engineer who is passionate about quality and brings hands‐on experience across API and UI automation. You will work alongside engineering and data teams to build robust test frameworks, integrate them into CI/CD pipelines, and improve automation standards. Key Responsibilities Design, implement, and maintain … reliability, and performance. Build and maintain automated regression suites, including consumer‐driven contract tests (e.g., Pact). Automate validation for AI‐driven services, data pipelines, and ETL transformations. Integrate test suites into CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or GitLab CI. Work with data ...

code and ensure robust, well-documented releases. Your Responsibilities Oversee architecture across trading, clearing and post-trade systems, including integrations with CCPs, exchanges, data/platform vendors and customers. Direct modernisation of integration patterns and frameworks, reinforcing strong security principles and practices. Steer data architecture strategy … data quality, ownership, security and accessibility. Chair architecture governance forums, driving timely, effective architectural decisions. Produce architecture documentation, architectural decision records, target-state blueprints and audit-ready artefacts. Design resilient systems meeting RTO/RPO requirements and FCA operational resilience obligations. Meet regulatory obligations by design (FCA/ ...

Fortnum & Mason seeks a Data and Reporting Engineer to build and optimise Power BI-based analytics. You will collaborate with stakeholders to translate business questions into scalable BI solutions, shaping data pipelines and semantic models within Azure Synapse, Data Lake, and Fabric. You will … lead reporting delivery, ensure data quality, and promote best practices for governance and end-user experience across the organisation. #J-18808-Ljbffr ...