476 to 500 of 551 Data Pipeline Jobs in London

integration Enterprise architecture: domain-driven design, architecture governance, reusable components and patterns AI for software engineering: leveraging AI/agentic tools for coding assistance, pipeline automation, testing, and developer productivity improvements Engineering lifecycle: CI/CD pipelines, automated testing, product lifecycle management, Agile and DevOps practices Strong understanding … distributed systems aligned with enterprise standards Nice to have: Familiarity with AI-driven DevOps/engineering tools (e.g., AI code review, testing bots, pipeline automation) Experience with infrastructure-as-code and deployment automation Certifications in software or enterprise architecture or Agile methodologies Background in regulated or payment/engagement ...

Shell Energy Europe & Environmental Products is looking for a Data Scientist to join the Market Analysis team in London. You will develop time series forecasting and optimisation models, productionise them in the cloud, and collaborate with domain experts to understand power market dynamics. You will work with Python … cloud technologies, building data pipelines and scalable analytics to support trading decisions. Strong programming skills and a pragmatic modelling approach are essential. #J-18808-Ljbffr ...

Wise is seeking a Senior Software Engineer II to lead data onboarding for our Lakehouse platform in London. You will build scalable data pipelines on Trino/Iceberg, implement Bronze-to-Gold transformations, and ensure high-quality, auditable financial data for the Finance squad. … will mentor engineers, collaborate with finance controllers and product teams, and drive architectural decisions that optimize data throughput and accuracy while aligning with Wise's strategic goals. #J-18808-Ljbffr ...

United States Digital Space LLC in London is seeking a Senior Backend Engineer to own the backend, build data pipelines, and shape a greenfield data platform for an industry tech forgotten. You will design APIs, optimize low-latency queries, orchestrate workflows, and set testing, CI/… deployment standards from scratch. The role requires 6+ years of backend experience, deep Python expertise, and a track record of shipping production data pipelines and REST APIs in fast-moving startups. #J-18808-Ljbffr ...

early engineering team to build production software for grid operators. This is a broad software engineering role spanning backend systems, frontend products, data-intensive applications, cloud infrastructure and applied AI. You will help turn complex engineering workflows into reliable, intuitive software used by planners, operators and engineers. This … engineering culture from an early stage. Responsibilities Build and ship production software across backend services, frontend applications and cloud infrastructure. Design APIs, data models and product interfaces for complex, data-heavy workflows. Develop tools for loading, validating, comparing, visualising and explaining technical datasets. Build reliable systems ...

build the perception and intelligence that power driver assistance in real-world driving. We work end-to-end: from creating high-quality training data, to developing and evaluating CV/3D perception models, to iterating quickly based on performance gaps. The team mixes “online” (on-car, latency/… compute constrained) and “offline” (heavier, large-scale data generation) work, with a strong focus on measurable impact and shipping. Your day-to-day You’ll train, debug, and improve computer vision and 3D perception models, and iterate based on clear evaluation signals. You’ll work across the full ...

foundation model research and trading at Jump. Our mission is to combine emerging techniques and original research to generate signals from financial market data and monetize it globally. We are building the future of ML-powered trading through breakthrough foundation models, and we\'re looking for an exceptional … drive the entire training stack: building fault-tolerant infrastructure that scales across thousands of GPUs and TPUs with near-linear performance, engineering data pipelines that stream terabytes per second as our models train on petabytes of data from every corner of the global markets, and designing ...

data centres are booming, electrification is accelerating, and trillions in generation, storage, and connection projects are queued - but the real bottleneck is the grid. Grid planning and operations are becoming a national-scale systems problem: complex network models, messy legacy data, strict governance, overloaded teams … that affect real infrastructure. Squid is building the agentic modelling platform for power grids: a versioned, auditable source of truth where network models, data, changes, assumptions, and decisions can be tracked - and where humans and AI agents can safely work together. We unify legacy planning models, operational data ...

Risk Strategy" for the Grow squad, moving us from reactive "fire-fighting" to proactive risk monitoring. Stakeholder Partnership: You will be the primary data partner for Wise’s Treasury, Risk, and Finance leadership, giving them the confidence that the Grow squad is operating within safe limits. Qualifications … strategic data leader who bridges the gap between technical analytics and business risk. You don’t just report on what happened; you influence what happens next. Technical Mastery : You bring expert-level SQL skills and are fully comfortable building and maintaining your own robust data pipelines ...

learning, ideally in domains involving high-frequency or large-scale time-series data. You will focus on developing alpha signal generation pipelines from data ingestion and feature engineering to model training and deployment - in collaboration with our trading and infrastructure teams. Responsibilities Develop ML-based alpha generation models … using high-frequency order book and market microstructure data. Design and maintain data pipelines, preprocessing, and feature extraction workflows tailored to streaming tick data. Research and implement advanced deep learning architectures for short-horizon forecasting and signal extraction. Collaborate with quant researchers and developers to integrate models into ...

JPMorgan Chase & Co. invites applications for an elite Applied Innovation ML Engineering role within the Chief Data Analytics Office (CDAO) Technology group. The position focuses on building scalable ML solutions for software, cybersecurity, and infrastructure, partnering across business lines to deliver long-term AI-driven projects. Responsibilities include … delivering production-ready ML products, maintaining data pipelines, and driving architectural governance for secure, high-quality code. #J-18808-Ljbffr ...

implement RAG pipelines, including chunking, embedding, indexing, retrieval, and reranking. Build and maintain integrations between retrieval and ML components and diverse enterprise data sources, vector databases, APIs, and services. Develop context retrieval systems that balance recall, precision, latency, and cost. Build evaluation frameworks, datasets, and metrics to measure … retrieval quality, context relevance, and end to end agent performance. Build reliable backend services and data pipelines that support ML and LLM components in production. Deliver experiments and new capabilities quickly, maintaining high quality and tight feedback loops with customers. Collaborate across product, ML, and infrastructure teams ...

governance, ethical AI guidance and regulatory compliance requirements. Lead end-to-end delivery of AI-enabled services, coordinating cross-functional teams of data/knowledge analysts, engineers and product specialists. Manage delivery of AI solutions leveraging automation capabilities, machine learning, natural language processing, generative and agentic AI, from … into sprints and milestones, managing delivery cadence and tracking velocity, quality and technical debt with the engineering team. Manage cross-team dependencies across data pipelines, APIs and cloud infrastructure, working closely with ML engineers and platform teams. Experience At least 12 years IT industry experience across project ...

Experis - ManpowerGroup is seeking a Data Solution Architect to shape data solutions in an architecture-led role within the Data Architecture & Design team. You will guide design across multiple data projects and drive governance and reusable patterns in a cloud Azure platform. … contract role (6 months with potential extension) focuses on Personalisation and enterprise-ready data pipelines, working with cross-functional teams to influence design decisions. #J-18808-Ljbffr ...

Experience in Machine Learning. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 5 years of experience with data structures and algorithms. 1 year of experience in a technical leadership role. Experience in Big Data. About the job the company's software engineers … looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will ...

launching software products. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 5 years of experience with data structures and algorithms. Experience with statistical inference, control theory, Ad targeting, or language modeling. About the job Google's software engineers develop the next-generation … looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will ...

Experience in Machine Learning. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 5 years of experience with data structures and algorithms. 1 year of experience in a technical leadership role. Experience in Big Data. About the job Google's software engineers develop … looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will ...

ship reliable, scalable implementations Define success metrics and use qualitative and quantitative feedback to guide iteration Debug production issues related to AI behavior, data quality, or workflow design Contribute code across the stack where needed, with a bias toward shipping value What we’re looking for Experience 4+ … Technical foundation Comfortable writing production-ready Python code Solid understanding of backend systems and APIs, even if not infrastructure-focused Experience working with data pipelines, embeddings, retrieval, or RAG-style systems Ability to reason about latency, cost, reliability, and quality trade-offs Product mindset You naturally think ...

Applicants should have 3+ years in a similar role and strong Python data stack experience. The position offers a vibrant office culture, competitive compensation, and opportunities to influence data reliability across trading platforms. #J-18808-Ljbffr ...

related technical field. 3 years of experience developing code, running experiments and analyses collaboratively with coding agents. Experience building large-scale, highly parallelised data pipelines, working on data quality, automated evaluation design and simple statistical modeling. Ability to use AI everyday to build and find ways … accelerate work. Ability to approach new research questions and implement technical solutions for them. About the job We aim to turn production data into intelligence on the safety of deployed AI models. Safety Oversight is a new team tasked with using large-scale production traffic and a variety ...

United States Digital Space LLC is seeking a Senior Engineer in Greater London to develop and manage data pipelines for AI systems. This role involves significant responsibilities, including ensuring the quality of reinforcement learning data, collaborating with various teams, and innovating operational frameworks. The ideal candidate ...

leading crypto-native algorithmic trading firm based in London, seeks an experienced machine learning engineer or researcher to build alpha signal pipelines from data ingestion to model deployment. You will develop ML-based models using order book data, design scalable data pipelines, and collaborate ...

Tesco Technology in London seeks a Senior Software Engineer for its Data & Intelligence Platform, connecting supply chain forecasts to actions. You will own end-to-end backend services, data pipelines, and LLM/tool-calling components, with production exposure across cloud-native environments. The role blends … data engineering, ML awareness, and developer infrastructure, focusing on scalable APIs and retrieval quality. #J-18808-Ljbffr ...

Inside IR35) We are seeking an experienced Senior .NET C# Engineer to join a fast-paced project focused on building and enhancing data ingestion and search capabilities using Elasticsearch. Role Overview You will play a key role in designing and developing index ingestion processes that populate Elasticsearch indices. … This includes working with event-driven architectures and translating incoming data into a consistent canonical model. Key responsibilities include: Building ingestion pipelines consuming data from Azure Event Hub and Kafka streams. Mapping incoming data (largely 1:1) into a canonical model, with additional metadata ...

Operations Analyst who is passionate about our mission of Money Without Borders. You will partner with our Payment Operations organisation to help drive data-driven decisions that would improve the quality of our payment systems, making them smoother and more efficient. The Payment Operations organisation is responsible … quarter. For example, understanding team quality KPIs and how each process intervention improves the organisation’s quality scores. Expose the vast amount of data available to the organisation in a meaningful and actionable way and support other teams in discovering insights from data. Support your team ...