1,426 to 1,450 of 1,513 Data Pipeline Jobs in London

spanning transport, water, energy, and sustainability at serious scale. As they invest in their internal digital capability, they're building the tools and data infrastructure that help engineers and project teams make better decisions, faster. They need a mid-level Python Engineer to join a cross-functional team … building the internal tooling, data pipelines and automation services that sit behind that work. What you'll do: Build and maintain Python-based tooling, automation scripts and internal APIs that serve engineering and project delivery teams Work with structured and semi-structured data — cleaning, transforming ...

cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure. Built by engineers … this role, you will focus on building systems that discover, fetch, and continuously refresh content from the open web and other large-scale data sources. You will design distributed crawling, scheduling, and ingestion infrastructure capable of operating at internet scale while balancing coverage, freshness, resource efficiency, and reliability. ...

primitives that underpin the sensor integration product. You'll work across the full backend surface: from stream processing and storage, to API design, data pipelines, and service architecture, in a Rust stack with Python at the platform API boundaries. You'll be responsible for building robust, well-abstracted … systems that scale with the demands of a growing integration and customer base, with ambitions of petabyte-scale data storage. You'll own meaningful architectural decisions and be expected to reason clearly through unfamiliar problem domains under real constraints. Core Skills Core technologies: Rust, with Python at some ...

This hands-on, early‐stage role spans software engineering, quantitative modelling, applied AI, and investment analytics, working with founders to design, evolve our data, analytics, and modelling platform. You will own end‐to‐end development across frontend dashboards (React/Next.js), backend services, data pipelines ...

that underpin Augur's sensor integration product. You'll work across the full backend surface: from stream processing and storage, to API design, data pipelines, and service architecture, in a Rust stack with Python at the platform API boundaries. You’ll be responsible for building robust, well-abstracted … systems that scale with the demands of a growing integration and customer base, with ambitions of petabyte-scale data storage. You’ll own meaningful architectural decisions and be expected to reason clearly through unfamiliar problem domains under real constraints. Core Skills Core technologies: Rust, with Python at some ...

oversee the end-to-end AI platform architecture powering telecom services across its networks. You will bridge technical excellence with business value, shaping data pipelines, model development, and deployment frameworks on Prem and cloud platforms. You will define architectural standards, ensure scalable, secure integrations with core infrastructure … guide engineering, data science and product teams to deliver measurable business #J-18808-Ljbffr ...

model training, evaluation and ongoing performance monitoring. Integrate AI services into existing platforms, applications and engineering workflows. Create technical documentation for models, data pipelines, APIs and deployment processes. Evaluate model outputs, identify risks or limitations, and improve performance through structured testing. Collaborate with engineers, data specialists ...

claim. Pearson has nearly two centuries of history and, with it, one of the world's deepest bodies of learning content, assessment data, and credentialing expertise. AI has transformed what that heritage makes possible. Our mission is to bring it to bear in new and distinctive ways - solving … build shares three characteristics: It will always involve integrations. Our products operate inside our clients' ecosystems - learning platforms, HR systems, identity providers, and data pipelines - and must work seamlessly with all of them. It will almost always build on other Pearson products. Pearson's portfolio spans assessment, qualifications ...

learning, ideally in domains involving high-frequency or large-scale time-series data. You will focus on developing alpha signal generation pipelines from data ingestion and feature engineering to model training and deployment - in collaboration with our trading and infrastructure teams. Responsibilities: Develop ML-based alpha generation models … using high-frequency order book and market microstructure data. Design and maintain data pipelines, preprocessing, and feature extraction workflows tailored to streaming tick data. Research and implement advanced deep learning architectures for short-horizon forecasting and signal extraction. Collaborate with quant researchers and developers to integrate models into ...

claim. Pearson has nearly two centuries of history and, with it, one of the world's deepest bodies of learning content, assessment data, and credentialing expertise. AI has transformed what that heritage makes possible. Our mission is to bring it to bear in new and distinctive ways - solving … build shares three characteristics: It will always involve integrations. Our products operate inside our clients' ecosystems - learning platforms, HR systems, identity providers, and data pipelines - and must work seamlessly with all of them. It will almost always build on other Pearson products. Pearson's portfolio spans assessment, qualifications ...

consumer product. This is a full-stack role with Python at its core; you'll own problems end-to-end across APIs, async data pipelines, databases, integrations, infrastructure, and web/mobile when needed. You'll work directly with the CTO and an experienced engineering team, alongside product … from early idea through production and iteration Work primarily in Python, moving across the stack when needed Build APIs, integrations, async data-processing pipelines and backend systems powering personalised product experiences Contribute to our React and React Native apps, working closely with design Shape product ideas directly with ...

across network planning, operations and assurance, ensuring solutions are implemented safely, responsibly and at scale. Working closely with senior stakeholders across technology, security, data, procurement, legal and regulatory teams, you will help establish consistent standards, encourage collaboration and deliver measurable business and customer outcomes. What you will … operational effectiveness. Shape a safe and governed approach to AI adoption, ensuring appropriate ownership, auditability, human oversight and production controls. Partner with Security, Data and AI governance teams to manage risks associated with AI deployment. Evaluate technology partners and vendor capabilities, supporting informed investment and technology decisions. Build ...

metadata enrichment at scale Collaborate with product, policy, and engineering teams to translate content intelligence into user impact Contribute to evaluation frameworks, data pipelines, and annotation systems Support rapid experimentation to prototype and launch new types of content signals Help improve system reliability, scalability, and performance across large … comfortable working with ML frameworks such as PyTorch, TensorFlow, or similar You have experience working with large datasets and care about data quality and evaluation You are interested in or have worked with multimodal machine learning You understand how to design systems that balance automation with quality ...

building and deploying custom AI agents, made for the document-heavy work finance and insurance teams handle every day. It takes multi-modal data and returns verifiable outputs with transparent logic, so accuracy and compliance come built in. It runs on the latest models too, including GPT, Claude … full audit trail, so the human in the loop can see exactly how it got there. The Context Graph makes all your data (across workflows, documents and integrations) queryable in one place, giving your agents the context to be properly useful. It's your institutional memory. The team ...

building and deploying custom AI agents, made for the document-heavy work finance and insurance teams handle every day. It takes multi-modal data and returns verifiable outputs with transparent logic, so accuracy and compliance come built in. It runs on the latest models too, including GPT, Claude … full audit trail, so the human in the loop can see exactly how it got there. The Context Graph makes all your data (across workflows, documents and integrations) queryable in one place, giving your agents the context to be properly useful. It's your institutional memory. The team ...

remaining secure. You will: Build Detection & Response Systems: Design, write, and maintain production-quality detections, automations and integrations (detections-as-code, SOAR playbooks, data and enrichment pipelines) that scale our monitoring capability and reduce manual toil. Own Tooling & Platform: Develop and improve the tooling the global SIRT/… detections, automation or security tooling, not solely operating. Engineering Proficiency: Comfortable writing and reviewing production-quality code (Scripting) and building automations, integrations and data pipelines that others depend on. Autonomous Leadership: Proven ability to work independently in satellite offices or distributed teams. You are comfortable being the "person ...

About Us: Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequoia Capital, and TCV, Fireworks … observability, and whatever a deployment turns out to need. Build on Training: Ship tooling around fine-tuning and post-training of LLMs, from data pipelines to evaluation, working alongside our applied ML engineers. Own Regional Capability: Turn EMEA-specific requirements into product, working with core platform where ...

features such as our agents, assistants, insights and more - from concept to production. Design and implement backend services for AI integrations and data pipeline. Build robust APIs and abstractions for internal AI usage Drive system scalability: caching, optimization, processing patterns, etc Contribute and drive the evolution … great fit if you... Are an experienced backend engineer who’s shipped AI products in the OpenAI & Anthropic era – especially text and data-heavy AI applications. Have hands-on experience with LLM orchestration and LLM API optimization (costs, latency, etc) Are familiar with RAG architectures and technologies Have ...

looking for a Software Engineer to join the Commodities trading group to build data pipelines for the ingestion and analysis of datasets. The role entails working closely with senior data engineers and key stakeholders across both green field and established projects. Initially it will be focused … getting data to our analysts, with opportunities to help design and build the core data infrastructure used across the group as your experience grows. How you will make an impact...Development of reliable ETL pipelines in PythonWork on a small team alongside experienced engineersRegular direct contact with ...

trg. seeks a mid-level Python Engineer to join a cross-functional team building internal tooling, data pipelines and automation services for engineering and project delivery teams in Central London. Hybrid — 4 days in office. The role focuses on delivering robust Python tooling and APIs to accelerate decision … making across major projects. You will work with structured data, write tests, and collaborate with senior engineers and domain experts to translate real-world engineering problems into #J-18808-Ljbffr ...

Citi’s GenAI Common Platform Engineering team is building Citi Assist, a Generative AI assistant powering Citi colleagues globally. We’re hiring a data-focused Full-Stack Engineer to enhance testing, evaluation and feedback capabilities across the stack, from React front-ends to Python back-end services … data pipelines. You will own features end-to-end, influence architecture, ensure security and compliance, and help shape the platform’s technical direction with ownership and pace. #J-18808-Ljbffr ...

Selection changes the language of the page/content Data Platform Infra Site Reliability Engineer London, England, United Kingdom Software and Services At Apple, we believe that innovation flourishes in an environment where ideas are challenged, collaboration is encouraged, and technology is pushed to its limits. This environment … world a better place.As an SRE on our team, you'll own the reliability, performance, and scale of the distributed storage and data platform systems that power Apple's services. You'll debug replication and consensus failures, tune systems at petabyte scale, and write production code that operates ...

About Football Radar Football Radar is a company that provides football analytics. Responsibilities You’ll own and optimise the data pipelines that power our prediction and club consultancy teams, helping deliver cutting‐edge football analytics. Estimated Benefits Health insurance Paid time off Benefits estimated based on industry standards ...

London is hiring a back-end engineer to build the programmable lab software that drives biology experiments. You’ll design robust data pipelines, implement APIs to connect instruments and robotics, and collaborate with scientists and automation engineers to translate workflows into scalable software. You’ll work with Python ...

Black Sheep Coffee is seeking a commercially minded Head of Finance Technology to lead the development of our Finance systems, data and automation capability. Based at our London HQ and reporting to the Interim Data Analytics & Systems Director, you will own NetSuite-driven processes, data ...