Data Pipeline Jobs in London

976 to 1,000 of 1,053 Data Pipeline Jobs in London

Quantitative Developer

london, south east england, united kingdom
Hybrid / WFH Options
Harrington Starr
optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯
Posted:

Quantitative Developer

london (city of london), south east england, united kingdom
Hybrid / WFH Options
Harrington Starr
optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯
Posted:

Privacy Specialist - Technology

Central London, London, United Kingdom
Staffworx Limited
and platform teams during privacy incidents or investigations. Provide technical insight during incident triage, root cause analysis, and remediation planning. Coach teams in privacy-preserving engineering practices, including data minimisation, anonymisation/pseudonymisation, and consent management. Cross-Functional Collaboration Collaborate with Product Owners, Architects, Security Engineers and Lega to ensure privacy compliance is aligned with business and technical … Architecture to embed privacy considerations early in design phases. Contribute to the continuous improvement of privacy engineering practices across the organisation. Experience Technical Expertise: Background in software or data engineering, with hands-on familiarity across data pipelines, APIs, SDKs, client/server tracking, consent tooling, and event-driven systems. Understanding of cloud environments, modern data … Regulatory Literacy: Working knowledge of GDPR, PECR and relevant regulatory guidance from authorities such as the ICO or EDPB. Capable of identifying potential compliance risks and escalating to Data Protection or Legal teams when appropriate. Agile & SAFe Proficiency: Experience embedding Non-Functional Requirements (NFRs) and Behaviour-Driven Development (BDD) practices within agile workflows. Comfortable participating in agile ceremonies More ❯
Employment Type: Contract
Posted:

Senior AI Solutions Engineer

london, south east england, united kingdom
Carbon3 - The UK's AI Solution Platform
Senior AI Solutions Engineer About Carbon3 is building the UK's sovereign AI infrastructure platform, combining renewable energy, distributed compute, and full data ownership to power the next generation of sustainable innovation. The Role: We're seeking a Senior AI Solutions Engineer to sit at the intersection of customer business challenges and cutting-edge AI technology. This is … and evaluation of foundation models for domain-specific use cases. Package and deploy models into scalable inference endpoints (REST/gRPC APIs, containerised or GPU-accelerated environments). Data and Knowledge Integration (RAG) Build pipelines that connect structured and unstructured enterprise data into vector databases and embedding models . Design semantic search and retrieval strategies to … maximise response accuracy and relevance. Ensure all data pipelines are secure, compliant, and performant at scale. Collaboration and Knowledge Sharing Work closely with infrastructure and platform engineering teams for smooth deployments. Feed insights into the product roadmap and platform feature development. Act as a thought leader and trusted advisor to customers exploring applied AI adoption. Technical Excellence Develop More ❯
Posted:

Senior Software Engineer, Transaction Tracing

London, United Kingdom
Chainalysis Inc
and doing it with other exceptionally talented teammates. Our industry changes every day and our job is to create user facing products supported by a flexible and scalable data platform allowing us to adapt to those rapid changes and bring value to our customers. As a Software Engineer within the Investigations group, you'll join a remote team … of other engineers and share the responsibility of providing the right tools for the right data in order to build best in class customer experiences for our customers. Thus, you'll find the opportunity to lead, build and maintain customer facing web frontend features as well as the services and data pipelines backing them. Part of … this responsibility is also to learn and understand the domain as well as the underlying data platform in order to successfully partner with product managers and designers to deliver impactful solutions to our customers. Responsibilities Become part of an established team adept at collaboration and task allocation. A team which can focus on generating direct impact. Make key More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Founding AI Engineer

City of London, London, United Kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Founding AI Engineer

London Area, United Kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Founding AI Engineer

london, south east england, united kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Founding AI Engineer

london (city of london), south east england, united kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Python Developer

London, UK
NearTech Search
fit for an out and out python engineer who has moved into the AI space/tinkered within LLMs. The company are not looking for out and out data scientists/MLEs at this point in time) You'll build back-end systems in Python that connect seamlessly with LLMs, data pipelines, and modern microservices. Now More ❯
Employment Type: Full-time
Posted:

AI / Machine Learning Engineer Agentic AI & LLM Systems

London, United Kingdom
Hybrid / WFH Options
of Agentic AI building systems where LLMs reason, act, and collaborate autonomously to drive real-world outcomes. As a Machine Learning Engineer , youll design the frameworks, tools, and data loops that allow intelligent agents to think, plan, and improve themselves transforming raw model power into adaptive, high-performing AI systems. Design Scalable Frameworks Create data pipelines More ❯
Posted:

Backend Python Developer

London, United Kingdom
Hybrid / WFH Options
Adecco
month contract , inside IR35 , offering hybrid working (3 days onsite). Key Responsibilities Develop robust backend systems for Python-based web applications Integrate AI/ML components with data, infrastructure, and frontend systems Deliver high-quality, well-documented, and thoroughly tested code Monitor and enhance performance of tools and services Collaborate across technical teams to build end-to … end data pipelines Skills Required Strong Python backend development experience (FastAPI, Flask, Django). Proven track record of delivering production-grade software at scale. Experience with Docker and containerisation. Familiarity with cloud deployment and troubleshooting cloud-related issues. Comfortable working in modern cloud-native environments with CI/CD pipelines. Interested in learning more or applying? Get in More ❯
Employment Type: Contract
Posted:

Machine Learning Quant Engineer - Investment banking/ XVA

London, United Kingdom
Harvey Nash
art ML models for alpha generation, portfolio construction, pricing, and risk management Lead ML research initiatives and contribute to long-term modeling strategy across asset classes Architect robust data pipelines and scalable model infrastructure for production deployment Mentor junior quants and engineers; contribute to knowledge-sharing and model governance processes Stay current with cutting-edge ML research (e.g. … deep learning, generative models, reinforcement learning) and assess applicability to financial markets Collaborate closely with cross-functional teams, including traders, data engineers, and software developers What We're Looking For Required: 7+ years of experience in a quant/ML engineering or research role within a financial institution, hedge fund, or tech firm Advanced degree (PhD or Master More ❯
Employment Type: Permanent
Salary: £1000 - £1200 per day
Posted:

Machine Learning Quant Engineer - Investment banking/ XVA

London, South East, England, United Kingdom
Harvey Nash
art ML models for alpha generation, portfolio construction, pricing, and risk management Lead ML research initiatives and contribute to long-term modeling strategy across asset classes Architect robust data pipelines and scalable model infrastructure for production deployment Mentor junior quants and engineers; contribute to knowledge-sharing and model governance processes Stay current with cutting-edge ML research (e.g. … deep learning, generative models, reinforcement learning) and assess applicability to financial markets Collaborate closely with cross-functional teams, including traders, data engineers, and software developers What We're Looking For Required: 7+ years of experience in a quant/ML engineering or research role within a financial institution, hedge fund, or tech firm Advanced degree (PhD or Master More ❯
Employment Type: Full-Time
Salary: £1,000 - £1,200 per day
Posted:

C# Developer - Up to £120,000 + Bonus + Package

Greater London, England, United Kingdom
Hybrid / WFH Options
Hunter Bond
and design decisions Collaborate with Front Office, Quant, and DevOps teams to deliver robust, production-ready systems Work with advanced technologies across distributed systems, microservices , and real-time data pipelines Influence platform direction and contribute to long-term technical strategy ✅ What We’re Looking For Strong proficiency in C#/.NET , with an emphasis on clean, maintainable, high … performance code Deep understanding of Computer Science fundamentals — data structures, algorithms, concurrency 1+ year of professional experience (FinTech, trading, or high-performance computing a strong plus) Experience in mission-critical or complex systems environments is highly advantageous Knowledge of multithreading, async programming , and system optimization beneficial Comfortable in a fast-paced, agile, test-driven development environment 💰 Compensation & Benefits More ❯
Posted:

C# Developer - Up to £120,000 + Bonus + Package

london, south east england, united kingdom
Hybrid / WFH Options
Hunter Bond
and design decisions Collaborate with Front Office, Quant, and DevOps teams to deliver robust, production-ready systems Work with advanced technologies across distributed systems, microservices , and real-time data pipelines Influence platform direction and contribute to long-term technical strategy ✅ What We’re Looking For Strong proficiency in C#/.NET , with an emphasis on clean, maintainable, high … performance code Deep understanding of Computer Science fundamentals — data structures, algorithms, concurrency 1+ year of professional experience (FinTech, trading, or high-performance computing a strong plus) Experience in mission-critical or complex systems environments is highly advantageous Knowledge of multithreading, async programming , and system optimization beneficial Comfortable in a fast-paced, agile, test-driven development environment 💰 Compensation & Benefits More ❯
Posted:

Software Engineer (National Security)

City of London, London, United Kingdom
Frontier Resourcing
a cutting-edge team developing impactful, mission-driven technology. The role offers the chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You’ll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible … taking projects from initial concept through to delivery Analytical thinker who can decompose challenges and deliver iterative value Preferred Background Experience using Java, C++, or Python Understanding of data-intensive systems, backend services, or cloud-based platforms Familiarity with regulated, high-security, or mission-critical development contexts Confidence working in research-led or exploratory project settings Curiosity about More ❯
Posted:

Software Engineer (National Security)

London Area, United Kingdom
Frontier Resourcing
a cutting-edge team developing impactful, mission-driven technology. The role offers the chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You’ll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible … taking projects from initial concept through to delivery Analytical thinker who can decompose challenges and deliver iterative value Preferred Background Experience using Java, C++, or Python Understanding of data-intensive systems, backend services, or cloud-based platforms Familiarity with regulated, high-security, or mission-critical development contexts Confidence working in research-led or exploratory project settings Curiosity about More ❯
Posted:

Senior AI Engineer (LLMs, Agents, Python)

City of London, London, United Kingdom
Evergrowth
LLM orchestration & evals: OpenAI/Anthropic/Gemini; Orq.ai and LangSmith are in use today (nice‐to‐have, not required); experience with lightweight, framework‐agnostic patterns is valued. Data & infra: SQL, Redis, managed vector DB, S3‐compatible storage, Docket, Sentry. Patterns: function/tool calling, retrieval‐augmented generation (RAG), structured outputs, self‐checks, retries/backoffs, circuit breakers … debugging failures across model/provider boundaries. Nice to have Experience with LangChain/LangSmith, Orq.ai, LlamaIndex, DSPy, RAG, Guardrails/Outlines/Instructor. Vector DBs, embeddings, and data pipelines. First 90 days - example outcomes Review and improve existing core Agentic workflows Improve the quality of existing LLM outputs through prompting Introduce auto Value Proposition feature to production More ❯
Posted:

Senior AI Engineer (LLMs, Agents, Python)

London Area, United Kingdom
Evergrowth
LLM orchestration & evals: OpenAI/Anthropic/Gemini; Orq.ai and LangSmith are in use today (nice‐to‐have, not required); experience with lightweight, framework‐agnostic patterns is valued. Data & infra: SQL, Redis, managed vector DB, S3‐compatible storage, Docket, Sentry. Patterns: function/tool calling, retrieval‐augmented generation (RAG), structured outputs, self‐checks, retries/backoffs, circuit breakers … debugging failures across model/provider boundaries. Nice to have Experience with LangChain/LangSmith, Orq.ai, LlamaIndex, DSPy, RAG, Guardrails/Outlines/Instructor. Vector DBs, embeddings, and data pipelines. First 90 days - example outcomes Review and improve existing core Agentic workflows Improve the quality of existing LLM outputs through prompting Introduce auto Value Proposition feature to production More ❯
Posted:

Senior AI Engineer (LLMs, Agents, Python)

london, south east england, united kingdom
Evergrowth
LLM orchestration & evals: OpenAI/Anthropic/Gemini; Orq.ai and LangSmith are in use today (nice‐to‐have, not required); experience with lightweight, framework‐agnostic patterns is valued. Data & infra: SQL, Redis, managed vector DB, S3‐compatible storage, Docket, Sentry. Patterns: function/tool calling, retrieval‐augmented generation (RAG), structured outputs, self‐checks, retries/backoffs, circuit breakers … debugging failures across model/provider boundaries. Nice to have Experience with LangChain/LangSmith, Orq.ai, LlamaIndex, DSPy, RAG, Guardrails/Outlines/Instructor. Vector DBs, embeddings, and data pipelines. First 90 days - example outcomes Review and improve existing core Agentic workflows Improve the quality of existing LLM outputs through prompting Introduce auto Value Proposition feature to production More ❯
Posted:

Senior AI Engineer (LLMs, Agents, Python)

london (city of london), south east england, united kingdom
Evergrowth
LLM orchestration & evals: OpenAI/Anthropic/Gemini; Orq.ai and LangSmith are in use today (nice‐to‐have, not required); experience with lightweight, framework‐agnostic patterns is valued. Data & infra: SQL, Redis, managed vector DB, S3‐compatible storage, Docket, Sentry. Patterns: function/tool calling, retrieval‐augmented generation (RAG), structured outputs, self‐checks, retries/backoffs, circuit breakers … debugging failures across model/provider boundaries. Nice to have Experience with LangChain/LangSmith, Orq.ai, LlamaIndex, DSPy, RAG, Guardrails/Outlines/Instructor. Vector DBs, embeddings, and data pipelines. First 90 days - example outcomes Review and improve existing core Agentic workflows Improve the quality of existing LLM outputs through prompting Introduce auto Value Proposition feature to production More ❯
Posted:

Quantitative Developer - Hybrid Working - £70,000 - £275,000 Base (+ Bonus)

Greater London, England, United Kingdom
Hybrid / WFH Options
Hunter Bond
next wave of tech driven, entrepreneurial personalities to help expand the team. Responsibilities: Develop and Maintain Research Platforms, building Python-based tools and libraries for backtesting strategies, analyzing data, and simulating trading logic to support quant researchers. Implement Quantitative Models and Signals, translating trading ideas or academic models into production-ready Python code, ensuring reproducibility, performance, and alignment … with real-world trading constraints. Automate Data Pipelines, designing and managing workflows for collecting, cleaning, and storing large volumes of financial data (e.g., price, volume, fundamentals, alternative data), often using tools like Pandas, NumPy, and Dask. Collaborate Across Teams for Deployment, working with researchers, traders, and DevOps teams to integrate Python models into production More ❯
Posted:

Business Analyst (Adtech)

City of London, London, United Kingdom
Hybrid / WFH Options
Harnham
digital media and publishing group, working within their commercial technology and advertising division. You’ll collaborate with senior analysts and product teams to deliver solutions across ad platforms, data systems, and video advertising technology. This is a hands-on, technically focused role ideal for someone who enjoys working in a fast-paced, data-driven environment. Our … and product teams to gather and define requirements. Translate commercial objectives into detailed technical specifications. Support the development and enhancement of ad technology solutions. Analyse and document processes, data flows, and systems integrations. Contribute to projects involving ad blockers, data pipelines, and analytics (e.g. BigQuery). Experience & Skills 3+ years’ experience as a Business Analyst Strong … technical understanding and ability to work closely with developers. Familiarity with ad tech platforms, data signals, or video ad stacks (e.g. programmatic advertising, publishing media environments). Advantageous: exposure to AWS, GitHub, or backend systems. Detail-oriented, proactive, and comfortable in a fast-paced commercial environment. Preference for candidates from product-led or media/tech organisations More ❯
Posted:

Business Analyst (Adtech)

London Area, United Kingdom
Hybrid / WFH Options
Harnham
digital media and publishing group, working within their commercial technology and advertising division. You’ll collaborate with senior analysts and product teams to deliver solutions across ad platforms, data systems, and video advertising technology. This is a hands-on, technically focused role ideal for someone who enjoys working in a fast-paced, data-driven environment. Our … and product teams to gather and define requirements. Translate commercial objectives into detailed technical specifications. Support the development and enhancement of ad technology solutions. Analyse and document processes, data flows, and systems integrations. Contribute to projects involving ad blockers, data pipelines, and analytics (e.g. BigQuery). Experience & Skills 3+ years’ experience as a Business Analyst Strong … technical understanding and ability to work closely with developers. Familiarity with ad tech platforms, data signals, or video ad stacks (e.g. programmatic advertising, publishing media environments). Advantageous: exposure to AWS, GitHub, or backend systems. Detail-oriented, proactive, and comfortable in a fast-paced commercial environment. Preference for candidates from product-led or media/tech organisations More ❯
Posted:
Data Pipeline
London
10th Percentile
£46,000
25th Percentile
£61,250
Median
£80,000
75th Percentile
£97,500
90th Percentile
£122,500