Data Pipeline Jobs in London

951 to 975 of 1,038 Data Pipeline Jobs in London

Lead AI Research Engineer

london (city of london), south east england, united kingdom
EMBS Technology
first AI R&D function from the ground up Design and deploy intelligent agents, models, and automation frameworks Experiment with LLMs, ML, and agentic systems using live production data Integrate third-party APIs (OpenAI, Microsoft, Anthropic) into core SaaS products Develop reusable architectures and rapid prototypes that move from idea to value fast Work with the AI Advisory … Board to shape strategic direction Upskill the wider engineering team in AI-first principles You’ll be turning raw data into smart systems that help schools, teachers, and students make better decisions — creating intelligent products that learn, adapt, and evolve. What Makes You a Fit You’re part engineer, part innovator. Someone who can move from concept to … understand LLMs, NLP, and ML frameworks like TensorFlow, PyTorch, or LangChain. You know your way around Azure, AWS, or GCP, and you’re confident designing APIs, microservices, and data pipelines. Maybe you’ve come from an academic background and now want to apply your research commercially. Or maybe you’re an experienced software engineer who’s already delivering More ❯
Posted:

AI Quantitative Developer - Crypto

london (city of london), south east england, united kingdom
Selby Jennings
Our client is a pioneering systematic hedge fund, redefining electronic trading through high-performance, data-driven solutions. As part of their Crypto desk, you'll join a cutting-edge team operating across centralised and decentralised markets, leveraging AI and ML to drive automation, enhance decision-making, and scale a fully automated global trading platform. This is a unique … scalable, real-time applications using deep learning and statistical techniques. Collaborate with Researchers and Traders to implement and optimise automated trading strategies. Integrate alternative datasets and build intelligent data pipelines to support research and execution. Monitor and manage the lifecycle of AI-driven systems in production environments. Requirements 6+ years of professional software development experience, ideally in a More ❯
Posted:

Technical Architect

Greater London, England, United Kingdom
Hybrid / WFH Options
Triad Group Plc
or based in our Godalming or Milton Keynes offices. Salary up to £80,000, plus excellent company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years’ experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make a real difference to users … or similar role. In-depth knowledge of system design, software architecture, and development methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Expertise in architectural design, data pipelines, cloud platforms, and API development. Knowledge of microservices and containerisation (Docker, Kubernetes). Experience with security best practices and compliance standards. Familiarity with agile methodologies and agile delivery. More ❯
Posted:

Technical Architect

london, south east england, united kingdom
Hybrid / WFH Options
Triad Group Plc
or based in our Godalming or Milton Keynes offices. Salary up to £80,000, plus excellent company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years’ experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make a real difference to users … or similar role. In-depth knowledge of system design, software architecture, and development methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Expertise in architectural design, data pipelines, cloud platforms, and API development. Knowledge of microservices and containerisation (Docker, Kubernetes). Experience with security best practices and compliance standards. Familiarity with agile methodologies and agile delivery. More ❯
Posted:

Quantitative Developer

London Area, United Kingdom
Hybrid / WFH Options
Harrington Starr
optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯
Posted:

Quantitative Developer

City of London, London, United Kingdom
Hybrid / WFH Options
Harrington Starr
optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯
Posted:

Quantitative Developer

london, south east england, united kingdom
Hybrid / WFH Options
Harrington Starr
optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯
Posted:

Quantitative Developer

london (city of london), south east england, united kingdom
Hybrid / WFH Options
Harrington Starr
optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯
Posted:

Privacy Specialist - Technology

Central London, London, United Kingdom
Staffworx Limited
and platform teams during privacy incidents or investigations. Provide technical insight during incident triage, root cause analysis, and remediation planning. Coach teams in privacy-preserving engineering practices, including data minimisation, anonymisation/pseudonymisation, and consent management. Cross-Functional Collaboration Collaborate with Product Owners, Architects, Security Engineers and Lega to ensure privacy compliance is aligned with business and technical … Architecture to embed privacy considerations early in design phases. Contribute to the continuous improvement of privacy engineering practices across the organisation. Experience Technical Expertise: Background in software or data engineering, with hands-on familiarity across data pipelines, APIs, SDKs, client/server tracking, consent tooling, and event-driven systems. Understanding of cloud environments, modern data … Regulatory Literacy: Working knowledge of GDPR, PECR and relevant regulatory guidance from authorities such as the ICO or EDPB. Capable of identifying potential compliance risks and escalating to Data Protection or Legal teams when appropriate. Agile & SAFe Proficiency: Experience embedding Non-Functional Requirements (NFRs) and Behaviour-Driven Development (BDD) practices within agile workflows. Comfortable participating in agile ceremonies More ❯
Employment Type: Contract
Posted:

Senior AI Solutions Engineer

london, south east england, united kingdom
Carbon3 - The UK's AI Solution Platform
Senior AI Solutions Engineer About Carbon3 is building the UK's sovereign AI infrastructure platform, combining renewable energy, distributed compute, and full data ownership to power the next generation of sustainable innovation. The Role: We're seeking a Senior AI Solutions Engineer to sit at the intersection of customer business challenges and cutting-edge AI technology. This is … and evaluation of foundation models for domain-specific use cases. Package and deploy models into scalable inference endpoints (REST/gRPC APIs, containerised or GPU-accelerated environments). Data and Knowledge Integration (RAG) Build pipelines that connect structured and unstructured enterprise data into vector databases and embedding models . Design semantic search and retrieval strategies to … maximise response accuracy and relevance. Ensure all data pipelines are secure, compliant, and performant at scale. Collaboration and Knowledge Sharing Work closely with infrastructure and platform engineering teams for smooth deployments. Feed insights into the product roadmap and platform feature development. Act as a thought leader and trusted advisor to customers exploring applied AI adoption. Technical Excellence Develop More ❯
Posted:

Senior Software Engineer, Transaction Tracing

London, United Kingdom
Chainalysis Inc
and doing it with other exceptionally talented teammates. Our industry changes every day and our job is to create user facing products supported by a flexible and scalable data platform allowing us to adapt to those rapid changes and bring value to our customers. As a Software Engineer within the Investigations group, you'll join a remote team … of other engineers and share the responsibility of providing the right tools for the right data in order to build best in class customer experiences for our customers. Thus, you'll find the opportunity to lead, build and maintain customer facing web frontend features as well as the services and data pipelines backing them. Part of … this responsibility is also to learn and understand the domain as well as the underlying data platform in order to successfully partner with product managers and designers to deliver impactful solutions to our customers. Responsibilities Become part of an established team adept at collaboration and task allocation. A team which can focus on generating direct impact. Make key More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Founding AI Engineer

City of London, London, United Kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Founding AI Engineer

London Area, United Kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Founding AI Engineer

london, south east england, united kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Founding AI Engineer

london (city of london), south east england, united kingdom
Higher - AI recruitment
Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯
Posted:

Python Developer

London, UK
NearTech Search
fit for an out and out python engineer who has moved into the AI space/tinkered within LLMs. The company are not looking for out and out data scientists/MLEs at this point in time) You'll build back-end systems in Python that connect seamlessly with LLMs, data pipelines, and modern microservices. Now More ❯
Employment Type: Full-time
Posted:

AI / Machine Learning Engineer Agentic AI & LLM Systems

London, United Kingdom
Hybrid / WFH Options
of Agentic AI building systems where LLMs reason, act, and collaborate autonomously to drive real-world outcomes. As a Machine Learning Engineer , youll design the frameworks, tools, and data loops that allow intelligent agents to think, plan, and improve themselves transforming raw model power into adaptive, high-performing AI systems. Design Scalable Frameworks Create data pipelines More ❯
Posted:

Backend Python Developer

London, United Kingdom
Hybrid / WFH Options
Adecco
month contract , inside IR35 , offering hybrid working (3 days onsite). Key Responsibilities Develop robust backend systems for Python-based web applications Integrate AI/ML components with data, infrastructure, and frontend systems Deliver high-quality, well-documented, and thoroughly tested code Monitor and enhance performance of tools and services Collaborate across technical teams to build end-to … end data pipelines Skills Required Strong Python backend development experience (FastAPI, Flask, Django). Proven track record of delivering production-grade software at scale. Experience with Docker and containerisation. Familiarity with cloud deployment and troubleshooting cloud-related issues. Comfortable working in modern cloud-native environments with CI/CD pipelines. Interested in learning more or applying? Get in More ❯
Employment Type: Contract
Posted:

Machine Learning Quant Engineer - Investment banking/ XVA

London, United Kingdom
Harvey Nash
art ML models for alpha generation, portfolio construction, pricing, and risk management Lead ML research initiatives and contribute to long-term modeling strategy across asset classes Architect robust data pipelines and scalable model infrastructure for production deployment Mentor junior quants and engineers; contribute to knowledge-sharing and model governance processes Stay current with cutting-edge ML research (e.g. … deep learning, generative models, reinforcement learning) and assess applicability to financial markets Collaborate closely with cross-functional teams, including traders, data engineers, and software developers What We're Looking For Required: 7+ years of experience in a quant/ML engineering or research role within a financial institution, hedge fund, or tech firm Advanced degree (PhD or Master More ❯
Employment Type: Permanent
Salary: £1000 - £1200 per day
Posted:

Machine Learning Quant Engineer - Investment banking/ XVA

London, South East, England, United Kingdom
Harvey Nash
art ML models for alpha generation, portfolio construction, pricing, and risk management Lead ML research initiatives and contribute to long-term modeling strategy across asset classes Architect robust data pipelines and scalable model infrastructure for production deployment Mentor junior quants and engineers; contribute to knowledge-sharing and model governance processes Stay current with cutting-edge ML research (e.g. … deep learning, generative models, reinforcement learning) and assess applicability to financial markets Collaborate closely with cross-functional teams, including traders, data engineers, and software developers What We're Looking For Required: 7+ years of experience in a quant/ML engineering or research role within a financial institution, hedge fund, or tech firm Advanced degree (PhD or Master More ❯
Employment Type: Full-Time
Salary: £1,000 - £1,200 per day
Posted:

C# Developer - Up to £120,000 + Bonus + Package

Greater London, England, United Kingdom
Hybrid / WFH Options
Hunter Bond
and design decisions Collaborate with Front Office, Quant, and DevOps teams to deliver robust, production-ready systems Work with advanced technologies across distributed systems, microservices , and real-time data pipelines Influence platform direction and contribute to long-term technical strategy ✅ What We’re Looking For Strong proficiency in C#/.NET , with an emphasis on clean, maintainable, high … performance code Deep understanding of Computer Science fundamentals — data structures, algorithms, concurrency 1+ year of professional experience (FinTech, trading, or high-performance computing a strong plus) Experience in mission-critical or complex systems environments is highly advantageous Knowledge of multithreading, async programming , and system optimization beneficial Comfortable in a fast-paced, agile, test-driven development environment 💰 Compensation & Benefits More ❯
Posted:

C# Developer - Up to £120,000 + Bonus + Package

london, south east england, united kingdom
Hybrid / WFH Options
Hunter Bond
and design decisions Collaborate with Front Office, Quant, and DevOps teams to deliver robust, production-ready systems Work with advanced technologies across distributed systems, microservices , and real-time data pipelines Influence platform direction and contribute to long-term technical strategy ✅ What We’re Looking For Strong proficiency in C#/.NET , with an emphasis on clean, maintainable, high … performance code Deep understanding of Computer Science fundamentals — data structures, algorithms, concurrency 1+ year of professional experience (FinTech, trading, or high-performance computing a strong plus) Experience in mission-critical or complex systems environments is highly advantageous Knowledge of multithreading, async programming , and system optimization beneficial Comfortable in a fast-paced, agile, test-driven development environment 💰 Compensation & Benefits More ❯
Posted:

Software Engineer (National Security)

London Area, United Kingdom
Frontier Resourcing
a cutting-edge team developing impactful, mission-driven technology. The role offers the chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You’ll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible … taking projects from initial concept through to delivery Analytical thinker who can decompose challenges and deliver iterative value Preferred Background Experience using Java, C++, or Python Understanding of data-intensive systems, backend services, or cloud-based platforms Familiarity with regulated, high-security, or mission-critical development contexts Confidence working in research-led or exploratory project settings Curiosity about More ❯
Posted:

Software Engineer (National Security)

City of London, London, United Kingdom
Frontier Resourcing
a cutting-edge team developing impactful, mission-driven technology. The role offers the chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You’ll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible … taking projects from initial concept through to delivery Analytical thinker who can decompose challenges and deliver iterative value Preferred Background Experience using Java, C++, or Python Understanding of data-intensive systems, backend services, or cloud-based platforms Familiarity with regulated, high-security, or mission-critical development contexts Confidence working in research-led or exploratory project settings Curiosity about More ❯
Posted:

Software Engineer (National Security)

london, south east england, united kingdom
Frontier Resourcing
a cutting-edge team developing impactful, mission-driven technology. The role offers the chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You’ll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible … taking projects from initial concept through to delivery Analytical thinker who can decompose challenges and deliver iterative value Preferred Background Experience using Java, C++, or Python Understanding of data-intensive systems, backend services, or cloud-based platforms Familiarity with regulated, high-security, or mission-critical development contexts Confidence working in research-led or exploratory project settings Curiosity about More ❯
Posted:
Data Pipeline
London
10th Percentile
£46,000
25th Percentile
£61,250
Median
£80,000
75th Percentile
£97,500
90th Percentile
£122,500