701 to 725 of 980 Data Pipeline Jobs in London

Senior Software Engineer (Data-Centric) Manchester or South London (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We’re Looking For 5+ years’ experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable “rolling your sleeves up” to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯

Senior Software Engineer (Data-Centric) Manchester or South London (Hybrid – 2 x a week in office) £70,000 – £85,000 + 10% bonus + excellent benefits Our client is a global self-defence intelligence and technology organisation helping governments and defence agencies act with confidence. They use AI, graph databases, cloud, and search technologies to deliver faster, smarter … Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We’re Looking For 5+ years’ experience in software … ability to deliver reliable, scalable systems using cloud technologies (AWS preferred). Strong understanding of system design , API-first development , and SDLC best practices . Experience with complex data systems - structured, unstructured, or graph-based. Curious, proactive, and comfortable “rolling your sleeves up” to solve hard problems. Why Join? Work on advanced data and intelligence platforms More ❯

Hiring: Data Engineer | Mission-Driven Fintech | Remote (UK based) 🚀 Propel are proud to be partnering with a rapidly scaling global fintech that’s transforming financial access for immigrants and international communities across the world. 📈 As their lending business continues to grow, they're looking for a Data Engineer to help scale the data infrastructure … that powers smarter, fairer credit decisions. 🧠 If you're passionate about building robust data pipelines, enabling real-time underwriting, and turning complex datasets into production-ready insights — this is your chance to work at the heart of a mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending … Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone you know? 📩 Drop me a message or apply directly – I’d love to tell you more More ❯

Hiring: Data Engineer | Mission-Driven Fintech | Remote (UK based) 🚀 Propel are proud to be partnering with a rapidly scaling global fintech that’s transforming financial access for immigrants and international communities across the world. 📈 As their lending business continues to grow, they're looking for a Data Engineer to help scale the data infrastructure … that powers smarter, fairer credit decisions. 🧠 If you're passionate about building robust data pipelines, enabling real-time underwriting, and turning complex datasets into production-ready insights — this is your chance to work at the heart of a mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending … Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone you know? 📩 Drop me a message or apply directly – I’d love to tell you more More ❯

Youll be joining an established global commodities trading firm where world-class data analysts are already building sophisticated, high-impact models. They now need the tech muscle to take them to production. In this crucial role, youll connect sophisticated analytics with scalable infrastructure, manage CI/CD pipelines, containerized systems, and AWS environments that underpin the firms data lake, data pipelines, and analytics platforms. Youll build robust infrastructure, automate data ingestion, and deploy cutting-edge analytical models into live trading environments. Working alongside brilliant analysts and engineers, youll shape the firms technical foundation and directly influence how data drives trading strategy and decision-making. Location: London, hybrid. If youre passionate More ❯

this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. For further information More ❯

brands. Kantar Media is a wholly owned but operationally independent part of the Kantar Group. Job Details As people increasingly move across channels and platforms, Kantar Media's data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries … s leading organisations succeed and grow. Job Title: Junior Product Owner Location: London, Grays Inn Road Full time/Permanent/Hybrid Role Description Atria is the core data processing engine at Kantar Media, powering cross-media measurement solutions for clients worldwide. It ingests and processes data from multiple media panels—including traditional TV and online … and client needs. This is an ideal opportunity for someone early in their product career who is eager to learn, grow, and develop their skills in a dynamic, data-driven, and agile environment. Role Requirements Product Delivery Support Assist Product team in managing and prioritising the team backlog based on business value and technical feasibility. Support in defining More ❯

a Quantitative Developer on a contract basis A leading hedge fund with a strong track record in systematic and quantitative trading. The firm combines advanced research, technology, and data to deliver market-leading performance across multiple asset classes. They are seeking a Quantitative Developer on a 6-month contract to support the ongoing development of research tools, trading … within their core systematic strategies team. Role The Quantitative Developer will collaborate with researchers to implement, test, and deploy quantitative trading strategies and risk models. Build and enhance data pipelines and backtesting frameworks for large-scale market data. Integrate new data sources and ensure data quality and reliability across research environments. Refactor and optimise … as a Quantitative Developer within a hedge fund, prop trading, or systematic trading environment. Strong programming expertise in Python (C++ or Java also advantageous). Excellent understanding of data structures, algorithms, and numerical computing. Experience with time-series data, backtesting, and quantitative research workflows. Familiarity with financial markets and trading systems. Strong communication skills with the More ❯

Are you a Data Engineer who loves solving real-world data problems and building scalable solutions from the ground up? We’re supporting a well-established business in the digital transformation space, and they’re looking for someone to help drive data platform development across multiple business areas and tech environments. Data Engineer £55,000-£65,000 per annum London based 2 days a week The role: You’ll work closely with technical and non-technical teams, owning data pipelines, improving performance, and getting involved in projects that span cloud, automation, and AI-readiness This role is perfect for someone who enjoys building and optimising data … moving environment, and wants to work across a variety of platforms and challenges. What you'll need: Solid hands-on experience with Python and SQL Strong knowledge of data pipelines, cloud infrastructure (AWS & Azure), and integration tools Familiarity with tools like Airflow and version control, GIT. Confident working with structured and unstructured datasets Comfortable contributing to both technical More ❯

Are you a Data Engineer who loves solving real-world data problems and building scalable solutions from the ground up? We’re supporting a well-established business in the digital transformation space, and they’re looking for someone to help drive data platform development across multiple business areas and tech environments. Data Engineer £55,000-£65,000 per annum London based 2 days a week The role: You’ll work closely with technical and non-technical teams, owning data pipelines, improving performance, and getting involved in projects that span cloud, automation, and AI-readiness This role is perfect for someone who enjoys building and optimising data … moving environment, and wants to work across a variety of platforms and challenges. What you'll need: Solid hands-on experience with Python and SQL Strong knowledge of data pipelines, cloud infrastructure (AWS & Azure), and integration tools Familiarity with tools like Airflow and version control, GIT. Confident working with structured and unstructured datasets Comfortable contributing to both technical More ❯

making process, with the founders having had firsthand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI.This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work on … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

You ll be joining an established global commodities trading firm where world-class data analysts are already building sophisticated, high-impact models. They now need the tech muscle to take them to production. In this crucial role, you ll connect sophisticated analytics with scalable infrastructure, manage CI/CD pipelines, containerized systems, and AWS environments that underpin the … firm s data lake, data pipelines, and analytics platforms. You ll build robust infrastructure, automate data ingestion, and deploy cutting-edge analytical models into live trading environments. Working alongside brilliant analysts and engineers, you ll shape the firm s technical foundation and directly influence how data drives trading strategy and decision-making. More ❯

You’ll be joining an established global commodities trading firm where world-class data analysts are already building sophisticated, high-impact models. They now need the tech muscle to take them to production. In this crucial role, you’ll connect sophisticated analytics with scalable infrastructure, manage CI/CD pipelines, containerized systems, and AWS environments that underpin the … firm’s data lake, data pipelines, and analytics platforms. You’ll build robust infrastructure, automate data ingestion, and deploy cutting-edge analytical models into live trading environments. Working alongside brilliant analysts and engineers, you’ll shape the firm’s technical foundation and directly influence how data drives trading strategy and decision-making. More ❯

You’ll be joining an established global commodities trading firm where world-class data analysts are already building sophisticated, high-impact models. They now need the tech muscle to take them to production. In this crucial role, you’ll connect sophisticated analytics with scalable infrastructure, manage CI/CD pipelines, containerized systems, and AWS environments that underpin the … firm’s data lake, data pipelines, and analytics platforms. You’ll build robust infrastructure, automate data ingestion, and deploy cutting-edge analytical models into live trading environments. Working alongside brilliant analysts and engineers, you’ll shape the firm’s technical foundation and directly influence how data drives trading strategy and decision-making. More ❯

Kafka Modernisation. We are looking at a potential project starting in December and likely running for 8 months to migrate Cloudera CDP Kafka clusters to Acceldata ODP Kafka. Data pipelines are streaming and the target architecture is stretched. If anyone exists who is a Kafka expert and has experience of doing this before in a global enterprise setting More ❯

Senior Data Engineer (GenAI) - Leading Tech Company | London (Hybrid) Hybrid: 1 day in the office/4 days WFH Permanent role only Represented by Robert Half Limited Please note: No visa sponsorship on offer, No B2B,B2C, Fully remote workers or contractors on offer. The Opportunity We're looking for a Senior Data Engineer with hands … on GenAI experience to join a forward-thinking technology business that's building data-driven solutions with real-world impact. This is a highly visible, senior-level role where you'll take ownership of data pipelines, architecture, and GenAI operational frameworks - helping shape the next generation of AI-driven products and analytics. If you enjoy combining … engineering rigor with AI innovation, this role gives you the platform, freedom, and backing to make it happen. Key Responsibilities Design, build, and maintain scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development of … their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k + bonus More ❯

We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯

We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯

We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯