751 to 775 of 1,086 Data Pipeline Jobs in London

Are you a Data Engineer who loves solving real-world data problems and building scalable solutions from the ground up? We’re supporting a well-established business in the digital transformation space, and they’re looking for someone to help drive data platform development across multiple business areas and tech environments. Data Engineer £55,000-£65,000 per annum London based 2 days a week The role: You’ll work closely with technical and non-technical teams, owning data pipelines, improving performance, and getting involved in projects that span cloud, automation, and AI-readiness This role is perfect for someone who enjoys building and optimising data … moving environment, and wants to work across a variety of platforms and challenges. What you'll need: Solid hands-on experience with Python and SQL Strong knowledge of data pipelines, cloud infrastructure (AWS & Azure), and integration tools Familiarity with tools like Airflow and version control, GIT. Confident working with structured and unstructured datasets Comfortable contributing to both technical More ❯

Are you a Data Engineer who loves solving real-world data problems and building scalable solutions from the ground up? We’re supporting a well-established business in the digital transformation space, and they’re looking for someone to help drive data platform development across multiple business areas and tech environments. Data Engineer £55,000-£65,000 per annum London based 2 days a week The role: You’ll work closely with technical and non-technical teams, owning data pipelines, improving performance, and getting involved in projects that span cloud, automation, and AI-readiness This role is perfect for someone who enjoys building and optimising data … moving environment, and wants to work across a variety of platforms and challenges. What you'll need: Solid hands-on experience with Python and SQL Strong knowledge of data pipelines, cloud infrastructure (AWS & Azure), and integration tools Familiarity with tools like Airflow and version control, GIT. Confident working with structured and unstructured datasets Comfortable contributing to both technical More ❯

making process, with the founders having had firsthand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI.This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work on … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

process, with the founders having had first hand experience of the lengthiness and challenges of deal processes in the past. Their stack spans across back end, front end, data and crucially AI. This is a great opportunity for an entrepreneurial software engineer who wants to play a part in shaping the technical vision of this business and work … their product from an early stage. What you'll work on: Backend APIs (Python/FastAPI): Build and maintain secure, high-performance services that drive AI features and data access at scale. RAG & vector search: Design and improve retrieval pipelines (embeddings, chunking, hybrid search, ranking, feedback loops), owning schema design, latency, and relevance across vector databases. LLM integration … Connect and orchestrate large language models (OpenAI, Bedrock, etc.), manage prompts, tools, safeguards, and evaluation. Data pipelines: Ingest, clean, and transform structured and unstructured data; design efficient schemas (Postgres/NoSQL) for search and analytics. Frontend (React/Next.js): Deliver user-friendly, performant UIs that make AI-powered features (search, filters, explanations, citations) clear and accessible. More ❯

Kafka Modernisation. We are looking at a potential project starting in December and likely running for 8 months to migrate Cloudera CDP Kafka clusters to Acceldata ODP Kafka. Data pipelines are streaming and the target architecture is stretched. If anyone exists who is a Kafka expert and has experience of doing this before in a global enterprise setting More ❯

Who are Inference Group? We’re a team of passionate innovators empowering businesses through the transformative power of data, machine learning, and artificial intelligence. At Inference Group, our mission is simple: to help organisations unlock their true potential and drive sustainable growth. As we expand rapidly, we’re looking for creative, curious minds who want to make a … real impact. Here, you’ll collaborate with leading experts in data, AI, and technology to help clients harness the full potential of their data. We believe in making the most of the journey. If you’re ambitious, inventive, and eager to contribute to the early stages of a fast-growing consultancy, we’d love to have you on … board. We’ll explore the limitless opportunities of data and AI - driving excellence and having plenty of fun along the way. We’re looking for a highly talented AI & Machine Learning Solutions Architect to design, build, and deliver next-generation data and AI solutions for our clients. You’ll work at the intersection of strategy, technology More ❯

Who are Inference Group? We’re a team of passionate innovators empowering businesses through the transformative power of data, machine learning, and artificial intelligence. At Inference Group, our mission is simple: to help organisations unlock their true potential and drive sustainable growth. As we expand rapidly, we’re looking for creative, curious minds who want to make a … real impact. Here, you’ll collaborate with leading experts in data, AI, and technology to help clients harness the full potential of their data. We believe in making the most of the journey. If you’re ambitious, inventive, and eager to contribute to the early stages of a fast-growing consultancy, we’d love to have you on … board. We’ll explore the limitless opportunities of data and AI - driving excellence and having plenty of fun along the way. We’re looking for a highly talented AI & Machine Learning Solutions Architect to design, build, and deliver next-generation data and AI solutions for our clients. You’ll work at the intersection of strategy, technology More ❯

Who are Inference Group? We’re a team of passionate innovators empowering businesses through the transformative power of data, machine learning, and artificial intelligence. At Inference Group, our mission is simple: to help organisations unlock their true potential and drive sustainable growth. As we expand rapidly, we’re looking for creative, curious minds who want to make a … real impact. Here, you’ll collaborate with leading experts in data, AI, and technology to help clients harness the full potential of their data. We believe in making the most of the journey. If you’re ambitious, inventive, and eager to contribute to the early stages of a fast-growing consultancy, we’d love to have you on … board. We’ll explore the limitless opportunities of data and AI - driving excellence and having plenty of fun along the way. We’re looking for a highly talented AI & Machine Learning Solutions Architect to design, build, and deliver next-generation data and AI solutions for our clients. You’ll work at the intersection of strategy, technology More ❯

Who are Inference Group? We’re a team of passionate innovators empowering businesses through the transformative power of data, machine learning, and artificial intelligence. At Inference Group, our mission is simple: to help organisations unlock their true potential and drive sustainable growth. As we expand rapidly, we’re looking for creative, curious minds who want to make a … real impact. Here, you’ll collaborate with leading experts in data, AI, and technology to help clients harness the full potential of their data. We believe in making the most of the journey. If you’re ambitious, inventive, and eager to contribute to the early stages of a fast-growing consultancy, we’d love to have you on … board. We’ll explore the limitless opportunities of data and AI - driving excellence and having plenty of fun along the way. We’re looking for a highly talented AI & Machine Learning Solutions Architect to design, build, and deliver next-generation data and AI solutions for our clients. You’ll work at the intersection of strategy, technology More ❯

for real-time rendering and high-throughput processing. Push the limits of GPU APIs (Vulkan, CUDA) for low-latency. Work with streaming and networking systems to deliver massive data pipelines at scale. Develop cross-platform code that runs on both Windows and Linux (Ubuntu). Profile, debug, and tune performance across CPUs, GPUs, and networks. Requirements 5+ years More ❯

Senior Data Engineer (GenAI) - Leading Tech Company | London (Hybrid) Hybrid: 1 day in the office/4 days WFH Permanent role only Represented by Robert Half Limited Please note: No visa sponsorship on offer, No B2B,B2C, Fully remote workers or contractors on offer. The Opportunity We're looking for a Senior Data Engineer with hands … on GenAI experience to join a forward-thinking technology business that's building data-driven solutions with real-world impact. This is a highly visible, senior-level role where you'll take ownership of data pipelines, architecture, and GenAI operational frameworks - helping shape the next generation of AI-driven products and analytics. If you enjoy combining … engineering rigor with AI innovation, this role gives you the platform, freedom, and backing to make it happen. Key Responsibilities Design, build, and maintain scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate More ❯

Data Software Engineer Opportunity for a Data Software Engineer to join a market leading Software House company in London Salary up to £120,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Data Software Engineer, you’ll help design and build an AI-powered data migration and integration platform from the ground up. You’ll own the development of scalable data pipelines, cloud-based architecture, and custom software components, working closely with senior engineers to deliver reliable, high-performance systems that power AI-driven insights. WHO … traction as an emerging player bringing efficiency and innovation to a traditionally outdated space. OUR BENEFITS: Private medical insurance Life insurance Share options Exciting growth opportunities And More.. DATA SOFTWARE ENGINEER – ESSTENTIAL SKILLS • Strong foundation in Python • Hands-on experience with Spark or Databricks • Ability to lead projects autonomously and prioritise effectively • Experience developing bespoke software components for More ❯

Data Software Engineer Opportunity for a Data Software Engineer to join a market leading Software House company in London Salary up to £120,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Data Software Engineer, you’ll help design and build an AI-powered data migration and integration platform from the ground up. You’ll own the development of scalable data pipelines, cloud-based architecture, and custom software components, working closely with senior engineers to deliver reliable, high-performance systems that power AI-driven insights. WHO … traction as an emerging player bringing efficiency and innovation to a traditionally outdated space. OUR BENEFITS: Private medical insurance Life insurance Share options Exciting growth opportunities And More.. DATA SOFTWARE ENGINEER – ESSTENTIAL SKILLS • Strong foundation in Python • Hands-on experience with Spark or Databricks • Ability to lead projects autonomously and prioritise effectively • Experience developing bespoke software components for More ❯

Data Software Engineer Opportunity for a Data Software Engineer to join a market leading Software House company in London Salary up to £120,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Data Software Engineer, you’ll help design and build an AI-powered data migration and integration platform from the ground up. You’ll own the development of scalable data pipelines, cloud-based architecture, and custom software components, working closely with senior engineers to deliver reliable, high-performance systems that power AI-driven insights. WHO … traction as an emerging player bringing efficiency and innovation to a traditionally outdated space. OUR BENEFITS: Private medical insurance Life insurance Share options Exciting growth opportunities And More.. DATA SOFTWARE ENGINEER – ESSTENTIAL SKILLS • Strong foundation in Python • Hands-on experience with Spark or Databricks • Ability to lead projects autonomously and prioritise effectively • Experience developing bespoke software components for More ❯

Data Software Engineer Opportunity for a Data Software Engineer to join a market leading Software House company in London Salary up to £120,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Data Software Engineer, you’ll help design and build an AI-powered data migration and integration platform from the ground up. You’ll own the development of scalable data pipelines, cloud-based architecture, and custom software components, working closely with senior engineers to deliver reliable, high-performance systems that power AI-driven insights. WHO … traction as an emerging player bringing efficiency and innovation to a traditionally outdated space. OUR BENEFITS: Private medical insurance Life insurance Share options Exciting growth opportunities And More.. DATA SOFTWARE ENGINEER – ESSTENTIAL SKILLS • Strong foundation in Python • Hands-on experience with Spark or Databricks • Ability to lead projects autonomously and prioritise effectively • Experience developing bespoke software components for More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development of … their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k + bonus More ❯

You'll be joining an established global commodities trading firm where world-class data analysts are already building sophisticated, high-impact models. They now need the tech muscle to take them to production.Skills, Experience, Qualifications, If you have the right match for this opportunity, then make sure to apply today. In this crucial role, you'll connect sophisticated … analytics with scalable infrastructure, manage CI/CD pipelines, containerized systems, and AWS environments that underpin the firm's data lake, data pipelines, and analytics platforms. You'll build robust infrastructure, automate data ingestion, and deploy cutting-edge analytical models into live trading environments. Working alongside brilliant analysts and engineers, you'll shape the … firm's technical foundation and directly influence how data drives trading strategy and decision-making. Location: London, hybrid. If you're passionate about creating tangible value through technology in a high-performance trading environment, this is where you can truly make a difference. More ❯

We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯

We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯

We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯

We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯

Senior Python Engineer to join a fast-growing AI startup shaping the next generation of intelligent systems. You’ll play a key role in building scalable backend services, data pipelines, and infrastructure that power cutting-edge AI products used by customers worldwide. ✉️ What You’ll Do Design, build, and maintain high-performance backend systems in Python Develop APIs … data pipelines, and integrations that support AI-driven features Work closely with ML and product teams to deploy AI models into production Optimize systems for reliability, scalability, and performance Implement robust monitoring, logging, and observability practices Contribute to architectural decisions and guide best practices across the engineering team 🧰 Tech Stack Core: Python (FastAPI, Django, or Flask) Infrastructure: AWS …/GCP, Docker, Kubernetes Data: Postgres, Redis, Kafka, S3 CI/CD & DevOps: GitHub Actions, Terraform, Pulumi AI/ML Ecosystem: PyTorch, Hugging Face, LangChain (or similar) 👀 About You 4+ years of professional experience building production-grade systems in Python Solid understanding of backend architecture, API design, and data modeling Comfortable working with cloud infrastructure and More ❯

Senior Python Engineer to join a fast-growing AI startup shaping the next generation of intelligent systems. You’ll play a key role in building scalable backend services, data pipelines, and infrastructure that power cutting-edge AI products used by customers worldwide. ✉️ What You’ll Do Design, build, and maintain high-performance backend systems in Python Develop APIs … data pipelines, and integrations that support AI-driven features Work closely with ML and product teams to deploy AI models into production Optimize systems for reliability, scalability, and performance Implement robust monitoring, logging, and observability practices Contribute to architectural decisions and guide best practices across the engineering team 🧰 Tech Stack Core: Python (FastAPI, Django, or Flask) Infrastructure: AWS …/GCP, Docker, Kubernetes Data: Postgres, Redis, Kafka, S3 CI/CD & DevOps: GitHub Actions, Terraform, Pulumi AI/ML Ecosystem: PyTorch, Hugging Face, LangChain (or similar) 👀 About You 4+ years of professional experience building production-grade systems in Python Solid understanding of backend architecture, API design, and data modeling Comfortable working with cloud infrastructure and More ❯

of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills More ❯

of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills More ❯