126 to 150 of 286 Data Pipeline Jobs in London

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

Senior Manager – Data Engineering 📍 London (Hybrid – 2-3 days per week) | Remote UK, Full-time Are you a data leader ready to shape the future of modern data platforms? We’re a next-generation data & AI consultancy , helping some of the world’s most recognised organisations unlock value through scalable, cloud-first … solutions. Working at the forefront of building cutting-edge data architectures, AI-driven insights, and high-performing teams. Now, we’re looking for a Senior Manager – Data Engineering to take a leading role in delivering complex data programmes, driving innovation, and mentoring the next wave of data talent. 💡 What you’ll be … doing Leading the design & delivery of scalable data platforms using Databricks, Snowflake, and cloud (AWS/Azure) . Developing scalable and repeatable AI Ready products for AI Adoption Building and optimising data pipelines with Python & SQL. Translating business needs into robust technical solutions for clients. Acting as a technical SME , providing oversight, solution design, and best More ❯

Senior Manager – Data Engineering 📍 London (Hybrid – 2-3 days per week) | Remote UK, Full-time Are you a data leader ready to shape the future of modern data platforms? We’re a next-generation data & AI consultancy , helping some of the world’s most recognised organisations unlock value through scalable, cloud-first … solutions. Working at the forefront of building cutting-edge data architectures, AI-driven insights, and high-performing teams. Now, we’re looking for a Senior Manager – Data Engineering to take a leading role in delivering complex data programmes, driving innovation, and mentoring the next wave of data talent. 💡 What you’ll be … doing Leading the design & delivery of scalable data platforms using Databricks, Snowflake, and cloud (AWS/Azure) . Developing scalable and repeatable AI Ready products for AI Adoption Building and optimising data pipelines with Python & SQL. Translating business needs into robust technical solutions for clients. Acting as a technical SME , providing oversight, solution design, and best More ❯

My Financial Services client is seeking to recruit an Oracle Data Warehouse Architect on an initial 6 month contract for a Financial Services client based in London. It is hybrid and will require 3x days onsite per week. You will design, optimize, and maintain Oracle-based data warehouse solutions to ensure high performance, scalability, and alignment … with business intelligence and analytics needs. This role requires the individual to design and optimize Oracle-based data warehouse systems, ensuring they are scalable, high-performing, and aligned with business analytics needs. They will collaborate closely with the head of the data team and .NET developers, applying advanced data modelling, performance tuning, and problem … insights into clear, actionable recommendations for both technical and non-technical stakeholders. Skills Required: Strong experience in designing and developing efficient ETL processes to support enterprise-scale Oracle Data Warehouse environments. Proven ability to optimize and tune complex SQL and PL/SQL scripts for performance, while guiding development teams on best practices for data modelling More ❯

My Financial Services client is seeking to recruit an Oracle Data Warehouse Architect on an initial 6 month contract for a Financial Services client based in London. It is hybrid and will require 3x days onsite per week. You will design, optimize, and maintain Oracle-based data warehouse solutions to ensure high performance, scalability, and alignment … with business intelligence and analytics needs. This role requires the individual to design and optimize Oracle-based data warehouse systems, ensuring they are scalable, high-performing, and aligned with business analytics needs. They will collaborate closely with the head of the data team and .NET developers, applying advanced data modelling, performance tuning, and problem … insights into clear, actionable recommendations for both technical and non-technical stakeholders. Skills Required: Strong experience in designing and developing efficient ETL processes to support enterprise-scale Oracle Data Warehouse environments. Proven ability to optimize and tune complex SQL and PL/SQL scripts for performance, while guiding development teams on best practices for data modelling More ❯

here to onboard the world to Web3 Why? Because we think Web3 is a unique and democratising technology. It gives people back control of their money, digital identity, data, and property like nothing else before it What we do We're the leading infrastructure company in Web3. This means we offer our partners everything from payment solutions (we … s something for you here. Come help us build the future of Web3 and digital ownership. About the Opportunity We are seeking a highly analytical and strategic Growth Data Scientist to drive pricing and monetization for MoonPay's Products As a Growth Data Scientist, you will be responsible for building our dynamic pricing algorithms, designing incentive … to optimize volume & revenue generation across the entire suite of MoonPay products and business lines. You will also be responsible for launching AB tests and quasi-experiments, analyzing data to identify opportunities for margin optimization, and developing an analytical infrastructure to track the performance of pricing optimizations. This role requires a deep understanding of marketplace dynamics, experimentation, causal More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

and probabilistic financial modelling algorithms. These include computations of risk and return metrics, Black-Scholes models, and Monte Carlo simulations. You will effectively leverage our Azure platform, our Data Lakehouse architecture and Platform Services to create best in class Trading Applications. You will also have line management responsibilities of a very talented and high performing product development team. … with Python or .NET like web applications on Azure cloud infrastructure with Docker, Kubernetes, automation testing and DevOps (ideally terraform + github actions). Create, monitor and maintain data pipelines and batch processes (databricks, pyspark, lakehouses, kafka). Productionise quant models into software applications, ensuring robust day-to-day operation, monitoring and back testing are in place. Stakeholder … second strongly typed language (e.g.: C#, C++, Rust or Java) Expert in application design, security, release, testing and packaging Mastery of SQL/no-SQL databases, data pipeline orchestration tools Mastery of concurrent/distributed programming and performance optimisation methods. Experienced in Cloud Technologies - Azure/AWS Experienced in Source Control Technologies (including GitHub, Azure DevOps), CI More ❯

Summary Core Responsibilities Generate synthetic data for training data augmentation and model evaluation Collaborate with product and design teams to define, prototype, and ship new AI-powered features including text-to-speech, image generation, and enhanced tool calling capabilities Implement and optimize model serving infrastructure using frameworks like vLLM, ONNX Runtime, and Nvidia Triton to achieve … related field Familiarity with LLM serving frameworks (vLLM, TGI, Ray Serve) and GPU optimization Experience with embeddings, vector databases, semantic search implementations, model training workflows, and data pipeline development Experience integrating LLMs with tool calling/MCP Knowledge of privacy-preserving ML techniques and on-device model deployment Previous work on cost optimization and performance tuning of More ❯

re looking for a Technical Programme Manager to join our team. About us Basecamp Research exists to push the forefront of complex biological design by completely rethinking the data and AI stack necessary to achieve it. We unlock the potential of our planet's unexplored biodiversity to solve some of biotechnology's hardest problems, demonstrating the value of … nature's undiscovered biology. At the core of our platform is a proprietary data asset of genetic information collected from across the tree of life through global expeditions and partnerships. Having recently closed our Series B (bringing total funding to $85M), we scaled our data asset 10 in just a few months - to billions of genes … Tooling & Infrastructure Oversight: Oversee the selection, implementation, and optimization of the software tools and platforms used by our technical teams (e.g. project management systems, knowledge bases, data pipeline tools). Make sure our engineers and scientists have the right tools and that those tools are well integrated and serving their needs. Cloud and IT Liaison: Serve as More ❯

Laundering (AML), Know Your Customer (KYC), Fraud Detection, Regulatory Reporting, and Transaction Monitoring. Advisory Services: Offer consulting on compliance scalability, operating models, regulatory guardrails, compliance governance, and integrated data management. Technology Integration: Leverage cutting-edge platforms, including AI and machine learning models, to deliver state-of-the-art compliance solutions. Thought Leadership: Represent Capgemini as a thought leader … architectures using cloud data platforms (AWS, Azure, GCP) and integrating with financial systems. Demonstrated knowledge in compliance model training, fine-tuning, and deployment, including data pipeline integration. Proficiency in designing compliance systems capable of autonomous decision-making and task execution, especially in financial contexts. Experience with compliance governance, ethical considerations, and ensuring adherence to financial … build, mentor, and lead onshore and offshore compliance teams. Client Engagement: Excellent client interaction, problem-solving, and communication skills, with experience working with C-level stakeholders. Educational Background: Data science or STEM degree preferred, with a solid foundation in compliance, AI, ML, and advanced analytics. Innovation and Thought Leadership: Passionate about cutting-edge compliance advancements and delivering innovative More ❯

Laundering (AML), Know Your Customer (KYC), Fraud Detection, Regulatory Reporting, and Transaction Monitoring. Advisory Services: Offer consulting on compliance scalability, operating models, regulatory guardrails, compliance governance, and integrated data management. Technology Integration: Leverage cutting-edge platforms, including AI and machine learning models, to deliver state-of-the-art compliance solutions. Thought Leadership: Represent Capgemini as a thought leader … architectures using cloud data platforms (AWS, Azure, GCP) and integrating with financial systems. Demonstrated knowledge in compliance model training, fine-tuning, and deployment, including data pipeline integration. Proficiency in designing compliance systems capable of autonomous decision-making and task execution, especially in financial contexts. Experience with compliance governance, ethical considerations, and ensuring adherence to financial … build, mentor, and lead onshore and offshore compliance teams. Client Engagement: Excellent client interaction, problem-solving, and communication skills, with experience working with C-level stakeholders. Educational Background: Data science or STEM degree preferred, with a solid foundation in compliance, AI, ML, and advanced analytics. Innovation and Thought Leadership: Passionate about cutting-edge compliance advancements and delivering innovative More ❯

Laundering (AML), Know Your Customer (KYC), Fraud Detection, Regulatory Reporting, and Transaction Monitoring. Advisory Services: Offer consulting on compliance scalability, operating models, regulatory guardrails, compliance governance, and integrated data management. Technology Integration: Leverage cutting-edge platforms, including AI and machine learning models, to deliver state-of-the-art compliance solutions. Thought Leadership: Represent Capgemini as a thought leader … architectures using cloud data platforms (AWS, Azure, GCP) and integrating with financial systems. Demonstrated knowledge in compliance model training, fine-tuning, and deployment, including data pipeline integration. Proficiency in designing compliance systems capable of autonomous decision-making and task execution, especially in financial contexts. Experience with compliance governance, ethical considerations, and ensuring adherence to financial … build, mentor, and lead onshore and offshore compliance teams. Client Engagement: Excellent client interaction, problem-solving, and communication skills, with experience working with C-level stakeholders. Educational Background: Data science or STEM degree preferred, with a solid foundation in compliance, AI, ML, and advanced analytics. Innovation and Thought Leadership: Passionate about cutting-edge compliance advancements and delivering innovative More ❯

Laundering (AML), Know Your Customer (KYC), Fraud Detection, Regulatory Reporting, and Transaction Monitoring. Advisory Services: Offer consulting on compliance scalability, operating models, regulatory guardrails, compliance governance, and integrated data management. Technology Integration: Leverage cutting-edge platforms, including AI and machine learning models, to deliver state-of-the-art compliance solutions. Thought Leadership: Represent Capgemini as a thought leader … architectures using cloud data platforms (AWS, Azure, GCP) and integrating with financial systems. Demonstrated knowledge in compliance model training, fine-tuning, and deployment, including data pipeline integration. Proficiency in designing compliance systems capable of autonomous decision-making and task execution, especially in financial contexts. Experience with compliance governance, ethical considerations, and ensuring adherence to financial … build, mentor, and lead onshore and offshore compliance teams. Client Engagement: Excellent client interaction, problem-solving, and communication skills, with experience working with C-level stakeholders. Educational Background: Data science or STEM degree preferred, with a solid foundation in compliance, AI, ML, and advanced analytics. Innovation and Thought Leadership: Passionate about cutting-edge compliance advancements and delivering innovative More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key … drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key … drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key … drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

Role: 12 month FTC - Data Engineer Salary: £60,000-£65,000 WFH: Fully Remote Start Date: September/October 2025 I'm working with a leading global retail brand to find a talented Data Engineer who can help shape and deliver their evolving data strategy. This role is perfect for someone who loves building … robust, scalable data pipelines and turning complex datasets into actionable insights for the business. In this role, you will: Develop and maintain a cloud-based data warehouse (BigQuery, GCP) Create and optimise ETL processes (SSIS, Talend, Airflow) Collaborate with BI teams to deliver key performance metrics Ensure data quality, security, and cost-efficient storage … What you'll bring: Strong SQL and data modelling skills Data warehouse design experience (BigQuery a plus) BI tool experience (Power BI preferred) Cloud architecture knowledge and problem-solving flair Bonus: ERP knowledge (Microsoft NAV/Business Central) or ML skills in Python/R If you're a proactive Data Engineer ready to More ❯

Job Description Role Title: Manager - GenAI Content Supply Chain CL: 7 Practice: Data & AI Location: UK London, Manchester, Birmingham, Edinburgh Reports to: Data & AI Leadership We Are: Accenture Song accelerates growth and value for our clients through sustained customer relevance. Our capabilities span ideation to execution: growth, product and experience design; technology and experience platforms; creative … relationships and deep industry expertise, we help our clients operate at the speed of life through the unlimited potential of imagination, technology and intelligence. Visit us at: The Data & AI team is: The Data and AI revolution is changing everything. It's everywhere - transforming how we work and play. Join Accenture and help transform leading organisations … and communities around the world. Accenture Data and AI is driving these exciting changes and bringing them to life across 40 industries in more than 120 countries. The sheer scale of our capabilities and client engagements and the way we collaborate with the ecosystem, operate and deliver value provides an unparalleled opportunity to grow and advance. Accenture's More ❯

About the role: We're looking for a Senior Data Engineer to join the Data & Analytics team at Holland & Barrett. This is a high-impact, mid-seniority role within our growing data function, where you'll design, build, and scale modern data solutions on AWS. You'll work closely with cross-functional … teams including Data Science, BI, and Product Analytics to develop cloud-native, scalable data infrastructure powering advanced analytics and machine learning. As a Senior Engineer, you'll not only deliver code — you'll take ownership, lead small teams, mentor others, and contribute to shaping our engineering culture and best practices. You'll join a team of … Data Engineers, reporting to the Senior Data Engineering Manager. You'll work alongside Associates, Mid-level Engineers, and Senior/Principal engineers. What You'll Do: Design, build, and scale data pipelines and services using AWS Glue, Lambda, Step Functions, S3, EMR, Athena, and more. Lead projects involving serverless, event-driven architectures and CI More ❯