Data Pipeline Jobs in London

301 to 325 of 599 Data Pipeline Jobs in London

Senior Full Stack Java Developer

London, United Kingdom
Hybrid / WFH Options
Citigroup Inc
edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Senior Java Data Engineer. The FX Data Analytics & Gen AI Technology team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven … models, and engineering robust data and analytics pipelines, to unlock actionable insights from our vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer (Level 6)

London, United Kingdom
Amazon
learning systems, and high-impact experiments which we integrate into business, financial, and system-level decision making. We are looking for a Senior Data Engineer to help put SOTA economic and data science models into production. We are looking for a individual who is interested in … working with the latest big data technology (Spark, EMR, Glue, SageMaker, and Airflow) and collaborate with Economist and Scientist in creating scalable solutions for our multiple Retail Businesses. Key job responsibilities - Partnering with economists and senior team members in building an environment of large high-quality datasets - Create … and support AWS based data platforms that leverage diverse data sources across Amazon, that feed input to and serve output from machine learning/econometric models - Help us move faster by building fast prototypes that help us prove out our ideas - Develop and extend reusable libraries More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior MLOps Engineer

London, United Kingdom
Daniel J Edelman Holdings
exciting point in our journey, leveraging Generative AI (GenAI) , Large Language Models (LLMs) , and advanced Retrieval-Augmented Generation (RAG) techniques to build intelligent, data-driven systems that deliver powerful PR insights. You'll also work on developing agentic workflows that autonomously orchestrate tasks, enabling scalable and dynamic solutions. … Our data stack is modern and efficient, designed to process large-scale information, automate analysis pipelines, and integrate seamlessly with AI-driven workflows. This is an excellent opportunity to make a significant impact on projects that push the boundaries of AI-powered insights and automation. If you're … managed AI/ML services. Hands-on experience with Docker, Kubernetes, and container orchestration. Expertise with Databricks, including ML workflows and data pipeline management. Familiarity with tools like MLflow, DVC, Prometheus, and Grafana for versioning and monitoring. Experience implementing security and compliance standards for AI systems. Strong More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer - Personalization

London, United Kingdom
Spotify
is central to that mission-reinventing how users find and connect with content in new and relevant ways. We're looking for a Data Engineer to join a squad passionate about delivering pioneering search experiences powered by Machine Learning (ML) and Large Language Models (LLMs). In this … role, you'll help craft the team's data strategy and build the systems that power smarter, more intuitive discovery on Spotify. You'll work alongside a dedicated mix of ML and Backend Engineers to tackle some of Spotify's most exciting challenges in retrieval, ranking, and personalization. … If you're excited by data systems, ML-powered products, and the opportunity to impact how millions of people explore audio content-this is the role for you. What You'll Do Design, build, and maintain scalable, reliable data pipelines that support advanced search capabilities. Partner More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Member of Technical Staff, AI Data

London, United Kingdom
Microsoft
power the training of the world's most capable AI frontier models, pushing the boundaries of scale, performance, and product deployment. The AI Data team at Microsoft AI is responsible for all aspects of data preparation to support our model pre-training operations, including collecting data from the source, extracting and transforming the most useful data, and understanding the impact of changes to data by training and evaluating new models. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models … next generation of systems that will transform the field. In particular, we are looking for candidates who: Are passionate about the role of data in large-scale AI model training Will thrive in a highly collaborative, fast-paced environment Have a high degree of craftsmanship and pay close More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Customer Data Analytics Lead

London Area, United Kingdom
Montash
Customer Platform Data Analytics Lead Remote (with regular travel to a London-based office) Competitive Salary + Benefits Full Time | Permanent A fast-scaling, well-funded FinTech in the insurance and payments space is looking for a Customer Platform Data & Analytics Lead to head up a … growing team of talented data engineers. This is a unique opportunity to lead the embedded analytics function within a SaaS product environment, shaping architecture and best practices while remaining hands-on with complex engineering tasks. You'll join a high-performing, collaborative team at a company backed by … and you’ll have real influence as they continue to scale. What You’ll Do Lead, mentor and manage a squad of 5 data & analytics engineers. Define technical standards and drive excellence in engineering practices. Architect and oversee the development of cloud-native data infrastructure and More ❯
Posted:

Customer Data Analytics Lead

london, south east england, united kingdom
Montash
Customer Platform Data Analytics Lead Remote (with regular travel to a London-based office) Competitive Salary + Benefits Full Time | Permanent A fast-scaling, well-funded FinTech in the insurance and payments space is looking for a Customer Platform Data & Analytics Lead to head up a … growing team of talented data engineers. This is a unique opportunity to lead the embedded analytics function within a SaaS product environment, shaping architecture and best practices while remaining hands-on with complex engineering tasks. You'll join a high-performing, collaborative team at a company backed by … and you’ll have real influence as they continue to scale. What You’ll Do Lead, mentor and manage a squad of 5 data & analytics engineers. Define technical standards and drive excellence in engineering practices. Architect and oversee the development of cloud-native data infrastructure and More ❯
Posted:

Senior Sales Engineer

London Area, United Kingdom
Orama Solutions
opportunities and identify use cases across key verticals (retail, media, digital products/services). Leverage your domain expertise to showcase how Customer Data Infrastructure enables digital analytics, marketing, product analytics, and AI/ML use cases. Design and deliver bespoke pitches and demos for various prospect stakeholders … such as Heads of Data, CTOs, data engineers/analysts/scientists, and wider senior management. Lead Proof of Concepts providing hands-on demonstration of products full capabilities. Become a product expert and trusted advisor to our customers. Contribute technical thought leadership to support broader go … years in a Sales Engineering capacity. You have strong technical skills and professional experience in: web and mobile app development, SQL, ETL or data pipelines, and data analysis. You have experience with cloud data warehouses/lakes including Snowflake, Databricks, BigQuery, Redshift, S3, and More ❯
Posted:

Business Intelligence Engineer, JP Retail Science

London, United Kingdom
Amazon
Business Intelligence Engineer, JP Retail Science We are seeking a Business Intelligence Engineer to drive the development of data engineering infrastructure and solutions that can scale across Amazon's largest vendors. In this role, your primary focus will be on designing and building robust data pipelines … and scale to hundreds of vendors, and even change the market, both in JP and WW, and with other business intelligence engineers and data engineers to develop the infrastructure necessary to deploy productionized solutions through code. As a member of the team you will also work with vendors … work, how we serve customers, and where we invest in future capabilities. This position is ideal for candidates with a strong background in data engineering, a passion for building scalable and efficient data solutions, and a desire to drive tangible business impact through data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Scientist

London, United Kingdom
Different Technologies Pty Ltd
including Predictive AI, LLMs, and other algorithms to identify security-relevant attributes within application responses. Role & Responsibilities We're looking for an experienced Data Scientist to join our automated red teaming product team to enhance data insights and accuracy. In this role you will: Analyze the … identified by the team. Identify and develop further improved methods for classifying results and identifying vulnerabilities. Identify new insights and visualisations from our data that would benefit our customers. Design and implement improvements to data pipelines and labelling systems that facilitate ongoing quality. Advise the engineering … team on good data engineering and data science practices. Work with the wider engineering team to implement your proposals. Clearly communicate complex data insights to less technical colleagues. Skills & Experience We're looking for people who are: Highly competent at statistical analysis. Experienced in More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer - V8 Supercars

london, south east england, united kingdom
Team 18
on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯
Posted:

Data Engineer - V8 Supercars

west london, south east england, united kingdom
Team 18
on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯
Posted:

Data Engineer - V8 Supercars

south west london, south east england, united kingdom
Team 18
on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯
Posted:

Business Intelligence Engineer, DaS FinTech

London, United Kingdom
Amazon
boundaries of modern technology? If you answered yes and you have a background in FinTech you'll love this role and Amazon's data obsessed culture. Amazon Devices and Services Fintech is the global team that designs and builds the financial planning and analysis tools for a wide … enable and improve senior level business decision making. A strategic thinker who combines technical expertise with business acumen to develop and maintain scalable data solutions. You will apply both business and technical acumen in a fast-paced, ambiguous and innovative environment. Our ideal teammate possesses a natural curiosity … analytical skills and is excited to pioneer on behalf of customers. Key job responsibilities Engineer robust, automated reporting systems and dashboards that facilitate data-driven decision making Partner with Product and Business teams to capture requirements and deliver analytical solutions Execute targeted data analyses and ensure More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Science Manager - Insurance

London Area, United Kingdom
Stott and May
Data Science Manager 📍 London | Lloyd’s Market | Hybrid About the Company Join a high-performing, globally recognised insurer in the Lloyd’s market — known for its disciplined underwriting, long-term partnerships, and collaborative culture. Our client blends innovation with tradition, offering a dynamic environment where data-driven insights are shaping the future of insurance. About the Role We’re hiring a Data Science Manager to lead the design, development, and deployment of machine learning and advanced analytics solutions. You’ll play a critical role in transforming how underwriting, pricing, and risk assessment … are executed, using data science to drive smarter decisions and digital trading strategies. You’ll manage a team of skilled data scientists and work hand-in-hand with underwriters, actuaries, engineers, and business leaders to turn complex data into actionable insights and measurable outcomes. More ❯
Posted:

Data Science Manager - Insurance

london, south east england, united kingdom
Stott and May
Data Science Manager 📍 London | Lloyd’s Market | Hybrid About the Company Join a high-performing, globally recognised insurer in the Lloyd’s market — known for its disciplined underwriting, long-term partnerships, and collaborative culture. Our client blends innovation with tradition, offering a dynamic environment where data-driven insights are shaping the future of insurance. About the Role We’re hiring a Data Science Manager to lead the design, development, and deployment of machine learning and advanced analytics solutions. You’ll play a critical role in transforming how underwriting, pricing, and risk assessment … are executed, using data science to drive smarter decisions and digital trading strategies. You’ll manage a team of skilled data scientists and work hand-in-hand with underwriters, actuaries, engineers, and business leaders to turn complex data into actionable insights and measurable outcomes. More ❯
Posted:

Advanced Data Insights Analyst III (Marketing Analytics)

London, United Kingdom
ENGINEERINGUK
You will need to login before you can apply for a job. Advanced Data Insights Analyst III (Marketing Analytics) View more categories View less categories Sector Travel and Tourism Role Analyst Contract Type Permanent Hours Full Time Expedia Group brands power global travel for everyone, everywhere. We design … processes to solve complex business issues and identify opportunities, then this could be the role for you! In this role you will: Extract data from multiple sources and combine into required datasets for model building or analytics. Challenge MMM concepts and outputs based on specific modelling, marketing, and … concepts like regression, ANOVA, AB testing. Select appropriate measurement techniques/designs to answer business questions and explain trade-offs. Define and build data models, interpret outputs, and iterate to improve models. Provide guidance and coaching on statistical techniques. Understand common data models, their assumptions, and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Azure Data Engineer

London, United Kingdom
Boston Hale
This fantastic institution located in SW London is seeking a dynamic and versatile Data Engineer/Analytics Engineer to contribute to the development, enhancement, and management of their data systems, pipelines, and reporting infrastructure. This role will focus on designing and maintaining efficient data pipelines while building a scalable data warehouse architecture. A major aspect of this position will involve integrating new data sources to create a unified Single Customer View. Additionally, collaboration with the Analytics and Insights teams is essential to ensure they have seamless access to … the necessary data, as well as assisting in optimizing SQL reporting processes. The ideal candidate will: Possess a strong curiosity and passion for exploring, transforming, and integrating data from diverse sources. Be adept at troubleshooting and fine-tuning data processes to enhance data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London, United Kingdom
Hybrid / WFH Options
Futureshaper.com
and pack-out-Locus Robotics empowers businesses to meet peak demands and adapt to ever-changing operational needs. Are you a skilled Python Data Engineer with a passion for building scalable, production-level systems and an interest in machine learning? We want to hear from you!At Locus … Robotics, we're evolving our data infrastructure to support advanced machine learning capabilities and real-time analytics. As a key member of our team, you'll help migrate our existing codebase into machine learning territory, drive innovation across multiple deployment sites, and collaborate closely with our optimization and … these countries without the need for work sponsorship. Responsibilities: Develop and maintain Python-based systems deployed across remote platforms. Contribute to and improve data pipelines, ensuring reliable and efficient system updates. Build and enhance features for real-time data analysis and system monitoring to ensure high More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Engineer (Databricks, Scala, Spark) - Contract

London, United Kingdom
La Fosse
Location: Central London (2-3 days/week onsite) Type: Contract - 6 months + Outside IR35 We're looking for a Senior Data Engineer with a strong track record in building and maintaining data lakehouses, ideally within banking or capital markets domains to join our global … consistent and accurate integration of internal and external data sources. Follow best practices in ETL, data modelling (medallion architecture), and pipeline development. Collaborate with Traders and Quants to deliver data solutions aligned with business needs. Maintain data quality, troubleshoot issues, and … optimize platform performance. Produce clear documentation for pipeline design and processes. Required Skills & Experience Expertise around Databricks, including unity catalogue (preferably on Azure) Strong programming in Scala and Python Deep understanding of Spark architecture and performance tuning Proven experience with ETL design, data modelling, and database design More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London, United Kingdom
Hybrid / WFH Options
Boston Hale
A prestigious organization based in London is seeking a dynamic and versatile Data Engineer/Analytics Engineer to contribute to the development, enhancement, and management of their data systems, pipelines, and reporting infrastructure. This role will focus on designing and maintaining efficient data pipelines … while building a scalable data warehouse architecture. A major aspect of this position will involve integrating new data sources to create a unified Single Customer View. Additionally, collaboration with the Analytics and Insights teams is essential to ensure they have seamless access to the necessary data … well as assisting in optimizing SQL reporting processes. The ideal candidate will: Possess a strong curiosity and passion for exploring, transforming, and integrating data from diverse sources. Be adept at troubleshooting and fine-tuning data processes to enhance data quality and stability. Thrive in More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Software Engineer (MLOps / LLMOps)

London Area, United Kingdom
Codesearch AI
to maximize performance while maintaining cost efficiency Governance and Versioning Systems : Establish best practices for model versioning, reproducibility, and responsible AI deployment Integrated Data Pipelines : Utilize Databricks to construct and manage sophisticated data and ML pipelines Monitoring Ecosystems : Implement comprehensive monitoring systems to ensure reliability and … Azure) and managed AI/ML services Practical experience with Docker, Kubernetes, and container orchestration Databricks expertise, including ML workflows and data pipeline integration Familiarity with MLflow, DVC, Prometheus, and Grafana for versioning and monitoring Bachelor's or Master's degree in Computer Science, Engineering, or related … enjoy mentoring junior team members and elevating the entire technical organization What Makes This Opportunity Special You'll be working with a modern data stack designed to process large-scale information, automate analysis pipelines, and integrate seamlessly with AI-driven workflows. This is your chance to make a More ❯
Posted:

Software Engineer (MLOps / LLMOps)

london, south east england, United Kingdom
Codesearch AI
to maximize performance while maintaining cost efficiency Governance and Versioning Systems : Establish best practices for model versioning, reproducibility, and responsible AI deployment Integrated Data Pipelines : Utilize Databricks to construct and manage sophisticated data and ML pipelines Monitoring Ecosystems : Implement comprehensive monitoring systems to ensure reliability and … Azure) and managed AI/ML services Practical experience with Docker, Kubernetes, and container orchestration Databricks expertise, including ML workflows and data pipeline integration Familiarity with MLflow, DVC, Prometheus, and Grafana for versioning and monitoring Bachelor's or Master's degree in Computer Science, Engineering, or related … enjoy mentoring junior team members and elevating the entire technical organization What Makes This Opportunity Special You'll be working with a modern data stack designed to process large-scale information, automate analysis pipelines, and integrate seamlessly with AI-driven workflows. This is your chance to make a More ❯
Posted:

BIE II - FBA Product Analytics

London, United Kingdom
Amazon
Amazon Marketplace. To meet our sellers' needs, we are constantly innovating and building on new ideas. Fulfillment by Amazon (FBA) Inbound analytics and data science team partners with product team to optimize inbound supply chain by influencing right tradeoffs among cost, speed and network capacity utilization. FBA Product … knowledge of business intelligence solutions, and the ability to work with product development, and business teams. The successful candidate will have passion for data and analytics, be a self-starter comfortable with ambiguity, with strong attention to detail. Key job responsibilities Develop business metrics and analysis to inform … extremely large datasets. From Day 1, you will be challenged with a variety of tasks, ranging from creating datasets, reports, dashboards to metadata modeling, pipeline monitoring. You will interact with internal program and product owners, and technical teams to gather requirements, structure scalable and perform data solutions More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Engineer

London, United Kingdom
Hybrid / WFH Options
Idexx Laboratories
IDEXX is looking for a Senior Data Engineer to join the Veterinary Software team in London! This is an exciting opportunity for a a data engineer looking to expand their technical leadership skills and make an impact in a meaningful industry. This role will be hybrid … days onsite in our Wimbledon office, London. As a Senior Data Engineer, you will lead data migration strategies and implementation across hybrid cloud environments (primarily AWS), enabling smooth and secure movement of legacy and modern systems. As a senior engineer, you'll design, develop, and optimise … scalable and efficient data pipelines integrating PHP, and C applications using .NET framework backend services and React frontends. You'll utilise tools such as Terraform for infrastructure-as-code ( IaC ), AWS (Lambda, EC2, EKS, Step Functions, VPC etc.) for ETL, Airflow pipelines, Snowflake, and ensure architectural alignment with More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
Data Pipeline
London
10th Percentile
£51,375
25th Percentile
£60,000
Median
£84,115
75th Percentile
£100,000
90th Percentile
£130,000