276 to 300 of 564 Data Pipeline Jobs in London

Data Scientist Remote (UK-Based) Up to £45,000 The Company This UK-based start-up has grown rapidly in just two years. With a team of ~30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking … KPIs for a wide range of companies and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. The Role As a Data Scientist, you’ll play a pivotal role in developing and refining KPI prediction models, working with … real-world data to create actionable insights. Clean and process data to ensure accuracy and usability. Build and maintain linear regression models for KPI tracking. Access APIs and integrate software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product More ❯

Location: London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s … a founding team of contractors with the view to scale into permanent leadership as the business grows. They’re now hiring a Senior Data Engineer to build robust, scalable data solutions powering AI, analytics, and future client delivery. If you love creating high-performance data … clean, governed data layers for ML, analytics, and application use 🔹 Supporting LLM/AI data workflows through structured and unstructured pipeline design 🔹 Contributing to reusable data engineering components across client and internal use cases 🔹 Collaborating with data scientists, architects, and product More ❯

Location: London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s … a founding team of contractors with the view to scale into permanent leadership as the business grows. They’re now hiring a Senior Data Engineer to build robust, scalable data solutions powering AI, analytics, and future client delivery. If you love creating high-performance data … clean, governed data layers for ML, analytics, and application use 🔹 Supporting LLM/AI data workflows through structured and unstructured pipeline design 🔹 Contributing to reusable data engineering components across client and internal use cases 🔹 Collaborating with data scientists, architects, and product More ❯

Implementation Engineer Outside IR35 Remote £400-£500 3 Months Initially We are seeking an Implementation Engineer who possesses a strong foundation in data and business analysis. This role requires logical thinking and the ability to understand and interpret data. The ideal candidate will have experience configuring tools and … than extensive coding expertise. In this role, you will work primarily with the clients platform, which utilises ETL packages. A solid understanding of data analysis will significantly benefit your performance in this position. Key Responsibilities: Collaborate with clients to analyse data-driven business processes in detail … ensuring a clear understanding of the data and its implications. Document findings to prepare for implementation Configure, extend, deploy, test, and validate complete solutions for our customers from end to end. Conduct data analysis, exploration, testing, and validation while interacting with clients to comprehend data More ❯

performance, implementing improvements based on analysis. Document and standardize ML processes, pipelines, and model specifications. Collaborate with cross-functional teams spanning research, engineering, data science, product managers and other stakeholders to understand business needs and identify opportunities for ML applications. Work closely with engineering teams to integrate ML … frameworks (e.g., TensorFlow or PyTorch). Solid understanding of various machine learning algorithms (e.g., classification, regression, clustering) and their practical applications. Proficient in data manipulation and analysis using tools like SQL and Pandas. Broad ML skillset and are happy to work … on all aspects of ML problems. Not only modeling, but also feature work in data pipelines, some implementation in data pipeline workflows, experimentation setup and analysis. Experience with model evaluation metrics and techniques for ensuring model quality and generalization. Experience with cloud platforms (e.g., GCP More ❯

performance, implementing improvements based on analysis. Document and standardize ML processes, pipelines, and model specifications. Collaborate with cross-functional teams spanning research, engineering, data science, product managers and other stakeholders to understand business needs and identify opportunities for ML applications. Work closely with engineering teams to integrate ML … frameworks (e.g., TensorFlow or PyTorch). Solid understanding of various machine learning algorithms (e.g., classification, regression, clustering) and their practical applications. Proficient in data manipulation and analysis using tools like SQL and Pandas. Broad ML skillset and are happy to work … on all aspects of ML problems. Not only modeling, but also feature work in data pipelines, some implementation in data pipeline workflows, experimentation setup and analysis. Experience with model evaluation metrics and techniques for ensuring model quality and generalization. Experience with cloud platforms (e.g., GCP More ❯

re located within a commutable distance of one of our offices so that we're able to interact and collaborate in person. Our Data Environment Our Data teams are aligned to divisions covering the following Banking Services & Products, Customer Identity & Financial Crime and Data & ML Engineering. Our Data teams are excited about delivering meaningful and impactful insights to both the business and more importantly our customers. Hear from the team in our latest blogs or our case studies with Women in Tech . We are looking for talented data … problems and challenges, who can work across teams do great things here at Starling, to continue changing banking for good. Responsibilities: Analyse source data from source databases (PostgreSQL) to understand structures, relationships and semantics. Design and implement streaming data pipelines using AWS EMR and PySpark to More ❯

edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Senior Java Data Engineer. The FX Data Analytics & Gen AI Technology team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven … models, and engineering robust data and analytics pipelines, to unlock actionable insights from our vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across More ❯

learning systems, and high-impact experiments which we integrate into business, financial, and system-level decision making. We are looking for a Senior Data Engineer to help put SOTA economic and data science models into production. We are looking for a individual who is interested in … working with the latest big data technology (Spark, EMR, Glue, SageMaker, and Airflow) and collaborate with Economist and Scientist in creating scalable solutions for our multiple Retail Businesses. Key job responsibilities - Partnering with economists and senior team members in building an environment of large high-quality datasets - Create … and support AWS based data platforms that leverage diverse data sources across Amazon, that feed input to and serve output from machine learning/econometric models - Help us move faster by building fast prototypes that help us prove out our ideas - Develop and extend reusable libraries More ❯

compute solutions to enable efficient processing and real-time interactions. Event-Driven Architecture : Build and maintain systems that facilitate scalable and real-time data processing. Efficient Workflow Management : Implement solutions to streamline complex AI processes and facilitate automation. Real-Time Communication : Enhance … communication frameworks to improve user experience across our platforms. Document Management Solutions : Develop indexing and retrieval systems for efficient document handling. Data Pipeline Creation : Design ETL pipelines to collect and process data from a variety of sources. Infrastructure Decision-Making : Advocate for architectural decisions that … ensure scalability, reliability, and cost efficiency. Support for Research Teams : Provide infrastructure and tools that empower our AI and data research initiatives. Tech Stack: Full-Stack Development : TypeScript, React, Next.js, Tailwind, Prisma Database Management : PostgreSQL, MongoDB, Redis Cloud Solutions : AWS, Google Cloud, Serverless Architectures Data Pipelines More ❯

exciting point in our journey, leveraging Generative AI (GenAI) , Large Language Models (LLMs) , and advanced Retrieval-Augmented Generation (RAG) techniques to build intelligent, data-driven systems that deliver powerful PR insights. You'll also work on developing agentic workflows that autonomously orchestrate tasks, enabling scalable and dynamic solutions. … Our data stack is modern and efficient, designed to process large-scale information, automate analysis pipelines, and integrate seamlessly with AI-driven workflows. This is an excellent opportunity to make a significant impact on projects that push the boundaries of AI-powered insights and automation. If you're … managed AI/ML services. Hands-on experience with Docker, Kubernetes, and container orchestration. Expertise with Databricks, including ML workflows and data pipeline management. Familiarity with tools like MLflow, DVC, Prometheus, and Grafana for versioning and monitoring. Experience implementing security and compliance standards for AI systems. Strong More ❯

is central to that mission-reinventing how users find and connect with content in new and relevant ways. We're looking for a Data Engineer to join a squad passionate about delivering pioneering search experiences powered by Machine Learning (ML) and Large Language Models (LLMs). In this … role, you'll help craft the team's data strategy and build the systems that power smarter, more intuitive discovery on Spotify. You'll work alongside a dedicated mix of ML and Backend Engineers to tackle some of Spotify's most exciting challenges in retrieval, ranking, and personalization. … If you're excited by data systems, ML-powered products, and the opportunity to impact how millions of people explore audio content-this is the role for you. What You'll Do Design, build, and maintain scalable, reliable data pipelines that support advanced search capabilities. Partner More ❯

power the training of the world's most capable AI frontier models, pushing the boundaries of scale, performance, and product deployment. The AI Data team at Microsoft AI is responsible for all aspects of data preparation to support our model pre-training operations, including collecting data from the source, extracting and transforming the most useful data, and understanding the impact of changes to data by training and evaluating new models. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models … next generation of systems that will transform the field. In particular, we are looking for candidates who: Are passionate about the role of data in large-scale AI model training Will thrive in a highly collaborative, fast-paced environment Have a high degree of craftsmanship and pay close More ❯

Customer Platform Data Analytics Lead Remote (with regular travel to a London-based office) Competitive Salary + Benefits Full Time | Permanent A fast-scaling, well-funded FinTech in the insurance and payments space is looking for a Customer Platform Data & Analytics Lead to head up a … growing team of talented data engineers. This is a unique opportunity to lead the embedded analytics function within a SaaS product environment, shaping architecture and best practices while remaining hands-on with complex engineering tasks. You'll join a high-performing, collaborative team at a company backed by … and you’ll have real influence as they continue to scale. What You’ll Do Lead, mentor and manage a squad of 5 data & analytics engineers. Define technical standards and drive excellence in engineering practices. Architect and oversee the development of cloud-native data infrastructure and More ❯

Customer Platform Data Analytics Lead Remote (with regular travel to a London-based office) Competitive Salary + Benefits Full Time | Permanent A fast-scaling, well-funded FinTech in the insurance and payments space is looking for a Customer Platform Data & Analytics Lead to head up a … growing team of talented data engineers. This is a unique opportunity to lead the embedded analytics function within a SaaS product environment, shaping architecture and best practices while remaining hands-on with complex engineering tasks. You'll join a high-performing, collaborative team at a company backed by … and you’ll have real influence as they continue to scale. What You’ll Do Lead, mentor and manage a squad of 5 data & analytics engineers. Define technical standards and drive excellence in engineering practices. Architect and oversee the development of cloud-native data infrastructure and More ❯

opportunities and identify use cases across key verticals (retail, media, digital products/services). Leverage your domain expertise to showcase how Customer Data Infrastructure enables digital analytics, marketing, product analytics, and AI/ML use cases. Design and deliver bespoke pitches and demos for various prospect stakeholders … such as Heads of Data, CTOs, data engineers/analysts/scientists, and wider senior management. Lead Proof of Concepts providing hands-on demonstration of products full capabilities. Become a product expert and trusted advisor to our customers. Contribute technical thought leadership to support broader go … years in a Sales Engineering capacity. You have strong technical skills and professional experience in: web and mobile app development, SQL, ETL or data pipelines, and data analysis. You have experience with cloud data warehouses/lakes including Snowflake, Databricks, BigQuery, Redshift, S3, and More ❯

A leading Global Technology Consultancy in the City of London is now looking for a Lead Data Engineer to join the business on a permanent basis. The role is offering a base of £110,000 (potential flexibility) + bonus and shares. Their HQ is in the City of … London and they have adopted a hybrid working model. The ideal Lead Data Engineer will have a background from either an IT Technology provider or IT Consultancy and enjoys working with clients to solve real world data problems. In this exciting role, you'll partner with … clients to transform raw data into powerful insights, ensuring top-tier performance, reliability, and compliance with data governance standards. The Lead Data Engineer will be well versed in the latest Data Tools/Gen AI and can utilise them to delivery high More ❯

Business Intelligence Engineer, JP Retail Science We are seeking a Business Intelligence Engineer to drive the development of data engineering infrastructure and solutions that can scale across Amazon's largest vendors. In this role, your primary focus will be on designing and building robust data pipelines … and scale to hundreds of vendors, and even change the market, both in JP and WW, and with other business intelligence engineers and data engineers to develop the infrastructure necessary to deploy productionized solutions through code. As a member of the team you will also work with vendors … work, how we serve customers, and where we invest in future capabilities. This position is ideal for candidates with a strong background in data engineering, a passion for building scalable and efficient data solutions, and a desire to drive tangible business impact through data More ❯

including Predictive AI, LLMs, and other algorithms to identify security-relevant attributes within application responses. Role & Responsibilities We're looking for an experienced Data Scientist to join our automated red teaming product team to enhance data insights and accuracy. In this role you will: Analyze the … identified by the team. Identify and develop further improved methods for classifying results and identifying vulnerabilities. Identify new insights and visualisations from our data that would benefit our customers. Design and implement improvements to data pipelines and labelling systems that facilitate ongoing quality. Advise the engineering … team on good data engineering and data science practices. Work with the wider engineering team to implement your proposals. Clearly communicate complex data insights to less technical colleagues. Skills & Experience We're looking for people who are: Highly competent at statistical analysis. Experienced in More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯

boundaries of modern technology? If you answered yes and you have a background in FinTech you'll love this role and Amazon's data obsessed culture. Amazon Devices and Services Fintech is the global team that designs and builds the financial planning and analysis tools for a wide … enable and improve senior level business decision making. A strategic thinker who combines technical expertise with business acumen to develop and maintain scalable data solutions. You will apply both business and technical acumen in a fast-paced, ambiguous and innovative environment. Our ideal teammate possesses a natural curiosity … analytical skills and is excited to pioneer on behalf of customers. Key job responsibilities Engineer robust, automated reporting systems and dashboards that facilitate data-driven decision making Partner with Product and Business teams to capture requirements and deliver analytical solutions Execute targeted data analyses and ensure More ❯

Data Science Manager 📍 London | Lloyd’s Market | Hybrid About the Company Join a high-performing, globally recognised insurer in the Lloyd’s market — known for its disciplined underwriting, long-term partnerships, and collaborative culture. Our client blends innovation with tradition, offering a dynamic environment where data-driven insights are shaping the future of insurance. About the Role We’re hiring a Data Science Manager to lead the design, development, and deployment of machine learning and advanced analytics solutions. You’ll play a critical role in transforming how underwriting, pricing, and risk assessment … are executed, using data science to drive smarter decisions and digital trading strategies. You’ll manage a team of skilled data scientists and work hand-in-hand with underwriters, actuaries, engineers, and business leaders to turn complex data into actionable insights and measurable outcomes. More ❯

You will need to login before you can apply for a job. Advanced Data Insights Analyst III (Marketing Analytics) View more categories View less categories Sector Travel and Tourism Role Analyst Contract Type Permanent Hours Full Time Expedia Group brands power global travel for everyone, everywhere. We design … processes to solve complex business issues and identify opportunities, then this could be the role for you! In this role you will: Extract data from multiple sources and combine into required datasets for model building or analytics. Challenge MMM concepts and outputs based on specific modelling, marketing, and … concepts like regression, ANOVA, AB testing. Select appropriate measurement techniques/designs to answer business questions and explain trade-offs. Define and build data models, interpret outputs, and iterate to improve models. Provide guidance and coaching on statistical techniques. Understand common data models, their assumptions, and More ❯