451 to 475 of 800 Data Pipeline Jobs in London

Data Analyst x2 FTC until March 2026 with expectation of 12-month extension Salary: The pro-rata starting salary is £53,459, which includes allowances totalling £2,928. The salary is broken down as £50,531 basic salary, which will increase annually until you reach the top of … today – involving the exploitation of children and vulnerable adults, fuelling violence, and stretching across regional and national borders. We’re building a new data capability to fight back. These two brand-new Data Analyst roles are your opportunity to shape how the National County Lines Coordination … Centre (NCLCC) uses data to target harm, safeguard victims, and inform national policing strategy. Working within a matrix environment, you’ll sit within the Met’s wider Digital, Data and Technology (DDaT) team but work day-to-day under the direction of the County Lines senior More ❯

Data Analyst x2 FTC until March 2026 with expectation of 12-month extension Salary: The pro-rata starting salary is £53,459, which includes allowances totalling £2,928. The salary is broken down as £50,531 basic salary, which will increase annually until you reach the top of … today – involving the exploitation of children and vulnerable adults, fuelling violence, and stretching across regional and national borders. We’re building a new data capability to fight back. These two brand-new Data Analyst roles are your opportunity to shape how the National County Lines Coordination … Centre (NCLCC) uses data to target harm, safeguard victims, and inform national policing strategy. Working within a matrix environment, you’ll sit within the Met’s wider Digital, Data and Technology (DDaT) team but work day-to-day under the direction of the County Lines senior More ❯

An esteemed Data Consultancy are seeking a number of ambitious Databricks Data Engineers to join their team. They are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in their data. They pride … themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you will be working in a team of highly skilled professionals to deliver effective market-leading data solutions using the latest cutting-edge technologies. This particular role will focus on leveraging the Databricks Data Intelligence platform, and Azure Data Platform technologies. You will split your time between client-site, home and the London office depending on requirements, and are asked to More ❯

Job Title: Senior Data Analyst Location: London, UK/Hybrid Must have experience working within the Lloyd’s of London market My client, a global leader in financial and insurance services, is seeking a Senior Data Analyst to join their growing international data team. … This role offers the opportunity to contribute to strategic, high-impact data initiatives across multiple global locations. What You’ll Be Doing You’ll play a key role in delivering high-quality data solutions across the business. Responsibilities include: Designing and leading the development of data pipelines, ETL processes, and reporting dashboards Ensuring data integrity and consistency through effective governance practices Supporting key projects across insurance, credit risk, and financial services Collaborating with global stakeholders using Agile methodologies Mentoring junior team members and helping shape the group’s data strategy More ❯

Job Title: Senior Data Analyst Location: London, UK/Hybrid Must have experience working within the Lloyd’s of London market My client, a global leader in financial and insurance services, is seeking a Senior Data Analyst to join their growing international data team. … This role offers the opportunity to contribute to strategic, high-impact data initiatives across multiple global locations. What You’ll Be Doing You’ll play a key role in delivering high-quality data solutions across the business. Responsibilities include: Designing and leading the development of data pipelines, ETL processes, and reporting dashboards Ensuring data integrity and consistency through effective governance practices Supporting key projects across insurance, credit risk, and financial services Collaborating with global stakeholders using Agile methodologies Mentoring junior team members and helping shape the group’s data strategy More ❯

Business Analysts are responsible for converting data into actionable business insights. They are analysis experts who leverage a variety of data platforms and analytical tools to provide timely, meaningful, and consumable information. They build deep contextual and domain knowledge. They ensure data quality and … They communicate findings with the most effective and influential methods. Amazon is seeking an exemplary Business Analyst with broad technical skills to develop data visualizations and build automation solutions that drive business decision making and process improvement. The ideal candidate will draw upon advanced analytical, problem solving skills … motivated, flexible, hardworking, and who like to have fun. The complexity of research and skills for a Business Analyst is well beyond basic data entry and extraction. It involves design and development of automated data pipelines, sophisticated analytical modeling and intuitive data visualization. This More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and … traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and … traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

What's the opportunity? The Research, Analytics & Data Science (RAD) team at Intercom uses data and insights to drive evidence-based decision-making. We're a team of data scientists and product researchers who use data - both big and small - to unlock … and shape products that deliver real value to our customers. If you get really excited about asking the right questions, exploring patterns in data, and surfacing actionable insights that drive strategic decisions, then this role is for you. Data Scientists in RAD partner with teams across … Intercom make sense of our users, our products, and our business, using metrics and data. This role will enable you to drive key data projects that directly impact our customers and millions of end users who communicate via our messaging platform daily. What will I be doing? You More ❯

We are looking for a Data Engineer to help us build structured, high-quality data solutions for our Content Understanding teams. Our teams process petabytes of data using tools such as BigQuery and Dataflow, and where needed we develop our own data tooling to support and evolve our music catalog. What You'll Do Take ownership over, maintain and improve data pipelines that are integral to our success Evaluate and optimize our offerings for efficiency and reliability at scale Identify areas of architectural improvement to remove the potential … for human error Collaborate with product and engineering teams to understand data requirements and create innovative solutions to challenging problems Understand the analytics data we collect from our systems and how it relates to the business value being produced Who You Are Proven experience in data More ❯

PR review and architecture discussions Desirable (but not essential): Event-driven architecture (e.g., SNS, SQS, EventBridge) AI/LLM integration (Python experience welcome) Data pipelines and ETL workflow knowledge Experience scaling cloud services and optimising for performance and cost in serverless environments Location & Flexibility: This is a London More ❯

PR review and architecture discussions Desirable (but not essential): Event-driven architecture (e.g., SNS, SQS, EventBridge) AI/LLM integration (Python experience welcome) Data pipelines and ETL workflow knowledge Experience scaling cloud services and optimising for performance and cost in serverless environments Location & Flexibility: This is a London More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition … to bringing all its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities … Design, develop, and optimise real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition … to bringing all its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities … Design, develop, and optimise real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS More ❯

We are looking for a Data Engineer to help us build structured, high-quality data solutions for our Content Understanding teams. Our teams process petabytes of data using tools such as BigQuery and Dataflow, and where needed we develop our own data … tooling to support and evolve our music catalog. Location London Job type Permanent What You'll Do Take ownership over, maintain and improve data pipelines that are integral to our success Evaluate and optimize our offerings for efficiency and reliability at scale Identify areas of architectural improvement to … remove the potential for human error Collaborate with product and engineering teams to understand data requirements and create innovative solutions to challenging problems Understand the analytics data we collect from our systems and how it relates to the business value being produced Who You Are Proven More ❯

seamless human-AI interaction. Build and deploy open-source models in cloud environments, optimizing inference and serving costs. Improve and maintain data pipeline reliability and participate in on-call rotations. Debug and fix issues in ML pipelines, even when the cause is obscure. Collaborate with cross-functional … Optimize prompts, refine model outputs, and experiment with novel prompting strategies. Implement backend endpoints to bridge AI capabilities into our production stack. Label data and refine model training workflows. Hire and manage part-time annotators to improve data quality. Create quick prototypes using Dash/Streamlit … GCP is a big plus. DevOps experience is a big plus. Prompt engineering expertise and creative problem-solving mindset. Experience with processing multimodal data (text, images, audio) is a plus. Perks and Benefits: Fully Remote: Work from anywhere with flexible hours. In-person Meetups and regular team-building More ❯

The Amazon Pricing & Promotions Analytics team seeks a Senior Data Engineer to build automated pricing solutions that deliver competitive prices to customers. In this role, you will design and implement data analytics solutions that drive pricing decisions while creating automated anomaly detection systems to monitor pricing … patterns to inform pricing strategy and developing actionable insights for senior leadership to guide business decisions. You will partner with stakeholders to implement data-driven pricing recommendations. Your work will directly impact Amazon's pricing strategy and customer experience. The position requires expertise in data analysis … and a track record of translating complex data into clear business recommendations. Key job responsibilities - Design and implement modern data pipelines and business intelligence solutions - Configure and optimize AWS services including EC2, RDS, Redshift, Kinesis, EMR, and Lambda - Create scalable data architecture to support More ❯

You will need to login before you can apply for a job. View more categories View less categories Sector Data Science Role Senior Executive Contract Type Permanent Hours Full Time Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it … can transform enterprise operations? Do you possess strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Are you eager to work in a dynamic, fast-growing category? If yes, you might be the ideal candidate for the Data and Analytics role in Global … agenda requires scalable digitization, thought leadership, decision-making, technical expertise, and the ability to navigate complex challenges while leading a team of top data and analytics professionals. With Digital First, PN is adopting a product-based model to develop business-facing digital capabilities. The role involves developing and More ❯

Octopus Energy, a leading force in the energy sector, is seeking a Data Engineer to join their Energy Markets team. This role sits at the intersection of energy trading, forecasting, and technological innovation, supporting the company's mission towards Net Zero transition. The position offers a unique opportunity … operational and reporting pipelines across regions Maintain critical data pipelines supporting trading, forecasting, risk and PPA processes Develop automations and alerts for pipeline monitoring Set up and maintain processes for capturing, preparing and loading data into the data lake Design and build operational … Engineer Strong aptitude with SQL, Python and Airflow Experience in Kubernetes, Docker, Django, Spark and related monitoring tools Experience with dbt for pipeline modelling Ability to shape needs into requirements and design scalable solutions Quick understanding of new domain areas and data visualization Team player More ❯

pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based … with version control systems (e.g., Git). • Familiarity with CI/CD tools and practices. • Strong problem-solving and analytical skills. • Understanding of data structures and algorithms. • Ability to design and develop scalable, efficient, and maintainable software systems. • Experience with microservice architecture, API development. Machine Learning (ML): • Deep … machine learning principles, algorithms, and techniques. • Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. • Proficiency in data preprocessing, feature engineering, and model evaluation. • Knowledge of ML model deployment and serving strategies, including containerization and microservices. • Familiarity with ML lifecycle management, including More ❯

DATA ENGINEER LONDON BASED £75,000-95,000 PER ANNUM This growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python. THE COMPANY This E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine … Learning variables. THE ROLE You will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform. Improve best coding practices within the Business. Stream real-time Data More ❯

together individuals with Mathematics, Physics and Computer Science backgrounds who are passionate about applying rigorous scientific methods to financial challenges. As a fundamentally data-driven business, our success is heavily linked to the acquisition, processing, and analysis of vast datasets. High-quality, well-managed data forms … the critical foundation for our quantitative research, strategy development, and automated trading systems. As a Data Engineer within our Quantitative Platform team, you will play a pivotal role in building and maintaining the data infrastructure that fuels our research and trading strategies. You will be responsible … diverse datasets - including market, fundamental, and alternative sources - ensuring their timely acquisition, rigorous cleaning and validation, efficient storage, and reliable delivery through robust data pipelines. Working closely with quantitative researchers and technologists, you will tackle complex challenges in data quality, normalization, and accessibility, ultimately providing the More ❯

pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based … with version control systems (e.g., Git). Familiarity with CI/CD tools and practices. Strong problem-solving and analytical skills. Understanding of data structures and algorithms. Ability to design and develop scalable, efficient, and maintainable software systems. Experience with microservice architecture, API development. Machine Learning (ML): Deep … machine learning principles, algorithms, and techniques. Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. Proficiency in data preprocessing, feature engineering, and model evaluation. Knowledge of ML model deployment and serving strategies, including containerization and microservices. Familiarity with ML lifecycle management, including More ❯

Data Analyst 📍 West London (3 days a week on-site) 💸 £55,000 – £60,000 About the Company A leading name in the UK property sector is on the hunt for a mid-level Data Analyst to join their growing data team. With a strong … foundation in Business Intelligence and a forward-thinking approach to tech, this company has spent the last five years investing heavily in their data infrastructure and are now gearing up to take things even further — including AI implementation over the next 6–12 months. 🚀 They're working on … internal data projects with real commercial impact and are looking for someone who can not only crunch the numbers, but also tell the story behind them. The Role You’ll take the lead on key analytics initiatives, working end-to-end across data pipelines, visualisation, and More ❯

Contract Opportunity: Senior AWS Machine Learning Data Engineer Location: London | Duration: 6 Months (Extension Possible) | Start Date: ASAP Rate: Up to £600 a day (Inisde IR35) Are you a cloud-native data engineer with a passion for building intelligent systems? I'm looking for a Senior … AWS Machine Learning Data Engineer to a cutting-edge team on a contract basis, working on high-impact ML solutions that scale. About the Role: In this role, you'll lead the design and implementation of data pipelines and ML infrastructure on AWS. You'll collaborate … with data scientists, architects, and product teams to deliver production-grade ML systems across a variety of domains — from predictive analytics to real-time personalization. ? What You'll Do: Architect and build scalable, secure, and maintainable data pipelines on AWS (Glue, Lambda, Step Functions, S3, Redshift More ❯