401 to 425 of 684 Data Pipeline Jobs in London

We are looking for a Data Engineer to help us build structured, high-quality data solutions for our Content Understanding teams. Our teams process petabytes of data using tools such as BigQuery and Dataflow, and where needed we develop our own data tooling to support and evolve our music catalog. What You'll Do Take ownership over, maintain and improve data pipelines that are integral to our success Evaluate and optimize our offerings for efficiency and reliability at scale Identify areas of architectural improvement to remove the potential … for human error Collaborate with product and engineering teams to understand data requirements and create innovative solutions to challenging problems Understand the analytics data we collect from our systems and how it relates to the business value being produced Who You Are Proven experience in data More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition … to bringing all its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities … Design, develop, and optimise real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition … to bringing all its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities … Design, develop, and optimise real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS More ❯

We are looking for a Data Engineer to help us build structured, high-quality data solutions for our Content Understanding teams. Our teams process petabytes of data using tools such as BigQuery and Dataflow, and where needed we develop our own data … tooling to support and evolve our music catalog. Location London Job type Permanent What You'll Do Take ownership over, maintain and improve data pipelines that are integral to our success Evaluate and optimize our offerings for efficiency and reliability at scale Identify areas of architectural improvement to … remove the potential for human error Collaborate with product and engineering teams to understand data requirements and create innovative solutions to challenging problems Understand the analytics data we collect from our systems and how it relates to the business value being produced Who You Are Proven More ❯

seamless human-AI interaction. Build and deploy open-source models in cloud environments, optimizing inference and serving costs. Improve and maintain data pipeline reliability and participate in on-call rotations. Debug and fix issues in ML pipelines, even when the cause is obscure. Collaborate with cross-functional … Optimize prompts, refine model outputs, and experiment with novel prompting strategies. Implement backend endpoints to bridge AI capabilities into our production stack. Label data and refine model training workflows. Hire and manage part-time annotators to improve data quality. Create quick prototypes using Dash/Streamlit … GCP is a big plus. DevOps experience is a big plus. Prompt engineering expertise and creative problem-solving mindset. Experience with processing multimodal data (text, images, audio) is a plus. Perks and Benefits: Fully Remote: Work from anywhere with flexible hours. In-person Meetups and regular team-building More ❯

You will need to login before you can apply for a job. View more categories View less categories Sector Data Science Role Senior Executive Contract Type Permanent Hours Full Time Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it … can transform enterprise operations? Do you possess strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Are you eager to work in a dynamic, fast-growing category? If yes, you might be the ideal candidate for the Data and Analytics role in Global … agenda requires scalable digitization, thought leadership, decision-making, technical expertise, and the ability to navigate complex challenges while leading a team of top data and analytics professionals. With Digital First, PN is adopting a product-based model to develop business-facing digital capabilities. The role involves developing and More ❯

Octopus Energy, a leading force in the energy sector, is seeking a Data Engineer to join their Energy Markets team. This role sits at the intersection of energy trading, forecasting, and technological innovation, supporting the company's mission towards Net Zero transition. The position offers a unique opportunity … operational and reporting pipelines across regions Maintain critical data pipelines supporting trading, forecasting, risk and PPA processes Develop automations and alerts for pipeline monitoring Set up and maintain processes for capturing, preparing and loading data into the data lake Design and build operational … Engineer Strong aptitude with SQL, Python and Airflow Experience in Kubernetes, Docker, Django, Spark and related monitoring tools Experience with dbt for pipeline modelling Ability to shape needs into requirements and design scalable solutions Quick understanding of new domain areas and data visualization Team player More ❯

pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based … with version control systems (e.g., Git). • Familiarity with CI/CD tools and practices. • Strong problem-solving and analytical skills. • Understanding of data structures and algorithms. • Ability to design and develop scalable, efficient, and maintainable software systems. • Experience with microservice architecture, API development. Machine Learning (ML): • Deep … machine learning principles, algorithms, and techniques. • Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. • Proficiency in data preprocessing, feature engineering, and model evaluation. • Knowledge of ML model deployment and serving strategies, including containerization and microservices. • Familiarity with ML lifecycle management, including More ❯

DATA ENGINEER LONDON BASED £75,000-95,000 PER ANNUM This growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python. THE COMPANY This E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine … Learning variables. THE ROLE You will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform. Improve best coding practices within the Business. Stream real-time Data More ❯

together individuals with Mathematics, Physics and Computer Science backgrounds who are passionate about applying rigorous scientific methods to financial challenges. As a fundamentally data-driven business, our success is heavily linked to the acquisition, processing, and analysis of vast datasets. High-quality, well-managed data forms … the critical foundation for our quantitative research, strategy development, and automated trading systems. As a Data Engineer within our Quantitative Platform team, you will play a pivotal role in building and maintaining the data infrastructure that fuels our research and trading strategies. You will be responsible … diverse datasets - including market, fundamental, and alternative sources - ensuring their timely acquisition, rigorous cleaning and validation, efficient storage, and reliable delivery through robust data pipelines. Working closely with quantitative researchers and technologists, you will tackle complex challenges in data quality, normalization, and accessibility, ultimately providing the More ❯

pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based … with version control systems (e.g., Git). Familiarity with CI/CD tools and practices. Strong problem-solving and analytical skills. Understanding of data structures and algorithms. Ability to design and develop scalable, efficient, and maintainable software systems. Experience with microservice architecture, API development. Machine Learning (ML): Deep … machine learning principles, algorithms, and techniques. Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. Proficiency in data preprocessing, feature engineering, and model evaluation. Knowledge of ML model deployment and serving strategies, including containerization and microservices. Familiarity with ML lifecycle management, including More ❯

Data Analyst 📍 West London (3 days a week on-site) 💸 £55,000 - £60,000 About the Company A leading name in the UK property sector is on the hunt for a mid-level Data Analyst to join their growing data team. With a strong … foundation in Business Intelligence and a forward-thinking approach to tech, this company has spent the last five years investing heavily in their data infrastructure and are now gearing up to take things even further - including AI implementation over the next 6-12 months. 🚀 They're working on … internal data projects with real commercial impact and are looking for someone who can not only crunch the numbers, but also tell the story behind them. The Role You'll take the lead on key analytics initiatives, working end-to-end across data pipelines, visualisation, and More ❯

Contract Opportunity: Senior AWS Machine Learning Data Engineer Location: London | Duration: 6 Months (Extension Possible) | Start Date: ASAP Rate: Up to £600 a day (Inisde IR35) Are you a cloud-native data engineer with a passion for building intelligent systems? I'm looking for a Senior … AWS Machine Learning Data Engineer to a cutting-edge team on a contract basis, working on high-impact ML solutions that scale. About the Role: In this role, you'll lead the design and implementation of data pipelines and ML infrastructure on AWS. You'll collaborate … with data scientists, architects, and product teams to deliver production-grade ML systems across a variety of domains — from predictive analytics to real-time personalization. ? What You'll Do: Architect and build scalable, secure, and maintainable data pipelines on AWS (Glue, Lambda, Step Functions, S3, Redshift More ❯

products including e-liquids, vape kits, accessories, and CBD items. As the business continues to grow, they’re now looking to add a Data Analyst to their expanding team in North London. As a Data Analyst, the main goal is to turn data into … actionable insights that support strategic, data-driven decisions. This involves gathering, cleaning, analysing, and interpreting data to uncover trends and patterns that drive improved business performance and revenue growth. In this role: You will… Collect, clean, and analyse data from multiple sources to support … strategic decision-making Automate workflows and build efficient data pipelines to improve data collection and processing Identify trends and insights through data analysis, surveys, and competitor research Collaborate with stakeholders to define KPIs and track performance through dashboards and visual reports Ensure data More ❯

tier quants, engineers, and analysts, contributing to systems that power critical investment decisions globally. 🧠 What You’ll Be Doing 📊 Design and develop scalable data pipelines for trading and quantitative analysis 🔧 Automate complex workflows to enhance performance and reduce friction 🤝 Work closely with cross-functional teams to build efficient More ❯

Conduct independent research to identify opportunities and inefficiencies in financial markets. Create portfolio optimisation tools and risk management models. Maintain and improve codebases, data pipelines, and database integrations. Enhance automation of processes and integrate AI-driven solutions where applicable. Collaborate with IT and investment teams to optimise internal More ❯

Conduct independent research to identify opportunities and inefficiencies in financial markets. Create portfolio optimisation tools and risk management models. Maintain and improve codebases, data pipelines, and database integrations. Enhance automation of processes and integrate AI-driven solutions where applicable. Collaborate with IT and investment teams to optimise internal More ❯

Role: Senior Product Manager (Data Foundations) Location: London (2-3 days per week in our Holborn office) Employment Type: Full-time, as an employee Prosapient is a global Expert Network firm. We provide clients with rapid access to high-quality, relevant expert insights through a combination of world … and most successful female co-founded businesses. At proSapient, we’re building the foundations of next-generation expert intelligence. As we grow our data capabilities, we’re looking for a data-savvy product leader to shape how proprietary and third-party data powers our … platform. From driving integrations to building scalable pipelines, you’ll play a central role in turning raw data into meaningful, actionable insights that enable faster, smarter decisions for our users. The key focus of the role includes: · Owning our data foundations product domain end-to-end More ❯

Role: Senior Product Manager (Data Foundations) Location: London (2-3 days per week in our Holborn office) Employment Type: Full-time, as an employee Prosapient is a global Expert Network firm. We provide clients with rapid access to high-quality, relevant expert insights through a combination of world … and most successful female co-founded businesses. At proSapient, we’re building the foundations of next-generation expert intelligence. As we grow our data capabilities, we’re looking for a data-savvy product leader to shape how proprietary and third-party data powers our … platform. From driving integrations to building scalable pipelines, you’ll play a central role in turning raw data into meaningful, actionable insights that enable faster, smarter decisions for our users. The key focus of the role includes: · Owning our data foundations product domain end-to-end More ❯

by economic prosperity that lifts society up. That's why we empower British businesses and government to harness the power of AI and data analytics, so they can create value for people, not just profits. By working with brave and ambitious organisations who share our vision, we're … value, complex processes to drive operational efficiency and profitability. As markets face greater disruption, QuantSpark empowers companies in realising their competitive advantage through data, strategic insight, and AI. The Role This is an exciting opportunity for an experienced Senior Analytics Engineer to lead technical work on projects, navigate … communication skills to navigate client relationships and translate technical insights into business value. Experience with cloud platforms (e.g., Snowflake, AWS) and ETL/ELT pipeline tools like Airflow/dbt. Benefits £6,000 per annum training & conference budget to help you up-skill and elevate your career Pension contribution More ❯

We are excited to offer a new opportunity for an Enterprise Data Architect to join our community of Solution, Data and Infrastructure Architects. Reporting to the Director of Technology Office, you will shape and drive our enterprise-wide data strategy, to establish best practices … and guidelines for data management, integration, and insights. Wickes are a digitally led, service enabled organisation with a vision to have a Wickes project in every home. We are more than the nation's favourite DIY store; we are a growing multichannel organisation, with a strong culture of … authenticity and innovation. This is a great time to join a growing business, to be part of a new technology team. The Enterprise Data Architect will work closely with our product owners and product/project managers to ensure a robust architectural runway that can support future business More ❯

they already have through expansive knowledge management. At proSapient, we're building the foundations of next-generation expert intelligence. As we grow our data capabilities, we're looking for a data-savvy product leader to shape how proprietary and third-party data powers our … platform. From driving integrations to building scalable pipelines, you'll play a central role in turning raw data into meaningful, actionable insights that enable faster, smarter decisions for our users. The key focus of the role includes: Owning our data foundations product domain end-to-end … align team efforts with the broader company strategy. Owning the end-to-end product lifecycle, from deep customer research to defining and delivering data-driven solutions. Leading the design and development of scalable data extraction and enrichment pipelines, working within a cross-functional squad and collaborating More ❯

by economic prosperity that lifts society up. That's why we empower British businesses and government to harness the power of AI and data analytics, so they can create value for people, not just profits. By working with brave and ambitious organisations who share our vision, we're … value, complex processes to drive operational efficiency and profitability. As markets face greater disruption, QuantSpark empowers companies in realising their competitive advantage through data, strategic insight, and AI. The Role We are looking for an Analytics Engineer to join our Analytics Engineering team. This role sits at the … intersection of Data Analytics, Software Development, and Data Engineering. You'll a pivotal role in designing complex data pipelines, managing data warehouses using tools like dbt and Airflow, and enabling predictive analytics solutions for our diverse group of clients. As part of More ❯

A boutique data consultancy are looking for passionate Consultants with skills in Alteryx to join their talented team, where you'll help their customers unlock the value in their data through innovative data-driven solutions. Their UK office is in London but, with the … across the UK. In this role you'll work directly with clients to deliver end-to-end solutions including designing, building and maintaining data pipelines to help clients extract value from their data-sets, and developing insightful reports and dashboards to allow for decision-making. You … Strong SQL skills and ideally Python Hands-on experience with Alteryx Experience with visualization tools such as Power BI or Tableau Experience building data pipelines Experience with at least one cloud-based data platform e.g. Azure, GCP, AWS, Snowflake or Databricks Excellent communication and stakeholder management More ❯

About us We are a fast-growing team on a mission to reimagine analytics and make data accessible to all. The Count canvas combines the power of data notebooks with the collaborative workflow of digital whiteboards. We're often referred to as the "Figma for data" because of the way Count transforms the way data teams work with the wider business through greater transparency and trust. Since launching in September 2022 we have seen the canvas concept explode, with Count empowering some of Europe's leading tech companies- including Cleo, BeautyPie, TooGoodToGo … exceptional software engineer to help shape Count's next stage of growth. You'll own technical projects at the intersection of software development, data engineering, analytics and DevOps infrastructure, playing a key role in automating and scaling processes that empower every team across the organisation. Your responsibilities will More ❯