76 to 100 of 280 Data Pipeline Jobs in Central London

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is … a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and … timely MI, streamline processes, and migrate to a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is … a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and … timely MI, streamline processes, and migrate to a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining the roadmap, proposing scalable Azure-native solutions, and collaborating with the … Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯

Data Engineer – Hedge Fund | AWS | SQL | Python | Power BI Location: London Contract: Full-time Salary: £150,000 + Bonus + Benefits A leading hedge fund is seeking a skilled Data Engineer to join its front-office technology team. This is a high-impact role where you’ll work directly with portfolio managers, quants, and analysts to … design and deliver scalable, cloud-based data solutions that power trading and investment strategies. Key Responsibilities Design, build, and optimise data pipelines and ETL workflows using AWS, Python, and SQL. Develop and maintain data models, ensuring accuracy and reliability of trading and market data. Deliver Power BI dashboards and reports to provide real-time … insights for investment teams. Partner with stakeholders across the equities business to understand data requirements and deliver impactful solutions. Ensure data quality, governance, and performance standards are consistently met. Collaborate with quants, traders, and developers to support research, trading, and risk workflows. What you’ll bring Proven experience as a Data Engineer within financial More ❯

Data & Technology Lead London (3 days in Office) | Up to £70,000 + Bonus I’m working with an employee-owned media agency that’s looking for a hands-on Data & Technology Lead to take ownership of their data engineering and automation capabilities. This role will focus on building and optimising data pipelines, shaping data architecture, and driving the use of AI and automation across the business. You’ll also mentor a small team and play a key part in developing the agency’s future data strategy. What you’ll bring: Strong background in data engineering – Python, SQL, and cloud platforms (GCP or Azure … . Experience designing or managing data pipelines and ETL processes . Exposure to orchestration tools such as dbt , Airflow , or Azure Data Factory . Good understanding of data architecture and automation . AdTech or MarTech experience would be a real plus. Confident mentoring and developing junior engineers/analysts. This is a great opportunity More ❯

around £500/day Starting ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role in developing and optimising a … Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What You’ll Be Doing Design, develop and maintain data pipelines and models … using Snowflake, dbt and Python. Enhance and support Power BI dashboards and data models, ensuring performance, accuracy and user accessibility. Contribute to the migration of legacy SQL Server (SSIS/SSAS/SSRS) systems into a modern Snowflake/Power BI environment. Work collaboratively with business users to understand requirements, translate them into technical solutions and deliver robust More ❯

around £500/day Starting ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role in developing and optimising a … Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What You’ll Be Doing Design, develop and maintain data pipelines and models … using Snowflake, dbt and Python. Enhance and support Power BI dashboards and data models, ensuring performance, accuracy and user accessibility. Contribute to the migration of legacy SQL Server (SSIS/SSAS/SSRS) systems into a modern Snowflake/Power BI environment. Work collaboratively with business users to understand requirements, translate them into technical solutions and deliver robust More ❯

Mid-Level Data Analyst - Outside IR35 Contract - SQL, Python, ETL, Data Pipelines I've had a new Mid-Level Data Analyst contract role come live for an InsureTech Client of OB's, who are looking for a highly skilled Mid-Level Data Analyst to join the team on a 6-month contract. … You'll be working closely with the Data Architect, setting up a Data & AI roadmap and helping to analyse how they use Data that comes through their platform. Mid-Level Data Analyst - Outside IR35 Contract - SQL, Python, ETL, Data Pipelines Key skills and experience: 3+ years of experience as a … Data Analyst SQL, Python, ETL, Data Pipelines Pays £450-£500 Outside IR35 6-month initial engagement 2-3 days a week in Central London offices Mid-Level Data Analyst - Outside IR35 Contract - SQL, Python, ETL, Data Pipelines More ❯

HMND 01 is a next-gen labour automation unit, providing highly efficient services across various use cases, starting with industrial applications. We are looking for Senior/Staff Data Engineer to join our team based in London, UK. Our Mission At Humanoid we strive to create the world’s leading, commercially scalable, safe, and advanced humanoid robots that … needs. Responsibilities Curate, preprocess, and manage large datasets used for training humanoid robots — projected to reach hundreds of terabytes by 2025. Ensure the quality, accuracy, and consistency of data across multiple projects. Collaborate with machine learning teams to design data pipelines that support efficient training workflows. Develop and maintain data quality metrics reporting systems. … Implement best practices for data management, including versioning, security, and compliance. Expertise Bachelor’s or Master’s degree in Data Science, Computer Science, or a related field. 5+ years of experience in data engineering and data quality. Strong proficiency in Python/Java, SQL, and data processing frameworks including Apache More ❯

HMND 01 is a next-gen labour automation unit, providing highly efficient services across various use cases, starting with industrial applications. We are looking for Senior/Staff Data Engineer to join our team based in London, UK. Our Mission At Humanoid we strive to create the world’s leading, commercially scalable, safe, and advanced humanoid robots that … needs. Responsibilities Curate, preprocess, and manage large datasets used for training humanoid robots — projected to reach hundreds of terabytes by 2025. Ensure the quality, accuracy, and consistency of data across multiple projects. Collaborate with machine learning teams to design data pipelines that support efficient training workflows. Develop and maintain data quality metrics reporting systems. … Implement best practices for data management, including versioning, security, and compliance. Expertise Bachelor’s or Master’s degree in Data Science, Computer Science, or a related field. 5+ years of experience in data engineering and data quality. Strong proficiency in Python/Java, SQL, and data processing frameworks including Apache More ❯

Senior Front Office Quant Developer (Data & Analytics) – Fixed Income London | On-site | Full-time A leading multi-strategy hedge fund is looking for a Front Office Quant Developer to join its Quant - Data & Analytics team . You’ll work directly with portfolio managers, traders, and researchers to build and support the data and analytics … infrastructure that powers research, trading, and portfolio decision-making across fixed income markets. What You’ll Do Build and maintain real-time and batch data pipelines across internal and external sources. Develop and optimize cloud-native workflows on AWS , including containerized deployments (Docker). Ingest, transform, and serve large-scale financial datasets using Python, Snowflake, and NoSQL databases … front-office or trading technology experience. Strong Python development and modern engineering practices (CI/CD, testing, version control). Proven experience with AWS , Docker , and data pipeline design . Solid understanding of financial instruments (rates, credit, FX, derivatives). Self-starter with excellent communication and problem-solving skills. Nice to Have Experience with Bloomberg/Refinitiv More ❯

Data Analyst | 6-month Contract | Inside IR35 | £500-£550 p/d | SQL, Python, ETL, Data Pipelines OB are partnered with an innovative InsurTech client who are looking for a Data Analyst to join their growing data function on a 6-month contract. In this role, you’ll work closely with the … Data Architect to design and deliver a Data & AI roadmap, while analysing and optimising how data flows through their core platform. Key Skills: 3+ years of experience as a Data Analyst Proficiency in SQL and Python Experience building and managing ETL workflows and data pipelines Contract Details: Inside IR35 …/day 3 days on-site Data Analyst | 6-month Contract | Inside IR35 | £500-£550 p/d | SQL, Python, ETL, Data Pipelines More ❯

Job Title: Business Intelligence Data Analyst Location: Middlesex 12 Month Contract Salary up to £65k + Benefits Job Type: Full-time Department: Sales Operations/Business Analytics Job Overview Are you passionate about transforming data into strategic insights that drive business success? We are looking for a Business Intelligence Data Analyst to support our … Global Virtual Sales (GVS) team across EMEA. This role is essential to enabling data-driven decision-making that maximizes sales effectiveness and enhances operational efficiency. As part of a dynamic and collaborative environment, you’ll work closely with cross-functional teams—including Sales, Finance, Operations, Strategy & Planning, and IT—to analyze complex datasets and deliver actionable insights. Your … work will directly influence how we execute our Sales Go-to-Market strategy and shape the future of virtual selling Key Responsibilities Enable and support data-driven decision-making across sales operations to enhance productivity and revenue growth. Conduct advanced analysis of complex datasets spanning sales, operations, marketing, and planning. Design and develop reports and dashboards to track More ❯

computational biology, combining machine learning, cloud infrastructure, and scientific research to accelerate discoveries in life sciences. As a Staff Backend Engineer , you’ll build the distributed systems and data infrastructure that power the lab’s next-generation biology platform. From model serving to real-time data processing, your work will form the backbone of a platform … enabling scientists to explore and manipulate biological data in entirely new ways. What you’ll do Design and own backend architecture for large-scale, data-intensive applications. Develop and optimize APIs that handle complex biological and ML-driven workloads. Build and maintain data pipelines for ingesting, transforming, and serving scientific data at … and long-term scalability. Nice-to-haves Experience with MLOps and model-serving infrastructure. Background in high-performance computing or large-scale scientific workloads. Expertise in data pipeline architecture and real-time streaming systems. Knowledge of scientific or biological computing environments . This is a rare opportunity to join a deep-tech AI lab where backend engineering More ❯

computational biology, combining machine learning, cloud infrastructure, and scientific research to accelerate discoveries in life sciences. As a Staff Backend Engineer , you’ll build the distributed systems and data infrastructure that power the lab’s next-generation biology platform. From model serving to real-time data processing, your work will form the backbone of a platform … enabling scientists to explore and manipulate biological data in entirely new ways. What you’ll do Design and own backend architecture for large-scale, data-intensive applications. Develop and optimize APIs that handle complex biological and ML-driven workloads. Build and maintain data pipelines for ingesting, transforming, and serving scientific data at … and long-term scalability. Nice-to-haves Experience with MLOps and model-serving infrastructure. Background in high-performance computing or large-scale scientific workloads. Expertise in data pipeline architecture and real-time streaming systems. Knowledge of scientific or biological computing environments . This is a rare opportunity to join a deep-tech AI lab where backend engineering More ❯

Enterprise Data Architect – Azure/Snowflake £105K - £110K + + Bonus + Bens London – 1 day PW in office (EC3) As part of a data transformation programme, a major reinsurer is looking for an experienced Enterprise Data Architect to join them in London. The role will focus around helping to shape and scale their … data strategy, building MVP’s and designing Snowflake DWH. What You’ll Do: Design and manage enterprise data architecture using Azure and Snowflake Build and optimize data pipelines, warehouses, and lakes Work with engineering, analytics, and business teams to align on data needs Define best practices for data governance, quality … Help modernize legacy systems and move them to the cloud Stay up to date on new tools, trends, and technologies What We’re Looking For: 7+ years in data architecture or related roles Solid hands-on experience with Azure data services and Snowflake Strong skills in data modeling , SQL , and ETL/ELT design More ❯

About the Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the … Infrastructure/AI Platform Lead Hybrid London office: minimum 3 days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python … A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or Azure environments Pragmatic More ❯

About the Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the … Infrastructure/AI Platform Lead Hybrid London office: minimum 3 days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python … A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or Azure environments Pragmatic More ❯

m working with a fast-growing global hospitality group that’s redefining modern travel. With several properties across key international cities and airports, they’re expanding quickly, and data is at the heart of their next stage of growth. They’re now hiring a Growth Analytics Manager to join their central commercial team in London. This is a … newly created position designed to modernise how the business uses data across marketing, digital, and revenue. You’ll sit at the intersection of revenue, marketing, and digital, translating data into insight that drives bookings, optimises campaigns, and informs commercial strategy. Your work will directly support senior leadership and shape data-driven decisions across multiple … markets. 🚀 Performance Analytics & Data Strategy This role combines strategic thinking with hands-on delivery. You’ll use data to identify opportunities, improve how we capture and model information, and help build scalable reporting frameworks that bring clarity to business performance. Working closely with the commercial and marketing teams, you’ll consolidate data from multiple More ❯