251 to 275 of 872 Data Pipeline Jobs in London

Lead Data Scientist - Regulatory Scanning Initiative This is a unique opportunity to lead a high-impact team, mentor junior talent, and drive innovation in a fast-growing company. You'll work alongside industry experts, collaborate with cross-functional teams, and have the freedom to explore new technologies and methodologies. At Vixio, we're on a mission to revolutionize … how businesses manage regulatory obligations through cutting-edge RegTech solutions combined with our human expertise. Join us as our Lead Data Scientist and play a pivotal role in shaping the future of regulatory intelligence. About the role: As our Lead Data Scientist , you will play a pivotal role in shaping and delivering data-driven … solutions that power our regulatory scanning, analytics, and generative AI capabilities. You'll take ownership of complex data science problems end-to-end, from framing business challenges with stakeholders, to deploying production-ready solutions. We're looking for someone who thrives in fast-moving environments, takes initiative, and delivers measurable results. Working closely with the Head of Regulatory More ❯

Datadog, Miro, Webflow, and Facebook. Role Overview Synthesia is building a modern, AI-powered back office. We are hiring a full-stack engineer to design and run the data layer that powers Finance ensuring data from finance systems land securely in a data warehouse and is easily consumed via Copilot (LLM) and Omni dashboards. … ll be a cornerstone in our shift to modern finance workflows. Key Responsibilities Design, develop, and maintain robust ETL/ELT pipelines to ingest, transform, and securely store data from NetSuite and other finance systems into Snowflake, ensuring data integrity, compliance, and security best practices (e.g., encryption, access controls, and auditing). Collaborate with finance and … data teams to define data models, schemas, and governance policies that support modern finance workflows, including automated reporting, forecasting, and anomaly detection. Implement data retrieval mechanisms optimized for LLM-based querying via Co-pilot and/or similar tools, enabling natural language access to financial data while maintaining accuracy and contextual relevance. More ❯

Python Development - Strong proficiency in Python programming including object-oriented design, asynchronous programming, error handling, and writing clean, maintainable code. Experience with key libraries including Pandas, NumPy for data manipulation, requests and APIs for integrations, asyncio for concurrent processing, and building robust automation scripts with proper logging, testing (pytest), and documentation. AI & Machine Learning Frameworks - Deep expertise in … powered automation solutions that leverage natural language understanding. Appian BPA Platform - Strong experience with Appian low-code platform including process modelling, interface design, expression rules, integration objects, and data modelling. Skilled in building end-to-end business process applications, configuring workflows, implementing business rules, managing records, and integrating Appian with external systems via REST APIs, web services, and … system integration. Ability to assess when RPA vs. API integration vs. AI solutions are most appropriate, and experience building hybrid automation solutions combining multiple technologies. Data Engineering & Pipeline Development - Strong skills in building data pipelines for AI/automation solutions including data extraction, transformation, and loading (ETL). Experience with SQL databases (SQL More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is … a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and … timely MI, streamline processes, and migrate to a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is … a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and … timely MI, streamline processes, and migrate to a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ up to 6-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is … a great opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and … timely MI, streamline processes, and migrate to a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business More ❯

Analytics Engineer | £60-75K | London (5 days/week on-site) | Permanent Bridge the gap between data engineering and analytics A major logistics company is undergoing a full rebuild of its legacy, siloed data estate - and we're hiring an experienced Analytics Engineer to help drive the transformation. You'll join a newly formed data team under a new Head of Data, working on a clean-slate Azure-based platform. The role bridges data engineering and analytics, focused on building scalable data models, automated pipelines, and enabling self-serve analytics across the organisation. What you'll be doing: Build and maintain scalable data pipelines using … Azure Data Factory and Databricks Develop transformation workflows in dbt, SQL, and Python Design dimensional models and semantic layers to support analytics use cases Implement automated data quality checks, monitoring, and alerting systems - linking issues to business impact Create reusable data assets and documentation to support self-serve analytics via Power BI Work with More ❯

Analytics Engineer London (onsite) | Full-Time, Permanent We're on an exciting data transformation journey and are looking for a skilled Analytics Engineer to join our growing data team. In this role, you'll help design and implement scalable, high-performance data infrastructure using the modern data stack, including Azure Databricks , Azure … Data Factory , dbt , SQL , Python , and Power BI . You'll act as the bridge between data engineering and analytics-building robust data models, automated pipelines, and self-service tools that drive decision-making across the business. This is a hands-on technical role with real impact. You'll collaborate with engineers, analysts, and … stakeholders to deliver clean, trusted, and accessible data. Key Responsibilities: Develop and maintain data pipelines using Databricks and ADF Create dimensional models and transformation workflows using dbt Implement automated data quality checks and monitoring systems Empower business users through self-service analytics using Power BI Document technical processes and uphold coding standards Collaborate with cross-functional More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and … Millennium. They combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands … in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We're seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. In this role, you'll architect and maintain robust, scalable data pipelines and infrastructure that power our analytics, machine learning, and business intelligence initiatives. You'll work with cutting-edge technologies like Python, PySpark, AWS EMR, and … Snowflake, and collaborate across teams to ensure data is clean, reliable, and actionable. Responsibilities: - Build and maintain scalable ETL pipelines using Python and PySpark to support data ingestion, transformation, and integration - Develop and optimize distributed data workflows on AWS EMR for high-performance processing of large datasets - Design, implement, and tune Snowflake data … datasets - Ensure data integrity, consistency, and accuracy across multiple sources and systems - Automate data workflows and processes to improve efficiency and reduce manual intervention - Monitor pipeline performance, identify bottlenecks, and resolve issues proactively - Apply best practices in CI/CD, version control (e.g., Git), and infrastructure-as-code (e.g., Terraform, CloudFormation) - Enforce data More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining the roadmap, proposing scalable Azure-native solutions, and collaborating with the … Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining the roadmap, proposing scalable Azure-native solutions, and collaborating with the … Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining the roadmap, proposing scalable Azure-native solutions, and collaborating with the … Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining the roadmap, proposing scalable Azure-native solutions, and collaborating with the … Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure Data Factory, applying robust transformation logic, validation, and lineage tracking More ❯

KDB Developer - Cross-Asset Data Engineering | Global Investment Bank | London We're partnering with a leading global investment bank that's building out a new Cross-Asset Data Engineering and Analytics function. This team sits at the heart of the bank's efforts to consolidate data across asset classes and drive AI-powered trading … insights and Alpha research. The Role You'll work within a high-performing engineering team developing a cross-asset data and analytics platform covering FX, Rates, Credit, and Equities. The platform underpins the bank's Front Office tools, data capture, and market data intelligence capabilities. You'll collaborate closely with quants, data scientists, and traders to design and deliver solutions that improve data quality, accessibility, and analytical capability across the business. Key Responsibilities Design, develop, and maintain high-performance KDB/q solutions. Work with Python to integrate and extend the data platform. Engineer scalable data pipelines across multiple asset classes. Partner with trading More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯