51 to 75 of 127 Data Ingestion Jobs in London

Project Manager (Data Lakes projects) Our client is building a Data Lake in Azure needs an experienced Project Manager with a solid proven background in managing and running a databricks and data ingestion frameworks project. Must be experienced in dealing with difficult customers and hit the ground running. If you are an experience PM in running … large Data projects with Azure please get in touch for full details The role is full remote - YOU MUST LIVE IN THE UK as there may be the occasional site visits Contract until May 2026 could go on longer I will only reply to candidates who are Project Managers with databricks and data ingestion frameworks project experience More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

Data Engineer | Health Tech | London - Dagster, dbt, BigQuery, LLMs They're using AI to automatically extract, categorise, and reconcile data from these scattered sources, turning chaos into actionable insights in the healthcare sector. What You'll Be Doing Working directly with the CTO, you'll own large parts of the data infrastructure: Building scalable data ingestion and processing systems for complex integrations. Taking problems from concept to production—making smart decisions. Designing ELT pipelines, working with unstructured data, and transforming raw data into customer-facing analytics Some data transformation and analysis work (no dedicated analyst yet) Contributing to product thinking and commercial goals—engineers here aren't siloed What They Need … z2bz0 years building production-grade data systems in fast-paced environments Solid experience with modern data stack (ELT pipelines, data warehouses, semantic layers, LLM integration) Strong SQL and comfortable with dbt for data transformation Product-minded —you care about outcomes, ask "why", and understand user context Self-directed with a bias for execution—you can scope More ❯

MI & Data Integration Analyst (Azure/Databricks) Hybrid - Central London | £43,000 pro rata | 3-month FTC (potential to extend) We're looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work - helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity You'll be supporting a small, forward-thinking team to improve how they use data - helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You'll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

a few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering … to regulatory requirements (e.g., GDPR, HIPAA)Implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge And Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with Python and .NET Experience in implementing data … Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation Nice to have: Experience in implementing version control for data artifacts Expertise in data migration strategies Familiarity with machine learning integration Knowledge and More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked on LARGE … and SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … being said, we need DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details Experience required: Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management:Demonstrated expertise More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked on LARGE … and SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … being said, we need DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details... Experience required: Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management: Demonstrated expertise More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

join our MarTech team at Aviva. In this role, youll take full ownership of building, managing, and optimising audiences within Adobe Experience Platform (AEP) using the real-time Customer Data Platform (rtCDP). Your work will enable personalised, data-driven experiences across paid media, website, app, and email channelsensuring the right message reaches the right customer at the … right time. This is a high-impact role suited to someone passionate about data-driven marketing and audience strategy. If you thrive in a fast-paced environment and enjoy blending technical capability with strategic thinking, wed love to hear from you. A bit about the job: This is a hands-on role where technical expertise meets marketing activation. Youll … digital channels. Collaboration will be key, as youll work closely with product and platform owners, go-to-market managers, and channel specialists to maximise the value of Avivas customer data and Adobe MarTech ecosystem. Youll be instrumental in managing customer profiles, identities, and the identity graph to maintain unified customer views. This includes overseeing data ingestion pipelinesEdge More ❯

tools, working closely with a multidisciplinary team What You'll Do: Maintain and improve our web API built with FastAPI, deployed on AWS.Collaborate on the product roadmap, focusing on data ingestion, UI enhancements, and exploring agentic AI capabilities.Develop innovative features to generate synthetic audiences based on existing data, demographics, and attitudes.Work alongside the team to ensure robust … testing, and deployment processes.Contribute to technical decisions around prompt engineering, RAG, and generative AI solutions.Document processes and support agile project management activities.Engage in developing features related to sentiment analysis, data ingestion, and synthetic audience creation. What We're Looking For: Proven experience building applications with Large Language Models (LLMs), including tool usage and information retrieval.Strong proficiency in Python More ❯

as a group Assisting with the maintenance and iteration of a FastAPI-based web API hosted on AWS. Enhancing the existing product in line with the roadmap, focusing on data ingestion, UI updates (with a Fullstack Developer), and potential agentic features. Supporting the design and delivery of a new capability converting audience data and insights into conversational … design, testing strategies, and technical direction, including Generative AI solutions involving RAG and prompt engineering. Maintaining documentation and Agile project processes. Assisting with new feature development in sentiment analysis, data ingestion, and synthetic audience creation. As a member of the Disability Confident Scheme, Circle and our Client guarantees to interview all candidates who have a disability and who More ❯

AI/Data Developer - Contract - SC Cleared - £500 - £600pd (Outside of IR35) - Hybrid working Our client, a leading deep-tech organisation, is seeking an experienced AI/Data Developer for an urgent contract assignment. Key Requirements: Proven background in AI and data development Strong proficiency in Python , including data-focused libraries such as Pandas, NumPy, and … PySpark Hands-on experience with Apache Spark (PySpark preferred) Solid understanding of data management and processing pipelines Experience in algorithm development and graph data structures is advantageous Active SC Clearance is mandatory Role Overview: You will play a key role in developing and delivering advanced AI solutions for a Government client . Responsibilities include: Designing, building, and maintaining … data processing pipelines using Apache Spark Implementing ETL/ELT workflows for large-scale data sets Developing and optimising Python-based data ingestion tools Collaborating on the design and deployment of machine learning models Ensuring data quality, integrity, and performance across distributed systems Contributing to data architecture and storage strategy design Working with cloud More ❯

days onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … support advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into production … ready systems . Develop and maintain end-to-end ML pipelines for data ingestion, training, testing, and deployment. Optimise model performance, scalability, and reliability using MLOps best practices. Work with large-scale structured and unstructured datasets for model training and validation. Implement model monitoring, versioning, and retraining processes to ensure continuous improvement. Collaborate cross-functionally with engineering, data More ❯

days onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … support advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into production … ready systems . Develop and maintain end-to-end ML pipelines for data ingestion, training, testing, and deployment. Optimise model performance, scalability, and reliability using MLOps best practices. Work with large-scale structured and unstructured datasets for model training and validation. Implement model monitoring, versioning, and retraining processes to ensure continuous improvement. Collaborate cross-functionally with engineering, data More ❯

days onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … support advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into production … ready systems . Develop and maintain end-to-end ML pipelines for data ingestion, training, testing, and deployment. Optimise model performance, scalability, and reliability using MLOps best practices. Work with large-scale structured and unstructured datasets for model training and validation. Implement model monitoring, versioning, and retraining processes to ensure continuous improvement. Collaborate cross-functionally with engineering, data More ❯

days onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … support advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into production … ready systems . Develop and maintain end-to-end ML pipelines for data ingestion, training, testing, and deployment. Optimise model performance, scalability, and reliability using MLOps best practices. Work with large-scale structured and unstructured datasets for model training and validation. Implement model monitoring, versioning, and retraining processes to ensure continuous improvement. Collaborate cross-functionally with engineering, data More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯