51 to 75 of 182 Data Ingestion Jobs in England

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

Test Engineer Data Platforms (FTC-6months Hybrid | London or Manchester) My client is looking for an experienced Test Engineer to take ownership of testing across modern data platforms. This is a hands-on role where you’ll design, implement, and execute test strategies for data pipelines, models, and reporting solutions built on Azure technologies. Key Responsibilities Define … and own the overall testing strategy for data pipelines, data models, and BI solutions. Develop and implement automated testing frameworks integrated with CI/CD pipelines. Design and execute test cases across data ingestion, transformation, storage, and presentation layers. Validate data accuracy, performance, and usability within Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Power BI. Establish and monitor data quality checks, reconciliation, and compliance processes. Collaborate closely with data engineers, BI developers, architects, and product owners to embed testing best practices across delivery. Essential Skills & Experience Proven experience as a Test Engineer within data engineering or analytics environments. Strong knowledge of Azure data services – Databricks More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis - Hybrid working - London based Looking for a highly skilled Data Engineer to join our growing data platform team. You will be responsible for designing, building, and optimising large-scale data pipelines and services that power analytics … reporting, and data-driven decision-making across the business. This role is heavily cloud-focused (AWS) and requires strong expertise in Python, Spark, and relational databases. Role Design, build, and maintain scalable, reliable, and high-performance data pipelines and workflows. Develop clean, maintainable, and testable code in Python for data ingestion, transformation, and processing. Optimise and … fine-tune query performance on Aurora Postgres and other relational databases. Architect and manage data solutions on AWS using serverless technologies such as Lambda, Glue, Glue Data Catalog, EMR serverless, and API Gateway. Implement and manage large-scale data processing with Spark (Iceberg tables in S3, Gold layer in Aurora Postgres). Collaborate with data scientists More ❯

we are hiring for Technical Data Architect location: Central London Type : Permanent Hybrid role (2-3 days from client location) We are seeking a highly skilled TechnicalData Architect- with expertise in Databricks, PySpark, and modern data engineering practices. The ideal candidate will lead the design, development, and optimization of scalable data pipelines, while ensuring data accuracy … platform. This role requires strong leadership, technical depth, and the ability to collaborate with cross-functional teams. ________________________________________ Key Responsibilities Lead the design, development, and maintenance of scalable, high-performance data pipelines on Databricks. Architect and implement data ingestion, transformation, and integration workflows using PySpark, SQL, and Delta Lake. Guide the team in migrating legacy ETL processes to … modern cloud-based data pipelines. Ensure data accuracy, schema consistency, row counts, and KPIs during migration and transformation. Collaborate with Data engineer , BI Engineers, and Security teams to define data standards, governance, and compliance. Optimize Spark jobs and Databricks clusters for performance and cost efficiency. Support real-time and batch data processing for downstream systems More ❯

seeking to recruit a DataOps Enginer on an initial 6 month contract based in London. It is hybrid and will require 2/3x days onsite per week. A Data Ops Engineer is a highly technical individual contributor, building modern, cloud-native, DevOps-first systems for standardizing and templatizing biomedical and scientific data engineering, with demonstrable experience across … the following areas:?? They are a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure and DevOps, data/metadata/knowledge platforms, and AI/ML and analysis platforms, all geared toward: - Building a next-generation, metadata- and automation-driven data experience for scientists, engineers, and decision-makers, increasing productivity and reducing time … spent on "data mechanics"- Providing best-in-class AI/ML and data analysis environments to accelerate our predictive capabilities and attract top-tier talent- Aggressively engineering our data at scale, as one unified asset, to unlock the value of our unique collection of data and predictions in real-timeAutomation of end-to-end data More ❯

seeking to recruit a DataOps Enginer on an initial 6 month contract based in London. It is hybrid and will require 2/3x days onsite per week. A Data Ops Engineer is a highly technical individual contributor, building modern, cloud-native, DevOps-first systems for standardizing and templatizing biomedical and scientific data engineering, with demonstrable experience across … the following areas: They are a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure and DevOps, data/metadata/knowledge platforms, and AI/ML and analysis platforms, all geared toward: - Building a next-generation, metadata- and automation-driven data experience for scientists, engineers, and decision-makers, increasing productivity and reducing time … spent on "data mechanics" - Providing best-in-class AI/ML and data analysis environments to accelerate our predictive capabilities and attract top-tier talent - Aggressively engineering our data at scale, as one unified asset, to unlock the value of our unique collection of data and predictions in real-time Automation of end-to-end data More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply, email: or call … Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines and integrations within Palantir Foundry … ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows in Palantir Foundry Integrate diverse data sources, ensuring More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Job Title: Salesforce Marketing & Data Cloud Lead Location: Central London (Hybrid - 2-3 days onsite) Salary: £80,000- £90,000 (potentially a little higher for the right skillset) + 15% Bonus + Benefits Industry: Global Brand | Salesforce Greenfield Implementation About the Company Join a globally recognised brand embarking on one of the largest Salesforce greenfield implementations in the UK. … With a major investment in the Salesforce ecosystem - including Marketing Cloud, Data Cloud, Agentforce, Sales, Service,S Slack, Sustainability Cloud and Experience Cloud - this is a rare opportunity to shape the future of digital engagement for millions of customers across global markets. This is a high-impact, strategic role that will put you at the forefront of marketing innovation … and data transformation, working alongside top-tier talent in a collaborative, forward-thinking environment. The Role As the Salesforce Marketing & Data Cloud Lead, you will take ownership of the end-to-end architecture, design, and delivery of Salesforce Marketing Cloud, Data Cloud & Agentforce across the global Salesforce estate. You will play a key role in ensuring customer More ❯

Job Title: Salesforce Marketing & Data Cloud Lead Location: Central London (Hybrid - 2-3 days onsite) Salary: £80,000- £90,000 (potentially a little higher for the right skillset) + 15% Bonus + Benefits Industry: Global Brand | Salesforce Greenfield Implementation About the Company Join a globally recognised brand embarking on one of the largest Salesforce greenfield implementations in the UK. … With a major investment in the Salesforce ecosystem - including Marketing Cloud, Data Cloud, Agentforce, Sales, Service,S Slack, Sustainability Cloud and Experience Cloud - this is a rare opportunity to shape the future of digital engagement for millions of customers across global markets. This is a high-impact, strategic role that will put you at the forefront of marketing innovation … and data transformation, working alongside top-tier talent in a collaborative, forward-thinking environment. The Role As the Salesforce Marketing & Data Cloud Lead, you will take ownership of the end-to-end architecture, design, and delivery of Salesforce Marketing Cloud, Data Cloud & Agentforce across the global Salesforce estate. You will play a key role in ensuring customer More ❯

Requirements Proven track record owning product strategy and roadmap in an early-stage startup, ideally pre-PMF and in a B2B SaaS environment , (Desirable) Good understanding of data ingestion workflows, third-party integrations, and APIs, including schema mapping, data quality, latency, and reliability considerations , Experience with data-heavy products where value depends on ingesting, harmonising, and … activating customer data , Ability to translate messy real-world data and customer workflows into product capabilities that drive measurable outcomes , Strong understanding of data ingestion workflows, third-party integrations, and APIs, including schema mapping, data quality, latency, and reliability considerations , Direct experience with customer discovery, pilots, and commercial collaboration in resource-constrained environments , Commercial fluency … the product roadmap and prioritisation, deciding what ships and in what order , Translate the vision into clear, actionable requirements for an intelligence platform that ingests, harmonises, and activates customer data , Define success metrics for experiments, pilots, and features, with a focus on measurable cost and time savings for customers , Define minimum viable scope and quality bars for releases, balancing More ❯

Project Manager (Data Lakes projects) Our client is building a Data Lake in Azure needs an experienced Project Manager with a solid proven background in managing and running a databricks and data ingestion frameworks project. Must be experienced in dealing with difficult customers and hit the ground running. If you are an experience PM in running … large Data projects with Azure please get in touch for full details The role is full remote - YOU MUST LIVE IN THE UK as there may be the occasional site visits Contract until May 2026 could go on longer I will only reply to candidates who are Project Managers with databricks and data ingestion frameworks project experience More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯