26 to 50 of 85 Data Ingestion Jobs in the South East

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis - Hybrid working - London based Looking for a highly skilled Data Engineer to join our growing data platform team. You will be responsible for designing, building, and optimising large-scale data pipelines and services that power analytics … reporting, and data-driven decision-making across the business. This role is heavily cloud-focused (AWS) and requires strong expertise in Python, Spark, and relational databases. Role Design, build, and maintain scalable, reliable, and high-performance data pipelines and workflows. Develop clean, maintainable, and testable code in Python for data ingestion, transformation, and processing. Optimise and … fine-tune query performance on Aurora Postgres and other relational databases. Architect and manage data solutions on AWS using serverless technologies such as Lambda, Glue, Glue Data Catalog, EMR serverless, and API Gateway. Implement and manage large-scale data processing with Spark (Iceberg tables in S3, Gold layer in Aurora Postgres). Collaborate with data scientists More ❯

seeking to recruit a DataOps Enginer on an initial 6 month contract based in London. It is hybrid and will require 2/3x days onsite per week. A Data Ops Engineer is a highly technical individual contributor, building modern, cloud-native, DevOps-first systems for standardizing and templatizing biomedical and scientific data engineering, with demonstrable experience across … the following areas:?? They are a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure and DevOps, data/metadata/knowledge platforms, and AI/ML and analysis platforms, all geared toward: - Building a next-generation, metadata- and automation-driven data experience for scientists, engineers, and decision-makers, increasing productivity and reducing time … spent on "data mechanics"- Providing best-in-class AI/ML and data analysis environments to accelerate our predictive capabilities and attract top-tier talent- Aggressively engineering our data at scale, as one unified asset, to unlock the value of our unique collection of data and predictions in real-timeAutomation of end-to-end data More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Graduate Data Engineer 📍 London (2 days in office, hybrid) | 💼 Full-time | 🎓 0–2 Years’ Experience Are you an aspiring Data Engineer eager to turn raw financial data into clean, structured, and scalable systems? We’re looking for a curious and motivated Graduate Data Engineer to join a hybrid-working team building cutting-edge data infrastructure … for the financial sector. You’ll spend 2 days a week in the office working directly with the Senior Data Engineer , and the rest working remotely — giving you the best of both worlds. You’ll be working on a platform that transforms diverse datasets into actionable insights — learning how to design ETL pipelines, manage cloud-based data systems … and deploy solutions that scale. In this role, you’ll help build, test, and maintain the pipelines and systems that power real-world applications. From data ingestion and transformation to monitoring and optimisation, you’ll gain hands-on experience across the full data engineering lifecycle — while contributing to a product used by clients in the financial industry. More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply, email: or call … Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines and integrations within Palantir Foundry … ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows in Palantir Foundry Integrate diverse data sources, ensuring More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Job Title: Salesforce Marketing & Data Cloud Lead Location: Central London (Hybrid - 2-3 days onsite) Salary: £80,000- £90,000 (potentially a little higher for the right skillset) + 15% Bonus + Benefits Industry: Global Brand | Salesforce Greenfield Implementation About the Company Join a globally recognised brand embarking on one of the largest Salesforce greenfield implementations in the UK. … With a major investment in the Salesforce ecosystem - including Marketing Cloud, Data Cloud, Agentforce, Sales, Service,S Slack, Sustainability Cloud and Experience Cloud - this is a rare opportunity to shape the future of digital engagement for millions of customers across global markets. This is a high-impact, strategic role that will put you at the forefront of marketing innovation … and data transformation, working alongside top-tier talent in a collaborative, forward-thinking environment. The Role As the Salesforce Marketing & Data Cloud Lead, you will take ownership of the end-to-end architecture, design, and delivery of Salesforce Marketing Cloud, Data Cloud & Agentforce across the global Salesforce estate. You will play a key role in ensuring customer More ❯

Project Manager (Data Lakes projects) Our client is building a Data Lake in Azure needs an experienced Project Manager with a solid proven background in managing and running a databricks and data ingestion frameworks project. Must be experienced in dealing with difficult customers and hit the ground running. If you are an experience PM in running … large Data projects with Azure please get in touch for full details The role is full remote - YOU MUST LIVE IN THE UK as there may be the occasional site visits Contract until May 2026 could go on longer I will only reply to candidates who are Project Managers with databricks and data ingestion frameworks project experience More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

Data Engineer | Health Tech | London - Dagster, dbt, BigQuery, LLMs They're using AI to automatically extract, categorise, and reconcile data from these scattered sources, turning chaos into actionable insights in the healthcare sector. What You'll Be Doing Working directly with the CTO, you'll own large parts of the data infrastructure: Building scalable data ingestion and processing systems for complex integrations. Taking problems from concept to production—making smart decisions. Designing ELT pipelines, working with unstructured data, and transforming raw data into customer-facing analytics Some data transformation and analysis work (no dedicated analyst yet) Contributing to product thinking and commercial goals—engineers here aren't siloed What They Need … z2bz0 years building production-grade data systems in fast-paced environments Solid experience with modern data stack (ELT pipelines, data warehouses, semantic layers, LLM integration) Strong SQL and comfortable with dbt for data transformation Product-minded —you care about outcomes, ask "why", and understand user context Self-directed with a bias for execution—you can scope More ❯

MI & Data Integration Analyst (Azure/Databricks) Hybrid - Central London | £43,000 pro rata | 3-month FTC (potential to extend) We're looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work - helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity You'll be supporting a small, forward-thinking team to improve how they use data - helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You'll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

a few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering … to regulatory requirements (e.g., GDPR, HIPAA)Implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge And Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with Python and .NET Experience in implementing data … Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation Nice to have: Experience in implementing version control for data artifacts Expertise in data migration strategies Familiarity with machine learning integration Knowledge and More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked on LARGE … and SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … being said, we need DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details... Experience required: Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management: Demonstrated expertise More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

tools, working closely with a multidisciplinary team What You'll Do: Maintain and improve our web API built with FastAPI, deployed on AWS.Collaborate on the product roadmap, focusing on data ingestion, UI enhancements, and exploring agentic AI capabilities.Develop innovative features to generate synthetic audiences based on existing data, demographics, and attitudes.Work alongside the team to ensure robust … testing, and deployment processes.Contribute to technical decisions around prompt engineering, RAG, and generative AI solutions.Document processes and support agile project management activities.Engage in developing features related to sentiment analysis, data ingestion, and synthetic audience creation. What We're Looking For: Proven experience building applications with Large Language Models (LLMs), including tool usage and information retrieval.Strong proficiency in Python More ❯

enable environmental impact assessments, economic modelling, and the integration of community preferences. The SME will be responsible for consolidating and migrating diverse spatial datasets into a unified system, ensuring data accuracy, quality, and accessibility, while supporting secure, role-based access, automation, and interoperability with internal and external systems. Your Responsibilities Platform Design & Implementation Architect and deploy a scalable ESRI … based GIS platform (ArcGIS Enterprise, ArcGIS Online, etc.). Define system architecture, data flows, and integration points with enterprise systems. Lead the migration and consolidation of spatial datasets from legacy systems. Spatial Analysis & Planning Develop spatial models for energy planning, environmental impact assessments, and economic forecasting. Integrate community feedback and preferences into spatial decision-making tools. Create interactive dashboards … and maps for stakeholder engagement. Data Management & Quality Assurance Establish data governance protocols for spatial data accuracy, completeness, and consistency. Implement ETL workflows using ArcGIS Data Interoperability tools or third-party solutions. Manage metadata standards and spatial data cataloging. Security & Access Control Configure role-based access controls and user permissions. Ensure compliance with data More ❯

as a group Assisting with the maintenance and iteration of a FastAPI-based web API hosted on AWS. Enhancing the existing product in line with the roadmap, focusing on data ingestion, UI updates (with a Fullstack Developer), and potential agentic features. Supporting the design and delivery of a new capability converting audience data and insights into conversational … design, testing strategies, and technical direction, including Generative AI solutions involving RAG and prompt engineering. Maintaining documentation and Agile project processes. Assisting with new feature development in sentiment analysis, data ingestion, and synthetic audience creation. As a member of the Disability Confident Scheme, Circle and our Client guarantees to interview all candidates who have a disability and who More ❯

wide array of complex projects across multiple industries. The Role: We are looking for a Software Engineer with a strong foundation in API development and C# to join our data engineering team in a highly regulated industry. In this role, you’ll be instrumental in designing and building scalable, secure software systems that support seamless data movement between … internal systems, third-party platforms, and cloud services. Your core focus will be developing and maintaining APIs and backend services that enable data ingestion, transformation, and delivery across our enterprise architecture. You’ll collaborate with cross-functional teams to ensure data is available where and when it’s needed—reliably, efficiently, and in compliance with strict regulatory … over 5 years of relevant experience, a solid understanding of software system design, and a strong command of C# and modern API development patterns. A background in working with data systems, cloud integrations, and secure, large-scale applications will be highly advantageous. Responsibilities: Design, develop, and maintain scalable APIs and backend services to facilitate data flow between systems. More ❯