51 to 75 of 123 Data Ingestion Jobs in the UK excluding London

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply, email: or call … Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines and integrations within Palantir Foundry … ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows in Palantir Foundry Integrate diverse data sources, ensuring More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Snowflake Data Engineer Location: Central London office space by Mansion House/Cannon Street/Monument (EC4V) Transform lives through data and AI Who we are: We deliver powerful data and AI solutions that minimise operational costs, strengthen resilience against risk, and uncover revenue opportunities. Clients can retain expert teams to drive lasting adoption while futureproofing their … workforce with exceptional talent. Since 2016, more than 3,000 data & AI specialists have been created by removing systemic barriers to the tech industry. Work spans a broad range of industries, including financial services, insurance, asset management, pharmaceuticals, energy and natural resources, retail, healthcare, manufacturing, and mobility. As a preferred partner of today’s leading technology providers - such as … Databricks, Snowflake and Collibra - delivery is accelerated and revolutionary solutions are co-created. The lives of consultants, clients, and their customers are transformed through data and AI. The Role: We are seeking a Snowflake Data Engineer to lead the design, development and deployment of cloud data platforms and analytics solutions using Snowflake. This combines hands-on engineering More ❯

Job Title: Salesforce Marketing & Data Cloud Lead Location: Central London (Hybrid - 2-3 days onsite) Salary: £80,000- £90,000 (potentially a little higher for the right skillset) + 15% Bonus + Benefits Industry: Global Brand | Salesforce Greenfield Implementation About the Company Join a globally recognised brand embarking on one of the largest Salesforce greenfield implementations in the UK. … With a major investment in the Salesforce ecosystem - including Marketing Cloud, Data Cloud, Agentforce, Sales, Service,S Slack, Sustainability Cloud and Experience Cloud - this is a rare opportunity to shape the future of digital engagement for millions of customers across global markets. This is a high-impact, strategic role that will put you at the forefront of marketing innovation … and data transformation, working alongside top-tier talent in a collaborative, forward-thinking environment. The Role As the Salesforce Marketing & Data Cloud Lead, you will take ownership of the end-to-end architecture, design, and delivery of Salesforce Marketing Cloud, Data Cloud & Agentforce across the global Salesforce estate. You will play a key role in ensuring customer More ❯

Project Manager (Data Lakes projects) Our client is building a Data Lake in Azure needs an experienced Project Manager with a solid proven background in managing and running a databricks and data ingestion frameworks project. Must be experienced in dealing with difficult customers and hit the ground running. If you are an experience PM in running … large Data projects with Azure please get in touch for full details The role is full remote - YOU MUST LIVE IN THE UK as there may be the occasional site visits Contract until May 2026 could go on longer I will only reply to candidates who are Project Managers with databricks and data ingestion frameworks project experience More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

MI & Data Integration Analyst (Azure/Databricks) 📍 Hybrid – Central London | 💰 £43,000 pro rata | ⏳ 3-month FTC (potential to extend) We’re looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work — helping build robust data foundations and self-serve reporting capability for an evolving business area. 🔍 The Opportunity You’ll be supporting a small, forward-thinking team to improve how they use data — helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You’ll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. 💼 Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

Data Engineer | Health Tech | London - Dagster, dbt, BigQuery, LLMs They're using AI to automatically extract, categorise, and reconcile data from these scattered sources, turning chaos into actionable insights in the healthcare sector. What You'll Be Doing Working directly with the CTO, you'll own large parts of the data infrastructure: Building scalable data ingestion and processing systems for complex integrations. Taking problems from concept to production—making smart decisions. Designing ELT pipelines, working with unstructured data, and transforming raw data into customer-facing analytics Some data transformation and analysis work (no dedicated analyst yet) Contributing to product thinking and commercial goals—engineers here aren't siloed What They Need … z2bz0 years building production-grade data systems in fast-paced environments Solid experience with modern data stack (ELT pipelines, data warehouses, semantic layers, LLM integration) Strong SQL and comfortable with dbt for data transformation Product-minded —you care about outcomes, ask "why", and understand user context Self-directed with a bias for execution—you can scope More ❯

MI & Data Integration Analyst (Azure/Databricks) Hybrid - Central London | £43,000 pro rata | 3-month FTC (potential to extend) We're looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great opportunity for … someone who enjoys combining hands-on data analysis, reporting, and Azure integration work - helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity You'll be supporting a small, forward-thinking team to improve how they use data - helping them access accurate and timely MI, streamline processes, and migrate to … a new Azure-based data environment. You'll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. Develop and maintain data tables and More ❯

Go Backend Engineer (Data Platform & APIs) - Northern Ireland (Remote-first) * Salary: £75,000-£150,000 + bonus + benefits About the Company: Our client is scaling an ML-driven data and analytics platform and modernizing their engineering standards. Their current stack includes Python, GoLang, TensorFlow, PyTorch, AWS, and Kubernetes , with a focus on building scalable, ML-driven data … now with further expansion in 2026 and building a high-impact team in Northern Ireland. The Role: You'll build robust backend services in Go that power both the data platform (data lake, pipelines, model serving) and product-facing APIs . You'll collaborate with Data Science (leaders, DS, ML engineers, data engineers) to standardize tooling … clear ownership, modern cloud infrastructure, and working at the intersection of Go + ML platforms . What You'll Do: Platform & ML Enablement * Design and implement Go services for data ingestion, transformation, and orchestration on AWS & Kubernetes * Integrate with Python-based ML services (TensorFlow/PyTorch), enabling model training, evaluation, and real-time/batch inference * Help standardize More ❯

a few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering … to regulatory requirements (e.g., GDPR, HIPAA)Implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge And Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with Python and .NET Experience in implementing data … Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation Nice to have: Experience in implementing version control for data artifacts Expertise in data migration strategies Familiarity with machine learning integration Knowledge and More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked on LARGE … and SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … being said, we need DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details... Experience required: Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management: Demonstrated expertise More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

We are looking for Data Engineers suitable for a group of world-class investment and trading firms that are actively expanding their data engineering functions. Each environment is highly technical, research-driven, and deeply data-centric — offering the opportunity to work on systems and pipelines that directly influence investment decisions. These positions sit within core data teams, responsible for building and maintaining the infrastructure that underpins everything from quantitative research to real-time trading and analytics. You’ll work closely with developers, data scientists, and researchers to ensure clean, accurate, and reliable data is available across the business. This is a fantastic opportunity for early-career engineers (1–5 years’ experience) who want … to accelerate their development in an environment that values intellectual curiosity, technical depth, and end-to-end ownership. The Role Design, build, and optimise data pipelines and ETL processes that feed critical research and trading systems. Engineer scalable, automated solutions for data ingestion, cleaning, and validation across multiple structured and unstructured sources. Collaborate with researchers, technologists, and More ❯

Data Engineer £700/day outside IR35 3-month initial contract Remote working - occasional site visits Working with a leading financial services client who are looking for a Data Engineering Consultant. Looking for someone who can act independently and deliver complex data products - work with stakeholders to understand requirements, engineer and deliver products. Data Engineering Consultant … key responsibilities: Work cross-functionally with non-technical stakeholders to understand data requirements Expert knowledge of SQL to query, analysis and model data Experience with Snowflake Using DBT for data transforms and modelling Data ingestion using Python Build foundations for business functions to be able to access the correct data and insights Experience working More ❯

enhancing the organisation's Logging, Monitoring, and Alerting (LMA) capability, working on the design, maintenance, and optimisation of Elastic stacks and clusters. The role requires hands-on experience with data ingestion pipelines, performance tuning, and building effective visualisations from large data sets. Key Skills & Experience: 2+ years as an ELK SME (Elastic, Logstash, Kibana) Proven experience designing … managing, and tuning large Elastic clusters Strong skills in data ingestion pipelines and indexing best practices Knowledge of visualisation techniques in Elasticsearch Background in software development, infrastructure engineering, and operations Location: Edinburgh/Glasgow (on-site 2 days per week on average, flexibility required) This is a fantastic opportunity for a motivated, hands-on engineer to contribute to More ❯

tools, working closely with a multidisciplinary team What You'll Do: Maintain and improve our web API built with FastAPI, deployed on AWS.Collaborate on the product roadmap, focusing on data ingestion, UI enhancements, and exploring agentic AI capabilities.Develop innovative features to generate synthetic audiences based on existing data, demographics, and attitudes.Work alongside the team to ensure robust … testing, and deployment processes.Contribute to technical decisions around prompt engineering, RAG, and generative AI solutions.Document processes and support agile project management activities.Engage in developing features related to sentiment analysis, data ingestion, and synthetic audience creation. What We're Looking For: Proven experience building applications with Large Language Models (LLMs), including tool usage and information retrieval.Strong proficiency in Python More ❯

enable environmental impact assessments, economic modelling, and the integration of community preferences. The SME will be responsible for consolidating and migrating diverse spatial datasets into a unified system, ensuring data accuracy, quality, and accessibility, while supporting secure, role-based access, automation, and interoperability with internal and external systems. Your Responsibilities Platform Design & Implementation Architect and deploy a scalable ESRI … based GIS platform (ArcGIS Enterprise, ArcGIS Online, etc.). Define system architecture, data flows, and integration points with enterprise systems. Lead the migration and consolidation of spatial datasets from legacy systems. Spatial Analysis & Planning Develop spatial models for energy planning, environmental impact assessments, and economic forecasting. Integrate community feedback and preferences into spatial decision-making tools. Create interactive dashboards … and maps for stakeholder engagement. Data Management & Quality Assurance Establish data governance protocols for spatial data accuracy, completeness, and consistency. Implement ETL workflows using ArcGIS Data Interoperability tools or third-party solutions. Manage metadata standards and spatial data cataloging. Security & Access Control Configure role-based access controls and user permissions. Ensure compliance with data More ❯

as a group Assisting with the maintenance and iteration of a FastAPI-based web API hosted on AWS. Enhancing the existing product in line with the roadmap, focusing on data ingestion, UI updates (with a Fullstack Developer), and potential agentic features. Supporting the design and delivery of a new capability converting audience data and insights into conversational … design, testing strategies, and technical direction, including Generative AI solutions involving RAG and prompt engineering. Maintaining documentation and Agile project processes. Assisting with new feature development in sentiment analysis, data ingestion, and synthetic audience creation. As a member of the Disability Confident Scheme, Circle and our Client guarantees to interview all candidates who have a disability and who More ❯

wide array of complex projects across multiple industries. The Role: We are looking for a Software Engineer with a strong foundation in API development and C# to join our data engineering team in a highly regulated industry. In this role, you’ll be instrumental in designing and building scalable, secure software systems that support seamless data movement between … internal systems, third-party platforms, and cloud services. Your core focus will be developing and maintaining APIs and backend services that enable data ingestion, transformation, and delivery across our enterprise architecture. You’ll collaborate with cross-functional teams to ensure data is available where and when it’s needed—reliably, efficiently, and in compliance with strict regulatory … over 5 years of relevant experience, a solid understanding of software system design, and a strong command of C# and modern API development patterns. A background in working with data systems, cloud integrations, and secure, large-scale applications will be highly advantageous. Responsibilities: Design, develop, and maintain scalable APIs and backend services to facilitate data flow between systems. More ❯