1 to 25 of 210 Permanent Data Ingestion Jobs in the UK excluding London

Description We are seeking an experienced Data Architect to join our Group Technology team in Milton Keynes. You will help realise the value of the immense Connells Group dataset for the benefit of customers, colleagues and the overall business. You will use your expertise to define, evolve and communicate … existing enterprise data architecture, to democratise safe access to data to help engineering teams create personal, relevant and timely customer experiences. The data architecture will also support colleagues in accessing data, getting insights and providing next best actions for faster and aligned decision making, both tactically ...

Data Engineer (Inside IR35) £425 Per day SC Cleared - A must to be considered for this opportunity London To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple … systems with inconsistent formats and limited automation. A Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery. Key Responsibilities Design, build, and maintain scalable data pipelines to ingest, transform ...

Data Engineer [Associate/Senior Associate] About the job We are looking to expand our Data Engineering team to build modern, scalable data platforms for our internal investment desks and portfolio companies. You will contribute to the firm's objectives by delivering rapid and reliable data solutions that unlock value for Cerberus desks, portfolio companies, and other businesses. You'll do this by designing and implementing robust data architectures, pipelines, and workflows that enable advanced analytics and AI applications. You may also support initiatives such as due diligence and pricing analyses by ensuring high ...

Title: Data Architect-Technical Job Location: London, UK Job Type: Contract The primary responsibilities are: • Hands on Experience on design & architecture of the Data Platform, Technical components, and Data Engg. related activities for supporting the key capabilities o Technical Data Architecture o Data Ingestion framework ( Batch/Micro Batch processing ) o Data Contract & Data management( including DQ, metadata & lineage) o Delivery, Scaling & Op Model • Discovery/assessment along with the Data platform requirements o Identify and document the relevant data sources to be used for collection & ingestion, cataloging ...

Lead Data Engineer (AWS Snowflake Python) London/WFH to £110k Are you a technologist Data Engineer with strong technical leadership skills? You could be progressing your career in an impactful, hands-on Lead Data Engineer role at a growing technology company as they expand their … presence. As a Lead Data Engineer you'll take responsibility for the team's engineering practices such as code reviews and CI/CD and for overall code quality and test coverage. You'll plan and manage the team's Sprints, collaborating closely with product and engineering management ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver ...

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence initiatives. … enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions, and turn unstructured data into valuable business assets. Key Responsibilities: Building and scaling data pipelines, analytical infrastructure, and dashboard solutions that power customer success insights across multiple ...

Contract Data Architect Greenfield Data Platform Outside IR35 | £600-£675 per day Initial 6 months | Start January Hybrid - Manchester (1-2 days per week on site) Overview This is a great piece of work with a supply chain management consultancy who are building a greenfield data platform … from scratch. Following a recent business split, data preparation is currently manual, and spreadsheet driven. The goal is to design a scalable, cloud-based platform to ingest, standardise, and enrich client data, initially for internal use and later as the foundation for client facing products. This ...

Senior Data Engineer Job Title: Senior Data Engineer Salary Range: £80,000–£100,000 Location/Working model: London | Hybrid This is a critical technical position within a high-growth, forward-thinking organization that specializes in digital innovation. We require an experienced Senior Data Engineer to design … organization's operational and analytical success. Core Responsibilities The successful candidate will own the technical development and strategic execution of the core data platform, ensuring high quality, performance, and security: System Architecture & Development: Lead the design, development, and maintenance of scalable, high-performance, real-time data pipelines ...

seeking an experienced Database Administrator to manage PostgreSQL, Greenplum or Snowflake databases. The role includes administration, performance tuning, backup and recovery, automation, and supporting data ingestion and integration pipelines. Focus areas: Snowflake DBA – data lakes, architecture, roles, schemas, and databases. Greenplum/Postgres DBA – database maintenance, migrations … performance optimisation. Responsibilities Administer and maintain PostgreSQL, Greenplum, and Snowflake databases Design and manage Snowflake data structures, roles, schemas, and databases Build and manage data ingestion pipelines (Informatica, Talend) Manage data from multiple sources (JSON, XML, CSV) Implement Patroni for HADR and streaming replication Perform database ...

seeking an experienced Database Administrator to manage PostgreSQL, Greenplum or Snowflake databases. The role includes administration, performance tuning, backup and recovery, automation, and supporting data ingestion and integration pipelines. Focus areas: Snowflake DBA – data lakes, architecture, roles, schemas, and databases. Greenplum/Postgres DBA – database maintenance, migrations … performance optimisation. Responsibilities Administer and maintain PostgreSQL, Greenplum, and Snowflake databases Design and manage Snowflake data structures, roles, schemas, and databases Build and manage data ingestion pipelines (Informatica, Talend) Manage data from multiple sources (JSON, XML, CSV) Implement Patroni for HADR and streaming replication Perform database ...

seeking an experienced Database Administrator to manage PostgreSQL, Greenplum or Snowflake databases. The role includes administration, performance tuning, backup and recovery, automation, and supporting data ingestion and integration pipelines. Focus areas: Snowflake DBA – data lakes, architecture, roles, schemas, and databases. Greenplum/Postgres DBA – database maintenance, migrations … performance optimisation. Responsibilities Administer and maintain PostgreSQL, Greenplum, and Snowflake databases Design and manage Snowflake data structures, roles, schemas, and databases Build and manage data ingestion pipelines (Informatica, Talend) Manage data from multiple sources (JSON, XML, CSV) Implement Patroni for HADR and streaming replication Perform database ...

Data Engineer | Swindon (1 day per month in office) | Permanent | Up to £50,000 p.a Peaple Talent have partnered with an exciting client in Swindon looking to recruit for a Data Engineer. This is working for a meaningful client who are on an exciting data journey, joining … small team and the opportunity to up-skill in Microsoft Fabric and Dynamics 365. Key Responsibilities: Create and operate end-to-end data platforms across both cloud and local environments, using the Microsoft ecosystem to deliver resilient, future-ready solutions. Data inputs include enterprise systems such as Dynamics ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

Role Senior Market data analyst Position Contract 12 months extendable Location London Hybrid Rates Good Day Rates My client a leading Investment bank are looking for a seasoned Market Data SME to act as there go-to authority for all aspects of market data ingestion, management … vendor relationships, licensing, and data governance. The successful candidate will work across trading, quant, risk, operations, and technology teams to ensure high-quality, reliable and compliant market data coverage across asset classes (e.g. equities, fixed income, FX, derivatives, commodities, as relevant). Role ...

Senior Data Engineer Remote first (occasional travel to office) Salary: up to £95,000 I'm partnered with a fast-scaling retailer who are looking to bring a Senior Data Engineer into their team. With over 40M+ global users and rapid year-on-year growth, this organisation … investing heavily in data to power smarter decisions, richer insights, and long-term product innovation. You'll work closely with internal teams to design, build, and optimise data models and ingestion pipelines, contributing to a new data lake and a robust gold-layer architecture. ...

Power BI/Analytics Engineer (Data & Reporting) Overview We’re looking for an experienced Power BI-focused analytics engineer to take ownership of a growing reporting and data environment. This role sits at the intersection of business intelligence, data modelling, and light data engineering , with responsibility … turning complex data into trusted, high-impact insights used across the organisation. You’ll work on an established data platform that is continuing to evolve, with the opportunity to influence tooling, standards, and the future direction of analytics — including the adoption of Microsoft Fabric . What ...

partnering with a globally respected multi-strategy investment firm seeking a senior-level engineer to take ownership of the next generation of its market data platforms. This role calls for someone who blends deep Python engineering capability with strong object-oriented design instincts, and who understands how to ingest … structure, and optimise vast, granular financial datasets. You'll play a central role in shaping large-scale tick-data architecture - building pipelines, improving data-lake structures, and refining storage formats to support demanding research and trading workflows... Key Responsibilities Architect, build, and refine high-throughput pipelines capable ...

Consultant Location: Reading, UK (Hybrid) Company: Coeo Ltd Department: Consulting Services Reports to: Head of Technical Delivery About Us Coeo is a Microsoft-exclusive Data & AI consultancy with deep expertise across the Microsoft data ecosystem. We help organizations solve challenges using data strategy, engineering, AI, analytics, visualization … experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling ...

Consultant Location: Reading, UK (Hybrid) Company: Coeo Ltd Department: Consulting Services Reports to: Head of Technical Delivery About Us Coeo is a Microsoft-exclusive Data & AI consultancy with deep expertise across the Microsoft data ecosystem. We help organizations solve challenges using data strategy, engineering, AI, analytics, visualization … experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling ...

Senior Data Engineer Bristol 12-Month Contract Paying up to £79p/h (Outside IR35) Role Overview: Our client, a large Aerospace company, is looking for an experienced Senior Data Engineer to assist with building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana … Apache NiFi Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance ...

Senior Data Engineer Bristol 12-Month Contract Paying up to £79p/h (Outside IR35) Role Overview: Our client, a large Aerospace company, is looking for an experienced Senior Data Engineer to assist with building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana … Apache NiFi Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance ...

Founding Data Engineer Holborn, London (Hybrid: 2-3 days onsite per week) £75,000-£80,000 + meaningful equity A newly formed tech startup in London is hiring its first Founding Data Engineer to build greenfield data infrastructure and shape the foundation of a predictive analytics product … genuine influence, autonomy, and the opportunity to build something from the ground up alongside experienced founders. The role You will: Build production-ready, pythonic data pipelines Create data models to organise raw behavioural data Support feature engineering for machine learning workflows Handle ETL processes and data ...

Senior Data Engineer | £80,000 | Hybrid & Remote Flexibility No Sponsorship Available I am currently partnering with an innovative technology company that is simplifying complex processes through cutting-edge data solutions. They are seeking a Senior Data Engineer to join their agile, collaborative team, where hybrid working … flexible schedules are the norm. The Role: As a Senior Data Engineer, you will be instrumental in evolving the company's data infrastructure, driving reliability, scalability, and insight. This is an end-to-end hands-on role where you will: Enhance the stability and performance of the data ...

Position: AWS Data Engineer Position type: Permanent (Onsite) Location: Ipswich, UK Job Description: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . … candidate will work closely with data architects, business analysts, and cross-functional teams to build scalable and efficient data solutions supporting network analytics, customer insights, billing systems, and telecom OSS/BSS workflows. Key Responsibilities 1. Data Engineering & ETL Development Design, develop, and maintain ETL/ ...