1 to 25 of 113 Data Ingestion Jobs in the UK excluding London

Role: Technical Data Architect Location: UK (remote is fine, candidate must be in UK and available for any IMP meeting) Contract: 3 months (will likelyextend) Data Feed Factory - for Telco Network Function Expectations on the role : Hands on Experience on design & architecture of the Data Platform, Technical components and Data Engg. related activities for supporting the … key capabilities Technical Data Architecture Data Ingestion framework ( Batch/Micro Batch processing ) Data Contract & Data management( including DQ, metadata & lineage) Delivery, Scaling & Op Model Discovery/assessment along with the Data platform requirements Identify and document the relevant data sources to be used for collection & ingestion, cataloging, defining Data management. … This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/technical requirements for More ❯

Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the team optimize workflows and feature delivery. … You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will work closely with engineering teams to optimize data models, queries, flows, and work with McLaren Enterprise IT teams on capacity planning and management. Accountabilities and Responsibilities Partner with systems architects and leads to ensure optimized data flows between operational platforms Design and optimise data processing approaches for real-time analysis, enabling quick and effective decision-making. Design and guide the delivery of tools and platforms More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

TLA, we're proud to be consumer champions in the automotive space. We're constantly exploring smarter ways to connect people with the right cars - and that's where data engineering plays a key role. You'll join a focused data team of 4 professionals (2 Data Scientists, 1 BI Developer, and yourself as Data Engineer … working collaboratively to deliver high-impact data solutions. As part of the team, you'll create data pipelines to extract diverse datasets from vehicle stock volumes to customer reviews and offers data in a timely, robust and efficient manner. We understand that great data forms the backbone of great data analysis, and as such the … data engineer is crucial to the success of the data department overall. TLA works with the modern data stack, utilising Snowflake for our data warehouse, dbt to transform data across our medallion architecture, and Apache Airflow for orchestration. Microsoft Azure is our choice of cloud provider for hosting infrastructure. Within the role you will be More ❯

IT services company is hiring for a Contract Data Architect to work in Telford for 2 days per week. This is a 6-month Contract with a likely extension, paying between £540 - £570 per day InsideIR35. Due to the nature of the role, you will need to hold active SC Clearance. We are seeking an experienced Data Architect … to join a critical government project. This role supports the development of a robust data platform to combat fraud. You will be embedded in a newly formed Scrum team on the Minerva Platform, contributing to the ingestion data within the SAS Platform, including IDP (Intelligent Data Platform) Responsibilities: - Design, develop, and maintain data architecture models … aligned with enterprise standards. - Support the ingestion and integration of data using the SAS platform. - Lead the upgrade, decommissioning, and archiving of data in accordance with data policies. - Collaborate with multidisciplinary teams to translate business problems into effective data solutions. - Maintain data dictionaries and metadata repositories to ensure information remains accurate and compliant. - Provide More ❯

IT services company is hiring for a Contract Data Architect to work in Telford for 2 days per week. This is a 6-month Contract with a likely extension, paying between 540 - 570 per day InsideIR35. Due to the nature of the role, you will need to hold active SC Clearance. We are seeking an experienced Data Architect … to join a critical government project. This role supports the development of a robust data platform to combat fraud. You will be embedded in a newly formed Scrum team on the Minerva Platform, contributing to the ingestion data within the SAS Platform, including IDP (Intelligent Data Platform) Responsibilities: - Design, develop, and maintain data architecture models … aligned with enterprise standards. - Support the ingestion and integration of data using the SAS platform. - Lead the upgrade, decommissioning, and archiving of data in accordance with data policies. - Collaborate with multidisciplinary teams to translate business problems into effective data solutions. - Maintain data dictionaries and metadata repositories to ensure information remains accurate and compliant. - Provide More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Overview Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire Head of Data Management Capital One is seeking a collaborative and driven Data Management leader, who is passionate about providing the organisation with well governed data that is easy to discover, understand and use. As the Head of Data Management, you will lead a team of Data Stewards and Data Management professionals to ensure the organisation is managing its data effectively. This role reports to the Head of Data. What you'll do Lead and develop a team of 12, responsible for the Stewardship and Governance of data across Capital One UK, fostering an open and high performing culture Create an ecosystem where … all data is discoverable, high quality and easy to use, in support of data driven decision making across the organisation Develop comprehensive data quality frameworks with clear metrics and success criteria Understand and drive adherence to regulatory and Enterprise policy requirements Demonstrate strong data risk awareness, and work with accountable executives and the data protection More ❯

such as Mulesoft Expertise in Integration patterns involving files(using FTP, SFTP, MoveIT), MQ, CDC, Message Bus, Hub & Spoke, Pub/Sub Experience in implementation of Security standards for Data in Transit & Rest such as TLS/SSL, Data Encryption Knowledge in MQ & AMQ concepts such as RabbitMQ & Oracle MQ Expertise Knowledge in Data Management workflow & integration … such as Data Lake, ETL , Data Ingestion, Sharding, Data Stream, Data Catalogue, Data Cleansing, Data Analytics, Batch, Scheduling Implementation knowledge on principles such as ACID, SOLID, OWASP Knowledge on UK GDPR, PII, PCI-DSS data standards Implementation of designs related to Batch processing patterns involving Talend, Databricks, Snowflake or similar Experience of … running GDPR related projects involving Data Sourcing, Validations, Integration, Data Disposition, Auditing & Reporting Ability to treat Data as an Asset and Architect & provide Solutions aligned to it • Strong working knowledge in Java 8+ with Clean Architecture, Mockito, Java Spring, Spring Boot, Spring Batch, Apache Camel needs to possess an expert depth and breadth of knowledge regarding multiple More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

Data Engineer - Azure Databricks , Apache Kafka Permanent Basingstoke (Hybrid - x2 PW) Circa £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern … tools such as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want … to make a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and business stakeholders to build high-quality More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

the private and public sectors. Driven by innovation and quality, they combine strategic thinking with deep technical capability to deliver transformational technology solutions. How youll spend your day Building data pipelines using Azure data factory for data ingestion Looking after the data integration, data conformity, data integrity and ensure the data structures … are designed for future business needs and enhancements Ensure that data transformations are well recorded and follow best practices so that it is easily understood by developers and analysts Work directly with the business to support various projects and solutions Using problem solving skills as challenges arise Process mining to scope and deliver solutions that meet agreed User Stories … clients and with strong communication skills Strong business-to-technology translation skills for identifying ways to apply solutions to help customers improve performance Strong verbal and written communication Azure Data Factory/Data Lakes/Databricks SQL server experience (SSIS, SSMS) Experience with Data Warehouse solutions Desirable but not essential Python is also desirable Understanding of Azure More ❯

Data Analytics Engineer Permanent Basingstoke (Hybrid - x2 PW) Up to £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern tools such … as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want to make … a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and business stakeholders to build high-quality data More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯