1 to 25 of 89 Data Ingestion Jobs in the South East

Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the team optimize workflows and feature delivery. … You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will work closely with engineering teams to optimize data models, queries, flows, and work with McLaren Enterprise IT teams on capacity planning and management. Accountabilities and Responsibilities Partner with systems architects and leads to ensure optimized data flows between operational platforms Design and optimise data processing approaches for real-time analysis, enabling quick and effective decision-making. Design and guide the delivery of tools and platforms More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Data Analytics Engineer Permanent Basingstoke (Hybrid - x2 PW) Up to £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern tools such … as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want to make … a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and business stakeholders to build high-quality data More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading/Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed … team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data More ❯

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading/Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed … team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data More ❯

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading/Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed … team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data More ❯

Data Engineer £500 - £560 per day London - 1 day per week in office We're working with a leading global healthcare technology company who are building out their next-generation data platform, with a strong emphasis on automation, testing, and cloud-native engineering, and are looking for an experienced Data Engineer to join their team. The Role … You'll be part of a modern data engineering function that's implementing best-in-class data practices across ingestion, transformation, and orchestration layers. The environment is highly technical, collaborative, and fast-paced, giving you the opportunity to work across a wide variety of data sources and tools. Day-to-day responsibilities include: Designing and developing … DBT models and Airflow pipelines within a modern data stack. Building robust data ingestion pipelines across multiple sources - including external partners, internal platforms, and APIs. Implementing automated testing and CI/CD pipelines for data workflows. Performing data extraction and enrichment, including web scraping and parsing of unstructured text (e.g., scanned forms and documents). More ❯

About the Opportunity This is a rare opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … the football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere to … best practices for data quality, integrity, and security Integrate modern data engineering tools and technologies into cloud-native infrastructure Develop tools and solutions to support sports data modeling, analytics, and predictive insights Collaborate with data scientists, analysts, and performance experts to enable end-to-end data workflows Own the architecture and maintenance of a GCP More ❯

About the Opportunity This is a rare opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … the football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere to … best practices for data quality, integrity, and security Integrate modern data engineering tools and technologies into cloud-native infrastructure Develop tools and solutions to support sports data modeling, analytics, and predictive insights Collaborate with data scientists, analysts, and performance experts to enable end-to-end data workflows Own the architecture and maintenance of a GCP More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises platforms. … You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises platforms. … You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯