1 to 25 of 130 Data Ingestion Jobs in London

Role: Technical Data Architect Location: UK (remote is fine, candidate must be in UK and available for any IMP meeting) Contract: 3 months (will likelyextend) Data Feed Factory - for Telco Network Function Expectations on the role : Hands on Experience on design & architecture of the Data Platform, Technical components and Data Engg. related activities for supporting the … key capabilities Technical Data Architecture Data Ingestion framework ( Batch/Micro Batch processing ) Data Contract & Data management( including DQ, metadata & lineage) Delivery, Scaling & Op Model Discovery/assessment along with the Data platform requirements Identify and document the relevant data sources to be used for collection & ingestion, cataloging, defining Data management. … This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/technical requirements for More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot … and optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000-£100,000 Sector: Fintech We're looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who began their career as … a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You'll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines and models that support decision-making across … the business. This is a hands-on, collaborative role, suited to someone who's confident communicating with data, product, and engineering teams, not a 'heads-down coder' type. Top 4 Core Skills Python - workflow automation, data processing, and ETL/ELT development. Snowflake - scalable data architecture, performance optimisation, and governance. SQL - expert-level query writing and optimisation More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to consider … candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design, development, implementation and … support. Projects typically span data ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more. This role would be well-suited to a Data Engineer looking to take More ❯

Job Title: Data Quality Analyst Location: London (2 days per week on-site at Liverpool Street) Contract: 6 months (via umbrella) Rate: Competitive Are you passionate about driving data accuracy and integrity in a fast-paced financial services environment? This is a fantastic opportunity to join a leading international bank at the forefront of data-led transformation. … You'll be part of a growing Data Office that is shaping strategy, governance, and innovation across EMEA - making a real impact from day one. The Role As a Data Quality Analyst, you will play a pivotal role in ensuring the accuracy, completeness, and integrity of data across AML and Sanctions screening platforms. You will work closely … with Financial Crime, Data Governance, Technology, and Risk teams to design and embed effective data quality controls, strengthen governance, and support regulatory compliance. This role offers the chance to directly contribute to critical transformation programmes within financial crime compliance. Key Responsibilities Design, build, and monitor Data Quality Rules within Collibra Data Quality (CDQ) for AML and More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Are you an experienced Data Engineer looking for your next big challenge? Do you have a passion for football? Why not bring the two together? This is a unique opportunity to work at the cutting edge of AI, data technology, and elite football analytics. As a Data Engineer, you’ll join a collaborative, high-performing team with … a culture rooted in creativity, innovation, and excellence. In this role, you’ll design and develop scalable data pipelines and infrastructure that power decision-making across every area of the club — from strategy, tactics, recruitment, and performance, to pre- and post-match analysis. You'll also play a key role in supporting the club’s commercial operations, including e … commerce and fan engagement. If you're passionate about using advanced data engineering to drive real-world impact in sport, this is the role for you. Key Responsibilities Architect, design and build scalable and high-performance data pipelines Ensure all systems adhere to best practices for data quality, integrity, and security Integrate modern data engineering tools More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs … Monitor, troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills … with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control More ❯

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading/Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed … team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data More ❯

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading/Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed … team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data More ❯

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading/Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed … team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data More ❯

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading/Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed … team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data More ❯