26 to 50 of 303 Data Ingestion Jobs in London

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

280+ Employees - We have over 280 passionate employees transforming the industry across the Group, one home at a time The Role We're seeking a motivated and detail orientated Data Engineer with experience in building and managing scalable data pipelines and infrastructure. You'll be responsible for developing robust ETL/ELT processes, optimising and maintaining data warehouse, and ensuring data quality and standards through comprehensive monitoring and governance. Collaborating closely with our Data, Tech and Product teams, you'll help shape and support our data strategy. The ideal candidate should have familiarity in SQL and cloud-based data solutions, be driven towards automated solutions and thrives in transforming complex data infrastructure into streamlined, reliable, and actionable assets. Responsibilities: Own Data Infrastructure : Design, develop, and maintain scalable data pipelines and infrastructure to enable reliable analytics and data-driven decisions. ETL/ELT Development : Build, optimise, and manage ETL processes in BigQuery and associated tools to ensure timely and accurate data ingestion. Data Warehousing : Maintain and More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … mentor, and grow an AI/ML team as we scale beyond our seed round. ⸻ Key Responsibilities Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (eg, deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … and grow an AI/ML team as we scale beyond our seed round. Key Responsibilities 1. Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (eg, neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud … availability inference. 2. Strategic Leadership Develop a multi-quarter AI roadmap aligned with product milestones and fundraising milestones. Identify and evaluate opportunities for AI-driven competitive advantages (eg, proprietary data, unique model architectures, transfer/few-shot learning). Collaborate with business stakeholders to translate big problems into technically feasible AI solutions. 3. Data & Infrastructure Oversee the creation More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

LBANK, Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering … tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data quality monitoring processes. Optimising database performance by … tuning queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying opportunities for process improvements and tool enhancements. Establishing and enforcing More ❯

Join to apply for the Data Engineer (Databricks) role at Pantheon Continue with Google Continue with Google Join to apply for the Data Engineer (Databricks) role at Pantheon Pantheon has been at the forefront of private markets investing for more than 40 years, earning a reputation for providing innovative solutions covering the full lifecycle of investments, from primary … to build secure financial futures. For further details please visit www.pantheon.com Purpose of Position Pantheon is undergoing a multi-year programme to build out a new best in class Data Platform using cloud native technologies hosted in Azure. We require an experienced and passionate hands-on Senior Data Engineer to design and implement new data pipelines for … adaption to business and/or technology changes. This role will be integral to the success of this programme and establishing Pantheon as a data-centric organisation. You will be working with a modern Azure tech stack and proven experience of ingesting and transforming data from a variety of internal and external systems is core to the role. More ❯

to continue to direct the firm's day-to-day operations. Purpose of Position Pantheon is undergoing a multi-year programme to build out a new best in class Data Platform using cloud native technologies hosted in Azure. We require an experienced and passionate hands-on Senior Data Engineer to design and implement new data pipelines for … adaption to business and/or technology changes. This role will be integral to the success of this programme and establishing Pantheon as a data-centric organisation. You will be working with a modern Azure tech stack and proven experience of ingesting and transforming data from a variety of internal and external systems is core to the role. … Responsibilities Pantheon require a highly capable, enthusiastic and experienced individual to join our team who will design and implement development activities to build out a new best in class Data Warehouse in cloud native Azure technology. The Data Engineer will design and execute development activities across projects ensuring that the software produced is written in a standard, maintainable More ❯

a global open economy that works for everyone. We exist behind the scenes, securely connecting companies - from growth to enterprise - to thousands of banks worldwide, enabling them to access data and initiate payments through the power of open banking. What we’re looking for As a Java Software Engineer focused on Data Products at Yapily, you will play … a key role in designing and implementing our next-generation data systems. You’ll be responsible for developing high-performance data pipelines, billing infrastructure and APIs that power our suite of products – including Reports API, Analytics API and Insights API – ensuring data is reliably processed and securely delivered to our customers. Develop & Optimize Data Pipelines: Design … build, and maintain scalable data ingestion and processing systems to transform raw data into actionable insights. Billing Infrastructure: Build and maintain a reliable billing architecture within an event driven environment. Data Products: Design, develop, and maintain APIs that deliver a seamless data experience for our customers. Database Management: Work with both SQL and NoSQL databases More ❯

Social network you want to login/join with: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting … development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets Capable of working closely with … the business and delivering complex requirements to tight timescales Strong interest in latest data engineering technologies, best practices, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting the Head of Data and Analytics and the wider business More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the front … office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to the development of … automation solutions to streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions Engaging directly More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the front … office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to the development of … automation solutions to streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions Engaging directly More ❯

to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric’s suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric’s suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

a part of a team that continually strives to do right by our community and users. We’re constantly innovating to raise the bar of engine and game development. DATA ENGINEERING What We Do Our mission is to provide a world-class platform that empowers the business to leverage data that will enhance, monitor, and support our products. … We are responsible for data ingestion systems, processing pipelines, and various data stores all operating in the cloud. We operate at a petabyte scale, and support near real-time use cases as well as more traditional batch approaches. What You'll Do You will be responsible for designing, building, and maintaining our data infrastructure to ensure … the reliability and efficiency of our data and systems used by our Machine Learning team. Your role will include creating and maintaining data pipelines that transform and load data from various products and managing the AWS infrastructure for our machine learning platform. Additionally, you will work with engineers, product managers, and data scientists to design and More ❯

for online retail. For over 10 years, we've been pioneering privacy-safe, full-funnel marketing measurement, empowering all teams to make smarter decisions Our platform unites Finance, Marketing, Data, and Leadership with a shared view of performance and profitability—combining full-funnel measurement, forecasting, and optimization. With Fospha, every team moves faster and grows smarter. Trusted by over … build, mentor, and lead our Business Intelligence team. The ideal candidate will be a strategic thinker with a strong analytical background, proven leadership abilities, and a passion for leveraging data to drive business decisions. This is an exciting opportunity to shape our BI capabilities from the ground up, fostering a data-driven culture and developing a high-performing … expertise—comfortable leading architecture and tooling decisions, while also rolling up your sleeves to build, optimize, and troubleshoot BI solutions when necessary. Responsibilities: Define and implement best practices for data analysis, reporting, and data governance. Conduct in-depth analysis to identify actionable trends, patterns, and insights. Lead initiatives to enhance BI capabilities and internal reporting standards. Develop and More ❯

doing what is right and a loyal and growing community who advocate for us. As an Analytics Engineer at Monica Vinader , you’ll play a vital role in using data and technology to drive efficiency, scale, and elevate the customer experience. We're on a mission to empower every team through data-driven decision-making - and you’ll … be at the heart of that transformation. From building and optimising systems, to solving complex problems and ensuring data quality, your work will unlock commercial value and power key business initiatives across the company. What You’ll Do Data Platform & Infrastructure: Architect, build, and maintain scalable and performant ELT pipelines and infrastructure using tools like GCP, BigQuery, dbt … third-party ingestion. Lead data ingestion and transformation from a wide range of first and third-party systems (e.g., GA4, Bloomreach CDP, our Inventory and Finance platforms) ensuring consistent, reliable data access. Collaborate with developers and other members of the data team to continuously improve data systems, reducing tech debt, increasing automation, and improving observability More ❯

solutions through an agile framework. Our Technology team is responsible for: Software Development Infrastructure DevOps and Automation Service Delivery Project Management Brief Role Objective: As a member of the Data Development team, you will be responsible for developing ways to consolidate, analyse, and present our data to support the operations and future growth of our business. In this … role you will be involved in a wide variety of high-profile business facing initiatives from developing data extracts and PowerBI reports to optimising the data warehouse to deliver data more quickly to the business each day. You will work with the Lead Data Engineer and other members of the Data Engineering team to deliver … our new strategic enterprise data platform based on Snowflake and DBT, while also maintaining our legacy data platform. Key Responsibilities: Data warehouse design and implementation working towards the creation of a single source of truth. Development of data ingestion/transformation pipelines using Fivetran, DBT and Gitlab. Creation of management information dashboards. Work with business More ❯

About the Role The Data Engineer plays a key role in shaping and delivering Global Switch’s modern data platform, enabling insights and analytics across a global data centre organisation. Reporting to the Head of Data, this role is central to the development and optimisation of scalable data pipelines and solutions within Microsoft Fabric, supporting … the company’s transformation into a data-driven enterprise. This is an exciting opportunity for a technically skilled and business-savvy professional who thrives on building data products that empower decision-making. You’ll work closely with cross-functional teams to understand stakeholder needs and deliver high-quality, cloud-native data solutions that drive value across the … organisation. Key Responsibilities Design, develop, and maintain scalable data pipelines within the Modern Data Platform. Collaborate with business and technical teams to gather requirements and translate them into effective data products. Implement robust data models and ensure data integrity, performance, and reliability. Develop and optimise batch and real-time ETL processes from diverse data More ❯

About the Role The Data Engineer plays a key role in shaping and delivering Global Switch’s modern data platform, enabling insights and analytics across a global data centre organisation. Reporting to the Head of Data, this role is central to the development and optimisation of scalable data pipelines and solutions within Microsoft Fabric, supporting … the company’s transformation into a data-driven enterprise. This is an exciting opportunity for a technically skilled and business-savvy professional who thrives on building data products that empower decision-making. You’ll work closely with cross-functional teams to understand stakeholder needs and deliver high-quality, cloud-native data solutions that drive value across the … organisation. Key Responsibilities Design, develop, and maintain scalable data pipelines within the Modern Data Platform. Collaborate with business and technical teams to gather requirements and translate them into effective data products. Implement robust data models and ensure data integrity, performance, and reliability. Develop and optimise batch and real-time ETL processes from diverse data More ❯

Social network you want to login/join with: Data Engineer - Leading Multi-Strategy Hedge Fund - London, london col-narrow-left Client: Location: london, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 26.06.2025 Expiry Date: 10.08.2025 col-wide Job Description: My client, a leading multi-strategy hedge fund, is seeking … a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the front-office investment team through the delivery of data solutions … enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to the development of automation solutions to streamline key workflows. You’ll also be More ❯