1 to 25 of 45 Data Ingestion Jobs in London

Title: Data Engineering Manager Job Type: Full Time, Permanent Location: London, Hybrid (3 days in the office a week) Role Purpose At Travelex we are developing modern data technology and data products. Data is central to the way we define and sell our foreign currency exchange … products. Our relationship with our customers is deeply data-driven. The data engineering manager ( DEM ) owns the design and delivery of all data flows to and from our data platform, underpinning crucial data products. The DEM is responsible for a significant transformation Travelex is going ...

Description We are seeking an experienced Technical Architect to support the design and evolution of large-scale, cloud-based data platforms across, working across our portfolio of clients. The Technical Architect will play a key role in shaping solution design patterns, ensuring alignment with established standards, and supporting … strategic transition and migrations across/to/from AWS & Azure. Key Responsibilities Define and evolve technical architecture patterns for data ingestion, processing, and access. Design scalable, resilient, and cost-efficient data solutions within a Hub and Spoke model. Support the design of new data ingestion ...

Data Manager - Strategic Delivery & Governance Lead 12 month fixed term contract Overview This is a senior data leadership role responsible for owning and delivering a multi year data warehouse and reporting transformation, working through external vendors and delivery partners. Key Responsibilities * Lead delivery of an organisation wide … data and reporting transformation, including the introduction of a cloud based data warehouse * Own the relationship with outsourced data warehouse, engineering and hosting partners, holding vendors accountable for delivery, quality and outcomes * Translate business needs into clear data requirements, roadmaps and priorities, and articulate technical concepts ...

Data Architect Charity/Not for Profit Sector | £65,000£75,000 (12 mth FTC) | London (Hybrid) Our client is a charitable organisation with a clear mission and a growing ambition to put data at the heart of how it operates. Theyre looking for a hands-on Data Architect to take ownership of their data function at a pivotal moment in its development. This is a hands-on leadership position. Youll be responsible for the end-to-end data capability from governance frameworks and quality controls through to the architecture and delivery of our data ...

Data Architect – Charity/Not for Profit Sector | £65,000–£ mth FTC) | London (Hybrid) Our client is a charitable organisation with a clear mission and a growing ambition to put data at the heart of how it operates. They are looking for a hands-on Data Architect … take ownership of their data function at a pivotal moment in its development. This is a hands-on leadership position. You’ll be responsible for the end-to-end data capability — from governance frameworks and quality controls through to the architecture and delivery of our data warehouse ...

.No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which … team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. ...

Overview: We are working with a leading UK-based wealth and investment management firm seeking a skilled Data Engineer to support the build and evolution of their modern data platform. This role will focus on developing scalable data pipelines and contributing to a cloud-native lakehouse architecture. … Responsibilities: Design, build, and maintain robust data pipelines using Azure-based services Develop and optimize data workflows within Databricks Implement and manage data ingestion processes, including real-time streaming with Kafka Structure and maintain data across bronze, silver, and gold layers within a lakehouse architecture ...

Responsibilities Programme Delivery Lead delivery across multiple workstreams including platform, data ingestion, modelling, and reporting Manage an outsourced delivery partner across scope, timelines, budget, and quality Track KPIs, milestones, and governance forums (e.g. SteerCo, Design Authority) Proactively manage risks, issues, and interdependencies Data Architecture Define, implement … govern the target data architecture (platforms, data models, integrations) Ensure alignment with enterprise architecture and strategic objectives Review and challenge vendor designs to ensure quality and scalability Drive best practices across: Data modelling Data pipelines Storage (lakehouse/warehouse) Metadata, lineage, and data quality Operating ...

Role Summary Aubay is seeking a Principal Data Engineer to join a leading energy client’s team who will conceptualize and design data foundations and end-to-end solutions, including data platforms, to maximize value from data. The role promotes a data-driven culture across … teams and wider business stakeholders, acting as a subject matter expert and thought partner in defining the vision and data strategy for robust, future-ready IT solutions. Required skills and experience Strong proficiency with cloud platforms: AWS, Azure, SAP Expertise in ELT development and automation with scalable pipeline design ...

Cleared Technical Architect – Data Platforms Truenorth are currently working with a leading technology consultancy on a Technical Architect (Data Platforms) opportunity, supporting the design and evolution of large-scale, cloud-based data platforms across a range of high-impact programmes. This role is ideal for someone … enjoys shaping architecture, working across complex environments, and driving modern data platform solutions end-to-end. Key details: • Salary: £65,000 – £85,000 • Location: Hybrid – London or Manchester hubs • Permanent or FTC options available • Active SC Clearance required (must already hold this - you will be required to evidence your ...

working with a leading global financial institution seeking a Lead Java engineer to help drive the development of a large scale, low latency market data platform. This role sits within a high impact data/tech function responsible for delivering real time and historical data to trading … quant teams. You will play a key role in shaping the architecture and evolution of a central data platform that underpins front office decision making. Key Responsibilities Lead the design and development of a large scale market data ingestion platform Build and optimise low latency data ...

Title: Data Engineer – Azure Data Platform Location : London (Hybrid) Our client is hiring a Data Engineer to help build and scale enterprise-grade data solutions on the Microsoft Azure platform. This role involves delivering reliable, high-performance data pipelines that support analytics and business operations. … Responsibilities: Design and develop ETL/ELT pipelines within Azure Build scalable solutions for data ingestion, transformation, and integration Ensure data quality, reliability, and performance Collaborate with cross-functional teams to deliver data-driven solutions Drive automation and optimization of data workflows Requirements: Experience ...

Data Warehouse/Database Engineer (Postgres/Netezza) Location: London, UK (Hybrid/2-3 Days Onsite required) Contract Type: FTC- 6 months Expereince needed 6-8 years Role Overview The Data Warehouse/Database Engineer will design, build, and support the data layer required to transition … reporting from Remedy to ServiceNow , enabling Business Objects to consume clean, performant, and reconciled datasets. The role focuses on bulk data ingestion, SQL development, schema design, and data validation , supporting a temporary dual dataset architecture across Remedy and ServiceNow. Key Responsibilities Design and implement data warehouse ...

DATA ENGINEER £90,000 LONDON/MANCHESTER Our client is looking for a Data Engineer to join a fast-growing adtech scale-up tackling real-time data problems at serious scale. This is a role for someone who enjoys ownership, impact, and working close to Data Science on systems that directly influence business outcomes. You'll be helping to shape the data foundations behind large-scale machine learning and fraud prevention. THE COMPANY A fast-growing SaaS business building technology to help advertisers improve performance and reduce wasted spend. The platform uses real-time ...

Azure Data Engineer (Contract – Day Rate) - Mid-Level | Azure | Data Lakehouse | ETL Location: Central London Day Rate: £375 - 425 per day (Outside IR35) Working Patterns: Hybrid, London Interviews: 2 stage processOpus are supporting a global insurance organisation seeking an Azure Data Engineering contractor to join its core … function on a day-rate basis. This role is part of a wider data platform capability build and offers the opportunity to bring a fresh, pragmatic perspective into an established Azure environment.The team is currently top-heavy and are deliberately looking to strengthen the mid-level layer - someone highly ...

Senior Data Engineer £70,000-£90,000 London (Hybrid) This is an exciting opportunity to join a growing tech scale-up where data is at the heart of their product. You will play a key role in shaping their data infrastructure, enabling large-scale machine learning … performance through advanced analytics, real-time behavioural insights and machine learning. With a collaborative engineering culture and strong investment backing, they are building scalable data systems to support rapid product expansion. THE ROLE As a Data Engineer you will take ownership of the company's core data ...

client is seeking a Business Analyst to join their FinOps product team, a newly created role sitting at the intersection of finance, operations and data engineering. Responsibilities: Gather and translate international business requirements into clear technical specifications and user stories for the FinOps product team Write and maintain … queries to extract, analyse and validate data across financial and operational databases Support data pipelines including bordereaux ingestion, data transformation and downstream reporting Provide hands-on technical product support, triaging issues and investigating data discrepancies Define acceptance criteria, lead UAT and validate delivered functionality against ...

Senior Data Engineer (Tick data, Time-Series; kdb+/Q ) 3-6 months initially. London 3 days onsite Are you a Data Engineer with a background in systematic trading who has worked with granular tick market data? Have you built pipelines to allow tick data … tech stack utilising kdb+ and Q? If so keep reading! Certain Advantage are recruiting on behalf of our London based trading client for a Data Engineer to focus on building a scalable data platform for algorithmic trading. Youll Identify and implement solutions for Quants and Traders, providing data ...

long term solo individual contributor role, within 12–18 months, you will grow into leading a team of 4–6 engineers across backend, data architecture, DevOps, and product engineering. What You'll Do Engineering & Architecture Design and build scalable, secure backend services and APIs for clinical AI inference … data processing Own cloud infrastructure (AWS), deployment pipelines, monitoring, and security controls Collaborate with the AI research team to deploy and serve machine learning models in production Establish engineering best practices across code review, testing, CI/CD, and documentation Data Architecture & Integration Design and maintain the data ...

Senior Data Engineer London (Hybrid Working) Full-time | Permanent £80,000 - £90,000 (depending on experience) About the Company: Viqu Energy is working with a fast-growing tech company building solutions at the forefront of the energy transition. As the grid shifts toward renewables, their platform helps optimise … collaborative, inclusive team solving complex problems in a fast-paced, high-impact environment. About the Role: We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure behind the company's platform. Data is central to their work, from power market analytics ...

Role In this role, you will define the architectural blueprint and technology foundations for AI driven solutions that transform how customers in dynamic, data intensive industries operate, scale, and innovate. You will design robust, future ready AI architectures that enable automation, advanced analytics, and intelligent decision making across complex … digital transformation programmes. With access to cutting edge AI frameworks, high performance computing environments, and modern data platforms, you will guide engineering and data science teams in building secure, scalable, and ethical AI systems. This role empowers you to shape end to end AI ecosystems-accelerating delivery, enhancing ...

Points Lead Data Engineer position Property Managing AI Solution – Start Up For a Technical Leader who enjoys building products with a passion for AI innovation Career path into a CTO role About The Company Seed funded AI solution for Property Management sector End to end automation removing all administrative … tasks for commercial and residential property businesses London HQ About the Role Architect and build scalable data pipelines and infrastructure to support AI and product systems. Design and maintain data ingestion, transformation, and storage architectures for operational and AI workloads. Develop and manage batch and real-time ...

components, defining reference architectures, and guiding development teams through POCs to production-scale implementations. The role has a strong open-source, distributed systems, and data architecture focus, with frequent CIO-level technical interactions. Your Responsibilities Architecture & Blueprint Design Define end-to-end architecture blueprints covering: OTEL collectors and agents … OPAM agents Kafka-based data ingestion pipelines Time-series and telemetry data storage layers Create reference architectures, patterns, and guardrails. Solution Design & POC Leadership Design and review major solution components for scalability, resilience, and performance. Lead tool selection and POC execution, validating architectural choices. Guide teams from ...

Data Engineer up to £90,000 + Benefits London (Hybrid) This is a great opportunity to join a high-growth adtech scale-up where you can take ownership of large-scale data infrastructure that directly powers machine learning, product intelligence, and customer ROI. THE COMPANY This … machine learning and real-time behavioural analytics to help brands optimise performance. THE ROLE Key responsibilities include: Designing, building, and maintaining batch and streaming data ingestion pipelines for high-volume event data Improving and optimising the AWS Redshift data warehouse, including modelling, performance, and cost efficiency ...

Metris, we’re on a mission to maximise every kWh of renewable capacity. Our platform delivers real-time data and automates time-consuming tasks involved in renewable operations — monitoring, fault detection, reporting, and billing. We’ve reached early product-market fit with MetrisOS deployed to 20 customers … management interface on the market. It’s a central command centre for operators of renewables, combining project documents, workflows, AI assistants, and live project data in one environment. This is the future strategy of the company, and it’s what you’ll be building. We’re a small, fast ...