1 to 25 of 45 Data Ingestion Jobs in London

Head of Data – London – Messy Data/Web Crawlers/Data Aggregation High Growth B2B SaaS | AI & Machine Learning Platform £90,000 – £100,000 + Significant Equity I am working with a scaling London based technology business where Machine Learning and AI sit at the core … platform is built around a large-scale dataset created by crawling the web and collecting millions of listings from multiple external sources. That raw data is then structured, matched and analysed to power a suite of SaaS tools used across the market. One of the core technical challenges ...

Data Architect (MDM Focus) Salary: Up to £90,000 + Bonus + Benefits Location: Central London - Onsite Working Hours: 40 hours per week - Full time A globally established organisation is seeking a Data Architect to join a large-scale enterprise data transformation programme. This role will focus … design and delivery of Master Data Management solutions, supporting the creation of high-quality, governed and scalable master data assets across the organisation. This is a hands-on architectural role suited to an experienced data professional with strong Informatica expertise who can define data models, establish ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … market. We pride ourselves on fostering a culture of excellence, collaboration, and support, enabling our team members to thrive! Job Purpose Are you a data enthusiast ready to take on an exciting challenge? As a Data Engineer, you will design, build, and operate our internal data platform ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … market. We pride ourselves on fostering a culture of excellence, collaboration, and support, enabling our team members to thrive! Job Purpose Are you a data enthusiast ready to take on an exciting challenge? As a Data Engineer, you will design, build, and operate our internal data platform ...

Tech Lead - Data Analytics & Data Engineering (AWS) - Central Government (Contract) Duration: 1 April 2026 - 30 November 2026 Rate: Up to £600 per day IR35 Status: Outside IR35 Location: Hybrid/Client site as required Clearance: SC and NPPV3 (both essential) Sector: UK Central Government We are seeking … experienced Tech Lead - Data Analytics & Data Engineering to support a central government programme delivering secure, scalable AWS-based data platforms within a highly regulated environment. This engagement is Outside IR35 , operating on a project-based delivery model with a clear focus on outcomes rather than headcount substitution. ...

ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such … team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. ...

Senior Data Engineer - Role Overview We are seeking a Senior Data Engineer to support the development and evolution of a scalable data platform underpinning private equity investment activity across EMEA. Working closely with investment, research, and technology teams, you will design, build, and optimise robust data pipelines and infrastructure that transform fragmented market and real estate data into structured intelligence. This role plays a critical part in enabling data-driven decision making across underwriting, portfolio strategy, and capital allocation. Key Responsibilities Design, build, and maintain scalable data pipelines to manage and process ...

Senior Data Engineer - Role Overview We are seeking a Senior Data Engineer to support the development and evolution of a scalable data platform underpinning private equity investment activity across EMEA. Working closely with investment, research, and technology teams, you will design, build, and optimise robust data pipelines and infrastructure that transform fragmented market and real estate data into structured intelligence. This role plays a critical part in enabling data-driven decision making across underwriting, portfolio strategy, and capital allocation. Key Responsibilities Design, build, and maintain scalable data pipelines to manage and process ...

Principal Data Architect, Secure Government and Defence Programmes Location: UK, hybrid, client site as required Security Requirement: Developed Vetting (DV) clearance is mandatory. This role is only suitable for candidates who currently hold active DV clearance. Overview A leading UK consulting organisation delivering mission-critical digital and data transformation across defence, national security, and sensitive government environments is seeking a Principal Data Architect. This is a senior, client-facing role focused on defining and delivering secure, scalable data platforms within highly classified programmes. Due to the nature of the work and access to classified systems ...

Data Engineering Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Engineering/Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required … London, Europe and the States) on occasions. We need someone who has come from a Data-Engineering First background with a hardened skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets ...

Senior Data Engineer (AWS) London/WFH to £90k Do you have expertise with modern data platform engineering? You could be progressing your career in a senior, hands-on role at a well established consumer facing financial services company that help people to manage debt, as they … through a technical transformation and scale-up following recent investment. As a Senior Data Engineer you will be responsible for designing, building and owning the new cloud (AWS) hosted data platform from the ground up. You'll collaborate with the Data Platform Lead, work closely with software ...

Data Engineering Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Engineering/Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required … London, Europe and the States) on occasions. We need someone who has come from a Data-Engineering First background with a hardened skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets ...

Principal Data Engineer (GCP) Northwest Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, this role will play … part in shaping and leading the organisation s data engineering capability, with a strong focus on technical leadership, platform design and mentoring engineers within a Google Cloud environment. Key Responsibilities of the Principal Data Engineer: Provide technical leadership, coaching and mentoring to data engineers Define how data ...

initial engagement - possibility of extension Active SC or SC eligibility required London location - flexible hybrid working Experience required in Oracle FDI, ADW, Oracle Cloud, Data Integration, and Stakeholder Management Role Opportunity We are seeking a highly experienced Oracle Fusion Data Intelligence (FDI/FAW) Architect to lead … delivery of enterprise-scale analytics solutions across Oracle Fusion Applications. This role will take ownership of the end-to-end FDI architecture - from data ingestion and transformation through to semantic modelling and executive dashboards. You will act as the technical authority across analytics, ensuring scalable, secure and high ...

Role: Data, Privacy & AI Security Consultant Location: London Level: Associate Manager, Consultant or Senior Analyst Salary: Competitive Salary & Package (Dependent on Experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods … point of application. Note: The above information relates to a specific client requirement As a Team: We are a specialist Data Security and Quantum Security practice, helping organisations translate regulatory, policy and standards-based requirements into practical, scalable technical controls. Our work spans the full lifecycle, from interpreting industry ...

Were partnering with a leading organisation seeking a Snowflake specialist to help modernise and scale their data capability. This is a delivery-focused role where youll shape cloud data architecture, lead migrations, and build high-performance data pipelines that directly support business-critical decision making. The Opportunity … Youll take ownership of Snowflake environments from design through to optimisation, ensuring data is structured, accessible and engineered for performance. Working across technical and business teams, youll translate complex requirements into scalable, resilient data solutions that support analytics, reporting and operational insight. Your remit will include: Architecting ...

Java Software Engineer – Data Engineering Up to £70,000 + bonus and benefits 4:1 hybrid in office – City of London Quant Capital is hiring for a small, high-performing market maker in London. This is a junior-to-mid role focused primarily on Java development, with a secondary … responsibility owning straightforward Python ETL/data ingestion into AWS and PostgreSQL. This is a growing team focused on data ingestion and building tooling for the wider firm. What you’ll do: Build and enhance Java backend services (APIs, batch jobs, integrations) used across the business ...

Junior Data Engineer - Research & Technology Role Overview This role supports the development and maintenance of a scalable data platform underpinning private equity investment activity across EMEA. Working closely with investment teams, you will build and optimise data pipelines, automate workflows, and transform fragmented market and real estate … data into structured intelligence that informs underwriting, portfolio strategy, and capital allocation decisions. Role Responsibilities * Build and maintain scalable data pipelines, managing large data sets from internal and external sources. * Develop and optimise ETL processes using AWS, SQL, and modern cloud technologies. * Manage API integrations and automate ...

Junior Data Engineer - Research & Technology Role Overview This role supports the development and maintenance of a scalable data platform underpinning private equity investment activity across EMEA. Working closely with investment teams, you will build and optimise data pipelines, automate workflows, and transform fragmented market and real estate … data into structured intelligence that informs underwriting, portfolio strategy, and capital allocation decisions. Role Responsibilities * Build and maintain scalable data pipelines, managing large data sets from internal and external sources. * Develop and optimise ETL processes using AWS, SQL, and modern cloud technologies. * Manage API integrations and automate ...

OpenAI services on Azure Function Apps Monitor and resolve API bugs and performance issues to ensure high availability and reliability Oversee and troubleshoot data ingestion processes supporting the chatbot’s functionality Collaborate with solution architects, product teams, and the cloud team to deliver a reliable and scalable solution … OpenAI APIs Hands-on experience with Azure Function Apps and cloud-native development Strong background in API design, monitoring, and performance optimisation Experience managing data ingestion pipelines and integrating data sources Excellent problem-solving skills and a proactive, solution-oriented mindset Strong communication and leadership skills, with ...

Lead Data Engineer - Gambling Sector (No Sponsorship) Salary: £125,000 Location: Remote (London Office) This is an opportunity to step into a hands-on leadership role where you will shape a modern data function, influence technical direction, and build high-impact data infrastructure from the ground up. … base across the UK. With strong growth, a clear product vision, and a collaborative engineering culture, they offer the chance to directly influence how data powers the next phase of their evolution. The business values responsible innovation, high technical standards, and a genuine passion for building great digital products. ...

DATA ENGINEER 6-MONTH CONTRACT £500-£550 PER DAY OUTSIDE IR35 FULLY REMOTE This role offers a great opportunity for an AWS Data Engineer to join a fast-paced media company working on a cutting-edge data ingestion and transformation project. You'll take ownership … pipeline development, integrating real-time data streams and third-party APIs into a modern analytics stack. The environment promotes autonomy, modern tooling, and close collaboration across technical and business teams. THE COMPANY This is a leading media organisation leveraging data to drive audience insights, engagement strategies, and targeted ...

Summary We require an Azure Databricks Architect to provide architectural leadership and assurance for the design, implementation, and ongoing evolution of an Azure-based data and analytics platform within a public sector environment. The role will focus on platform architecture, data patterns, governance, and non-functional requirements, working … secure, scalable, and compliant with organisational and government standards. Key Responsibilities Define and maintain the end-to-end architecture for Azure Databricks-based data platforms. Design Lakehouse architectures using Azure Databricks, Azure Data Lake Storage (ADLS Gen2), and associated Azure services. Produce and maintain High-Level Designs (HLDs ...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives their data … Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end-to-end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend ...

Clearly is a fleet management intelligence platform on a mission to bring clarity to one of the most data-rich yet analytically underserved industries in the world. Fleet operators today are drowning in fragmented data, with little ability to turn that data into actionable insight. Clearly solves … ground up. About the role As a Senior Software Engineer at Clearly, you will own and shape the full technical stack - from the data pipelines that ingest telematics streams at scale, through the processing and analytics layers that power our intelligence platform, to the APIs and interfaces that ...