20 of 20 Data Ingestion Jobs in the City of London

Data Engineer (Inside IR35) £425 Per day SC Cleared - A must to be considered for this opportunity London To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple … systems with inconsistent formats and limited automation. A Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery. Key Responsibilities Design, build, and maintain scalable data pipelines to ingest, transform ...

Data Engineer [Associate/Senior Associate] About the job We are looking to expand our Data Engineering team to build modern, scalable data platforms for our internal investment desks and portfolio companies. You will contribute to the firm’s objectives by delivering rapid and reliable data solutions that unlock value for Cerberus desks, portfolio companies, and other businesses. You’ll do this by designing and implementing robust data architectures, pipelines, and workflows that enable advanced analytics and AI applications. You may also support initiatives such as due diligence and pricing analyses by ensuring high ...

Title: Data Architect-Technical Job Location: London, UK Job Type: Contract The primary responsibilities are: • Hands on Experience on design & architecture of the Data Platform, Technical components, and Data Engg. related activities for supporting the key capabilities o Technical Data Architecture o Data Ingestion framework ( Batch/Micro Batch processing ) o Data Contract & Data management( including DQ, metadata & lineage) o Delivery, Scaling & Op Model • Discovery/assessment along with the Data platform requirements o Identify and document the relevant data sources to be used for collection & ingestion, cataloging ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver ...

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence initiatives. … enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions, and turn unstructured data into valuable business assets. Key Responsibilities: Building and scaling data pipelines, analytical infrastructure, and dashboard solutions that power customer success insights across multiple ...

Senior Data Engineer Job Title: Senior Data Engineer Salary Range: £80,000–£100,000 Location/Working model: London | Hybrid This is a critical technical position within a high-growth, forward-thinking organization that specializes in digital innovation. We require an experienced Senior Data Engineer to design … organization's operational and analytical success. Core Responsibilities The successful candidate will own the technical development and strategic execution of the core data platform, ensuring high quality, performance, and security: System Architecture & Development: Lead the design, development, and maintenance of scalable, high-performance, real-time data pipelines ...

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play … part in designing and developing scalable data pipelines and infrastructure that directly impacts decision-making at the highest levels of the football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced ...

Employment Type: Full-time About the Role We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines ...

partnering with a globally respected multi-strategy investment firm seeking a senior-level engineer to take ownership of the next generation of its market data platforms. This role calls for someone who blends deep Python engineering capability with strong object-oriented design instincts, and who understands how to ingest … structure, and optimise vast, granular financial datasets. You’ll play a central role in shaping large-scale tick-data architecture - building pipelines, improving data-lake structures, and refining storage formats to support demanding research and trading workflows... Key Responsibilities Architect, build, and refine high-throughput pipelines capable ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets, Data Bricks and is able to bring Proof of Concepts to the table and help with the execution. The platform primarily serves ...

Senior Data Scientist Hybrid - 1/2 days a week in Guildford Up to £80,000 About the Role Our client is a specialist technology and analytics consultancy delivering advanced data science solutions into complex, mission-critical environments. Working across sectors such as aviation, defence and high-reliability … systems, they help organisations turn challenging, data-rich problems into scalable, impactful solutions. They are now looking for a Senior Data Scientist to take a leading role across a portfolio of technically demanding projects. You’ll operate end-to-end - shaping problem definitions, engineering data pipelines, developing ...

Machine Learning Engineer London – (3 days a week in office) Up to £90,000 About the Role Our client is a data-driven organisation focused on delivering measurable operational and financial improvements across a range of industries. They combine deep technical expertise with real-world delivery to design, build … deploy machine learning solutions that create tangible business impact. As a Machine Learning Engineer, you’ll work closely with Data Scientists, Data Engineers and delivery teams to productionise models and build robust, scalable ML systems within client environments. This role is highly hands-on, with a strong focus ...

Role - Senior Lead Analyst- Data Scientist Technology – Data science, MLops, GenAI Location – London, UK Job Description Today, the corporate landscape is dynamic, and the world ahead is full of possibilities! None of the amazing things we do at Infosys would be possible without an equally amazing culture … relationships with our clients continue to be the cornerstones of our organization and these values are upheld only because of our people. Your Role : Data Scientist Preferred : Azure data science and open AI Technical Expertise: •Proven experience in data science leadership roles with team management. •Strong expertise ...

will reach out to shortlisted professionals to begin the interview process. Location : London Work mode: hybrid About the Role: We are seeking an experienced Data Engineer with deep expertise in Power BI and enterprise-scale reporting environments. The ideal candidate will be responsible for designing, optimizing, and maintaining high … performance dashboards using Power BI Desktop & Power BI Service . Write advanced, performance-optimized DAX following best practices. Leverage Power Query (M) for scalable data ingestion and transformation. Perform deep model optimization using Tabular Editor , DAX Studio , and performance analyzer tools. Apply strong understanding of the Power ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, you’ll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities • Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. • Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. • Design ...

hiring a Senior Software Engineer to help build and scale a next-generation agentic data analytics platform used by medium to enterprise teams. Business data is critical - but getting answers from it is still slow, complex, and overly technical. We’re building an AI-native platform that lets … anyone ask natural-language questions of their business data and receive precise, secure answers in seconds . This is an opportunity to join a high-calibre engineering team , working at the intersection of distributed systems, data infrastructure, and applied AI . This role will be in the office ...

Google Agent Development Kit (ADK). Develop and Evaluate RAG Pipelines: Engineer and optimize end-to-end Retrieval-Augmented Generation (RAG) systems, including data ingestion, chunking strategies, and implementing rigorous pipeline evaluation frameworks for accuracy and performance. Fine-Tune & Optimize LLMs: Implement advanced model customization techniques, including PEFT … track record of delivering scalable, reliable, and high-performance software solutions from concept to deployment. For more information on how we process your personal data, please refer to HCLTech’s Candidate Data Privacy Notice . ...

systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure … Practical knowledge of infrastructure as code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent ...

position to help lead the expansion of their cloud environment. This will involved contribution to the development of their quantitative research platform, data ingestion pipelines and post-trade systems. The successful individual will have previous experience with AWS and be an expert in Kubernetes. You will be responsible ...

latency integrations with major crypto exchanges. Key Responsibilities Design and implement exchange connectivity modules (REST, WebSocket, FIX, proprietary APIs). Optimize order entry, market data ingestion, and account management for performance and reliability. Contribute to a fault-tolerant, scalable connectivity framework using Rust and Typescript. Collaborate with trading ...