76 to 100 of 108 Data Ingestion Jobs in Central London

growth, and over 20M in annual sales, they're now investing heavily in their technology to unlock the next phase: scaling from 150 sites to 5,000+, powered by data, AI, and automation. The Role You'll be a foundational member of their engineering team. This is a high-impact individual contributor role, ideal for someone who enjoys building … from the ground up, solving real-world problems, and owning architecture decisions in a fast-moving environment. Youll work across the stack, with a focus on backend systems, data infrastructure, and internal tools. What Youll Be Doing Implementing AI tooling across all their products focusing on data ingestion and aggregation Lead the design and implementation of scalable … microservices-based systems Own and evolve their core platform architecture, including APIs, internal tools, and data pipelines Work with large, varied data sets from third-party sources (e.g. partner platforms, supply chains, operational data) Help turn data into insights and recommendations using AI/ML tooling Tackle technical debt and improve system robustness as we scale More ❯

growth, and over £20M in annual sales, they're now investing heavily in their technology to unlock the next phase: scaling from 150 sites to 5,000+, powered by data, AI, and automation. The Role You'll be a foundational member of their engineering team. This is a high-impact individual contributor role, ideal for someone who enjoys building … from the ground up, solving real-world problems, and owning architecture decisions in a fast-moving environment. You’ll work across the stack, with a focus on backend systems, data infrastructure, and internal tools. What You’ll Be Doing Implementing AI tooling across all their products focusing on data ingestion and aggregation Lead the design and implementation … of scalable, microservices-based systems Own and evolve their core platform architecture, including APIs, internal tools, and data pipelines Work with large, varied data sets from third-party sources (e.g. partner platforms, supply chains, operational data) Help turn data into insights and recommendations using AI/ML tooling Tackle technical debt and improve system robustness as More ❯

Senior Engineer Data/Software - London - 90,000 - 130,000 My client are expanding their Data Science & Technology, the team builds the systems and tools that enable trading teams to analyze markets, forecast price movements, and manage risk with speed and precision. If youre passionate about engineering impactful solutions in a high-performance trading environment, this is an … opportunity to drive innovation at the intersection of data, technology, and commerce. Salary and Benefits Competitive salary of up to 130,000 (DOE) Performance bonus of up to 30% Comprehensive medical, dental, retirement, and life insurance Wellness and employee assistance programs Parental and family leave policies Two paid days annually to volunteer with local charities 23 days annual leave … office workflows and analytical models. Develop robust Python-based services and APIs using modern frameworks, microservice architectures, and best-practice design principles. Design and maintain tools that support market data ingestion, supply & demand modeling, and position management. Leverage AWS cloud technologies (including ECS, Lambda, S3, and CloudWatch) to deploy scalable, high-availability systems for data processing and More ❯

Senior Engineer – Data/Software - London - £90,000 - £130,000 My client are expanding their Data Science & Technology, the team builds the systems and tools that enable trading teams to analyze markets, forecast price movements, and manage risk with speed and precision. If you’re passionate about engineering impactful solutions in a high-performance trading environment, this is … an opportunity to drive innovation at the intersection of data, technology, and commerce. Salary and Benefits Competitive salary of up to £130,000 (DOE) Performance bonus of up to 30% Comprehensive medical, dental, retirement, and life insurance Wellness and employee assistance programs Parental and family leave policies Two paid days annually to volunteer with local charities 23 days annual … office workflows and analytical models. Develop robust Python-based services and APIs using modern frameworks, microservice architectures, and best-practice design principles. Design and maintain tools that support market data ingestion, supply & demand modeling, and position management. Leverage AWS cloud technologies (including ECS, Lambda, S3, and CloudWatch) to deploy scalable, high-availability systems for data processing and More ❯

The Client Tempest Vane Partners has partnered with a globally recognised investment firm where data and technology sit at the centre of every decision. The firms Core Data Platform group builds and maintains the essential systems, services, and APIs that enable researchers, engineers, and investment teams to access and analyse data at scale. Youll join a small … highly capable team operating in a cloud-native, Kubernetes environment, combining open-source tools and modern engineering practices to create a unified, next-generation data platform. What Youll Get A key engineering role within a world-class technology organisation that values innovation and impact. Exposure to a modern data ecosystem including Iceberg, Kafka, Airflow, and other open-source … where engineers are trusted to take ownership and drive outcomes. Excellent compensation package with strong performance incentives. What Youll Do Design, develop, and maintain high-performance APIs and core data service s used across the firm. Work closely with fellow engineers, analysts, and stakeholders to enhance data accessibility and reliability. Take part in architecture and design discussions, ensuring More ❯

The Client Tempest Vane Partners has partnered with a globally recognised investment firm where data and technology sit at the centre of every decision. The firm’s Core Data Platform group builds and maintains the essential systems, services, and APIs that enable researchers, engineers, and investment teams to access and analyse data at scale. You’ll join … a small, highly capable team operating in a cloud-native, Kubernetes environment, combining open-source tools and modern engineering practices to create a unified, next-generation data platform. What You’ll Get A key engineering role within a world-class technology organisation that values innovation and impact. Exposure to a modern data ecosystem including Iceberg, Kafka, Airflow, and … engineers are trusted to take ownership and drive outcomes. Excellent compensation package with strong performance incentives. What You’ll Do Design, develop, and maintain high-performance APIs and core data service s used across the firm. Work closely with fellow engineers, analysts, and stakeholders to enhance data accessibility and reliability. Take part in architecture and design discussions, ensuring More ❯

Were partnering with a fast-growing London-based startup thats building the next generation of intelligent financial infrastructure. Theyre developing a cutting-edge data and AI platform designed to power decision-making and automation across complex financial workflows. As a Senior AI Engineer/Founding Engineer , youll play a pivotal role in designing and building the core architecture defining … from day one and work closely with the founding team to bring ambitious ideas to life. What Youll Do Architect and build a scalable, modular platform that integrates diverse data sources and systems Define component architecture, communication patterns, and integration frameworks across a complex data ecosystem Design flexible data ingestion and transformation pipelines for financial market … data and trading systems Build and maintain AI/ML infrastructure, including model serving, evaluation, and observability frameworks Collaborate directly with clients to ensure the platform meets real-world enterprise requirements Contribute to both strategic technical direction and hands-on implementation as part of a small, high-performing team About You Degree-qualified in Computer Science, Engineering, Mathematics, or More ❯

We’re partnering with a fast-growing London-based startup that’s building the next generation of intelligent financial infrastructure. They’re developing a cutting-edge data and AI platform designed to power decision-making and automation across complex financial workflows. As a Senior AI Engineer/Founding Engineer , you’ll play a pivotal role in designing and building … day one and work closely with the founding team to bring ambitious ideas to life. What You’ll Do Architect and build a scalable, modular platform that integrates diverse data sources and systems Define component architecture, communication patterns, and integration frameworks across a complex data ecosystem Design flexible data ingestion and transformation pipelines for financial market … data and trading systems Build and maintain AI/ML infrastructure, including model serving, evaluation, and observability frameworks Collaborate directly with clients to ensure the platform meets real-world enterprise requirements Contribute to both strategic technical direction and hands-on implementation as part of a small, high-performing team About You Degree-qualified in Computer Science, Engineering, Mathematics, or More ❯

Work with our core technology stack, including Python , Linux (via WSL) , PostgreSQL , SQL Server , Databricks , and leverage both Azure and AWS cloud platforms. Design and implement advanced solutions for data ingestion , transformation , and large-scale orchestration of network I/O. Manage Infrastructure as Code and collaborate with infrastructure teams to deliver new features for CFC’s Engineering … Platform. Model data for diverse use cases—both operational and analytical—partnering with your team, other engineering groups, and data consumers. Monitor and improve data quality across our systems, driving enhancements against key metrics. Assess new data sources for completeness and accuracy to ensure suitability for specific applications. Contribute to CI/CD automation , optimizing for More ❯

Work with our core technology stack, including Python , Linux (via WSL) , PostgreSQL , SQL Server , Databricks , and leverage both Azure and AWS cloud platforms. Design and implement advanced solutions for data ingestion , transformation , and large-scale orchestration of network I/O. Manage Infrastructure as Code and collaborate with infrastructure teams to deliver new features for CFC’s Engineering … Platform. Model data for diverse use cases—both operational and analytical—partnering with your team, other engineering groups, and data consumers. Monitor and improve data quality across our systems, driving enhancements against key metrics. Assess new data sources for completeness and accuracy to ensure suitability for specific applications. Contribute to CI/CD automation , optimizing for More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and ClickHouse. They’re looking for a … Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused) Hands-on with analytical databases such as ClickHouse, SingleStore … Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and ClickHouse. They’re looking for a … Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused) Hands-on with analytical databases such as ClickHouse, SingleStore … Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling More ❯

and ensure the environment is compliant. • Evaluate and pilot emerging capabilities such as Microsoft Copilot and AI-driven productivity tools. • Oversee the operational integrity, performance, and availability of core data platforms and pipelines that support reporting, analytics, and AI readiness across the firm. • Collaborate closely with the Data & AI teams to ensure cloud infrastructure supports scalable, secure, and … reliable data ingestion, transformation, and delivery. Budgeting & Licensing • Own and manage the platform budget, ensuring efficient use of resources and cost optimisation. • Manage and forecast consumption charges, ensuring compliance and maximising license utilisation. • Liaise with procurement, finance, and vendors for renewals and cost planning. Governance, Risk & Compliance • Define and enforce policies for workload management and governance across our … cloud estate. • Maintain compliance with internal policies and regulatory requirements. • Ensure data governance best practices across cloud environment. Stakeholder Engagement • Collaborate with business units, Technology senior leadership team, and product teams to gather requirements and improve platform services. • Champion change management initiatives that drive behavioural adoption of digital tools across the firm. • Act as an evangelist for Modern cloud More ❯

and ensure the environment is compliant. • Evaluate and pilot emerging capabilities such as Microsoft Copilot and AI-driven productivity tools. • Oversee the operational integrity, performance, and availability of core data platforms and pipelines that support reporting, analytics, and AI readiness across the firm. • Collaborate closely with the Data & AI teams to ensure cloud infrastructure supports scalable, secure, and … reliable data ingestion, transformation, and delivery. Budgeting & Licensing • Own and manage the platform budget, ensuring efficient use of resources and cost optimisation. • Manage and forecast consumption charges, ensuring compliance and maximising license utilisation. • Liaise with procurement, finance, and vendors for renewals and cost planning. Governance, Risk & Compliance • Define and enforce policies for workload management and governance across our … cloud estate. • Maintain compliance with internal policies and regulatory requirements. • Ensure data governance best practices across cloud environment. Stakeholder Engagement • Collaborate with business units, Technology senior leadership team, and product teams to gather requirements and improve platform services. • Champion change management initiatives that drive behavioural adoption of digital tools across the firm. • Act as an evangelist for Modern cloud More ❯

and ensure the environment is compliant. Evaluate and pilot emerging capabilities such as Microsoft Copilot and AI-driven productivity tools. Oversee the operational integrity, performance, and availability of core data platforms and pipelines that support reporting, analytics, and AI readiness across the firm. Collaborate closely with the Data C AI teams to ensure cloud infrastructure supports scalable, secure … and reliable data ingestion, transformation, and delivery. Budgeting s Licensing Own and manage the platform budget, ensuring efficient use of resources and cost optimisation. Manage and forecast consumption charges, ensuring compliance and maximising license utilisation. Liaise with procurement, finance, and vendors for renewals and cost planning. Governance, Risk s Compliance Define and enforce policies for workload management and … governance across our cloud estate. Maintain compliance with internal policies and regulatory requirements. Ensure data governance best practices across cloud environment. Stakeholder Engagement Collaborate with business units, Technology senior leadership team, and product teams to gather requirements and improve platform services. Champion change management initiatives that drive behavioural adoption of digital tools across the firm. Act as an evangelist More ❯

and ensure the environment is compliant. Evaluate and pilot emerging capabilities such as Microsoft Copilot and AI-driven productivity tools. Oversee the operational integrity, performance, and availability of core data platforms and pipelines that support reporting, analytics, and AI readiness across the firm. Collaborate closely with the Data C AI teams to ensure cloud infrastructure supports scalable, secure … and reliable data ingestion, transformation, and delivery. Budgeting s Licensing Own and manage the platform budget, ensuring efficient use of resources and cost optimisation. Manage and forecast consumption charges, ensuring compliance and maximising license utilisation. Liaise with procurement, finance, and vendors for renewals and cost planning. Governance, Risk s Compliance Define and enforce policies for workload management and … governance across our cloud estate. Maintain compliance with internal policies and regulatory requirements. Ensure data governance best practices across cloud environment. Stakeholder Engagement Collaborate with business units, Technology senior leadership team, and product teams to gather requirements and improve platform services. Champion change management initiatives that drive behavioural adoption of digital tools across the firm. Act as an evangelist More ❯

Ready to build the high-performance logic powering next-generation logistics? Join Reelables and architect the core back-end services that process and serve data for millions of smart labels worldwide! This isn't just back-end development – you're building the mission-critical application layer that handles massive IoT data streams, ensures millisecond latency for global supply … chains, and scales seamlessly as we grow from millions to billions of tracking events. Think API performance and data processing efficiency meets cutting-edge innovation. You'll be designing highly performant and distributed services that ingest and process location and temperature data from every corner of the globe, building robust, low-latency APIs that power logistics decisions worth … manage their shipments globally, and we're just getting started. Responsibilities Core Service Architecture & Scale Design, develop, and maintain highly scalable back-end services that handle millions of concurrent data ingestion events and user requests. Architect and optimize data processing pipelines and application logic for massive streams of real-time location, temperature, and sensor data. Develop robust More ❯

Ready to build the high-performance logic powering next-generation logistics? Join Reelables and architect the core back-end services that process and serve data for millions of smart labels worldwide! This isn't just back-end development – you're building the mission-critical application layer that handles massive IoT data streams, ensures millisecond latency for global supply … chains, and scales seamlessly as we grow from millions to billions of tracking events. Think API performance and data processing efficiency meets cutting-edge innovation. You'll be designing highly performant and distributed services that ingest and process location and temperature data from every corner of the globe, building robust, low-latency APIs that power logistics decisions worth … manage their shipments globally, and we're just getting started. Responsibilities Core Service Architecture & Scale Design, develop, and maintain highly scalable back-end services that handle millions of concurrent data ingestion events and user requests. Architect and optimize data processing pipelines and application logic for massive streams of real-time location, temperature, and sensor data. Develop robust More ❯

We’re currently supporting a leading financial services firm in their search for an experienced KDB+ Engineer to join their growing data and analytics engineering team. This is a hands-on development role focused on building high-performance data systems and real-time analytics that power decision-making across trading and management teams. Key Responsibilities Design, enhance, and … maintain analytics platforms that deliver transparency and actionable insights across new and existing business domains. Develop and optimise data ingestion pipelines to curate, collect, and store large volumes of internal trading and external market data. Build and fine-tune data access frameworks supporting real-time dashboards, execution analytics, and market microstructure research. Design complex event processing systems … to detect data anomalies and generate real-time trading signals. Continuously improve system performance, robustness, and scalability while managing cost and operational efficiency. Collaborate closely with quants, traders, and technology teams to deliver reliable, low-latency data solutions. Required Skills & Experience Expert proficiency in KDB+/Q, with experience in large-scale data and analytics systems. Strong More ❯

We’re currently supporting a leading financial services firm in their search for an experienced KDB+ Engineer to join their growing data and analytics engineering team. This is a hands-on development role focused on building high-performance data systems and real-time analytics that power decision-making across trading and management teams. Key Responsibilities Design, enhance, and … maintain analytics platforms that deliver transparency and actionable insights across new and existing business domains. Develop and optimise data ingestion pipelines to curate, collect, and store large volumes of internal trading and external market data. Build and fine-tune data access frameworks supporting real-time dashboards, execution analytics, and market microstructure research. Design complex event processing systems … to detect data anomalies and generate real-time trading signals. Continuously improve system performance, robustness, and scalability while managing cost and operational efficiency. Collaborate closely with quants, traders, and technology teams to deliver reliable, low-latency data solutions. Required Skills & Experience Expert proficiency in KDB+/Q, with experience in large-scale data and analytics systems. Strong More ❯

other relevant programming languages to build intelligent applications on the Azure platform. Design and develop Azure AI Services proficiently; Develop solutions using Azure AI Prompt Flow; Setup and develop data ingestion pipelines and components; design and develop efficient ingestion methodologies Developing search related components using Azure AI Search (Vector Store) Developing and deploying AI/ML models … on Azure technologies for business teams Work closely with MLOps engineers to Integrate MLOps practices into the existing development lifecycle Collaborate with AI Engineers, MLOps Engineers, Data Scientists and Business stakeholders to understand deployment, networking and security requirements in helping design effective AI solutions for the projects Develop and test code, ensuring high quality, maintainability, and adherence to best More ❯

other relevant programming languages to build intelligent applications on the Azure platform. Design and develop Azure AI Services proficiently; Develop solutions using Azure AI Prompt Flow; Setup and develop data ingestion pipelines and components; design and develop efficient ingestion methodologies Developing search related components using Azure AI Search (Vector Store) Developing and deploying AI/ML models … on Azure technologies for business teams Work closely with MLOps engineers to Integrate MLOps practices into the existing development lifecycle Collaborate with AI Engineers, MLOps Engineers, Data Scientists and Business stakeholders to understand deployment, networking and security requirements in helping design effective AI solutions for the projects Develop and test code, ensuring high quality, maintainability, and adherence to best More ❯

frameworks like LangChain, LangGraph, and the Google Agent Development Kit (ADK). Develop and Evaluate RAG Pipelines: Engineer and optimize end-to-end Retrieval-Augmented Generation (RAG) systems, including data ingestion, chunking strategies, and implementing rigorous pipeline evaluation frameworks for accuracy and performance. Fine-Tune & Optimize LLMs: Implement advanced model customization techniques, including PEFT (Parameter-Efficient Fine-Tuning … systems into production. A proven track record of delivering scalable, reliable, and high-performance software solutions from concept to deployment. For more information on how we process your personal data, please refer to HCLTech’s Candidate Data Privacy Notice . More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯

create strategic Road-map for large enterprise initiatives Must have experience in Legacy Modernization programs Should be proficient at collaborating with cross functional teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to More ❯