Data Ingestion Jobs in London

101 to 125 of 154 Data Ingestion Jobs in London

Software Engineer - Data Platform Engineering

London, UK
Quant Capital
Software Engineer – Data Platform Engineering London – Hybrid (4 days office/1 remote) Quant Capital is hiring for a trading and research firm seeking a Software Engineer to join its Data Platform team. This team owns the infrastructure that powers structured, high-quality datasets used across trading, research, and operations. The focus is not on breadth but depth … consolidating the most critical financial datasets into clean, accessible, and reliable pipelines. You’ll work at the intersection of systems engineering, data quality, and automation, shaping the way the firm accesses and relies on structured data. Role Overview You’ll design and build robust data ingestion pipelines, apply algorithmic solutions to data validation problems, and contribute … level thinking are valued more than process or oversight. Key Responsibilities Design and maintain pipelines for ingesting and cleaning financial datasets Integrate with distributed internal systems to serve structured data to end-users Develop new algorithmic techniques for quality control, error correction, and anomaly detection Engage with internal stakeholders to shape schema, resolve issues, and anticipate data needs More ❯
Employment Type: Full-time
Posted:

Software Engineer - Data Platform Engineering

City of London, Greater London, UK
Quant Capital
Software Engineer – Data Platform Engineering London – Hybrid (4 days office/1 remote) Quant Capital is hiring for a trading and research firm seeking a Software Engineer to join its Data Platform team. This team owns the infrastructure that powers structured, high-quality datasets used across trading, research, and operations. The focus is not on breadth but depth … consolidating the most critical financial datasets into clean, accessible, and reliable pipelines. You’ll work at the intersection of systems engineering, data quality, and automation, shaping the way the firm accesses and relies on structured data. Role Overview You’ll design and build robust data ingestion pipelines, apply algorithmic solutions to data validation problems, and contribute … level thinking are valued more than process or oversight. Key Responsibilities Design and maintain pipelines for ingesting and cleaning financial datasets Integrate with distributed internal systems to serve structured data to end-users Develop new algorithmic techniques for quality control, error correction, and anomaly detection Engage with internal stakeholders to shape schema, resolve issues, and anticipate data needs More ❯
Employment Type: Full-time
Posted:

ETL Developer (Infrastructure Services) - Investment Bank

City of London, Greater London, UK
Sterlings
A Bank, based in the City of London, is currently seeking an ETL Developer to help deliver infrastructure data processing solutions for the business. The company is seeking an experienced ETL Application Developer with experience of Extract/Transform/Load, SQL Server and data-processing of infrastructure-sourced capacity metrics. This role is critical to strengthening operational … monitoring is in place to highlight and mitigate potential system outages in a timely fashion to minimise potential disruptions. Key tasks include; Developing scripts, and ETL to obtain such data from the providers and working with a DBA to load this data into SQL Server from an application server. This person will also help normalise raw infrastructure and … monitoring data into structured formats suitable for graphing and trending Other tasks include automating regular data ingestion processing. Key Skills; Demonstrate evidence of working on similar data analysis and capture projects in the financial or other sector of equal complexity. Strong proficiency in one or more ETL tools Strong proficiency in data extraction methods usingRESTful More ❯
Posted:

Senior Software Engineer

London, United Kingdom
Hybrid / WFH Options
Ophelos
Hotwire (Turbo, Stimulus), View Components, Sidekiq, PostgreSQL, Redis, Serverless, AWS (Fargate, Aurora, ElastiCache), GitHub In this role, you'll get to: Design, implement and deliver software such as ingestion pipelines, API and a greenfield internal operations application. Align technical solutions with business goals that enable us to meet our goals Prioritise and organise the team's backlog; this refers … and self-motivation to take on tasks with loose requirements and see them through to successful completion. Nice to haves: Experience working with large datasets and building tools for data ingestion and processing. You enjoy learning new technologies and are passionate about experimenting to figure out how to build things better. We are continually evolving our benefits package … or other protected characteristics as required by law and as a matter of our company values. GDPR Notice When you apply to a job on this site, the personal data contained in your application will be collected by Ophelos ("Controller"), which is located at 1 Finsbury Ave, London EC2M 2PF and can be contacted by emailing . Controller's More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Software Engineer London (Hybrid)

London, United Kingdom
Hybrid / WFH Options
Ophelos Limited
Hotwire (Turbo, Stimulus), View Components, Sidekiq, PostgreSQL, Redis, Serverless, AWS (Fargate, Aurora, ElastiCache), GitHub In this role, you'll get to: Design, implement and deliver software such as ingestion pipelines, API and a greenfield internal operations application. Align technical solutions with business goals that enable us to meet our goals Prioritise and organise the team's backlog; this refers … and self-motivation to take on tasks with loose requirements and see them through to successful completion. Nice to haves: Experience working with large datasets and building tools for data ingestion and processing. You enjoy learning new technologies and are passionate about experimenting to figure out how to build things better. We are continually evolving our benefits package More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scraping Specialist

London, UK
NJF Global Holdings Ltd
quantitative and systematic hedge fund with a global presence, known for their scientific and technology-driven approach to investing across all major liquid asset classes. They're seeking a Data Scraping Specialist to join their world-class data and technology team. In this role, you will be responsible for developing and maintaining web scraping tools, integrating diverse data … and ensuring the reliability and quality of large-scale datasets used for the research and trading platforms. Ideal Candidate: 2+ years of hands-on experience with web scraping and data ingestion pipelines. Polygot developer, with experience in Python. Familiarity with structured and unstructured data formats. Solid understanding of software engineering best practices. Strong communication skills. Experience with … financial data, especially equities/derivatives, is a plus. More ❯
Posted:

Data Scraping Specialist

City of London, Greater London, UK
NJF Global Holdings Ltd
quantitative and systematic hedge fund with a global presence, known for their scientific and technology-driven approach to investing across all major liquid asset classes. They're seeking a Data Scraping Specialist to join their world-class data and technology team. In this role, you will be responsible for developing and maintaining web scraping tools, integrating diverse data … and ensuring the reliability and quality of large-scale datasets used for the research and trading platforms. Ideal Candidate: 2+ years of hands-on experience with web scraping and data ingestion pipelines. Polygot developer, with experience in Python. Familiarity with structured and unstructured data formats. Solid understanding of software engineering best practices. Strong communication skills. Experience with … financial data, especially equities/derivatives, is a plus. More ❯
Posted:

Data Solutions Director

London, United Kingdom
Hybrid / WFH Options
Publicis Groupe
each other and our clients, and it is deeply rooted throughout our work, to elevate and bring to life our differences throughout the platform world. Job Description THE TEAM Data Solutions is a Groupe wide practice for the delivery of end-to-end Data and Reporting Solutions for our key Global Network Clients. Data Solutions works with … key external and internal stakeholders to understand and analyse technical reporting requirements, define business rules for data ingestion, and lead the development of Publicis propriety data technology. As a Data Solutions Director, you will manage the Juniors, Managers and Senior Managers in the Data Solutions practice. You will be the team lead on communications between … Responsibilities ROLE SUMMARY Team Provide support managing client team relationships for some of Publicis Groupe's major Global Network Clients, working collaboratively across the network Act as support to Data Solutions team members providing leadership oversight on the global reporting solutions we deploy across our top accounts Collaborating closely with essential Team Leads to enhance technical processes, developments, and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Junior Software Engineer

London, United Kingdom
Tracer Cloud Inc
truth, learn fast, and iterate faster Meritocracy Like a professional sports team, we focus on contribution and reward excellence. Key Responsibilities • Architect and develop our Rust-based client for data ingestion • Design and implement core platform features: Data ingestion connectors Logs management systems Observability interfaces Error resolution tools • Drive core architecture decisions and lead deployment on … Brings 1-2 years of experience in building complex software systems • Proven ability to solve challenging engineering problems • Demonstrates deep technical expertise in high-performance computing, observability, cloud infrastructure, data engineering, or data science • Proficient in low-level programming like Rust, C, or other technologies • Track record of taking calculated technical risks and learning from failures • Ability to … priorities • Proven track record of shipping complex products at high velocity • Brings a strong product mindset, ensuring technical solutions align with business priorities Bonus points • Proficient in high-performance data infrastructure • Experienced in technical leadership as a manager or project lead • Early-stage startup experience Our Tech Stack • Rust: We prioritise speed and efficiency for our core systems • Nextflow More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

First Senior / Lead Product Engineer (series A)

London, United Kingdom
Growth Kitchen
you will be an integral part of our rapidly growing startup. You'll have the opportunity to build beyond the limitations typically found in larger firms, directly shaping our data infrastructure, analytics capabilities, and cutting-edge AI solutions from the ground up. You will take lots of real world manual workflows that we do to quality control kitchens and … and staying at the forefront of technological innovation in the food space. We are offering significant stock options. Stack TypeScript Node.js React NestJS Tailwind Postgres Projects Own & evolve our data ingestion engine (Deliveroo/Uber/JustEat) Build self-serve dashboards for kitchens & food brands Greenfield: AI food quality control (models + Mechanical Turk) Greenfield: AI & Gamified kitchen … management Greenfield: Anomaly detection Greenfield: Performance marketing optimisation (multi-armed bandits) Software engineer who is strong on data engineering and integrations Architect profile: ability to define and build stable underlying architecture that scale Can leverage AI-native tools/Cursor as superpower Fast, curious, hands-on, enjoys hackathons and hungry to scale real-world problems Deep passion for fixing More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Research Engineer / Research Scientist, Multimodal

London, United Kingdom
Hybrid / WFH Options
Menlo Ventures
we believe the most impactful safety research will require access to frontier AI systems. The most powerful AIs will operate not just on text but also other modes of data, including images, video and audio. Such models have potential to augment human creativity and productivity in exciting ways. However, we are very concerned about the risks introduced by powerful … builds and studies multimodal models to better understand and mitigate these risks. Our team works across many parts of a large stack that includes training, inference, system design and data collection. Some of our core focus areas are: Foundational Research We develop new architectures for modeling multimodal data and study how they interact with text-only models at … scale. Building Infrastructure We work on many infrastructure projects including: Complex multimodal reinforcement learning environments. High-performance RPC servers for processing image inputs. Sandboxing infrastructure for securely collecting data. Data Ingestion We are more interested in running simple experiments at large scale than smaller complex experiments. This requires access to very large sources of multimodal data. We develop More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Elastic Observability Specialist

London, UK
GIOS Technology
applications and infrastructure. You will architect and implement logging, metrics, and tracing pipelines; build user-friendly dashboards; and optimize performance and cost for large-scale Elastic deployments. Key Responsibilities Data Ingestion & Mapping Design Ingest Pipelines with Grok, JSON, and user-defined processors to normalize logs. Configure Beats (Filebeat, Metricbeat, Heartbeat) and Elastic Agent for logs, metrics, uptime, and … Strong knowledge of Linux system administration and container orchestration (Docker, Kubernetes). Experience with observability frameworks (OpenTelemetry, Prometheus) and integrating with Elastic. Expertise in scripting (Bash, Python) for automating data onboarding and operational tasks. Understanding of network protocols, gRPC, and related logging intricacies. Deep familiarity with Filebeat modules (e.g. system, nginx, kafka) and Metricbeat modules (e.g. docker, kubernetes, system More ❯
Posted:

Elastic Observability Specialist

City of London, Greater London, UK
GIOS Technology
applications and infrastructure. You will architect and implement logging, metrics, and tracing pipelines; build user-friendly dashboards; and optimize performance and cost for large-scale Elastic deployments. Key Responsibilities Data Ingestion & Mapping Design Ingest Pipelines with Grok, JSON, and user-defined processors to normalize logs. Configure Beats (Filebeat, Metricbeat, Heartbeat) and Elastic Agent for logs, metrics, uptime, and … Strong knowledge of Linux system administration and container orchestration (Docker, Kubernetes). Experience with observability frameworks (OpenTelemetry, Prometheus) and integrating with Elastic. Expertise in scripting (Bash, Python) for automating data onboarding and operational tasks. Understanding of network protocols, gRPC, and related logging intricacies. Deep familiarity with Filebeat modules (e.g. system, nginx, kafka) and Metricbeat modules (e.g. docker, kubernetes, system More ❯
Posted:

Business Analyst Intern

London, UK
Commerzbank AG
operation of current and future systems. Ensure user stories are up-to-date and reflective of current priorities. Hands-on validation of end-to-end pricing pipeline from market data ingestion to price discovery. Maintain technology wiki pages and runbooks for pricing functionality and operations. Follow established agile process, protocols and quality standards in the development and deployment More ❯
Posted:

Business Analyst Intern

City of London, Greater London, UK
Commerzbank AG
operation of current and future systems. Ensure user stories are up-to-date and reflective of current priorities. Hands-on validation of end-to-end pricing pipeline from market data ingestion to price discovery. Maintain technology wiki pages and runbooks for pricing functionality and operations. Follow established agile process, protocols and quality standards in the development and deployment More ❯
Posted:

Sales Forward Deployed Engineer - AI London £105K - £125K

London, United Kingdom
Hybrid / WFH Options
V7 Labs
you come in. What you will be be doing (AI Solutions Engineer): Solutions development and presentation: You will develop and present workflow implementations within V7 that combine prompt engineering, data ingestion pipelines, and format conversions, solving customer problems in image recognition, document processing, product development and more. You will present your findings to customers alongside sales. Technical integrations … models, SFT (Supervised Fine-Tuning), prompt engineering, RAG (Retrieval-augmented generation) and/or measuring AI accuracy. Two years + experience in solutions architecture or integrating multiple applications/data streams, or ML development within customer-facing roles. Intermediate experience with Python. University degree in computer science, engineering, mathematics or related fields. Solutioning: ability to develop and articulate an More ❯
Employment Type: Permanent
Salary: GBP 105,000 - 125,000 Annual
Posted:

AI Engineer

City Of Westminster, London, United Kingdom
Resource Area for Teaching
detection, classification, clustering, and retrieval across vision and language models, ideally for identifying cyber threats (URLs, domains, phishing, botnets, etc.) Hands-on experience building production -grade AI pipelines, including data ingestion, feature engineering, validation, model deployment, and monitoring . Proficient in a major backend language and related ML/AI libraries (e.g. Tensorflow & PyTorch , etc), with a preference More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Quantitative Developer - Market Data

London, England, United Kingdom
Selby Jennings
Our client, a rapidly scaling unicorn, is seeking a talented Quantitative Developer to join their Market Data team in London. This is a unique opportunity for an experienced Software or Quantitative Developer to play a key role in shaping the organisation's market data strategy. You'll contribute to both product and infrastructure development, enhancing the firm's … data ingestion and query frameworks. Your work will focus on improving functionality, performance, scalability, robustness, and usability across the platform. Key Responsibilities Drive the development of the firm's market data roadmap. Contribute to both product features and core infrastructure enhancements. Build and optimise data ingestion and query systems. Integrate new pricing data sources … into the platform. Develop UI and visualisation tools to improve transparency and control of market data systems. Requirements 5+ years of experience building large-scale or low-latency systems at a top-tier firm. Strong background in market data or trading infrastructure. Proficiency in Python, with the ability to write robust, maintainable, and high-performance production code. Solid More ❯
Posted:

Associate Director, Data Solutions

London, United Kingdom
Hybrid / WFH Options
Publicis Groupe
transformation. Publicis Groupe is a privileged partner in its clients' transformation to enhance personalisation at scale. The Groupe relies on ten expertise concentrated within four main activities: Communication, Media, Data and Technology. Through a unified and fluid organisation, its clients, including Disney, P&G, LEGO, Nestlé, and Cartier have a facilitated access to all its expertise in every market. … as well as global accelerator PMX and integrated platform-based technologies including CJ, CitrusAd, Epsilon and Profitero. A key business solution of Publicis Groupe, Publicis Media's digital-first, data-driven global solutions deliver client value anddrive growth in a platform-poweredworld. It is present in over 100 countries with over 23,000 employees worldwide. Job Description The Team … Data Solutions is a Groupe-wide practice dedicated to delivering end-to-end data and reporting solutions for key Global Network Clients. The team collaborates with both internal and external stakeholders to analyse technical reporting requirements, define business rules for data ingestion, and drive the development of Publicis' proprietary data technology. The Role: Data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Avaloq Software Engineer

London, UK
Luxoft
Avaloq Software Engineer to join our Wealth Practice in the UK. In this role, you'll play a key part in designing, developing, and maintaining high-quality software and data structures to support our evolving data platforms. You'll collaborate across teams to support data migration, cleansing, enrichment, scripting, and reconciliation—ensuring we deliver reliable and scalable … expertise in Avaloq technologies, database management, and software development—combined with a solid understanding of the Avaloq Enterprise-Wide Object Model—will be critical in shaping and enhancing our data capabilities. This is a fantastic opportunity to bring your passion for innovation into a fast-paced, dynamic environment where your impact will be tangible. Qualifications You will have between … years experience working as an Avaloq Developer. Mapping physical data from Avaloq and other platforms to the Enterprise Data Model, ensuring adherence to reference data standards and clear conceptual definitions. Performing data quality assessments, developing strategies to enhance data integrity, and creating Avaloq system functionalities to mitigate the risk of poor data at source. More ❯
Posted:

Avaloq Software Engineer

City of London, Greater London, UK
Luxoft
Avaloq Software Engineer to join our Wealth Practice in the UK. In this role, you'll play a key part in designing, developing, and maintaining high-quality software and data structures to support our evolving data platforms. You'll collaborate across teams to support data migration, cleansing, enrichment, scripting, and reconciliation—ensuring we deliver reliable and scalable … expertise in Avaloq technologies, database management, and software development—combined with a solid understanding of the Avaloq Enterprise-Wide Object Model—will be critical in shaping and enhancing our data capabilities. This is a fantastic opportunity to bring your passion for innovation into a fast-paced, dynamic environment where your impact will be tangible. Qualifications You will have between … years experience working as an Avaloq Developer. Mapping physical data from Avaloq and other platforms to the Enterprise Data Model, ensuring adherence to reference data standards and clear conceptual definitions. Performing data quality assessments, developing strategies to enhance data integrity, and creating Avaloq system functionalities to mitigate the risk of poor data at source. More ❯
Posted:

MarTech Solutions Architect (Braze)

London, UK
Staffworx
the Braze platform, ensuring it aligns with business objectives and integrates seamlessly with our existing marketing technology stack. End-to-end implementation of Braze, including SDK integration, API connections, data ingestion, and the configuration of campaigns, Canvases, and Content Cards. Serve as the primary technical consultant for all things Braze, providing strategic advice and best practice recommendations to … marketing, product, and engineering teams. Collaborate with stakeholders to understand their needs and translate them into technical requirements and actionable use cases within Braze. Work closely with data and engineering teams to design and manage data flows, ensuring the right data is available in Braze to power personalised customer journeys. Essential: Hands-on experience with the Braze … architecting and leading at least two full-cycle Braze implementations. Proven experience with Docker, Kubernetes, Terraform, or similar IaC technologies Have experience with MongoDB, Redis, Kafka, Postgres, or similar data technologies Experience with data integration, including ETL processes and customer data platforms (CDPs). Comprehensive awareness of various marketing technology platforms like CRM, DAM, dynamic creative optimization More ❯
Posted:

Solutions Architect

London, United Kingdom
Staffworx Limited
the Braze platform, ensuring it aligns with business objectives and integrates seamlessly with our existing marketing technology stack. End-to-end implementation of Braze, including SDK integration, API connections, data ingestion, and the configuration of campaigns, Canvases, and Content Cards. Serve as the primary technical consultant for all things Braze, providing strategic advice and best practice recommendations to … marketing, product, and engineering teams. Collaborate with stakeholders to understand their needs and translate them into technical requirements and actionable use cases within Braze. Work closely with data and engineering teams to design and manage data flows, ensuring the right data is available in Braze to power personalised customer journeys. Essential: Hands-on experience with the Braze … architecting and leading at least two full-cycle Braze implementations. Proven experience with Docker, Kubernetes, Terraform, or similar IaC technologies Have experience with MongoDB, Redis, Kafka, Postgres, or similar data technologies Experience with data integration, including ETL processes and customer data platforms (CDPs). Comprehensive awareness of various marketing technology platforms like CRM, DAM, dynamic creative optimization More ❯
Employment Type: Contract
Posted:

MarTech Solutions Architect (Braze)

City of London, Greater London, UK
Staffworx
the Braze platform, ensuring it aligns with business objectives and integrates seamlessly with our existing marketing technology stack. End-to-end implementation of Braze, including SDK integration, API connections, data ingestion, and the configuration of campaigns, Canvases, and Content Cards. Serve as the primary technical consultant for all things Braze, providing strategic advice and best practice recommendations to … marketing, product, and engineering teams. Collaborate with stakeholders to understand their needs and translate them into technical requirements and actionable use cases within Braze. Work closely with data and engineering teams to design and manage data flows, ensuring the right data is available in Braze to power personalised customer journeys. Essential: Hands-on experience with the Braze … architecting and leading at least two full-cycle Braze implementations. Proven experience with Docker, Kubernetes, Terraform, or similar IaC technologies Have experience with MongoDB, Redis, Kafka, Postgres, or similar data technologies Experience with data integration, including ETL processes and customer data platforms (CDPs). Comprehensive awareness of various marketing technology platforms like CRM, DAM, dynamic creative optimization More ❯
Posted:

Founding AI Engineer

London Area, United Kingdom
Fabrik Talent
first product and early revenue projected (high six-figure ARR this year), the company is now developing a second, more ambitious system that uses LLMs, RAG, and multi-source data ingestion to solve real problems in a complex, high-value industry. This is a rare opportunity to join early, build real AI systems, and take ownership of core … architecture and product direction. What You’ll Do Build and own core AI/ML systems (Python, MLops/LLMops pipelines, integrations, data retrieval) Architect and scale a product that works across messy enterprise data (SharePoint, Slack, Outlook, etc.) Define infrastructure and engineering best practices from the ground up What We’re Looking For 3–6+ years AI … software engineering and deployment experience Strong exposure to MLops/LLMops, ideally in real-world AI product builds Experience with unstructured data, search/re-ranking, or retrieval systems (e.g., RAG) A “builder” mindset, fast, hands-on, pragmatic, collaborative Excited by early-stage start-up life More ❯
Posted:
Data Ingestion
London
10th Percentile
£67,750
25th Percentile
£72,500
Median
£85,000
75th Percentile
£98,125
90th Percentile
£115,000