201 to 225 of 382 Data Ingestion Jobs in England

on the Central Execution Desk, directly contributing to scale up Tower's Mid-Frequency Trading capabilities. Design, implement, and maintain high-performance services in Rust and Python for market-data ingestion, ML pipelines, and post-trade analytics Translate research prototypes into production-ready code, adding testing, monitoring, and CI/CD automation Optimise existing code for throughput, memory … footprint, and reliability on distributed systems Collaborate closely with quantitative researchers to iterate on data pipelines, simulation frameworks, and performance diagnostics Qualifications Bachelor’s or Master’s degree in Computer Science, Mathematics, or a related STEM field 2-5 years of professional software-engineering experience, including production systems written in Python Proficiency in a systems language - Rust preferred (C … Go also acceptable) - and the desire to deepen that expertise Strong computer-science fundamentals: algorithms, data structures, concurrency, networking, and performance profiling Experience working with real-time and historical market data or other high-volume time-series data Proficiency with Linux development, Git, containers, and CI/CD workflows Familiarity with SQL and at least one columnar More ❯

electrical integrity monitoring, where we deliver advanced solutions that offer deep insights into the health of electrical systems. Our commitment is to empower customers through enhanced monitoring systems, sophisticated data gathering, and analytical capabilities, enabling them to make informed decisions about their critical infrastructure. Our innovative approach ensures our clients receive not just data, but actionable intelligence that … drives efficiency and safety in their operations. The Role: We are seeking a dynamic and adaptable Senior Software Engineer to deliver the next generation of data ingestion, analysis, and display functionality for our new greenfield product, ‘Platform Vi’. This product is being developed for both internal stakeholders and our customers, providing them with valuable insights into their … Proven experience in developing and contributing to production applications using Java, the Spring Framework and GraphQL/REST APIs. Strong understanding of backend system design, including infrastructure, APIs, and data storage. Proficiency in writing clean, maintainable, and testable code, with experience using testing frameworks such as JUnit and familiarity with Test-Driven Development (TDD). Strong understanding of Continuous More ❯

and profitability. Your primary focus will be integrating ML-driven credit and eligibility models into our Ruby on Rails monolith. These models, written in Python by ML engineers and data scientists, require robust, scalable integration patterns; you’ll own the productionisation of those services: from data ingestion and interface design to monitoring, alerting, and runtime observability. You … engineers. What We’re Looking For You’re a backend engineer who’s comfortable working in technically complex domains - particularly those involving machine learning, financial decisioning, or large-scale data systems. You're proficient in Ruby and have experience building and maintaining production systems that interface with machine learning models, data pipelines, or high-throughput decision engines. Exposure … observability, system reliability, and deployment best practices. You know how to make integrations robust and maintainable, and how to ensure they operate correctly in production over time. You’re data-aware - able to reason about data lifecycle, ownership, transformations, and how downstream consumers rely on it. You’re also a strong cross-functional collaborator, able to work closely More ❯

+ benefits + bonus potential About Us Come and be a part of The Investigo Group (TIG ), a dynamic coalition of cutting-edge tech firms specialising in Platform, Software, Data, AI and other bleeding-edge technology solutions. Our innovative prowess spans the globe while proudly hailing from the United Kingdom. The group is multi-functional with a large portfolio … for our community. The Consultancy side concentrates on expert support of our customers as well as specifically assigned individual deployments. Collaboraite is a bleeding-edge company that provides our Data and AI capability. A collaborative partner for designing user-centred secure data solutions to overcome operational hurdles, delivered through design thinking and agile coaching. Diversity, Equity, and Inclusion … inclusive environment where every voice matters, driving innovation and progress in our dynamic tech community. The group provides bespoke, secure, user-centric products fuelled by deep technical knowledge advanced data and analytical skills. We proudly stand as a global leader in this space, partnering with esteemed entities that require these advanced forward-thinking capabilities. These partnerships have been forged More ❯

Test Data Engineer, london (city of london) Client: Mastek Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes Job Views: 7 Posted: 26.06.2025 Expiry Date: 10.08.2025 Job Description: Job Title: Test Data Engineer Location: London, UK (3 days in office) SC Cleared: Required Job Type: Full-Time Experience: 5+ years Job Summary … We are seeking a highly skilled and detail-oriented Test Data Engineer to join our growing team. As a Test Data Engineer, you will be responsible for designing, implementing, and executing test cases and scripts for software applications in the banking domain. You will work closely with the development team to identify and resolve defects, ensure product quality … and deliver reliable and efficient software solutions. Key Data-Testing Responsibilities: Test Internal data ingestion and reference data ingestion Data Ingress – Source to Landing Zone Landing Zone to Bronze Silver to Gold – Curation Registration in Unity Catalogue/Purview Macrobond PCX use case tests Scripts PCX use case tests Output Dataset labelling algorithm tests More ❯

Data Software Engineer - London-based hedge fund Location: London, UK A top-tier global trading firm is seeking a skilled Data Software Engineer to join its London-based Global Data Engineering team. In this role, you'll architect and implement a high-performance framework for modelling financial instruments, working with a complex ecosystem of financial and alternative … datasets to drive strategic decision-making in low- to high-frequency trading. Role Overview As a key contributor to the data engineering team, you'll tackle some of the most challenging problems at the intersection of financial data and technology, including: Designing and deploying a scalable, high-throughput data model to unify financial instrument identifiers across vendors … markets, and timeframes. Building and optimizing data pipelines for global data ingestion, processing, and validation with Python. Leveraging cloud technologies (e.g., S3) to handle massive datasets while maintaining performance standards. Collaborating with cross-functional teams worldwide to align data solutions with trading objectives and technical requirements, ensuring consistency and precision in data handling. Your Skill More ❯

apply: Complete the online applications form using this link: https://forms.office.com/e/FxFGZgxmXy Role Summary The Football Department at Leeds United is working to leverage data to enhance decision making from analysis and recruitment to performance and medicine. We are looking for an individual to build robust pipelines to create a data infrastructure ready … for data science modelling and to support our football platform. Role Responsibilities Data Pipelines & Infrastructure: working with our Football Data Platform Lead, you will maintain and build data pipelines that serve our models, tools and central platform. Data Ingestion: Further develop our central data storage and integrate new data sources Data Standardisation: Leverage SQL to create a standardised layer across our various data types to allow for efficient and scalable data science and analysis. Data Synchronisation: you will enhance integrations between event and tracking datasets Metric Development: you will develop player and team metrics from our event-tracking models Other Responsibilities To take responsibilities for personal performance More ❯

Social network you want to login/join with: Data Software Engineer – London-based hedge fund, London col-narrow-left Client: Oxford Knight Location: London, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 883e105d196b Job Views: 4 Posted: 29.06.2025 Expiry Date: 13.08.2025 col-wide Job Description: Location: London, UK A top … tier global trading firm is seeking a skilled Data Software Engineer to join its London-based Global Data Engineering team. In this role, you’ll architect and implement a high-performance framework for modelling financial instruments, working with a complex ecosystem of financial and alternative datasets to drive strategic decision-making in low- to high-frequency trading. Role … Overview As a key contributor to the data engineering team, you’ll tackle some of the most challenging problems at the intersection of financial data and technology, including: Designing and deploying a scalable, high-throughput data model to unify financial instrument identifiers across vendors, markets, and timeframes. Building and optimizing data pipelines for global data More ❯

Social network you want to login/join with: Software Engineer III Data Lake Engineer, London col-narrow-left Client: Location: London, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: d4217e416aa3 Job Views: 42 Posted: 22.06.2025 Expiry Date: 06.08.2025 col-wide Job Description: We have an exciting and rewarding opportunity for you … capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Solid understanding of software applications and technical processes within a related technical discipline (. data ingestion, data storage, data serving, APIs, . Hands-on experience in data lake or data warehouse and related technologies (. Spark, ETL, Databricks). More ❯

Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham Client: CGI Location: Birmingham, United Kingdom Job Category: Other EU work permit required: Yes Job Reference: 68452019cc93 Job Views: 4 Posted: 29.06.2025 Expiry Date: 13.08.2025 Job Description: Position Description: Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham We … re growing rapidly and are looking for a Solution Architect to join our team and help us develop and deploy enterprise-grade platforms that enable data-driven solutions. You will be responsible for designing, implementing, and overseeing data-driven solutions that support business objectives. This role bridges the gap between business needs and technical implementation, ensuring that solutions … inclusive place where you’re empowered to chart your own path, then we’d love to meet you. Your future duties and responsibilities: Develop end-to-end architecture for data science and AI/ML solutions. Ensure integration with existing enterprise systems and data pipelines. Define best practices for data ingestion, processing, storage, and model deployment. More ❯

Base c. £140-155 k + bonus and LTIP (flexible for the right hire) 35 days leave │ 14 % pension │ full family healthcare Purpose Establish and scale a single enterprise data backbone for a global retail-investing and pensions platform (~£400 bn AUA), enabling regulatory-grade lineage, real-time analytics, and API-driven product innovation. You will be tasked with … the front, middle and back-office solution, defining the interactions, integration and data model transformation. Candidate with no Investment or Asset Management experience are not being considered for this role! 12-Month Success Metrics Publish an enterprise-wide canonical data model covering custody, wrappers, trading, and digital touchpoints. Stand-up policy-as-code controls delivering automated Consumer Duty … CASS MI. Migrate 60 % of legacy ETL into an event-stream/Snowflake lakehouse pattern, cutting report latency to Embed data-product operating model across UK & India hubs; uplift data-literacy score by 25 %. Architecture & Design Authority : Define reference architectures, patterns, and guardrails for data ingestion, storage, lineage, and access. Governance & Quality : Chair Data More ❯

The BBC's digital products play a key role in our mission to inform, educate and entertain the audience. We are looking for an Engineering Manager to join the Data Engineering team. The BBC offers an inclusive workplace where the principles of fairness, respect, equality, dignity, and autonomy are promoted and are part of our everyday goals and behaviour. … based questions. Interviews expected to begin the week 7th July 2025. · 2nd stage - Technical Interview Job Description As the Engineering Manager for the Insights Tooling team within BBC's Data Platform, you will lead up to 50 engineers, including Software Engineering Team Leads and Principal Engineers, to transform siloed analytics solutions into a unified, API-driven platform on AWS. … Your work will empower teams across the BBC-from journalists to executives-to make data-informed decisions by delivering scalable, user-friendly data products. You will collaborate with Engineering, Architecture, Product, and UX leaders to drive technical excellence while fostering a culture of innovation, inclusivity, and best practices in data engineering. Main Responsibilities Platform Leadership: Architect and More ❯

Data Analyst, Data Engineer, SQL, Informatica, ETL, Data Ingestion, Data Integration, Data Analytics, Data Science There is a new role with an industry-leading Data Analytics and Data Science company based in London, looking for a Data Analyst/Data Engineer to join their business and build a career … within the business. Established six years ago, the company have grown rapidly and are now recognized as one of the industry leaders in the Data Analytics/Data Science space. They provide complex data solutions for blue chip and enterprise grade clients using cutting-edge data and cloud technology. They are looking for a Data Analyst/Data Engineer to work across all areas of the business, defining data requirements across business units, analysing the relationships of data and technical data feed requirements aswell as working in proximity to architects on the Data Warehouse design, build and deployment This is a junior role, and as such will have a More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across … the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across … the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting More ❯

are known for being a pioneer in Cyber insurance are looking for a Python Developer to join their growing team. This is a unique role with exposure to the data space in a high-functioning team. This role sits at the heart of a cyber data innovation team, focused on building and evolving a proprietary platform that powers … risk intelligence and customer protection. You'll work across large-scale data ingestion, performance APIs, Real Time event handling, and quality-first design - all aimed at delivering actionable insights that matter. Responsibilities: Designing and developing robust data ingestion pipelines and high-performance APIs Working with large, fast-moving datasets to improve product capability and data quality Supporting infrastructure (IaC) and CI/CD processes in Azure and AWS Collaborating across teams to model data for both operational and analytical use cases Leading on data quality metrics, testing automation, and clean documentation Mentoring and contributing to a modern, pairing-friendly engineering culture Technology Stack: Python, SQL (Postgres, SQL Server), Linux/WSL Azure More ❯

Quantitative Developer - Risk Technology Millennium is a top tier global hedge fund with a strong commitment to technology and data science. We are looking for a Quantitative Developer to join our Risk Technology team in London. The developer will use Python, AWS and data manipulation libraries to provide risk managers with data-driven insights on our fund … Work closely with quants, risk managers and other technologists in New York, Tel Aviv and Singapore to develop risk analytics solutions for our Fixed-Income business. Develop micro-services, data ingestion pipelines and APIs to feed tools and dashboards that monitor Millennium’s market risks. Analyse data with pandas/polars to present data in the … understanding of financial instruments and services. Strong analytical skills & problem-solving capabilities. Ability to work independently in a fast-paced environment. Minimum 2 years’ experience working with Python, and data analysis libraries (Pandas/Polars/Numpy). Experience with REST APIs and cloud services. Relational SQL database development experience. Unix/Linux command-line experience. Detail oriented, organised More ❯

Machine Learning Engineer Location: York or Manchester This position is for an experienced Machine Learning Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The … engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment framework for all data science services. You will have oversight of how data will flow into the data science life … cycle from the wider business data warehouse. Oversight of the automation of the data science life cycle (dataset build, training, evaluation, deployment, monitoring) when we move to production. Automate the data science pipeline (data prep to deployment). Collaborate with cross-functional teams to ensure smooth productionisation of models. Write clean, production-ready Python code. Apply More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building and developing the tooling … and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work from anywhere for … and their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own analyses More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building and developing the tooling … and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work from anywhere for … and their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own analyses More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building and developing the tooling … and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work from anywhere for … and their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own analyses More ❯

Developer to join a world-leading investment bank’s Front Office Quantitative Technology team in London . You will design, build, and optimise low-latency, high-performance time-series data systems used for real-time analytics , trading , and decision-making across global markets. This is a critical hire for an elite team driving alpha-generation tools and cutting-edge … data platforms using KDB+/q . 🧠 Key Responsibilities Develop and maintain scalable KDB+/q solutions for real-time market data ingestion, processing, and analytics. Collaborate directly with quant traders , quants , and front office technologists to build mission-critical trading systems. Optimise existing KDB+ databases for performance, latency, and storage efficiency . Design and implement solutions … for tick data capture , data normalisation , and time-series analysis . Contribute to architectural decisions around data pipelines , streaming platforms , and KX integration . Ensure high availability and reliability of market data infrastructure in high-pressure, low-latency environments . ✅ Required Skills & Experience 3+ years of hands-on commercial experience with KDB+/q in a More ❯

Developer to join a world-leading investment bank’s Front Office Quantitative Technology team in London . You will design, build, and optimise low-latency, high-performance time-series data systems used for real-time analytics , trading , and decision-making across global markets. This is a critical hire for an elite team driving alpha-generation tools and cutting-edge … data platforms using KDB+/q . 🧠 Key Responsibilities Develop and maintain scalable KDB+/q solutions for real-time market data ingestion, processing, and analytics. Collaborate directly with quant traders , quants , and front office technologists to build mission-critical trading systems. Optimise existing KDB+ databases for performance, latency, and storage efficiency . Design and implement solutions … for tick data capture , data normalisation , and time-series analysis . Contribute to architectural decisions around data pipelines , streaming platforms , and KX integration . Ensure high availability and reliability of market data infrastructure in high-pressure, low-latency environments . ✅ Required Skills & Experience 3+ years of hands-on commercial experience with KDB+/q in a More ❯

a dynamic self-starter to join their innovative team in the heart of London. If you thrive in a fast-paced environment and want to contribute to cutting-edge data science applications, this is the perfect opportunity for you! About Client: Our client is a leading global payments technology company that enables businesses of all sizes to accept payments … geographies. They handle billions of transactions annually, offering secure, scalable solutions that support innovation in the financial ecosystem. With deep industry expertise, they empower merchants to grow through advanced data insights and reliable infrastructure. What You'll Do : Design, develop, and deploy machine learning models that solve real-world problems. Collaborate with cross-functional teams to improve production systems … and ensure seamless integration of ML models. Drive the ML life cycle from data ingestion to model deployment and monitoring. Implement CI/CD pipelines and leverage DevOps practices to enhance operational efficiency. What You Need : A relevant BSc/MSc degree in a related field with strong industry experience. Proven expertise in ML engineering and MLOps, with More ❯

investment adviser. Overview: We are looking for a Risk Analytics Manager to join our Risk team. This role is critical in ensuring the integrity of both input and output data across our in-house and third-party risk systems. The ideal candidate will have a strong background in risk management, combined with hands-on experience in software development and … data engineering. Responsibilities: Develop, validate, and maintain risk reporting tools and dashboards. Design and enhance risk metrics and reports to support trading decisions and risk oversight. Collaborate with stakeholders across trading, technology, and risk to understand evolving requirements and continuously improve the risk analytics and reporting framework. Oversee the quality and consistency of data used in internal and … external risk systems and processes. Troubleshoot and improve data ingestion, transformation, and analysis pipelines. Keep track of and communicate the key assumptions and methods used in the analytics. Requirements: 5+ years of experience in a risk analytics or similar role within a financial institution. Strong programming and scripting skills in Python and SQL. Experience in Django and JavaScript More ❯