151 to 175 of 382 Data Ingestion Jobs in England

Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity to join a leading AI company whose Machine Learning product suite creates new … trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While most companies process data in days, hours, or minutes, our client … driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform services that underpin our products, in tandem with SME’s in data science and quantitive finance. Contribute new products and technical ideas, providing feedback and collaboration sessions. Work closely with QA to ensure that systems are engineered accordingly What we’re More ❯

development of scalable trading platforms and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality through code reviews, CI/… workflows. Own deployment pipelines across cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software development, with exposure to both … and storage configurations. Familiarity with monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure, latency optimization, execution systems, and market data feeds. Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a team of 3–10 engineers. Ability More ❯

development of scalable trading platforms and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality through code reviews, CI/… workflows. Own deployment pipelines across cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software development, with exposure to both … and storage configurations. Familiarity with monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure, latency optimization, execution systems, and market data feeds. Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a team of 3–10 engineers. Ability More ❯

development of scalable trading platforms and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality through code reviews, CI/… workflows. Own deployment pipelines across cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software development, with exposure to both … and storage configurations. Familiarity with monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure, latency optimization, execution systems, and market data feeds. Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a team of 3–10 engineers. Ability More ❯

+ benefits + bonus potential About Us Come and be a part of The Investigo Group (TIG ), a dynamic coalition of cutting-edge tech firms specialising in Platform, Software, Data, AI and other bleeding-edge technology solutions. Our innovative prowess spans the globe while proudly hailing from the United Kingdom. The group is multi-functional with a large portfolio … for our community. The Consultancy side concentrates on expert support of our customers as well as specifically assigned individual deployments. Collaboraite is a bleeding-edge company that provides our Data and AI capability. A collaborative partner for designing user-centred secure data solutions to overcome operational hurdles, delivered through design thinking and agile coaching. Diversity, Equity, and Inclusion … inclusive environment where every voice matters, driving innovation and progress in our dynamic tech community. The group provides bespoke, secure, user-centric products fuelled by deep technical knowledge advanced data and analytical skills. We proudly stand as a global leader in this space, partnering with esteemed entities that require these advanced forward-thinking capabilities. These partnerships have been forged More ❯

Data Engineer | Location: Leeds (4 days per week in office with some flexibility) | Salary: £60,000-£80,000 The Opportunity Our client is seeking a skilled and motivated Data Engineer to play a key role in the creation of a brand-new data platform within the Azure ecosystem including Azure Data Factory (ADF), Synapse and PySpark …/Databricks and Snowflake. You will be a data ingestion and ETL Pipeline guru, tackling complex problems at source in order to retrieve the data and ensure to can flow upstream to the Snowflake DWH. You will not be an analytics engineer or someone who operates at the latter stages of the development lifecycle unless you have … skills and desire to work on data ingestion, ETL/ELT. Key Responsibilities Build & Develop robust ETL/Data Ingestion pipelines leveraging Azure Data Factory, Synapse, PySpark and Python. Connect APIs, databases, and data streams to the platform, implementing ETL/ELT processes. Data Integrity – Embed quality measures, monitoring, and alerting mechanisms. CI More ❯

Social network you want to login/join with: Data Engineer - Hybrid/Bristol - Up to £55k, Bristol col-narrow-left Client: Location: Bristol, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 5e1215c48b22 Job Views: 4 Posted: 25.06.2025 Expiry Date: 09.08.2025 col-wide Job Description: Data Engineer - Hybrid/Bristol … Up to £55, Job Title : Data Engineer Responsibilities : - Pipeline Development and Optimisation : Continuously assess and improve the performance of data enrichment pipelines, ensuring their efficiency, dependability, and scalability. - Data Management : Design and implement robust processes for data ingestion and cleaning, supporting machine learning and analytical models. - Collaborative Problem-Solving : Work closely with data scientists … Deployment : Assist in building, training, monitoring, and deploying cutting-edge machine learning models. - Stay Current with AI/ML Trends : Keep up to date with the latest advancements in data processing, AI, and ML, and incorporate them into our client's processes to improve efficiency. - Adaptable Approach : Collaborate across different functions as required, including taking on backend development tasks More ❯

transforms, and handling seasonality. Proven ability to tune the performance of existing deployed forecasting models. Must have experience with Azure Machine Learning Python SDK v1/v2 to: Manage data, models, and environments Build/debug AML pipelines to stitch together multiple tasks (feature engineering, training, registering models, etc.) and production workflows using Azure ML pipelines Schedule Azure ML … jobs Deploy registered models to create endpoints. Good to have experience with K-Means clustering. Must utilized Azure services such as Azure Data Factory, Azure Databricks, Azure Data Lake, and Azure Key Vault to architect and maintain scalable data solutions. Design, develop, and deploy new Azure Data Factory (ADF) pipelines for data ingestion, transformation … and logging, ensuring robustness and reliability. Proficiently transform and manipulate data using PySpark and Python, leveraging their capabilities to derive actionable insights from complex datasets. Collaborate with cross-functional teams to understand data requirements and translate them into effective technical solutions. Lead the implementation and optimization of CI/CD pipelines using Azure DevOps, ensuring a seamless build More ❯

transforms, and handling seasonality. Proven ability to tune the performance of existing deployed forecasting models. Must have experience with Azure Machine Learning Python SDK v1/v2 to: Manage data, models, and environments Build/debug AML pipelines to stitch together multiple tasks (feature engineering, training, registering models, etc.) and production workflows using Azure ML pipelines Schedule Azure ML … jobs Deploy registered models to create endpoints. Good to have experience with K-Means clustering. Must utilized Azure services such as Azure Data Factory, Azure Databricks, Azure Data Lake, and Azure Key Vault to architect and maintain scalable data solutions. Design, develop, and deploy new Azure Data Factory (ADF) pipelines for data ingestion, transformation … and logging, ensuring robustness and reliability. Proficiently transform and manipulate data using PySpark and Python, leveraging their capabilities to derive actionable insights from complex datasets. Collaborate with cross-functional teams to understand data requirements and translate them into effective technical solutions. Lead the implementation and optimization of CI/CD pipelines using Azure DevOps, ensuring a seamless build More ❯

Senior Data Engineer - £82,000 - Hybrid & Remote Flexibility No Sponsorship Available Company We are a forward-thinking technology company dedicated to simplifying complex processes through innovative solutions. With a focus on enhancing efficiency and transparency, we strive to deliver outstanding experiences for our customers. Our team operates with a flexible hybrid working model, fostering collaboration and innovation in a … supportive environment. Responsibilities As a Senior Data Engineer, you'll play a pivotal role in advancing our data infrastructure to support our expanding scope and responsibilities. Key responsibilities include: Enhancing the reliability and stability of our data infrastructure. Managing data ingestion pipelines using tools such as Azure Data Factory (ADF) and Python. Ensuring the … quality of raw datasets to empower Data Analysts in creating robust data models. Deploying and managing data tools on Kubernetes (Airflow, Superset, RStudio Connect). Supporting Data Analytics through the management of DBT, DevOps, and deployment rules. You will have the opportunity to work end-to-end, making meaningful contributions within a small, agile team. Experience More ❯

Senior Data Engineer - £82,000 - Hybrid & Remote Flexibility No Sponsorship Available Company We are a forward-thinking technology company dedicated to simplifying complex processes through innovative solutions. With a focus on enhancing efficiency and transparency, we strive to deliver outstanding experiences for our customers. Our team operates with a flexible hybrid working model, fostering collaboration and innovation in a … supportive environment. Responsibilities As a Senior Data Engineer, you'll play a pivotal role in advancing our data infrastructure to support our expanding scope and responsibilities. Key responsibilities include: Enhancing the reliability and stability of our data infrastructure. Managing data ingestion pipelines using tools such as Azure Data Factory (ADF) and Python. Ensuring the … quality of raw datasets to empower Data Analysts in creating robust data models. Deploying and managing data tools on Kubernetes (Airflow, Superset, RStudio Connect). Supporting Data Analytics through the management of DBT, DevOps, and deployment rules. You will have the opportunity to work end-to-end, making meaningful contributions within a small, agile team. Experience More ❯

DV (MOD) Cleared Data Engineer - Elastic Stack & Apache NiFi Location: Bristol | Contract Type: £430.00 pd (Outside IR35) | Working Pattern: Hybrid (3 - 4 days on-site) Are you a contract Data Engineer with a knack for designing secure, high-performance data solutions? We're on the lookout for a technical expert in the Elastic Stack and Apache NiFi … to take the lead in building robust, real-time data pipelines in a security-focused environment. This is a hands-on contract opportunity to make a real impact-ideal for professionals with a strong track record in regulated sectors. What You'll Be Doing Designing and deploying scalable, secure data pipelines using Elasticsearch, Logstash, Kibana, and Apache NiFi … Handling real-time data ingestion and transformation with an emphasis on integrity and availability Collaborating with architects and cybersecurity stakeholders to align with governance and compliance needs Monitoring and optimising high-throughput data flows across on-prem and cloud environments Building insightful Kibana dashboards to support business intelligence and operational decision-making Maintaining documentation of data More ❯

DV (MOD) Cleared Data Engineer - Elastic Stack & Apache NiFi Location: Bristol | Contract Type: GBP430.00 pd (Outside IR35) | Working Pattern: Hybrid (3 - 4 days on-site) Are you a contract Data Engineer with a knack for designing secure, high-performance data solutions? We're on the lookout for a technical expert in the Elastic Stack and Apache NiFi … to take the lead in building robust, Real Time data pipelines in a security-focused environment. This is a hands-on contract opportunity to make a real impact-ideal for professionals with a strong track record in regulated sectors. What You'll Be Doing Designing and deploying scalable, secure data pipelines using Elasticsearch, Logstash, Kibana, and Apache NiFi … Handling Real Time data ingestion and transformation with an emphasis on integrity and availability Collaborating with architects and cybersecurity stakeholders to align with governance and compliance needs Monitoring and optimising high-throughput data flows across on-prem and cloud environments Building insightful Kibana dashboards to support Business Intelligence and operational decision-making Maintaining documentation of data More ❯

Job Title: Data Engineer (NPPV3 + SC Clearance Required)Location: Hybrid (UK-based)Contract: 3 Months (with potential extension/move to other projects)Rate: £550 per day (Outside IR35)A bout the Role:We are seeking an experienced Data Engineer with NPPV3 + SC clearance to join our dynamic team on a 3-month contract basis. This … role offering the flexibility of working both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and … storage in cloud environments.* Troubleshoot and optimise data workflows for performance and reliability.* Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions. More ❯

Data Engineer - £75,000 per annum - Azure - Snowflake - Finance Data Engineer - £75,000 per annum - Azure - Snowflake - Finance Direct message the job poster from VirtueTech Recruitment Group Head of Permanent - Data, Product and Infrastructure at VirtueTech Recruitment Group Data Engineer - £75,000 per annum - Azure - Snowflake - Finance My client are seeking a Data Engineer to … join their tech function, this role will report to the Lead Data Engineer, and has a focus on building and maintaining a robust data infrastructure to support the business's strategic goals. This role involves developing and managing data ingestion and transformation pipelines using modern tools such as Fivetran, DBT, and GitLab, while collaborating with business … end-users to ensure systems are continuously enhanced to meet evolving needs. In this role you’ll play a crucial part in the migration of legacy systems to modern data platforms, supporting the creation of insightful management information dashboards and scalable data solutions. The role requires hands-on experience in developing and maintaining high-quality code aligned with More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

required: Yes col-narrow-right Job Views: 4 Posted: 26.06.2025 Expiry Date: 10.08.2025 col-wide Job Description: My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting … and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio … Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams More ❯

our purpose is to radically accelerate the clean-energy revolution - starting withsmarter, safer, and more efficient homes.We're focused on improving experiences for people through the application of technology, data, and a deep understanding of human behaviour. Why? As a society, we need to decarbonise and accelerate the transition to alternative energy sources. Existing solutions are expensive and disparate … led and puts people at its core, then we'd love to hear from you! The Role We're looking to grow our quality and test coverage in our data space. In this Intermediate-Senior role,you'll be helping us to implement processes, architectures and test coverage for validating our data backend with your excellent software skills … and guidance. We have an existing small team working and building the data backend and we need a QA engineer to work with the team to verify and validate this part of our product. Some of the things that you might be involved in include: Lead Data Quality Assurance: Develop and implement comprehensive testing for our data More ❯

poster from Digital Waffle Tech Recruitment Manager (DevOps, Cloud & Infrastructure) for the UK & US . Get in touch to find out how I can solve your hiring problems! Senior Data Insights Analyst Data-Driven Strategy | Revenue Optimisation | Business Impact PowerBI SQL VBA Are you an intellectually curious, highly motivated analyst with a passion for turning data into … real business value? We’re on the hunt for a Senior Data Insights Analyst to join our fast-growing team in Oxford — someone ready to roll up their sleeves and make a meaningful impact from day one. This role sits at the core of our business , where data isn’t just a resource — it’s the engine powering … our product innovation, customer experience, and revenue growth. About the Role As part of our high-performing Data Insight Team , you’ll be working with large datasets to extract critical trends, uncover growth opportunities, and drive fast-paced, data-informed decision-making. You'll influence key business strategies, using insights to directly shape product performance and customer satisfaction. More ❯

Closing Date 2025-06-30 Job Title: Head of Data, Analytics and AI Location: Hybrid working between our offices in Falmer (East Sussex), Durrington (Worthing) and home. Contract Type: Permanent Hours: 37 hours per week, Monday - Friday Salary: Commensurate to experience + car allowance. Southern Water is dedicated to providing reliable and sustainable water and wastewater services to millions … committed to leveraging innovative solutions to enhance our operations and services. We are at a pivotal moment in our journey, embarking on a transformative initiative in the fields of Data, Analytics, and Artificial Intelligence (AI). This transformation will harness the power of data to drive strategic decision-making, optimise and automate processes, and deliver exceptional value to … our customers. As the Head of Data, Analytics & AI, you will play a crucial role in shaping and leading this transformation, positioning Southern Water at the forefront of technological advancement in the water industry. This is an exciting opportunity to join a forward-thinking organisation and make a significant impact on our future. The Head of Data, Analytics More ❯

Join to apply for the Data Migration Lead - Dynamics D365 - CRM, BC, F&O/F&SCM role at Experis UK 2 days ago Be among the first 25 applicants Join to apply for the Data Migration Lead - Dynamics D365 - CRM, BC, F&O/F&SCM role at Experis UK Get AI-powered advice on this job … and more exclusive features. Full Time Role - Fully Hybrid - Work from Home - with Occasional Travel to Client Sites - Fully Expensed Enterprise Solution Data Migrations encompassing D365 CRM, BC, F&O/F&SCM for Small to Large-Scale Migrations within an Agile Delivery Model, working both hands-on and in a "Solution Lead Capacity". In this role, you … will Lead and Shape the Key, Focussed, Data Migration Service Portfolio that clients expect! Location is UK - Office HQ is West Midlands with a UK Wide Clientele - Work from Home is Guaranteed - Remote First! Salary: To Start is at the £80,000pa mark + An Excellent Benefits Package + Remote Working + Training & Certifications Full Security and DBS Vetting More ❯

risk management for years to come. As a Quant Developer, you will work at the intersection of quantitative research, machine learning, and software engineering. You'll collaborate with quants, data scientists, and portfolio managers to design and implement scalable systems for data ingestion, model training, and real-time signal deployment. Key Responsibilities Design and develop robust, high … performance systems for AI/ML model development and deployment. Collaborate with quantitative researchers to translate trading strategies into production-ready code. Build and maintain data pipelines for structured and unstructured financial data. Implement backtesting frameworks and simulation environments. Optimise model inference and execution latency for real-time trading. Contribute to architectural decisions and technology stack selection for the … and deployment. Experience with quantitative finance, including time series analysis, alpha modelling, or risk analytics. Familiarity with cloud infrastructure (e.g., AWS, GCP) and containerisation (Docker, Kubernetes). Proficiency with data engineering tools Experience working in fast-paced, collaborative environments with agile methodologies. Nice to Have Prior experience in a hedge fund, prop trading firm, or investment bank. Exposure to More ❯

your recruiter to learn more. Base pay range Direct message the job poster from Synchro We are actively recruiting multiple KDB Developers at various levels for a fast-paced, data-driven organisation at the forefront of real-time analytics and high-performance computing. This organisation are a consultancy working with some of the leading names in the financial services … sector. The Role: As a KDB Developer, you will be responsible for designing, developing, and maintaining high-performance applications and data analytics solutions using kdb+/q. You’ll work closely with quants, traders, and data scientists to deliver scalable systems and actionable insights from large volumes of time-series data. Key Responsibilities: Design, implement, and optimise kdb+ …/q-based applications and data pipelines Work on real-time data ingestion, transformation, and analysis Collaborate with stakeholders to gather requirements and translate them into technical solutions Maintain and enhance existing codebases, ensuring high availability and performance Contribute to architectural decisions and best practices for kdb+ systems Troubleshoot and resolve production issues quickly and effectively Required More ❯

Get AI-powered advice on this job and more exclusive features. Millennium is a top tier global hedge fund with a strong commitment to leveraging innovations in technology and data science to solve complex problems for the business. Risk Technology team is looking for a Quantitative Developer who would leverage Python, Cloud infrastructure (AWS), and scientific frameworks to provide … data-driven, risk management solutions to Risk Managers, Portfolio Managers, Business Management. Responsibilities Work in the intersection of Portfolio Management, Risk Management and Quantitative Research to develop risk analytics solutions for Equity Derivatives businesses. Collaborate with risk management for rapid prototyping and delivery of solutions to enhancement risk metrics. Develop data ingestion pipelines and analytics the generated … information. Design and implement cloud-native, data-intensive applications that effectively leverage AWS solutions Mentor junior team members, fostering growth and collaboration within the team. Fit into the active culture of Millennium, judged by the ability to deliver timely solutions to Portfolio and Risk Managers Required Skills/Experience Minimum 5 years of experience using Python and scientific python More ❯