176 to 200 of 407 Data Ingestion Jobs in England

Job Title: Data Engineer (NPPV3 + SC Clearance Required)Location: Hybrid (UK-based)Contract: 3 Months (with potential extension/move to other projects)Rate: £550 per day (Outside IR35)A bout the Role:We are seeking an experienced Data Engineer with NPPV3 + SC clearance to join our dynamic team on a 3-month contract basis. This … role offering the flexibility of working both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and … storage in cloud environments.* Troubleshoot and optimise data workflows for performance and reliability.* Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions. More ❯

Data Engineer - £75,000 per annum - Azure - Snowflake - Finance Data Engineer - £75,000 per annum - Azure - Snowflake - Finance Direct message the job poster from VirtueTech Recruitment Group Head of Permanent - Data, Product and Infrastructure at VirtueTech Recruitment Group Data Engineer - £75,000 per annum - Azure - Snowflake - Finance My client are seeking a Data Engineer to … join their tech function, this role will report to the Lead Data Engineer, and has a focus on building and maintaining a robust data infrastructure to support the business's strategic goals. This role involves developing and managing data ingestion and transformation pipelines using modern tools such as Fivetran, DBT, and GitLab, while collaborating with business … end-users to ensure systems are continuously enhanced to meet evolving needs. In this role you’ll play a crucial part in the migration of legacy systems to modern data platforms, supporting the creation of insightful management information dashboards and scalable data solutions. The role requires hands-on experience in developing and maintaining high-quality code aligned with More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

required: Yes col-narrow-right Job Views: 4 Posted: 26.06.2025 Expiry Date: 10.08.2025 col-wide Job Description: My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting … and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio … Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams More ❯

our purpose is to radically accelerate the clean-energy revolution - starting withsmarter, safer, and more efficient homes.We're focused on improving experiences for people through the application of technology, data, and a deep understanding of human behaviour. Why? As a society, we need to decarbonise and accelerate the transition to alternative energy sources. Existing solutions are expensive and disparate … led and puts people at its core, then we'd love to hear from you! The Role We're looking to grow our quality and test coverage in our data space. In this Intermediate-Senior role,you'll be helping us to implement processes, architectures and test coverage for validating our data backend with your excellent software skills … and guidance. We have an existing small team working and building the data backend and we need a QA engineer to work with the team to verify and validate this part of our product. Some of the things that you might be involved in include: Lead Data Quality Assurance: Develop and implement comprehensive testing for our data More ❯

Data Migration Lead - Dynamics D365 - CRM, BC, F&O/F&SCM Full Time Role - Fully Hybrid - Work from Home - with Occasional Travel to Client Sites - Fully Expensed Enterprise Solution Data Migrations encompassing D365 CRM, BC, F&O/F&SCM for Small to Large-Scale Migrations within an Agile Delivery Model, working both hands-on and in … a "Solution Lead Capacity". In this role, you will Lead and Shape the Key, Focussed, Data Migration Service Portfolio that clients expect! Location is UK - Office HQ is West Midlands with a UK Wide Clientele - Work from Home is Guaranteed - Remote First! Salary: To Start is at the £80,000pa mark + An Excellent Benefits Package + Remote … Security and DBS Vetting will be necessary on presentation of a Job Offer to the Successful Candidate. The person required for the is role: You will be a proven Data Migration Leader with expertise and deep understanding of data migrations to Dynamics 365 and other similar SaaS applications. You will have end-to-end experience of delivering Enterprise More ❯

poster from Digital Waffle Tech Recruitment Manager (DevOps, Cloud & Infrastructure) for the UK & US . Get in touch to find out how I can solve your hiring problems! Senior Data Insights Analyst Data-Driven Strategy | Revenue Optimisation | Business Impact PowerBI SQL VBA Are you an intellectually curious, highly motivated analyst with a passion for turning data into … real business value? We’re on the hunt for a Senior Data Insights Analyst to join our fast-growing team in Oxford — someone ready to roll up their sleeves and make a meaningful impact from day one. This role sits at the core of our business , where data isn’t just a resource — it’s the engine powering … our product innovation, customer experience, and revenue growth. About the Role As part of our high-performing Data Insight Team , you’ll be working with large datasets to extract critical trends, uncover growth opportunities, and drive fast-paced, data-informed decision-making. You'll influence key business strategies, using insights to directly shape product performance and customer satisfaction. More ❯

Closing Date 2025-06-30 Job Title: Head of Data, Analytics and AI Location: Hybrid working between our offices in Falmer (East Sussex), Durrington (Worthing) and home. Contract Type: Permanent Hours: 37 hours per week, Monday - Friday Salary: Commensurate to experience + car allowance. Southern Water is dedicated to providing reliable and sustainable water and wastewater services to millions … committed to leveraging innovative solutions to enhance our operations and services. We are at a pivotal moment in our journey, embarking on a transformative initiative in the fields of Data, Analytics, and Artificial Intelligence (AI). This transformation will harness the power of data to drive strategic decision-making, optimise and automate processes, and deliver exceptional value to … our customers. As the Head of Data, Analytics & AI, you will play a crucial role in shaping and leading this transformation, positioning Southern Water at the forefront of technological advancement in the water industry. This is an exciting opportunity to join a forward-thinking organisation and make a significant impact on our future. The Head of Data, Analytics More ❯

Join to apply for the Head of Data, Analytics and AI role at Southern Water Join to apply for the Head of Data, Analytics and AI role at Southern Water Get AI-powered advice on this job and more exclusive features. Closing Date 2025-06-30 Job Title: Head of Data, Analytics and AI Location: Hybrid working … committed to leveraging innovative solutions to enhance our operations and services. We are at a pivotal moment in our journey, embarking on a transformative initiative in the fields of Data, Analytics, and Artificial Intelligence (AI). This transformation will harness the power of data to drive strategic decision-making, optimise and automate processes, and deliver exceptional value to … our customers. As the Head of Data, Analytics & AI, you will play a crucial role in shaping and leading this transformation, positioning Southern Water at the forefront of technological advancement in the water industry. This is an exciting opportunity to join a forward-thinking organisation and make a significant impact on our future. The Head of Data, Analytics More ❯

risk management for years to come. As a Quant Developer, you will work at the intersection of quantitative research, machine learning, and software engineering. You'll collaborate with quants, data scientists, and portfolio managers to design and implement scalable systems for data ingestion, model training, and real-time signal deployment. Key Responsibilities Design and develop robust, high … performance systems for AI/ML model development and deployment. Collaborate with quantitative researchers to translate trading strategies into production-ready code. Build and maintain data pipelines for structured and unstructured financial data. Implement backtesting frameworks and simulation environments. Optimise model inference and execution latency for real-time trading. Contribute to architectural decisions and technology stack selection for the … and deployment. Experience with quantitative finance, including time series analysis, alpha modelling, or risk analytics. Familiarity with cloud infrastructure (e.g., AWS, GCP) and containerisation (Docker, Kubernetes). Proficiency with data engineering tools Experience working in fast-paced, collaborative environments with agile methodologies. Nice to Have Prior experience in a hedge fund, prop trading firm, or investment bank. Exposure to More ❯

your recruiter to learn more. Base pay range Direct message the job poster from Synchro We are actively recruiting multiple KDB Developers at various levels for a fast-paced, data-driven organisation at the forefront of real-time analytics and high-performance computing. This organisation are a consultancy working with some of the leading names in the financial services … sector. The Role: As a KDB Developer, you will be responsible for designing, developing, and maintaining high-performance applications and data analytics solutions using kdb+/q. You’ll work closely with quants, traders, and data scientists to deliver scalable systems and actionable insights from large volumes of time-series data. Key Responsibilities: Design, implement, and optimise kdb+ …/q-based applications and data pipelines Work on real-time data ingestion, transformation, and analysis Collaborate with stakeholders to gather requirements and translate them into technical solutions Maintain and enhance existing codebases, ensuring high availability and performance Contribute to architectural decisions and best practices for kdb+ systems Troubleshoot and resolve production issues quickly and effectively Required More ❯

Get AI-powered advice on this job and more exclusive features. Millennium is a top tier global hedge fund with a strong commitment to leveraging innovations in technology and data science to solve complex problems for the business. Risk Technology team is looking for a Quantitative Developer who would leverage Python, Cloud infrastructure (AWS), and scientific frameworks to provide … data-driven, risk management solutions to Risk Managers, Portfolio Managers, Business Management. Responsibilities Work in the intersection of Portfolio Management, Risk Management and Quantitative Research to develop risk analytics solutions for Equity Derivatives businesses. Collaborate with risk management for rapid prototyping and delivery of solutions to enhancement risk metrics. Develop data ingestion pipelines and analytics the generated … information. Design and implement cloud-native, data-intensive applications that effectively leverage AWS solutions Mentor junior team members, fostering growth and collaboration within the team. Fit into the active culture of Millennium, judged by the ability to deliver timely solutions to Portfolio and Risk Managers Required Skills/Experience Minimum 5 years of experience using Python and scientific python More ❯

special focus on time series analysis. This pivotal role merges cloud infrastructure, DevOps practices, and advanced machine learning to automate and deploy sophisticated computational models tailored for time series data across diverse industries. You'll lead the development of innovative solutions, driving our technological evolution with a focus on forecasting, predictive analytics and dynamic data modeling Key Responsibilities … Specialize in Time Series Analysis: Design and implement machine learning models that excel in forecasting, anomaly detection, and pattern recognition within time series data Architect Time Series Machine Learning Pipelines: Create robust pipelines specifically designed for time series data workflows, ensuring scalability, efficiency, and seamless flow from data ingestion to model deployment Ensure Data Integrity … for Time Series:Conduct thorough audits and cleansing of time series data, develop strategies for managing seasonality, trends, and noise to power insightful predictive models Develop Scalable Time Series Algorithms: Craft algorithms and models that are accurate and adaptable for time series data, ensuring reliable predictions and insights from evolving datasets From Prototype to Production: Collaborate with the More ❯

a unified, trusted and sustainable value chain that enables the most efficient production and logistics outcomes, while lowering the impact on the environment. We deliver actionable digital solutions and data insights that connect global supply chains, improving the safety, quality and sustainability of food and consumer goods, all in a way that's traceable and clear to the end … right price, creating more sustainable production and consumption outcomes. As part of our Food, Beverage and Consumer Goods team, you'll help our customers connect business processes and leverage data-driven technology for better visibility, agility and responsiveness. The purpose of this role is to complete technical tasks as required in the delivery of client implementations of Trade Promotion … using SQL Server stack 2012 or above, Knowledge of SQL Server Suite, V12. • Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server • Kimball methodologies for Data Warehousing • Strong experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, • An analytical mindset, excellent communication and interpersonal skills More ❯

unlock insights and help the teams to achieve their strategic business goals. It also involves evangelizing effective and consistent use of marketing technology platforms and promoting better understanding of data-driven marketing practices among the Marketing teams. A key focus of this role will be supporting the implementation of a new Customer Data Platform (CDP) solution. The analyst … Duties & Responsibilities Develop strong partnerships with key business partners: Function as a liaison among CIX and Marketing teams to assist in documenting business use cases, identifying gaps in customer data management, and enhancement opportunities within the new CDP. Work with the business teams to identify projects and enhancements that align with Ralph Lauren's strategic objectives. CDP Implementation: Work … closely with business and IT teams to ensure the smooth integration of the CDP with existing technology solutions and data sources. Assist in mapping data flows, defining data models, and establishing processes for data ingestion. Encourage Data Confidence: Partner with CIX stakeholders and IT partners to ensure thorough and timely response to CDP-related questions More ❯

Job Description Do you want to help us build a data-driven culture for digital product development? We have an amazing job opportunity for you! We are looking for an Analytics Engineer in our Data, Analytics & Business Improvement team. Come and help us build a robust behavioral analytics platform for our portfolio of consumer-facing LEGO websites, apps … and other owned experiences. Core Responsibilities Partner with multiple digital product teams to define & implement our data model, ensuring we have a scalable way of turning raw data from a range of sources into structured tables and data feeds that are aligned with the most common business questions requiring analysis and reporting: Work with Analytics Business Partners … and create a semantic & reporting layer for our suite of digital products, including the build and maintenance of DBT models for our behavioral analytics platform. Partner with the LEGO Data Office to develop standards and ways of working for data producers and data consumers across Digital Consumer Engagement and embed these across digital product teams (data More ❯

so that we're able to interact and collaborate in person. In Technology, we're asking that you attend the office a minimum of 1 day per week. Our Data Environment Our Data teams are aligned to divisions covering the following Banking Services & Products, Customer Identity & Financial Crime and Data & ML Engineering. Our Data teams are … both the business and more importantly our customers. Hear from the team in our latest blogs or our case studies with Women in Tech. We are looking for talented data professionals at all levels to join the team. We value people being engaged and caring about customers, caring about the code they write and the contribution they make to … multitude of problems and challenges, who can work across teams do great things here at Starling, to continue changing banking for good. Responsibilities: Optimising and creating development aids for data analysts and data scientists, driving developer efficiency and best practices Improve existing tooling and implement new tooling in and between AWS and GCP Building out multi-cloud Analytics More ❯

Social network you want to login/join with: Our client is seeking a skilled Data Engineer to take the lead in developing and optimising their data systems. This role will focus on SQL database application development, utilising Google BigQuery as the new platform for data management, and supporting the development of data analytics and visualisation … tools such as PowerBI. The Data Engineer will be responsible for ensuring seamless data ingestion, transformation, and reporting, as well as working with key stakeholders to provide timely and actionable insights. Main Responsibilities Developing and maintaining business-critical data ingestion, analysis, and management systems. Utilizing API and ETL methods to integrate with internal systems. Building … tools to minimize errors and improve customer experience. Automating data development and governance to improve data health. Designing procedures for system troubleshooting, capacity management, and scaling infrastructure. Analytics : Developing scripts and data outputs to automate reporting and visualizations. Ensuring timely and easily translatable data delivery for business stakeholders. Supporting customer segmentation and data clustering for More ❯

Data Engineer - BigQuery Salary: £75,000-£80,000 Role type: Permanent Location: London/Hybrid Our client is seeking a skilled Data Engineer to take the lead in developing and optimising their data systems. This role will focus on SQL database application development, utilising Google BigQuery as the new platform for data management, and supporting the … development of data analytics and visualisation tools such as PowerBI. The Data Engineer will be responsible for ensuring seamless data ingestion, transformation, and reporting, as well as working with key stakeholders to provide timely and actionable insights. Main Responsibilities Engineering : Developing and maintaining business-critical data ingestion, analysis, and management systems. Utilizing API and … ETL methods to integrate with internal systems. Building tools to minimize errors and improve customer experience. Automating data development and governance to improve data health. Designing procedures for system troubleshooting, capacity management, and scaling infrastructure. Analytics : Developing scripts and data outputs to automate reporting and visualizations. Ensuring timely and easily translatable data delivery for business stakeholders. More ❯

Data Engineer - BigQuery Salary: £75,000-£80,000 Role type: Permanent Location: London/Hybrid Our client is seeking a skilled Data Engineer to take the lead in developing and optimising their data systems. This role will focus on SQL database application development, utilising Google BigQuery as the new platform for data management, and supporting the … development of data analytics and visualisation tools such as PowerBI. The Data Engineer will be responsible for ensuring seamless data ingestion, transformation, and reporting, as well as working with key stakeholders to provide timely and actionable insights. Main Responsibilities Engineering : Developing and maintaining business-critical data ingestion, analysis, and management systems. Utilizing API and … ETL methods to integrate with internal systems. Building tools to minimize errors and improve customer experience. Automating data development and governance to improve data health. Designing procedures for system troubleshooting, capacity management, and scaling infrastructure. Analytics : Developing scripts and data outputs to automate reporting and visualizations. Ensuring timely and easily translatable data delivery for business stakeholders. More ❯

note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯

note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯

note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯

Job Title: Test Data Engineer Location: London, UK (3 days in office) SC Cleared: Required Job Type: Full-Time Experience: 5+ years Job Summary: We are seeking a highly skilled and detail-oriented Test Data Engineer to join our growing team. As a Test Data Engineer, you will be responsible for designing, implementing, and executing test cases … applications in the banking domain. You will work closely with the development team to identify and resolve defects, ensure product quality, and deliver reliable and efficient software solutions. Key Data-Testing Responsibilities: Test Internal data ingestion and reference data ingestion Data Ingress – Source to Landing Zone Landing Zone to Bronze Bronze to Silver – Data … tests Output Dataset labelling algorithm tests Vintaging labelling algorithm tests Key Core-Testing Responsibilities: Plan, Schedule, Coordinate, prep, run and report manual tests when required, defect lifecycle, prep test data, mainly for System Test, SIT and migrations testing. Analyse and prioritise test cases to ensure effective test coverage, identify defects, and track resolution to closure; participate in Defect Triage More ❯