76 to 100 of 134 Data Ingestion Jobs in the UK excluding London

Working within a small, collaborative team, this role will support cross-functional initiatives across Finance, HR, and Operations, directly impacting business processes and decision-making through technology, automation, and data integration. This position offers hands-on experience in ERP administration, BI reporting, ETL workflows, and custom application development. Duties & Responsibilities: Serve as the primary administrator for NetSuite ERP, overseeing … system configurations, workflows, permissions, and enhancements. Support and administer HRIS platforms, ensuring functionality and data integrity for HR and payroll processes. Build and maintain Power BI dashboards and reports to support business insights across departments. Develop and optimize DAX formulas and Power Query transformations for efficient data visualization and reporting. Write and refine SQL queries and SSRS reports … for accurate and actionable data access. Manage and troubleshoot data integrations between ERP, HRIS, and third-party applications. Collaborate with internal teams to automate workflows, reduce manual processes, and improve operational efficiency. Design and maintain ETL pipelines for data ingestion, cleaning, transformation, and deduplication. Support API-based integrations and develop internal tools using C#/.NET More ❯

development of scalable trading platforms and internal developer tools. Collaborate with quant researchers, traders, and infrastructure teams to deliver performant solutions. Maintain and optimize trading infrastructure (low-latency systems, data pipelines, monitoring, etc.). Manage a team of software engineers, mentor junior developers, and drive best practices across the stack. Ensure high code quality through code reviews, CI/… workflows. Own deployment pipelines across cloud providers (AWS, GCP, Azure) using containerization (Docker, Kubernetes). Design and implement microservices and APIs for internal tools and external integrations. Work with data at scale (market data ingestion, real-time analytics, historical storage). Required Skills & Experience: Core Engineering: 5+ years of experience in software development, with exposure to both … and storage configurations. Familiarity with monitoring/logging tools (e.g., Prometheus, Grafana, ELK stack). Trading Systems & Finance: Solid understanding of trading infrastructure, latency optimization, execution systems, and market data feeds. Experience working in or with quantitative research, HFT, or hedge fund teams is highly desirable. Leadership: Proven experience managing and mentoring a team of 3–10 engineers. Ability More ❯

Data Engineer | Location: Leeds (4 days per week in office with some flexibility) | Salary: £60,000-£80,000 The Opportunity Our client is seeking a skilled and motivated Data Engineer to play a key role in the creation of a brand-new data platform within the Azure ecosystem including Azure Data Factory (ADF), Synapse and PySpark …/Databricks and Snowflake. You will be a data ingestion and ETL Pipeline guru, tackling complex problems at source in order to retrieve the data and ensure to can flow upstream to the Snowflake DWH. You will not be an analytics engineer or someone who operates at the latter stages of the development lifecycle unless you have … skills and desire to work on data ingestion, ETL/ELT. Key Responsibilities Build & Develop robust ETL/Data Ingestion pipelines leveraging Azure Data Factory, Synapse, PySpark and Python. Connect APIs, databases, and data streams to the platform, implementing ETL/ELT processes. Data Integrity – Embed quality measures, monitoring, and alerting mechanisms. CI More ❯

Social network you want to login/join with: Data Engineer - Hybrid/Bristol - Up to £55k, Bristol col-narrow-left Client: Location: Bristol, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 5e1215c48b22 Job Views: 4 Posted: 25.06.2025 Expiry Date: 09.08.2025 col-wide Job Description: Data Engineer - Hybrid/Bristol … Up to £55, Job Title : Data Engineer Responsibilities : - Pipeline Development and Optimisation : Continuously assess and improve the performance of data enrichment pipelines, ensuring their efficiency, dependability, and scalability. - Data Management : Design and implement robust processes for data ingestion and cleaning, supporting machine learning and analytical models. - Collaborative Problem-Solving : Work closely with data scientists … Deployment : Assist in building, training, monitoring, and deploying cutting-edge machine learning models. - Stay Current with AI/ML Trends : Keep up to date with the latest advancements in data processing, AI, and ML, and incorporate them into our client's processes to improve efficiency. - Adaptable Approach : Collaborate across different functions as required, including taking on backend development tasks More ❯

Senior Data Engineer - £82,000 - Hybrid & Remote Flexibility No Sponsorship Available Company We are a forward-thinking technology company dedicated to simplifying complex processes through innovative solutions. With a focus on enhancing efficiency and transparency, we strive to deliver outstanding experiences for our customers. Our team operates with a flexible hybrid working model, fostering collaboration and innovation in a … supportive environment. Responsibilities As a Senior Data Engineer, you'll play a pivotal role in advancing our data infrastructure to support our expanding scope and responsibilities. Key responsibilities include: Enhancing the reliability and stability of our data infrastructure. Managing data ingestion pipelines using tools such as Azure Data Factory (ADF) and Python. Ensuring the … quality of raw datasets to empower Data Analysts in creating robust data models. Deploying and managing data tools on Kubernetes (Airflow, Superset, RStudio Connect). Supporting Data Analytics through the management of DBT, DevOps, and deployment rules. You will have the opportunity to work end-to-end, making meaningful contributions within a small, agile team. Experience More ❯

DV (MOD) Cleared Data Engineer - Elastic Stack & Apache NiFi Location: Bristol | Contract Type: £430.00 pd (Outside IR35) | Working Pattern: Hybrid (3 - 4 days on-site) Are you a contract Data Engineer with a knack for designing secure, high-performance data solutions? We're on the lookout for a technical expert in the Elastic Stack and Apache NiFi … to take the lead in building robust, real-time data pipelines in a security-focused environment. This is a hands-on contract opportunity to make a real impact-ideal for professionals with a strong track record in regulated sectors. What You'll Be Doing Designing and deploying scalable, secure data pipelines using Elasticsearch, Logstash, Kibana, and Apache NiFi … Handling real-time data ingestion and transformation with an emphasis on integrity and availability Collaborating with architects and cybersecurity stakeholders to align with governance and compliance needs Monitoring and optimising high-throughput data flows across on-prem and cloud environments Building insightful Kibana dashboards to support business intelligence and operational decision-making Maintaining documentation of data More ❯

Job Title: Data Engineer (NPPV3 + SC Clearance Required)Location: Hybrid (UK-based)Contract: 3 Months (with potential extension/move to other projects)Rate: £550 per day (Outside IR35)A bout the Role:We are seeking an experienced Data Engineer with NPPV3 + SC clearance to join our dynamic team on a 3-month contract basis. This … role offering the flexibility of working both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and … storage in cloud environments.* Troubleshoot and optimise data workflows for performance and reliability.* Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions. More ❯

our purpose is to radically accelerate the clean-energy revolution - starting withsmarter, safer, and more efficient homes.We're focused on improving experiences for people through the application of technology, data, and a deep understanding of human behaviour. Why? As a society, we need to decarbonise and accelerate the transition to alternative energy sources. Existing solutions are expensive and disparate … led and puts people at its core, then we'd love to hear from you! The Role We're looking to grow our quality and test coverage in our data space. In this Intermediate-Senior role,you'll be helping us to implement processes, architectures and test coverage for validating our data backend with your excellent software skills … and guidance. We have an existing small team working and building the data backend and we need a QA engineer to work with the team to verify and validate this part of our product. Some of the things that you might be involved in include: Lead Data Quality Assurance: Develop and implement comprehensive testing for our data More ❯

poster from Digital Waffle Tech Recruitment Manager (DevOps, Cloud & Infrastructure) for the UK & US . Get in touch to find out how I can solve your hiring problems! Senior Data Insights Analyst Data-Driven Strategy | Revenue Optimisation | Business Impact PowerBI SQL VBA Are you an intellectually curious, highly motivated analyst with a passion for turning data into … real business value? We’re on the hunt for a Senior Data Insights Analyst to join our fast-growing team in Oxford — someone ready to roll up their sleeves and make a meaningful impact from day one. This role sits at the core of our business , where data isn’t just a resource — it’s the engine powering … our product innovation, customer experience, and revenue growth. About the Role As part of our high-performing Data Insight Team , you’ll be working with large datasets to extract critical trends, uncover growth opportunities, and drive fast-paced, data-informed decision-making. You'll influence key business strategies, using insights to directly shape product performance and customer satisfaction. More ❯

Join to apply for the Data Migration Lead - Dynamics D365 - CRM, BC, F&O/F&SCM role at Experis UK 2 days ago Be among the first 25 applicants Join to apply for the Data Migration Lead - Dynamics D365 - CRM, BC, F&O/F&SCM role at Experis UK Get AI-powered advice on this job … and more exclusive features. Full Time Role - Fully Hybrid - Work from Home - with Occasional Travel to Client Sites - Fully Expensed Enterprise Solution Data Migrations encompassing D365 CRM, BC, F&O/F&SCM for Small to Large-Scale Migrations within an Agile Delivery Model, working both hands-on and in a "Solution Lead Capacity". In this role, you … will Lead and Shape the Key, Focussed, Data Migration Service Portfolio that clients expect! Location is UK - Office HQ is West Midlands with a UK Wide Clientele - Work from Home is Guaranteed - Remote First! Salary: To Start is at the £80,000pa mark + An Excellent Benefits Package + Remote Working + Training & Certifications Full Security and DBS Vetting More ❯

note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯

note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯

note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯

to over a million students in over 80 countries annually and operating as a centre of excellence in qualifications and assessment. About the Job: The position is for a Data Engineer with experience working on large data-focused projects. Responsibilities include data transformation, ingestion, validation from multiple sources, and improving methods for data analytics and … reporting. We are initiating a large new programme hosting data in AWS and platforms like MySQL. The role involves collaborating with SMEs, product owners, architects, and developers, requiring excellent communication and analytical skills. Attendance at senior stakeholder meetings to explain project progress and design decisions is also expected, so good communication and planning skills are essential, with the ability … to simplify technical concepts for a wider audience. About You: You should have a background in complex data transformation projects or project initiation, and be eager to work on fast-moving, critical projects, contributing to design decisions. Proven project delivery and advanced data validation experience are advantageous. Key Skills & Experience: Proficiency with database systems such as Amazon Aurora More ❯

Senior Data Insights Analyst 📍 Oxford 💰 £50,000 - £55,000 🧠 Data-Driven Strategy | Revenue Optimisation | Business Impact Key skills: Large data sets (Google Analytics, Google Ads, Meta Ads etc) PowerBI SQL VBA E-commerce environment Are you an intellectually curious, highly motivated analyst with a passion for turning data into real business value? We’re on the … hunt for a Senior Data Insights Analyst to join our fast-growing team in Oxford — someone ready to roll up their sleeves and make a meaningful impact from day one. This role sits at the core of our business , where data isn’t just a resource — it’s the engine powering our product innovation, customer experience, and revenue … growth. 🔍 About the Role As part of our high-performing Data Insight Team , you’ll be working with large datasets to extract critical trends, uncover growth opportunities, and drive fast-paced, data-informed decision-making. You'll influence key business strategies, using insights to directly shape product performance and customer satisfaction. If you’re someone who loves the More ❯

DATA ENGINEER (Real Time) About client: At RemoteStar we are currently hiring for a client who is a world-class iGaming operator offering various online gaming products across multiple markets, both through their proprietary gaming sites and partner brands. Their iGaming platform is central to their strategy, supporting over 25 online brands and growing, and it's used by … users worldwide. Our client embraces a Hybrid work-from-home model , with the flexibility of working three days in the office and two days from home . About the Data Engineer role: In this role, you will contribute to the design and development of Real-Time Data Processing applications to fulfil business needs. For any Technical Data wiz out there, this is the perfect environment to put your skills to the test by building a consolidated Data Platform with innovative features and most importantly joining a bunch of talented and fun group of people. What you will be involved in: Development and Maintenance of Real-Time Data Processing Applications by using frameworks and libraries More ❯

Join to apply for the Head of Data Technology & Operations role at Cancer Research UK (CRUK) Join to apply for the Head of Data Technology & Operations role at Cancer Research UK (CRUK) Get AI-powered advice on this job and more exclusive features. 4,000 professionals, 0 days wasted, 1 incredible purpose. Together we will beat cancer. Head … of Data Technology & Operations Salary: £83,000 - £93,000 per annum Department: Chief Operating Office Contract: Permanent Hours: Full time 35 hours per week Location: Stratford, London Office-based with high flexibility (1-2 days per week in the office) Closing date: 1st July 11.59pm This vacancy may close earlier if a high volume of applications are received or … need to go much further and much faster. That’s why we’re looking for someone talented, someone determined, someone like you. We’re looking for a Head of Data Technology & Operations to join our Technology leadership team. In this crucial role, you will be accountable for the design, implementation, roll out and continuous improvement of fit-for-purpose More ❯

Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from SPG Resourcing Data Recruitment Consultant | Connecting Top Talent with Data-Driven Companies | North of the UK Machine Learning Engineer Location: Leeds or Manchester This position is for an experienced Machine Learning … Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The engineer will work closely with data scientists in a collaborative, cross-functional setting, helping … transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment framework for all data science services. You will have oversight of how data will flow into the data science life cycle from the wider business data warehouse. Oversight of the automation of the data More ❯

electrical integrity monitoring, where we deliver advanced solutions that offer deep insights into the health of electrical systems. Our commitment is to empower customers through enhanced monitoring systems, sophisticated data gathering, and analytical capabilities, enabling them to make informed decisions about their critical infrastructure. Our innovative approach ensures our clients receive not just data, but actionable intelligence that … drives efficiency and safety in their operations. The Role: We are seeking a dynamic and adaptable Senior Software Engineer to deliver the next generation of data ingestion, analysis, and display functionality for our new greenfield product, ‘Platform Vi’. This product is being developed for both internal stakeholders and our customers, providing them with valuable insights into their … Proven experience in developing and contributing to production applications using Java, the Spring Framework and GraphQL/REST APIs. Strong understanding of backend system design, including infrastructure, APIs, and data storage. Proficiency in writing clean, maintainable, and testable code, with experience using testing frameworks such as JUnit and familiarity with Test-Driven Development (TDD). Strong understanding of Continuous More ❯

+ benefits + bonus potential About Us Come and be a part of The Investigo Group (TIG ), a dynamic coalition of cutting-edge tech firms specialising in Platform, Software, Data, AI and other bleeding-edge technology solutions. Our innovative prowess spans the globe while proudly hailing from the United Kingdom. The group is multi-functional with a large portfolio … for our community. The Consultancy side concentrates on expert support of our customers as well as specifically assigned individual deployments. Collaboraite is a bleeding-edge company that provides our Data and AI capability. A collaborative partner for designing user-centred secure data solutions to overcome operational hurdles, delivered through design thinking and agile coaching. Diversity, Equity, and Inclusion … inclusive environment where every voice matters, driving innovation and progress in our dynamic tech community. The group provides bespoke, secure, user-centric products fuelled by deep technical knowledge advanced data and analytical skills. We proudly stand as a global leader in this space, partnering with esteemed entities that require these advanced forward-thinking capabilities. These partnerships have been forged More ❯

Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham Client: CGI Location: Birmingham, United Kingdom Job Category: Other EU work permit required: Yes Job Reference: 68452019cc93 Job Views: 4 Posted: 29.06.2025 Expiry Date: 13.08.2025 Job Description: Position Description: Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham We … re growing rapidly and are looking for a Solution Architect to join our team and help us develop and deploy enterprise-grade platforms that enable data-driven solutions. You will be responsible for designing, implementing, and overseeing data-driven solutions that support business objectives. This role bridges the gap between business needs and technical implementation, ensuring that solutions … inclusive place where you’re empowered to chart your own path, then we’d love to meet you. Your future duties and responsibilities: Develop end-to-end architecture for data science and AI/ML solutions. Ensure integration with existing enterprise systems and data pipelines. Define best practices for data ingestion, processing, storage, and model deployment. More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across … the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting More ❯

Machine Learning Engineer Location: York or Manchester This position is for an experienced Machine Learning Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The … engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment framework for all data science services. You will have oversight of how data will flow into the data science life … cycle from the wider business data warehouse. Oversight of the automation of the data science life cycle (dataset build, training, evaluation, deployment, monitoring) when we move to production. Automate the data science pipeline (data prep to deployment). Collaborate with cross-functional teams to ensure smooth productionisation of models. Write clean, production-ready Python code. Apply More ❯

a dynamic self-starter to join their innovative team in the heart of London. If you thrive in a fast-paced environment and want to contribute to cutting-edge data science applications, this is the perfect opportunity for you! About Client: Our client is a leading global payments technology company that enables businesses of all sizes to accept payments … geographies. They handle billions of transactions annually, offering secure, scalable solutions that support innovation in the financial ecosystem. With deep industry expertise, they empower merchants to grow through advanced data insights and reliable infrastructure. What You'll Do : Design, develop, and deploy machine learning models that solve real-world problems. Collaborate with cross-functional teams to improve production systems … and ensure seamless integration of ML models. Drive the ML life cycle from data ingestion to model deployment and monitoring. Implement CI/CD pipelines and leverage DevOps practices to enhance operational efficiency. What You Need : A relevant BSc/MSc degree in a related field with strong industry experience. Proven expertise in ML engineering and MLOps, with More ❯

Social network you want to login/join with: We’re seeking a proactive Trading Developer to architect and enhance the data and process backbone of our trading environment. You’ll design and implement backend APIs, real-time data pipelines, and monitoring frameworks—ensuring reliable, low-latency access to market and operational data. While your core focus is … tasks and responsibilities API & Service Development Design, develop, and maintain robust internal RESTful and event-driven APIs. Establish best practices for versioning, documentation, security, and monitoring. Build and manage data streaming pipelines using frameworks such as Spark, Kafka, or equivalents. Ensure high-availability and low-latency delivery of market and industry data. Deploy and operate services on Azure using … Functions, App Services, AKS (Kubernetes), and related services. Data Ingestion & Management Ingest diverse data sources (exchange feeds, third-party APIs, FIX/WebSocket interfaces). Implement ETL processes and data models to drive downstream analytics and trading strategies. Uptime & Monitoring Implement health checks, alerting, and observability (metrics, logs, tracing) to maintain 24/7 uptime. Rapidly More ❯