51 to 75 of 107 Data Ingestion Jobs in the UK

Robert Half Technology are assisting UK's market leading telecommunications organisation to recruit a Data Engineer on a contract basis - Hybrid working - London/Hampshire based We are supporting a data transformation programme and are looking for a Senior Data/Platform Engineer to take full ownership … production data platform. This role is critical to delivering a scalable, production-ready platform ahead of a mid-August NetSuite cutover, including responsibility for build, integration, and operational readiness. Role The Data Engineer will own the end-to-end data platform (ingestion, orchestration, infrastructure, observability) Design ...

offer stage. Please note: this role is listed as Executive Product Manager on our Careers Path Framework. PURPOSE OF THE ROLE The BBC Data Platform is the foundation that enables teams across the organisation to capture, process, govern, and utilise data. It powers our analytics, personalisation, and insights … products such as iPlayer, Sounds, and News. We're in the middle of a major transformation to modernise how we ingest, process, and serve data in real time. Our ambition is to build an enterprise data platform that provides reliable, real-time data at scale and open ...

Senior Data Scientist Hybrid - 1/2 days a week in Guildford Up to £80,000 About the Role Our client is a specialist technology and analytics consultancy delivering advanced data science solutions into complex, mission-critical environments. Working across sectors such as aviation, defence and high-reliability … systems, they help organisations turn challenging, data-rich problems into scalable, impactful solutions. They are now looking for a Senior Data Scientist to take a leading role across a portfolio of technically demanding projects. You’ll operate end-to-end - shaping problem definitions, engineering data pipelines, developing ...

Role Summary: The Cribl Engineer is responsible for designing, deploying, and operating telemetry data pipelines using Cribl Stream in a cloud-centric environment. This role focuses on enabling reliable, scalable, and cost-efficient log ingestion and routing across SIEM and observability platforms, supporting detection engineering, audit, and operational … excellence objectives. Key Responsibilities: Design, build, and maintain Cribl Stream pipelines (routes, parsing, filtering, transformation). Manage log ingestion and routing to downstream platforms (e.g., Google SecOps, Splunk, or other SIEMs). Optimize pipelines for performance, cost efficiency, and reliability . Troubleshoot and resolve data flow, ingestion ...

currently looking for a Full Stack IoT Developer to join their team. This position will bridge physical hardware and cloud platforms to convert telemetry data into predictive maintenance insights and operational cost savings, using strong systems thinking, automation, and modern software engineering practices. Key Responsibilities Configure and manage industrial … hardware (routers, gateways, edge devices) using protocols such as CANBus, Modbus, and Ethernet. Design and maintain secure, reliable data ingestion pipelines using Azure or VM-based cloud infrastructure. Develop Python-based automation, data ingestion tools, and analytics. Apply signal processing and analytics to build predictive algorithms ...

delivery across our robotics platform. You’ll translate real-world lessons from industrial deployments into clear architectural decisions, ensuring our services, data models, and integrations are coherent, scalable, and observable. You will lead design reviews, define standards, and make pragmatic trade-offs that accelerate delivery while reducing complexity. Partnering … milestones, proactively manage risks, and unblock engineers across FE/BE/DevOps tracks. Hands-on where it matters, you’ll guide backend and data design (APIs, workers, time-series/relational models), provide frontend guidance for quality and consistency, and uphold DevOps, reliability, and security baselines (CI/ ...

delivery across our robotics platform. You’ll translate real-world lessons from industrial deployments into clear architectural decisions, ensuring our services, data models, and integrations are coherent, scalable, and observable. You will lead design reviews, define standards, and make pragmatic trade-offs that accelerate delivery while reducing complexity. Partnering … milestones, proactively manage risks, and unblock engineers across FE/BE/DevOps tracks. Hands-on where it matters, you’ll guide backend and data design (APIs, workers, time-series/relational models), provide frontend guidance for quality and consistency, and uphold DevOps, reliability, and security baselines (CI/ ...

Cititec are partnered with one of the largest energy providers & risk managers in the UK, who are currently going on a new Data & AI journey. The core of this is expanding their data engineering capabilities to support across the entire business from front office trading & forecasting through … will touch every aspect of the business. Given the change in landscape and how many businesses are becoming agentic, they are looking to hire data engineers who simply have the core foundations (Python, SQL etc) rather than the usual wishlist! Key Skills required: Python Sql Data Engineering Agentic ...

highly skilled Automation Test engineer with expertise in Identity and Access management (IAM) back-end validation. Skilled in identity orchestration, API testing, data ingestion and transformation, and event-driven (Pub/Sub) architectures. This role focuses on testing secure, scalable identity and access workflows across Google Cloud Platform … automated test framework and suites for API, event, and graph-based services (Python/PyTest). Define and execute test plans/cases/data aligned to requirements and technical specs; maintain FR/NFR traceability. Validate IAM concepts and access models (RBAC/ABAC/ReBAC/PBAC ...

Finance Data Engineering Lead - Insurance Programme Contract | Outside IR35 | London (Hybrid) We are working with a leading insurance organisation seeking a Finance Data Engineering Lead to join a major programme at a critical stage of delivery. This is a hands-on role focused on building and delivering data solutions within an established cloud data environment. The Role You will play a key role in developing and deploying finance and actuarial data pipelines, supporting reporting, analytics and reconciliation capabilities. Key responsibilities include: Developing Python/PySpark data pipelines within cloud platforms Building datasets and models ...

market. This is a hands-on technical and analytical role where your work will directly support commercial pricing decisions through the development of robust data pipelines, workflow automation and production-ready model deployment. You'll work closely with pricing analysts and stakeholders across the business to ensure pricing models … data processes are scalable, accurate and operationally effective. We're looking for someone who enjoys solving complex technical challenges, working with data and building automated solutions that drive real commercial value within a fast-paced pricing environment. Responsibilities include: Support the successful delivery of Consumer pricing strategy ...

Robert Half Technology are assisting a leading telecommunications business to recruit a Senior Data Platform Engineer on a contract basis. Hybrid working - 2 days on-site in Hampshire every other week. Role * The Senior Data Platform Engineer will take ownership of the end-to-end production data platform, including ingestion, orchestration, infrastructure, and observability. * Design, develop, and maintain scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover and provide support during hypercare phases. * Build and maintain integrations across Salesforce/Ability (CRM), NetSuite/ ...

Systems and Data Analyst (FTC) Croda is a FTSE100 organisation where we truly believe our people are our difference and this, along with our values of Innovative, Responsible and Together, create our Purpose, Smart science to improve lives. With over 5,000 employees globally, we specialise in the research … using smart science to create a more sustainable future. As we deliver our ambitious 2030 Growth Strategy, were looking for a HR Systems and Data Analyst to join our global HR team. This is a highly autonomous role expected to deliver complex people analytics, data quality ownership ...

Snapper Recruitment are recruiting for a junior eDiscovery Specialist. Location: Remote Contract: 3 months (potential extensions) Vetting: NPPV3 and SC clearance Main Responsibilities Data Intake & Verification: Manage the secure receipt, intake, validation, and verification of electronic data, facilitating its secure transfer from client environments to our internal network. … eDiscovery Data Processing: Oversee and execute data processing activities using Relativity or Nuix (with automation where possible), including but not limited to data ingestion, filtering, de-duplication, and export, ensuring data is prepared efficiently for legal review. Document Review Workflow Support (Relativity): Support the setup ...

Metris, we’re on a mission to maximise every kWh of renewable capacity. Our platform delivers real-time data and automates time-consuming tasks involved in renewable operations — monitoring, fault detection, reporting, and billing. We’ve reached early product-market fit with MetrisOS deployed to 20 customers … management interface on the market. It’s a central command centre for operators of renewables, combining project documents, workflows, AI assistants, and live project data in one environment. This is the future strategy of the company, and it’s what you’ll be building. We’re a small, fast ...

Lead Data Engineer UK Remote | £75,000 to £90,000 This is a rare opportunity to step into a Lead Data Engineer role within a growing, boutique consulting environment where greenfield delivery and real ownership are central to the work. You will combine hands on technical contribution with … people leadership, shaping modern data platforms and processes for mid market organisations undergoing genuine digital transformation. The Company They are a specialist consulting firm focused on digital transformation across data, analytics and technology. Operating as a hands on delivery partner, they embed consultants directly into client squads ...

Lead Data Engineer UK Remote | £75,000 to £90,000 This is a rare opportunity to step into a Lead Data Engineer role within a growing, boutique consulting environment where greenfield delivery and real ownership are central to the work. You will combine hands on technical contribution with … people leadership, shaping modern data platforms and processes for mid market organisations undergoing genuine digital transformation. The Company They are a specialist consulting firm focused on digital transformation across data, analytics and technology. Operating as a hands on delivery partner, they embed consultants directly into client squads ...

Robert Half Technology are assisting a telecommunications business to recruit a Senior Data Platform Engineer on a 9-month contract basis. Hybrid working - Hampshire/London based. ASAP start. Role * The Senior Data Platform Engineer will take full ownership of the production data platform, including ingestion, orchestration, infrastructure, and observability. * Design, build, and deliver scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover, including hypercare support. * Build and maintain integrations across Salesforce/Ability (CRM), NetSuite/Sage X3 (ERP), and Billing/ ...

Senior Oracle Data & Analytics Engineer Required Skills & Experience · Proven experience across the Oracle analytics technology stack, including: Oracle Analytics Cloud (OAC)/OBIEE Autonomous Data Warehouse (ADW) Oracle BI Administration Tool (RPD) Oracle Data Integrator (ODI) · Strong experience designing and developing enterprise Business Intelligence and Data Warehouse solutions. · Expertise in ETL development using ODI, including: data ingestion, cleansing, transformation, and pipeline orchestration. · Strong dimensional data modelling and Star Schema design experience. · Advanced Oracle SQL development and performance optimization skills. · Experience developing OAC Data Visualization (DV) dashboards, including geographic/map-based ...

Senior Data Engineer | Outside IR35 | £450- £550 per day | Hybrid | London We are seeking a Senior Data Engineer/Developer to join a major Liquidity Reporting programme, delivering regulatory reporting solutions for large UK insurers. This is a hands-on role focused on building and enhancing a Databricks … based data engineering framework. You will design and develop scalable PySpark pipelines covering data ingestion, validation, transformation, and mapping, while creating reusable libraries and ensuring high engineering standards. You will also provide technical leadership, conducting code reviews, guiding offshore teams, and ensuring delivery quality aligns with architectural ...

through expert-led technology and consulting. Across both our technology and consulting services, Novatus delivers practical solutions to some of the most complex regulatory, data and operational challenges in financial services. Our SaaS platform, En>ACT ( short for Ensuring Accurate, Complete and Timely reporting ), is a market-leading solution … unique model delivers consulting services to solve complex challenges, combining deep expertise, ownership and delivery to create lasting change. Our expertise spans Strategy & Operations, Data & AI, Risk & Resilience, Compliance, Transaction Reporting, and ESG. We embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes ...

hands-on technical role, suited to someone with strong Splunk Enterprise and Splunk Enterprise Security experience, who can take ownership of platform engineering, data ingestion, detection content and performance tuning across complex client environments. This is a key technical leadership role, responsible for ensuring the right tooling, controls … will be doing: Lead the deployment, management and optimisation of Splunk Enterprise and Splunk ES platforms in large, complex environments. Design, implement and maintain data pipelines, including log ingestion, enrichment and schema standardisation. Develop and tune security detection content, translating threat intelligence and TTPs aligned to MITRE ...

helping clients investigate and mitigate financial, legal, and regulatory risks using advanced analytics and emerging technologies. The team is investing heavily in AI and data capabilities to support complex, high-impact client engagements. THE ROLE This is a senior leadership position combining hands-on project delivery with team management … business development responsibilities. You will lead complex data-driven forensic investigations whilst working closely with clients and contributing to the growth of the practice. Specifically, you can expect to be involved in: Leading data and AI-driven forensic projects, including data ingestion, analysis and modelling Managing ...

knowledge of reinsurance agreements and key reinsurance contract features and will involve: Develop a strong, practical understanding of WTW’s Igloo Standard Model including: Data input tables Model methodologies Standard reporting and outputs Build an extensive understanding of the Igloo parametrisation tool and its application across client projects. Extract … detailed model results and interpret Igloo code to support technical diagnostics and enhancement. Apply common methods for data ingestion and data output using: Python Power Query Power BI Calibrate loss distributions for pricing, capital modelling, and portfolio analysis. Apply common reinsurance pricing methods. Client Engagement & Relationship Building ...

plus benefits This is a senior opportunity to shape high impact forensic and regulatory investigations at scale, sitting at the intersection of data, AI and financial services risk. You will play a pivotal role in delivering complex, data led programmes while building and leading high performing teams … responsibilities with hands on delivery, working closely with senior stakeholders and clients. Key responsibilities include: Leading complex forensic, regulatory and investigation programmes underpinned by data, analytics and AI. Managing and developing multidisciplinary teams of data and analytics specialists. Acting as a senior client contact, communicating findings, insights ...