276 to 296 of 296 Data Pipeline Jobs in the UK excluding London

with cloud infrastructure, containerisation (Docker, Kubernetes), CI/CD pipelines, and deployment of Azure-hosted or similar cloud services. Experience designing and building data pipelines for ingestion, transformation, and storage at reasonable scale. Strong analytical and problem-solving skills, including the ability to work with evolving requirements, translate … startup experience. This focuses more on the engineering aspects than before: Shifted emphasis from evaluation/research to platform engineering, APIs, data pipelines, deployment, and operational reliability Added CI/CD, monitoring, containerisation, and deployment as explicit responsibilities Moved ML/evaluation experience from required to preferred Made ...

edge platforms Design, curate, and manage image/video datasets for training and evaluation Develop and maintain annotation workflows and tooling Create synthetic data pipelines (including generative approaches) to augment real-world datasets Stay current with emerging tools, methods, and best practices in CV/ML What … mindset with strong problem-solving ability Clear communicator who works well in a collaborative team Nice to Have Experience with real-world sensor data (e.g., RGB-D, thermal, radar) Model optimisation/deployment tooling (ONNX, TensorRT) Edge deployment experience (e.g., NVIDIA Jetson or other resource-constrained devices) Familiarity ...

specialist technology consultancy based in Bristol. We help large organisations banks, energy companies, airports, investment platforms get real value from the data that flows through their IT infrastructure. That means helping them monitor their systems, protect their networks, and make sense of the information their technology generates every … consultants, and building skills that have a clear path to progression. The Opportunity Were looking for a Graduate Consultant to join our Data practice. Youll work alongside senior colleagues on the design, deployment, and optimisation of monitoring and observability platforms primarily Splunk and Cribl helping enterprise clients ...

365. The role also includes researching and prototyping future telemetry/IoT solutions as the company looks at future sensor-based products and data collection Key Responsibilities: Managing Microsoft 365 services including Entra ID, Intune, Defender, Purview, SharePoint, and Exchange Online Device and user management (onboarding, configuration, security … offboarding) Supporting and improving Dynamics 365 Field Service Building and maintaining Power Apps and Power Automate flows Working with Dataverse and relational data structures Maintaining existing API integrations and investigating new ones General IT support and technical troubleshooting as required Analysing company data and providing reports ...

role is 100% on site. The successful candidate will join our development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real … time data flows, and complex multi-threaded processing pipelines. Proficient in C++ and with knowledge of C#, you will play a critical part in the design, development, integration, and verification of test software solutions that are central to our system validation and delivery capabilities. Responsibilities: Design and develop ...

will formulate, train and deploy machine learning models for robotic systems that perceive the world through vision and sensors, learn structured representation in data, and operate reliably in real‐world industrial environments. You’ll translate research into clean, production‐grade software that improves system performance and accelerates deployment. … complexity with scalable and reliable designs. You’ll push beyond incremental improvements by applying ideas from foundation models and generative AI, leveraging synthetic data generation, and validating results on real robots. Your work will raise the bar for capability, reliability, and speed of iteration. Responsibilities Key objective ...

BPSS (must be SC eligible) Tenure: 6 months Start Date: 1 June 2026 We are seeking an experienced Delivery Lead to coordinate a data engineering and testing capability within a government-aligned environment . The role focuses on ensuring structured, predictable delivery across complex data pipelines … ensure work is ready for delivery into engineering and test teams Proactively identify and manage delivery risks, dependencies, and blockers Coordinate across data engineering and testing functions to maintain delivery flow Provide clear, concise, senior-level delivery updates and forward-looking plans Experience Required Proven delivery leadership experience ...

based team is driving new AI Infrastructure & Agentic Serving architectures. This role is a unique opportunity to help define next-generation large-scale data centres and AI infrastructure systems, turning innovative system designs into deployable, real-world technologies. We are seeking Systems Research Engineers with a deep passion … global AI clusters. What you will be doing Distributed Systems Research & Development : Architect, implement, and evaluate distributed system components for emerging AI and data-centric workloads. Drive modular design and scalability across GPU, and NPU clusters, building highly efficient serving and scheduling systems. Performance Optimization & Profiling : Conduct ...

Remote-first UK role, with regular time near Tetbury- UK Huru is building brain-monitoring technology for a future where brain-health data is easier to collect, understand, and use. Our Clic EEG platform is a miniaturised, self-applied wearable designed to make long-duration brain monitoring possible … What you’ll be doing You will help build, operate, and improve the backend and cloud systems that support Huru’s devices, apps, data pipelines, internal tools, and customer-facing services. Your responsibilities will include: Building and maintaining backend services, primarily using Node.js, with some use of Python. ...

Solution Architect/Technical Lead/Agile Architect within a cross-functional squad Shape end-to-end AI solution design across applications, data, integration and cloud Translate business goals into scalable, secure, production-ready architectures Guide engineers on implementation patterns, technical decisions and delivery risks Work closely with … digital Hands-on experience delivering AI/ML initiatives in a real production environment Ability to design end-to-end solutions across data pipelines, APIs, cloud services and application components Architecture experience (Solution or Domain), with the ability to operate as a tech lead Experience working in agile ...

critical solutions for National Security customers - building products that protect people, platforms, missions and information against evolving threats. You'll help customers use data to improve mission outcomes, lead teams hands-on, and mentor others while working at the forefront of innovation. What you'll be doing … patterns across established and emerging technologies. Convert designs into working implementations and document to required standards. Develop and maintain APIs, UI components and data pipelines within existing data infrastructure. Lead and contribute to agile ceremonies (stand-ups, refinement, planning, demos). Keep the team aligned ...

questions into production ready LLM and RAG workflows Debug, optimise and scale LLM applications in real world, client facing environments Build and integrate data pipelines and services across cloud platforms and modern data stacks Collaborate with non technical stakeholders, clearly explaining platform capabilities and guiding them … back into product and engineering teams to shape the roadmap Your Skills and Experience Strong commercial engineering experience in AI, machine learning or data focused roles Hands on experience with retrieval augmented generation and production LLM workflows Confidence debugging and improving end to end LLM systems in live ...

Computer Science, Maths, Stats, or Op Research Recruit From UK only Annual Salary - £250,000 - £600,000 Senior Quantitative Developer/Research & Data Engineer - LONDON, UK x3 - Annual Salary - £250,000 - £600,000 (base salary £120k - £160k+) Primary Skills - Python, C++, quantitative, research, market data, simulation … frameworks Secondary Skills - distributed systems, cloud computing, execution systems, performance optimization, data pipelines, Linux Remote Status - No Remote Client Willing to Sponsor - Yes Degree - Bachelor's Degree in Computer Science, Mathematics, Statistics, or Operation Research ONLY Relocation Paid - YesRecruit From UK only Other Compensation - Base + BonusA leading ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … trends acrosstickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

technically ambitious organisation building advanced machine learning systems tightly integrated with real-world systems. Their platform supports the full lifecycle from data collection through to large-scale training and deployment. Engineering quality, reliability, and thoughtful system design are core to how they operate. The Role and Deliverables … evolve the operator-facing platform, including web UIs, backend services, and CLI tooling used for live data collection and dataset workflows. Design and maintain robust recording and orchestration systems that scale across robots, sensors, and lab environments. Collaborate with the ML team on dataset builders, ingestion pipelines ...

week working remotely. The Role You will design, build, and optimise the fund’s quantitative research and trading systems. This includes everything from data ingestion and modelling pipelines to execution tooling and performance analytics. You’ll work closely with quants, traders, and the CTO to deliver clean, robust … production-ready code that directly supports live trading. Key Responsibilities Develop and maintain quant research infrastructure , backtesting frameworks, and simulation tools Build data pipelines for market, alternative, and proprietary datasets Implement and optimise systematic trading models in collaboration with researchers Improve execution workflows, latency, and reliability Contribute ...

Senior Software Engineer - Real-Time Data (Kafka/Spark) Chester | Hybrid working | 12-month contract | Inside IR35 | Global Investment Bank A leading global investment bank is looking for a hands-on Senior Engineer to build high-performance, real-time data platforms supporting regulatory compliance across global … This is a fully engineering-led role focused on streaming, distributed systems, and low-latency processing , ideal for someone who enjoys solving complex data challenges at scale. What You'll Do Design and build Kafka-based streaming pipelines and Spark processing jobs Develop low-latency, high throughput systems ...

marine, defence, and scientific applications. What you'll do: 1. FPGA Architecture & Real-Time Signal Processing Develop FPGA designs for: Multi-channel acoustic data acquisition Digital down conversion (DDC) Filtering (FIR/IIR) FFT processing Beamforming algorithms Pulse compression and matched filtering Implement high-speed streaming data … interfaces such as: High-speed ADC/DAC interfaces JESD204 LVDS SERDES Develop memory interfaces (DDR3/DDR4) for buffering high-bandwidth acoustic data Ensure deterministic timing and synchronisation (e.g., PTP, trigger alignment). 3. Hardware Integration & Subsea Considerations Collaborate with analogue and hardware engineers on: Front ...

with a leading technology organisation in the defence industry who are looking for a Full Stack Developer with a focus on API and data pipelines. Due to the nature of this role, you will need to be a sole British national and hold SC clearance. We are looking … someone with previous experience creating and managing data pipelines and creating and integrating APIs. You will need experience in the creation and integration of databases and working with system models and JSON schemas. The ideal candidate will also have experience with ASP or other logic programming languages ...