276 to 294 of 294 Data Pipeline Jobs in the UK excluding London

Develop and enhance algorithmic trading and automated bidding solutions Build scalable back testing frameworks and validation pipelines Integrate new datasets, products, and external data sources Take operational ownership of deployed systems (monitoring, reliability, improvements) Collaborate with engineering, data, and trading teams to deliver robust solutions Drive … Infrastructure: AWS, Docker, Docker Compose, AWS Fargate DevOps & CI/CD: Azure DevOps, CI/CD pipelines, Entra ID Monitoring: Datadog Optimisation: CPLEX Data & APIs: EATT API, AIDA What You'll Be Delivering AWS Fargate-based backtesting infrastructure Rust-based orchestration UI Integration of optimisation models (CPLEX) External ...

company building an advanced cloud security platform designed to help organisations better understand and protect their infrastructure. Their platform uses real time runtime data and intelligent automation to identify the most critical security risks and provide teams with clear, prioritised insights. As adoption grows, they are now looking … engineering background with experience building AI/ML-powered systems * Experience working with modern machine learning frameworks and model development * Experience building scalable data pipelines or AI infrastructure * Strong programming skills (commonly Python or similar) * Experience working in cloud-native environments * Strong problem-solving ability and collaborative mindset ...

365. The role also includes researching and prototyping future telemetry/IoT solutions as the company looks at future sensor-based products and data collection Key Responsibilities: Managing Microsoft 365 services including Entra ID, Intune, Defender, Purview, SharePoint, and Exchange Online Device and user management (onboarding, configuration, security … offboarding) Supporting and improving Dynamics 365 Field Service Building and maintaining Power Apps and Power Automate flows Working with Dataverse and relational data structures Maintaining existing API integrations and investigating new ones General IT support and technical troubleshooting as required Analysing company data and providing reports ...

role is 100% on site. The successful candidate will join our development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real … time data flows, and complex multi-threaded processing pipelines. Proficient in C++ and with knowledge of C#, you will play a critical part in the design, development, integration, and verification of test software solutions that are central to our system validation and delivery capabilities. Responsibilities: Design and develop ...

BPSS (must be SC eligible) Tenure: 6 months Start Date: 1 June 2026 We are seeking an experienced Delivery Lead to coordinate a data engineering and testing capability within a government-aligned environment . The role focuses on ensuring structured, predictable delivery across complex data pipelines … ensure work is ready for delivery into engineering and test teams Proactively identify and manage delivery risks, dependencies, and blockers Coordinate across data engineering and testing functions to maintain delivery flow Provide clear, concise, senior-level delivery updates and forward-looking plans Experience Required Proven delivery leadership experience ...

client Build guardrails for prompt injection, PII, and output safety Drive prompt engineering practice - versioning, A/B testing, platform overlays 3. Cloud & Data Infrastructure Own the cloud substrate that runs the AI workloads. You will: Architect and maintain AWS infrastructure (ECS Fargate, Lambda, Step Functions, EventBridge … Athena, DynamoDB, Bedrock) Build and operate data pipelines that move LLM outputs from generation to analytics Manage containerized deployments, CI/CD, and infrastructure as code Ensure reliability, observability, and cost efficiency across the platform 4. Security, Compliance & AI Safety Implement IAM, encryption, and network security best practices ...

recruiting a Senior SAP S/4HANA Order-to-Cash(O2C) specialist to lead, operate, and optimize their end-to-end commercial data streams across Retail, E-Commerce, Digital Marketplaces, Logistics, and Finance. This role ensures real-time data integrity between SAP S/4HANA … management, accurate multi-currency handling, and country-specific tax/VAT localizations across European markets. 2. Digital Commerce, Omnichannel & POS Integrations E-Commerce Data Integrity: Govern and optimize real-time SAP Magento data pipelines ensuring flawless synchronization of product catalogs, localized pricing, dynamic stock pools, customer ...

critical solutions for National Security customers - building products that protect people, platforms, missions and information against evolving threats. You'll help customers use data to improve mission outcomes, lead teams hands-on, and mentor others while working at the forefront of innovation. What you'll be doing … patterns across established and emerging technologies. Convert designs into working implementations and document to required standards. Develop and maintain APIs, UI components and data pipelines within existing data infrastructure. Lead and contribute to agile ceremonies (stand-ups, refinement, planning, demos). Keep the team aligned ...

Computer Science, Maths, Stats, or Op Research Recruit From UK only Annual Salary - £250,000 - £600,000 Senior Quantitative Developer/Research & Data Engineer - LONDON, UK x3 - Annual Salary - £250,000 - £600,000 (base salary £120k - £160k+) Primary Skills - Python, C++, quantitative, research, market data, simulation … frameworks Secondary Skills - distributed systems, cloud computing, execution systems, performance optimization, data pipelines, Linux Remote Status - No Remote Client Willing to Sponsor - Yes Degree - Bachelor's Degree in Computer Science, Mathematics, Statistics, or Operation Research ONLY Relocation Paid - YesRecruit From UK only Other Compensation - Base + BonusA leading ...

actively transitioning away from legacy commercial SaaS platforms platforms (e.g., Salesforce, HubSpot), toward AI-first, customised add-ons built on proprietary Product Data Management (PDM) software and core ERP architectures to drive significant operating cost reductions with process optimisation. The incoming CISO will hold ultimate accountability for ensuring … Personally audit and define the compliance boundaries for newly deployed custom AI infrastructure (built on LLM platforms like Anthropic Claude). Ensure robust data handling, strict access controls, and correct isolation of proprietary data pipelines. - - Rigorous Framework Delivery: Maintain full operational control of an in-progress ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … trends acrosstickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

Customer Support (not exhaustive): Technical Leadership & System Expertise Become the CST technical authority on the MDA system GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

powering outdoor advertising across the UK, we make sure we're doing it as a team. We're looking for a highly skilled Data Engineer who'll help us to build and operate large-scale data pipelines that are capable of withstanding our growth and ambitions. ...

technically ambitious organisation building advanced machine learning systems tightly integrated with real-world systems. Their platform supports the full lifecycle from data collection through to large-scale training and deployment. Engineering quality, reliability, and thoughtful system design are core to how they operate. The Role and Deliverables … evolve the operator-facing platform, including web UIs, backend services, and CLI tooling used for live data collection and dataset workflows. Design and maintain robust recording and orchestration systems that scale across robots, sensors, and lab environments. Collaborate with the ML team on dataset builders, ingestion pipelines ...

/Xilinx RFSoC (Zynq UltraScale+) and Intel FPGA platforms (Agilex/Stratix) Integrate with high-speed ADC/DAC interfaces and real-time data pipelines Work across VHDL, SystemVerilog and MATLAB/Simulink HDL workflows Support lab-based integration, test and evaluation using RF instrumentation Contribute to architectural … analysers) Experience leading or mentoring engineers Desirable experience Embedded Linux or bare-metal C development High-speed interfaces (AXI, JESD204, memory architectures) Streaming data architectures and high-throughput signal handling Experience within EW, radar or spectrum-related systems Our non-negotiables Due to the highly secure nature ...

week working remotely. The Role You will design, build, and optimise the fund’s quantitative research and trading systems. This includes everything from data ingestion and modelling pipelines to execution tooling and performance analytics. You’ll work closely with quants, traders, and the CTO to deliver clean, robust … production-ready code that directly supports live trading. Key Responsibilities Develop and maintain quant research infrastructure , backtesting frameworks, and simulation tools Build data pipelines for market, alternative, and proprietary datasets Implement and optimise systematic trading models in collaboration with researchers Improve execution workflows, latency, and reliability Contribute ...

work within a lean, agile team to bridge frontend development with backend systems, transforming how internal engineers interact with, validate, and secure core data pipelines. Your Impact Platform Innovation: Build and scale developer-facing tools and dashboards from scratch to manage data contracts at the code … level. Infrastructure Safeguards: Protect downstream systems (like recommendation engines) by implementing code-level guardrails against data incidents. Capacity Expansion: Act as a critical accelerator for a tight-knit core team, driving rapid prototyping during an essential discovery MVP phase. Cross-Functional Tooling: Balance frontend utility with data ...

marine, defence, and scientific applications. What you'll do: 1. FPGA Architecture & Real-Time Signal Processing Develop FPGA designs for: Multi-channel acoustic data acquisition Digital down conversion (DDC) Filtering (FIR/IIR) FFT processing Beamforming algorithms Pulse compression and matched filtering Implement high-speed streaming data … interfaces such as: High-speed ADC/DAC interfaces JESD204 LVDS SERDES Develop memory interfaces (DDR3/DDR4) for buffering high-bandwidth acoustic data Ensure deterministic timing and synchronisation (e.g., PTP, trigger alignment). 3. Hardware Integration & Subsea Considerations Collaborate with analogue and hardware engineers on: Front ...