651 to 675 of 688 Data Pipeline Jobs in the UK

Senior Data Engineer/GCP/Looker/Big Query £500 - 550 per day (Outside IR35) London/Hybrid Senior Data Engineer/GCP/Looker/Big Query This is an opportunity for you to join a rapidly growing ecommerce business who are looking … Senior Data Engineer to build and maintain data pipelines for a new reporting solution within the business. You'll be responsible for the build across ingestion, modelling and creating semantic layers using their GCP stack. Successful applicants will have experience with: Looker BigQuery GCP Gemini Exceptional ...

Required Experience & Skills Core Stack: Proven expertise in building and scaling services using Java , Postgres , and BigTable on Google Cloud Platform (GCP) . Data Engineering: Hands-on experience managing data pipelines, specifically utilizing Scio and Flight . Domain Knowledge: Previous experience in E-commerce or Financial ...

deploying, and optimising Splunk Enterprise and Splunk IT Service Intelligence (ITSI) in complex hybrid Kubernetes/OpenShift environments. You will handle large-scale data onboarding, build advanced ITSI service models and monitoring views, tune platform performance, implement secure governance, and integrate with modern observability pipelines. The position supports … high-stakes enterprise setting. Key Responsibilities Design, deploy, and operate Splunk Enterprise and ITSI in hybrid Kubernetes/OpenShift environments. Onboard data at scale using HEC, Universal Forwarders/Deployment Server; align to Common Information Model (CIM); enforce RBAC, retention policies, and cost guardrails. Build ITSI service decompositions ...

deploying, and optimising Splunk Enterprise and Splunk IT Service Intelligence (ITSI) in complex hybrid Kubernetes/OpenShift environments. You will handle large-scale data onboarding, build advanced ITSI service models and monitoring views, tune platform performance, implement secure governance, and integrate with modern observability pipelines. The position supports … high-stakes enterprise setting. Key Responsibilities Design, deploy, and operate Splunk Enterprise and ITSI in hybrid Kubernetes/OpenShift environments. Onboard data at scale using HEC, Universal Forwarders/Deployment Server; align to Common Information Model (CIM); enforce RBAC, retention policies, and cost guardrails. Build ITSI service decompositions ...

deploying, and optimising Splunk Enterprise and Splunk IT Service Intelligence (ITSI) in complex hybrid Kubernetes/OpenShift environments. You will handle large-scale data onboarding, build advanced ITSI service models and monitoring views, tune platform performance, implement secure governance, and integrate with modern observability pipelines. The position supports … high-stakes enterprise setting. Key Responsibilities Design, deploy, and operate Splunk Enterprise and ITSI in hybrid Kubernetes/OpenShift environments. Onboard data at scale using HEC, Universal Forwarders/Deployment Server; align to Common Information Model (CIM); enforce RBAC, retention policies, and cost guardrails. Build ITSI service decompositions ...

Responsibilities/Objectives 1.Design, deploy, and operate Splunk Enterprise and ITSI within hybrid Kubernetes and OpenShift environments 2.Onboard and manage large-scale data ingestion using HEC, Universal Forwarders, and Deployment Serve 3.Align data models to CIM standards and implement RBAC, retention policies, and cost controls 4.Develop … trees, KPIs, thresholds, and visualisation tools 3.Deep understanding of Kubernetes and OpenShift observability including cluster metrics, logs, and event correlation 4.Experience with modern data pipelines and telemetry tools such as OpenTelemetry, Prometheus, Fluentd/Fluent Bit, Vector, and Kafka Desirable Skills/Experience 1.Candidates should be comfortable working ...

Responsibilities - Technical Leadership & System Expertise Become the CST technical authority on the MDA system, including (not exhaustive): GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

access and leverage property data. Our platform empowers property developers, land agents, architects, and planners with real-time insights, helping them make smarter, data-driven decisions when acquiring and developing land. In just five years, we’ve built one of the UK’s most advanced property data pipelines, integrating thousands of data sources and processing terabytes of information with less than 24-hour latency. Our cutting-edge platform is shaping the future of property intelligence. About The Role We’re looking for a Lead Full-Stack Engineer who will combine deep technical ability ...

further information about this position please apply. you will build the infrastructure that sits between our traders and the market - execution paths, data pipelines, and observability tooling that power trillions in annual notional volume. When a system performs at 3am under peak load, you will … ordering guarantees, exactly-once semantics, consumer group management Production observability: metrics (Prometheus/OpenTelemetry), distributed tracing, structured logging, and alert design CI/CD pipeline design including benchmarking gates, automated performance regression detection, and reproducible builds TDD as a design discipline - property-based testing, integration tests, chaos and fault ...

three internal AI agents: • Website Optimisation and CRO Agent • Performance Marketing and Growth Agent • Brand Copywriter Agent Each agent will ingest real business data, generate prioritised recommendations or outputs, integrate into existing workflows and continuously improve based on live performance feedback. What You Will Do • Define … architecture across multiple use cases • Map and integrate data sources across analytics, paid media, CRM and ecommerce systems • Design orchestration logic and feedback loops • Translate commercial growth objectives into functional AI specifications • Oversee implementation to ensure scalability, governance and measurable impact • Embed AI capability directly into operational team ...

robust mathematical models and scalable software systems. What You’ll Be Doing Designing novel algorithmic and machine learning approaches to interpret complex scientific data Developing mathematical models (including probabilistic/Bayesian methods) Building proof-of-concept tools and production-ready Python systems Managing and improving data ...

Dev. This is a forward deployed software engineering role with an embedded-with-customer edge. You’ll contribute to product development, integrate complex data, build custom tools, and work shoulder-to-shoulder with customers to enable them to accomplish their goals in the product. An FDE's success … with the platform and achieve their mission objectives. You’ll be responsible for everything from understanding core user needs to writing code for data integrations and custom applications. This position requires you to think like a startup cofounder or an early-stage CTO. You’ll dive into ambiguous ...

Lead Software Engineer to own the design and delivery of our IoT and cloud software platform. Youll connect our ultra-fast chargers, manage data and remote control functions, and ensure security and scalability across our systems. Youll work directly with the VP Product and VP Power Electronics, shaping … performance turning ideas into real, working solutions. ________________________________________ What Youll Do Build IoT and cloud software for charger connectivity and monitoring Create telemetry and data pipelines (PLC, CAN) Enable secure remote control and bi-directional communication (MQTT/WebSockets) Deliver OTA firmware updates and REST APIs (OCPP/OCPI ...

closely with Product and Design teams to deliver intuitive, scalable workflows and user experiences across customer-facing applications. Solve complex engineering challenges involving data pipelines, secure access control, system observability, and large-scale SaaS infrastructure . Shape engineering practices across teams, embedding quality, security, agility, and DevOps principles … scaling high-performing engineering teams , including hiring, mentoring, performance frameworks, and career progression Experience working with cybersecurity platforms or large-scale security data , ideally within threat intelligence or offensive security environments Track record building engineering organisations within early-stage or high-growth B2B SaaS startups serving enterprise clients ...

reviews, coaching, and career development pathways Partnering with Product Design to deliver intuitive, robust enterprise workflows Tackling complex technical challenges across large-scale data pipelines, secure access, event-driven systems, and multi-tenant architectures Embedding Agile, DevOps, and best practices into the engineering organisation What theyre looking … granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms or large-scale security data systems Why join? Competitive compensation & benefits Key leadership role in a high-growth cybersecurity scale-up Opportunity to shape global engineering strategy and culture ...

reviews, coaching, and career development pathways Partnering with Product Design to deliver intuitive, robust enterprise workflows Tackling complex technical challenges across large-scale data pipelines, secure access, event-driven systems, and multi-tenant architectures Embedding Agile, DevOps, and best practices into the engineering organisation What theyre looking … granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms or large-scale security data systems Why join? Competitive compensation & benefits Key leadership role in a high-growth cybersecurity scale-up Opportunity to shape global engineering strategy and culture ...

models — enabling robots to understand context, predict intent, and act in complex, dynamic environments. Design and scale auto-labeling and large-scale data pipelines to train and evaluate multimodal models for navigation and interaction. Develop and implement scene understanding and 3D reconstruction methods that give robots persistent spatial … taking projects from concept to model training, evaluation, and robot integration. Comfortable working in a fast-moving, research-driven environment with evolving models, data, and tools. What We Offer Competitive salary plus participation in our Employee Stock Option Plan Paid vacation with adjustments based on your location ...

product and platform strategy for an observability and telemetry ecosystem, covering OTEL collectors, OTEL/OPAM agents, Kafka-based data pipelines, and time-series data platforms. This role acts as the bridge between CIO-level stakeholders, architecture, and engineering, ensuring business requirements are converted into scalable … Define and own the product vision and platform roadmap for observability and telemetry platforms. Lead blueprint and target-state architecture for OTEL-based data collection, Kafka ingestion, and time-series data storage. Drive tool finalization and POC execution, ensuring alignment with enterprise standards and non-functional ...

used by front-office teams Collaborate closely with traders and quantitative researchers to enable new trading strategies Build scalable, low-latency systems and data pipelines handling large volumes of market data Contribute across the full software development lifecycle, from design to production support Continuously improve system ...

builders in London. Now we’re looking for a GTM Engineering Intern to work directly with the founder to build an AI-driven pipeline engine that helps drive growth and revenue. This internship can turn into a full-time role for the right person. This role is ideal … Work directly with the founder on a mission-critical system Learn how AI-native companies actually build growth engines Build real systems that drive pipeline and revenue Work at the bleeding edge of AI development For the right person, this internship can turn into a full-time founding role. ...

rapidly growing fintech building a next-generation account-to-account payments network. By combining real-time bank payments with financial and identity data, they help businesses onboard users, accept payments, and make payouts quickly and securely at scale. Their products are used by companies across e-commerce, gaming … strategy for fraud prevention and risk management across the company’s payments and credit products. You’ll work at the intersection of technology, data, and security, collaborating with internal teams and external partners to build tools and processes that detect, prevent, and respond to fraud efficiently while maintaining ...

firm seeking an FPGA/ASIC Hardware Engineer to design high-performance, low-latency compute systems. You’ll design RTL in SystemVerilog, optimise data pipelines, and work on advanced hardware platforms in a hands-on, performance-focused role—no industry background required. Key responsibilities: Design and develop FPGA …/or ASIC solutions as part of a cross-functional engineering team Implement and optimise RTL for complex data structures and processing pipelines Explore and evaluate new tools, technologies, and architectures Contribute to a fast-moving, modern hardware development environment Key requirements: 4+ years’ experience in FPGA ...

multiple MFT strategies and multiple exchanges in equities, crypto, and futures. Work with quant and machine learning researchers to continuously refine and improve data pipelines and execution algorithms. Provide an extra pair of hands for various other SE/QD workloads. Responsibilities for a Quantitative developer Build, maintain … production-grade code. Manage and execute orders across multiple MFT strategies and exchanges. Collaborate with quant and machine learning researchers. Refine and improve data pipelines and execution algorithms. Support various SE/QD workloads. Qualifications Experience developing live execution systems across different products and platforms at top tier ...

such as: Large language models and agentic workflows Retrieval-augmented generation (RAG) Optimisation and decision intelligence systems Enterprise integrations with existing platforms and data systems Key Responsibilities Lead and grow the engineering team responsible for the company’s AI platform Own platform architecture, technical strategy, and engineering delivery … Build production-grade AI systems integrating LLMs, agents, and data pipelines Work closely with product and leadership teams to define the AI roadmap Collaborate with enterprise customers to design scalable AI solutions What They’re Looking For 10+ years of software or platform engineering experience Experience leading engineering ...

targeting real-time system responsiveness ( Develop and integrate Windows Service components for background processing, system monitoring, and service lifecycle management. Build real-time data visualization and charting (ScottPlot WPF) for live telemetry at 4Hz+ sample rates, with consistent UI styling using Material Design Themes. Develop batched I/… simultaneous dataframe processing. Design and maintain failover and degraded-mode behavior to ensure system resilience under adverse conditions. Design and maintain real-time data pipelines with a focus on algorithmic efficiency, fault tolerance, and graceful degradation. Perform profiling and optimization using Visual Studio 2026, memory and CPU profiling ...