401 to 425 of 430 Data Pipeline Jobs in the UK excluding London

algorithm development, optimization modelling, and power system techno-economic assessment. The ideal candidate will have deep knowledge of Python's core features, data analysis, web frameworks, and modern development practices. Experience with mathematical optimization tools, containerization, and message-queue technologies will be considered a significant advantage. Your Responsibilities … Software Engineering Develop, optimize, and maintain software using core Python features including iterators/generators, exception handling, file handling, type hints, OOP, and data structure design. Build scalable algorithms and write clean, maintainable, and well-structured code. Develop and maintain RESTful APIs using OpenAPI/Swagger, Connexion ...

roll up your sleeves and get involved in: Build and maintain scalable backend services in Python (Django) and AWS. Design APIs and data models that serve both internal tools and customer-facing applications. Work with IoT messaging protocols (MQTT, HTTP, or similar) to communicate with field devices. Working …/creating React UIs and supporting infrastructure to provide rich interfaces to users. Help ingest, store, and query large volumes of time series data from InfluxDB Collaborate with the Hardware and Edge teams to support device provisioning, remote diagnostics, and secure firmware rollouts Investigate and resolve production issues ...

strong track record of innovation, operational excellence, and a culture that values collaboration, flexibility, and diversity. This opportunity sits within a modern Data Science team and will play a pivotal role in designing and building an AI-enabled reporting and reconciliation platform that will transform the client … Fund Administration processes. Role Overview The successful candidate will report into the Head of Data Science and work closely with a dedicated Product Manager in the Fund Administration team. This is a hands-on engineering role where you will architect, build, and deliver production-grade automation solutions ...

build decision-making infrastructure for complex, real-world systems, primarily in global logistics. Our platform combines edge devices, cloud-based analytics, streaming data pipelines, and graph-based systems to process real-time data and support automated decisions. We are hiring a Senior Backend Engineer to design … high-complexity distributed systems. You will own systems end-to-end, from architecture through to production. Responsibilities Design and build backend services and data pipelines in Python Develop and operate streaming systems (Kafka or similar) Work with graph-based data structures and real-time analytics Build ...

, microbiome sequencing, clinical and real-world outcomes. Our goal is to translate biological signals into actionable compound discovery and optimisation, powering a pipeline across: Discovery → Prediction → Design → Validation We are looking for a Senior Computational Biologist with ML Engineering background to help build, bridge, and functionalise … intelligent ingredient complexes o repurposed peptides o newly discovered natural peptides 4) Productionise the AI product launch ● Build end-to-end ML pipeline covering ingestion, training, evaluation and deployment ● Develop APIs/services to serve predictions and ranked candidates into internal tools and client outputs ● Create evaluation harnesses ...

performance, stability, and sensitivity of next-generation technologies. Working closely with experimental scientists and hardware engineers, you will translate complex physical system data into actionable improvements through intelligent data modelling and automation. Key Responsibilities Develop and implement custom machine learning models for signal processing, sensor fusion … system optimisation Design models for applications such as noise suppression, drift compensation, anomaly detection, and adaptive calibration Build and maintain robust data pipelines to process high-dimensional experimental and time-series datasets Train, validate, and optimise machine learning models using modern Python-based frameworks Integrate ML inference into ...

solutions within our clients AWS environment. This is a great opportunity for a MLOps Engineer to become a vital part on a new data team. This is a hybrid role with the expectation to be in the London office 1-2 times per week. Key Responsibilities Deploy … manage batch inference pipelines * Implement CI/CD workflows for ML using Git-based processes * Containerize applications using Docker * Monitor model performance, data drift, and system health using CloudWatch * Automate data pipelines and feature workflows using Python & SQL * Ensure secure access and governance using ...

Support Location: Bristol (hybrid) Salary: up to £50,000 Ready to move from application support into a role where you own a critical data product and release cycle? Do you want to join a rapidly growing scale up, with the opportunity to grow and shape your own team … scale-up, working with household-name clients across 20+ countries. You’ll sit between Engineering, Analytics and client-facing teams, making sure monthly data releases are reliable, accurate and on time – and that issues get unblocked quickly and sensibly. The Role: Own and improve the monthly release ...

scalable integration platform (Hubspot) Define patterns for event-driven workflows and asynchronous processing Establish best practices for reliability (idempotency, retries, failure handling, data consistency) Set standards for how internal services integrate with external APIs and third-party systems Build the Platform (Hands-On) This is a hands … Lambda, API Gateway) Build event-driven pipelines using EventBridge, SQS, and SNS Implement robust API integrations and webhook processing Design and implement data mapping and transformation between systems Integrate External Systems Build and maintain integrations with platforms such as HubSpot and other partner systems Design resilient, scalable ...

growing climate tech company developing digital platforms that help organisations better understand and manage complex infrastructure systems. Their technology brings together sensor data, cloud platforms, analytics, and geospatial insights to provide greater visibility into real-world operations. By combining modern software engineering with environmental innovation, the company … endpoints Applying best practices around code quality and system design Contributing to reliable and regular platform releases Developing your understanding of cloud infrastructure, data pipelines, and distributed systems Seeing your work support technology that enables more sustainable infrastructure management What We’re Looking For We’re looking ...

Role We are looking for a Head of Engineering to join a high-growth technology business operating at the forefront of large-scale data processing, machine learning and next-generation search experiences. In this role, you will lead multiple engineering teams across data … diverse and deeply technical organisation. Responsibilities Own the execution of the engineering roadmap across all product and platform areas Lead architectural direction for data processing, machine learning pipelines and web application development Ensure systems are scalable, reliable and capable of handling large-scale data and evolving ...

multi-award-winning research agency in mid-transformation. We’re rebuilding our processes from the inside out, including using Displayr to streamline our data pipeline. The Role We’ve moved to Displayr, and need someone who can use it with confidence, curiosity and creativity. You will … connection between teams: part Displayr specialist, part problem-solver, part data scientist. This is a role at the coal-face of our work. You’ll manage an ever-shifting workload, keeping projects on track amid changing priorities and pipelines. Key Responsibilities Consistently delivering clean, accurate tables & reports Help ...

pioneer in delivering secure, cost-effective cloud solutions designed to help businesses operate confidently in the digital landscape. Their services span SaaS, data recovery, VoIP, office applications, cybersecurity, security cameras, and IoT solutions—providing organizations with the essential tools to enhance efficiency and protect critical data. About … strong technical skills across AWS core services, AI/ML platforms, and cloud-native tooling, engineers learn to diagnose complex issues, analyse model and pipeline behaviour, report incidents, and clearly communicate solutions that enable data- and AI-driven business outcomes. This role supports the organisation in maximising ...

organisation operating at the intersection of science and technology. They are seeking an experienced API Engineer to support the development of scalable data platforms that underpin advanced scientific research. This is a hands-on contract role focused on building robust APIs, optimising data models, and integrating … complex scientific datasets across multiple systems. Responsibilities: Design and develop RESTful or GraphQL APIs to expose complex datasets Build and optimise relational data models using ORM frameworks Improve database performance, including query optimisation and indexing strategies Integrate internal platforms with third-party scientific tools and systems Develop ...

SKILLS - Extensive experience in PowerBI. - Strong skills in Power Platform (Power Apps and Power Automate). - Cloud experience in AWS. - Excellent understanding of data pipelines click apply for full job details ...

Workflow Design: Authoring and testing Electronic Batch Records (EBR) and manufacturing recipes following ISA-95/ISA-88 standards to ensure efficient production. Data Management: Developing data pipelines and dashboards for real-time monitoring of Key Performance Indicators (KPIs) such as yield, cycle time, and OEE. ...

Data & Statistical Modelling Engineer Oxfordshire £Competitive + Good Benefits Our client is a fast-growing, venture-backed advanced manufacturing company, redefining how high-performance metal components are designed and produced. By combining machine learning, physics-based modelling, and metal 3D printing, the team is pushing the boundaries … scale next-generation manufacturing systems. The Role Laser Powder Bed Fusion machines generate vast streams of data. The successful candidate will turn that data into insight and predictive power. Responsibilities include: Building statistical and machine learning models to predict machine and component performance Identifying key drivers of variation ...

Title: Data Analyst (SQL) Location: Hybrid, North Yorkshire (2-3 days pw in the office) Overview We are seeking a Data Analyst (SQL) to support the development and maintenance of SQL databases, data pipelines, and reporting datasets. You will work closely with … reporting teams to ensure data is accurate, reliable, and ready for analytics click apply for full job details ...

Responsibilities - Technical Leadership & System Expertise Become the CST technical authority on the MDA system, including (not exhaustive): GeoVS software architecture and functionality System data sources, Sensor integration (AIS, radar, satellite, cameras, radio, etc.) Network infrastructure, server environments, virtualisation, interfaces, and data pipelines Translate complex technical concepts … across tickets, events, and sensor/system performance to identify recurring patterns and systemic weaknesses Drive initiatives to improve System uptime and reliability, Data quality, Installation and configuration standards along with recommend and initiate improvements in process, documentation, and training Skills & Experience Strong understanding of IT infrastructure: networks ...

robust mathematical models and scalable software systems. What You’ll Be Doing Designing novel algorithmic and machine learning approaches to interpret complex scientific data Developing mathematical models (including probabilistic/Bayesian methods) Building proof-of-concept tools and production-ready Python systems Managing and improving data ...

Lead Software Engineer to own the design and delivery of our IoT and cloud software platform. Youll connect our ultra-fast chargers, manage data and remote control functions, and ensure security and scalability across our systems. Youll work directly with the VP Product and VP Power Electronics, shaping … performance turning ideas into real, working solutions. ________________________________________ What Youll Do Build IoT and cloud software for charger connectivity and monitoring Create telemetry and data pipelines (PLC, CAN) Enable secure remote control and bi-directional communication (MQTT/WebSockets) Deliver OTA firmware updates and REST APIs (OCPP/OCPI ...

closely with Product and Design teams to deliver intuitive, scalable workflows and user experiences across customer-facing applications. Solve complex engineering challenges involving data pipelines, secure access control, system observability, and large-scale SaaS infrastructure . Shape engineering practices across teams, embedding quality, security, agility, and DevOps principles … scaling high-performing engineering teams , including hiring, mentoring, performance frameworks, and career progression Experience working with cybersecurity platforms or large-scale security data , ideally within threat intelligence or offensive security environments Track record building engineering organisations within early-stage or high-growth B2B SaaS startups serving enterprise clients ...

Salary: Competitive The Role We are looking for a Python Developer with strong GIS experience to join a growing engineering team building geospatial data platforms used by global organisations. This role sits within the Client Solutions team , responsible for developing tools and data pipelines that deliver ...

time system responsiveness (<1ms). Develop and integrate Windows Service components for background processing, system monitoring, and service lifecycle management. Build real-time data visualization and charting (ScottPlot WPF) for live telemetry at 4Hz+ sample rates, with consistent UI styling using Material Design Themes. Develop batched I/… simultaneous dataframe processing. Design and maintain failover and degraded-mode behavior to ensure system resilience under adverse conditions. Design and maintain real-time data pipelines with a focus on algorithmic efficiency, fault tolerance, and graceful degradation. Perform profiling and optimization using Visual Studio 2026, memory and CPU profiling ...

Location-Chippenham, UK (On-Site) Monday to Friday - Office Hours At Oakhouse Foods, part of Pilgrim's Europe, data drives everything we do - from operational performance to customer experience. We're looking for a technically strong and commercially aware Integrations & Data Engineer to design, build … support resilient data pipelines and system integrations that power our business click apply for full job details ...