501 to 525 of 648 Data Pipeline Jobs in the UK

handling, autoscaling - Ensure graceful handling of failovers, deployments, and edge cases across all services Data Pipelines & Warehouse - Manage the Airbyte replication pipeline from production database to data warehouse - Configure incremental replication for new tables as the product evolves - Maintain the data warehouse (PostgreSQL … autovacuum tuning, memory parameters, capacity planning - Manage RudderStack for event streaming to analytics (Amplitude) and attribution (AppsFlyer) CI/CD & Deployment - Own CircleCI pipeline configuration and reliability - Manage ECS deployment strategies, health checks, and rollout verification - Maintain test environments and cleanup automation WHAT WE'RE LOOKING FOR Must Have ...

spinout building AI-powered clinical decision-support tools certified as Software as a Medical Device (SaMD). Our platform uses real-world EHR data to identify patients at risk of preventable harm — giving NHS clinicians time to act. We are a small, high-ownership team operating … Role You will own and shape the technical core of a live clinical AI platform — working across backend services, ML infrastructure, and hospital data integrations. You will have a direct line to the CTO and CEO from day one, with real influence over architectural decisions on a system ...

Head of Engineering (Data Platform) Azure & Databricks transformation | Scaling Media Organisation | Hybrid (London) The Company Our client is a fast-growing, technology-led media organisation where data and cloud platforms sit at the heart of how the business operates. They are investing heavily in modern infrastructure … initiatives, and highly connected digital services across the organisation. This hire plays a critical role in shaping how teams access, share, and operationalise data at scale. Why this role stands out: Strategic ownership of cloud and data platforms across the business Direct involvement in enabling ...

days Location: London, England Job Summary: We are looking for a hands-on Senior Software Engineer to own and accelerate our product delivery pipeline — from back-end database optimization to client-facing interactive dashboards and reporting platforms. This is a builder role. You will work directly alongside the Head … Data & Customer Analytics to identify bottlenecks, design improvements, and push products from backlog to production. You will be embedded in a small, high-output team where your contributions are immediately visible and impactful. Responsibilities: Optimize and maintain a Treasury Dashboard hosted in client Azure environments (currently Streamlit-based ...

Software Engineers (Java/Data Platform) Remote First (Must be UK based with full right to work with no sponsorship) £75,000–£95,000 **Monthly meetups in London - fully expensed/optional. Access to offices should you prefer I’m working with a global consumer platform processing millions … user events, building systems that turn raw behavioural data into real-time insights and recommendations. This is not a typical backend role. It sits at the intersection of data, distributed systems and product, working on one of the most unique user datasets in its space. They ...

market. We are now entering an exciting growth phase. The business is live, performing strongly, and moving towards significant scale. As we grow, data science will sit at the heart of how we underwrite, price, monitor risk and improve performance. We are looking for a sharp, hands … Data Scientist to help drive that forward. You will be expected to deliver quickly, iterate based on evidence, and continuously improve decisioning as new data becomes available. What you'll do · Build and improve models across credit risk, pricing and portfolio performance · Analyse originations, arrears, defaults ...

requires a strong AI Consultant to design, build, and deploy machine learning solutions on large-scale datasets. This role focuses on turning complex data into actionable insights and production-ready AI models. Key Responsibilities Develop, test, and deploy machine learning models and AI solutions. Work with large, complex … datasets to extract insights and drive decision-making. Build data pipelines and prepare datasets for modelling. Apply advanced analytics to use cases such as prediction, risk modelling, and recommendation systems. Evaluate model performance and optimise for accuracy and efficiency. Collaborate with cross-functional teams to translate business problems ...

strong engineering capability is the bigger priority. What you will do Design and build core platform components including pricing services, APIs, and data pipelines Develop scalable ingestion and processing systems for market, macro, and time-series data Build internal tooling that improves how analytics and trading … platform What you will need Strong software engineering fundamentals across architecture, design, and quality practices 5+ years’ experience in platform engineering, quant development, data engineering, or software engineering within financial services Strong Python experience in production environments Exposure to C++ or Rust would be beneficial for performance-sensitive ...

Machine Learning Operations Engineer opportunity. You will build and maintain the infrastructure for AI and ML models, focusing on data pipelines, automation, and deployment. This role lives between data engineering and machine learning Key Skills and Experience: Previous experience in tuning and deploying machine learning methods ...

Responsibilities: Design and build responsive web and mobile experiences for end users. Develop intuitive interfaces for operators and remote supervision, integrating teleoperation, navigation data, and safety features. Create and maintain dashboards and front-end systems that support operational workflows and data-driven decision-making. Develop … manage scalable backend services, including APIs, databases, and real-time data pipelines. Collaborate with AI and autonomy teams to embed advanced models into user-facing products and tools. Work closely with cross-functional teams and take ownership of features from concept through to deployment. Required Skills & Experience: 5+ ...

Responsibilities: Design and build responsive web and mobile experiences for end users. Develop intuitive interfaces for operators and remote supervision, integrating teleoperation, navigation data, and safety features. Create and maintain dashboards and front-end systems that support operational workflows and data-driven decision-making. Develop … manage scalable backend services, including APIs, databases, and real-time data pipelines. Collaborate with AI and autonomy teams to embed advanced models into user-facing products and tools. Work closely with cross-functional teams and take ownership of features from concept through to deployment. Required Skills & Experience: 5+ ...

within Birketts’ core ecosystem, including Microsoft 365 (Copilot), iManage (Document Management), Aderant Expert (Practice Management), Intapp Intake (new client onboarding) and Microsoft Fabric (data platform). Azure is a likely hosting platform for any future ‘Birketts-approved AI environment’, subject to requirements and build vs buy decisions. … repeatable AI-enabled workflows. This role is delivery-oriented: you will design, build and ship incremental improvements, partnering with colleagues across Development, Data, Security, Knowledge Management and Learning & Development to drive adoption, skills sharing and effective change management. You will also support evidence-based build vs buy decisions ...

/systematic strategies Solid academics What You'll Be Doing Designing and building high-performance trading systems alongside traders and quants Creating data pipelines to ingest and process large volumes of market data Developing monitoring tools and dashboards for live trading environments Improving engineering standards through … qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: roberthalf.com/gb/en/privacy-notice. ...

play a key part in shaping testing practices, defining processes, and embedding quality deeply into our development lifecycle. The product is highly data-driven, with dashboards, reports, and complex business logic. You’ll work closely with developers, product, and design to ensure features are delivered correctly, reliably … manual testing when needed, and help the team aggressively reduce our bug backlog and technical debt. The Business This is a London-based data intelligence startup operating at the intersection of brand strategy, emerging technology, and digital culture. The company works with some of the world's biggest ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

experience on AWS; Azure exposure is highly beneficial. Hands-on experience or working exposure in securing LLM/AI workloads, including model deployment, data flows, and runtime considerations. Proficiency with cloud-native security tooling (CSPM, CWPP, secrets management, logging/monitoring, container security). Experience securing … ensure secure implementation of AI workloads. Desirable Skills/Knowledge/Experience Experience securing GenAI, Agentic AI, vector databases, model APIs, or data pipelines used by LLMs. Knowledge of responsible AI principles, model governance, or AI-specific threat modelling (e.g., adversarial ML, data poisoning, prompt injection ...

physical tasks. They’re now hiring an AI/ML Infrastructure Engineer to own the end-to-end infrastructure that powers model training, data pipelines, and deployment into real-world robotic systems. This is a highly technical role sitting at the intersection of machine learning, distributed systems … robotics - not a generic MLOps position. Key Responsibilities: Build and scale GPU-based training infrastructure for large ML workloads Develop robust data pipelines for multi-modal datasets Own experiment tracking, model versioning, and reproducibility Design and optimise model deployment pipelines (including edge inference) Improve CI/CD workflows ...

seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design and build robust data pipelines using Azure Data Factory and Databricks Develop ETL/ELT processes to transform raw data into analyti click apply for full job details ...

real-world application. What you’ll be doing You’ll design and develop AI agent systems that can interact with tools, APIs, and data sources to complete complex tasks autonomously. You’ll work closely with product and engineering teams to translate clinical and operational requirements into scalable … agent frameworks (e.g. LangChain, LlamaIndex, AutoGen or similar) Understanding of prompt engineering, RAG pipelines, and tool-using AI systems Experience working with APIs, data pipelines, and cloud platforms (AWS, Azure or GCP) Strong software engineering fundamentals (testing, version control, scalable design) Bonus experience: Background in healthcare, life sciences ...

performance, and real-world application. What youll be doing Youll design and develop AI agent systems that can interact with tools, APIs, and data sources to complete complex tasks autonomously. Youll work closely with product and engineering teams to translate clinical and operational requirements into scalable AI-driven … agent frameworks (e.g. LangChain, LlamaIndex, AutoGen or similar) Understanding of prompt engineering, RAG pipelines, and tool-using AI systems Experience working with APIs, data pipelines, and cloud platforms (AWS, Azure or GCP) Strong software engineering fundamentals (testing, version control, scalable design) Bonus experience: Background in healthcare, life sciences ...

integration with Zero Trust. Harden AKS clusters and cloud-native apps through role-based access control (RBAC), secrets management, and runtime protection. Secure data pipelines and models in AI workloads, implementing guardrails for model integrity and prompt injection defence. Cloud & Network Security Engineer secure access and posture … automation. Strategic, yet pragmatic: balances best practice with business context. Proactive, communicative, and passionate about elevating security posture through innovation. MS Engineer & MS Data Scientist Associate Ability to exercise independent judgment and act on it. What’s in it for you? Hybrid working options for flexibility. Bonus linked ...

play a key role in supporting the plant's digital transformation journey. Working closely with Plant IT, Ford Production System teams, Global IT, Data Science and AI teams, you will help develop, deploy and maintain digital tools that improve manufacturing processes across the site. You will support … dashboards. Work with key stakeholders to develop and support a digital transformation roadmap focused on efficiency, waste reduction and process improvement. Partner with Data Science and AI teams to explore how predictive analytics can support production processes. Identify opportunities to improve manufacturing performance through digital tools, automation, data ...

India's original IT garage start-ups. For more on HCL, please visit www.hcl.com Job Role - Job Title: Senior Data Lifecycle & Catalog Expert Experience: 10+ Years Work Location: Glasgow, UK Employment Type: Permanent and 1 year fixed term contract Hybrid- 2 days onsite and 3 days remote … Description- Senior Data Lifecycle & Catalog Expert – 8-10 yrs of exp Expertise in data lifecycle management and data cataloging Strong experience with databases: Sybase, DB2, MongoDB, SQL Hands-on experience in batch processing and data pipelines Proficiency in Java/Perl scripting ...

looking for a Data Platform Engineer with strong expertise in Microsoft Fabric and Terraform to build and scale a modern, cloud-native data platform. You'll focus on creating a highly automated environment where both infrastructure and data services are defined and deployed through … hybrid role with 1 day a week in the Milton Keynes office. What you'll do Design and deliver a Fabric-based data platform with a modular, scalable architecture. Use Terraform to implement Infrastructure as Code and automate deployments. Build and optimise data pipelines, lakehouse/ ...

surveillance capability within the Markets Risk Technology function of a major UK bank. The role ensures that surveillance controls, supervisory workflows and associated data flows are designed and documented with a high level of technical precision. The position also contributes to the review and automation of existing manual … current manual supervisory processes operated across front-office and operations Identify automation opportunities and support transition planning as new platform features are Deployed Data Flow and Requirements Documentation Map end-to-end data flows from trading systems to surveillance platforms Identify gaps, ambiguities or incomplete requirements ...