476 to 500 of 582 Data Pipeline Jobs in the UK

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

design, secure, and optimise Azure environments at scale. You’ll play a key role in cloud transformation, migrating legacy systems, and driving modern data, AI, and automation capabilities. What You’ll Be Doing Design and manage Azure infrastructure (compute, storage, networking, Microsoft Fabric) Lead on-prem Azure migrations … with minimal downtime Own identity & access (Microsoft Entra ID/Azure AD, hybrid environments) Implement API integrations using Azure API Management (APIM) Deliver data & analytics solutions (Microsoft Fabric, Power BI, AI services) Drive security best practice (Defender suite, Zero Trust, Purview) Build automation & IaC (PowerShell, Azure CLI, Terraform ...

physical tasks. They’re now hiring an AI/ML Infrastructure Engineer to own the end-to-end infrastructure that powers model training, data pipelines, and deployment into real-world robotic systems. This is a highly technical role sitting at the intersection of machine learning, distributed systems … robotics - not a generic MLOps position. Key Responsibilities: Build and scale GPU-based training infrastructure for large ML workloads Develop robust data pipelines for multi-modal datasets Own experiment tracking, model versioning, and reproducibility Design and optimise model deployment pipelines (including edge inference) Improve CI/CD workflows ...

real-world application. What you’ll be doing You’ll design and develop AI agent systems that can interact with tools, APIs, and data sources to complete complex tasks autonomously. You’ll work closely with product and engineering teams to translate clinical and operational requirements into scalable … agent frameworks (e.g. LangChain, LlamaIndex, AutoGen or similar) Understanding of prompt engineering, RAG pipelines, and tool-using AI systems Experience working with APIs, data pipelines, and cloud platforms (AWS, Azure or GCP) Strong software engineering fundamentals (testing, version control, scalable design) Bonus experience: Background in healthcare, life sciences ...

performance, and real-world application. What youll be doing Youll design and develop AI agent systems that can interact with tools, APIs, and data sources to complete complex tasks autonomously. Youll work closely with product and engineering teams to translate clinical and operational requirements into scalable AI-driven … agent frameworks (e.g. LangChain, LlamaIndex, AutoGen or similar) Understanding of prompt engineering, RAG pipelines, and tool-using AI systems Experience working with APIs, data pipelines, and cloud platforms (AWS, Azure or GCP) Strong software engineering fundamentals (testing, version control, scalable design) Bonus experience: Background in healthcare, life sciences ...

integration with Zero Trust. Harden AKS clusters and cloud-native apps through role-based access control (RBAC), secrets management, and runtime protection. Secure data pipelines and models in AI workloads, implementing guardrails for model integrity and prompt injection defence. Cloud & Network Security Engineer secure access and posture … automation. Strategic, yet pragmatic: balances best practice with business context. Proactive, communicative, and passionate about elevating security posture through innovation. MS Engineer & MS Data Scientist Associate Ability to exercise independent judgment and act on it. What’s in it for you? Hybrid working options for flexibility. Bonus linked ...

play a key role in supporting the plant's digital transformation journey. Working closely with Plant IT, Ford Production System teams, Global IT, Data Science and AI teams, you will help develop, deploy and maintain digital tools that improve manufacturing processes across the site. You will support … dashboards. Work with key stakeholders to develop and support a digital transformation roadmap focused on efficiency, waste reduction and process improvement. Partner with Data Science and AI teams to explore how predictive analytics can support production processes. Identify opportunities to improve manufacturing performance through digital tools, automation, data ...

looking for a Data Platform Engineer with strong expertise in Microsoft Fabric and Terraform to build and scale a modern, cloud-native data platform. You'll focus on creating a highly automated environment where both infrastructure and data services are defined and deployed through … hybrid role with 1 day a week in the Milton Keynes office. What you'll do Design and deliver a Fabric-based data platform with a modular, scalable architecture. Use Terraform to implement Infrastructure as Code and automate deployments. Build and optimise data pipelines, lakehouse/ ...

looking for a Data Platform Engineer with strong expertise in Microsoft Fabric and Terraform to build and scale a modern, cloud-native data platform. You'll focus on creating a highly automated environment where both infrastructure and data services are defined and deployed through … hybrid role with 1 day a week in the Milton Keynes office. What you'll do Design and deliver a Fabric-based data platform with a modular, scalable architecture. Use Terraform to implement Infrastructure as Code and automate deployments. Build and optimise data pipelines, lakehouse/ ...

know your interest. Role: Delivery lead Duration: 6 months (Inside IR35) Location: London/Watford, UK (Hybrid) Job description: Role: Delivery Lead – Data Engineering (Lottery Reconciliation Platform) Lead end‐to‐end delivery of an Agile data engineering program focused on lottery transaction reconciliation and financial balancing. … delivery governance, sprint execution, and release management across multiple data engineering teams. Provide strong delivery and technical leadership to Python‐based data engineers . Drive implementation of scalable, high‐volume data solutions for transaction processing and reconciliation. Ensure data accuracy, completeness, traceability ...

compliant AI systems that improve patient outcomes, streamline clinical workflows, and unlock value from healthcare data. You will work closely with clinical stakeholders, data scientists, engineers, and leadership to define AI strategy and deliver impactful solutions across the organization. Key Responsibilities Design and architect …/ML solutions tailored to healthcare use cases (e.g., diagnostics, patient risk prediction, operational optimization) Lead the development of scalable AI platforms and data pipelines Ensure compliance with healthcare regulations (e.g., HIPAA, GDPR) Collaborate with clinical and business teams to translate requirements into technical solutions Evaluate and integrate ...

/Architect to drive enterprise AI initiatives. This role blends strategic leadership with hands-on solution design, working closely with Product, Engineering, and Data teams to deliver scalable, practical AI-driven capabilities. Key Responsibilities Identify and prioritize impactful AI/GenAI use cases with business leaders Define architectures … enabled solutions across data, applications, and workflows Provide hands-on technical leadership in prototyping, model integration, and validation Establish best practices for embedding AI/GenAI into development workflows Build reusable AI patterns and accelerators for enterprise adoption Align with data teams on readiness, governance ...

onboarding of additional delivery capability. You will work primarily across Talend and Oracle RDS platforms , contributing to the development and support of secure data integration and exchange services using established frameworks and patterns. Key Responsibilities Develop and maintain ETL solutions within an existing Talend framework Support data integration and outbound data exchange services Work with Oracle RDS databases to deliver and support data pipelines Collaborate with delivery teams to meet increasing programme demand Ensure solutions align with security, data handling, and quality standards Essential Skills & Experience Active SC Clearance ...

pair on, and review the development work of other lead software developers. You’ll work on the entire company's backend code base: data models, algorithms, data pipelines, infrastructure, APIs, complex database queries, ML models. Learn, use, and improve best practices and processes for high-quality ...

markets. This role sits at the intersection of CX Operations, Product, and Engineering, with a focus on building scalable test automation frameworks and data validation systems that replace highly manual QA processes tied to product launches across Amazon and internal platforms. You will play a critical role … designing automation-first solutions, improving data quality at scale, and partnering with engineering teams to build sustainable systems that ensure accuracy, consistency, and speed across global deployments. THE OPPORTUNITY FOR YOU Design and implement automation frameworks to validate product content, catalog data, and NPI workflows across ...

years of professional experience. You must have 'under-the-hood' knowledge of Python, specifically for building high-throughput microservices and complex data pipelines using FastAPI, Pandas, and NumPy . The RAG & Agentic Expert: This is the 'Critical' requirement. Our client needs someone with deep hands-on experience building … Agentic frameworks . You should know how to use LangChain or LlamaIndex to create AI that can execute multi-step tasks. The Data Architect: Proficiency in Vector Databases is essential. You should be comfortable designing data persistence layers using PG Vector, Pinecone, Milvus, or Mongo Atlas ...

creation across our PE partner portfolio, from first engagement with a sponsor, through deep technical and strategic analysis, to managing our engineers and data scientists as they build and deploy solutions that move EBITDA. You will operate across a range of workstreams simultaneously: evaluating AI opportunities …/ML product management, strategy consulting (MBB or comparable preferred), investment banking, or engineering You have managed teams of 5+ people (engineers, data scientists, consultants, or analysts) and held them accountable to ambitious timelines You have managed executive and C-suite stakeholder relationships, ideally ...

visibility, operational dashboards, and scalable deployments across Europe and North America. This is not embedded/vehicle software, it’s cloud platform engineering, data pipelines, API integrations, and real-time operational monitoring. What You’ll Do Build and maintain cloud software for fleet supervision and monitoring Develop data ...

visibility, operational dashboards, and scalable deployments across Europe and North America. This is not embedded/vehicle software, it’s cloud platform engineering, data pipelines, API integrations, and real-time operational monitoring. What You’ll Do Build and maintain cloud software for fleet supervision and monitoring Develop data ...

quality, stability and long-term thinking. The Global IT function is at the heart of the organisation's strategy to modernise through data and digital platforms, and testing is seen as a critical enabler. You'll be joining a supportive environment with approachable leadership, an inclusive culture … role where your contribution directly improves confidence in delivery and the reliability of systems used across the business. You will work with: Data Engineering and Development teams across global locations Development Leads and Business Analysts throughout the delivery lifecycle Azure-based platforms and pipelines, including ADF, Databricks ...

real-time production environments. You'll design and build scalable systems using Node.js and TypeScript, working across REST APIs, event-driven architecture, data pipelines, and distributed systems, ensuring performance, reliability, and scalability as the platform grows. This is a hands-on leadership role where you'll set technical … direction, mentor engineers, and contribute to engineering culture, while collaborating closely with AI engineers, data teams, and product stakeholders to translate complex workflows into robust, production-grade systems. You'll be responsible for building and maintaining scalable backend services, APIs, and integrations, designing microservices and event-driven architectures ...

will facilitate research and development within the healthcare sector! This company's diagnostics visualisation platform allows medical researchers to visualise and analyse clinical data in order to develop new treatments that will massively improve the lives of patients. Key to this is the creation of secure multi-tenant … multi-region storage solution that allows swift and secure access to various types of data. Data security and integrity is of paramount importance, and the solution needs to be compliant with healthcare industry software standards. This role calls for strong AWS skills, rapid application development, and software development ...

production‐ready AI‐assisted workflows. Your duties: Acting as a hands‐on technical lead for priority AI initiatives, partnering closely with Product, Development, Data, Security, Knowledge Management and Learning & Development Designing, building and releasing incremental AI‐enabled solutions that are secure, auditable and operationally robust Productising AI capabilities … experience with Microsoft 365 Copilot, Copilot Agents or Microsoft‐aligned automation Strong system integration experience (API‐led integrations, events and/or data pipelines) Hands‐on software development skills in at least one mainstream enterprise language (e.g. C#/.NET, Python) Practical experience delivering AI‐assisted features into ...

While the role is full stack in nature, the majority of your time will be spent on backend development, including system architecture, APIs, data pipelines, and cloud-based services. You'll also work across the frontend where needed, ensuring end-to-end solutions are robust, scalable, and maintainable. … What were looking for Essential Strong commercial experience in backend development, NodeJs and TypeScript preferred Solid experience building and maintaining RESTful APIs and data integrations Experience working with relational and/or non-relational databases Hands-on experience with cloud platforms (AWS and/or Azure) Confident using ...

Solution Architect & AI Manager will bridge the gap between complex data architecture and cutting-edge AI implementation. You will be responsible for the strategic delivery of the AIPX framework within the Balance Sheet Management (BSM) domain, ensuring that AI-driven insights are built on a foundation of robust … scalable, and high-performance engineering. Key Responsibilities: Lead cross-functional engineering teams to design, build, and deliver data-intensive platforms and AI-powered solutions aligned to strategic business needs. Oversee end-to-end delivery across the data and AI lifecycle for Balance Sheet Management (BSM)-from ...