301 to 325 of 362 Data Pipeline Jobs in the UK excluding London

looking for a Data Platform Engineer with strong expertise in Microsoft Fabric and Terraform to build and scale a modern, cloud-native data platform. You'll focus on creating a highly automated environment where both infrastructure and data services are defined and deployed through … hybrid role with 1 day a week in the Milton Keynes office. What you'll do Design and deliver a Fabric-based data platform with a modular, scalable architecture. Use Terraform to implement Infrastructure as Code and automate deployments. Build and optimise data pipelines, lakehouse/ ...

looking for a Data Platform Engineer with strong expertise in Microsoft Fabric and Terraform to build and scale a modern, cloud-native data platform. You'll focus on creating a highly automated environment where both infrastructure and data services are defined and deployed through … hybrid role with 1 day a week in the Milton Keynes office. What you'll do Design and deliver a Fabric-based data platform with a modular, scalable architecture. Use Terraform to implement Infrastructure as Code and automate deployments. Build and optimise data pipelines, lakehouse/ ...

Join us at Barclays as a Senior AWS Data Platform Developer, where you’ll be part of a team to build a sustainable data platform infrastructure to support the multiple channels of their business areas. This is an exciting period in Barclays technology where there … build our services and modernise our development practices to ensure our architecture supports our agile goals. To be successful as a Senior AWS Data Platform Developer, you should have: Ample proficiency in Python or Scala programming languages. Experience with Apache Spark and big data processing frameworks. ...

Test Engineer Up to £65,000 I am seeking a Test Engineer to support the quality, reliability and performance of modern data and digital platforms within a large, globally operating organisation. Sitting within an established IT and Digital function, this role is central to ensuring high-quality delivery … across applications, integrations and data pipelines that underpin critical business operations. This role is ideal for someone with strong hands-on testing experience across data platforms and low-code applications, combined with a structured, analytical approach to quality assurance. You will work closely with Development Leads ...

decision-making, and unlock productivity across business functions like Finance, HR, and Operations. This is a client-facing delivery role within a leading Data & AI transformation consultancy, working alongside world-class data scientists, engineers, and strategists to move ideas from concept to production. The Role Lead … stakeholders to identify high-value AI opportunities and shape product roadmaps. Translate requirements into actionable user stories and acceptance criteria for engineering and data teams. Collaborate closely with teams building solutions using RAG pipelines, LLMs, embeddings, and API integrations. Define and track KPIs such as accuracy, latency, adoption ...

Advanced Engineering/AI What You’ll Be Doing: Design and deliver full-stack, cloud-native AI applications across front end, APIs, and data layers Build and deploy RAG-based and agent-driven AI systems using secure, governed data sources Develop scalable services on Azure, integrating … building AI/ML systems, particularly RAG or agent-based architectures Solid Azure expertise (Azure ML, Azure OpenAI, Functions, AKS, CI/CD pipelines) Data engineering knowledge including pipelines, schema design, and observability Experience with software testing, performance optimisation, and production monitoring Understanding of secure development practices, identity ...

onboarding of additional delivery capability. You will work primarily across Talend and Oracle RDS platforms , contributing to the development and support of secure data integration and exchange services using established frameworks and patterns. Key Responsibilities Develop and maintain ETL solutions within an existing Talend framework Support data integration and outbound data exchange services Work with Oracle RDS databases to deliver and support data pipelines Collaborate with delivery teams to meet increasing programme demand Ensure solutions align with security, data handling, and quality standards Essential Skills & Experience Active SC Clearance ...

years of professional experience. You must have 'under-the-hood' knowledge of Python, specifically for building high-throughput microservices and complex data pipelines using FastAPI, Pandas, and NumPy . The RAG & Agentic Expert: This is the 'Critical' requirement. Our client needs someone with deep hands-on experience building … Agentic frameworks . You should know how to use LangChain or LlamaIndex to create AI that can execute multi-step tasks. The Data Architect: Proficiency in Vector Databases is essential. You should be comfortable designing data persistence layers using PG Vector, Pinecone, Milvus, or Mongo Atlas ...

This AI/ML infrastructure role is with a seriously exciting scale up. The robots are deployed, the data is flowing, and the team is growing. They need someone to own the operational infrastructure that powers the robot Learning team, from demonstration capture through to deployed behaviour … infrastructure you build directly determines how fast the team can iterate on new manipulation capabilities. The Role You will own training infrastructure, data pipelines, model deployment, and developer experience for the Robot Learning team. The key responsibilities Develop reproducible, containerised training environments for diffusion policies, VLAs, and transformer ...

visibility, operational dashboards, and scalable deployments across Europe and North America. This is not embedded/vehicle software, it’s cloud platform engineering, data pipelines, API integrations, and real-time operational monitoring. What You’ll Do Build and maintain cloud software for fleet supervision and monitoring Develop data ...

quality, stability and long-term thinking. The Global IT function is at the heart of the organisation's strategy to modernise through data and digital platforms, and testing is seen as a critical enabler. You'll be joining a supportive environment with approachable leadership, an inclusive culture … role where your contribution directly improves confidence in delivery and the reliability of systems used across the business. You will work with: Data Engineering and Development teams across global locations Development Leads and Business Analysts throughout the delivery lifecycle Azure-based platforms and pipelines, including ADF, Databricks ...

production‐ready AI‐assisted workflows. Your duties: Acting as a hands‐on technical lead for priority AI initiatives, partnering closely with Product, Development, Data, Security, Knowledge Management and Learning & Development Designing, building and releasing incremental AI‐enabled solutions that are secure, auditable and operationally robust Productising AI capabilities … experience with Microsoft 365 Copilot, Copilot Agents or Microsoft‐aligned automation Strong system integration experience (API‐led integrations, events and/or data pipelines) Hands‐on software development skills in at least one mainstream enterprise language (e.g. C#/.NET, Python) Practical experience delivering AI‐assisted features into ...

teams). You’ll be at the forefront of cloud-native engineering, working with modern technologies across AWS, On-premise Kubernetes, Python, and data pipelines. If you are passionate about solving hard technical problems, staying current with trends like AI Engineering, and want to make a difference … modern engineering trends, especially in AI/ML infrastructure and cloud-native tooling. Key Requirements 6-12 years of experience in software/data engineering; ideally in platform or infra roles. Strong understanding of Generative AI concepts, along with hands-on experience in developing and deploying AI applications ...

, microbiome sequencing, clinical and real-world outcomes. Our goal is to translate biological signals into actionable compound discovery and optimisation, powering a pipeline across: Discovery → Prediction → Design → Validation We are looking for a Senior Computational Biologist with ML Engineering background to help build, bridge, and functionalise … intelligent ingredient complexes o repurposed peptides o newly discovered natural peptides 4) Productionise the AI product launch ● Build end-to-end ML pipeline covering ingestion, training, evaluation and deployment ● Develop APIs/services to serve predictions and ranked candidates into internal tools and client outputs ● Create evaluation harnesses ...

building production-ready AI systems using LLMs, this role offers high ownership and the chance to shape how AI is applied in critical, data-intensive domains. The Role: Design, build, and deploy agentic AI systems within a scalable, production environment. This is a hands-on engineering role with … Strong experience building production AI/ML systems Experience with LLMs and agentic AI frameworks Proficiency in Python and working with APIs/data pipelines Experience working with structured or enterprise data Ability to operate in a fast-paced, high-ownership environment If this role ...

including JavaScript/TypeScript and Python Experience with React (frontend) and backend frameworks such as FastAPI or similar Experience designing and implementing scalable data pipelines and database structures Hands-on experience with cloud infrastructure, ideally AWS Strong understanding of security and compliance considerations including ISO 27001 and GDPR … evolve it into a production-ready SaaS platform for enterprise customers Build and maintain a secure, scalable backend capable of handling sensitive enterprise data Design and develop high-quality frontend interfaces that make complex AI outputs intuitive and actionable for users Build and maintain deployment pipelines, testing frameworks ...

support and maintain a suite of Python-based processes and reporting tools used across the business. * Provide day-to-day support for existing data pipelines, APIs, and reporting frameworks, troubleshooting issues and resolving incidents. * Work across a technology stack centred on Python, Postgres, Docker, REST APIs, and local … databases. * Assist with the management and optimisation of automated processes to improve reliability and efficiency. * Support infrastructure including virtual machines and data workflows. * Collaborate with internal teams to enhance reporting and operational processes. * Contribute to the integration and ongoing use of AI tools across the organisation, including supporting ...

systems and are looking for an experienced quantitative developer to face off to the traders and quantitative researchers to develop enhanced systems and data capabilities for their fixed income business. You will have a background in financial markets, ideally on the buy-side, with significant commercial experience developing … enterprise production-grade systems and data pipelines in Python and/or Java, a solid understanding of financial products and their representation, and proven experience using AI coding assistants to enable faster delivery in compressed timelines. You will collaborate with quant teams, to ensure their requirements are properly ...

Cleared Location - Exeter Overview A leading UK-based organisation is undertaking a major transformation of the technology platforms that underpin critical data, science, and digital services. We are seeking an experienced Product Manager to shape and evolve internal platforms used by engineers, technical specialists, and operational teams. This … role sits within a central Platform Technology function responsible for shared capabilities such as developer tooling, APIs, data pipelines, and infrastructure services. The focus is on improving reliability, usability, and scalability—enabling teams across the organisation to deliver faster, safer, and more effectively. Key Responsibilities Develop business cases ...

this role. We’re supporting a major organisation undergoing a significant transformation of its technology platforms that underpin critical services across engineering, data, and operational teams. This is an opportunity for an experienced Product Manager to take ownership of internal platforms that enable developers, scientists, and service teams … reliability, and overall delivery effectiveness. The Role You’ll join a Platform Technology function responsible for shared capabilities such as developer tooling, APIs, data pipelines, and infrastructure services. Your focus will be on making these platforms intuitive, reliable, and valuable—reducing friction for internal users and enabling faster ...

Company They are part of a large international media and advertising group operating across multiple markets. Their focus is on combining technology, data and creativity to deliver impactful advertising solutions across physical and digital environments. Technology and AI are becoming increasingly central to how the business operates internally … based AI services and modern LLM frameworks. Turning ambiguous business problems into clear, scalable technical solutions. Building APIs, backend services, automation workflows and data pipelines that support AI capabilities. Deploying, monitoring and iterating on AI solutions in live environments. Setting engineering best practice and mentoring other AI engineers ...

every day. You'll join Platform Technology - a part of the organisation responsible for shared, cross-cutting capabilities such as developer tools, APIs, data pipelines and infrastructure services. Your job is to make these platforms reliable, discoverable and enabling: reducing delivery friction, improving user experience, and helping downstream … developers to operations staff - and translate their needs into clear priorities Investigate the development of measurable service outcomes (adoption, usability, performance) and use data to track progress Balance short-term reliability with long-term sustainability and compliance Facilitate collaboration across technical and non-technical stakeholders; communicate trade-offs ...

Were looking for a skilled Azure Data Engineer with hands-on experience in Microsoft Fabric to join our growing data team. If youre passionate about building scalable, modern data platforms in Microsoft Azure, wed love to hear from you. What Youll Do Design, build … maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Wa click apply for full job details ...

global organisation is undergoing a significant digital modernisation programme and is looking to appoint a Test Engineer to strengthen quality assurance across its data and application landscape. This role sits within a central IT & Digital function and plays a critical role in improving delivery confidence, system reliability … proactive testing throughout the delivery lifecycle. The Role As a Test Engineer, you will act as a quality gate across applications, integrations and data platforms, ensuring solutions are accurate, stable and fit for real-world use. Key responsibilities include: Partnering with development leads and business analysts on test ...

strong communication skills and a proactive, problem-solving mindset. Key Responsibilities Analyse business processes and identify automation opportunities Build internal tools, dashboards, and data pipelines Integrate systems using APIs and data feeds Develop AI-powered features to improve workflows and insights Support rollout, training, and ongoing … system improvements About You 35 years experience in a technical role (development, data, or solutions) Strong understanding of programming concepts and integrations Experience working with APIs, data, and databases Familiarity with AI tools and where they add value Confident communicator, able to work with non-technical ...