1,301 to 1,325 of 1,401 Data Pipeline Jobs in the UK excluding London

Software Engineer AI & Data Systems £40,000 to £90,000 (DOE) + performance bonus Permanent Hybrid UK nationals only | Must hold SC clearance About the Role An innovative UK technology company is developing a next-generation AI platform designed for defence and health applications. Were looking for a Software Engineer who thrives on learning quickly, solving complex technical … Youll Work On Design, build, and scale intelligent systems and microservices Develop AI-driven capabilities (e.g. LLMs, retrieval-augmented generation (RAG), and AI agents) Build and maintain APIs, data pipelines, and backend components (primarily Python, FastAPI, or Flask) Engineer robust, containerised architectures using Docker and Kubernetes Work with ElasticSearch, Weaviate, Pinecone, and other vector databases Help deliver high … premise systems Passionate programmer with a problem-solving mindset Quick learner who enjoys exploring new technologies Familiarity with microservice architectures and containerisation (Docker/K8s) Experience in AI, data engineering, or distributed systems Flexible, collaborative, and adaptable, comfortable wearing many hats in an SME environment Security Check (SC) cleared, British nationals only (no dual nationality) Why Join? Shape More ❯

Software Engineer – AI & Data Systems £40,000 to £90,000 (DOE) + performance bonus Permanent Hybrid (1 day per week in the week, 4 days remote) UK nationals only (no dual nationality) | Must hold SC clearance About the Role An innovative UK technology company is developing a next-generation AI platform designed for defence and health applications. We … ll Work On Design, build, and scale intelligent systems and microservices Develop AI-driven capabilities (e.g. LLMs, retrieval-augmented generation (RAG), and AI agents) Build and maintain APIs, data pipelines, and backend components (primarily Python, FastAPI, or Flask) Engineer robust, containerised architectures using Docker and Kubernetes Work with ElasticSearch, Weaviate, Pinecone, and other vector databases Help deliver high … premise systems Passionate programmer with a problem-solving mindset Quick learner who enjoys exploring new technologies Familiarity with microservice architectures and containerisation (Docker/K8s) Experience in AI, data engineering, or distributed systems Flexible, collaborative, and adaptable, comfortable wearing many hats in an SME environment Security Check (SC) cleared, British nationals only (no dual nationality) Why Join? Shape More ❯

Our platform replaces weeks of traditional market research with seconds of AI-powered simulation, achieving 92% accuracy validated against real-world data. Founded by Ben Warner (former Chief Data Advisor to the UK Prime Minister, architect of the 2019 election model) and Alex Cooper (19-year British Army veteran, Director of UK mass COVID testing), we serve leading … build the next generation of applied AI tools. What You’ll Do Build and ship production features end-to-end across Python , SQL , and Next.js . Design APIs, data pipelines, and UIs that make complex model outputs intuitive and actionable. Own architecture and design decisions — schemas, modularisation, and system patterns. Refactor and optimise existing systems for performance and … and CI/CD experience. Product-focused mindset and attention to code quality. Comfortable working on-site in a fast-paced, collaborative startup. Nice to Have Experience with data-heavy or high-throughput systems. Exposure to applied AI or LLM integrations (no model training required). Familiarity with GCP , especially IAM, networking, and security. Why Electric Twin Impact More ❯

Our platform replaces weeks of traditional market research with seconds of AI-powered simulation, achieving 92% accuracy validated against real-world data. Founded by Ben Warner (former Chief Data Advisor to the UK Prime Minister, architect of the 2019 election model) and Alex Cooper (19-year British Army veteran, Director of UK mass COVID testing), we serve leading … build the next generation of applied AI tools. What You’ll Do Build and ship production features end-to-end across Python , SQL , and Next.js . Design APIs, data pipelines, and UIs that make complex model outputs intuitive and actionable. Own architecture and design decisions — schemas, modularisation, and system patterns. Refactor and optimise existing systems for performance and … and CI/CD experience. Product-focused mindset and attention to code quality. Comfortable working on-site in a fast-paced, collaborative startup. Nice to Have Experience with data-heavy or high-throughput systems. Exposure to applied AI or LLM integrations (no model training required). Familiarity with GCP , especially IAM, networking, and security. Why Electric Twin Impact More ❯

Our platform replaces weeks of traditional market research with seconds of AI-powered simulation, achieving 92% accuracy validated against real-world data. Founded by Ben Warner (former Chief Data Advisor to the UK Prime Minister, architect of the 2019 election model) and Alex Cooper (19-year British Army veteran, Director of UK mass COVID testing), we serve leading … build the next generation of applied AI tools. What You’ll Do Build and ship production features end-to-end across Python , SQL , and Next.js . Design APIs, data pipelines, and UIs that make complex model outputs intuitive and actionable. Own architecture and design decisions — schemas, modularisation, and system patterns. Refactor and optimise existing systems for performance and … and CI/CD experience. Product-focused mindset and attention to code quality. Comfortable working on-site in a fast-paced, collaborative startup. Nice to Have Experience with data-heavy or high-throughput systems. Exposure to applied AI or LLM integrations (no model training required). Familiarity with GCP , especially IAM, networking, and security. Why Electric Twin Impact More ❯

Agentic AI - building systems where LLMs reason, act, and collaborate autonomously to drive real-world outcomes. As a Machine Learning Engineer , you'll design the frameworks, tools, and data loops that allow intelligent agents to think, plan, and improve themselves - transforming raw model power into adaptive, high-performing AI systems. What You'll Do: Build Agentic Systems - Develop … and execute multi-step tasks autonomously. Enhance LLM Reasoning - Apply reinforcement learning, tool use, and reflection techniques to strengthen decision-making and contextual understanding. Design Scalable Frameworks - Create data pipelines, annotation tools, and evaluation flywheels that accelerate model iteration and feedback loops. Collaborate with Research Teams - Translate experimental findings into production-grade systems that extend the autonomy and More ❯

Our client is a pioneering systematic hedge fund, redefining electronic trading through high-performance, data-driven solutions. As part of their Crypto desk, you'll join a cutting-edge team operating across centralised and decentralised markets, leveraging AI and ML to drive automation, enhance decision-making, and scale a fully automated global trading platform. This is a unique … scalable, real-time applications using deep learning and statistical techniques. Collaborate with Researchers and Traders to implement and optimise automated trading strategies. Integrate alternative datasets and build intelligent data pipelines to support research and execution. Monitor and manage the lifecycle of AI-driven systems in production environments. Requirements 6+ years of professional software development experience, ideally in a More ❯

first AI R&D function from the ground up Design and deploy intelligent agents, models, and automation frameworks Experiment with LLMs, ML, and agentic systems using live production data Integrate third-party APIs (OpenAI, Microsoft, Anthropic) into core SaaS products Develop reusable architectures and rapid prototypes that move from idea to value fast Work with the AI Advisory … Board to shape strategic direction Upskill the wider engineering team in AI-first principles You'll be turning raw data into smart systems that help schools, teachers, and students make better decisions - creating intelligent products that learn, adapt, and evolve. What Makes You a Fit You're part engineer, part innovator. Someone who can move from concept to … understand LLMs, NLP, and ML frameworks like TensorFlow, PyTorch, or LangChain. You know your way around Azure, AWS, or GCP, and you're confident designing APIs, microservices, and data pipelines. Maybe you've come from an academic background and now want to apply your research commercially. Or maybe you're an experienced software engineer who's already delivering More ❯

Our client is a pioneering systematic hedge fund, redefining electronic trading through high-performance, data-driven solutions. As part of their Crypto desk, you'll join a cutting-edge team operating across centralised and decentralised markets, leveraging AI and ML to drive automation, enhance decision-making, and scale a fully automated global trading platform. This is a unique … scalable, real-time applications using deep learning and statistical techniques. Collaborate with Researchers and Traders to implement and optimise automated trading strategies. Integrate alternative datasets and build intelligent data pipelines to support research and execution. Monitor and manage the lifecycle of AI-driven systems in production environments. Requirements 6+ years of professional software development experience, ideally in a More ❯

first AI R&D function from the ground up Design and deploy intelligent agents, models, and automation frameworks Experiment with LLMs, ML, and agentic systems using live production data Integrate third-party APIs (OpenAI, Microsoft, Anthropic) into core SaaS products Develop reusable architectures and rapid prototypes that move from idea to value fast Work with the AI Advisory … Board to shape strategic direction Upskill the wider engineering team in AI-first principles You’ll be turning raw data into smart systems that help schools, teachers, and students make better decisions — creating intelligent products that learn, adapt, and evolve. What Makes You a Fit You’re part engineer, part innovator. Someone who can move from concept to … understand LLMs, NLP, and ML frameworks like TensorFlow, PyTorch, or LangChain. You know your way around Azure, AWS, or GCP, and you’re confident designing APIs, microservices, and data pipelines. Maybe you’ve come from an academic background and now want to apply your research commercially. Or maybe you’re an experienced software engineer who’s already delivering More ❯

first AI R&D function from the ground up Design and deploy intelligent agents, models, and automation frameworks Experiment with LLMs, ML, and agentic systems using live production data Integrate third-party APIs (OpenAI, Microsoft, Anthropic) into core SaaS products Develop reusable architectures and rapid prototypes that move from idea to value fast Work with the AI Advisory … Board to shape strategic direction Upskill the wider engineering team in AI-first principles You’ll be turning raw data into smart systems that help schools, teachers, and students make better decisions — creating intelligent products that learn, adapt, and evolve. What Makes You a Fit You’re part engineer, part innovator. Someone who can move from concept to … understand LLMs, NLP, and ML frameworks like TensorFlow, PyTorch, or LangChain. You know your way around Azure, AWS, or GCP, and you’re confident designing APIs, microservices, and data pipelines. Maybe you’ve come from an academic background and now want to apply your research commercially. Or maybe you’re an experienced software engineer who’s already delivering More ❯

first AI R&D function from the ground up Design and deploy intelligent agents, models, and automation frameworks Experiment with LLMs, ML, and agentic systems using live production data Integrate third-party APIs (OpenAI, Microsoft, Anthropic) into core SaaS products Develop reusable architectures and rapid prototypes that move from idea to value fast Work with the AI Advisory … Board to shape strategic direction Upskill the wider engineering team in AI-first principles You’ll be turning raw data into smart systems that help schools, teachers, and students make better decisions — creating intelligent products that learn, adapt, and evolve. What Makes You a Fit You’re part engineer, part innovator. Someone who can move from concept to … understand LLMs, NLP, and ML frameworks like TensorFlow, PyTorch, or LangChain. You know your way around Azure, AWS, or GCP, and you’re confident designing APIs, microservices, and data pipelines. Maybe you’ve come from an academic background and now want to apply your research commercially. Or maybe you’re an experienced software engineer who’s already delivering More ❯

Our client is a pioneering systematic hedge fund, redefining electronic trading through high-performance, data-driven solutions. As part of their Crypto desk, you'll join a cutting-edge team operating across centralised and decentralised markets, leveraging AI and ML to drive automation, enhance decision-making, and scale a fully automated global trading platform. This is a unique … scalable, real-time applications using deep learning and statistical techniques. Collaborate with Researchers and Traders to implement and optimise automated trading strategies. Integrate alternative datasets and build intelligent data pipelines to support research and execution. Monitor and manage the lifecycle of AI-driven systems in production environments. Requirements 6+ years of professional software development experience, ideally in a More ❯

and mentor developers, shape sprint processes, introduce best-practice engineering frameworks, and drive continual improvement around performance, security, and scalability.Expect to work closely with product, operations, marketing, and data teams to support player experiences, platform stability, and regulatory needs across real-time, high-availability environments. This role requires someone who thrives in a fast-paced setting and enjoys … constantly evolving product environment Nice to Have Knowledge of gaming integrations, payments, and provider APIs Experience with fraud prevention, security controls, or compliance frameworks Familiarity with platform personalisation, data pipelines, or event-driven systems Exposure to machine learning, AI, or player analytics Ready to lead a high-performing engineering function and build modern gaming technology at scale? Please More ❯

working remotely, or based in our Godalming or Milton Keynes offices. Up to £80k, plus excellent company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make a real difference to users … or similar role. In-depth knowledge of system design, software architecture, and development methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Expertise in architectural design, data pipelines, cloud platforms, and API development. Knowledge of microservices and containerisation (Docker, Kubernetes). Experience with security best practices and compliance standards. Familiarity with agile methodologies and agile delivery. More ❯

working remotely, or based in our Godalming or Milton Keynes offices. Up to £80k, plus excellent company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make a real difference to users … or similar role. In-depth knowledge of system design, software architecture, and development methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Expertise in architectural design, data pipelines, cloud platforms, and API development. Knowledge of microservices and containerisation (Docker, Kubernetes). Experience with security best practices and compliance standards. Familiarity with agile methodologies and agile delivery. More ❯

or based in our Godalming or Milton Keynes offices. Salary up to £80,000, plus excellent company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years’ experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make a real difference to users … or similar role. In-depth knowledge of system design, software architecture, and development methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Expertise in architectural design, data pipelines, cloud platforms, and API development. Knowledge of microservices and containerisation (Docker, Kubernetes). Experience with security best practices and compliance standards. Familiarity with agile methodologies and agile delivery. More ❯

or based in our Godalming or Milton Keynes offices. Salary up to £80,000, plus excellent company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years’ experience primarily serving the UK public sector and central government. We deliver high-quality solutions that make a real difference to users … or similar role. In-depth knowledge of system design, software architecture, and development methodologies. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud). Expertise in architectural design, data pipelines, cloud platforms, and API development. Knowledge of microservices and containerisation (Docker, Kubernetes). Experience with security best practices and compliance standards. Familiarity with agile methodologies and agile delivery. More ❯

optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm's systematic traders. While your focus will be on engineering - including APIs, automation, and data pipelines - you'll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1-3 years' professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯

optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯

optimise back-testing tooling, research infrastructure, and algorithmic trading systems that support the firm’s systematic traders. While your focus will be on engineering — including APIs, automation, and data pipelines — you’ll also gain occasional exposure to strategy development and signal testing. Key Responsibilities Design, build, and maintain back-testing frameworks and research tools Develop APIs and automation … execution Collaborate with quants and traders to test and deploy new ideas Build and maintain robust, scalable codebases for live and simulated trading Contribute to continuous improvement across data quality, performance, and reliability Requirements 1–3 years’ professional software development experience (Python preferred) Experience building or maintaining back-testing systems , APIs, or data tools Strong understanding … of algorithms, data structures, and performance optimisation Analytical mindset with interest in systematic trading and quantitative research Nice to Have Exposure to trading systems, market data, or algo/bot development Familiarity with numerical libraries (NumPy, Pandas, Numba, etc.) Understanding of version control, CI/CD, or distributed computing More ❯

Senior AI Solutions Engineer About Carbon3 is building the UK's sovereign AI infrastructure platform, combining renewable energy, distributed compute, and full data ownership to power the next generation of sustainable innovation. The Role: We're seeking a Senior AI Solutions Engineer to sit at the intersection of customer business challenges and cutting-edge AI technology. This is … and evaluation of foundation models for domain-specific use cases. Package and deploy models into scalable inference endpoints (REST/gRPC APIs, containerised or GPU-accelerated environments). Data and Knowledge Integration (RAG) Build pipelines that connect structured and unstructured enterprise data into vector databases and embedding models . Design semantic search and retrieval strategies to … maximise response accuracy and relevance. Ensure all data pipelines are secure, compliant, and performant at scale. Collaboration and Knowledge Sharing Work closely with infrastructure and platform engineering teams for smooth deployments. Feed insights into the product roadmap and platform feature development. Act as a thought leader and trusted advisor to customers exploring applied AI adoption. Technical Excellence Develop More ❯

Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯

Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯

Integrate AI models into operational workflows Ensure reliability through fail-safes, self-healing, and fallback mechanisms Monitor & improve AI performance with feedback loops and observability tools Collaborate with Data Engineers to ensure AI has accurate, real-time data Implement human-in-the-loop systems where needed Skills and Qualifications Exceptional Python skills and experience with LLM … orchestration frameworks (e.g., DSPy, LangChain, or similar) Experience in AI-driven automation & orchestration in production environments Proven ability to optimise AI agents for reliability and efficiency Familiarity with data pipelines & integrations Interest in AI process automation & workflow design And ideally you... Thrive in fast-moving environments and work at a high pace Enjoy owning and solving problems, act More ❯