551 to 575 of 648 Data Pipeline Jobs in the UK

real-time production environments. You'll design and build scalable systems using Node.js and TypeScript, working across REST APIs, event-driven architecture, data pipelines, and distributed systems, ensuring performance, reliability, and scalability as the platform grows. This is a hands-on leadership role where you'll set technical … direction, mentor engineers, and contribute to engineering culture, while collaborating closely with AI engineers, data teams, and product stakeholders to translate complex workflows into robust, production-grade systems. You'll be responsible for building and maintaining scalable backend services, APIs, and integrations, designing microservices and event-driven architectures ...

week on site Existing SC or DV Clearance is required National Security Sector Tech: JAVA/C++/Python - or Devops/Data Background An exciting opportunity has arisen for a Software Engineer to join a cutting-edge team developing impactful, mission-driven technology. The role offers … chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You'll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible outcomes. This ...

week on site Existing SC or DV Clearance is required National Security Sector Tech: JAVA/C++/Python - or Devops/Data Background An exciting opportunity has arisen for a Software Engineer to join a cutting-edge team developing impactful, mission-driven technology. The role offers … chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You'll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible outcomes. This ...

production‐ready AI‐assisted workflows. Your duties: Acting as a hands‐on technical lead for priority AI initiatives, partnering closely with Product, Development, Data, Security, Knowledge Management and Learning & Development Designing, building and releasing incremental AI‐enabled solutions that are secure, auditable and operationally robust Productising AI capabilities … experience with Microsoft 365 Copilot, Copilot Agents or Microsoft‐aligned automation Strong system integration experience (API‐led integrations, events and/or data pipelines) Hands‐on software development skills in at least one mainstream enterprise language (e.g. C#/.NET, Python) Practical experience delivering AI‐assisted features into ...

teams). You’ll be at the forefront of cloud-native engineering, working with modern technologies across AWS, On-premise Kubernetes, Python, and data pipelines. If you are passionate about solving hard technical problems, staying current with trends like AI Engineering, and want to make a difference … modern engineering trends, especially in AI/ML infrastructure and cloud-native tooling. Key Requirements 6-12 years of experience in software/data engineering; ideally in platform or infra roles. Strong understanding of Generative AI concepts, along with hands-on experience in developing and deploying AI applications ...

Solution Architect & AI Manager will bridge the gap between complex data architecture and cutting-edge AI implementation. You will be responsible for the strategic delivery of the AIPX framework within the Balance Sheet Management (BSM) domain, ensuring that AI-driven insights are built on a foundation of robust … scalable, and high-performance engineering. Key Responsibilities: Lead cross-functional engineering teams to design, build, and deliver data-intensive platforms and AI-powered solutions aligned to strategic business needs. Oversee end-to-end delivery across the data and AI lifecycle for Balance Sheet Management (BSM)-from ...

Data Engineer 12 months Croydon - x1 day a week x4 remote Inside IR35 - Umbrella only Active SC clearance required Are you passionate about building reliable data pipelines and microservices? Our client, a leading organisation in the IT sector, is hiring for a talented Data ...

, microbiome sequencing, clinical and real-world outcomes. Our goal is to translate biological signals into actionable compound discovery and optimisation, powering a pipeline across: Discovery → Prediction → Design → Validation We are looking for a Senior Computational Biologist with ML Engineering background to help build, bridge, and functionalise … intelligent ingredient complexes o repurposed peptides o newly discovered natural peptides 4) Productionise the AI product launch ● Build end-to-end ML pipeline covering ingestion, training, evaluation and deployment ● Develop APIs/services to serve predictions and ranked candidates into internal tools and client outputs ● Create evaluation harnesses ...

prominent technology firm in the UK is seeking a Data Leadership role to scale their existing data function and drive maturation across the business. The successful candidate will own and evolve data pipelines while leading a team and collaborating across departments for strategic insight. … Ideal applicants will have 10+ years of experience in data engineering, excellent SQL skills, and familiarity with high-volume datasets and data warehousing technologies. #J-18808-Ljbffr ...

Security Architect to join our Cybersecurity team in London. Responsibilities Define enterprise AI security architecture: develop reference architectures, guardrails, and standards for secure data pipelines, model training/inference, and AI-integrated applications across on-prem and cloud. Secure MLOps/ML platforms: architect identity, secrets management, network … segmentation, and least-privilege access for feature stores, model registries, orchestration, and deployment pipelines. Data protection by design: establish controls for sensitive data ingestion, anonymization/pseudonymization, encryption (at rest/in transit), tokenization, and lineage across AI workflows. Adversarial ML defense: design controls and tests ...

activate and scale partnerships. Measure activation rate, moves per partner, integration velocity, and partner NPS. Integration quality. Own the reliability, speed, and data quality of partner data flowing into our platform. When a partner sends us a move, the experience should be seamless. B2B metrics. Partner … measurably increases moves from at least one partner. Build relationships with key partner stakeholders. Understand their pain points, not just ours. Map the integration pipeline and develop a prioritisation framework for new partner types (deposit schemes, mortgage software, conveyancing platforms). Establish your operating rhythm with Engineering ...

Must have skills: Python Machine Learning SQL Roles and Responsibilities: Design and develop rapid prototypes and PoCs using Python for data-driven and AI/ML use cases. Build, train, evaluate, and fine-tune machine learning models for structured and unstructured data. Perform data analysis, feature … engineering, and experimentation to validate hypotheses. Develop efficient SQL queries for data extraction, transformation, and analysis from relational databases. Integrate prototypes with APIs, data pipelines, and visualization tools when required. Translate business problems into analytical and ML solutions. Collaborate with cross-functional teams to refine requirements ...

+ benefits Are you a Senior Backend Engineer who thrives on designing and scaling complex systems? Do you enjoy working on data-intensive platforms involving real-time pipelines, streaming architectures, and graph-based services? This is a hands-on role within a small, research-driven engineering team working … components from architecture through to production, while contributing to the overall technical direction. Key Responsibilities Design, build, and own backend services and data pipelines in Python Develop and operate streaming systems using Kafka or similar technologies Work with graph-based data structures and algorithms to support ...

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

Senior Software Engineer | Sports Data London, UK | Remote Working Up to £80,000 + Company-wide benefits We’re partnered with a high-growth sports media network that operates a portfolio of market-leading brands and partnerships across the sports betting and tech space. Their mission … cutting-edge tools, all powered by modern, cloud-native technology. They are looking for an established Senior Software Engineer to join their expanding data team, where you will be working directly on key services that power a core part of the company's platform. While having essential responsibility ...

building production-ready AI systems using LLMs, this role offers high ownership and the chance to shape how AI is applied in critical, data-intensive domains. The Role: Design, build, and deploy agentic AI systems within a scalable, production environment. This is a hands-on engineering role with … Strong experience building production AI/ML systems Experience with LLMs and agentic AI frameworks Proficiency in Python and working with APIs/data pipelines Experience working with structured or enterprise data Ability to operate in a fast-paced, high-ownership environment If this role ...

operational dashboards, and scripts that eliminate repetitive manual tasks across the business. Cross-Boundary Integration: Solve complex problems that span multiple systems, including data onboarding pipelines and API integrations. Product Delivery: Contribute directly to the core product, shipping high-quality features while ensuring the underlying systems remain robust. … modern CI/CD architectures, automated testing frameworks, and internal tool development. Application Code: Proficiency in building and maintaining production-grade product features. Data & Pipelines: Experience building ingestion workflows and connecting disparate internal data sources. Stack Versatility: You are highly proficient in Python ( FastAPI ) and TypeScript ...

working with an early-stage, high-calibre team building systems that turn large volumes of unstructured data (think PDFs, documents, messy real-world inputs) into production-ready datasets that drive critical decisions. This is a builder-led environment where engineers own problems end-to-end, automating what they … harder challenges. The focus is on designing reliable, scalable pipelines, leveraging AI agents and LLMs where they add value, and shipping high-quality data as a product. Responsibilities Own data pipelines end-to-end: ingestion, parsing, cleaning, transformation, storage, and delivery Build systems to extract structured ...

team Requirements Published research in peer-reviewed venues such as IEEE, ICML, NeurIPS, ICLR, or equivalent Deep expertise in time series modelling - financial data experience strongly preferred Proven end-to-end ML experience: data pipelines, model development, deployment, and monitoring Strong Python and ML engineering skills … time and support for continued research and publishing Competitive base, performance bonus, and equity Hybrid working, flexible culture, and access to institutional-grade data and compute ...

including JavaScript/TypeScript and Python Experience with React (frontend) and backend frameworks such as FastAPI or similar Experience designing and implementing scalable data pipelines and database structures Hands-on experience with cloud infrastructure, ideally AWS Strong understanding of security and compliance considerations including ISO 27001 and GDPR … evolve it into a production-ready SaaS platform for enterprise customers Build and maintain a secure, scalable backend capable of handling sensitive enterprise data Design and develop high-quality frontend interfaces that make complex AI outputs intuitive and actionable for users Build and maintain deployment pipelines, testing frameworks ...

support and maintain a suite of Python-based processes and reporting tools used across the business. * Provide day-to-day support for existing data pipelines, APIs, and reporting frameworks, troubleshooting issues and resolving incidents. * Work across a technology stack centred on Python, Postgres, Docker, REST APIs, and local … databases. * Assist with the management and optimisation of automated processes to improve reliability and efficiency. * Support infrastructure including virtual machines and data workflows. * Collaborate with internal teams to enhance reporting and operational processes. * Contribute to the integration and ongoing use of AI tools across the organisation, including supporting ...

systems and are looking for an experienced quantitative developer to face off to the traders and quantitative researchers to develop enhanced systems and data capabilities for their fixed income business. You will have a background in financial markets, ideally on the buy-side, with significant commercial experience developing … enterprise production-grade systems and data pipelines in Python and/or Java, a solid understanding of financial products and their representation, and proven experience using AI coding assistants to enable faster delivery in compressed timelines. You will collaborate with quant teams, to ensure their requirements are properly ...

most complex organisations in the world. We’re assembling a small, exceptional engineering team to solve problems at the intersection of AI, data, and scale—turning messy, manual workflows into automated, reliable systems that operate globally, securely, and at speed. If you’ve always wanted your work … core systems that make advanced AI workflows production‐ready: High‐performance backend services and APIs that power complex AI‐driven platforms Large‐scale data pipelines handling sensitive, high‐value datasets Systems that deploy and monitor machine‐learning models in real-world environments Enterprise‐grade infrastructure where reliability, security ...

Cleared Location - Exeter Overview A leading UK-based organisation is undertaking a major transformation of the technology platforms that underpin critical data, science, and digital services. We are seeking an experienced Product Manager to shape and evolve internal platforms used by engineers, technical specialists, and operational teams. This … role sits within a central Platform Technology function responsible for shared capabilities such as developer tooling, APIs, data pipelines, and infrastructure services. The focus is on improving reliability, usability, and scalability—enabling teams across the organisation to deliver faster, safer, and more effectively. Key Responsibilities Develop business cases ...

engages in real conversations, understands product attributes, compatibility, visual features, and domain expertise, and provides genuinely expert guidance. Every interaction generates high-intent data on customer needs, objections, and unmet demand. This intelligence powers segmentation, product development, and personalisation — far beyond traditional analytics. Long-term, the company … will be at the forefront of developing the intelligence that powers the AI agent. You will design, build, and scale the AI models, data pipelines, and cognitive systems that drive conversational recommendations and insights. This is a unique opportunity to shape the core AI and influence the company ...