501 to 525 of 582 Data Pipeline Jobs in the UK

, microbiome sequencing, clinical and real-world outcomes. Our goal is to translate biological signals into actionable compound discovery and optimisation, powering a pipeline across: Discovery → Prediction → Design → Validation We are looking for a Senior Computational Biologist with ML Engineering background to help build, bridge, and functionalise … intelligent ingredient complexes o repurposed peptides o newly discovered natural peptides 4) Productionise the AI product launch ● Build end-to-end ML pipeline covering ingestion, training, evaluation and deployment ● Develop APIs/services to serve predictions and ranked candidates into internal tools and client outputs ● Create evaluation harnesses ...

native quality engineering. You will join a team that is actively redesigning how QA works in a world of fast development cycles, complex data, and increasing automation, with AI tools like Claude, GitHub Copilot and similar assistants embedded into daily workflows rather than treated as add-ons. … Company They are a technology-led business operating in a highly data-driven financial environment, building a modern web platform that aggregates and analyses complex information to deliver clear, actionable insights for users. Working in small, cross-functional squads, they value thoughtful engineering, clean architecture and continuous improvement. ...

prominent technology firm in the UK is seeking a Data Leadership role to scale their existing data function and drive maturation across the business. The successful candidate will own and evolve data pipelines while leading a team and collaborating across departments for strategic insight. … Ideal applicants will have 10+ years of experience in data engineering, excellent SQL skills, and familiarity with high-volume datasets and data warehousing technologies. #J-18808-Ljbffr ...

Security Architect to join our Cybersecurity team in London. Responsibilities Define enterprise AI security architecture: develop reference architectures, guardrails, and standards for secure data pipelines, model training/inference, and AI-integrated applications across on-prem and cloud. Secure MLOps/ML platforms: architect identity, secrets management, network … segmentation, and least-privilege access for feature stores, model registries, orchestration, and deployment pipelines. Data protection by design: establish controls for sensitive data ingestion, anonymization/pseudonymization, encryption (at rest/in transit), tokenization, and lineage across AI workflows. Adversarial ML defense: design controls and tests ...

activate and scale partnerships. Measure activation rate, moves per partner, integration velocity, and partner NPS. Integration quality. Own the reliability, speed, and data quality of partner data flowing into our platform. When a partner sends us a move, the experience should be seamless. B2B metrics. Partner … measurably increases moves from at least one partner. Build relationships with key partner stakeholders. Understand their pain points, not just ours. Map the integration pipeline and develop a prioritisation framework for new partner types (deposit schemes, mortgage software, conveyancing platforms). Establish your operating rhythm with Engineering ...

Must have skills: Python Machine Learning SQL Roles and Responsibilities: Design and develop rapid prototypes and PoCs using Python for data-driven and AI/ML use cases. Build, train, evaluate, and fine-tune machine learning models for structured and unstructured data. Perform data analysis, feature … engineering, and experimentation to validate hypotheses. Develop efficient SQL queries for data extraction, transformation, and analysis from relational databases. Integrate prototypes with APIs, data pipelines, and visualization tools when required. Translate business problems into analytical and ML solutions. Collaborate with cross-functional teams to refine requirements ...

+ benefits Are you a Senior Backend Engineer who thrives on designing and scaling complex systems? Do you enjoy working on data-intensive platforms involving real-time pipelines, streaming architectures, and graph-based services? This is a hands-on role within a small, research-driven engineering team working … components from architecture through to production, while contributing to the overall technical direction. Key Responsibilities Design, build, and own backend services and data pipelines in Python Develop and operate streaming systems using Kafka or similar technologies Work with graph-based data structures and algorithms to support ...

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

building production-ready AI systems using LLMs, this role offers high ownership and the chance to shape how AI is applied in critical, data-intensive domains. The Role: Design, build, and deploy agentic AI systems within a scalable, production environment. This is a hands-on engineering role with … Strong experience building production AI/ML systems Experience with LLMs and agentic AI frameworks Proficiency in Python and working with APIs/data pipelines Experience working with structured or enterprise data Ability to operate in a fast-paced, high-ownership environment If this role ...

operational dashboards, and scripts that eliminate repetitive manual tasks across the business. Cross-Boundary Integration: Solve complex problems that span multiple systems, including data onboarding pipelines and API integrations. Product Delivery: Contribute directly to the core product, shipping high-quality features while ensuring the underlying systems remain robust. … modern CI/CD architectures, automated testing frameworks, and internal tool development. Application Code: Proficiency in building and maintaining production-grade product features. Data & Pipelines: Experience building ingestion workflows and connecting disparate internal data sources. Stack Versatility: You are highly proficient in Python ( FastAPI ) and TypeScript ...

London Stock Exchange Group is seeking a Senior Manager in Data Acquisition to lead strategies for sourcing data. The role involves managing 3rd party suppliers, automating data pipelines, and developing evaluation frameworks for data sources. The successful candidate will have significant experience in data roles, a strong understanding of data techniques, and excellent communication skills. This full-time position is based in London, offering competitive benefits and a collaborative work culture. #J-18808-Ljbffr ...

team Requirements Published research in peer-reviewed venues such as IEEE, ICML, NeurIPS, ICLR, or equivalent Deep expertise in time series modelling - financial data experience strongly preferred Proven end-to-end ML experience: data pipelines, model development, deployment, and monitoring Strong Python and ML engineering skills … time and support for continued research and publishing Competitive base, performance bonus, and equity Hybrid working, flexible culture, and access to institutional-grade data and compute ...

including JavaScript/TypeScript and Python Experience with React (frontend) and backend frameworks such as FastAPI or similar Experience designing and implementing scalable data pipelines and database structures Hands-on experience with cloud infrastructure, ideally AWS Strong understanding of security and compliance considerations including ISO 27001 and GDPR … evolve it into a production-ready SaaS platform for enterprise customers Build and maintain a secure, scalable backend capable of handling sensitive enterprise data Design and develop high-quality frontend interfaces that make complex AI outputs intuitive and actionable for users Build and maintain deployment pipelines, testing frameworks ...

support and maintain a suite of Python-based processes and reporting tools used across the business. * Provide day-to-day support for existing data pipelines, APIs, and reporting frameworks, troubleshooting issues and resolving incidents. * Work across a technology stack centred on Python, Postgres, Docker, REST APIs, and local … databases. * Assist with the management and optimisation of automated processes to improve reliability and efficiency. * Support infrastructure including virtual machines and data workflows. * Collaborate with internal teams to enhance reporting and operational processes. * Contribute to the integration and ongoing use of AI tools across the organisation, including supporting ...

with cloud infrastructure, containerisation (Docker, Kubernetes), CI/CD pipelines, and deployment of Azure-hosted or similar cloud services. Experience designing and building data pipelines for ingestion, transformation, and storage at reasonable scale. Strong analytical and problem-solving skills, including the ability to work with evolving requirements, translate … startup experience. This focuses more on the engineering aspects than before: Shifted emphasis from evaluation/research to platform engineering, APIs, data pipelines, deployment, and operational reliability Added CI/CD, monitoring, containerisation, and deployment as explicit responsibilities Moved ML/evaluation experience from required to preferred Made ...

engages in real conversations, understands product attributes, compatibility, visual features, and domain expertise, and provides genuinely expert guidance. Every interaction generates high-intent data on customer needs, objections, and unmet demand. This intelligence powers segmentation, product development, and personalisation — far beyond traditional analytics. Long-term, the company … will be at the forefront of developing the intelligence that powers the AI agent. You will design, build, and scale the AI models, data pipelines, and cognitive systems that drive conversational recommendations and insights. This is a unique opportunity to shape the core AI and influence the company ...

edge platforms Design, curate, and manage image/video datasets for training and evaluation Develop and maintain annotation workflows and tooling Create synthetic data pipelines (including generative approaches) to augment real-world datasets Stay current with emerging tools, methods, and best practices in CV/ML What … mindset with strong problem-solving ability Clear communicator who works well in a collaborative team Nice to Have Experience with real-world sensor data (e.g., RGB-D, thermal, radar) Model optimisation/deployment tooling (ONNX, TensorRT) Edge deployment experience (e.g., NVIDIA Jetson or other resource-constrained devices) Familiarity ...

help deliver production-grade AI systems. Our work is focused on real workflow automation. Think document intelligence, multi-step agents, RAG systems, data extraction, approval workflows, operational copilots, and AI systems that connect into the tools clients already use. This role sits close to what we call … solver. What you’ll be doing: Building agentic AI systems for complex enterprise workflows Working across Python, Node.js, TypeScript, APIs, LLMs, RAG, and data pipelines Helping design architecture for AI systems that need to be reliable, secure, and usable Joining client whiteboarding sessions to understand workflows and spot ...

Design, build, and maintain Python-based trading and research infrastructure Develop bespoke analytics and visualisation tools in close partnership with investment teams Optimise data pipelines, automate complex workflows, and enhance system efficiency 🌟 Why This Role Stands Out 💼 Front-Office Exposure – Work side-by-side with PMs and Quants … clear progression ✅ What You Bring 🎓 Degree in Computer Science, Engineering, Mathematics, or a related field 💻 Strong Python experience in high-performance or data-intensive environments 📊 Understanding of financial markets (equities, fixed income, or derivatives is a plus) 🧠 Excellent problem-solving skills with the ability to communicate across technical ...

every day. You'll join Platform Technology - a part of the organisation responsible for shared, cross-cutting capabilities such as developer tools, APIs, data pipelines and infrastructure services. Your job is to make these platforms reliable, discoverable and enabling: reducing delivery friction, improving user experience, and helping downstream … developers to operations staff - and translate their needs into clear priorities Investigate the development of measurable service outcomes (adoption, usability, performance) and use data to track progress Balance short-term reliability with long-term sustainability and compliance Facilitate collaboration across technical and non-technical stakeholders; communicate trade-offs ...

global organisation is undergoing a significant digital modernisation programme and is looking to appoint a Test Engineer to strengthen quality assurance across its data and application landscape. This role sits within a central IT & Digital function and plays a critical role in improving delivery confidence, system reliability … proactive testing throughout the delivery lifecycle. The Role As a Test Engineer, you will act as a quality gate across applications, integrations and data platforms, ensuring solutions are accurate, stable and fit for real-world use. Key responsibilities include: Partnering with development leads and business analysts on test ...

specialist technology consultancy based in Bristol. We help large organisations banks, energy companies, airports, investment platforms get real value from the data that flows through their IT infrastructure. That means helping them monitor their systems, protect their networks, and make sense of the information their technology generates every … consultants, and building skills that have a clear path to progression. The Opportunity Were looking for a Graduate Consultant to join our Data practice. Youll work alongside senior colleagues on the design, deployment, and optimisation of monitoring and observability platforms primarily Splunk and Cribl helping enterprise clients ...

specialist technology consultancy based in Bristol. We help large organisations banks, energy companies, airports, investment platforms get real value from the data that flows through their IT infrastructure. That means helping them monitor their systems, protect their networks, and make sense of the information their technology generates every … consultants, and building skills that have a clear path to progression. The Opportunity Were looking for a Graduate Consultant to join our Data practice. Youll work alongside senior colleagues on the design, deployment, and optimisation of monitoring and observability platforms primarily Splunk and Cribl helping enterprise clients ...

strong communication skills and a proactive, problem-solving mindset. Key Responsibilities Analyse business processes and identify automation opportunities Build internal tools, dashboards, and data pipelines Integrate systems using APIs and data feeds Develop AI-powered features to improve workflows and insights Support rollout, training, and ongoing … system improvements About You 35 years experience in a technical role (development, data, or solutions) Strong understanding of programming concepts and integrations Experience working with APIs, data, and databases Familiarity with AI tools and where they add value Confident communicator, able to work with non-technical ...

SOAR playbooks to automate investigation and response workflows Support onboarding of log sources into SIEM, ensuring accurate parsing and normalisation Optimise search performance, data pipelines, and platform efficiency Troubleshoot issues across SIEM/SOAR environments (data ingestion, alerting, integrations, automation workflows) Collaborate with Detection Engineers … operationalise detection use cases Implement enrichment workflows incorporating threat intelligence, asset context, and identity data Support incident response through effective automation and data availability Maintain clear and comprehensive documentation for configurations, integrations, and playbooks Required Skills & Experience Minimum 3+ years of commercial experience in SOC, SIEM ...