576 to 600 of 661 Data Pipeline Jobs in the UK

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

Senior Software Engineer | Sports Data London, UK | Remote Working Up to £80,000 + Company-wide benefits We’re partnered with a high-growth sports media network that operates a portfolio of market-leading brands and partnerships across the sports betting and tech space. Their mission … cutting-edge tools, all powered by modern, cloud-native technology. They are looking for an established Senior Software Engineer to join their expanding data team, where you will be working directly on key services that power a core part of the company's platform. While having essential responsibility ...

building production-ready AI systems using LLMs, this role offers high ownership and the chance to shape how AI is applied in critical, data-intensive domains. The Role: Design, build, and deploy agentic AI systems within a scalable, production environment. This is a hands-on engineering role with … Strong experience building production AI/ML systems Experience with LLMs and agentic AI frameworks Proficiency in Python and working with APIs/data pipelines Experience working with structured or enterprise data Ability to operate in a fast-paced, high-ownership environment If this role ...

operational dashboards, and scripts that eliminate repetitive manual tasks across the business. Cross-Boundary Integration: Solve complex problems that span multiple systems, including data onboarding pipelines and API integrations. Product Delivery: Contribute directly to the core product, shipping high-quality features while ensuring the underlying systems remain robust. … modern CI/CD architectures, automated testing frameworks, and internal tool development. Application Code: Proficiency in building and maintaining production-grade product features. Data & Pipelines: Experience building ingestion workflows and connecting disparate internal data sources. Stack Versatility: You are highly proficient in Python ( FastAPI ) and TypeScript ...

London Stock Exchange Group is seeking a Senior Manager in Data Acquisition to lead strategies for sourcing data. The role involves managing 3rd party suppliers, automating data pipelines, and developing evaluation frameworks for data sources. The successful candidate will have significant experience in data roles, a strong understanding of data techniques, and excellent communication skills. This full-time position is based in London, offering competitive benefits and a collaborative work culture. #J-18808-Ljbffr ...

team Requirements Published research in peer-reviewed venues such as IEEE, ICML, NeurIPS, ICLR, or equivalent Deep expertise in time series modelling - financial data experience strongly preferred Proven end-to-end ML experience: data pipelines, model development, deployment, and monitoring Strong Python and ML engineering skills … time and support for continued research and publishing Competitive base, performance bonus, and equity Hybrid working, flexible culture, and access to institutional-grade data and compute ...

including JavaScript/TypeScript and Python Experience with React (frontend) and backend frameworks such as FastAPI or similar Experience designing and implementing scalable data pipelines and database structures Hands-on experience with cloud infrastructure, ideally AWS Strong understanding of security and compliance considerations including ISO 27001 and GDPR … evolve it into a production-ready SaaS platform for enterprise customers Build and maintain a secure, scalable backend capable of handling sensitive enterprise data Design and develop high-quality frontend interfaces that make complex AI outputs intuitive and actionable for users Build and maintain deployment pipelines, testing frameworks ...

hiring for a Data Scientist to join a growing technology company applying advanced data science and machine learning to complex, real-world problems in a highly regulated environment. The company has built a proprietary analytical platform that has been successfully validated through large-scale, real-world … team is now expanding and offers a collaborative, mission-driven culture. The Role This role focuses on applied machine learning and data analysis, working with complex datasets alongside scientists and engineers. You'll contribute across the model lifecycle - from exploration and development through to evaluation, documentation, and deployment ...

support and maintain a suite of Python-based processes and reporting tools used across the business. * Provide day-to-day support for existing data pipelines, APIs, and reporting frameworks, troubleshooting issues and resolving incidents. * Work across a technology stack centred on Python, Postgres, Docker, REST APIs, and local … databases. * Assist with the management and optimisation of automated processes to improve reliability and efficiency. * Support infrastructure including virtual machines and data workflows. * Collaborate with internal teams to enhance reporting and operational processes. * Contribute to the integration and ongoing use of AI tools across the organisation, including supporting ...

systems and are looking for an experienced quantitative developer to face off to the traders and quantitative researchers to develop enhanced systems and data capabilities for their fixed income business. You will have a background in financial markets, ideally on the buy-side, with significant commercial experience developing … enterprise production-grade systems and data pipelines in Python and/or Java, a solid understanding of financial products and their representation, and proven experience using AI coding assistants to enable faster delivery in compressed timelines. You will collaborate with quant teams, to ensure their requirements are properly ...

systems and are looking for an experienced quantitative developer to face off to the traders and quantitative researchers to develop enhanced systems and data capabilities for their fixed income business. You will have a background in financial markets, ideally on the buy-side, with significant commercial experience developing … enterprise production-grade systems and data pipelines in Python and/or Java, a solid understanding of financial products and their representation, and proven experience using AI coding assistants to enable faster delivery in compressed timelines. You will collaborate with quant teams, to ensure their requirements are properly ...

most complex organisations in the world. We’re assembling a small, exceptional engineering team to solve problems at the intersection of AI, data, and scale—turning messy, manual workflows into automated, reliable systems that operate globally, securely, and at speed. If you’ve always wanted your work … core systems that make advanced AI workflows production‐ready: High‐performance backend services and APIs that power complex AI‐driven platforms Large‐scale data pipelines handling sensitive, high‐value datasets Systems that deploy and monitor machine‐learning models in real-world environments Enterprise‐grade infrastructure where reliability, security ...

Cleared Location - Exeter Overview A leading UK-based organisation is undertaking a major transformation of the technology platforms that underpin critical data, science, and digital services. We are seeking an experienced Product Manager to shape and evolve internal platforms used by engineers, technical specialists, and operational teams. This … role sits within a central Platform Technology function responsible for shared capabilities such as developer tooling, APIs, data pipelines, and infrastructure services. The focus is on improving reliability, usability, and scalability—enabling teams across the organisation to deliver faster, safer, and more effectively. Key Responsibilities Develop business cases ...

engages in real conversations, understands product attributes, compatibility, visual features, and domain expertise, and provides genuinely expert guidance. Every interaction generates high-intent data on customer needs, objections, and unmet demand. This intelligence powers segmentation, product development, and personalisation — far beyond traditional analytics. Long-term, the company … will be at the forefront of developing the intelligence that powers the AI agent. You will design, build, and scale the AI models, data pipelines, and cognitive systems that drive conversational recommendations and insights. This is a unique opportunity to shape the core AI and influence the company ...

this role. We’re supporting a major organisation undergoing a significant transformation of its technology platforms that underpin critical services across engineering, data, and operational teams. This is an opportunity for an experienced Product Manager to take ownership of internal platforms that enable developers, scientists, and service teams … reliability, and overall delivery effectiveness. The Role You’ll join a Platform Technology function responsible for shared capabilities such as developer tooling, APIs, data pipelines, and infrastructure services. Your focus will be on making these platforms intuitive, reliable, and valuable—reducing friction for internal users and enabling faster ...

Design, build, and maintain Python-based trading and research infrastructure Develop bespoke analytics and visualisation tools in close partnership with investment teams Optimise data pipelines, automate complex workflows, and enhance system efficiency 🌟 Why This Role Stands Out 💼 Front-Office Exposure – Work side-by-side with PMs and Quants … clear progression ✅ What You Bring 🎓 Degree in Computer Science, Engineering, Mathematics, or a related field 💻 Strong Python experience in high-performance or data-intensive environments 📊 Understanding of financial markets (equities, fixed income, or derivatives is a plus) 🧠 Excellent problem-solving skills with the ability to communicate across technical ...

Company They are part of a large international media and advertising group operating across multiple markets. Their focus is on combining technology, data and creativity to deliver impactful advertising solutions across physical and digital environments. Technology and AI are becoming increasingly central to how the business operates internally … based AI services and modern LLM frameworks. Turning ambiguous business problems into clear, scalable technical solutions. Building APIs, backend services, automation workflows and data pipelines that support AI capabilities. Deploying, monitoring and iterating on AI solutions in live environments. Setting engineering best practice and mentoring other AI engineers ...

every day. You'll join Platform Technology - a part of the organisation responsible for shared, cross-cutting capabilities such as developer tools, APIs, data pipelines and infrastructure services. Your job is to make these platforms reliable, discoverable and enabling: reducing delivery friction, improving user experience, and helping downstream … developers to operations staff - and translate their needs into clear priorities Investigate the development of measurable service outcomes (adoption, usability, performance) and use data to track progress Balance short-term reliability with long-term sustainability and compliance Facilitate collaboration across technical and non-technical stakeholders; communicate trade-offs ...

Were looking for a skilled Azure Data Engineer with hands-on experience in Microsoft Fabric to join our growing data team. If youre passionate about building scalable, modern data platforms in Microsoft Azure, wed love to hear from you. What Youll Do Design, build … maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Wa click apply for full job details ...

global organisation is undergoing a significant digital modernisation programme and is looking to appoint a Test Engineer to strengthen quality assurance across its data and application landscape. This role sits within a central IT & Digital function and plays a critical role in improving delivery confidence, system reliability … proactive testing throughout the delivery lifecycle. The Role As a Test Engineer, you will act as a quality gate across applications, integrations and data platforms, ensuring solutions are accurate, stable and fit for real-world use. Key responsibilities include: Partnering with development leads and business analysts on test ...

Hedge Fund client is looking for a Python Developer/Engineer Contract role This team is responsible for the firms equity transaction data platform, including trade life cycle event processing, enrichment, and PnL calculations. The role is ideal for an engineer who enjoys building robust, high-throughput services … data pipelines in a fast-paced, delivery-focused environment. Principal Responsibilities Design and develop solutions for trade life cycle event processing, including corporate actions, expiries, and other post-trade events. Build and operate Python-based services that perform large-scale data transformations and calculations. Publish ...

strong communication skills and a proactive, problem-solving mindset. Key Responsibilities Analyse business processes and identify automation opportunities Build internal tools, dashboards, and data pipelines Integrate systems using APIs and data feeds Develop AI-powered features to improve workflows and insights Support rollout, training, and ongoing … system improvements About You 35 years experience in a technical role (development, data, or solutions) Strong understanding of programming concepts and integrations Experience working with APIs, data, and databases Familiarity with AI tools and where they add value Confident communicator, able to work with non-technical ...

role is 100% on site. The successful candidate will join our development team responsible for building and integrating real-time test and data capture systems. The role will focus on developing and maintaining software in a Linux environment, working closely with high-speed multi-channel SFPDP cards, real … time data flows, and complex multi-threaded processing pipelines. Proficient in C++ and with knowledge of C#, you will play a critical part in the design, development, integration, and verification of test software solutions that are central to our system validation and delivery capabilities. Responsibilities: Design and develop ...

will be 2 days on site in London , UK. About role: You will design, deliver, and lead enterprise‐level master data management solutions within Cloud MDM environments. Specific skills/experience desired: 5+ years experience with Informatica MDM and Informatica Cloud MDM (SaaS) development Experience building and configurating … Business Entity models and Match/Merge rules in IDMC Proficiency developing data pipelines using Informatica Cloud (CDI) and APIs to sync master data across enterprise systems Implemented Cloud Data Quality (CDQ) rules and ActiveVOS workflows to automate cleansing Strong technical leading abilities, leading ...

production environments. Monitor database health and perform routine maintenance tasks including index optimisation, table maintenance, and schema modifications. Work with Development and Data engineering teams to optimise performance & cost of data pipelines Manage database capacity planning and storage allocation to ensure adequate resources for current … availability solutions including replication, clustering, and failover configurations. Document database architectures, configurations, procedures and policies. Implement appropriate security controls to ensure databases and data are protected. Ensure database backup, validation and disaster recovery capabilities are in place and rehearsed. Provide insight and recommendation on the adoption and consolidation ...