251 to 275 of 299 Data Pipeline Jobs in London

quality, stability and long-term thinking. The Global IT function is at the heart of the organisation's strategy to modernise through data and digital platforms, and testing is seen as a critical enabler. You'll be joining a supportive environment with approachable leadership, an inclusive culture … role where your contribution directly improves confidence in delivery and the reliability of systems used across the business. You will work with: Data Engineering and Development teams across global locations Development Leads and Business Analysts throughout the delivery lifecycle Azure-based platforms and pipelines, including ADF, Databricks ...

real-time production environments. You'll design and build scalable systems using Node.js and TypeScript, working across REST APIs, event-driven architecture, data pipelines, and distributed systems, ensuring performance, reliability, and scalability as the platform grows. This is a hands-on leadership role where you'll set technical … direction, mentor engineers, and contribute to engineering culture, while collaborating closely with AI engineers, data teams, and product stakeholders to translate complex workflows into robust, production-grade systems. You'll be responsible for building and maintaining scalable backend services, APIs, and integrations, designing microservices and event-driven architectures ...

Solution Architect & AI Manager will bridge the gap between complex data architecture and cutting-edge AI implementation. You will be responsible for the strategic delivery of the AIPX framework within the Balance Sheet Management (BSM) domain, ensuring that AI-driven insights are built on a foundation of robust … scalable, and high-performance engineering. Key Responsibilities: Lead cross-functional engineering teams to design, build, and deliver data-intensive platforms and AI-powered solutions aligned to strategic business needs. Oversee end-to-end delivery across the data and AI lifecycle for Balance Sheet Management (BSM)-from ...

Data Engineer 12 months Croydon - x1 day a week x4 remote Inside IR35 - Umbrella only Active SC clearance required Are you passionate about building reliable data pipelines and microservices? Our client, a leading organisation in the IT sector, is hiring for a talented Data ...

Security Architect to join our Cybersecurity team in London. Responsibilities Define enterprise AI security architecture: develop reference architectures, guardrails, and standards for secure data pipelines, model training/inference, and AI-integrated applications across on-prem and cloud. Secure MLOps/ML platforms: architect identity, secrets management, network … segmentation, and least-privilege access for feature stores, model registries, orchestration, and deployment pipelines. Data protection by design: establish controls for sensitive data ingestion, anonymization/pseudonymization, encryption (at rest/in transit), tokenization, and lineage across AI workflows. Adversarial ML defense: design controls and tests ...

activate and scale partnerships. Measure activation rate, moves per partner, integration velocity, and partner NPS. Integration quality. Own the reliability, speed, and data quality of partner data flowing into our platform. When a partner sends us a move, the experience should be seamless. B2B metrics. Partner … measurably increases moves from at least one partner. Build relationships with key partner stakeholders. Understand their pain points, not just ours. Map the integration pipeline and develop a prioritisation framework for new partner types (deposit schemes, mortgage software, conveyancing platforms). Establish your operating rhythm with Engineering ...

Must have skills: Python Machine Learning SQL Roles and Responsibilities: Design and develop rapid prototypes and PoCs using Python for data-driven and AI/ML use cases. Build, train, evaluate, and fine-tune machine learning models for structured and unstructured data. Perform data analysis, feature … engineering, and experimentation to validate hypotheses. Develop efficient SQL queries for data extraction, transformation, and analysis from relational databases. Integrate prototypes with APIs, data pipelines, and visualization tools when required. Translate business problems into analytical and ML solutions. Collaborate with cross-functional teams to refine requirements ...

+ benefits Are you a Senior Backend Engineer who thrives on designing and scaling complex systems? Do you enjoy working on data-intensive platforms involving real-time pipelines, streaming architectures, and graph-based services? This is a hands-on role within a small, research-driven engineering team working … components from architecture through to production, while contributing to the overall technical direction. Key Responsibilities Design, build, and own backend services and data pipelines in Python Develop and operate streaming systems using Kafka or similar technologies Work with graph-based data structures and algorithms to support ...

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

Senior Software Engineer | Sports Data London, UK | Remote Working Up to £80,000 + Company-wide benefits We’re partnered with a high-growth sports media network that operates a portfolio of market-leading brands and partnerships across the sports betting and tech space. Their mission … cutting-edge tools, all powered by modern, cloud-native technology. They are looking for an established Senior Software Engineer to join their expanding data team, where you will be working directly on key services that power a core part of the company's platform. While having essential responsibility ...

operational dashboards, and scripts that eliminate repetitive manual tasks across the business. Cross-Boundary Integration: Solve complex problems that span multiple systems, including data onboarding pipelines and API integrations. Product Delivery: Contribute directly to the core product, shipping high-quality features while ensuring the underlying systems remain robust. … modern CI/CD architectures, automated testing frameworks, and internal tool development. Application Code: Proficiency in building and maintaining production-grade product features. Data & Pipelines: Experience building ingestion workflows and connecting disparate internal data sources. Stack Versatility: You are highly proficient in Python ( FastAPI ) and TypeScript ...

London Stock Exchange Group is seeking a Senior Manager in Data Acquisition to lead strategies for sourcing data. The role involves managing 3rd party suppliers, automating data pipelines, and developing evaluation frameworks for data sources. The successful candidate will have significant experience in data roles, a strong understanding of data techniques, and excellent communication skills. This full-time position is based in London, offering competitive benefits and a collaborative work culture. #J-18808-Ljbffr ...

team Requirements Published research in peer-reviewed venues such as IEEE, ICML, NeurIPS, ICLR, or equivalent Deep expertise in time series modelling - financial data experience strongly preferred Proven end-to-end ML experience: data pipelines, model development, deployment, and monitoring Strong Python and ML engineering skills … time and support for continued research and publishing Competitive base, performance bonus, and equity Hybrid working, flexible culture, and access to institutional-grade data and compute ...

support and maintain a suite of Python-based processes and reporting tools used across the business. * Provide day-to-day support for existing data pipelines, APIs, and reporting frameworks, troubleshooting issues and resolving incidents. * Work across a technology stack centred on Python, Postgres, Docker, REST APIs, and local … databases. * Assist with the management and optimisation of automated processes to improve reliability and efficiency. * Support infrastructure including virtual machines and data workflows. * Collaborate with internal teams to enhance reporting and operational processes. * Contribute to the integration and ongoing use of AI tools across the organisation, including supporting ...

systems and are looking for an experienced quantitative developer to face off to the traders and quantitative researchers to develop enhanced systems and data capabilities for their fixed income business. You will have a background in financial markets, ideally on the buy-side, with significant commercial experience developing … enterprise production-grade systems and data pipelines in Python and/or Java, a solid understanding of financial products and their representation, and proven experience using AI coding assistants to enable faster delivery in compressed timelines. You will collaborate with quant teams, to ensure their requirements are properly ...

most complex organisations in the world. We’re assembling a small, exceptional engineering team to solve problems at the intersection of AI, data, and scale—turning messy, manual workflows into automated, reliable systems that operate globally, securely, and at speed. If you’ve always wanted your work … core systems that make advanced AI workflows production‐ready: High‐performance backend services and APIs that power complex AI‐driven platforms Large‐scale data pipelines handling sensitive, high‐value datasets Systems that deploy and monitor machine‐learning models in real-world environments Enterprise‐grade infrastructure where reliability, security ...

Design, build, and maintain Python-based trading and research infrastructure Develop bespoke analytics and visualisation tools in close partnership with investment teams Optimise data pipelines, automate complex workflows, and enhance system efficiency 🌟 Why This Role Stands Out 💼 Front-Office Exposure – Work side-by-side with PMs and Quants … clear progression ✅ What You Bring 🎓 Degree in Computer Science, Engineering, Mathematics, or a related field 💻 Strong Python experience in high-performance or data-intensive environments 📊 Understanding of financial markets (equities, fixed income, or derivatives is a plus) 🧠 Excellent problem-solving skills with the ability to communicate across technical ...

Company They are part of a large international media and advertising group operating across multiple markets. Their focus is on combining technology, data and creativity to deliver impactful advertising solutions across physical and digital environments. Technology and AI are becoming increasingly central to how the business operates internally … based AI services and modern LLM frameworks. Turning ambiguous business problems into clear, scalable technical solutions. Building APIs, backend services, automation workflows and data pipelines that support AI capabilities. Deploying, monitoring and iterating on AI solutions in live environments. Setting engineering best practice and mentoring other AI engineers ...

global organisation is undergoing a significant digital modernisation programme and is looking to appoint a Test Engineer to strengthen quality assurance across its data and application landscape. This role sits within a central IT & Digital function and plays a critical role in improving delivery confidence, system reliability … proactive testing throughout the delivery lifecycle. The Role As a Test Engineer, you will act as a quality gate across applications, integrations and data platforms, ensuring solutions are accurate, stable and fit for real-world use. Key responsibilities include: Partnering with development leads and business analysts on test ...

Hedge Fund client is looking for a Python Developer/Engineer Contract role This team is responsible for the firms equity transaction data platform, including trade life cycle event processing, enrichment, and PnL calculations. The role is ideal for an engineer who enjoys building robust, high-throughput services … data pipelines in a fast-paced, delivery-focused environment. Principal Responsibilities Design and develop solutions for trade life cycle event processing, including corporate actions, expiries, and other post-trade events. Build and operate Python-based services that perform large-scale data transformations and calculations. Publish ...

will be 2 days on site in London , UK. About role: You will design, deliver, and lead enterprise‐level master data management solutions within Cloud MDM environments. Specific skills/experience desired: 5+ years experience with Informatica MDM and Informatica Cloud MDM (SaaS) development Experience building and configurating … Business Entity models and Match/Merge rules in IDMC Proficiency developing data pipelines using Informatica Cloud (CDI) and APIs to sync master data across enterprise systems Implemented Cloud Data Quality (CDQ) rules and ActiveVOS workflows to automate cleansing Strong technical leading abilities, leading ...

arisen for an experienced KDB Developer to work alongside their Quants and Traders. This is an exciting opportunity to take ownership of critical data and analytics capabilities in a business where your work will directly support front-office decision-making, research, and platform performance. In addition … months. THE ROLE: KDB Developer This position sits within a small, highly capable team focused on building, improving and supporting the firms data environment. The successful candidate will play a key role in designing and developing scalable data collection and analytics solutions, while helping ensure ...

Role The Senior Technical Product Manager will own and build lifecycle and retention capabilities end-to-end, combining product thinking, technical execution, and data-driven experimentation to unlock sustained user growth. Role Highlights Design and launch AI-driven lifecycle journeys with minimal engineering support Architect and optimise … programmes across the full customer lifecycle Integrate APIs, tools, and data pipelines to deliver personalised experiences Run structured experiments to improve retention, engagement, and revenue Collaborate closely with growth, data, and engineering leadership You Will Need Proven ability to build and ship technical products independently Strong ...

pivotal role in designing and delivering a modern, AI-driven platform. Your work will span multiple areas, from developing intelligent systems and data pipelines to contributing to scalable SaaS infrastructure. You’ll help define architecture, improve developer workflows, and ensure systems are robust, secure, and production-ready. This … ability to design and deliver production-ready systems Familiarity with modern technologies such as Python, TypeScript, React, and PostgreSQL Experience with AI engineering, data engineering, and cloud-based SaaS infrastructure are all highly beneficial A proactive, solution-focused mindset, with the ability to take ownership of problems ...

more direct DPO family. You understand what each approach optimises for, where each breaks down, and which to reach for given the data and objective at hand. Parameter-efficient fine-tuning Production experience with LoRA and QLoRA. You understand how rank, the alpha-to-rank scaling ratio … diagnosis Building eval frameworks tied to real-world outcomes. You can identify why a model is failing from first principles. Training infrastructure Owning data pipelines, distributed training runs, and model versioning end-to-end. PyTorch is your default. You've debugged a training run that wasn't converging ...