226 to 250 of 299 Data Pipeline Jobs in London

pipelines, vector search solutions, and agent-based workflows Creating robust evaluation frameworks to measure accuracy, reliability, and performance Building scalable APIs, services, and data pipelines Implementing observability, monitoring, and feedback loops to continuously improve outputs Optimising models and prompts for latency, cost, and quality across different providers What … production systems Solid understanding of cloud environments (AWS, GCP, or Azure) Experience with distributed systems, CI/CD, testing, and deployment pipelines Strong data handling skills (SQL, pandas) and an understanding of evaluation strategies for AI systems Comfortable working in ambiguous environments and iterating on non-deterministic systems ...

systems, including RAG pipelines, vector/knowledge databases, and agentic frameworks. Build and maintain production-grade AI applications with clean code, APIs, data pipelines, and robust error handling. Develop and maintain evaluation frameworks to measure and monitor system performance, accuracy, and reliability. Implement feedback loops and observability … skills with production API/service development experience. Knowledge of cloud platforms (AWS, GCP, Azure), distributed systems, and CI/CD pipelines. Strong data manipulation skills (SQL, pandas) and experience evaluating AI system outputs. Ability to work with ambiguity and optimise non-deterministic systems while balancing latency, cost ...

week in our Waterloo office Experience level: At least five years in commercial software engineering 🚀 About Orchestra Orchestra is an AI-native data pipelining platform building the future of data orchestration and observability . We have built a declarative framework allowing data engineers … explicitly declare how their data pipelines behave. Think CI/CD but for data teams! Backed by VCs from San Francisco, New York and London with angels from across the data space and beyond. 👷 Engineering at Orchestra We care deeply about our users—their ...

handling, autoscaling - Ensure graceful handling of failovers, deployments, and edge cases across all services Data Pipelines & Warehouse - Manage the Airbyte replication pipeline from production database to data warehouse - Configure incremental replication for new tables as the product evolves - Maintain the data warehouse (PostgreSQL … autovacuum tuning, memory parameters, capacity planning - Manage RudderStack for event streaming to analytics (Amplitude) and attribution (AppsFlyer) CI/CD & Deployment - Own CircleCI pipeline configuration and reliability - Manage ECS deployment strategies, health checks, and rollout verification - Maintain test environments and cleanup automation WHAT WE'RE LOOKING FOR Must Have ...

days Location: London, England Job Summary: We are looking for a hands-on Senior Software Engineer to own and accelerate our product delivery pipeline — from back-end database optimization to client-facing interactive dashboards and reporting platforms. This is a builder role. You will work directly alongside the Head … Data & Customer Analytics to identify bottlenecks, design improvements, and push products from backlog to production. You will be embedded in a small, high-output team where your contributions are immediately visible and impactful. Responsibilities: Optimize and maintain a Treasury Dashboard hosted in client Azure environments (currently Streamlit-based ...

market. We are now entering an exciting growth phase. The business is live, performing strongly, and moving towards significant scale. As we grow, data science will sit at the heart of how we underwrite, price, monitor risk and improve performance. We are looking for a sharp, hands … Data Scientist to help drive that forward. You will be expected to deliver quickly, iterate based on evidence, and continuously improve decisioning as new data becomes available. What you'll do · Build and improve models across credit risk, pricing and portfolio performance · Analyse originations, arrears, defaults ...

Founding BE Data Engineer (Python, Postgres, LLMs) Salary up to £150k + Equity London Onsite Join a lean (under 10), early‐stage startup building sustainable, environmentally‐focused financial services. The focus of the solution is understanding where capital flows, and the data behind those decisions needs … accurate, traceable, and built with care. This is a true end‐to‐end data focused role. You'll own data wrangling from ingestion through to delivery, no hand‐offs, no downstream dumping. Full responsibility, real impact. The company is profitable and revenue focused, with clients that ...

strong engineering capability is the bigger priority. What you will do Design and build core platform components including pricing services, APIs, and data pipelines Develop scalable ingestion and processing systems for market, macro, and time-series data Build internal tooling that improves how analytics and trading … platform What you will need Strong software engineering fundamentals across architecture, design, and quality practices 5+ years’ experience in platform engineering, quant development, data engineering, or software engineering within financial services Strong Python experience in production environments Exposure to C++ or Rust would be beneficial for performance-sensitive ...

/systematic strategies Solid academics What You'll Be Doing Designing and building high-performance trading systems alongside traders and quants Creating data pipelines to ingest and process large volumes of market data Developing monitoring tools and dashboards for live trading environments Improving engineering standards through … qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: roberthalf.com/gb/en/privacy-notice. ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

best practices in AI engineering. MLOps, AIOps) to improve products/services and processes related to AI. Optimise existing model serving and data pipelines to meet changing performance and security requirements. Hold requirements gathering sessions with business stakeholders and data science teams. Lead functional projects … leveraging AI-powered development tools like GitHub Copilot or similar platforms (e.g., Knowledge of or experience with MCP to integrate LLMs with external data sources and tools Our teams forge connections internally and work with some of the best-known brands on the planet, giving us truly international ...

experience on AWS; Azure exposure is highly beneficial. Hands-on experience or working exposure in securing LLM/AI workloads, including model deployment, data flows, and runtime considerations. Proficiency with cloud-native security tooling (CSPM, CWPP, secrets management, logging/monitoring, container security). Experience securing … ensure secure implementation of AI workloads. Desirable Skills/Knowledge/Experience Experience securing GenAI, Agentic AI, vector databases, model APIs, or data pipelines used by LLMs. Knowledge of responsible AI principles, model governance, or AI-specific threat modelling (e.g., adversarial ML, data poisoning, prompt injection ...

engineering. Use best practices (e.g., MLOps, AIOps) to improve products/services and processes related to AI. Optimise existing model serving and data pipelines to meet changing performance and security requirements. Hold requirements gathering sessions with business stakeholders and data science teams. Lead functional projects … similar platforms (e.g., Kiro, Cursor) to enhance productivity and code generation. Knowledge of or experience with MCP to integrate LLMs with external data sources and tools At JET, this is on the menu: Our teams forge connections internally and work with some of the best-known brands ...

engineering. Use best practices (e.g., MLOps, AIOps) to improve products/services and processes related to AI. Optimise existing model serving and data pipelines to meet changing performance and security requirements. Hold requirements gathering sessions with business stakeholders and data science teams. Lead functional projects … similar platforms (e.g., Kiro, Cursor) to enhance productivity and code generation. Knowledge of or experience with MCP to integrate LLMs with external data sources and tools At JET, this is on the menu: Our teams forge connections internally and work with some of the best-known brands ...

seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design and build robust data pipelines using Azure Data Factory and Databricks Develop ETL/ELT processes to transform raw data into analyti click apply for full job details ...

surveillance capability within the Markets Risk Technology function of a major UK bank. The role ensures that surveillance controls, supervisory workflows and associated data flows are designed and documented with a high level of technical precision. The position also contributes to the review and automation of existing manual … current manual supervisory processes operated across front-office and operations Identify automation opportunities and support transition planning as new platform features are Deployed Data Flow and Requirements Documentation Map end-to-end data flows from trading systems to surveillance platforms Identify gaps, ambiguities or incomplete requirements ...

Test Engineer Up to £65,000 I am seeking a Test Engineer to support the quality, reliability and performance of modern data and digital platforms within a large, globally operating organisation. Sitting within an established IT and Digital function, this role is central to ensuring high-quality delivery … across applications, integrations and data pipelines that underpin critical business operations. This role is ideal for someone with strong hands-on testing experience across data platforms and low-code applications, combined with a structured, analytical approach to quality assurance. You will work closely with Development Leads ...

Insight Global’s client is hiring a Product Owner to lead the digital, CRM and data capabilities that will power our Away from Home (Away from Home) go‐to‐market strategy and execution model. You will be the single business owner accountable for designing, delivering and realizing commercial … value from digital assets, Salesforce CRM and external data (e.g. Circana). This role owns automation, integration and the business use of digital assets and data to drive targeting, lead qualification, customer management, performance tracking and commercial decision‐making. This is a hybrid model role ...

Python Developer (AI/Data Focus) – Financial Services We’re partnering with an innovative financial services firm with deep expertise across FX, Swaps, Options, and a range of complex financial products. Their technology team is building cutting-edge, data-intensive, event-driven systems that power real … time market data, analytics, and execution workflows — and they’re looking for a Full-Stack Python Engineer to join them. 💻 What you’ll be working on: • Designing, developing, and optimising full-stack applications • Building API-first, scalable backend services • Developing real-time data pipelines and event ...

partnering with a rapidly scaling Palantir implementation partner, expanding across all seniority levels, having secured a strong pipeline of projects across various industries. This is an exciting opportunity to specialise in one of the fastest-growing technology markets and collaborate with some of the most experienced leaders … field. Responsibilities: Develop and maintain data pipelines and ETL processes Analyse client challenges and design tailored solutions Collaborate on implementing AI and machine learning models Serve as a point of contact, providing consultative guidance and support Requirements: Proven programming skills in Python and JavaScript Familiarity with Palantir ...

organisation continues to scale its AI capabilities, they are looking for someone to lead and shape the technical direction of their data and NLP initiatives. The Role As a Staff Applied Scientist, you will act as the technical lead for data and NLP initiatives , driving improvements … recall) • Optimising search algorithms to deliver fast and accurate results • Designing and implementing agentic AI workflows powered by LLMs • Building and maintaining scalable data pipelines • Leading technical decision-making across ML and NLP projects Requirements • 8+ years of commercial engineering and/or data science experience ...

Role You’ll take ownership of designing and delivering an end-to-end AI-driven reporting and automation platform, working closely with Data Science and operational stakeholders. This is a build-from-scratch opportunity — ideal for someone who enjoys solving real-world complexity and turning manual processes into … robust, automated systems. What You’ll Be Doing Designing and building an automated reporting platform from the ground up Creating intelligent workflows across data ingestion, validation, and reconciliation Implementing AI-driven and agent-based automation to streamline operations Introducing exception handling and human-in-the-loop systems where ...

creation across our PE partner portfolio, from first engagement with a sponsor, through deep technical and strategic analysis, to managing our engineers and data scientists as they build and deploy solutions that move EBITDA. You will operate across a range of workstreams simultaneously: evaluating AI opportunities …/ML product management, strategy consulting (MBB or comparable preferred), investment banking, or engineering You have managed teams of 5+ people (engineers, data scientists, consultants, or analysts) and held them accountable to ambitious timelines You have managed executive and C-suite stakeholder relationships, ideally ...

best practices in AI engineering. MLOps, AIOps) to improve products/services and processes related to AI. Optimise existing model serving and data pipelines to meet changing performance and security requirements. Hold requirements gathering sessions with business stakeholders and data science teams. Lead functional projects … leveraging AI-powered development tools like GitHub Copilot or similar platforms (e.g., Knowledge of or experience with MCP to integrate LLMs with external data sources and tools Our teams forge connections internally and work with some of the best-known brands on the planet, giving us truly international ...

Senior Technical Business Analyst to support an Analytics & Modelling Platform across Gas, LNG and Power markets. You’ll work with Quants, Data Scientists and Engineers to translate complex modelling and forecasting requirements into scalable technical solutions. What you’ll do Gather and define requirements for forecasting, scenario modelling … analytics Translate quantitative concepts into technical requirements and user stories Support design of data pipelines, models and analytics tools Work with Python-based analytics and complex datasets Drive Agile delivery, UAT and stakeholder alignment What you’ll bring BA experience in energy trading, analytics or modelling Strong knowledge ...