151 to 175 of 274 Data Pipeline Jobs in London

Azure AI Foundry, Azure OpenAI, AI Search, agents and RAG patterns. Strong practical knowledge of databases, including SQL and NoSQL platforms, schema design, data access patterns, query performance and secure data handling. Ability to design, build and review maintainable code while following agreed coding standards, architectural …/CD workflows, branching strategies, pull requests and automated testing using tools such as Playwright. Experience with Microsoft Fabric, Lakehouse architecture, data pipelines or analytics engineering would be beneficial, especially where data needs to be prepared for reporting, automation or AI use cases. Role Build ...

Data Engineer - SC Cleared UK (Remote/Hybrid) | £490 per day | 6 Months | Inside IR35 We're seeking an experienced SC Cleared AWS Data Engineer to support a high-profile Central Government programme delivering critical data capabilities within a secure cloud environment. This … excellent opportunity to contribute to nationally significant work while leveraging modern AWS and data engineering technologies. Key Responsibilities Design, build, and optimise scalable cloud-based data pipelines on AWS Develop and maintain robust ETL processes to support complex data integration requirements Implement and manage ...

Data Scientist London £450 - £500 Per Day Outside IR35 Immediate Start 3 Days In Office The Company They are a data-driven organisation operating at scale, with a strong focus on leveraging analytics to improve performance and customer outcomes. Their teams bring together expertise across data … modern tools and encourages continuous learning. The Role and Deliverables Build, validate, and deploy machine learning models to solve business problems Translate complex data into actionable insights for non-technical stakeholders Work with structured and unstructured datasets to uncover trends and opportunities Collaborate with data engineers ...

across eBay Finance by building scalable solutions that improve decision-making and operational efficiency. The team works on complex, often undefined problems using data, AI, and automation. This role focuses on leading end-to-end transformation initiatives, from problem discovery through to production deployment. It involves working across … solution roadmaps Deliver end-to-end AI, machine learning, and automation solutions from concept to production, driving measurable business outcomes Build scalable, reusable data frameworks and pipelines that improve efficiency and enable future innovation Work with large, complex datasets to develop practical solutions that balance speed, accuracy ...

firm is seeking a talented backend engineer to develop the infrastructure for autonomous AI systems. You will work closely with founders to design data pipelines, architect backend services, and ensure optimal integration of various components. The ideal candidate has over 5 years of experience in production-grade Python ...

myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Description We are seeking a Data Scientist with experience prototyping, building, and scaling AI applications to join WTW’s Data Science team within our Consulting practice. In this role … will help grow our AI and Data Science advisory capability, working alongside leading insurance market experts to design and deliver cutting edge machine learning and generative AI solutions for the world’s leading general insurers and intermediaries. The Role: As a data scientist, you will operate ...

Overview Principal AI Engineer – you will lead the design and delivery of AI solutions that turn complex data into impactful outcomes. You will serve as the technical lead for an embedded Innovation Squad, owning the entire technical lifecycle from discovery through to production. Role As the senior authority … stakeholders and end users. Your responsibilities include hardening prototypes, delivering new AI services, codifying reusable patterns, mentoring teammates, and ensuring solutions meet security, data‐governance, and architectural standards. Key Responsibilities Own technical execution from discovery to production; build, assess, and harden prototypes and proofs of concept. Design ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath — data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments • Troubleshoot integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft ...

Fargate, RDS, ElastiCache, and Lambda. Own the monitoring and observability stack using Datadog APM to reduce alert fatigue and lead incident response. Optimize data pipelines and performance, including Airbyte replication and PostgreSQL tuning for high-concurrency music streaming. The ideal candidate: Deep expertise in AWS (ECS/Fargate ...

account, partner with your cross-functional team to solve the most critical pain points they are facing, drive strategy and growth by providing data driven insights and recommendations. This would mean finding the right balance and friction to deflect bad actors whilst providing legitimate users with a good … on. For more information on our Analytics Career Map and levelling structure, click here. WHAT YOU’LL BE DOING: Derive actionable insights from data to inform product decisions, to help support and improve onboarding and access to Wise for new and existing customers Partnering with your product manager ...

everyone, everywhere. More about our mission and what we offer . We are looking for an Analyst to sit at the intersection of Data Analytics and Financial Reporting. You aren’t here to do traditional accounting; you are here to build the data infrastructure and automation … that ensures our financial statements are accurate, consistent, and audit-ready as we scale globally. What will you be working on? Metric Ownership & Data Logic: Define and own the logic for key performance metrics. You will ensure there is clear attribution for every line item that manifests ...

conscious, and built to support rapid experimentation and sustainable growth. As our MarTech Manager, you will work cross-functionally with Marketing, Engineering, Product, Data, Legal, and external vendors to build the infrastructure and operational processes that enable marketing at scale. From vendor sourcing and onboarding to integrations, data … evolve Feeld’s marketing technology ecosystem across acquisition, lifecycle, attribution, analytics, and automation platforms Build and maintain scalable integrations, workflows, APIs, and data pipelines that ensure reliable and actionable marketing data Partner closely with Engineering, Product, and Data teams to enable scalable marketing operations ...

Robert Half Technology are assisting UK's market leading telecommunications organisation to recruit a Data Engineer on a contract basis - Hybrid working - London/Hampshire based We are supporting a data transformation programme and are looking for a Senior Data/Platform Engineer … take full ownership of the production data platform. This role is critical to delivering a scalable, production-ready platform ahead of a mid-August NetSuite cutover, including responsibility for build, integration, and operational readiness. Role The Data Engineer will own the end-to-end data ...

NetSuite expert, owning the day-to-day administration, configuration, and continuous improvement of the system. You will work closely with Finance, Operations, and Data teams to ensure NetSuite delivers accurate, reliable data and supports efficient processes as the company scales. Duties Act as the key internal … regression testing) and coordinate system changes to ensure smooth deployment Drive continuous improvement of NetSuite configuration and processes to reduce inefficiencies Own data integrity within NetSuite, proactively identifying and resolving data quality issues Act as a key liaison between Finance, Operations, and Data teams ...

money. For everyone, everywhere. More about our mission and what we offer . We are looking for an analytical and curious Senior Marketing Data Analyst to join our Marketing Science team. Our mission is to fuel sustainable growth by measuring marketing effectiveness - building a unified measurement framework based … partnering with marketing teams to ensure every £ is spent efficiently. Key Responsibilities Maintain and enhance our attribution model logic. Use dbt to maintain data pipelines, refine attribution rules, and implement new logic as our channel mix and marketing effectiveness understanding evolves. Ensure the accuracy of marketing data ...

Snowflake Developer Hybrid - London 6-month contract (Potential Extension) The Opportunity: We are seeking a hands-on Senior Data Warehouse Developer with 10-12 years of experience to design and implement scalable, high-performance data pipelines. … will collaborate with a cross-functional team of architects and analysts to optimize large-scale datasets, transforming raw information into strategic assets. Your Impact: Pipeline Engineering: Build and optimize scalable ETL/ELT workflows and data pipelines for structured and semi-structured datasets (exposure to policy/ ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Data Scientist AI for Science, Research Intelligence & Knowledge Discovery Technology - Data Science Organization Are you excited by the opportunity to use machine learning … solutions that support scientific discovery, knowledge extraction, decision support, and intelligent content understanding. You will work with large-scale scientific content and data, applying the right techniques to solve complex problems and deliver reliable, production-ready systems. Working closely with cross-functional partners, you will help turn ambiguous ...

least 5 years in technical leadership roles. Strong experience in Azure cloud architecture and enterprise application delivery. Experience working with Dataiku for analytics, data pipelines, or AI/ML-driven applications. Strong knowledge of .NET/ASP.NET Core architecture and enterprise integrations. Experience with financial services, treasury, derivatives … risk management platforms. Understanding of derivative valuation concepts, yield curves, curve validation, or market data processing. Experience with APIs, microservices, DevOps, and CI/CD pipelines. Strong stakeholder management and client-facing communication skills. Experience managing distributed/global teams. Preferred Skills Exposure to market risk or quantitative ...

+ excellent benefits A leading technology-focused organisation is seeking an experienced AI Deployment Engineer to join its growing AI and data function. This is a highly technical, hands-on role forming the backbone of the companys AI deployment capability, responsible for taking AI-driven solutions from prototype … reliably across the business. The role is predominantly remote, with occasional on-site collaboration days in London. Key Responsibilities: Own and develop the data and integration infrastructure supporting AI deployments, including pipelines, storage and data delivery layers Design and implement robust integrations between AI solutions ...

APIs, AI agents, and automation solutions across a Microsoft and Azure ecosystem. This includes integrating Microsoft 365 Copilot, Claude Cowork, and Azure-based data platforms with business-critical systems including practice management, CRM, and document management solutions. This is a developer-first role suited to someone who enjoys … Copilot Studio and Claude Cowork. Develop Retrieval-Augmented Generation (RAG) pipelines, document automation tools, and LLM-powered solutions. Contribute to Azure infrastructure, including data pipelines, storage, integrations, governance, and security. Collaborate with technical and business stakeholders to scope and deliver technology solutions. Produce clear technical documentation and support ...

/ML Platform, you will own the vision, roadmap, and delivery of the core engineering and MLOps capabilities that empower our data scientists and developers. You will be the crucial link between the advanced needs of our AI/ML practitioners and the platform engineering teams that build … foundational tools. This role requires a deep technical understanding of the machine learning lifecycle and the ability to translate architectural and data science requirements into a clear, actionable product backlog. Your primary objective is to maximize the velocity, efficiency, and scalability of how AI/ML models ...

team building scalable, customer-facing digital products. The role focuses on developing Java/Spring Boot services within a GCP environment, building data pipelines, and integrating with a customer engagement platform used in retail environments. You'll need to show where you've worked on highly available, high ...

leader with deep technical expertise, a strong understanding of advertising effectiveness and the ability to work cross-functionally with marketing stakeholders, analysts, data scientists, engineers and finance teams. Your Mission You will be responsible for the strategic direction of our triangle of measurements, ensuring it provides the best … strategy and implementation of our triangle of measurement ranging our marketing attribution model, experimentation and Marketing Mix Models. Collaborate effectively with marketing channels, data science and data engineering, and other cross-functional teams to identify and prioritise key business needs in our measurement products. Manage ...

Role * The AI Engineer will design, develop, and deploy scalable AI and machine learning solutions across digital sports media platforms. * Collaborate with product, data, and engineering teams to deliver AI-driven features and audience engagement tools. * Build and optimise LLM-powered applications, recommendation systems, and intelligent content workflows. … Develop and maintain robust data pipelines and model deployment infrastructure. * Implement monitoring, evaluation, and governance processes for AI systems to ensure reliability and performance. * Work with structured and unstructured datasets including video, social, audience, and editorial content. * Optimise AI models and inference pipelines for scalability, latency, and cost ...