126 to 150 of 272 Data Pipeline Jobs in London

recruiting a Test Engineer to join a global organisation undergoing a significant digital transformation, investing heavily in modern data platforms and enterprise technology. This role sits within a growing global IT and data function and will play a key part in improving the quality, reliability … consistency of outputs across engineering teams. This is a hands-on testing role with a strong focus on data validation, integration testing and end-to-end quality assurance across applications and data platforms. You will work closely with Development Leads and Business Analysts to ensure solutions ...

Senior/Principal Palantir Engineer UK (Hybrid) | Permanent | Data & AI Platform About the Role: Highly reputable organisation currently building a high-impact Data & AI capability and are looking for a Senior/Principal Palantir Engineer to help shape and scale their platform from the ground up. … Exciting opportunity to work at the intersection of data engineering, AI, and operational systems, designing solutions that directly drive business decisions and real-world outcomes. You will play a key role in delivering enterprise platforms using Palantir Foundry and AIP, working closely with stakeholders across engineering, operations ...

Platforms Lead to support the design, optimization, and governance of Fitch's enterprise marketing ecosystem. This role sits at the intersection of Marketing, data, and digital optimization to strengthen our marketing technology architecture, enhance platform performance, optimize integrations, strengthen data flows, and support our AI-enabled … workflows and how marketers succeed in reaching performance and brand objectives. Taking this input, you will partner closely with Marketing Shared Services, IT, Data, and Infrastructure teams to deliver solutions that enable scale, automation, and data integrity for Marketing to meet its objectives. This role ...

maximising customer value. Bridge Product and Pricing - translate product strategy into pricing implications and vice versa, ensuring both teams operate from a shared, data-driven understanding. Drive strategic impact - lead analytical roadmaps, cut through ambiguity, and influence pricing direction in leadership forums. Champion technical excellence - write high-performing … Marketing. You influence without authority and drive consensus through clear, compelling communication. Advanced technical skills - expert-level SQL, experience with data pipeline tools like dbt, and the ability to architect scalable data solutions. Leadership and influence - you mentor analysts, build partnerships with senior stakeholders ...

Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles … Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments Implement monitoring, logging, cost optimisation, and performance ...

Junior Data Engineer FTC (Azure) up to £45,000 + Benefits Remote (UK - occasional office visits) This is a great opportunity to join a high-growth organisation where you can take ownership of building and supporting modern data pipelines within a rapidly evolving data platform team. THE COMPANY: This is within the legal industry and is with a client who are significantly investing in its data and technology function, creating exciting opportunities for engineers looking to grow in a forward-thinking environment. THE ROLE: You will take ownership of supporting ...

solutions to enable advanced analytics, automation, and decision-making across complex government systems. This is a hands-on engineering role, working closely with data scientists, analysts, architects, and product teams to productionise models, build data pipelines, and embed ML capabilities into live services. Key Requirements Active … beneficial Experience with MLOps practices and tools (CI/CD pipelines, model monitoring, versioning) Strong understanding of data engineering concepts (ETL pipelines, data lakes, feature engineering) Experience working with large-scale structured and unstructured datasets Knowledge of AI ethics, bias mitigation, and model governance Comfortable working ...

STAFF AI ENGINEER £200,000 LONDON This is a rare opportunity to join a rapidly scaling, PE-backed data platform business and take ownership of building a next-generation AI-native data layer. Working directly with the Group CTO, you'll play a pivotal role … shaping both the technical direction and the future of their global data products. THE COMPANY This organisation is a global leader in B2B data and business intelligence, operating across 200+ countries and supporting industries such as fintech, compliance, and fraud prevention. Backed by private equity ...

HEAD OF AI ENGINEERING £200,000 LONDON This is a rare opportunity to join a rapidly scaling, PE-backed data platform business and take ownership of building a next-generation AI-native data layer. Working directly with the Group CTO, you'll play a pivotal role … shaping both the technical direction and the future of their global data products. THE COMPANY This organisation is a global leader in B2B data and business intelligence, operating across 200+ countries and supporting industries such as fintech, compliance, and fraud prevention. Backed by private equity ...

Finance Data Design Lead - Insurance Transformation Contract | Outside IR35 | London (Hybrid) We are supporting a large-scale insurance transformation programme entering a critical delivery phase and are looking to engage an experienced Finance Data Design Lead. This role sits at the centre of delivery, bridging architecture … engineering, and will play a key part in shaping and implementing complex finance and actuarial data solutions. The Role You will be responsible for translating high-level architecture into detailed, implementable designs across finance, actuarial and regulatory reporting data domains. Designing finance data models ...

exciting opportunity for a Data Engineer (GCP) to join a fast-growing business in London is looking for a hands-on engineer to support and evolve their data platform. Based in London 2 days a week in the office 3 months initially Start date: ASAP … Outside Ir35 The Job As the Data Engineer (GCP), your responsibilities will include: Managing and optimising data pipelines and workflows within Google Cloud Platform Working extensively with BigQuery to process large-scale datasets Integrating and managing data from Google Analytics and Google Ad Manager ...

Java script Back-end: Expertise in C# .NET Core, REST APIs, and microservices-based development is essential Python (pyspark): Experience with data pipelines and analytics is a plus. Power BI: Familiarity with developing dashboards and data models. Architecture: Knowledge of microservices, API design, and event-driven ...

Analytics Engineer Farringdon, London/HYBRID UP TO £60,000 Overview This is a standout opportunity to join a growing data function at an organisation where data is becoming central to how the business operates. You will step into a highly visible role with real influence … owning end to end delivery across data pipelines, modelling, and reporting while helping to shape standards and ways of working from an early stage. The Company They are a globally operating design and professional services organisation delivering complex projects across a wide range of sectors. Headquartered in London ...

travel ally. (Ambitious? 💪 Yes, but, hey, that's what got us here) About the role Hybrid You'll step into a pivotal Data Engineering Manager role within our Audience Experience tribe, helping power how millions of travellers discover, engage with and return to Skyscanner. Sitting within Paid Marketing … Marketing Technology, you'll lead the team behind the data that drives smarter marketing investment and fuels global audience growth. This is where people leadership meets deep data engineering expertise. You'll be just as comfortable shaping a high-performing, happy team as you are thinking ...

Role: Senior Azure DevOps Engineer (Kafka) Location: Remote (UK) Salary: £75k + 10% Bonus Key Skills: Azure Terraform Kubernetes Kafka Data platforms Overview We're partnering with a fast-growing SaaS organisation building a modern, data-driven platform that powers better insight into behaviour, performance … They're scaling their platform capability and are now looking for a Platform Engineer to help design, build, and evolve their cloud and data infrastructure. This is a hands-on role spanning cloud infrastructure, DevOps, and data platform engineering. The Role You'll work across Azure ...

architecture, including model strategy, orchestration frameworks, APIs, and integration standards. Establish architectural patterns for Generative AI, agentic systems, retrieval-augmented generation, and data pipelines at scale. Lead the selection and optimisation of the AI technology stack, balancing capability, cost, risk, and vendor considerations. Drive the adoption of shared ...

Title: Senior Manager, Data Acquisition & Partnerships Location: London The Opportunity Our client is a fast scaling maritime intelligence software company at the centre of global trade, using satellite powered geospatial data and advanced AI to help governments and commercial operators see, understand and act on what … scalable and commercially disciplined asset. Design and implement the operating framework that enables delivery of a rapidly growing, high value satellite data pipeline without loss of quality or control. Turn flagship partners with large salesforces and customer bases into effective routes to market for the company ...

days onsite, London) Position Type: Permanent Salary: £50,000 - £60,000 per annum + Benefits Experience Required: 6-8 years in Data Integration/ETL About the Role Are you a seasoned Data Integration specialist with deep expertise in cloud ecosystems? We are seeking a Senior … modern data warehouses like Snowflake or Databricks . Performance Tuning: Act as the senior technical lead for debugging, advanced error handling, and pipeline optimization to ensure high scalability and performance. Collaboration: Partner closely with Solution Architects and Business Analysts to translate complex requirements into technical realities, ensuring ...

days onsite, London) Position Type: Permanent Salary: £50,000 - £60,000 per annum + Benefits Experience Required: 6-8 years in Data Integration/ETL About the Role Are you a seasoned Data Integration specialist with deep expertise in cloud ecosystems? We are seeking a Senior … modern data warehouses like Snowflake or Databricks . Performance Tuning: Act as the senior technical lead for debugging, advanced error handling, and pipeline optimization to ensure high scalability and performance. Collaboration: Partner closely with Solution Architects and Business Analysts to translate complex requirements into technical realities, ensuring ...

Voila, Power BI, GitHub, Vue, Nuxt AEC Platforms & Standards: Revit, Revit API, pyRevit, Rhino, Grasshopper, IES VE (and it’s Python API), BIM data standards (IFC, COBie) Cloud & Infrastructure: AWS/Azure, Git, Ansible Extract, Transform and Load (ETL) Responsibilities Key responsibilities of the roleIn addition … plugins that integrate with AEC platforms (e.g. Revit, Rhino, IES). To support the Director responsible in developing the technical strategy for data and software initiatives aligned with the practice’s digital transformation goals. Designing and implementing data pipelines and analytics dashboards to support project performance ...

reliability, scalability, and operational integrity of our machine-learning systems in research & production. This role sits at the intersection of data engineering and ML infrastructure: youll design and operate data pipelines that feed models, and youll build the tooling that trains, deploys, monitors, and retrains them. … lifecycle infrastructure Productionizing models: packaging, deployment, versioning, and rollback Designing CI/CD pipelines for ML (training validation deployment) Implementing model monitoring (data drift, prediction drift, performance decay) Managing experiment tracking and reproducibility Data engineering foundations Building and maintaining batch and nearreal-time data ...

distributed training (DeepSpeed/FSDP/SLURM/K8s). Experience in deep learning, NLP or LLMs; bonus for CUDA or data‐pipeline chops. Strong software‐design instincts: testing, code review, CI/CD. Self‐starter, low‐ego, collaborative. Benefits France 💰 Competitive cash salary and equity 🥕 Food ...

experiences What will the Senior Product Engineer bring? Strong backend development expertise with Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building ...

Azure AI Foundry, Azure OpenAI, AI Search, agents and RAG patterns. Strong practical knowledge of databases, including SQL and NoSQL platforms, schema design, data access patterns, query performance and secure data handling. Ability to design, build and review maintainable code while following agreed coding standards, architectural …/CD workflows, branching strategies, pull requests and automated testing using tools such as Playwright. Experience with Microsoft Fabric, Lakehouse architecture, data pipelines or analytics engineering would be beneficial, especially where data needs to be prepared for reporting, automation or AI use cases. Role Build ...

Data Engineer - SC Cleared UK (Remote/Hybrid) | £490 per day | 6 Months | Inside IR35 We're seeking an experienced SC Cleared AWS Data Engineer to support a high-profile Central Government programme delivering critical data capabilities within a secure cloud environment. This … excellent opportunity to contribute to nationally significant work while leveraging modern AWS and data engineering technologies. Key Responsibilities Design, build, and optimise scalable cloud-based data pipelines on AWS Develop and maintain robust ETL processes to support complex data integration requirements Implement and manage ...