101 to 125 of 1,537 Data Pipeline Jobs in London

Soho, London Hybrid working: 3 days in the office Tues - Thurs The Role We are seeking a Data Engineer to join our Data Team, playing a vital part in building the complex, scalable systems that power our data strategy. You will contribute to architectural … Explore ways to enhance data infrastructure and contribute to the development of new data products. Provide second-line support for pipeline failures or data quality incidents and perform fault analysis to resolve issues. Contribute to system-design decisions and help develop data ...

navigate the resulting measurement challenges Experience working with advertising platform APIs (Google Ads, Meta Ads) for data extraction and pipeline automation Familiarity with GCP data services and event analytics platforms (Mixpanel or equivalent) Demonstrable experience building data products and self-serve reporting assets … models Understanding of CI/CD practices for data pipelines Experience with Python for data manipulation, modelling, and pipeline work Whats In It For You Join a fast-growing, award-winning company with genuine ambition to improve people's financial lives Work ...

navigate the resulting measurement challenges Experience working with advertising platform APIs (Google Ads, Meta Ads) for data extraction and pipeline automation Familiarity with GCP data services and event analytics platforms (Mixpanel or equivalent) Demonstrable experience building data products and self-serve reporting assets … models Understanding of CI/CD practices for data pipelines Experience with Python for data manipulation, modelling, and pipeline work Whats In It For You Join a fast-growing, award-winning company with genuine ambition to improve people's financial lives Work ...

Data & AI Architect Manager £90000 GBP Onsite WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Manager - AI & Data Architect | Up to £90k | London I'm working with a leading global change and transformation consultancy that is growing its Technology & Data practice. They … looking for a Manager-level AI & Data Architect to lead the design and delivery of modern data solutions, working across complex transformation programmes and directly with senior client stakeholders. The role will cover: • End-to-end data architecture across ingestion, processing, storage and analytics ...

status, or any basis prohibited by the laws that govern its operations. How does this role contribute to our collective success? As a Data Quality Business Partner within AXIS, you will support the Data & Analytics Transformation programme, which aims to replace our legacy data estate and modernise it through a new data platform. Your role will focus on helping ensure the integrity, accuracy, and usability of data across the organisation. Working closely with technical teams and business stakeholders, you will apply data quality best practices ...

leads to deliver engineering work that raises the quality and capability of the entire practice. What You'll Do: Cloud Engineering & ETL/ELT Pipeline Development Build, maintain, and improve ELT/ETL pipelines that ingest billing, usage, and tagging data from AWS, Azure, and GCP into … CBRE's centralized FinOps data store, applying modern pipeline patterns including event‐driven ingestion, incremental loading, and change data capture. Design and implement layered data models and transformation logic (raw, conformed, aggregated) using tools such as dbt, Spark, and cloud‐native processing services ...

Cloud Data Engineer (Python) Up to £54,150 per annum + excellent pension | Hybrid working | London, Manchester, Cardiff, Belfast, Edinburgh or Darlington Are you an experienced Data or Software Engineer with hands-on experience of: Python and end to end Cloud deployment, looking for a role … where your work can make a real difference? Our Government client is looking for a Data Engineer to join its Data, Technology and Insights (DTI) unit on a 12-month fixed-term contract . Youll join a multidisciplinary team of data engineers, data ...

Senior Data Engineer Microsoft Azure data This is a new and exclusive opportunity for a Senior Data Engineer with strengths in Microsoft Azure data to be a key lead in strengthening, evolving, and modernising our core data platforms. Job details … Title: Senior Data Engineer Technical Stack: Microsoft Azure data Location: London or Glasgow with 1 day a week in the office Permanent role salary £80,000- £100,000 Requirements: Strong experience as a Senior Data Engineer in enterprise data environments. Technical stack ...

anodyne version. Bonus points if you can find the more analeptic version. And provide proof of your quest. Good luck! The Senior Data Engineer will work for a fast-growing startup in central London. The Senior Data Engineer will earn £130,000+ and equity. The Senior … Data Engineer will work 4+1. We're building a product and a culture. The Senior Data Engineer will have huge autonomy, ownership and accountability. The Senior Data Engineer will pair with BackEnd and AI Engineering teams to support the product roadmap. The Senior Data ...

company. Job Description: About the RoleWe are looking for a Head of Engineering to own the technical roadmap for our enterprise-scale data and AI infrastructure. You will lead a multi-disciplinary engineering organisation, set data platform and cloud architecture direction, and act as the bridge … matrixed organisation. Industry experience working with Data platforms is essential, with strong background in dimensional data modelling, data pipeline development and data engineering in support of web applications. Strong hands-on background in modern cloud data platforms (e.g. Databricks ...

future of gaming. Are you ready to LEVEL-UP THE GAME? Focusing on our Sportsbook product, we’re looking for a Senior Data Engineer to help build and evolve our next-generation data platform, powering trusted, scalable, and real-time data assets across multiple … brands and markets. You’ll primarily work on our Sportsbook Data Platform — a modern, event-driven lakehouse built on AWS and aligned to medallion architecture principles — delivering high-quality, well-governed data products that support analytics, trading insight, and machine learning use cases. This platform underpins ...

combined with the architectural judgement to make enterprise-grade design decisions independently — with full autonomy over schema, ingestion patterns, data standardisation, and pipeline architecture — in a complex, multi-source, globally scaled environment. What you'll be doing: Pipeline Design & Delivery: Lead the design and implementation … regulatory use cases. Technical Decision Authority: Make day-to-day architectural and design decisions independently — on schema design, data standardisation approaches, and pipeline patterns — reducing escalation to senior leadership and enabling faster, higher-confidence delivery. Regulatory & Compliance Enablement: Ensure pipelines and data models are designed ...

events that have a financial impact on Checkout.com and our merchants. Our team is responsible for maintaining an accurate record of all financial data, the data integrity of our systems and ensuring our infrastructure meets regulatory and compliance obligations in a scalable, reliable and fault-tolerant … pipelines to process data from our systems, services and applications. Implement monitoring and alerting frameworks to ensure data pipeline performance and reliability. Partner with other analytics engineers to design and implement scalable data models that support downstream business operations and analytical ...

Soho, London Hybrid working: 3 days in the office Tues - Thurs The Role We are seeking a Senior Data Engineer to join our Data Team, taking a leading role in building the complex, scalable systems that power our data strategy. You will lead architectural … technologies, setting technical direction where they can enhance data infrastructure or enable new data products. Lead the resolution of critical pipeline failures and data- quality incidents, performing fault analysis and ensuring that preventative improvements are implemented. Lead critical system- design and architectural decisions ...

OpportunityJoin a team building the data foundations that support the firm's AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data use across … including version control, testing, release discipline and CI/CD practices. Data Engineering CapabilityStronger ownership of technical design across multiple datasets or pipeline domains. Experience guiding implementation standards, code quality and engineering practices within a team. Ability to lead delivery for a workstream, manage dependencies and support ...

Description As a Senior Data Engineer, you’ll focus on designing and implementing scalable, reusable data pipelines, platform components, and data engineering standards that enable reliable, secure, and high‐quality data solutions across the organisation. You’ll work closely with Data … embedded in product teams such as Forecasting, Recommendations, Marketing, Customer, and Pricing—helping them accelerate delivery and improve the quality and accessibility of data by providing a robust and standardised data platform experience. What you’ll be doing Designing, building, and maintaining scalable data ...

opportunity We are investing in the next generation of our data and technology capabilities to create more connected, intelligent experiences for customers. Data is central to this ambition. This is an opportunity to define the architecture, standards and delivery patterns for a modern data platform that will enable trusted data use across products and support advanced analytics and AI. The Principal Data Architect will be the senior technical authority for data architecture within this strategic transformation. The role is architecture-led while remaining practically engaged through ...

Project description This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue — a foundational shift in how one of the world's largest financial market infrastructure companies … Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR) Implement data quality checks, validation, and reconciliation processes Optimize pipeline performance and manage compute/storage costs Ensure data security and access control (IAM, KMS, encryption) Monitor and troubleshoot pipeline failures (CloudWatch ...

Principal Data Architect will be the senior technical authority for data architecture within this strategic transformation. The role is architecture-led while remaining practically engaged through prototyping, proof-of-concepts, technical reviews and the resolution of complex engineering challenges. As the capability grows, the remit … expand to include leadership of a small team. Define and own the target data architecture, standards, reference patterns and technical roadmap for a strategic enterprise data capability. Design a modern Databricks lakehouse foundation that enables secure, scalable use of data across a complex product ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. The role will focus on designing and building robust data pipelines, migrating data from a wide range of legacy and enterprise … source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where applicable. Key Skills & Experience Azure Data Engineering Azure Data ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands-on exposure to: ☁️ AWS cloud & migration 🐍 Python development 🗄️ SQL, databases & data platforms 🔄 Data pipelines & ETL/ELT 🔌 APIs & backend engineering 🚀 CI/CD & production systems 📊 Analytics & modern data platforms 🤖 AI/ ...

mitigate risk, and scale with efficiency and confidence. To learn more about Comply, visit comply.com The Role We are looking for Senior AI Data Engineers to implement and operationalize Comply’s semantic layer — turning the ontological models defined by our ontologist and architects into working knowledge graphs, vector … data pipelines. Familiarity with semantic web standards — JSON‐LD, RDF, OWL, or SKOS. Strong Python skills and experience with data pipeline frameworks. Experience with cloud‐native data platforms (AWS, Azure, or GCP). Exposure to domain‐driven design (DDD) and bounded contexts ...

Senior Data Engineer Microsoft Fabric Azure data This is a new and exclusive opportunity for a Senior Data Engineer with strengths in Microsoft Azure data to be a key lead in strengthening, evolving, and modernising our core data platforms. … details Title: Senior Data Engineer Technical Stack: Microsoft Azure data Location: London or Glasgow with 1 day a week in the office Industry: STEM Technology Permanent role salary £50- £70,000 dependant on skills and location Requirements: Strong experience as a Senior Data Engineer ...

Role Description The Technical Analyst – Data Lineage will support a Data Governance, Controls, and Reporting program for a top-tier banking client. Responsible for establishing and validating end-to-end lineage across critical datasets used in operational and regulatory reporting. Translate governance and reporting requirements into … Produce and maintain Source-to-Target Mapping (STTM) documentation and metadata standards. Validate lineage accuracy by tracing logic through SQL/Spark transformations and pipeline configurations. Support impact analysis for proposed changes (upstream/downstream dependencies, report impact, control impact). Partner with engineers and platform teams to improve ...

free to ask us! Location : Chiswick, London - Hybrid Sponsorship : We are unable to offer sponsorship for this role The Role As a Senior Data Engineer, you will play a key role in the development and maintenance of our data infrastructure, ensuring efficient and scalable data … highly favourable. Advanced knowledge of SQL for complex data transformation and query optimization. Proven experience in Python for scalable data pipeline development and orchestration following best practices. Experience implementing Terraform for Infrastructure as Code (IaC) to automate GCP resource management. Knowledge of CI/ ...