1 to 25 of 556 Data Pipeline Jobs in London

standards, and delivery excellence. Coach offshore data engineering teams to understand the rationale for technical approaches in data architecture and pipeline design, surfacing and dealing with ambiguity and conflicting demands, escalating appropriately to resolve prioritization conflicts. Build collaborative relationships with Data Scientists, Data … cost management and optimization Knowledge of data quality frameworks, data governance practices, and metadata management Understanding of data pipeline architecture, ETL/ELT patterns, and data modeling principles Familiarity with infrastructure as code (Terraform) and CI/CD for data ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

life balance. That’s waiting for you at Sainsbury’s. Think about the scale it takes to feed the nation. The level of data, transactions and variety involved. Then you’ll realise this is a modern software engineering environment, because it has to be. We’ve made significant … standards, and delivery excellence. Coach offshore data engineering teams to understand the rationale for technical approaches in data architecture and pipeline design, surfacing and dealing with ambiguity and conflicting demands, escalating appropriately to resolve prioritization conflicts. Build collaborative relationships with Data Scientists, Data ...

Select how often (in days) to receive an alert: Create Alert Competitive salary | UK: hybrid: London + remote At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company … analytics. Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions. Optimize data pipeline performance, scalability, reliability, and data quality. Implement data governance, validation, and security best practices. Troubleshoot production data issues ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … warehousing concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Kaluza’s evolving data & architecture strategy - they build and own the infrastructure, tooling and governance for Kaluza's internal data pipeline, from data ingestion, data cataloguing to data storage and exposing data externally. What will … pipelines, strategic data architectural decisions, and high‐quality "data mart" objects across functions like product, finance, or strategy. Pipeline Specialist: You possess extensive experience in engineering robust ETL/ELT processes and data pipelines, with a focus on curating, transforming ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

observable data pipelines supporting critical Commodities datasets Modernize legacy workflows, reduce technical debt, and improve performance, reliability, and maintainability. Design automated pipeline controls for validation, monitoring, schema change, exception handling, and data integrity. Develop workflow orchestration, alerting, observability, and remediation processes. Translate business and client … Finance or other STEM related field or degree‐equivalent qualifications 4+ years of experience designing and building scalable data solutions, ETL pipelines, data workflows, and monitoring frameworks. Strong hands‐on experience with Python or similar programming/scripting languages. Experience with querying structured, semi‐structured ...

About the Role An established professional services organisation is seeking a Data Engineer with experience in enterprise data platforms, data analysis and data architecture to join its growing Data Services function. The successful candidate will support the delivery … modern Reporting & Analytics programme by designing, developing and maintaining an enterprise data platform. The role focuses on building scalable data solutions, ensuring reliable data movement from operational systems into a Snowflake environment, and developing robust data models that underpin enterprise reporting ...

Data Engineer Location: London (Hybrid) Salary: Up to £75,000 + Bonus + Benefits Technology: SQL, Python, Spark - Azure, AWS, GCP - ETL/ELT - Data Governance The Opportunity Are you a Data Engineer looking for an opportunity to work on large-scale data transformation programmes whilst helping shape enterprise-wide data strategy? We're partnering with an organisation that is making significant investments in its data capabilities and digital transformation journey. Data sits at the heart of business decision-making, making this an excellent opportunity ...

capital and derivative valuation adjustments. Using the latest analytics and technology such as a fully vectorized pricing library, Machine Learning, and a Big Data stack for scalability, our products and solutions are used by the largest tier-one banks to smaller niche firms. Our risk analytics solutions … London to join the Market Data and Integration team within Risk Analytics. The role will focus on workflow design, data pipeline requirements, integration patterns, validation controls, and operational improvements that support scalable risk analytics delivery. Responsibilities The Senior Product Analyst will work with product, financial ...

capital and derivative valuation adjustments. Using the latest analytics and technology such as a fully vectorized pricing library, Machine Learning, and a Big Data stack for scalability, our products and solutions are used by the largest tier-one banks to smaller niche firms. Our risk analytics solutions … London to join the Market Data and Integration team within Risk Analytics. The role will focus on workflow design, data pipeline requirements, integration patterns, validation controls, and operational improvements that support scalable risk analytics delivery. Responsibilities The Senior Product Analyst will work with product, financial ...

Senior Data Manager £90k - £120k per annum + Bonus and Benefits London, Manchester or Glasgow/Hybrid Are you ready to help organisations transform how they use data and AI? Do you thrive on designing cloud-native platforms, solving complex technical challenges and turning emerging … technologies into real business value? This is your chance to join a market-leading technology consultancy at the forefront of Data & AI transformation. You'll work with major organisations to design and deliver next-generation data platforms that enable AI, advanced analytics and intelligent automation, while ...

Data Pipeline & Systems Manager (Digital Marketing) Salary: £45,000 - £55,000 Employment Type: Full time Location: Camden (London), 2 days a week in the office This is a fantastic opportunity for a data-minded professional who wants to own the infrastructure behind a growing marketing … impact organisations, sustainable brands, or arts & cultural institutions. Whatever the cause, we help clients do good, better. What does being a Data Pipeline & Systems Manager at ethix look like? You'll own the agency's data pipeline end to end: pulling data ...

Will Be Working WithThe Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Data Platforms is the home of the Data Engineers, Platform Engineers … Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms.We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP along with various data platforms like Databricks, Snowflake, Quantexa ...

Data Architect Shape the future of enterprise data architecture within a modern cloud environment. We are seeking an experienced Data Architect to play a key role in designing, developing, and evolving a modern data platform. This position offers the opportunity to drive … strategic data initiatives, implement Data Mesh principles, and help create scalable, secure, and high-performing data solutions that support business growth. The Role As a Data Architect, you will be responsible for defining and governing data platform architecture, ensuring data ...

observable data pipelines supporting critical Commodities datasets Modernize legacy workflows, reduce technical debt, and improve performance, reliability, and maintainability. Design automated pipeline controls for validation, monitoring, schema change, exception handling, and data integrity. Develop workflow orchestration, alerting, observability, and remediation processes. Translate business and client … Finance or other STEM related field or degree‐equivalent qualifications 4+ years of experience designing and building scalable data solutions, ETL pipelines, data workflows, and monitoring frameworks. Strong hands‐on experience with Python or similar programming/scripting languages. Experience with querying structured, semi‐structured ...

About the Role We are seeking an experienced Data Engineer with deep expertise in Snowflake to join a growing Data & Analytics function. This is an exciting opportunity to play a pivotal role in designing, developing and optimising an enterprise data platform that underpins business … intelligence, reporting and analytics across the organisation. The successful candidate will be responsible for building scalable, high-performance data solutions within Snowflake , designing robust data architectures, and developing modern data pipelines that transform data into trusted, business-ready information. This role will ...

sends, logistics, offers, and reporting, but also the analytical core that makes it work, building the response model and sourcing the data pipeline and user-data enrichment that let us target the right customer, with the right offer, at the right moment. … modelling, automation) Desirable Experience in financial services, regulated or other consumer categories where offers and eligibility matter Experience standing up a data pipeline or enrichment stack (first-party + third-party/bureau data) Experience building a channel or function from scratch Familiarity with credit ...

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience ...

Director of Data and AI Department: Platform Employment Type: Permanent Location: London Reporting To: James Complin Description We’re seeking a strategic Director of Data and AI to lead, develop, and empower our Data and AI teams. This role balances leadership with technical excellence … define how data, analytics, machine learning, and generative AI enable the wider business. You’ll work closely with senior stakeholders, translating business objectives into a clear Data and AI strategy, and ensuring the team delivers scalable, trusted, secure, and commercially impactful solutions. The ultimate goal will ...

SENIOR DATA ENGINEER Salary up to £100,000 + Equity London-based role - hybrid working with 4 days per week in the office Join a fast-growing technology business building modern, cloud-based data platforms Develop scalable data infrastructure using Python, SQL and cloud … technologies Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're recruiting for a Senior Data Engineer to join an ambitious technology business with exciting expansion plans. You'll work as part of a collaborative engineering team, helping to design and deliver ...

# AWS Data Solution ArchitectBirmingham, Bristol, Newcastle Bank House, Manchester, LondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 466372-en\_GB## **Who You'll Be Working With**As an AWS Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data driven decision making at scale. You will translate business strategy into robust, governed, and AI ready architectures, taking end to end ownership from vision through to delivery and value realisationYou will be part of the Data ...

Ataccama is the agentic data trust company. Organizations worldwide rely on Ataccama ONE, the agentic data trust platform, to ensure data is accurate, accessible, and trusted for every decision and system. Powered by the ONE AI Agent, Ataccama ONE brings autonomy to data quality and governance, continuously monitoring, improving, and explaining the reliability of data across complex enterprise and multi-agent environments. At the core of the platform is Ataccama’s market-leading data quality, with modules built around it to unify data quality monitoring ...

Senior Data Engineer Up to £75,000 - London (3 days in office) We are partnering with a global consulting and technology services organisation that delivers large-scale digital, data and AI transformation programmes for enterprise clients across a range of industries. Due to continued growth within … Data & Analytics practice, the organisation is looking to hire a Senior Data Engineer to take a leading role in designing, developing and optimising modern enterprise data platforms. This is an excellent opportunity to join a highly skilled team delivering complex data transformation ...