1 to 25 of 1,690 Data Pipeline Jobs in the UK

Azure Data Platform Manager Putney, London | Hybrid £85,000+ Bonus + Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with a strong background designing and delivering enterprise-scale Azure data platforms? We're looking for an experienced Azure Data Platform Manager to lead the design, development and optimisation of a modern Azure Data Platform ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities: Data Pipeline Development & Optimisation: o Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various … both technical and non-technical audiences. o Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. o Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain. Solid understanding of commodities data ...

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Kaluza's evolving data & architecture strategy - they build and own the infrastructure, tooling and governance for Kaluza's internal data pipeline, from data ingestion, data cataloguing to data storage and exposing data externally. What will … pipelines, strategic data architectural decisions, and high-quality "data mart" objects across functions like product, finance, or strategy. Pipeline Specialist: You possess extensive experience in engineering robust ETL/ELT processes and data pipelines, with a focus on curating, transforming ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Role Profile Job Title: Data Engineering & Insights Manager (Hybrid Working Policy) 2 days a month. Reports To: Chief Innovation Officer Role Purpose The Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside … delivery of high-quality, business-ready insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted ...

level proficiency in SQL for complex data transformation, optimization, and analytical workload development Advanced proficiency in Python for data engineering, pipeline automation, and integration development Deep expertise in PySpark for data processing and transformation Proven mastery of cloud platforms with strong preference … Microsoft Azure Expertise in ETL/ELT development and data pipeline orchestration (e.g. Databricks Workflows, DLT, ADF) Extensive experience with Git version control, GitHub collaboration workflows, and modern CI/CD practices including automated testing frameworks and deployment pipeline automation for data engineering workloads ...

Senior Technical Consultant - Data Architect London, UK Job Description Posted Tuesday 25 August 2026 at 00:00 | Expires Wednesday 30 September 2026 at 23:59 Job Role: Data Architect Working Structure: Hybrid (Regular visits to client site) Career Grade: Senior Technical Consultant The role … Data Architect at CACI Information Intelligence Group, you will join a community of dedicated engineers delivering cutting-edge data solutions for our public sector customers across Central Government, Defence, National Security, Critical National Infrastructure and Law Enforcement. This role is focused on architecting and delivering modern ...

lifecycle and mentors others in the team. Experience working on large and complex projects, programmes and products spanning multiple geographical locations, ideally including data, analytics, AI, automation or digital product delivery. Proven experience of working with a wide range of business stakeholders including lawyers, Partners or heads … function. Technical knowledge to interface confidently with delivery teams, architects, data engineers, data analysts and data scientists. With an understanding of some key data concepts such as structured and unstructured data, data visualisation, data taxonomy, data ...

Asset Alliance Group - Head Of Data & Analytics Asset Alliance Group is part of the Arbuthnot Latham Banking Group. We serve the commercial vehicle, bus, coach, and general asset finance sectors with tailored award-winning lending, contract hire, rental and finance packages. We are a full-service finance … incidents. Providing vision and direction to the Platform development team and stakeholders throughout projects and creating customer focussed outcomes. Planning and managing the pipeline of activity for the team (both engineering, analytics, governance and change disciplines) in order to optimise resource capacity and workloads, whilst securing timely engagement ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations … utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex ...

safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations … utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex ...

Manager - AI & Data Architect £70,000 to 90,000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Manager - AI & Data Architect Location: London | Hybrid Salary: Up to £90,000 + bonus We're working with a leading change and transformation consultancy … that is looking to hire an experienced AI & Data Architect into its Technology & Data practice. This is an excellent opportunity for a Data Architect from a consultancy background who enjoys working directly with clients, solving complex business problems and designing modern, scalable data ...

## Lead Product Performance Data Analyst, GlobalApply: London, England: Full time: Posted Today: R24596# **About Vantage**Vantage powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large enterprises. Developing and operating across North America, EMEA and Asia Pacific, Vantage … including Pandas, NumPy or similar libraries.* Experience with ETL/ELT workflows, automated validation routines, controlled data refreshes, or data pipeline documentation.* Exposure to benchmarking, normalization, regional factors, configuration bridges, confidence frameworks, or variance attribution.* Experience working with Developers and IT to translate dataset requirements ...

about making a positive impact, we'd love to have you on our team. About the role We are seeking a Data Pipeline Manager to join the team at Valpak on a permanent basis. This role offers primarily remote working, with occasional travel to our Stratford-upon … Avon office, typically once per quarter. As the Data Pipeline Manager, you will lead a team of 2 responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data ...

ensuring the seamless delivery of data solutions. Looking ahead to future opportunities. As our business continues to grow, we are building a pipeline of exceptional talent for upcoming positions across the UK. This advertisement is intended to identify and engage candidates in advance of specific vacancies becoming … apply if you would like to be considered for future opportunities that match your expertisePrimary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Snowflake & Cloud Data Platforms Data Architecture & Modelling Collaboration & Best Practices Quality, Governance & SecurityBusiness Relationships Solution Architects Data ...

Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data migration, ETL/ELT pipeline engineering, and cloud-native data platforms, with a strong focus on AWS-based Data Lakehouse architectures. This role is critical … maintain ETL/ELT pipelines using: AWS GluePython/PySparkSQLYAML-driven configurationsImplement bulk data migration processes followed by incremental/delta loadsSupport pipeline repointing and replatforming to target cloud architecturesData Pipeline Testing & Validation (Core Focus)Test end-to-end ETL data solutions running ...