1 to 25 of 1,750 Data Pipeline Jobs in the UK

Azure Data Platform Manager Putney, London | Hybrid £85,000+ Bonus + Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with a strong background designing and delivering enterprise-scale Azure data platforms? We're looking for an experienced Azure Data Platform Manager to lead the design, development and optimisation of a modern Azure Data Platform ...

DescriptionWe're passionate about using technology to drive sustainability. You too? Join us as a Data Architect for Technology Architecture at Ramboll Tech and help us become the leading Tech-Enabled Partner for Sustainable Change. We are seeking an experienced and results-driven Data Architect … integration with engineering systems (Great to have skill) Advanced knowledge of data modelling tools, data lakes, SQL, and pipeline design Excellent communication and interpersonal skills, with the ability to convey technical concepts to non-technical stakeholders Proficient in Microsoft Fabric platform (Great ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain. Solid understanding of commodities data ...

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data migration, ETL/ELT pipeline engineering, and cloud-native data platforms, with a strong focus on AWS-based Data Lakehouse architectures. This role is critical … maintain ETL/ELT pipelines using: AWS GluePython/PySparkSQLYAML-driven configurationsImplement bulk data migration processes followed by incremental/delta loadsSupport pipeline repointing and replatforming to target cloud architectures Data Pipeline Testing & Validation (Core Focus) Test end-to-end ETL data ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

divisional implications. As Vanguard continues to expand its Environmental, Social, and Governance (ESG) capabilities, the need for high-quality, scalable, and interconnected ESG data has never been greater. This role offers a unique opportunity to help shape the future of enterprise data products supporting investment, stewardship … risk, compliance, and reporting outcomes across the firm. We are seeking a Technical Product Manager who is passionate about solving complex data challenges and building products that create value across multiple business domains. In this role, you will partner closely with the ESG Data Product Family ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Kaluza's evolving data & architecture strategy - they build and own the infrastructure, tooling and governance for Kaluza's internal data pipeline, from data ingestion, data cataloguing to data storage and exposing data externally. What will … pipelines, strategic data architectural decisions, and high-quality "data mart" objects across functions like product, finance, or strategy. Pipeline Specialist: You possess extensive experience in engineering robust ETL/ELT processes and data pipelines, with a focus on curating, transforming ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI.We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps).Expertise in data ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Role Profile Job Title: Data Engineering & Insights Manager (Hybrid Working Policy) 2 days a month. Reports To: Chief Innovation Officer Role Purpose The Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside … delivery of high-quality, business-ready insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted ...

level proficiency in SQL for complex data transformation, optimization, and analytical workload development Advanced proficiency in Python for data engineering, pipeline automation, and integration development Deep expertise in PySpark for data processing and transformation Proven mastery of cloud platforms with strong preference … Microsoft Azure Expertise in ETL/ELT development and data pipeline orchestration (e.g. Databricks Workflows, DLT, ADF) Extensive experience with Git version control, GitHub collaboration workflows, and modern CI/CD practices including automated testing frameworks and deployment pipeline automation for data engineering workloads ...

Senior Technical Consultant - Data Architect London, UK Job Description Posted Tuesday 25 August 2026 at 00:00 | Expires Wednesday 30 September 2026 at 23:59 Job Role: Data Architect Working Structure: Hybrid (Regular visits to client site) Career Grade: Senior Technical Consultant The role … Data Architect at CACI Information Intelligence Group, you will join a community of dedicated engineers delivering cutting-edge data solutions for our public sector customers across Central Government, Defence, National Security, Critical National Infrastructure and Law Enforcement. This role is focused on architecting and delivering modern ...

Closing date: 2026-10-18Location: CardiffSalary: Competitive Salary DOE (per annum)Job type: PermanentWorking pattern: Full timeIndustry: Banking & Financial Services/Data & Advanced AnalyticsCompany: HaysConsultant: Adam SinclairHays office: London-City — 5th Floor, 107 Cheapside,Phone: 0333 010 6203Email: adam.sinclair@hays.comRole ProfileJob Title: Data Engineering & Insights … Manager (Hybrid Working Policy) 1 day a week. Reports To: Chief Innovation OfficerRole PurposeThe Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside the delivery of high-quality, business-ready insights that support strategic decision ...

Asset Alliance Group - Head Of Data & Analytics Asset Alliance Group is part of the Arbuthnot Latham Banking Group. We serve the commercial vehicle, bus, coach, and general asset finance sectors with tailored award-winning lending, contract hire, rental and finance packages. We are a full-service finance … incidents. Providing vision and direction to the Platform development team and stakeholders throughout projects and creating customer focussed outcomes. Planning and managing the pipeline of activity for the team (both engineering, analytics, governance and change disciplines) in order to optimise resource capacity and workloads, whilst securing timely engagement ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

scalable solutions. Participate in code reviews, technical discussions, and platform improvement initiatives as an active contributor. Proactively identify data quality issues, pipeline risks, and improvement opportunities, and communicate them clearly in a fast‐paced environment. DutiesDevelop and maintain PySpark notebooks and jobs to ingest, transform, and curate … workflows, including use of PySpark. Proficiency in SQL for querying, transformation, and analytical data processing. Solid understanding of ETL/ELT pipelines, data transformation patterns, and data integration concepts. Experience analyzing enterprise data sources to identify data relationships, transformations ...

safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations … utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex ...

safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations … utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex ...

Manager - AI & Data Architect £70,000 to 90,000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Manager - AI & Data Architect Location: London | Hybrid Salary: Up to £90,000 + bonus We're working with a leading change and transformation consultancy … that is looking to hire an experienced AI & Data Architect into its Technology & Data practice. This is an excellent opportunity for a Data Architect from a consultancy background who enjoys working directly with clients, solving complex business problems and designing modern, scalable data ...