1 to 25 of 2,684 Data Pipeline Jobs in the UK

Azure Data Platform Manager Putney, London | Hybrid £85,000+ Bonus + Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with a strong background designing and delivering enterprise-scale Azure data platforms? We're looking for an experienced Azure Data Platform Manager to lead the design, development and optimisation of a modern Azure Data Platform ...

DescriptionWe're passionate about using technology to drive sustainability. You too? Join us as a Data Architect for Technology Architecture at Ramboll Tech and help us become the leading Tech-Enabled Partner for Sustainable Change. We are seeking an experienced and results-driven Data Architect … integration with engineering systems (Great to have skill) Advanced knowledge of data modelling tools, data lakes, SQL, and pipeline design Excellent communication and interpersonal skills, with the ability to convey technical concepts to non-technical stakeholders Proficient in Microsoft Fabric platform (Great ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain. Solid understanding of commodities data ...

Engineer DUAL Personal Lines’ strategic data platforms, especially the Data Lakehouse Provide technical expertise in data engineering, analysis, orchestration, and enrichment Build data solutions to address changing requirements, new requests, and incidents Build, test, and deploy data products while maintaining … governance, change control, accountability, data quality, and data security Consult business analysts, developers, and system owners to maintain agreed data standards Assess the impact of changes on the data model and prevent issues affecting operational, analytical, and reporting environments Collaborate with data ...

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

Contract Data Engineer - £375/day Inside IR35 - Immediate Start Please note - this is a hybrid role with 2-3 days per week required in London based office. You must have the unrestricted right to work in the UK to be eligible for this role - this organisation … data modelling, including schema design, partitioning, indexing, and performance optimisation. Proven experience with Azure Data Factory for ETL/ELT pipeline design, orchestration, and monitoring. Strong SQL skills, including queries, stored procedures, views, and performance tuning. Practical experience supporting data migration projects, including ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

Lead and oversee multiple audit data analytics engagements, ensuring quality, timeliness and budget control Design and implement data analytics solutions using Databricks, SQL, Python and Power BI Coach and develop managers and more junior team members through hands-on support and formal reviews Engage with Directors … Partners and clients to translate data insights into audit-relevant outcomes Modernise audit delivery through data and analytics Lead high-performing teams and complex engagements Requirements Significant experience delivering data and analytics solutions within external audit or regulated assurance environments Ability to lead ...

scalable solutions.* Participate in code reviews, technical discussions, and platform improvement initiatives as an active contributor.* Proactively identify data quality issues, pipeline risks, and improvement opportunities, and communicate them clearly in a fast‐paced environment.# **Duties*** Develop and maintain PySpark notebooks and jobs to ingest, transform … workflows, including use of PySpark.* Proficiency in SQL for querying, transformation, and analytical data processing.* Solid understanding of ETL/ELT pipelines, data transformation patterns, and data integration concepts.* Experience analyzing enterprise data sources to identify data relationships, transformations ...

growing world. We leverage cutting-edge technology to optimize operations, enhance customer experience, and drive business growth. We are seeking a Senior Data Engineer to join our team and play a pivotal role. About The Role At Maersk, we are redefining global logistics through data, platform … data ecosystems Operational Excellence Ensure data solutions are reliable, scalable, performant, secure, and production‐ready Monitor, troubleshoot, and continuously improve pipeline performance, data quality, and platform stability Drive automation, observability, and supportability across data, analytics, and AI/ML solutions ...

Methods is recruiting for a permanent Mid/Senior Data Engineer to join the Data and AI Capability Centre. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol. You will support complex … reused as part of an enduring data governance model. Experience implementing and advocating for test‐driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks Proven experience leading technical aspects of data projects Strong ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Kaluza's evolving data & architecture strategy - they build and own the infrastructure, tooling and governance for Kaluza's internal data pipeline, from data ingestion, data cataloguing to data storage and exposing data externally. What will … pipelines, strategic data architectural decisions, and high-quality "data mart" objects across functions like product, finance, or strategy. Pipeline Specialist: You possess extensive experience in engineering robust ETL/ELT processes and data pipelines, with a focus on curating, transforming ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI.We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps).Expertise in data ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Role Profile Job Title: Data Engineering & Insights Manager (Hybrid Working Policy) 2 days a month. Reports To: Chief Innovation Officer Role Purpose The Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside … delivery of high-quality, business-ready insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted ...

reward programmes and loyalty initiatives. Purpose of the job The role provides expert legal advice and strategic support on all aspects of data protection, privacy and information governance across the Group. The role ensures that the organisation's data strategy, governance framework and commercial initiatives … responsible and innovative use of data. As a member of the wider legal team, the role will be working closely with the Data Enablement Officer, Data Protection, Information Security, Compliance, Technology and Business teams, the role embeds privacy by design , supports enterprise data governance ...

NEXT CHAPTER STARTS WITH YOU. Data Engineer Build trusted data products that turn complexity into confident decisions Vanquis is strengthening how it uses data to improve customer outcomes, insight and competitive advantage. This is an opportunity to help shape a modern, cloud-first data … tools that improve time to market. Learning together. We document well, share experience and help the wider engineering community grow. Technology stack Snowflake – ELT pipeline development – Agile and DevOps Coalesce – Data modelling and data marts – CI/CD and test automation SQL – Metadata-driven pipelines ...

Business Intelligence - Data EngineerExperience working with SEI frameworks and Data Delivery to various firms using Snowflake, Airflow, Azure Data Factory and Microsoft Azure. Day to Day job Duties: (what this person will do on a daily/weekly basis)Work closely with client stakeholders … goals. Participate in daily stand-ups, sprint planning, and review meetings to ensure continuous communication and progress tracking. Design, build, and optimize scalable data pipelines using Azure Data Factory and Apache Airflow for scheduling and orchestration. Implement efficient data ingestion, transformation, and movement processes ...

Role Data Architect Working Structure Hybrid (Regular visits to client site) Career Grade Senior Technical Consultant The Role As a Data Architect at CACI Information Intelligence Group, you will join a community of dedicated engineers delivering cutting-edge data solutions for our public sector … customers across Central Government, Defence, National Security, Critical National Infrastructure and Law Enforcement. This role is focused on architecting and delivering modern cloud data platforms, with particular emphasis on Snowflake and/or Databricks. You will work directly with customers to design, assess, optimise, and modernise enterprise data ...