126 to 150 of 866 Data Pipeline Jobs in the UK

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

Title: Microsoft Fabric Data Engineer Location: Remote Contract: 3 months with the possibility of extension Clearance: Active SC clearance or eligible Are you an experienced Microsoft Data Engineer with experience in Microsoft Fabric? We are seeking a proactive and skilled Microsoft Fabric Data Engineer … PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within Microsoft Fabric. Team Collaboration: Ability to communicate technical concepts clearly and collaborate effectively within a team to ensure data ...

client is looking for a Senior DataOps Engineer to play a key role in the delivery, automation, and operational excellence of enterprise-grade data platforms. You will work as part of cross-functional, domain-oriented data product teams, enabling the design, build, testing, deployment, and support … high-quality data solutions. This role has a strong focus on automation, CI/CD, infrastructure-as-code, data pipeline reliability, and continuous improvement, acting as a DataOps and delivery expert within the wider data engineering community. Key Responsibilities Design, develop, and automate ...

Head of Data Engineering (12 Month FTC) London - 2 Days in London Up to £115,000 + 15% Bonus We're partnering with an exciting start-up, created by two fortune 100 companies, on a Head of Data Engineering hire based in London. This … senior leadership role owning the data engineering function for a business operating at the heart of the US generic pharmaceuticals supply chain , where data quality, governance, and scale are mission-critical. This role suits an experienced data engineering leader who enjoys operating in complex ...

looking for a Data Engineer with a strong foundation in data engineering principles and a keen interest in cloud technologies. This is an excellent opportunity for someone early in their career, recent graduates or those with a couple of years’ experience, who wants to grow … grasp fundamentals and fine-tune solutions for efficiency. Nice to Have Exposure to Databricks or willingness to learn. Familiarity with data pipeline orchestration tools. Interest in business processes and ability to communicate technical concepts in business terms. What We’re Looking For Someone enthusiastic, curious, and eager ...

Data Engineer is required to support the development and improvement of data pipelines within a Microsoft-based analytics environment. The role focuses on ingesting, transforming, and standardising data from multiple sources to enable reliable reporting and analytics. Key Technical Responsibilities Design, build, and maintain … data pipelines using SQL, Python, and R Ingest and transform structured and semi-structured data within Microsoft Fabric Improve data quality, performance, and reliability across existing pipelines Prepare analytics-ready datasets optimised for Power BI consumption Apply data modelling and transformation best ...

Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data … Performance optimization & troubleshooting Python: Automation scripts Data processing workflows Monitoring, debugging, validation scripts AWS Support/Operations: Troubleshooting ETL failures, performance bottlenecks, pipeline issues Monitoring cloud workloads (CloudWatch, CloudTrail) Handling incidents, root-cause analysis (RCA), patching & releases Cost optimization and resource usage tracking Data quality ...

Databricks Data Engineer £500 - £600 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive … smarter decisions, improve efficiency, and create personalised journeys for millions of shoppers worldwide. The Role As a Senior Data Engineer, you'll play a key role in developing and optimising the backbone of the company's data platform. You'll be responsible for building and maintaining ...

Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data … Performance optimization & troubleshooting Python: Automation scripts Data processing workflows Monitoring, debugging, validation scripts AWS Support/Operations: Troubleshooting ETL failures, performance bottlenecks, pipeline issues Monitoring cloud workloads (CloudWatch, CloudTrail) Handling incidents, root-cause analysis (RCA), patching & releases Cost optimization and resource usage tracking Telecom Domain: Experience with ...

Role Overview We are seeking a high-performing FME Analyst to support the Local Digitisation Programme, delivering high-volume, high-accuracy spatial data automation. This role is critical to enabling scale, consistency, and quality across multiple Local Authorities, supporting both production delivery and automation uplift. The ideal candidate … Collaboration Support daily production delivery across LA waves and batches Collaborate with: o Delivery Pods o QA teams o Automation and data pipeline teams o Programme and Planning leads Provide clear documentation of: o FME logic o Data rules o Exceptions and assumptions Required Skills ...

Data Engineer - Azure We are seeking a Data Engineer to join the Analytics department within the public sector in Brighton. This role focuses on designing, building, and maintaining robust data pipelines and platforms to support organisational objectives. Client Details Data Engineer - Azure … quality services. It is a medium-sized organisation known for its structured approach and focus on analytics to drive impactful decision-making. Description Data Engineer - Azure Develop and maintain scalable data pipelines and systems to manage large datasets effectively. Collaborate with cross-functional teams to understand ...

award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data ...

where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Role We are looking for an experienced, driven, and hands-on data engineer with strong data … lead the delivery of a key migration project. You will play a key role in the migration and redevelopment of an existing Data Warehouse into a modern AWS-based environment. This position focuses on analysing current ETL processes, understanding existing data structures, and re-engineering them ...

Sanderson are currently working with a client who are looking to develop their data engineering capability, this involves working on mission critical solutions that focuses on data services for their customers. You will … managing and developing data pipelines that transforms raw data, enabling downstream analytics. You will be responsible for Data pipeline development - Data ingestion and pipeline click apply for full job details ...

Senior Data Engineer, Azure London/hybrid Circa £90k-£100k + bonus + benefits Senior Data Engineer required by global banking organisation to help build and scale a modern data platform within a complex financial services environment. This role plays a key part … bringing together data from multiple regions into a single, well-governed and scalable platform built on Microsoft Fabric and Azure. You'll work closely with business stakeholders, product owners and federated data teams to design and deliver a shared data model that supports incremental ...

Senior Data Engineer, Azure London/hybrid Circa £90k-£100k + bonus + benefits Senior Data Engineer required by global banking organisation to help build and scale a modern data platform within a complex financial services environment. This role plays a key part … bringing together data from multiple regions into a single, well-governed and scalable platform built on Microsoft Fabric and Azure. Youll work closely with business stakeholders, product owners and federated data teams to design and deliver a shared data model that supports incremental business ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

Data Engineer ( Snowflake and Matillion) - £425PD - Remote About the Role We are looking for a Data Engineer with strong experience in Snowflake and Matillion to design, build, and maintain scalable data pipelines and analytics-ready data models. You'll work closely with … analytics, product, and business teams to turn raw data into reliable, high-quality datasets that power reporting, dashboards, and advanced analytics. This role is ideal for someone who enjoys working in a modern cloud data stack and takes pride in building clean, performant, and well-documented ...

Snowflake Senior Developer Location: London (Hybrid) Seniority: Senior Individual Contributor Reports to: Data Engineering Lead/Manager Summary of role We are seeking a Snowflake Senior Developer to design, develop, and optimise data solutions on our cloud data platform. You will work closely with … data engineers, analysts, and architects to deliver high-quality, scalable data pipelines and models. Strong expertise in Snowflake, ETL/ELT, data modelling, and data warehousing is essential. Responsibilities Snowflake Development: Build and optimise Snowflake objects (databases, schemas, tables, views, tasks, streams ...

Data Engineer ( Snowflake and Matillion) - £425PD - Remote About the Role We are looking for a Data Engineer with strong experience in Snowflake and Matillion to design, build, and maintain scalable data pipelines and analytics-ready data models. You'll work closely with … analytics, product, and business teams to turn raw data into reliable, high-quality datasets that power reporting, dashboards, and advanced analytics. This role is ideal for someone who enjoys working in a modern cloud data stack and takes pride in building clean, performant, and well-documented ...

Your new company Working for a renowned commodity, metals, trades and exchange group. You'll be a key part of the Enterprise Data team helping to replace legacy ETL tools (Informatica) and deliver modern data engineering capabilities. Your work will include managing data pipelines … visualisation, and collaborating with ETL developers and wider technology teams to deliver solutions aligned with our strategic roadmap. You'll work across backend, data, and infrastructure engineering, contributing to solution design, implementation, deployment, testing, and support. This is a hands-on role for someone with strong data ...

Azure Data Engineer - £70K (£5K Car allowance) Rugby based - Mostly remote with monthly trips to office I'm supporting a fast-moving organisation undergoing major data transformation, and they're looking for a skilled Azure Data Engineer to help build modern, scalable cloud data solutions. If you thrive on solving complex data challenges and working with the latest Azure technologies, this one's for you. What You'll Do Build and optimise data pipelines , databases and cloud data platforms. Develop AZure Data Factory/ ...

Role: Data & ML Architect Location: Newcastle Upon Tyne Levels: Associate Manager Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process as part of this role, which requires 5+ years … cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. Role Overview As a Data & ML Architect, you will lead the design and architecture of scalable, enterprise-grade data platforms and advanced machine learning solutions. You will ...