1 to 25 of 27 Data Pipeline Jobs in Leeds

with length of service Sick Pay Increasing with length of service The Role: DataOps Engineer Job Description We are seeking a senior Data DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role … you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft …/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards More ❯

About Us We are Data Services, our mission is to unlock the value of data by delivering high-quality, reliable, and secure data services that are accessible, understandable, and actionable! We continuously evolve our offerings, using modern cloud-based technologies, and foster strong partnerships … product groups, identifying common solution patterns and developing reusable frameworks. Lead the identification of dependencies and produce detailed design documents for data pipeline solutions. Leverage subject-matter expertise to drive project and release plans with key partners including SMEs and Product Owners. Participate in organisation-wide projects … platform-centric FinOps policies. Provide mentorship and coaching to data engineers on modern tools and technologies in Azure, data pipeline management, coding practices, design principles, and implementation patterns. Minimum Criteria Extensive experience in data engineering on an Azure data platform More ❯

Job Title: Data Engineer Location: Leeds ( 1 day every 2 weeks) Department: Data & Analytics Salary: £70,000 - £80,000 About Us One of the UK’s leading services for selling items in one simple, hassle-free process. With a mission to promote sustainability and support a … circular economy, as they expand into new markets, they are looking for a highly skilled and motivated Data Engineer to join the dynamic team and help elevate their data infrastructure and analytics capabilities. If you have experience with Snowflake, digital marketing analytics, and are familiar with … data warehousing as well as what best practice looks like when undertaking data engineering. Key Responsibilities Data Architecture & Pipeline Development: Design, implement, and maintain robust and scalable data pipelines, ensuring seamless integration and flow of data across multiple systems. More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think … scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and … help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling More ❯

My client is based in the Leeds area are currently looking to recruit for an experienced Data Engineer to join their Data & AI Consulting team. They are a specialist Tech organisation, that are at the forefront of engineering practices. They are currently going through a period … of growth and are looking for an experienced Data Engineer to join their team. They only recruit the "best" talent and have a diverse workforce. Key Responsibilities: Design, build, and manage data pipelines in Snowflake, ensuring seamless data flow from diverse sources into the … data platform. Collaborate with business stakeholders and data analysts to gather data requirements and deliver effective solutions. Integrate structured and unstructured data sources into Snowflake, optimising data models for analytics and reporting. Support data analysts by optimising semantic More ❯

Snowflake Data Engineer I am working with a hugely successful organisation based in Leeds who are looking for a Snowflake Data Engineer to join their newly formed data practice. You will join a business to work on their exciting Greenfield data platform … project, where you will have the opportunity to create the data warehouse from scratch and shape the ongoing direction of the data platform. You will work to build and maintain a robust and scalable data platform and will support the organisation's BI and … analytics goals. You will work closely with developers to transform data ready for reporting purposes to deliver accurate information to key business stakeholders. As part of this role you will be responsible for - Design and develop data pipelines ensuring the successful integration of data More ❯

I'm looking for a Data Quality & Governance Manager to join a global business in Leeds - they are building a modern data platform, using cutting-edge technologies including Snowflake and Microsoft Azure. You'll join their newly established Data Team, based in their modern … fast-paced, forward-thinking and entrepreneurial environment. In this brand-new role, you will lead on the development and implementation of frameworks for data quality, governance, and master data management (MDM), ultimately shaping how data is trusted and used across the organisation. You'll … work closely with Data Engineers, to ensure the effective management of data warehouse architecture and data pipelines, using a combination of Snowflake and Microsoft Azure technologies. You'll also look at implementing data governance tools and platforms (e.g. Purview), and ensure the More ❯

I'm looking for a Data Quality & Governance Manager to join a global business who are building a modern data platform, using cutting-edge technologies including Snowflake and Microsoft Azure. You'll join their newly established Data Team, based in their modern office space … fast-paced, forward-thinking and entrepreneurial environment. In this brand-new role, you will lead on the development and implementation of frameworks for data quality, governance, and master data management (MDM), ultimately shaping how data is trusted and used across the organisation. You'll … work closely with Data Engineers, to ensure the effective management of data warehouse architecture and data pipelines, using a combination of Snowflake and Microsoft Azure technologies. You'll also look at implementing data governance tools and platforms (e.g. Purview), and ensure the More ❯

Role: Data Engineering Manager Salary: £65,000- £70,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of … is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. … coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £70,000 per More ❯

Title: Azure Data Engineer Location: Fully remote (working UAE hours) Salary: 5k GBP per month Are you a data expert with a passion for building scalable, cloud-first data pipelines? We’re hiring an experienced Azure Data Engineer to join a fast … growing team focused on developing a centralised, enterprise-grade data warehouse in the Azure cloud. This is a full-time remote role open to candidates located within GMT +1 to +6 time zones . If you thrive in fast-paced environments, take extreme ownership of your work, and … Creating and maintaining secure, scalable data pipelines and ingestion workflows Leveraging Azure Synapse Analytics and ADF to deliver robust ELT solutions Ensuring pipeline execution, availability, and reliability across platforms Owning physical data models and collaborating with BI teams on reporting layers Supporting data More ❯

I'm looking for a Data Engineer with Snowflake experience to join a global business who are embarking on a greenfield project to build a brand-new Snowflake Data Warehouse. They are building a modern, AI-ready data platform, which allows for better decision … both themselves and their customers, with a tech stack including Snowflake, dbt, Microsoft Azure and Power BI. You'll join their newly established Data Team, based in their modern office space in Leeds - you'll spend at least 3 days per week in the office to collaborate with … in what's a very fast-paced, forward-thinking and entrepreneurial environment. The purpose of this role is to build and maintain the data architecture that supports various business intelligence initiatives. This will include designing and managing Snowflake data pipelines, ensuring data flows seamlessly More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible … business value. This is not a role for someone just moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the … role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data More ❯

Senior Data Engineer – Assistant Manager Base Location: Leeds based (Hybrid – 3 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations As a result of the work that we do, we require applicants to hold or be capable of obtaining UK National Security Vetting, the requirements for … planet or everything in-between. In a world where tech is always changing, so are we. Why Join KPMG Curve as a Senior Data Engineer Progression at pace. Innovation, led by constant learning. Work that excites you with every twist and turn. It all starts at KPMG Curve. … one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline To discuss this or wider Technology roles with our recruitment team, all you need to do is apply, create a profile, upload your CV More ❯

currently in the midst of a major IT transformation. As part of this journey, they're looking to bring on board a talented Data Engineer for a contract role. This position offers the chance to make a real impact by helping to modernise the company's data infrastructure. You'll be involved in migrating from legacy systems to a cutting-edge, cloud-based data platform built on Microsoft Azure. Working within a collaborative team, you'll contribute to the design, development, and upkeep of scalable data pipelines and models-ensuring data is accurate, accessible, and secure across the business. What we're looking for: Solid hands-on experience with Azure Data Platform tools (e.g., Synapse, Data Lakes, ADF) Strong background in data modelling, ETL/ELT processes, and data integration Proficiency More ❯

Location: Leeds City Centre + Hybrid Working Job Type: Full-time Team: Product Reports to: Head of Product Development About Us: We use data science and AI to help retailers make profitable pricing, marketing and retail media decisions. Put simply, we help retailers sell the right products, to … a business intelligence development or related role Excellent SQL skills Good understanding of relational and analytical database architectures and methodologies Experience of cloud data warehousing solutions e.g. Snowflake, BigQuery, Redshift Good hands-on experience with at least one Business Intelligence platform Strong analytical and problem-solving skills Excellent … the ability to explain technical details to non-technical stakeholders Comfortable with occasional client interaction in a professional and supportive capacity Great UX & data visualisation skills The Role: Design, develop and maintain BI solutions including dashboards, reports and data models Produce visually engaging deliverables for consumption More ❯

About The Role Hippo is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo's Principal Data Engineers are experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others. Please … ensuring that challenges are overcome Lead in the recruitment of other engineers, and support other consultants in their professional development Ensure Hippo's Data and Engineering communities contribute to Hippo's business at a strategic level Lead on new business opportunities, writing technical bids and proposals Promote Hippo More ❯

Principal Test Specialist (DATA) £75,000 + Profit Share | Hybrid with flexible monthly office visits | Permanent Are you a hands-on, technically advanced Test Specialist looking to take the lead on testing strategy across a cutting-edge data environment? We're working exclusively with a high … organisation who are making a rare and strategic external hire into their specialist team - and they're looking for a Principal Test Specialist (DATA) to elevate testing across their data engineering and analytics function. This is a business-critical role, working at the intersection of technical … strategy and hands-on delivery. You'll help define and implement scalable test automation across complex data pipelines and analytical models, directly impacting the quality and reliability of data products used business-wide. What You'll Be Doing Partner with the Test Manager to modernise and More ❯

Job Title: Lead Data Engineer Base Location: Leeds based (Hybrid – 3 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations As a result of the work that we do, we require applicants to hold or be capable of obtaining UK National Security Vetting, the requirements for … planet or everything in-between. In a world where tech is always changing, so are we. Why Join KPMG Curve as a Lead Data Engineer Progression at pace. Innovation, led by constant learning. Work that excites you with every twist and turn. It all starts at KPMG Curve. … science applications Ability to use wide variety of open-source technologies Knowledge of test automation frameworks and ability to automate testing within the pipeline To discuss this or wider Technology roles with our recruitment team, all you need to do is apply, create a profile, upload your CV More ❯

Principal Test Specialist (DATA) £75,000 + Profit Share | Hybrid with flexible monthly office visits | Permanent Are you a hands-on, technically advanced Test Specialist looking to take the lead on testing strategy across a cutting-edge data environment? We’re working exclusively with a high … organisation who are making a rare and strategic external hire into their specialist team – and they’re looking for a Principal Test Specialist (DATA) to elevate testing across their data engineering and analytics function. This is a business-critical role, working at the intersection of technical … strategy and hands-on delivery. You’ll help define and implement scalable test automation across complex data pipelines and analytical models, directly impacting the quality and reliability of data products used business-wide. What You’ll Be Doing Partner with the Test Manager to modernise and More ❯

Lead Data Consultant Leading UK Logistics Organisation Hybrid Working | £66,000 - £75,000 We're looking for an exceptional Data Consultant to join one of the UK's largest parcel delivery organisations. This is a unique opportunity to blend technical leadership with hands-on development, working … with cutting-edge technologies in an exciting logistics environment! What You'll Do: - Lead and implement technical solutions across our data landscape - Provide technical mentorship and drive engineering best practices - Optimize mission-critical data pipelines supporting nationwide operations - Establish and maintain robust CI/CD practices … Shape strategic technical roadmaps - Drive innovation in our data engineering space Must-Have Experience: - 8+ years in data engineering with team leadership experience - Expert-level knowledge of Databricks platform for logistics applications - Advanced Python development skills - Deep understanding of SQL optimization for large-scale operations - Proven More ❯

/week Onsite) Duration: 06+ Months Job Summary: We are looking for an experienced Kafka Architect to design and implement scalable, high-throughput data streaming solutions using Apache Kafka on Cloudera (on-premises). The ideal candidate will have a strong background in distributed systems, data pipelines, and real-time data processing. Key Responsibilities: -Design and implement scalable Kafka-based architectures using open-source -Kafka on Cloudera on-premises infrastructure. -Lead the setup, configuration, and optimization of Kafka clusters. -Define standards and best practices for Kafka producers, consumers, and streaming applications. -Integrate … Kafka with various data sources, storage systems, and enterprise applications. -Monitor Kafka performance and ensure high availability, fault tolerance, and data security. -Collaborate with DevOps, Data Engineering, and Application teams to support real-time data needs. -Automate deployment and configuration using tools More ❯

As our next Technical Engineer, you'll join our Leeds Based Data Technology Solutions function to shape, lead, coordinate, and transition technical change into service. This role offers hybrid working with working from home capability. What You'll Do Identify, shape, scope and lead development work. Create delivery … of design activities Primary contact for IT, solution architecture, product owners, infrastructure, testing and release. Work with colleagues in these areas to review data solution options to assess impact of new requirements on existing functionality, data and systems including alternative design scenarios. Perform detailed gap analysis … ll Do It Expert knowledge of current technologies and platforms. Examples are Oracle (Database, ODI, Pl-SQL), SAP Business Objects, SAP business objects data services, Denodo Virtualisation, MDM solutions, reference data management Experience in Meta data driven design for Data pipelines Proven More ❯

We are seeking an experienced Kafka Real-Time Architect to design and implement scalable, high-performance real-time data processing systems leveraging Apache Kafka. In this role, you will be responsible for architecting and managing Kafka clusters, ensuring system scalability and availability, and integrating Kafka with various data processing platforms. This position requires a deep understanding of Kafka and related technologies, along with a proactive approach to addressing business data needs and ensuring optimal system performance. Key Responsibilities: Design & Architecture: Architect and design scalable, real-time streaming systems using Apache Kafka, ensuring they are … robust, highly available, and meet business requirements for data ingestion, processing, and real-time analytics. Kafka Cluster Management: Configure, deploy, and maintain highly available Kafka clusters, ensuring scalability and fault tolerance across distributed environments. Manage configurations, optimize cluster performance, and troubleshoot issues to maintain smooth operations. Integration & Data More ❯

Snowflake Data Engineer - £60,000-£80,000 My client is looking for a skilled Data Engineer with expertise in Snowflake to join their team. You will build and manage data pipelines, ensure integration of data into Snowflake and implement data … a fast-paced, technology driven business and work alongside experienced colleagues at all different levels. Requirements: -Snowflake -Cloud-based platform experience -Experience building data pipelines in Snowflake -Stakeholder management Please Note: This is role for UK residents only. This role does not offer Sponsorship. You must have the More ❯