1 to 25 of 43 Permanent Data Pipeline Jobs in Yorkshire

with length of service Sick Pay Increasing with length of service The Role: DataOps Engineer Job Description We are seeking a senior Data DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role … you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft …/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards More ❯

with length of service Sick Pay Increasing with length of service The Role: DataOps Engineer Job Description We are seeking a senior Data DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role … you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft …/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards More ❯

About Us We are Data Services, our mission is to unlock the value of data by delivering high-quality, reliable, and secure data services that are accessible, understandable, and actionable! We continuously evolve our offerings, using modern cloud-based technologies, and foster strong partnerships … product groups, identifying common solution patterns and developing reusable frameworks. Lead the identification of dependencies and produce detailed design documents for data pipeline solutions. Leverage subject-matter expertise to drive project and release plans with key partners including SMEs and Product Owners. Participate in organisation-wide projects … platform-centric FinOps policies. Provide mentorship and coaching to data engineers on modern tools and technologies in Azure, data pipeline management, coding practices, design principles, and implementation patterns. Minimum Criteria Extensive experience in data engineering on an Azure data platform More ❯

Job Title: Data Engineer Location: Leeds ( 1 day every 2 weeks) Department: Data & Analytics Salary: £70,000 - £80,000 About Us One of the UK’s leading services for selling items in one simple, hassle-free process. With a mission to promote sustainability and support a … circular economy, as they expand into new markets, they are looking for a highly skilled and motivated Data Engineer to join the dynamic team and help elevate their data infrastructure and analytics capabilities. If you have experience with Snowflake, digital marketing analytics, and are familiar with … data warehousing as well as what best practice looks like when undertaking data engineering. Key Responsibilities Data Architecture & Pipeline Development: Design, implement, and maintain robust and scalable data pipelines, ensuring seamless integration and flow of data across multiple systems. More ❯

Job Title: Data Engineer Location: Leeds ( 1 day every 2 weeks) Department: Data & Analytics Salary: £70,000 - £80,000 About Us One of the UK’s leading services for selling items in one simple, hassle-free process. With a mission to promote sustainability and support a … circular economy, as they expand into new markets, they are looking for a highly skilled and motivated Data Engineer to join the dynamic team and help elevate their data infrastructure and analytics capabilities. If you have experience with Snowflake, digital marketing analytics, and are familiar with … data warehousing as well as what best practice looks like when undertaking data engineering. Key Responsibilities Data Architecture & Pipeline Development: Design, implement, and maintain robust and scalable data pipelines, ensuring seamless integration and flow of data across multiple systems. More ❯

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior … Data Engineer as we look to expand our team and support our growing roster of local and national clients. If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process. Who We're Looking For … growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms. We're not just processing data-we're transforming it into organizational intelligence. More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think … scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and … help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think … scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and … help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling More ❯

I'm looking for a Data Quality & Governance Manager to join a global business in Leeds - they are building a modern data platform, using cutting-edge technologies including Snowflake and Microsoft Azure. You'll join their newly established Data Team, based in their modern … fast-paced, forward-thinking and entrepreneurial environment. In this brand-new role, you will lead on the development and implementation of frameworks for data quality, governance, and master data management (MDM), ultimately shaping how data is trusted and used across the organisation. You'll … work closely with Data Engineers, to ensure the effective management of data warehouse architecture and data pipelines, using a combination of Snowflake and Microsoft Azure technologies. You'll also look at implementing data governance tools and platforms (e.g. Purview), and ensure the More ❯

I'm looking for a Data Quality & Governance Manager to join a global business who are building a modern data platform, using cutting-edge technologies including Snowflake and Microsoft Azure. You'll join their newly established Data Team, based in their modern office space … fast-paced, forward-thinking and entrepreneurial environment. In this brand-new role, you will lead on the development and implementation of frameworks for data quality, governance, and master data management (MDM), ultimately shaping how data is trusted and used across the organisation. You'll … work closely with Data Engineers, to ensure the effective management of data warehouse architecture and data pipelines, using a combination of Snowflake and Microsoft Azure technologies. You'll also look at implementing data governance tools and platforms (e.g. Purview), and ensure the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

Role: Data Engineering Manager Salary: £65,000- £70,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of … is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. … coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £70,000 per More ❯

Title: Azure Data Engineer Location: Fully remote (working UAE hours) Salary: 5k GBP per month Are you a data expert with a passion for building scalable, cloud-first data pipelines? We’re hiring an experienced Azure Data Engineer to join a fast … growing team focused on developing a centralised, enterprise-grade data warehouse in the Azure cloud. This is a full-time remote role open to candidates located within GMT +1 to +6 time zones . If you thrive in fast-paced environments, take extreme ownership of your work, and … Creating and maintaining secure, scalable data pipelines and ingestion workflows Leveraging Azure Synapse Analytics and ADF to deliver robust ELT solutions Ensuring pipeline execution, availability, and reliability across platforms Owning physical data models and collaborating with BI teams on reporting layers Supporting data More ❯

I'm looking for a Data Engineer with Snowflake experience to join a global business who are embarking on a greenfield project to build a brand-new Snowflake Data Warehouse. They are building a modern, AI-ready data platform, which allows for better decision … both themselves and their customers, with a tech stack including Snowflake, dbt, Microsoft Azure and Power BI. You'll join their newly established Data Team, based in their modern office space in Leeds - you'll spend at least 3 days per week in the office to collaborate with … in what's a very fast-paced, forward-thinking and entrepreneurial environment. The purpose of this role is to build and maintain the data architecture that supports various business intelligence initiatives. This will include designing and managing Snowflake data pipelines, ensuring data flows seamlessly More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible … business value. This is not a role for someone just moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the … role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible … business value. This is not a role for someone just moving data from A to B with Python — it’s for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of … the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data More ❯

Senior Data Engineer – Assistant Manager Base Location: Leeds based (Hybrid – 3 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations As a result of the work that we do, we require applicants to hold or be capable of obtaining UK National Security Vetting, the requirements for … planet or everything in-between. In a world where tech is always changing, so are we. Why Join KPMG Curve as a Senior Data Engineer Progression at pace. Innovation, led by constant learning. Work that excites you with every twist and turn. It all starts at KPMG Curve. … one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline To discuss this or wider Technology roles with our recruitment team, all you need to do is apply, create a profile, upload your CV More ❯

currently in the midst of a major IT transformation. As part of this journey, they're looking to bring on board a talented Data Engineer for a contract role. This position offers the chance to make a real impact by helping to modernise the company's data infrastructure. You'll be involved in migrating from legacy systems to a cutting-edge, cloud-based data platform built on Microsoft Azure. Working within a collaborative team, you'll contribute to the design, development, and upkeep of scalable data pipelines and models-ensuring data is accurate, accessible, and secure across the business. What we're looking for: Solid hands-on experience with Azure Data Platform tools (e.g., Synapse, Data Lakes, ADF) Strong background in data modelling, ETL/ELT processes, and data integration Proficiency More ❯

currently in the midst of a major IT transformation. As part of this journey, they're looking to bring on board a talented Data Engineer for a contract role. This position offers the chance to make a real impact by helping to modernise the company's data infrastructure. You'll be involved in migrating from legacy systems to a cutting-edge, cloud-based data platform built on Microsoft Azure. Working within a collaborative team, you'll contribute to the design, development, and upkeep of scalable data pipelines and models-ensuring data is accurate, accessible, and secure across the business. What we're looking for: Solid hands-on experience with Azure Data Platform tools (e.g., Synapse, Data Lakes, ADF) Strong background in data modelling, ETL/ELT processes, and data integration Proficiency More ❯

Data Engineer Location: Leeds (Hybrid – 2 days/week) Compensation: Up to £55,000 (plus benefits) Are you a hands-on data engineer ready to modernize a legacy environment and leave a lasting impact? We're partnered with a growing financial services firm undergoing a full … data transformation—this is your chance to get in early and help build something from the ground up. Backed by senior leadership and driven by a clear vision, the business is shifting from fragmented BI reporting to a modern, cloud-native data function. You won’t … just be building pipelines—you’ll be helping to define how the business uses data for the next decade. What You’ll Be Doing Designing and developing data pipelines as part of a migration to Microsoft Fabric . Moving legacy systems (SQL, SSRS, ClickView) into a More ❯

Senior Data Engineer – Assistant Manager Base Location: Leeds based (Hybrid – 3 days per week in office) As a result of the work that we do, we require applicants to hold or be capable of obtaining UK National Security Vetting, the requirements for which could include but not be … planet or everything in-between. In a world where tech is always changing, so are we. Why Join KPMG Curve as a Senior Data Engineer Progression at pace. Innovation, led by constant learning. Work that excites you with every twist and turn. It all starts at KPMG Curve. … one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline To discuss this or wider Technology roles with our recruitment team, all you need to do is apply, create a profile, upload your CV More ❯