1 to 25 of 41 Data Pipeline Jobs in Yorkshire

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

with length of service Sick Pay Increasing with length of service The Role: DataOps Engineer Job Description We are seeking a senior Data DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role … you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft …/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards More ❯

Job Title: Data Engineer Location: Leeds ( 1 day every 2 weeks) Department: Data & Analytics Salary: £70,000 - £80,000 About Us One of the UK’s leading services for selling items in one simple, hassle-free process. With a mission to promote sustainability and support a … circular economy, as they expand into new markets, they are looking for a highly skilled and motivated Data Engineer to join the dynamic team and help elevate their data infrastructure and analytics capabilities. If you have experience with Snowflake, digital marketing analytics, and are familiar with … data warehousing as well as what best practice looks like when undertaking data engineering. Key Responsibilities Data Architecture & Pipeline Development: Design, implement, and maintain robust and scalable data pipelines, ensuring seamless integration and flow of data across multiple systems. More ❯

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior … Data Engineer as we look to expand our team and support our growing roster of local and national clients. If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process. Who We're Looking For … growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms. We're not just processing data-we're transforming it into organizational intelligence. More ❯

Data Engineering Vacancies - Mid to Lead Level - Leeds I am working with a brand new client, and end user based in Leeds who are building an exciting data practice, doing some highly advanced work in the data space. Salary and Benefits Highly comptetitive salary … days per week in Leeds office Competitive annual leave package And many more Role and Responsibilities Design and manage Snowflake-based data pipelines, ensuring data flows seamlessly from multiple sources into the data platform. Collaborate with business stakeholders and data analysts to … identify data requirements and deliver the appropriate solutions. Ensure the integration of structured and unstructured data sources into Snowflake, optimizing data models for reporting. Work with data analysts to support their data needs and optimize semantic models for Snowflake-based More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think … scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and … help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling More ❯

My client is based in the Leeds area are currently looking to recruit for an experienced Data Engineer to join their Data & AI Consulting team. They are a specialist Tech organisation, that are at the forefront of engineering practices. They are currently going through a period … of growth and are looking for an experienced Data Engineer to join their team. They only recruit the "best" talent and have a diverse workforce. Key Responsibilities: Design, build, and manage data pipelines in Snowflake, ensuring seamless data flow from diverse sources into the … data platform. Collaborate with business stakeholders and data analysts to gather data requirements and deliver effective solutions. Integrate structured and unstructured data sources into Snowflake, optimising data models for analytics and reporting. Support data analysts by optimising semantic More ❯

it. They're the values that make us LNER. Are you on board? At LNER, we don't just move people - we move data, ideas, and innovation. As we accelerate toward a smarter, more connected future, our data is at the heart of how we operate … plan, and grow. Now, we're looking for a Data Services Manager to help lead that charge. This is more than a management role. It's a chance to shape the future of data at one of the UK's most iconic train operating companies. You … ll be the strategic and technical backbone behind our data lake, engineering pipelines, and analytics-ready data assets - driving smarter decisions, better customer experiences, and genuine innovation across every part of the business. Within this role you'll also be involved in; Own our Data More ❯

Snowflake Data Engineer I am working with a hugely successful organisation based in Leeds who are looking for a Snowflake Data Engineer to join their newly formed data practice. You will join a business to work on their exciting Greenfield data platform … project, where you will have the opportunity to create the data warehouse from scratch and shape the ongoing direction of the data platform. You will work to build and maintain a robust and scalable data platform and will support the organisation's BI and … analytics goals. You will work closely with developers to transform data ready for reporting purposes to deliver accurate information to key business stakeholders. As part of this role you will be responsible for - Design and develop data pipelines ensuring the successful integration of data More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap … to maximize long-term business value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and More ❯

I'm looking for a Data Quality & Governance Manager to join a global business in Leeds - they are building a modern data platform, using cutting-edge technologies including Snowflake and Microsoft Azure. You'll join their newly established Data Team, based in their modern … fast-paced, forward-thinking and entrepreneurial environment. In this brand-new role, you will lead on the development and implementation of frameworks for data quality, governance, and master data management (MDM), ultimately shaping how data is trusted and used across the organisation. You'll … work closely with Data Engineers, to ensure the effective management of data warehouse architecture and data pipelines, using a combination of Snowflake and Microsoft Azure technologies. You'll also look at implementing data governance tools and platforms (e.g. Purview), and ensure the More ❯

I'm looking for a Data Quality & Governance Manager to join a global business who are building a modern data platform, using cutting-edge technologies including Snowflake and Microsoft Azure. You'll join their newly established Data Team, based in their modern office space … fast-paced, forward-thinking and entrepreneurial environment. In this brand-new role, you will lead on the development and implementation of frameworks for data quality, governance, and master data management (MDM), ultimately shaping how data is trusted and used across the organisation. You'll … work closely with Data Engineers, to ensure the effective management of data warehouse architecture and data pipelines, using a combination of Snowflake and Microsoft Azure technologies. You'll also look at implementing data governance tools and platforms (e.g. Purview), and ensure the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

Role: Data Engineering Manager Salary: £65,000- £70,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of … is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. … coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £70,000 per More ❯

Title: Azure Data Engineer Location: Fully remote (working UAE hours) Salary: 5k GBP per month Are you a data expert with a passion for building scalable, cloud-first data pipelines? We’re hiring an experienced Azure Data Engineer to join a fast … growing team focused on developing a centralised, enterprise-grade data warehouse in the Azure cloud. This is a full-time remote role open to candidates located within GMT +1 to +6 time zones . If you thrive in fast-paced environments, take extreme ownership of your work, and … Creating and maintaining secure, scalable data pipelines and ingestion workflows Leveraging Azure Synapse Analytics and ADF to deliver robust ELT solutions Ensuring pipeline execution, availability, and reliability across platforms Owning physical data models and collaborating with BI teams on reporting layers Supporting data More ❯

I'm looking for a Data Engineer with Snowflake experience to join a global business who are embarking on a greenfield project to build a brand-new Snowflake Data Warehouse. They are building a modern, AI-ready data platform, which allows for better decision … both themselves and their customers, with a tech stack including Snowflake, dbt, Microsoft Azure and Power BI. You'll join their newly established Data Team, based in their modern office space in Leeds - you'll spend at least 3 days per week in the office to collaborate with … in what's a very fast-paced, forward-thinking and entrepreneurial environment. The purpose of this role is to build and maintain the data architecture that supports various business intelligence initiatives. This will include designing and managing Snowflake data pipelines, ensuring data flows seamlessly More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a … options aligned with the departments long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will … Factory (ADF): Incremental creation of data dimensions to optimise processing, reduce overheads, and improve cost efficiency across compute, storage, and networking. Enhancing pipeline security by replacing basic authentication with managed identities or service principals. Introducing parallelism into pipeline workflows to improve performance and scalability. Refactoring existing More ❯

A fantastic opportunity has arisen for a Data Analyst to join a business in Pocklington. In this key role, you will be responsible for capturing, analysing, and reporting data to optimise supply chain efficiency, biological asset management, and commercial decision-making. This position offers the chance … to provide valuable insights that drive business performance and strategic growth. The Role Reporting to the Head of Optimisation, the Data Analyst will generate data-driven insights to enhance performance across the business. This is an excellent opportunity for a data professional to contribute … and exciting opportunities for career development within a dynamic, forward-thinking environment. You will be involved in cutting-edge data projects that are shaping the future of food production. Key Responsibilities: Ensure accurate and timely data capture across the entire supply chain. Develop and maintain automated More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. Providing … insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then LETS More ❯