1 to 25 of 32 Permanent Data Pipeline Jobs in Yorkshire

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce More ❯

Job Title: Data Engineer Location: York (once a week) Department: Data & Business Intelligence Salary: £55,000 - 60,000 + Excellent Benefits Type: Full-Time, Permanent About the Role: WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As a Data Engineer, you will help shape and deliver the future of data … pipelines and high-quality data assets in line with designs, with progress updated via JIRA and any blockers identified and escalated. Ensure all data pipeline and quality issues are tracked with recommendations made for strategic improvements where there are repeated or high impacting issues Promote standards and best practices within the data More ❯

Job Title: Data Engineer Location: York (once a week) Department: Data & Business Intelligence Salary: £55,000 - 60,000 + Excellent Benefits Type: Full-Time, Permanent About the Role: WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As a Data Engineer, you will help shape and deliver the future of data … pipelines and high-quality data assets in line with designs, with progress updated via JIRA and any blockers identified and escalated. Ensure all data pipeline and quality issues are tracked with recommendations made for strategic improvements where there are repeated or high impacting issues Promote standards and best practices within the data More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

Data Engineer Join the Team Powering the Future of Data at Vivedia Location: Sheffield - Hybrid (3 days per week) Salary : £50,000 to £60,000 depending on experience Department: Data Team At Vivedia , data isn’t just numbers — it’s the engine driving every decision, every innovation, and every customer experience. We … re growing, and we’re looking for a Data Engineer who’s ready to build the foundations of a smarter, more connected future. Why You’ll Love This Role You’ll play a pivotal role in designing, building, and optimizing the data systems that power our business. From robust pipelines to scalable platforms, your work will … help every team at Vivedia unlock insights, drive performance, and make data-driven decisions that matter. This is your chance to shape the future of our data ecosystem — and see your impact ripple across an entire organisation. What You’ll Do Build the backbone of our data universe Design, develop, and deploy scalable, secure More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Senior Data Engineer to play a key role in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from … scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect for you. This is a unique opportunity to influence the data strategy and define data architecture from the outset … ll work in a collaborative, forward thinking environment where innovation is encouraged, with flexible working arrangements and opportunities for professional growth. Responsibilities Design, build, and optimise scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Senior Data Engineer to play a key role in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from … scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect for you. This is a unique opportunity to influence the data strategy and define data architecture from the outset … ll work in a collaborative, forward thinking environment where innovation is encouraged, with flexible working arrangements and opportunities for professional growth. Responsibilities Design, build, and optimise scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

Senior Data Engineer - Greenfield AWS Role Leeds (Hybrid) £75,000-£85,000 Our client is a nationally recognised leader in their industry, operating across the UK with a strong reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support enterprise-wide … transformation and insight-driven decision-making. The Role: We are seeking a Senior Data Engineer to play a key role in the design, build, and implementation of a new enterprise data platform as the business migrates to AWS. You will work closely with architects, analysts, and data scientists to develop robust, scalable, and secure … data solutions that enable analytics, AI, and advanced insights. This role is ideal for an ambitious engineer who wants to take ownership of technical delivery and grow into a Lead Data Engineer position within 12-18 months as the team expands through the next phase of the company's data strategy. Senior Data More ❯

Data Engineer £60,000 – £75,000 Hybrid (1 day per week in Leeds) My client is an established and fast-growing e-commerce business based in the heart of Leeds. Over the past few years, they’ve invested heavily in digital transformation and are now entering a new phase of growth — building a modern, data-driven … foundation to power decision-making across every part of the business. They’re now looking for an experienced Data Engineer to help design and implement their new data environment from the ground up. This is a rare opportunity to shape the architecture, tooling, and best practices within a company that’s genuinely open to new ideas … automated, analytics-led environment. Skills & Experience Proven experience as a Data Engineer within a modern data or cloud environment. Strong knowledge of ETL/ELT pipeline design and data modelling. Experience with Snowflake (or similar cloud-based data warehouse solutions). Familiarity with integration and automation tools such as Boomi, Celigo More ❯

Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, Python, Power BI. Job Summary The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, Power BI and Python. The role … involves designing, developing, and maintaining data pipelines and ETL processes while ensuring high performance and scalability of data solutions. (1.) Key Responsibilities 1. Lead the end-to-end technical implementation of data projects using azure data factory, azure databricks, sql, oracle pl/sql, Power BI and python. 2. Design and develop … efficient and reliable etl processes for large datasets. 3. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions. 4. Optimize data workflows, troubleshoot issues, and ensure data quality and integrity. 5. Implement best practices for data security, governance, and compliance. 6. Provide technical guidance, mentoring, and support to More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

+ Bonus + 10% Pension + 26 days Holiday + Bupa Healthcare - LeedsWe are looking for a highly motivated and skilled SQL Developer to join an established data/BI team based in central Leeds.This exciting opportunity will suit a talented SQL Developer who is well versed in the Microsoft Stack. You will be working in an established … Data team of 16, who contribute to smooth running of a multi-million pound organisation with over 2000 employees.You will be working in a team comprised of DBAs, BI and SQL developers working on a range of projects using the latest technologies. They are a big believer in sharing thoughts and encouraging and supporting innovation and creativity. You … to be involved in all aspects of the project process from conception through to completion and launch.SQL Developer Key skills:* SQL Server* Cloud platforms, ideally Azure* Data pipeline tools, SSIS/Spark* Data warehousing and data modelling principles* ETL* MS Fabric* PythonYou will be a motivated SQL Developer with good communication skills and More ❯

Job Title: Senior Data Engineer Salary: Up to £65,000 Location: Leeds (Hybrid - 2 days a week in the office) Are you a data engineering expert ready to take the next step in your career? We're hiring a Senior Data Engineer to join our growing team in Leeds. You'll play a critical … role in designing, building, and managing modern data pipelines and cloud-based data solutions. What you'll be doing: Designing and maintaining scalable data pipelines Building and optimising data warehousing solutions Working with Databricks … and modern cloud platforms (Azure or AWS) Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline architecture What we're looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with Azure or AWS cloud More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

Senior Data Engineers with a background are required by this major client, as they continue to expand their engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

still contributing to the codebase. Key Responsibilities Lead the design, development, and testingof secure, scalable systems using Java with modern front-end frameworks (e.g., React) Architect and maintainAPIs, data pipelines, and cloud-native solutions(AWS, Azure, private cloud) Drive adoption ofDevOps practices CI/CD, containers, infrastructure-as-code Guide and mentor engineers, promotingbest practice, clean coding, and More ❯

Junior Data Engineers are required by this major client, as they continue to build the cloud engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants to hold … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Junior Data Engineer roles you must be able to demonstrate the following experience: Commercial experience gained in a Data Engineering role on any major cloud platform (Azure, AWS or … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our client’s data … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

Lead Business Systems Analyst Location: Sheffield – Site Based Monday - Friday Salary: Competitive Are you passionate about transforming data into actionable insights and aligning business applications with organisational goals? Our key client, a forward-thinking company based in Sheffield, is looking for a proactive and experienced Lead Business Systems Analyst to take ownership of business intelligence, data … ll combine strong technical expertise with the ability to engage and influence stakeholders at all levels. Acting as both a technical lead and internal consultant, you’ll ensure data systems drive efficiency, accuracy and informed decision-making across the organisation. Key Responsibilities Act as the go-to expert for ERP processes, providing guidance on functionality, integration and business … alignment Chair ERP improvement meetings and champion best practice across teams Design, develop and maintain scalable data models, pipelines and dashboards using Microsoft Fabric, Power BI, SSRS and SQL Collaborate with business leaders to understand requirements and deliver clear, actionable insights Translate complex technical challenges into practical business solutions Integrate data from ERP and third-party More ❯