1 to 25 of 36 Permanent Data Pipeline Jobs in Yorkshire

Senior Data Engineer - AWS Leeds/Hybrid, c. 2x per week Salary - Competitve/Negotiable The Role Joining one of the best tech consultancies in the North. The Senior Data Engineer role focuses on the production of scalable and robust data solutions for clients, through conception, deployment and their ongoing evolution. Working closely with … stakeholders across the business - including product managers, analysts, and software developers you will ensure seamless data integration and reporting capabilities to support informed decision-making. The role focuses on building and optimising data pipelines, managing data warehousing, and ensuring high-quality data availability for business insights. You will be instrumental in enabling … efficient data processing, transformation, and analysis through best-in-class technologies and methodologies. Your ability to design scalable data solutions, solve problems creatively, and collaborate with both technical and non-technical teams will be crucial to success. While technical expertise is at the core of the role, strong communication skills and a proactive mindset are equally More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talented Lead … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … the delivery of robust and reusable data pipelines using AWS technologies such as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talentedLead Data … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talentedLead Data … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Senior Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £58,000 - 63,000 + Excellent Benefits Type: Full-Time, Permanent About the Role: WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We areseeking a Senior Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As a Senior Data Engineer, you will help shape and deliver the future of data … projects using JIRA and Confluence. Support and mentor other engineers, promoting best practice, reusability, and consistent standards across the data landscape. Troubleshoot and resolve data pipeline issues, identifying long-term solutions to recurring challenges. Help grow a strong data culture through technical leadership, training, and cross-team collaboration. Key Requirements: Essential: 3+ years More ❯

a range of benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We're looking for a Senior Data Engineer to join the Asset Data & Insights value stream. You'll lead the design, development and operations of robust, scalable data pipelines using modern cloud … technologies-empowering real-time analytics, advanced BI, and data-driven decision-making across SSE Thermal. You'll need hands-on expertise with the Databricks ecosystem, a strong command of data engineering best practices, and a growth mindset that balances technical excellence with collaboration and continuous improvement. Experience in an asset-intensive or energy environment is desirable … Delta Live Tables, Unity Catalog) to serve downstream analytics and reporting. - Optimise data architecture for performance, scalability, and reliability, proactively monitoring data health and troubleshooting pipeline issues. - Mentor junior engineers and foster a knowledge-sharing culture through documentation, pairing, and architectural guidance. - Collaborate with analysts, product teams, and business stakeholders to translate requirements into performant More ❯

Data Engineering Manager Location: Leeds (Mostly Remote 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We re looking for a Lead Data Engineer to join our team based in Leeds, working mostly remotely with just one day … on-site per week. You ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our team based in Leeds, working mostly remotely with just one day … on-site per week. You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python — it’s for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. … particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

About The Role Hippo is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo's Principal Data Engineers are experts in their field. You will act as … a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others. Please note, we are looking for candidates who are looking for growth at this level (principal), therefore the advertised salary band is the … team and stakeholders, identifying and ensuring that challenges are overcome Lead in the recruitment of other engineers, and support other consultants in their professional development Ensure Hippo's Data and Engineering communities contribute to Hippo's business at a strategic level Lead on new business opportunities, writing technical bids and proposals Promote Hippo's Data Herd More ❯

days in office Leeds £60K We are looking for a BI Developer to join our clients team in Leeds. The ideal candidate will have experience in PowerBI, Data Engineering, and have a strong understanding of data warehousing and business intelligence. The role will involve working with a team of data engineers to design, develop … and maintain data pipelines. You will also be responsible for creating and managing data models, and developing reports and dashboards using PowerBI. The successful candidate will be a highly motivated and self-directed individual with excellent communication and teamwork skills. They will also have a strong understanding of data analysis and visualization techniques. Responsibilities … Create and manage data models Designing, developing, testing, and implementing robust data applications powered by cutting-edge technologies like Azure DataFactory, PowerBI, Qlikview, and SSRS. Develop reports and dashboards using PowerBI Work with a team of data engineers to improve data quality and performance Provide technical support to users of PowerBI Qualifications More ❯

AWS Data Engineer - Manchester - Hybrid We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about building scalable … data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You … ll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such as S3, Glue, Lambda More ❯

A small and growing consultancy who are delivering cutting-edge data solutions for high-profile clients, are now looking for a hands-on Data Engineer to join their talented delivery team. This is a fantastic opportunity to work with a modern data stack - including Snowflake , dbt , AWS , Python , and SQL - on impactful projects that … to someone with a self-starter mentality, who wants to be part of company that is growing and maturing whilst continually learning. Key responsibilities: Designing and building robust data pipelines using SQL, dbt, and Python within Snowflake Developing scalable, testable, and maintainable code Collaborating with analytics, product, and client teams to deliver high-quality data solutions … Supporting the development of data products like dashboards, APIs, and predictive models Driving automation and operational efficiency through data tooling Contributing to internal best practices and agile delivery processes Experience required: Proven experience as a Data Engineer or Analytics Engineer Strong experience with Snowflake Hands-on experience with dbt Proficiency in Python and SQL More ❯

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯

Location: Leeds City Centre + Hybrid Working Job Type: Full-time Team: Product Reports to: Head of Product Development About Us: We use data science and AI to help retailers make profitable pricing, marketing and retail media decisions. Put simply, we help retailers sell the right products, to the right people, for the right price. We offer a … 2+ years of experience in a business intelligence development or related role Excellent SQL skills Good understanding of relational and analytical database architectures and methodologies Experience of cloud data warehousing solutions e.g. Snowflake, BigQuery, Redshift Good hands-on experience with at least one Business Intelligence platform Strong analytical and problem-solving skills Excellent communication skills, with the ability … to explain technical details to non-technical stakeholders Comfortable with occasional client interaction in a professional and supportive capacity Great UX & data visualisation skills The Role: Design, develop and maintain BI solutions including dashboards, reports and data models Produce visually engaging deliverables for consumption by retail clients Write complex SQL queries and scripts for data More ❯

Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The … the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. Manage the adoption of automated … experience in a managerial role, coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day More ❯

AWS Data Engineer - IT Consultancy - Leeds - Hybrid Are you a data engineer with a passion for AWS and solving real-world business problems? I am working with a fast-growing IT consultancy based in Leeds that's delivering cutting-edge cloud and data solutions to clients across the UK. They're looking for their … next AWS Data Engineer to join the team. As an AWS Data Engineer, you'll be working on a variety of client projects, helping to design, build, and optimise scalable data pipelines and cloud-native architectures. You'll collaborate with cross-functional teams to deliver high-impact solutions that drive business value. Requirements: Experience … as a Data Engineer using AWS: Glue, Lambda, S3, Redshift, Athena, EMR. Snowflake experience (Not essential) Strong Python SQL & NoSQL databases CI/CD tools : GitHub Actions or CodePipeline Infrastructure as Code (Terraform is preferable) Experience building ETL/ELT pipelines Familiarity with data lake and data warehouse concepts Excellent communication and stakeholder engagement More ❯

Data Engineer – Leeds– SQL | Power BI | Azure | ETL Ready to drive innovation with T-SQL and BI, shaping a cutting-edge data platform? Do you have the expertise to build and maintain complex data warehouses and Power BI solutions? Excited to solve BI challenges and support data-driven decision-making across the … business? A fantastic new opportunity has arisen with a professional services company for an experienced Data Engineer. You'll be joining a growing team with offices across the UK, committed to ambitious growth and employee wellbeing. This role is based in their Leeds office, offering hybrid working. What's in it for you? Salary up to … Factory to ensure the warehouse can support large-scale reporting and analytics needs. Your T-SQL expertise will be crucial for managing complex queries and troubleshooting data pipeline issues. Key Skills: SQL/T-SQL Power BI or Tableau Experience with data warehousing and ETL/ELT processes Azure If you're passionate about shaping More ❯

A fantastic opportunity has arisen for a Data Analyst to join a business in Pocklington. In this key role, you will be responsible for capturing, analysing, and reporting data to optimise supply chain efficiency, biological asset management, and commercial decision-making. This position offers the chance to provide valuable insights that drive business performance and strategic … growth. The Role Reporting to the Head of Optimisation, the Data Analyst will generate data-driven insights to enhance performance across the business. This is an excellent opportunity for a data professional to contribute to innovative projects within the food production and agriculture sector. The role is full-time and permanent, offering a salary … between £35,000 - £40,000 and exciting opportunities for career development within a dynamic, forward-thinking environment. You will be involved in cutting-edge data projects that are shaping the future of food production. Key Responsibilities: Ensure accurate and timely data capture across the entire supply chain. Develop and maintain automated data pipelines to More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Senior Data Engineer - Azure - Leeds I'm looking for a Senior Azure Data Engineer for a client near to Leeds. The company are building a greenfield Data Platform in Azure and Snowflake and so looking for someone who has been heavily involved in building end to end data platforms in Azure using … Synapse, Data Factory, Data Lake and SQL. Role & Responsibilities Building end to end data pipelines in Azure (Data Factory and SQL) Building workflows in SQL, Spark and DBT Data and dimensional modelling Skills & Qualifications Azure Data factory, Synapse and SSIS Python/Park/PySpark Ideally Snowflake and More ❯

for a skilled Business Intelligence Developer to be part of that journey from the ground up. The Opportunity This is a brand-new role within a growing BI & Data function. You'll be joining a small but expanding team at a key stage in their evolution. Working closely with business stakeholders, you'll play a critical role in … helping the organisation unlock the value of its data-delivering insights that drive real change and strategic decision-making. It's a genuinely exciting time to join. Backed by strong financial investment, the business is undergoing major digital and technological transformation-meaning you'll have the opportunity to shape the BI landscape, grow your skillset, and play a … meaningful role in future developments. What You'll Be Doing: Partnering with business users to understand data requirements and translate them into meaningful dashboards and reports. Designing, developing, and maintaining BI solutions using Power BI (with DAX) , SQL , and Excel . Working across the full BI stack-including SSIS (ETL) , SSAS , and SSRS -to build robust data More ❯

for a skilled Business Intelligence Developer to be part of that journey from the ground up. The Opportunity This is a brand-new role within a growing BI & Data function. You'll be joining a small but expanding team at a key stage in their evolution. Working closely with business stakeholders, you'll play a critical role in … helping the organisation unlock the value of its data-delivering insights that drive real change and strategic decision-making. It's a genuinely exciting time to join. Backed by strong financial investment, the business is undergoing major digital and technological transformation-meaning you'll have the opportunity to shape the BI landscape, grow your skillset, and play a … meaningful role in future developments. What You'll Be Doing: Partnering with business users to understand data requirements and translate them into meaningful dashboards and reports. Designing, developing, and maintaining BI solutions using Power BI (with DAX) , SQL , and Excel . Working across the full BI stack-including SSIS (ETL) , SSAS , and SSRS -to build robust data More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and governance of data. This role will work closely with business … and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers, business stakeholders, and data stewards. Please Note: This is role for UK residents only. This role does not offer Sponsorship. You must have the right to work in More ❯