1 to 25 of 100 Data Pipeline Jobs in the North of England

Job summary We are looking for an experienced Senior Data Engineer with … strong technical expertise and innovative mindset to drive our team forward. Main duties of the job Data Engineer will be involved in the entire data pipeline from data acquisition to data extraction, ensuring that the data is accurate, reliable, and accessible, and fit-for-purpose for business intelligence, analytics … and data science functions. Data Engineer will be collaborating with cross-functional teams to support the delivery of impactful analytics work for our clients. About us We are the official research support team for the NHS Benchmarking Network, working with over 300 healthcare organisations across the UK to identify opportunities for service development and quality improvement. More ❯

Job summary Join NHSBSA as an Apprentice Data Engineer and gain hands-on experience building and maintaining data pipelines while studying for a Level 5 qualification. You'll support data sourcing, transformation, and integration under expert guidance, ensuring data is accurate, secure, and accessible. Collaborate with analysts, engineers, and governance teams to … deliver data solutions. You'll develop coding, documentation, and troubleshooting skills, and apply data protection principles. This hybrid role includes remote work and regular office visits in Newcastle. Ideal for someone curious, detail-oriented, and eager to learn in a supportive, innovative environment. What do we offer? o Hybrid working - offering flexibility to work predominantly from … your loved oneso Access to a wide range of benefits and high street and online discounts Main duties of the job Support the design, build, and testing of data pipelines using multiple data sources. Assist in creating reusable data products and maintaining accurate documentation. Learn and apply data protection and governance principles. More ❯

Peaple Talent has partnered with a global digital engineering consultancy who are recruiting for a Lead Data Engineer on a permanent basis based out of their Sunderland office. You will have a great understanding of technology consultancy services along with fantastic communication and stakeholder engagement skills as this role will be client facing. Skills and experience: Proven experience … as a Lead Data Engineer with a focus on Azure cloud services. Experience of managing small teams whilst also being hands-on. Strong database fundamentals including SQL/TSQL, performance and schema design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure … Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary documentation. Proficiency in working with APIs and integrating them into More ❯

A Manchester based FMCG is seeking a highly skilled Senior/LeadData Engineer to join their growing data team. This role will be instrumental in designing, building, and maintaining a modern data warehouse and data infrastructure to support advanced analytics and reporting needs for a fast-growing organisation. Key Responsibilities: Design, develop, and maintain … scalable data pipelines using SQL and Python (PySpark) . Ingest, transform, and curate data from multiple sources into Azure Data Lake and Delta Lake formats. Build and optimize datasets for performance and reliability in Azure Databricks . Collaborate with analysts and business stakeholders to translate data requirements into robust technical solutions. Implement … and maintain ETL/ELT pipelines using Azure Data Factory or Synapse Pipelines . Design and develop a fit-for-purpose enterprise data warehouse to serve reporting and analytics. Ensure data quality, data integrity, and adherence to governance policies. Monitor and troubleshoot production jobs and processes. Preferred Skills & Experience: Strong proficiency in More ❯

Senior Data Engineer - AWS Leeds/Hybrid, c. 2x per week Salary - Competitve/Negotiable The Role Joining one of the best tech consultancies in the North. The Senior Data Engineer role focuses on the production of scalable and robust data solutions for clients, through conception, deployment and their ongoing evolution. Working closely with … stakeholders across the business - including product managers, analysts, and software developers you will ensure seamless data integration and reporting capabilities to support informed decision-making. The role focuses on building and optimising data pipelines, managing data warehousing, and ensuring high-quality data availability for business insights. You will be instrumental in enabling … efficient data processing, transformation, and analysis through best-in-class technologies and methodologies. Your ability to design scalable data solutions, solve problems creatively, and collaborate with both technical and non-technical teams will be crucial to success. While technical expertise is at the core of the role, strong communication skills and a proactive mindset are equally More ❯

Role: Senior Data Engineer - AWS Location: Leeds/Hybrid, c. 2x per week Contract: Outside IR35, Competitive Daily Rate Duration: 6 months The Role: Joining one of the best tech consultancies in the North. The Senior Data Engineer role focuses on the production of scalable and robust data solutions for clients, through conception, deployment … and their ongoing evolution. Working closely with stakeholders across the business - including product managers, analysts, and software developers you will ensure seamless data integration and reporting capabilities to support informed decision-making. The role focuses on building and optimising data pipelines, managing data warehousing, and ensuring high-quality data availability for business … insights. You will be instrumental in enabling efficient data processing, transformation, and analysis through best-in-class technologies and methodologies. Your ability to design scalable data solutions, solve problems creatively, and collaborate with both technical and non-technical teams will be crucial to success. While technical expertise is at the core of the role, strong communication More ❯

hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Looking at our current pipeline of work, we can also consider those with an Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry More ❯

Senior Data Engineer An exciting opportunity has arisen for a Senior Data Engineer to join my clients dynamic and growing data team. In this role, you will work across the full data lifecyclestreaming, enrichment, and curationwithin a cloud-based environment. You will be responsible for ensuring data quality, integrating key … data sets, and supporting the insights and data science teams. As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access to advanced training in ML Ops. Key Responsibilities: Automate and maintain data pipelines within a cloud-based environment (AWS/GCP/Azure … . Source and verify data from multiple sources, ensuring it is ready for ingestion. Gain experience in data infrastructure and contribute to the development of new cloud-based methodologies. Analyse large datasets using Python and SQL. Set up new pipelines for data streaming, enrichment, and curation. Manage and maintain source code repositories (GitHub). More ❯

Senior Data Engineer An exciting opportunity has arisen for a Senior Data Engineer to join my client’s dynamic and growing data team. In this role, you will work across the full data lifecycle—streaming, enrichment, and curation—within a cloud-based environment. You will be responsible for ensuring data quality, integrating key data sets, and supporting the insights and data science teams. As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access to advanced training in ML Ops. Key Responsibilities: Automate and maintain data pipelines within a cloud-based environment … AWS/GCP/Azure). Source and verify data from multiple sources, ensuring it is ready for ingestion. Gain experience in data infrastructure and contribute to the development of new cloud-based methodologies. Analyse large datasets using Python and SQL. Set up new pipelines for data streaming, enrichment, and curation. Manage and maintain More ❯

DEPT/AI has a single mission: to make the best work in the industry using Data & AI to enhance everything we do. This role sits within our Data & AI practice, which has deep expertise in leveraging AI. The team includes data strategists, consultants, data scientists and analysts that work alongside DEPT … and most challenging problems facing some of the best loved brands in the world - and doing this alongside an experienced team. This role is part of our EMEA Data craft team, an integrated craft across Europe driving data engineering, data science, and AI initiatives. We combine our expertise in data architecture, analytics … and AI to deliver exceptional data-driven solutions that build lasting relationships with our clients like Footlocker, Nikon, Rituals, and Philips ROLE OVERVIEW The Lead Data Engineer is responsible for building and leading our data engineering capabilities across EMEA and setting technical standards. This senior technical leadership role will drive the strategic vision for More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talented Lead … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … the delivery of robust and reusable data pipelines using AWS technologies such as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talentedLead Data … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talentedLead Data … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Senior Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £58,000 - 63,000 + Excellent Benefits Type: Full-Time, Permanent About the Role: WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We areseeking a Senior Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As a Senior Data Engineer, you will help shape and deliver the future of data … projects using JIRA and Confluence. Support and mentor other engineers, promoting best practice, reusability, and consistent standards across the data landscape. Troubleshoot and resolve data pipeline issues, identifying long-term solutions to recurring challenges. Help grow a strong data culture through technical leadership, training, and cross-team collaboration. Key Requirements: Essential: 3+ years More ❯

a range of benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We're looking for a Senior Data Engineer to join the Asset Data & Insights value stream. You'll lead the design, development and operations of robust, scalable data pipelines using modern cloud … technologies-empowering real-time analytics, advanced BI, and data-driven decision-making across SSE Thermal. You'll need hands-on expertise with the Databricks ecosystem, a strong command of data engineering best practices, and a growth mindset that balances technical excellence with collaboration and continuous improvement. Experience in an asset-intensive or energy environment is desirable … Delta Live Tables, Unity Catalog) to serve downstream analytics and reporting. - Optimise data architecture for performance, scalability, and reliability, proactively monitoring data health and troubleshooting pipeline issues. - Mentor junior engineers and foster a knowledge-sharing culture through documentation, pairing, and architectural guidance. - Collaborate with analysts, product teams, and business stakeholders to translate requirements into performant More ❯

Data Engineering Manager Location: Leeds (Mostly Remote 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We re looking for a Lead Data Engineer to join our team based in Leeds, working mostly remotely with just one day … on-site per week. You ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our team based in Leeds, working mostly remotely with just one day … on-site per week. You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python — it’s for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. … particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly … RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). Understanding More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly … RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). Understanding More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python — it’s for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. … particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). More ❯