26 to 50 of 118 Data Pipeline Jobs in the North of England

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talented Lead … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … the delivery of robust and reusable data pipelines using AWS technologies such as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talentedLead Data … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Lead Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £66,000 - 71,000 + Excellent Benefits Type: Full-Time, Permanent About the Role WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talentedLead Data … strategic input on data architecture. Prioritise and track data sourcing activities through JIRA and Confluence. Design delivery plans and oversee execution of data pipeline and asset development. Collaborate across business units to identify opportunities for data reuse, efficiency, and innovation. Mentor and upskill data engineers, analysts, and scientists across … experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such as Alteryx, AWS Athena, Quicksight, Sagemaker, Tableau, and Power BI. More ❯

Job Title: Senior Data Engineer Location: York (Hybrid Working Available) Department: Data & Business Intelligence Salary: £58,000 - 63,000 + Excellent Benefits Type: Full-Time, Permanent About the Role: WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We areseeking a Senior Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As a Senior Data Engineer, you will help shape and deliver the future of data … projects using JIRA and Confluence. Support and mentor other engineers, promoting best practice, reusability, and consistent standards across the data landscape. Troubleshoot and resolve data pipeline issues, identifying long-term solutions to recurring challenges. Help grow a strong data culture through technical leadership, training, and cross-team collaboration. Key Requirements: Essential: 3+ years More ❯

a range of benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We're looking for a Senior Data Engineer to join the Asset Data & Insights value stream. You'll lead the design, development and operations of robust, scalable data pipelines using modern cloud … technologies-empowering real-time analytics, advanced BI, and data-driven decision-making across SSE Thermal. You'll need hands-on expertise with the Databricks ecosystem, a strong command of data engineering best practices, and a growth mindset that balances technical excellence with collaboration and continuous improvement. Experience in an asset-intensive or energy environment is desirable … Delta Live Tables, Unity Catalog) to serve downstream analytics and reporting. - Optimise data architecture for performance, scalability, and reliability, proactively monitoring data health and troubleshooting pipeline issues. - Mentor junior engineers and foster a knowledge-sharing culture through documentation, pairing, and architectural guidance. - Collaborate with analysts, product teams, and business stakeholders to translate requirements into performant More ❯

Data Engineering Manager Location: Leeds (Mostly Remote 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We re looking for a Lead Data Engineer to join our team based in Leeds, working mostly remotely with just one day … on-site per week. You ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our team based in Leeds, working mostly remotely with just one day … on-site per week. You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly … RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). Understanding More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly … RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). Understanding More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly … RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). Understanding More ❯

We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You … will provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a … culture of innovation, collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using More ❯

We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You … will provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a … culture of innovation, collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

dynamic environment. About the Role: Full-Stack Development : Design, build, and maintain both front-end and back-end components for our SaaS security platform, with particular emphasis on data processing and analytics systems Data Engineering: Build and optimize data pipelines, ETL processes, and real-time data streaming systems to support security analytics … and intelligence. Data Architecture: Design and implement scalable data storage solutions, including databases, data warehouses, and distributed data systems. Security Focus : Work on security-related features, integrating cutting-edge security protocols, and building tools that help secure our customers' data and infrastructure. Collaboration : Work closely with other engineers, product managers … technologies, and best practices, and contribute ideas to the development of new security features. Key Qualifications: 1-2 years of experience in software development. Experience with data pipeline development and optimization (ETL/ELT processes). Solid understanding of distributed systems, databases,(PostgreSQL, Databricks, Clickhouse, ElasticSearch), and performance tuning. Familiarity with modern web frameworks and front-end More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

About The Role Hippo is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo's Principal Data Engineers are experts in their field. You will act as … a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others. Please note, we are looking for candidates who are looking for growth at this level (principal), therefore the advertised salary band is the … team and stakeholders, identifying and ensuring that challenges are overcome Lead in the recruitment of other engineers, and support other consultants in their professional development Ensure Hippo's Data and Engineering communities contribute to Hippo's business at a strategic level Lead on new business opportunities, writing technical bids and proposals Promote Hippo's Data Herd More ❯

About The Role Hippo is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo's Principal Data Engineers are experts in their field. You will act as … a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others. Please note, we are looking for candidates who are looking for growth at this level (principal), therefore the advertised salary band is the … team and stakeholders, identifying and ensuring that challenges are overcome Lead in the recruitment of other engineers, and support other consultants in their professional development Ensure Hippo's Data and Engineering communities contribute to Hippo's business at a strategic level Lead on new business opportunities, writing technical bids and proposals Promote Hippo's Data Herd More ❯

Senior Data Scientist at AJ Bell (Sponsorship Available) AJ Bell is looking for an experienced and driven Senior Data Scientist to join its dynamic team in Manchester, United Kingdom. This is a fantastic opportunity to contribute to data-driven innovation within one of the UK's leading investment platforms. Visa sponsorship may be available … for exceptional candidates. The ideal candidate will have a minimum of 5 years' experience in data science or a related field, with extensive knowledge of advanced statistical analysis and machine learning algorithms. Proficiency in Python, R, and SQL is essential. As a Senior Data Scientist, you will play a key role in developing data … and enhance operational efficiency. Join AJ Bell and be part of a forward-thinking organisation that values expertise, innovation, and continuous learning in a collaborative environment. Position: Senior Data Scientist Job Type: Full-Time Location: Manchester About the Role Hackajob is partnering with AJ Bell to fill this position. Create a profile to be automatically considered for this More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯