1 to 25 of 43 Data Pipeline Jobs in the North West

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and … continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide … engineering solutions and provide comprehensive reports. Identify and address performance bottlenecks, optimise data processing and query performance for scalability. Implement monitoring frameworks to oversee data pipeline health, swiftly resolving issues to maintain system integrity. Conduct performance tuning to fulfil scalability and availability targets. Develop and enforce stringent data security measures, including access controls More ❯

with a flexible, student-powered workforce. The platform enables partnersfrom local pubs to multinational chainsto optimise staffing in real-time, enhancing efficiency and profitability. The Role As a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Building and Maintaining Data Pipelines: Design and implement scalable … data scientists, software engineers, and internal stakeholders to understand data needs and deliver solutions that drive data-driven decisions. Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What Youll Bring Technical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such … architecture, data modelling, and scalable data solutions. Backend Development: Willingness to develop proficiency in backend technologies (e.g., Python with Django) to support data pipeline integrations. Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker. Data Quality Management: Experience with data versioning and quality More ❯

Data Manager–£36,000- £47,000 + Benefits– Liverpool, L3 The Role Are you experienced in managing clinical data and ensuring its accuracy? Do you have the technical skills to handle imaging-related datasets and streamline workflows with Python?If so, this could be the perfect opportunity for you! We are MyCardium AI , an innovative company … at the forefront of cardiac imaging and AI technology. We are now seeking a Data Manager to join our growing team in Liverpool. You will be responsible for managing the lifecycle of clinical study data, ensuring accuracy, compliance and smooth data handling processes. Working closely with project managers, imaging analysts and sponsor representatives, you … will help ensure that study data is reliable, secure and supports high-quality clinical outcomes. If this sounds like the right opportunity for you, we'd love to hear from you. Apply today and join us on our journey to transform healthcare with AI. This role is 4 days office based (Liverpool)/1 day WFH. Key Responsibilities More ❯

Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote Industry: Retail & eCommerce Role: Senior Data Engineer Location: Remote Salary: £65,000 Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid growth and investing heavily in data, analytics, and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. Enabling & empowering smarter insights and creating … seamless customer experiences. The Role As a Senior Data Engineer, you'll be a key player in building and evolving a modern Azure-based data platform that underpins decision-making across the business. The Senior Data Engineer will design, deliver, and optimise scalable data solutions, ensuring the right data is More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Data Engineer - Manchester - £55,000 + Bonus The Company: Lorien Global are working with one of the biggest names in the North West. Having recently completed a large-scale migration, the business is now investing in data to unlock new products, smarter technologies, and unrivalled customer experiences on a global scale. The Role: We're looking … for a Data Engineer to join the growing Data Engineering team, playing a key role in maintaining and evolving a modern AWS-based data platform. You'll be designing and optimising pipelines, supporting the migration of the existing SQL Server Data Warehouse to AWS, and helping to deliver scalable, real-time data … technologies and apply them where relevant The Skill Requirements: Hands-on experience with AWS services (Glue, Lambda, S3, Redshift, EMR) Strong skills in Python, SQL, PySpark and pipeline orchestration Proven understanding of data warehousing and data lakehouse concepts Excellent problem-solving skills with the ability to resolve performance bottlenecks Clear communicator, comfortable working More ❯

Lead Cloud Data Engineer – Liverpool – Hybrid - £70k A well-established professional services business that's modernising their data infrastructure and embracing cloud-first technologies are looking for a Lead Cloud Data Enigneer. Based Liverpool City Centre, they're investing significantly in their data capabilities to enhance client services, improve operational efficiency, and … drive strategic decision-making through advanced analytics and robust data management practices. The Role They're looking for an exceptional Lead Cloud Data Engineer to spearhead their data engineering initiatives and drive technical excellence across their cloud infrastructure. You'll be architecting sophisticated data solutions that power critical business operations whilst leading … dataset processing Deep understanding of data security frameworks, encryption protocols, access management and regulatory compliance Proven track record building automated, scalable ETL frameworks and data pipeline architectures Outstanding analytical and problem-solving abilities with talent for converting business needs into technical solutions Excellent stakeholder management and documentation skills Team leadership experience with ability to mentor More ❯

Our top telecoms client is looking for a Data Engineer to join their team on a staff or contract basis Our Client has a requirement for a Data Engineer, who will be required to work on a staff or contract basis in Irlam (Manchester). Role Purpose: The BI Data Engineer will be responsible … for leading and developing and reporting views to ensure data-driven insights are underpinned by a validated dataset, aligning to the data definitions set out by the business. In addition, this role will focus on data engineering, building and managing the infrastructure that allows Freedom Fibre to collect, store, and analyse data. The role … will involve designing, building, and maintaining databases to ensure data is readily available, reliable, and efficient for various purposes, including data science and business intelligence. This will also include developing and maintaining API integrations with systems to extract and load data into the database. The role will also be responsible for designing, developing, and More ❯

Data Engineer – Unlock Insights, Drive Performance Job Title: Data Engineer Salary: £44,133 – £55,166 plus bonus Contract: Permanent Hours: Full-time, Monday to Friday About Graham & Brown Welcome to Graham & Brown, where creativity, innovation, and data-driven decision-making combine to deliver exceptional outcomes for our customers worldwide. Since 1946, we've been … paint, and home décor products, serving both retail and commercial markets across multiple channels and international sites. At Graham & Brown, we value curiosity, collaboration, and continuous improvement. Our data and analytics capabilities are central to our business, enabling smarter decisions, seamless operations, and better customer experiences. Joining us means being part of a dynamic, forward-thinking team where … your technical expertise has a real impact on global operations and growth. The Role We are seeking a skilled and proactive Data Engineer to join our IT and Data & Analytics team. You will be responsible for designing, building, and maintaining data pipelines and integrations as we migrate our data warehouse from Microsoft More ❯

Data Scientist (Hybrid - Manchester) A growing data and analytics company is on the lookout for a Data Scientist to take ownership of its monitoring and alerting infrastructure. This is a fantastic opportunity to play a hands-on role in designing scalable solutions that safeguard data quality and system reliability across a suite … solving complex problems, and wants to shape how monitoring is done across multiple projects and departments. Key Responsibilities: Design and build robust monitoring and alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical … models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience More ❯

Data Scientist (Hybrid - Manchester) A growing data and analytics company is on the lookout for a Data Scientist to take ownership of its monitoring and alerting infrastructure. This is a fantastic opportunity to play a hands-on role in designing scalable solutions that safeguard data quality and system reliability across a suite … solving complex problems, and wants to shape how monitoring is done across multiple projects and departments. Key Responsibilities: Design and build robust monitoring and alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical … models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience More ❯

to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on!?? The TeamWe're Intuita - a fast-growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … an interesting insight into projects spanning a variety of industries, which may include telecoms, insurance, healthcare, finance and mortgages across various sectors.?? The RoleWe are seeking a skilled Data Engineer, ideally Senior experience to join our Data Engineering team, ideally as a permanent consultant opportunity. We can move fast and adapt our selection period to our … permanent rights to work are essential, alongside other factors we'll consider. This is a hands-on Analytics Engineering role where you'll be at the heart of data-driven decisions. Day to day you will be transforming raw data in clean, reliable and performant data models using dbt within Google Cloud Platform (GCP More ❯

BRAND NEW DATA ENGINEER OPPORTUNITY IN MANCHESTER - HYBRID WORKING Salary up to £55,000 p/a plus bonus & excellent benefits Work on complex, large-scale data pipelines with cutting-edge tech We're looking for strong Python, SQL, and AWS skills, plus experience in ETL processes Hybrid working - 2-3 days in the office ABOUT … SQL, Apache Spark, and AWS services such as EMR, Athena, and Lambda to deliver robust, high-performance solutions.You'll also play a key role in optimising data pipeline architecture, supporting knowledge sharing within the team, and collaborating with stakeholders to translate business requirements into technical solutions. KEY SKILLS/EXPERIENCE: Proven experience as a Data Engineer, with Python & SQL expertise Familiarity with AWS services (or equivalent cloud platforms) Experience with large-scale datasets and ETL pipeline development Knowledge of Apache Spark (Scala or Python) beneficial Understanding of agile development practices, CI/CD, and automated testing Strong problem-solving and analytical skills Positive team player with excellent communication abilities TO BE CONSIDERED More ❯

Role: Data Engineering Manager - Manchester, hybrid The Team: A highly passionate bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models. We are … with them to help protect their information, make informed decisions, deliver a personalised service and automate their workloads. Our engineers might be building data pipelines, modelling data, developing predictive models or automations for repeatable tasks or creation of data products. The role: Your role in the division is to lead the team developing our … be to understand our business data and team capabilities to then expand and improve our Kimball-model data warehouse in Azure, focusing on new datasets, pipeline resilience, performance and security. You will lead and coach the team in deploying tools and processes to ensure good practice is embedded, in line with our strategic themes of More ❯

Data Engineer Location: Manchester (Hybrid) Type: Temporary ongoing - March 2026 Salary: £35-40ph About the Role We're supporting a well-established organisation in the finance sector who are in search of a skilled Data Engineer . This is a fantastic opportunity to join a forward-thinking business that places data at the … centre of its operations and is investing heavily in its analytics capabilities. Role Overview As a Data Engineer, you'll be responsible for developing and maintaining robust data pipelines that support business intelligence and analytics. You'll work closely with stakeholders to understand their data needs and translate them into scalable, SQL-driven workflows. … Your work will directly support strategic decision-making by ensuring data is clean, reliable, and accessible. Key Responsibilities Build and maintain efficient ETL pipelines to support data transformation and integration. Collaborate with business teams to gather requirements and deliver tailored data solutions. Design and implement structured data models and marts for specific More ❯

Data Engineer Location: Manchester (Hybrid) Type: Temporary ongoing - March 2026 Salary: £35-40ph About the Role We're supporting a well-established organisation in the finance sector who are in search of a skilled Data Engineer . This is a fantastic opportunity to join a forward-thinking business that places data at the … centre of its operations and is investing heavily in its analytics capabilities. Role Overview As a Data Engineer, you'll be responsible for developing and maintaining robust data pipelines that support business intelligence and analytics. You'll work closely with stakeholders to understand their data needs and translate them into scalable, SQL-driven workflows. … Your work will directly support strategic decision-making by ensuring data is clean, reliable, and accessible. Key Responsibilities Build and maintain efficient ETL pipelines to support data transformation and integration. Collaborate with business teams to gather requirements and deliver tailored data solutions. Design and implement structured data models and marts for specific More ❯

Lead Data Architect £67,000 - 76,000 GBP Hybrid WORKING Location: Manchester, North West - United Kingdom Type: Permanent Lead Data Architect Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £67,000 - £76,000 (non-London)/Up to £83,000 (London) + Benefits A … respected digital consultancy is hiring a Lead Data Architect to join its growing Data Engineering practice. Known for delivering modern, human-centred services across public and private sectors, this organisation supports clients through meaningful transformation by combining data, design, and engineering. This role is ideal for experienced architects who enjoy shaping cloud-native data platforms, working in multidisciplinary teams, and embedding data governance and architectural rigour across complex service ecosystems. The Role: As a Lead Data Architect, you'll play a key role in designing scalable, secure, and accessible data platforms that enable insight-driven decision-making. You'll work closely with engineering teams and client More ❯

Data Engineer Salary: up to £55,000 Hybrid A forward-thinking organisation is hiring a Data Engineer to join a growing data function that's focused on building a modern, scalable analytics stack. If you're confident in dbt, fluent in SQL, and excited by shaping best practices from the ground up, this could … you'll be a mentor to others Get involved in: Access control strategies within dbt/Snowflake Designing sandbox environments Optimising how analysts interact with the data pipeline Platform improvement initiatives Balance of BAU, adhoc support, and long-term build work Who We're Looking For 1+ years working with dbt in production Confident SQL developer with More ❯

Data Engineer - Generative AI & Secure Data Platforms Hybrid Working | UK-Based | SC Clearance Up to £60k + Paid Overtime + Bonus + Benefits Engineer the Future of Secure AI Innovation Are you ready to use your data engineering skills to build secure, intelligent platforms that power generative AI and national resilience? This is a … hands-on opportunity to join a high-impact, high-trust organisation working on next-gen data platforms. You'll be part of a collaborative international team, helping internal customers unlock the full potential of their data securely and intelligently. What You'll Be Doing Design, deploy, and maintain resilient data pipelines across on-prem … and cloud environments Collaborate with internal teams to optimise and secure sensitive data-sets Ensure compliance with strict data governance and quality standards Contribute to the technology roadmap with insights into emerging tools and platforms Work across SQL, NoSQL, Python, ETL, and big data ecosystems Support projects involving Generative AI, NLP, and OCR What More ❯

with a leading UK consumer goods brand, known nationwide for their products in the home & lifestyle space. With ongoing growth and digital transformation, they are investing heavily in data capabilities to improve business decision-making, customer insight, and operational efficiency. The organisation has already built out a small but capable data team, and they're now … looking to appoint a BI Lead to accelerate their reporting, analytics, and automation strategy.This is a high-impact role where you'll shape how data is delivered across the group, working with stakeholders across Finance, Operations, Marketing, and Commercial to enable smarter, faster decisions. The Role This newly created BI Lead role sits within a growing data … at Harnham via the Apply link on this page. Keywords BI Lead, Business Intelligence Lead, BI Developer, BI Specialist, Data Engineer, Power BI, Azure, Databricks, SQL, Pipelines, Data Visualisation, Self-Service Analytics, Reporting Platform, Consumer Goods, Lancashire, Preston, Burnley, North West, UK Jobs More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

As a Data Engineer , youll design, build, and maintain scalable pipelines and models that ensure data is accurate, accessible, and usable across the organisation. Youll partner closely with analysts, engineers, and business stakeholders, applying modern software development principles and promoting a DataOps culture of automation, reliability, and agility. Key Responsibilities Design, build, and optimise data pipelines across a modern data platform. Ingest, clean, and transform data using tools such as dbt, Snowflake, and Airflow . Collaborate with cross-functional teams to deliver data products aligned to business priorities. Develop scalable data models that support BI and analytics platforms including Tableau and Power BI. Apply robust … queries. Hands-on experience with dbt (including testing and layered modelling). Practical knowledge of Snowflake for loading, transforming, and exporting datasets. Experience building and managing Airflow DAGs for pipeline orchestration. Understanding of BI tool requirements (e.g., Tableau, Power BI) and related performance considerations. Advanced Excel capability, including pivot tables and complex formulas. Familiarity with data modelling More ❯