1 to 25 of 29 Data Pipeline Jobs in Manchester

Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote Industry: Retail & eCommerce Role: Senior Data Engineer Location: Remote Salary: £65,000 Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid growth and investing heavily in data, analytics, and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. Enabling & empowering smarter insights and creating … seamless customer experiences. The Role As a Senior Data Engineer, you'll be a key player in building and evolving a modern Azure-based data platform that underpins decision-making across the business. The Senior Data Engineer will design, deliver, and optimise scalable data solutions, ensuring the right data is More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Azure Data Engineer - Databricks - Hybrid - Manchester - Up to £65,000 A well-established organisation is seeking a talented Azure Data Engineer to join their growing data team. This is a fantastic opportunity to work on high-impact projects using modern cloud technologies, including Azure and Databricks, in a collaborative and forward-thinking environment. The … Role: You'll be responsible for designing, building, and maintaining scalable data pipelines and solutions that support business intelligence, analytics, and operational reporting. Working closely with data architects, analysts, and stakeholders, you'll help unlock the value of data across the organisation. Key Responsibilities: Develop and optimise data pipelines using Azure Data … Azure Data Services (Data Factory, Databricks, Synapse) Strong knowledge of Python, SQL, and Spark Experience with data modelling, ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … passionate about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you. Key Responsibilities: Design, develop, maintain, and optimise data More ❯

Data Engineer - Manchester - £55,000 + Bonus The Company: Lorien Global are working with one of the biggest names in the North West. Having recently completed a large-scale migration, the business is now investing in data to unlock new products, smarter technologies, and unrivalled customer experiences on a global scale. The Role: We're looking … for a Data Engineer to join the growing Data Engineering team, playing a key role in maintaining and evolving a modern AWS-based data platform. You'll be designing and optimising pipelines, supporting the migration of the existing SQL Server Data Warehouse to AWS, and helping to deliver scalable, real-time data … technologies and apply them where relevant The Skill Requirements: Hands-on experience with AWS services (Glue, Lambda, S3, Redshift, EMR) Strong skills in Python, SQL, PySpark and pipeline orchestration Proven understanding of data warehousing and data lakehouse concepts Excellent problem-solving skills with the ability to resolve performance bottlenecks Clear communicator, comfortable working More ❯

Our top telecoms client is looking for a Data Engineer to join their team on a staff or contract basis Our Client has a requirement for a Data Engineer, who will be required to work on a staff or contract basis in Irlam (Manchester). Role Purpose: The BI Data Engineer will be responsible … for leading and developing and reporting views to ensure data-driven insights are underpinned by a validated dataset, aligning to the data definitions set out by the business. In addition, this role will focus on data engineering, building and managing the infrastructure that allows Freedom Fibre to collect, store, and analyse data. The role … will involve designing, building, and maintaining databases to ensure data is readily available, reliable, and efficient for various purposes, including data science and business intelligence. This will also include developing and maintaining API integrations with systems to extract and load data into the database. The role will also be responsible for designing, developing, and More ❯

Data Scientist (Hybrid - Manchester) A growing data and analytics company is on the lookout for a Data Scientist to take ownership of its monitoring and alerting infrastructure. This is a fantastic opportunity to play a hands-on role in designing scalable solutions that safeguard data quality and system reliability across a suite … solving complex problems, and wants to shape how monitoring is done across multiple projects and departments. Key Responsibilities: Design and build robust monitoring and alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical … models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience More ❯

Data Scientist (Hybrid - Manchester) A growing data and analytics company is on the lookout for a Data Scientist to take ownership of its monitoring and alerting infrastructure. This is a fantastic opportunity to play a hands-on role in designing scalable solutions that safeguard data quality and system reliability across a suite … solving complex problems, and wants to shape how monitoring is done across multiple projects and departments. Key Responsibilities: Design and build robust monitoring and alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical … models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience More ❯

BRAND NEW DATA ENGINEER OPPORTUNITY IN MANCHESTER - HYBRID WORKING Salary up to £55,000 p/a plus bonus & excellent benefits Work on complex, large-scale data pipelines with cutting-edge tech We're looking for strong Python, SQL, and AWS skills, plus experience in ETL processes Hybrid working - 2-3 days in the office ABOUT … SQL, Apache Spark, and AWS services such as EMR, Athena, and Lambda to deliver robust, high-performance solutions.You'll also play a key role in optimising data pipeline architecture, supporting knowledge sharing within the team, and collaborating with stakeholders to translate business requirements into technical solutions. KEY SKILLS/EXPERIENCE: Proven experience as a Data Engineer, with Python & SQL expertise Familiarity with AWS services (or equivalent cloud platforms) Experience with large-scale datasets and ETL pipeline development Knowledge of Apache Spark (Scala or Python) beneficial Understanding of agile development practices, CI/CD, and automated testing Strong problem-solving and analytical skills Positive team player with excellent communication abilities TO BE CONSIDERED More ❯

Role: Data Engineering Manager - Manchester, hybrid The Team: A highly passionate bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models. We are … with them to help protect their information, make informed decisions, deliver a personalised service and automate their workloads. Our engineers might be building data pipelines, modelling data, developing predictive models or automations for repeatable tasks or creation of data products. The role: Your role in the division is to lead the team developing our … be to understand our business data and team capabilities to then expand and improve our Kimball-model data warehouse in Azure, focusing on new datasets, pipeline resilience, performance and security. You will lead and coach the team in deploying tools and processes to ensure good practice is embedded, in line with our strategic themes of More ❯

Lead Data Architect £67,000 - 76,000 GBP Hybrid WORKING Location: Manchester, North West - United Kingdom Type: Permanent Lead Data Architect Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £67,000 - £76,000 (non-London)/Up to £83,000 (London) + Benefits A … respected digital consultancy is hiring a Lead Data Architect to join its growing Data Engineering practice. Known for delivering modern, human-centred services across public and private sectors, this organisation supports clients through meaningful transformation by combining data, design, and engineering. This role is ideal for experienced architects who enjoy shaping cloud-native data platforms, working in multidisciplinary teams, and embedding data governance and architectural rigour across complex service ecosystems. The Role: As a Lead Data Architect, you'll play a key role in designing scalable, secure, and accessible data platforms that enable insight-driven decision-making. You'll work closely with engineering teams and client More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

As a Data Engineer , youll design, build, and maintain scalable pipelines and models that ensure data is accurate, accessible, and usable across the organisation. Youll partner closely with analysts, engineers, and business stakeholders, applying modern software development principles and promoting a DataOps culture of automation, reliability, and agility. Key Responsibilities Design, build, and optimise data pipelines across a modern data platform. Ingest, clean, and transform data using tools such as dbt, Snowflake, and Airflow . Collaborate with cross-functional teams to deliver data products aligned to business priorities. Develop scalable data models that support BI and analytics platforms including Tableau and Power BI. Apply robust … queries. Hands-on experience with dbt (including testing and layered modelling). Practical knowledge of Snowflake for loading, transforming, and exporting datasets. Experience building and managing Airflow DAGs for pipeline orchestration. Understanding of BI tool requirements (e.g., Tableau, Power BI) and related performance considerations. Advanced Excel capability, including pivot tables and complex formulas. Familiarity with data modelling More ❯

Head of Data Engineering Manchester (Hybrid) Permanent Full-time Salary: £100,000 - £120,000 (DOE) A major UK financial services organisation is seeking a visionary Head of Data Engineering to lead and scale its enterprise-wide data platforms. Youll drive the design and delivery of modern data solutions across cloud, analytics, and … core banking systems — enabling smarter decisions, customer innovation, and regulatory excellence. Key Responsibilities: Lead and develop high-performing data engineering teams Architect scalable, secure data pipelines and platforms (Azure, Databricks, etc.) Partner with product, risk, and tech leaders to deliver data-driven outcomes Champion best practices in data governance, quality, and DevOps … What You'll Bring: Proven leadership in large-scale data engineering within complex environments Deep technical expertise in cloud-native data architecture Strong strategic thinking and stakeholder engagement skills Passion for transforming legacy systems into modern, value-driving platforms This is a rare opportunity to shape the future of data in a trusted institution More ❯

Role: Analytics and AI Manager The Team: A highly passionate bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models. We are with them to … help protect their information, make informed decisions, deliver a personalised service and automate their workloads. Our engineers might be building data pipelines, modelling data, developing predictive models or automations for repeatable tasks or creation of data products. The role: Your role in the division is to lead the development of our MI, BI and … AI capabilities, exploiting our data warehouse to replace legacy reporting and create new BI and AI products for both internal and external customers. Your initial objectives will be to understand our business data and existing solutions and to define a roadmap for moving these into our Power BI cloud service. You will also work with other More ❯

Data Scientist (Hybrid | Manchester) A forward-thinking data company, known for delivering actionable insights across media and market research, is on the lookout for a Data Scientist. This role is ideal for someone who thrives in autonomy, enjoys working across teams, and wants to play a key part in building scalable, standardised systems that … ensure data reliability across multiple products. ?? The Opportunity: Join a product and data-driven company that works with top global brands Lead the development of systems to monitor data integrity, health, and performance Own projects end-to-end from defining the problem to deploying production-ready solutions Hybrid role: Split your time between our … Manchester office (Trafford Park) and remote working, with flexibility built in ?? What You'll Be Doing: Design and implement scalable monitoring and alerting solutions across data pipelines Define critical metrics and thresholds in collaboration with technical and non-technical teams Build and deploy models using Python, PySpark, and AWS services Troubleshoot data anomalies and promote best More ❯

Data Engineer - Award-Winning AI SaaS platform We're partnered with a pioneering SaaS company that's transforming their industry through cutting-edge AI and data technology. With a multi-award-winning platform and a client base that includes global household names, this is a rare opportunity to join a high-growth tech business that blends … startup agility with enterprise stability. We're looking for a passionate Data Engineer who is experienced with AI tooling - including building Gen AI agents in-product - to join their growing Data Engineering ream. Why You'll Love This Role: Tech at Scale : Work with hundreds of millions of data points daily, using distributed systems … office if you prefer Exceptional Benefits : From unlimited holiday and private healthcare to stock options and paid parental leave. What You'll Be Doing: Build and maintain scalable data pipelines using Spark with Scala and Java, and support tooling in Python Design low-latency APIs and asynchronous processes for high-volume data. Collaborate with Data Science More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and … support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with … the industrial and/or defence sector. The successful candidate must have: SQL technologies skills (e.g. MS SQL, Oracle). noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J). Data exchange and processing skills (e.g. ETL, ESB, API). Development skills (e.g. Python). Big data technologies knowledge (e.g. Hadoop stack). This position offers a lucrative More ❯

Data Engineer – Manchester (Hybrid) Up to £55K to £65,000 + Bonus, 10% pension, 25+ Days HolidayPyspark | Databricks | SQL Shape the future of travel with data. Join a tech-led company that’s reimagining how millions experience travel. This is your chance to work on high-impact data projects that drive smarter decisions across product, operations … and commercial teams — all while growing your skills in a modern, cloud-first environment. Why This Role Stands Out: You’ll build scalable, production-grade data pipelines using PySpark , SQL , and Databricks Your work will directly power analytics, BI, and data science across the business You’ll be part of a collaborative, forward-thinking data … values experimentation and clean engineering You’ll get space to grow, learn new tools, and make a real impact What You’ll Bring: 2–5 years’ experience in data engineering or similar Strong PySpark and advanced SQL skills Hands-on experience with Databricks and building ETL/ELT pipelines Familiarity with CI/CD and version control Bonus More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance … data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge More ❯

A great marketing digital client based in Old Trafford is looking for a Data Scientist to help build and mature our monitoring and alerting infrastructure, centralising current efforts and enabling scalable, standardised approaches across multiple projects. This is a pivotal role for someone who thrives in autonomous environments and enjoys owning solutions from concept to deployment. The role … training programs, and all the support you need to keep growing. · Giving Back: Join us in supporting local charities and making a positive impact. The Role: As a Data Scientist in this role, you will lead the design, development, and deployment of systems that monitor the health and integrity of our data. You will work with stakeholders across … a hands-on role that requires both analytical thinking and strong engineering practices. You will take full ownership of projects - from discovering and defining problems, cleaning and preparing data in the warehouse, developing and testing models and logic, and deploying solutions into production environments. Key Responsibilities: · Design and implement monitoring and alerting systems to ensure the reliability and More ❯

Role: Azure Senior Data Engineer Location: Manchester, Lancashire Hybrid working: go into office 1x day a week Salary: £60,000 - £70,000 (dependent on experience) Insight into the Company: A large retail organisation - market leaders in their industry - are looking for a Senior Data Engineer to enter their team. You will be working in a small … team of 3 (including you!) and they are looking to build up the team over the next year. The ideal candidate will have experience with managing data warehouses from start to finish and liaise with IT teams regularly. The role will involve stakeholder management, working with diverse roles, such as software engineers, sales and marketing professionals and more. … Therefore, communicating your projects needs and understanding others is an essential part of this role. Role and Responsibilities: You will design, build and upgrade data pipelines You will work in CI/CD and with Software/DevOps teams in the organisation You will have expertise in azure - from collecting, to transforming to loading! Skills and Experience: Essential More ❯

web applications, focusing on lead generation workflows. Optimize and scale platform performance to handle increasing lead volumes efficiently. Integrate and manage APIs for customer eligibility checks, ensuring encrypted data transmission and receipt in compliance with GDPR and FCA guidelines. Collaborate with marketing teams and partners to enhance lead qualification processes using automated systems. Build responsive, conversion-driven user … interfaces with a seamless customer journey. Ensure platform security, including data encryption and compliance with UK regulatory standards. Troubleshoot, debug, and upgrade existing systems to improve functionality and user experience. Work with cloud infrastructure (AWS or Replit) to deploy, manage, and scale applications. Participate in code reviews, testing, and documentation to maintain high-quality standards. Stay updated on … and Express.js for server-side logic. Familiarity with Formik and Yup for form handling and validation. Database and Storage : Experience with Supabase or similar PostgreSQL-based solutions for data management. Ability to integrate and manage relational databases securely. API Integration : Strong experience in working with RESTful APIs (e.g., Numverify, ZeroBounce) to send and receive encrypted data. Knowledge of More ❯