1 to 25 of 66 Data Pipeline Jobs in Manchester

Data Engineer Salary: Competitive plus excellent benefits Location: Remote Start: ASAP Ideal skills: AWS Certified, AWS Cloud, ELT/ETL, CI/CD Who we are: Founded in 2003, Mobysoft provides data-based insight solutions to a wide range of social housing clients, supplying technology to help landlords to improve their income-collection processes for the … working towards a world in which intelligent technology significantly improves the quality of life for people who live in social housing and our mission is delivering accurate actionable data insights that help social housing providers to deliver a more consistent and equitable service What are we looking for? We are an ambitious, customer-centric Data & Insights … team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with a focused product lens, driven by curiosity and a commitment to technical excellence. Data Engineering is foundational to this mission, ensuring synchronized, curated, trusted, dynamic data is available at speed and scale More ❯

algorithms. Lead the selection, validation, and optimization of models to discover meaningful patterns and insights, ensuring models remain relevant, reliable, and scalable. Drive continuous integration and deployment of data science solutions, optimizing performance through advanced machine learning techniques, code reviews, and best practices. 'Develop and deliver sophisticated visualizations, dashboards, and reports translate complex data into clear … actionable insights for business stakeholders. Present technical solutions to business stakeholders, using creative methods to explain complex concepts, increase understanding, and encourage solution adoption. Mentor and develop junior data scientists, fostering a culture of continuous learning, knowledge sharing, and skills development within the organization. Write clean, high-quality code, ensuring all outputs pass quality assurance checks, and contribute … Experience with MLOps practices including model drift detection, decay, A/B testing, integration testing, differential testing, Python package building, and code version control. Skilled in data pipeline creation and working with both structured and unstructured data. Familiar with cloud platforms (AWS, Azure, GCP) and containerization technologies like Docker and Kubernetes. Excellent problem-solving skills, combined with More ❯

As a Technical Lead, you will play a key role in architecting and implementing robust data solutions within Google Cloud Platform (GCP). Full-time Closes 24/12/2025 Working within the Data Engineering department, you will help to shape the technical direction of cloud-based solutions. Your focus will be defining the overall … architecture for data ingestion from our Data Lake, including processing, storage, and analysis within GCP. By leveraging your expertise of Google BigQuery architecture and its features, you will design and implement data models optimised for performance, scalability and best practices. You will act as the subject matter expert for development and optimisation to maintain … of data modelling, data transformation, data governance, and proficient in SQL and other data processing languages. Experience with data pipeline orchestration tools, preferably Cloud Composer. Broad understanding of core GCP services such as BigQuery, Cloud Storage, Kubernetes, Cloud Functions, Pub/Sub, and IAM. Experience with IaC tools such More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Following the acquisition of Brookson by People2.0, the responsibilities of the Data and Analytics team have significantly expanded. We are now seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer within the Data and Analytics team, you will play a pivotal role in designing, maintaining, and optimising … the data architecture for People2.0 Group. This architecture ensures the seamless flow of data from source systems to the Data Warehouse, providing a robust foundation of aggregated analytical base tables and operational sources. Our data architecture is critical in enabling People2.0 Group to become a data-driven organisation. Your responsibilities … will include maintaining existing data pipelines, developing new branches within the architecture, and collaborating closely with stakeholders across the business. You will engage with stakeholders from various regions, including EMEA, US, and APAC, ensuring that the architecture aligns with regional and global requirements. Reporting directly to the Senior Data Engineer within the Data and More ❯

Test Engineer Data Platforms (FTC-6months Hybrid | London or Manchester) My client is looking for an experienced Test Engineer to take ownership of testing across modern data platforms. This is a hands-on role where you’ll design, implement, and execute test strategies for data pipelines, models, and reporting solutions built on Azure technologies. … Key Responsibilities Define and own the overall testing strategy for data pipelines, data models, and BI solutions. Develop and implement automated testing frameworks integrated with CI/CD pipelines. Design and execute test cases across data ingestion, transformation, storage, and presentation layers. Validate data accuracy, performance, and usability within Azure Databricks, Azure … Data Factory, Azure Data Lake Storage, and Power BI. Establish and monitor data quality checks, reconciliation, and compliance processes. Collaborate closely with data engineers, BI developers, architects, and product owners to embed testing best practices across delivery. Essential Skills & Experience Proven experience as a Test Engineer within data engineering or More ❯

DV Cleared Data Engineers – Manchester – AWS or Azure – Senior/Principal We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in Manchester. If you hold active DV clearance and want to work on cutting … edge, mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. They are considering Data Engineers at all levels from Junior up to Principal Data Engineer. What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯

Master Data Management (MDM) Analyst Manchester - Hybrid, Up to £50K We're looking for a Master Data Management (MDM) Analyst to play a pivotal role in maintaining and enhancing the organisation's master data assets. This is an exciting opportunity to join a growing data team and directly contribute to building a … single, trusted view across the business. Reporting to the MDM Manager, you'll help ensure that data powering critical business systems is clean, consistent and reliable - enabling smarter decisions and greater efficiency across the organisation. The Role As an MDM Analyst, you'll support the daily operation of the Tamr platform, monitor data pipelines, validate records … and resolve data quality issues. You'll collaborate with Finance, Operations and Analytics teams to align data across systems and ensure it supports accurate reporting and business processes. You'll also help evolve MDM standards, contribute to data governance initiatives and work closely with both technical and business stakeholders to continually improve how data More ❯

Job Title: Airflow/AWS Data Engineer Location: Manchester Area (3 days per week in the office) Rate: Up to £400 per day inside IR35 Start Date: 03/11/2025 Contract Length: Until 31st December 2025 Job Type: Contract Company Introduction: An exciting opportunity has become available with one of our sector-leading financial services clients. … resource optimization for Airflow workers and AWS resources. Manage integrations with source control systems (GitHub, GitLab) and CI/CD pipelines. Collaborate with AWS teams and internal stakeholders for pipeline scalability and optimization. Design and implement process improvements, including automation, data delivery optimization, and infrastructure re-design. Develop ETL pipelines and data workflows using AWS … and tools like Jenkins, GitHub Actions, or GitLab CI. Solid understanding of containerization technologies (Docker, Kubernetes). Working knowledge of Python and SQL for automation and data pipeline development. Familiarity with monitoring and observability tools (Grafana, Prometheus, CloudWatch). Strong grasp of data architecture principles and ETL design patterns. Financial services or regulated industry experience More ❯

Senior Data Engineer (Snowflake) Manchester Based - Hybrid working 4 days in office Salary £75K to £80K A Consultancy firm is looking for an experienced Senior Data Engineer to their data team. You will drive innovative data solutions within our organisation. The main focus of this Senior Data Engineer/Snowflake … Specialist role is to serve as the technical authority and leader for complex data engineering initiatives, with a specialised emphasis on Snowflake Cloud Data Warehouse architecture and its internal features. You will be responsible for the following activities Design and Build Data Pipelines: The role involves leveraging expertise in ANSI-SQL and Python to … design and construct robust and efficient data pipelines. Implement Data Models: You will be responsible for applying deep expertise in various data models, specifically Dimensional, ER (Entity-Relationship), and Data Vault, to structure data. Manage Key Stakeholders: A critical function is managing product owners and stakeholders to align technical delivery with business More ❯

Senior Data Engineer (Snowflake) Manchester Based - Hybrid working 4 days in office Salary £75K to £80K A Consultancy firm is looking for an experienced Senior Data Engineer to their data team. You will drive innovative data solutions within our organisation. The main focus of this Senior Data Engineer/Snowflake … Specialist role is to serve as the technical authority and leader for complex data engineering initiatives, with a specialised emphasis on Snowflake Cloud Data Warehouse architecture and its internal features. You will be responsible for the following activities Design and Build Data Pipelines: The role involves leveraging expertise in ANSI-SQL and Python to … design and construct robust and efficient data pipelines. Implement Data Models: You will be responsible for applying deep expertise in various data models, specifically Dimensional, ER (Entity-Relationship), and Data Vault, to structure data. Manage Key Stakeholders: A critical function is managing product owners and stakeholders to align technical delivery with business More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting … the design, development, and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll … work within MBDA’s IM GenAI Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting … the design, development, and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll … work within MBDA’s IM GenAI Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the More ❯

Data Architect Location: Manchester (Hybrid – Onsite Tuesdays) Salary: £85,000 - £90,000 + up to 25% Bonus A leading household name in the digital and e-commerce space, with over 16 million users on their app and £1 billion in annual revenue generated through digital channels, is embarking on a major 5-year data transformation strategy. … company-wide on-prem to Azure migration. What You’ll Be Doing Lead the cloud architecture transformation (Azure focus) Work hands-on with SQL, Azure, and data pipeline development Engage with stakeholders across the business – educate, influence, and lead Collaborate with BI, Data Engineering, and Digital Analytics teams Design and deliver scalable architecture for massive … data sets and high-volume user bases What You’ll Bring Minimum 2 years’ experience in architecture (cloud/data focused) Strong hands-on technical background (SQL, Azure essential) Experience in on-prem to cloud migration (Azure preferred) Ability to work autonomously, with strong stakeholder management Experience working with large data volumes and customer More ❯

Data Architect Location: Manchester (Hybrid – Onsite Tuesdays) Salary: £85,000 - £90,000 + up to 25% Bonus A leading household name in the digital and e-commerce space, with over 16 million users on their app and £1 billion in annual revenue generated through digital channels, is embarking on a major 5-year data transformation strategy. … company-wide on-prem to Azure migration. What You’ll Be Doing Lead the cloud architecture transformation (Azure focus) Work hands-on with SQL, Azure, and data pipeline development Engage with stakeholders across the business – educate, influence, and lead Collaborate with BI, Data Engineering, and Digital Analytics teams Design and deliver scalable architecture for massive … data sets and high-volume user bases What You’ll Bring Minimum 2 years’ experience in architecture (cloud/data focused) Strong hands-on technical background (SQL, Azure essential) Experience in on-prem to cloud migration (Azure preferred) Ability to work autonomously, with strong stakeholder management Experience working with large data volumes and customer More ❯

Senior Data Engineer – Digital Consultancy 💰 £80,000 – £95,000 per annum 🏢 Manchester/Leeds based candidates (fully remote role with one team meet-up every two months) I’m currently partnered with a leading digital consultancy that’s expanding its Data Practice and looking for an experienced Senior Data Engineer to join their talented … team 😍. This is a fantastic opportunity to work on impactful projects for major UK organisations, using modern cloud technologies to design and deliver scalable, high-quality data solutions. What You’ll Be Doing: Designing, building and maintaining cloud-native data pipelines Automating and orchestrating workflows using tools such as AWS Glue, Azure Data … or Snowflake Collaborating with engineers, analysts and client teams to deliver value-focused data solutions What We’re Looking For: Strong experience with Python, SQL, Spark and pipeline tools such as dbt or Airflow Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) A solid grasp of data modelling, data More ❯

Data Engineer Manchester £70,000 + benefits package Our client is a data-driven SaaS company who are looking for an experienced Data Engineer who has successfully scaled a company's data maturity before and is eager to do it again. This isn't a maintenance role. It's a rare opportunity … to lead a large-scale data re-architecture project from the ground up. You'll have the autonomy and trust to make key architectural decisions, shaping the technical foundation that powers our entire business—from product and analytics to customer intelligence and growth. If you're motivated by high-impact work and the challenge of building a best … in-class, scalable data platform, we'd love to talk. Skills Needed 4–6+ years of professional experience as a Senior or Lead Data Engineer , including leadership on at least one major data re-architecture project Deep expertise in SQL and Python , applying data engineering best practices such as testing, version control More ❯

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Senior Data Engineer in Databricks - Lead the Future of Data in Financial Services Location: Hybrid | 2-3 days/week on site Offices: Banbury, Milton Keynes, Bedford, Northampton, Manchester Salary: Up to £80,000 + Car Allowance + Bonus + Benefits Note: Visa sponsorship is not available for this role. Be the Technical Leader in a … Bold Data Transformation Our client is entering a pivotal phase in its data journey. With a new Head of Data already in place and a Data Architect joining shortly, the business is investing in a modern, scalable data platform to turn messy, complex client data into trusted, actionable … team. Finance sector experience is a bonus-but not essential. Interview Process Initial coffee chat to explore team fit and technical challenges. Technical interview covering Databricks, MDM, semantic layers, pipeline design, and governance. This is a rare opportunity to lead, build, and shape the future of data in a growing financial services business. Ready to make your More ❯

Senior Data Engineer in Databricks - Lead the Future of Data in Financial Services Location: Hybrid | 2-3 days/week on site Offices: Banbury, Milton Keynes, Bedford, Northampton, Manchester Salary: Up to £80,000 + Car Allowance + Bonus + Benefits Note: Visa sponsorship is not available for this role. Be the Technical Leader in a … Bold Data Transformation Our client is entering a pivotal phase in its data journey. With a new Head of Data already in place and a Data Architect joining shortly, the business is investing in a modern, scalable data platform to turn messy, complex client data into trusted, actionable … team. Finance sector experience is a bonus-but not essential. Interview Process Initial coffee chat to explore team fit and technical challenges. Technical interview covering Databricks, MDM, semantic layers, pipeline design, and governance. This is a rare opportunity to lead, build, and shape the future of data in a growing financial services business. Ready to make your More ❯

Lead Data Engineer – Manchester – £70,000–£75,000 + Bonus Hybrid – 2–3 days per week in the office We’re representing an award-winning, tech-driven organisation in the travel industry that’s scaling its data capability to support rapid growth and digital transformation. They’re seeking a Lead Data Engineer to guide … a small, dynamic team and help shape the future of their cloud-based data platform. This is a fantastic opportunity for a technically strong engineer with a collaborative mindset, someone who can translate complex data challenges into clear business outcomes. You’ll be joining a company where data sits at the heart of decision … making and innovation, working alongside passionate professionals in an ambitious, people-focused culture. The Role Lead, mentor, and develop a small team of two Data Engineers. Design, build, and optimise data pipelines and integrations (using dbt, Airbyte , OpenFlow , APIs , and Python ) to deliver reliable and scalable data. Support the development of a new cloud-based data More ❯

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, evaluate options, research and propose suitable More ❯

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, evaluate options, research and propose suitable More ❯

Data Engineer Opportunity for a Data Engineer to join a market leading entertainment brand in Greater Manchester Salary up to £53,045 + fantastic benefits including our Inclusive working culture, Generous holiday allowance, Hybrid working and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? In this role, you’ll … be building and maintaining the data systems that power our reporting and analytics across the business. You’ll develop reliable data pipelines in Databricks, bringing together real-time and batch data from multiple sources on AWS. Working closely with teams across Finance, Marketing, and Compliance, you’ll make sure our data is … accurate, accessible, and ready for decision-making. You’ll also play a key part in improving performance, automation, and governance across our modern cloud-based data platform. OUR BENEFITS: Hybrid Working Generous holiday allowance Pension Annual Bonus Life Insurance Training & Development Opportunities Enhanced Maternity & Paternity Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER More ❯