26 to 50 of 61 Data Pipeline Jobs in the North West

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Senior Data Engineer - Clayton-le-Moors Company Description At Frasers Group we're rethinking retail. Through digital innovation and unique customer experiences, we're serving our consumers with the world's best sports, premium and luxury brands globally. As a leader in the industry, we're elevating the retail experience for our consumers providing flexible and convenient ways … your role and own the results Be relevant - Relevant to our people, our partners and the planet Job Description To support the design, development, and maintenance of our data infrastructure. The role involves ensuring the efficient, reliable, and secure collection, storage, and processing of data, which is critical for enabling data-driven decision-making … solutions, optimise data pipelines, and contribute to the overall data strategy, ensuring data integrity, security, and accessibility across FGFS. Data Pipeline Development: Engage in the design, build, and maintenance of scalable and efficient data pipelines for extracting, transforming, and loading data from multiple sources. Troubleshooting and More ❯

growing organisation? Do you have a passion for enabling people to perform at their best? If so, we want to hear from you. We are looking for a Data Engineer (Python) to join our Data Science and Technology team at BIT. As a Data Engineer you will be responsible for the technical delivery of … building and maintaining robust, scalable technology. You will play a crucial role in maintaining and enhancing Predictiv - our online research platform running at production scale - while delivering innovative data engineering solutions for client-facing projects. This is an exciting opportunity to use your technical skills while contributing to meaningful, high-impact projects. You will gain hands-on experience … platforms (e.g., AWS, GCP, or Azure). An understanding of DevOps concepts such as Infrastructure as Code, CI/CD, or MLOps. Knowledge of Python-based data pipeline frameworks (e.g. Airflow, Metaflow) and Python-based product development packages (e.g. FastAPI, Streamlit). An interest in developing or improving full stack product development skills. Who are we and More ❯

AWS Data Engineer - Manchester - Hybrid - £75,000 We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about … building scalable data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You'll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such More ❯

AWS Data Engineer - Manchester - Hybrid - £75,000 We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about … building scalable data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You'll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such More ❯

AWS Data Engineer - Manchester - Hybrid We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about building scalable … data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You … ll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such as S3, Glue, Lambda More ❯

Data Engineer – Financial Services | Strong Kafka/Streaming Focus- Liverpool/Hybrid – Up to £75K (DOE) Our client, an innovative and rapidly expanding Financial Services organization, is seeking a Data Engineer to join their highly technical data team. This is a unique opportunity to be part of a forward-thinking company where data is central to strategic decision-making. We’re looking for someone who brings hands-on experience in streaming data architectures, particularly with Apache Kafka and Confluent Cloud, and is eager to shape the future of scalable, real-time data pipelines. You’ll work closely with both the core Data Engineering team and … the Data Science function, bridging the gap between model development and production-grade data infrastructure. What You’ll Do: Design, build, and maintain real-time data streaming pipelines using Apache Kafka and Confluent Cloud. Architect and implement robust, scalable data ingestion frameworks for batch and streaming use cases. Collaborate with stakeholders to More ❯

As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve … diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms, data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the … chance to elevate how the Home Office exploits data for maximum public impact. In this role, you will translate strategic data vision into tangible designs and solutions, ensuring data assets are secure, well-structured, and aligned with evolving Home Office priorities. Partnering with Technical Architects, Principal Data Architects, and various data More ❯

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯

defence leaders to act with confidence in an increasingly complex world. Our trusted defence, security, and geopolitical information delivered through seamless digital platforms and system integrations-turns overwhelming data into clear, actionable intelligence and insight. By filling critical information gaps, Janes helps customers analyse threats, accelerate decisions, and stay ahead of emerging challenges. Job purpose: We are seeking … experienced Software Engineers with expertise in one of a number of identified technical areas, who have a strong background working with complex data, comprehensive experience in developing, high impact scalable systems, transforming and delivering complex datasets, and showing a high appreciation for data quality. You will be working as part of a multi-functional team based … DocumentDB/MongoDB RDF Graph database such as GraphDB ML/AI such as Sagemaker/Bedrock Search technologies such as SOLR or Opensearch/ElasticSearch Data pipeline engineering utilising cloud-based technologies (AWS) Write high quality clean, testable code, with a focus on incremental innovation. Take part in code and design reviews helping to improve overall More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion, transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB More ❯

Data Engineer Hybrid Lancashire (2 Days Onsite per Week) Permanent | 37 Hours | £55,000£65,000 + Benefits Looking to use your data engineering skills … on meaningful projects? We're working with an established UK-based technology business that develops solutions to support critical national infrastructure. With demand growing and new projects in the pipeline, the company is expanding its data team and looking for a proactive, cloud-savvy Data Engineer. What Youll Be Doing: Designing and building scalable data pipelines across a modern cloud platform. Driving automation and ensuring data quality in complex data workflows. Contributing to the design and development of robust data architecture. Collaborating with internal teams to solve data challenges and support analytics. Sharing best practices and mentoring less experienced colleagues. What Youll Need: Hands-on More ❯

web applications, focusing on lead generation workflows. Optimize and scale platform performance to handle increasing lead volumes efficiently. Integrate and manage APIs for customer eligibility checks, ensuring encrypted data transmission and receipt in compliance with GDPR and FCA guidelines. Collaborate with marketing teams and partners to enhance lead qualification processes using automated systems. Build responsive, conversion-driven user … interfaces with a seamless customer journey. Ensure platform security, including data encryption and compliance with UK regulatory standards. Troubleshoot, debug, and upgrade existing systems to improve functionality and user experience. Work with cloud infrastructure (AWS or Replit) to deploy, manage, and scale applications. Participate in code reviews, testing, and documentation to maintain high-quality standards. Stay updated on … and Express.js for server-side logic. Familiarity with Formik and Yup for form handling and validation. Database and Storage : Experience with Supabase or similar PostgreSQL-based solutions for data management. Ability to integrate and manage relational databases securely. API Integration : Strong experience in working with RESTful APIs (e.g., Numverify, ZeroBounce) to send and receive encrypted data. Knowledge of More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

horizon, we're scaling quickly toward long-term growth and IPO readiness. Join us as we define the future of SaaS security! We're looking for a Senior Data Engineer to join our growing engineering team. In this role, you'll lead the end-to-end development of new integrations into our platform - powering the insights that help … secure our customers' most critical SaaS environments. About the Role As a Senior Data Engineer, you'll: Build robust, scalable connectors to SaaS platforms (e.g., Microsoft 365, Workday, Salesforce) to extract data on users, roles, permissions, and configuration Design and maintain data pipelines that normalize and transform raw SaaS data into our … security posture model Collaborate with platform and security engineers to shape how we build, deploy, and scale integrations across hundreds of enterprise SaaS platforms. Debug and improve production data pipelines, resolving discrepancies and improving performance, accuracy, and resilience What's in It for You Have immediate impact - your work directly improves how some of the world's top More ❯

of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe's largest providers of fuel cards. As a Data Engineer at WEX, you'll be responsible for building and maintaining the bridge between our data and the rest of the organization. You'll work with stakeholders … to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You'll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data-driven decisions. How you'll make an impact A highly motivated individual who loves working as part of a high performing team … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

Who We Are TetraScience is the Scientific Data and AI Cloud company. We are catalyzing the Scientific AI revolution by designing and industrializing AI-native scientific data sets, which we bring to life in a growing suite of next gen lab data management solutions, scientific use cases, and AI-enabled outcomes. TetraScience is the … in this vital new market, generating more revenue than all other companies in the aggregate. In the last year alone, the world's dominant players in compute, cloud, data, and AI infrastructure have converged on TetraScience as the de facto standard, entering into co-innovation and go-to-market partnerships: Latest News and Announcements TetraScience Newsroom In connection … EU. The ideal candidate should have expertise in customer and field enablement, adult learning principles, educational program creation, use case architecture and implementation, and a genuine passion for Data and AI technologies. The candidate should be driven by a desire to educate and inspire, and have the technical skills to quickly prototype new ideas and solutions. And finally More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week Hybrid (2 days a week in office) Salary: £50-55,000 + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where your ideas … and growing organisation thats been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If youre excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, wed love to hear from you. What youll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week - Hybrid (2 days a week in office) Salary: Up to £55,000 DOE + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where … growing organisation that’s been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If you’re excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, we’d love to hear from you. What you’ll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

SQL Data Engineer/BI Developer North West NHS Client Outside IR35 3 Month initial period Flexible day rate We are seeking a BI Developer/Data Engineer with end-to-end data project experience to join a North-West based NHS trust. This is a fantastic opportunity to contribute to meaningful healthcare improvement … by delivering high-quality BI solutions that drive clinical, operational, and strategic decision-making. You will play a pivotal role in transforming complex healthcare data into accessible and actionable insights. Develop and maintain robust Power BI dashboards and reports, ensuring accuracy and usability for clinical and operational teams. Design and build data pipelines and transformation logic More ❯

JOB TITLE: Product Owner - Data LOCATION: Chester, Halifax, Leeds or Manchester HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in one of our office hubs mentioned above About Us: As the UK's largest retail and commercial bank, Lloyds Banking Group has a footprint that touches nearly every household in the UK. That gives us a … opportunity employer and deeply value diversity within our organisation. Why not join our forward-thinking Consumer Lending team as we embark on a ground-breaking journey towards a data-driven future. We are seeking a hardworking Data Design Engineer to support our data transformation initiatives and contribute to the development of a modern data platform powered by consumer data products. What Makes This Opportunity Unique As a Product Owner within our Consumer Lending team, you'll be at the forefront of transforming the way we serve our customers. This is an outstanding opportunity to bring to bear your technical expertise and leadership skills to drive world-class solutions in a More ❯