51 to 75 of 97 Data Pipeline Jobs in the North of England

Location: Leeds City Centre + Hybrid Working Job Type: Full-time Team: Product Reports to: Head of Product Development About Us: We use data science and AI to help retailers make profitable pricing, marketing and retail media decisions. Put simply, we help retailers sell the right products, to the right people, for the right price. We offer a … 2+ years of experience in a business intelligence development or related role Excellent SQL skills Good understanding of relational and analytical database architectures and methodologies Experience of cloud data warehousing solutions e.g. Snowflake, BigQuery, Redshift Good hands-on experience with at least one Business Intelligence platform Strong analytical and problem-solving skills Excellent communication skills, with the ability … to explain technical details to non-technical stakeholders Comfortable with occasional client interaction in a professional and supportive capacity Great UX & data visualisation skills The Role: Design, develop and maintain BI solutions including dashboards, reports and data models Produce visually engaging deliverables for consumption by retail clients Write complex SQL queries and scripts for data More ❯

Newcastle, United Kingdom Posted on 22/05/2025 Data Lead (Contract - 3 Months initial) Location: London, Newcastle (Hybrid) Contract Duration: 3 months initial Overview We're seeking a seasoned Data Lead to own and deliver the data strategy for govt client that uses services used by over 18m citizens encompassing three newly … rebuilt benefits systems. You will define where our data capabilities are today, set the future vision, and architect the roadmap to get us there-then design the data team to execute it. Key Responsibilities Lead the end-to-end Data Strategy for Bereavement & Care services. Map the "as-is" and "to-be" state of … strategies in complex organisations. Technical Breadth : Cloud-based data platforms AWS must (Azure, AWS or equivalent) Modern ETL/ELT tools and data pipeline frameworks Data modelling, warehousing and transformation best practices Data science/ML lifecycle from prototype to production Government/Public Sector : Experience to GDS-equivalent More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion, transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB More ❯

Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The … the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. Manage the adoption of automated … experience in a managerial role, coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day More ❯

AWS Data Engineer - IT Consultancy - Leeds - Hybrid Are you a data engineer with a passion for AWS and solving real-world business problems? I am working with a fast-growing IT consultancy based in Leeds that's delivering cutting-edge cloud and data solutions to clients across the UK. They're looking for their … next AWS Data Engineer to join the team. As an AWS Data Engineer, you'll be working on a variety of client projects, helping to design, build, and optimise scalable data pipelines and cloud-native architectures. You'll collaborate with cross-functional teams to deliver high-impact solutions that drive business value. Requirements: Experience … as a Data Engineer using AWS: Glue, Lambda, S3, Redshift, Athena, EMR. Snowflake experience (Not essential) Strong Python SQL & NoSQL databases CI/CD tools : GitHub Actions or CodePipeline Infrastructure as Code (Terraform is preferable) Experience building ETL/ELT pipelines Familiarity with data lake and data warehouse concepts Excellent communication and stakeholder engagement More ❯

Data Engineer – Leeds– SQL | Power BI | Azure | ETL Ready to drive innovation with T-SQL and BI, shaping a cutting-edge data platform? Do you have the expertise to build and maintain complex data warehouses and Power BI solutions? Excited to solve BI challenges and support data-driven decision-making across the … business? A fantastic new opportunity has arisen with a professional services company for an experienced Data Engineer. You'll be joining a growing team with offices across the UK, committed to ambitious growth and employee wellbeing. This role is based in their Leeds office, offering hybrid working. What's in it for you? Salary up to … Factory to ensure the warehouse can support large-scale reporting and analytics needs. Your T-SQL expertise will be crucial for managing complex queries and troubleshooting data pipeline issues. Key Skills: SQL/T-SQL Power BI or Tableau Experience with data warehousing and ETL/ELT processes Azure If you're passionate about shaping More ❯

Principal Data Engineer Department: Intel Employment Type: Permanent Location: Newcastle-upon-Tyne Reporting To: Head of Data Description We're looking for a Principal Data Engineer to join the team responsible for delivering trusted, high-quality data products that power decisions across Bede. Reporting to the Head of Data, you … ll be a respected technical authority, owning the design, integrity, and ongoing improvement of our data architecture. You'll set the standard for engineering excellence in your product area, guiding teams on best practices, system health, documentation, and long-term technical direction. This is a high-impact role suited to someone who thrives on solving complex problems, collaborating … across disciplines, and shaping scalable, resilient data platforms. This is a hybrid role that requires you to be in our Newcastle-upon-Tyne office two days a week. Please apply only if you're comfortable with this arrangement. What you'll be doing Core Responsibilities Own and evolve the technical roadmap for the data product area More ❯

a Manual QA Test Engineer with hands-on experience in SnapLogic to join my clients growing team on a contract basis. You will be responsible for testing integrations, data pipelines, and workflows built using the SnapLogic platform, ensuring quality, stability, and performance across various projects. Key Responsibilities Design and execute manual test cases for SnapLogic pipelines and integrations. … Validate data transformations, API integrations, and ETL workflows. Collaborate with developers, business analysts, and integration architects to understand functional and non-functional requirements. Identify, document, and track bugs through to resolution. Maintain test documentation, including test cases, test results, and issue logs. Support UAT and production release verification. Ensure data accuracy and integrity across systems and … integrations. Required Skills & Experience 1+ years of experience testing SnapLogic integrations (required). Strong background in manual testing , particularly for APIs, data pipelines, and enterprise integrations. Experience with JSON, REST APIs, SQL , and data validation. Familiarity with tools like Postman, JIRA, Confluence, or similar. Strong analytical and problem-solving skills. Excellent communication skills and attention to More ❯

web applications, focusing on lead generation workflows. Optimize and scale platform performance to handle increasing lead volumes efficiently. Integrate and manage APIs for customer eligibility checks, ensuring encrypted data transmission and receipt in compliance with GDPR and FCA guidelines. Collaborate with marketing teams and partners to enhance lead qualification processes using automated systems. Build responsive, conversion-driven user … interfaces with a seamless customer journey. Ensure platform security, including data encryption and compliance with UK regulatory standards. Troubleshoot, debug, and upgrade existing systems to improve functionality and user experience. Work with cloud infrastructure (AWS or Replit) to deploy, manage, and scale applications. Participate in code reviews, testing, and documentation to maintain high-quality standards. Stay updated on … and Express.js for server-side logic. Familiarity with Formik and Yup for form handling and validation. Database and Storage : Experience with Supabase or similar PostgreSQL-based solutions for data management. Ability to integrate and manage relational databases securely. API Integration : Strong experience in working with RESTful APIs (e.g., Numverify, ZeroBounce) to send and receive encrypted data. Knowledge of More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

Role: Azure Senior Data Engineer Location: Manchester, Lancashire Hybrid working: go into office 1x day a week Salary: £50,000 - £65,000 (dependent on experience) Insight into the Company: A large retail organisation - market leaders in their industry - are looking for a Senior Data Engineer to enter their team. You will be working in a small … team of 3 (including you!) and they are looking to build up the team over the next year. The ideal candidate will have experience with managing data warehouses from start to finish and liaise with IT teams regularly. The role will involve stakeholder management, working with diverse roles, such as software engineers, sales and marketing professionals and more. … Therefore, communicating your projects needs and understanding others is an essential part of this role. Role and Responsibilities: You will design, build and upgrade data pipelines You will work in CI/CD and with Software/DevOps teams in the organisation You will have expertise in azure - from collecting, to transforming to loading! Skills and Experience: Essential More ❯

A fantastic opportunity has arisen for a Data Analyst to join a business in Pocklington. In this key role, you will be responsible for capturing, analysing, and reporting data to optimise supply chain efficiency, biological asset management, and commercial decision-making. This position offers the chance to provide valuable insights that drive business performance and strategic … growth. The Role Reporting to the Head of Optimisation, the Data Analyst will generate data-driven insights to enhance performance across the business. This is an excellent opportunity for a data professional to contribute to innovative projects within the food production and agriculture sector. The role is full-time and permanent, offering a salary … between £35,000 - £40,000 and exciting opportunities for career development within a dynamic, forward-thinking environment. You will be involved in cutting-edge data projects that are shaping the future of food production. Key Responsibilities: Ensure accurate and timely data capture across the entire supply chain. Develop and maintain automated data pipelines to More ❯

horizon, we're scaling quickly toward long-term growth and IPO readiness. Join us as we define the future of SaaS security! We're looking for a Senior Data Engineer to join our growing engineering team. In this role, you'll lead the end-to-end development of new integrations into our platform - powering the insights that help … secure our customers' most critical SaaS environments. About the Role As a Senior Data Engineer, you'll: Build robust, scalable connectors to SaaS platforms (e.g., Microsoft 365, Workday, Salesforce) to extract data on users, roles, permissions, and configuration Design and maintain data pipelines that normalize and transform raw SaaS data into our … security posture model Collaborate with platform and security engineers to shape how we build, deploy, and scale integrations across hundreds of enterprise SaaS platforms. Debug and improve production data pipelines, resolving discrepancies and improving performance, accuracy, and resilience What's in It for You Have immediate impact - your work directly improves how some of the world's top More ❯

of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe's largest providers of fuel cards. As a Data Engineer at WEX, you'll be responsible for building and maintaining the bridge between our data and the rest of the organization. You'll work with stakeholders … to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You'll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data-driven decisions. How you'll make an impact A highly motivated individual who loves working as part of a high performing team … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week Hybrid (2 days a week in office) Salary: £50-55,000 + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where your ideas … and growing organisation thats been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If youre excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, wed love to hear from you. What youll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week - Hybrid (2 days a week in office) Salary: Up to £55,000 DOE + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where … growing organisation that’s been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If you’re excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, we’d love to hear from you. What you’ll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … encourages applications from underrepresented groups. We are committed to equality of opportunity and welcome applications from individuals, regardless of their background. Job Description We are looking for a Data Engineer to join our Product Development team. You will work closely with the Scrum Master to deliver our technical builds, approach, and prioritisation. Are you a developer, data or software engineer with experience working with advertising/media dataset, and a history of creating data pipelines and structures that can be used in front end applications or creating automations that make data work harder? If so this is the role for you! Qualifications To be successful in this role you will need More ❯

will take ownership of core backend development efforts, leading a small, agile team. You will be instrumental in architecting and building software systems that interface with real-time data sources and power intelligent automation platforms. This is a hands-on leadership position where you'll balance technical delivery with mentorship and team coordination. Key Responsibilities: Lead the design … scalable backend systems using Python and microservices architecture Oversee code quality, testing, and DevOps practices to ensure continuous delivery Collaborate closely with multidisciplinary teams, including hardware engineers and data scientists Mentor and support junior developers and contribute to a high-performance engineering culture Implement software solutions for real-time data processing in an industrial environment Drive … Azure cloud environment Excellent problem-solving and leadership skills Desirable: Background in industrial automation, IoT, or embedded systems Familiarity with protocols used in industrial environments Experience with modern data pipelines or event-driven architectures What's on Offer: Competitive salary and benefits package Flexible working hours and hybrid options Career growth in a cutting-edge technology environment A More ❯

Senior Data Engineer - Azure - Leeds I'm looking for a Senior Azure Data Engineer for a client near to Leeds. The company are building a greenfield Data Platform in Azure and Snowflake and so looking for someone who has been heavily involved in building end to end data platforms in Azure using … Synapse, Data Factory, Data Lake and SQL. Role & Responsibilities Building end to end data pipelines in Azure (Data Factory and SQL) Building workflows in SQL, Spark and DBT Data and dimensional modelling Skills & Qualifications Azure Data factory, Synapse and SSIS Python/Park/PySpark Ideally Snowflake and More ❯