51 to 75 of 127 Data Pipeline Jobs in the North of England

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Data Quality and Governance Manager - Hybrid - Leeds - £65,000 My client is looking for a Data Quality & Governance Manager to shape how data is trusted and used throughout their organisation. They are looking for someone to lead efforts in ensuring the consistency, reliability, and … governance of data. This role will work closely with business and technical teams to develop and implement frameworks for data quality, governance, and master data management, using Snowflake and Microsoft Azure. Requirements: Experience in data governance and data quality management Strong knowledge … of data warehouse architecture and cloud platforms, especially Snowflake and Microsoft Azure. Proven experience designing and managing data pipelines in cloud environments with integrated data governance principles. Hands-on experience with data migrations Strong experience in working with data engineers More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a start up tech consultancy and help to lead their data engineering practice. If you are an experienced and capable data engineer … and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the … engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, Synapse, SQL) Expert use of Databricks More ❯

to keep the world moving smarter, safer, more efficiently and greener. We harness an unmatched collection of historic and real-time global GPS data from connected cars, fleet vehicles, and mobile devices to provide complex analysis across huge data sets with ambitious lead times. Our customers … include cities, states, countries, and enterprise corporations. We're looking for someone who wants to learn about computing data at scale, building robust systems, and loves to learn and keep up with the latest cloud computing technology. Do you want to be at the heart of turning raw … delivery. Familiarity one or more of the following would also be beneficial : Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus A team player - we highly More ❯

Senior Analyst & Data Specialist Location: Liverpool Working style: Hybrid About the Role: In this role, the successful candidate will play a key part in supporting data projects, providing expertise in database development, data security, and documentation. Working closely with the wider data project team, you will help implement a new core platform and support the Finance Domain's reporting requirements. You will interpret raw data, transforming it into actionable insights for senior stakeholders. This role involves daily collaboration with the Data Architect, Head of Data and Analytics, and the Director of Finance, Risk, and Compliance. Key Responsibilities: Perform advanced data analysis on large datasets to extract actionable insights. Identify/interpret trends, patterns and correlations to support strategic and operational decision-making. Conduct detailed analyses across the business, producing clear, informative More ❯

AWS Data Engineer Old Trafford/Trafford Park, Manchester (Hybrid-Working) c£80,000 per year Plus excellent company benefits and rewards package The Opportunity: Are you passionate about data and problem-solving? We're looking for a skilled Data Engineer to … join our client’s growing team? You'll play a key role in developing, maintaining, and improving our end-to-end data pipeline, working with cutting-edge technologies and large-scale datasets in real-time. Skills and Experience: Strong problem-solving skills Knowledge of AWS or similar … Experience debugging business-critical systems Role and Responsibilities: Write high-quality application code and tests Develop infrastructure automation and scheduling scripts for reliable data processing Continuously improve platform performance with cutting-edge technologies Provide support for production systems Review code and give helpful feedback Developing scalable backend and More ❯

Data Engineer (Azure, SQL, ETL, Databricks, Data Factory) South Manchester – Remote First (On-site just once a month) Up to £60,000 + Bonus + Benefits Are you a skilled Data Engineer ready to shape the future of data in a rapidly … across sectors including the NHS, logistics, public safety, and retail. With their tech function now fully in-house, they’re investing heavily in data—and you’ll be at the forefront of that transformation. You’ll work directly with the CTO and Head of Engineering, helping define the … company’s data architecture, pipelines, and reporting solutions from the ground up. What You’ll Be Doing: Designing, building, and optimising scalable data pipelines, data warehouse structures, and integration processes. Implementing robust ETL solutions to consolidate data from multiple sources into the More ❯

proficiency in PySpark, Hadoop, Python, Git - Strong understanding of data engineering concepts and ETL processes, Data warehousing, Data Pipeline, SQL - Additional Good To Have Skills: AWS Glue, Knowledge of implementing ETL and data pipelines in AWS -5+ years of experience More ❯

Data Architect – Databricks Hybrid (Manchester or London) Up to £100,000 Full-time, Permanent About the Role Our client, a dynamic Microsoft Partner, is seeking a highly skilled Data Architect with deep expertise in Databricks. This is a strategic role focused on designing, leading, and delivering … modern data solutions for enterprise clients across various sectors. You will work closely with stakeholders to define architecture, modernise data platforms, and guide delivery teams through complex implementations. Key Responsibilities Design and lead the architecture of modern data solutions using Databricks. Collaborate with clients … solutions, contribute to technical discovery sessions, and articulate architectural approaches. Support proposal development by providing technical input, solution design narratives, and estimations for data platform engagements. Define best practices around data modelling, ETL/ELT pipelines, and data platform scalability. Champion cloud-native principles More ❯

Application closing date: 16/02/25 at 23:59 A bit about the role As the Head of Data Engineering and Data Platform, you will lead the design, development, and management of our cloud-based data environment, ensuring it meets the organisation … of the Platform, identifying opportunities to adopt new technologies and enhance capabilities to support the Agency. This is a critical role within the Data & Analytics directorate, where you will oversee the end-to-end engineering of data pipelines, ensuring the efficient ingestion, transformation, and accessibility of … trusted data across the agency. Your work will underpin the agency's data-driven decision-making, enabling advanced analytics, AI, and innovation. You will provide strategic leadership to the data platform team, driving the adoption of emerging technologies and ensuring that the platform is More ❯

Lead/Senior Data Consultant - Leeds/Hybrid - £70,000-90,000 Darwin Recruitment have partnered with a Leeds-based Consultancy who are in a growth-phase, investing heavily in their technical teams. They are searching for a Lead/Senior Data Consultant to play a … environment Focus on new products and features. A clear path to Leadership. The Role You will lead on internal projects centred around developing data processing pipelines & GenAI applications within Cloud environments. … These projects are large-scale, complex and have a huge impact for their clients. Experience of Interest Python, FastAPI, Application Development. Data Pipeline Processing/Data Engineering Cloud expertise - AWS/GCP Terraform, Docker, Bash Github, CI/CD, Jira, Confluence Agile, Scrum, Kanban Previous More ❯

Senior Data Engineer - Runcorn - £80K A growing manufacturing business in Runcorn is looking for a Senior Data Engineer to join their team. You'll design and optimise data pipelines, ensuring efficient data flow across the business. Working closely with the wider business … you'll ensure their data warehouse efficiently delivers high-quality insights. The role also offers fantastic career progression, with the potential to move into a Head of Data Engineering role in the future What's in it for you? Salary up to £80,000 + bonus … and wellness benefits Hybrid working from Runcorn Company discount on their products + much more Key Responsibilities Develop and maintain ETL/ELT data pipelines using Python and SQL. Work with enterprise-level cloud platforms, ideally GCP (BigQuery, Airflow, Cloud Functions). Integrate APIs and process data More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a … options aligned with the departments long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will … Factory (ADF): Incremental creation of data dimensions to optimise processing, reduce overheads, and improve cost efficiency across compute, storage, and networking. Enhancing pipeline security by replacing basic authentication with managed identities or service principals. Introducing parallelism into pipeline workflows to improve performance and scalability. Refactoring existing More ❯

We are seeking a diligent and innovative Data Engineer to join our Analytics team, the successful Data Engineer with be able to demonstrate a strong business acumen. The ideal candidate will ideally worked with ETL processes, Snowflake, and Tableau, and will be instrumental in bridging the … gap between data engineering and business strategy. Client Details We are a global electronics and manufacturing company that operates in 100 countries. Our UK subsidiary is based in Manchester. We are on a journey to further develop our data first approach this role will play a … key part in bridging the gap between or data engineering team and the wider business. Description The successful Data Engineer will be responsible for but not limited to: Building robust, scalable data pipelines. Implement complex, large scale big data projects with a More ❯

are seeking an experienced Power BI Developer for a 6-month interim contract to support a fast-paced retail business in transforming financial data into actionable insights. This role focuses on designing and building finance-focused Power BI dashboards and reports, leveraging data extracted from Microsoft … Responsibilities: Design, develop, and maintain Power BI dashboards and reports tailored to finance and retail business needs. Extract and transform financial and transactional data from Dynamics 365 via Azure Data Lake/Synapse/Data Factory (as applicable). Collaborate with finance and IT … teams to understand data requirements and reporting goals. Ensure data models are optimised for performance and scalability. Implement best practices in report design, data governance, and version control. Support the integration and automation of data pipelines from source systems to Power BI. More ❯

Job Title: Data Engineer Location: Aberdeen (Hybrid 3 days on-site) Salary: £55,000 – 65,000 About Us: Join a dynamic and innovative team at one of the top oil and gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability … in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and optimising data processes. Key Responsibilities … Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems More ❯

A fantastic opportunity has arisen for a Data Analyst to join a business in Pocklington. In this key role, you will be responsible for capturing, analysing, and reporting data to optimise supply chain efficiency, biological asset management, and commercial decision-making. This position offers the chance … to provide valuable insights that drive business performance and strategic growth. The Role Reporting to the Head of Optimisation, the Data Analyst will generate data-driven insights to enhance performance across the business. This is an excellent opportunity for a data professional to contribute … and exciting opportunities for career development within a dynamic, forward-thinking environment. You will be involved in cutting-edge data projects that are shaping the future of food production. Key Responsibilities: Ensure accurate and timely data capture across the entire supply chain. Develop and maintain automated More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. Providing … insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then LETS More ❯

Azure Data Engineer Location- Wigan Area Salary: Up to £50K Maxwell Bond have partnered with a SaaS and market-leading company in their sector, driving innovation with products that support multi-sites, cashless payments and ethical enforcement. After growing success, the company is continuing its growth and looking … to expand its Data Engineering team. Key Responsibilities: Working in a 20+ strong IT, Software & Data team. Building the future of their data systems (data pipelines, reporting, Datawarehouse etc). Working with the latest MS tech stack including ADF, Synapse, MS Fabric … and Power BI. DataBricks experience – hugely advantageous MUST have 3+ years of Data Engineering experience What’s in it for you as their Data Engineer? 23 days holiday which increases with length of service, with an element of carry-over allowable (Bank Holidays in addition to More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯