1 to 25 of 42 Data Lake Jobs in the North of England

future of data within the business, designing and maintaining robust data pipelines and curated data products within a cloud-based data lake environment. You will play a key role in embedding data engineering best practices, supporting colleagues across the data community, and ensuring the delivery of impactful … create high-quality data assets that are stable, scalable and re-useable. Experience developing and deploying data pipelines within an AWS S3 Data Lake using VS Code, Glue, Lambda, Git Hub and Terraform Experience with/understanding of a wide variety of analytics tools such as SQL, Alteryx, AWS Sagemaker, Quicksight, Tableau and … PowerBI Desirable: Experience using Lake Formation Experience with AWS Kinesis/Firehose for real-time data pipelines Experience of rail, airline or leisure industry Experience with data warehousing and AWS Redshift Why Join? This is a unique opportunity to join a forward-thinking organisation investing heavily in its data capability. You’ll be More ❯

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

management technical knowledge so as to be able to work across full data cycle. Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD Coding experience in Apache Spark, Iceberg or Python (Pandas) Experience in change and release management. Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. Experience is building Data lake and building CI/CD data pipelines A candidate is expected More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to … join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how … modernise legacy systems, migrate data to the cloud, and optimise data storage and processing costs. Ensure the integrity of datasets within the data lake aligns with logical models and that data is well documented in wikis, data dictionaries, etc. Participate in data engineering sprints, develop data More ❯

POWWR are looking for a Senior Data & Reporting Engineer to join our UK engineering team and help advance POWWR’s modern data and analytics platform (MDP). In this role, you’ll design and deliver high-quality data pipelines, models, software, and reporting solutions that power product features and insights across our SaaS business. … Platform Engineering: Design, build, and orchestrate modular, declarative data pipelines using dbt , Dagster , and dlt within a Kubernetes-hosted environment . Develop and optimize Delta Lake models in Databricks/Synapse and Azure Data Lake Gen2 , ensuring scalability and ACID compliance. Maintain and enhance existing data pipelines (SQL Server, Azure … architecture teams as well as business stakeholders. Bonus Skills Knowledge of data governance and lineage tools (e.g., OpenMetadata, DataHub). Use of table formats such as Delta Lake or Iceberg. Experience with data quality frameworks (e.g., dbt, Elementary, Great Expectations). Understanding of event-driven architectures and real-time data streaming (Kafka, Event More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Principal Data Engineer - hyrbid (Leeds) - £70k-£80k Are you an experienced Azure Data Engineer looking to make an impact in an established financial insitution. We are seeking a hands-on professional to join a high-performing team tasked with building and enhancing a modern Azure data platform, with an expertise in Databricks. About the … architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to … outputs. Opportunity to transition into a leadership role, supporting the development of junior team members. Key Skills & Experience: 5+ years of experience in Azure (ADF, Data Lake, Synapse). Strong SQL skills for data integration and reporting. Experience with Power BI for visualization and analytics. Familiarity with Python (preferred but not currently in use More ❯

Overview Data & Insight Managing Consultant Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always make a remarkable impact for our clients. We do this … helping them solve their most complex, ambiguous and strategic problems in new, inspiring and innovative ways. We collaborate with our clients to build remarkable digital products, together. The Data and Insight Practice in AND Consulting helps our clients to use data to make business choices based on evidence, design best in class technology and support them … in embedding data into their strategy and ways of working. As a Data & Insight Managing Consultant, you will be working and leading on data consulting projects with AND Digital's household name clients. Responsibilities Creating data visions & strategies for household name businesses Driving the transformation required for data-focussed ways More ❯

Purview Implementation Specialist – Azure - Inside IR35 The client is seeking a Purview Implementation Specialist to deliver the setup and integration of Microsoft Purview within their Azure data environment. The role focuses on metadata management, lineage tracking, and data quality enablement to support enterprise data governance and compliance.Key Responsibilities Configure and manage Microsoft Purview for metadata, lineage, and classification. Connect Purview to Azure and on-prem data sources (Data Lake, Synapse, SQL, Power BI, ADF). Implement and automate data quality rules, profiling, and dashboards. Enable and maintain metadata, glossary, and classification structures. Integrate Purview with ADF … and handover materials for internal teams. Skills & Experience Strong hands-on experience with Microsoft Purview implementation. Proficient in Azure data services – ADF, Synapse, SQL, Data Lake, Power BI. Good understanding of data governance, metadata, and data quality principles. Experience with automation scripting (PowerShell, ARM, Azure CLI). Excellent documentation and communication More ❯

Data Engineer Join the Team Powering the Future of Data at Vivedia Location: Sheffield - Hybrid (3 days per week) Salary : £50,000 to £60,000 depending on experience Department: Data Team At Vivedia , data isn’t just numbers — it’s the engine driving every decision, every innovation, and every customer experience. We … re growing, and we’re looking for a Data Engineer who’s ready to build the foundations of a smarter, more connected future. Why You’ll Love This Role You’ll play a pivotal role in designing, building, and optimizing the data systems that power our business. From robust pipelines to scalable platforms, your work will … help every team at Vivedia unlock insights, drive performance, and make data-driven decisions that matter. This is your chance to shape the future of our data ecosystem — and see your impact ripple across an entire organisation. What You’ll Do Build the backbone of our data universe Design, develop, and deploy scalable, secure More ❯

As a Technical Lead, you will play a key role in architecting and implementing robust data solutions within Google Cloud Platform (GCP). Full-time Closes 24/12/2025 Working within the Data Engineering department, you … will help to shape the technical direction of cloud-based solutions. Your focus will be defining the overall architecture for data ingestion from our Data Lake, including processing, storage, and analysis within GCP. By leveraging your expertise of Google BigQuery architecture and its features, you will design and implement data models optimised for … performance, scalability and best practices. You will act as the subject matter expert for development and optimisation to maintain data governance, while ensuring all designed solutions adhere to Company standards, security best practices, and regulatory requirements. This role is eligible for inclusion in the Company's hybrid working from home policy. Preferred Skills and Experience Proven experience as More ❯

We are looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects, Engineers, and Analysts, defining data architecture … frameworks and ensuring the development of scalable, robust, and cost-effective solutions. The ideal candidate will have a passion for data, be technology-agnostic, and possess excellent client-facing skills. Lead Data Architect Annual Salary: circa £85,000 Location: Flexible, hybrid working with some client travel Day to day of the role: Shape the approach to … agnostic. Proficiency in SQL and experience with data engineering coding languages such as Python, R, or Spark. Understanding of data warehouse and data lake principles. Experience with data visualisation tools such as PowerBI or Tableau. Leadership or mentoring experience within a technical team. Agile and/or DevOps project delivery experience More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

Data Curator is required to join a team working on a large-scale data governance programme and to be responsible for interpreting and structuring complex data, as well as creating interoperable datasets to support scientific research. You will be responsible for: Designing vocabularies, ontologies, and taxonomies, ensuring data is accurate, consistent, and … aligned with best practices. Curating, profiling, and validating datasets to ensure their quality and usability. Maintaining repositories and ensuring ongoing data accuracy. Collaborating with scientists, technical specialists, and business teams. Supporting training and adoption of data curation tools across the organisation. Contributing to process improvements and adapting to automation and AI developments Required experience and skills … Extensive experience in data curation in support of scientific research. Knowledge of data standards, ontologies, and taxonomies, and their implementation in centralized repositories. Proficiency with wide range of data curation and data governance tools will be beneficial. Strong communication and stakeholder engagement skills. Experience with enterprise data management, and data More ❯

Data Management Lead S/4HANA Hybrid - Ormskirk| £75,000 + Excellent Benefits Are you a data professional ready to take the lead in shaping a large-scale digital transformation? We're looking for an experienced Data Management Lead to define and deliver a long-term data strategy that underpins both our … ERP programme and the wider digital landscape. This is a senior, high-impact role that combines strategic vision with hands-on delivery You'll take ownership of the data workstream for a major ERP harmonisation initiative, ensuring the organisation's data is clean, compliant, and ready to drive smarter decision-making. You'll lead a team … of data professionals and work closely with stakeholders to embed sustainable data governance and management practices. Key Responsibilities Define and implement a comprehensive data strategy for the Digital function, focused on ERP transformation. Lead the data workstream, covering the full data migration lifecycle (ETL). Oversee data governance More ❯

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

Fabric Data engineer - £600 per day - Outside IR35 - Manchester once a week ** You must have experience with Fabric, those without will not be considered. You will be working to implement Microsoft Fabric … helping to technically guide the team. Rate: £600 per day location: Manchester once a week/UK only Duration: 6 Months Tech: Microsoft Fabric (essential), Azure Data Lake, Azure Data Factory, Building scalable data pipelines and working with APIs If this role sounds like a good fit, please send your Cv to amy … louise.boardman@maxwellbond.co.uk ** Fabric Data engineer - £600 per day - Outside IR35 - Manchester once a week More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯