14 of 14 Permanent Data Lake Jobs in the North of England

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

Data Architect Up to £125,000 About the Role We are seeking a Data Architect to support the design and delivery of modern Azure-based data solutions within a fast-growing data consultancy environment. This role plays a key part in helping … data solutions end-to-end Strong hands-on experience with Azure data technologies (ADF, Synapse, Azure SQL, Data Lake, Fabric) Expertise in data modelling techniques Ability to gather and translate business and technical requirements into scalable solutions Strong communication skills, with ...

Data Analyst - Manchester or Liverpool Based (2 days a week on site) - Permanent Role Team: IT - Infrastructure Location: Liverpool or Manchester Role overview Introduction to the role: As a Data Analyst, you are an integral part of both the IT Services team and the wider … from stakeholders Demonstrable previous experience within the SQL DBA/Power BI area, specifically: Microsoft Fabric, including data factory Data Lake Dataverse Python Google Looker Studio AI Microsoft SQL Server, including Enterprise features, specifically availability groups SQL Scripting/Queries Power BI (Data ...

Data Engineer - SC Cleared/SC Eligible Location: Newcastle upon Tyne About the Role We are working with a leading organisation who are building a brand-new engineering and data function in Newcastle. They are looking to hire multiple Data Engineers across Junior … modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good communication and stakeholder engagement • Understanding of secure ...

Data Engineer £60,000-£65,000 Manchester City Centre- Hybrid We are looking for highly skilled and experienced Azure Data Engineer to join a newly established team with a strong focus on data. In this role, you will play a key part in delivering a complex … high-impact project within the Financial Services/Capital Markets domain. The position centres on designing and building robust, scalable, and reusable data pipelines, transforming raw data into well-structured relational models. You will work with large, complex, multi-source datasets, including loan servicing platforms, property ...

healthtech scale-up is transforming how organisations understand and act on real-world feedback data. Their platform aggregates and processes millions of unstructured data points from external sources, turning them into meaningful insights that drive decision-making across large enterprise clients. Following recent investment and a strategic shift … high-volume data challenges. Key Responsibilities Own and evolve the organisation’s AWS-based data platform, including data lake, warehouse and modelling layers Design and build scalable data pipelines ingesting large volumes of structured and unstructured external data Develop ...

Data Architect Up to £90,000 (Dependant on Experience) This is a hybrid position, combining the best of both worlds - working from home and spending 1-2 days a week in ourHalifaxoffice. We have an exciting opportunity to join us here atCovéa Insuranceas a Data Architect … Data Vault, Kimball, Inmon, and medallion design patterns Broad experience with cloud and on-prem Data Warehouse, Data Lake, and Lakehouse architectures Relevant cloud/data architecture certifications (Databricks, AWS, Azure) preferred Confident working with stakeholders at all levels, including partners ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

data engineer who takes pride in building clean pipelines, fast queries, and reliable data infrastructure? We are looking for a talented Senior Data Engineer to join our growing and highly capable Business Intelligence team at Protein Works. You will be responsible for delivering … Take day-to-day responsibility for the maintenance and enhancement of the data quality, security and performance of our Data Lake and Warehouse. Drive CI/CD: Build and maintain robust CI/CD processes for data pipelines using tools such as Cloud ...

Data Analyst £35,000 Liverpool OR Manchester - 2 days a week in the office Our client in Liverpool is on the lookout for a Data Analyst who will play a vital role within both the IT Services team and the wider IT Department, supporting the delivery … business The following skills and experience will be beneficial for this role: Microsoft Fabric, including data factory Data Lake Python Microsoft SQL Server, including Enterprise features, specifically availability groups Power BI (Data Visualisation), designing and building interactive/dynamic dashboards ...

Role – Azure Data Engineer Technology – MS Fabric, Azure, PowerBI Location – Leeds, UK Compensation – Competitive (including bonus) Your Role As an Azure & Microsoft Fabric Lead Developer, you will lead the design and development of enterprise‐grade data pipelines, lakehouses, and analytics solutions using Azure Data … high‐quality delivery of modern analytics platforms. Required Strong hands‐on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse Proven experience designing and developing solutions using Microsoft Fabric: Lakehouse Data Pipelines Dataflows Gen2 Warehouse (SQL Endpoint ...

Data Engineering Manager - Up to £100,000 Location: UK-wide The Opportunity We're working with a leading data consultancy who specialise in delivering modern, cloud-based data platforms across a broad range of industries. They partner closely with clients to design and deliver … scalable, high-quality data solutions using cutting-edge Microsoft technologies. This is an ideal role for a seasoned consultant who enjoys a blend of strategy, leadership, and hands-on engineering. The Role As a Data Engineering Manager, you will play a key role in both delivery ...

Data Engineering Manager - Up to £100,000 Location: UK-wide The Opportunity We're working with a leading data consultancy who specialise in delivering modern, cloud-based data platforms across a broad range of industries. They partner closely with clients to design and deliver … scalable, high-quality data solutions using cutting-edge Microsoft technologies. This is an ideal role for a seasoned consultant who enjoys a blend of strategy, leadership, and hands-on engineering. The Role As a Data Engineering Manager, you will play a key role in both delivery ...

coding languages such as Python, Java, SQL, and scripting languages e.g., Bash. Mentors and advises other team members in testing practices. Automates data and application testing tasks and builds test coverage through existing or new infrastructure. Analyses and reports on test activities, results, issues and risks. Production data … environment issues. Using Apache Airflow for task orchestration and reviewing output logs. Basic understanding of EMR and reviewing output logs. Basic understanding of data processing using Apache Spark. Use of Jupyter notebooks to query and validate data. Use of Amazon Athena to query and validate data. ...