18 of 18 Data Lake Jobs in the North of England

solutions* Evaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patterns* Design technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)* Create and maintain architecture documentation, including data … tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate new technologies before ...

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing … ensuring compliance with industry standards. Deep expertise in data modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration ...

Data Architect Up to £125,000 About the Role We are seeking a Data Architect to support the design and delivery of modern Azure-based data solutions within a fast-growing data consultancy environment. This role plays a key part in helping … data solutions end-to-end Strong hands-on experience with Azure data technologies (ADF, Synapse, Azure SQL, Data Lake, Fabric) Expertise in data modelling techniques Ability to gather and translate business and technical requirements into scalable solutions Strong communication skills, with ...

Data Analyst - Manchester or Liverpool Based (2 days a week on site) - Permanent Role Team: IT - Infrastructure Location: Liverpool or Manchester Role overview Introduction to the role: As a Data Analyst, you are an integral part of both the IT Services team and the wider … from stakeholders Demonstrable previous experience within the SQL DBA/Power BI area, specifically: Microsoft Fabric, including data factory Data Lake Dataverse Python Google Looker Studio AI Microsoft SQL Server, including Enterprise features, specifically availability groups SQL Scripting/Queries Power BI (Data ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot Intermediate or advanced … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

Data Engineer £60,000-£65,000 Manchester City Centre- Hybrid We are looking for highly skilled and experienced Azure Data Engineer to join a newly established team with a strong focus on data. In this role, you will play a key part in delivering a complex … high-impact project within the Financial Services/Capital Markets domain. The position centres on designing and building robust, scalable, and reusable data pipelines, transforming raw data into well-structured relational models. You will work with large, complex, multi-source datasets, including loan servicing platforms, property ...

healthtech scale-up is transforming how organisations understand and act on real-world feedback data. Their platform aggregates and processes millions of unstructured data points from external sources, turning them into meaningful insights that drive decision-making across large enterprise clients. Following recent investment and a strategic shift … high-volume data challenges. Key Responsibilities Own and evolve the organisation’s AWS-based data platform, including data lake, warehouse and modelling layers Design and build scalable data pipelines ingesting large volumes of structured and unstructured external data Develop ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

data engineer who takes pride in building clean pipelines, fast queries, and reliable data infrastructure? We are looking for a talented Senior Data Engineer to join our growing and highly capable Business Intelligence team at Protein Works. You will be responsible for delivering … Take day-to-day responsibility for the maintenance and enhancement of the data quality, security and performance of our Data Lake and Warehouse. Drive CI/CD: Build and maintain robust CI/CD processes for data pipelines using tools such as Cloud ...

enjoy shaping robust data solutions and leading teams to deliver high-quality outcomes for clients? As a Senior Data Architect within our Data & AI Practice, you will play a critical role in the technical delivery of complex data solutions across our Strategic … Open Group Architecture Framework. Hands-on experience designing and delivering modern data platforms using technologies such as Azure Data Lake Gen2, Azure Synapse Analytics, Microsoft Fabric, Snowflake, Oracle, SAP or Teradata. Strong expertise in data integration and pipeline development using tools such ...

Data Analyst £35,000 Liverpool OR Manchester - 2 days a week in the office Our client in Liverpool is on the lookout for a Data Analyst who will play a vital role within both the IT Services team and the wider IT Department, supporting the delivery … business The following skills and experience will be beneficial for this role: Microsoft Fabric, including data factory Data Lake Python Microsoft SQL Server, including Enterprise features, specifically availability groups Power BI (Data Visualisation), designing and building interactive/dynamic dashboards ...

Role – Azure Data Engineer Technology – MS Fabric, Azure, PowerBI Location – Leeds, UK Compensation – Competitive (including bonus) Your Role As an Azure & Microsoft Fabric Lead Developer, you will lead the design and development of enterprise‐grade data pipelines, lakehouses, and analytics solutions using Azure Data … high‐quality delivery of modern analytics platforms. Required Strong hands‐on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse Proven experience designing and developing solutions using Microsoft Fabric: Lakehouse Data Pipelines Dataflows Gen2 Warehouse (SQL Endpoint ...

delivery Operational Responsibilities: Ensure timely resolution and compliance of escalated incidents and tickets in line with agreed SLAs Support ETL and Data Lake operational practices and continuous improvement activities Validate change implementation plans and support capacity planning activities Participate in customer meetings to understand operational challenges … Strong systems analysis and user experience analysis capabilities Analytical mindset with strong problem-solving skills Experience working with ETL processes and Data Lake architectures Knowledge of AWS Core Services, RDS and analytics tooling Desirable Certifications: AWS Certified Data Analytics - Specialty ITIL Foundation Certification This ...

Data Engineering Manager - Up to £100,000 Location: UK-wide The Opportunity We're working with a leading data consultancy who specialise in delivering modern, cloud-based data platforms across a broad range of industries. They partner closely with clients to design and deliver … scalable, high-quality data solutions using cutting-edge Microsoft technologies. This is an ideal role for a seasoned consultant who enjoys a blend of strategy, leadership, and hands-on engineering. The Role As a Data Engineering Manager, you will play a key role in both delivery ...

Data Engineering Manager - Up to £100,000 Location: UK-wide The Opportunity We're working with a leading data consultancy who specialise in delivering modern, cloud-based data platforms across a broad range of industries. They partner closely with clients to design and deliver … scalable, high-quality data solutions using cutting-edge Microsoft technologies. This is an ideal role for a seasoned consultant who enjoys a blend of strategy, leadership, and hands-on engineering. The Role As a Data Engineering Manager, you will play a key role in both delivery ...

Judge, RAGAS), monitoring/observability (Langfuse), cost optimisation Delivery Governance: programme planning, roadmap ownership, risk & dependency management, stakeholder alignment, executive reporting Data & Analytics: Data lakes/warehouses, ETL/ELT, PySpark, SQL, BI integration, data quality and lineage ...

coding languages such as Python, Java, SQL, and scripting languages e.g., Bash. Mentors and advises other team members in testing practices. Automates data and application testing tasks and builds test coverage through existing or new infrastructure. Analyses and reports on test activities, results, issues and risks. Production data … environment issues. Using Apache Airflow for task orchestration and reviewing output logs. Basic understanding of EMR and reviewing output logs. Basic understanding of data processing using Apache Spark. Use of Jupyter notebooks to query and validate data. Use of Amazon Athena to query and validate data. ...