1 to 25 of 79 Permanent Data Lake Jobs in the UK excluding London

Data Engineer, you will: Build, test and maintain scalable data pipelines using Azure Synapse Pipelines and Data Lake Storage Develop and maintain solutions to support the NHS Federated Data Platform Contribute to the design and automation of data flows … Delivering and maintaining data engineering solutions within a cloud-based data platform using Azure Synapse Pipelines and Data Lake Storage or similar Developing and optimising curated datasets using Synapse SQL, Spark notebooks such as PySpark or equivalent technologies Ttranslating requirements into effective data ...

Data Architect Hybrid - Staffordshire (2-3 days a week ideally, but can be flexible for the right person) £70-90,000 based on experience About the Organisation Join a nationally recognised organisation that is significantly investing in its data and AI capabilities as part … data, innovation and continuous improvement Technology You'll Work With Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines and orchestration Architecture & Governance: Enterprise data ...

platform that directly supports board-level decision making. The technology stack is Microsoft-led, with an Azure environment, Azure Data Lake, Power BI, and Power Apps, alongside a bespoke operational system and an ERP that need to be integrated. Key Responsibilities Design and build … modern Azure-based data platform, including: Azure Data Lake Data ingestion pipelines Data modelling and transformation Automate ingestion of data from: Bespoke operational systems ERP systems High-volume transactional sources (1,000+ transactions per hour) Establish robust data ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies (event hub). Version control (Git), Agile Delivery, and DevOps ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data … Keywords Senior Data Engineer, Data Engineer, Microsoft Fabric, Azure Data Engineer, Data Warehouse, Data Lake, Lakehouse, ETL, Data Pipelines, SQL Server, SQL, Power BI, Python, M Language, R, Microsoft Partner, Consultancy, MSP, Scotland, Remote, Hybrid ...

role will involve working closely with business users, developing modern reporting solutions, and strengthening our data platform across our data lake and data warehouse environments. Key Responsibilities: Reporting Deliver MI and BI reporting across the business. Analyse and report on data … semantic models, stored procedures, views, tables, and underlying source data. Develop, maintain, and expand ETL pipelines for ingestion into the data lake and data warehouse. Liaise with third parties regarding file deliveries and resolve import or data quality issues. Perform log and error ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

Data Architect Harrogate- Hybrid workingUp to £80,000 (DOE) + Benefits Are you an experienced Data Architect looking to shape the data foundations of a modern, forward-thinking organisation? This is a rare opportunity to take ownership of enterprise-wide data architecture … play a central role in how data is structured, governed, protected, and leveraged across the business. In this role, you'll define the organisation's data vision and turn strategic goals into real, scalable data capabilities - ensuring data is trusted, secure ...

major client in the energy sector. The position focuses on designing, developing, and maintaining Azure-based data platforms-particularly Delta Lake and modern analytics services-while providing architectural leadership and hands-on engineering expertise. The role operates on a hybrid model, requiring three days per week onsite … Glasgow. Key Responsibilities Develop and maintain Azure data architecture , including Delta Lake, ensuring compliance with data governance and security standards. Analyse and resolve data integration and system interoperability challenges across complex environments. Design and implement Azure data solutions using services such ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

Data Architect 3 days a week onsite in Sunderland 35hr working week with flexible working hours We're looking for an experienced Data Architect to join a well-established company who are going through an enterprise-wide modernisation programme. This is a brand-new role within … Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture ...

Overview We are seeking a highly skilled Data Analyst to play a pivotal role in transforming Chambers into a truly data-driven insights business. Working within a dedicated data team alongside analysts, data engineers and AI engineers, you will translate business needs … Python, Databricks and visualisation tools (Power BI, Tableau). Investigate and reconcile data across operational databases, the data lake, and the lakehouse to support business and data governance needs. Develop and maintain business intelligence dashboards across various domains Collaborate closely with stakeholders ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

make a significant impact from day one. Role Responsibilities Design and build a modern Azure-based data platform (Data Lake, ingestion pipelines, modelling, transformation). Lead data-driven projects across the organisation, ensuring timely delivery. Automate ingestion from ERP, CRM, bespoke operational systems … experience as a Data Engineer or in a similar role. Strong Azure background, ideally including Data Factory, Data Lake, Databricks, Synapse (or similar). Solid understanding of SQL, Python, ETL/ELT, data warehousing, and data modelling. Experience integrating ...

Databricks Architect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

Databricks Architect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

Databricks A rchitect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

looking for a highly skilled Senior Data Engineer to lead the design and build of our new enterprise data platform using Microsoft Fabric. This is a hands-on role focused on creating a scalable, secure and future-ready data warehouse to enable robust analytics … principles. Ability to design scalable data architectures aligned to business needs. Desirable: Previously worked with Databricks, Azure Synapse, Azure Data Lake, or equivalent cloud platforms. Knowledge of data governance and security frameworks. Exposure to DevOps/DataOps practices (e.g., CI/CD, environments ...

Role: Lead Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a lead data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Hands on skills across the GCP tech stack, SQL and Python. Ability to lead cultural change across organisations, and manage senior ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … clients turn complexity into opportunity, and fostering a culture where technical specialists thrive and grow. An opportunity has arisen for a Principal GCP Data Engineer to join the London-based data and analytics practice. This Principal GCP Data Engineer role offers the chance ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … clients turn complexity into opportunity, and fostering a culture where technical specialists thrive and grow. An opportunity has arisen for a Principal GCP Data Engineer to join the London-based data and analytics practice. This Principal GCP Data Engineer role offers the chance ...