1 to 25 of 92 Permanent Data Lake Jobs in England

Data Engineer, you will: Build, test and maintain scalable data pipelines using Azure Synapse Pipelines and Data Lake Storage Develop and maintain solutions to support the NHS Federated Data Platform Contribute to the design and automation of data flows … Delivering and maintaining data engineering solutions within a cloud-based data platform using Azure Synapse Pipelines and Data Lake Storage or similar Developing and optimising curated datasets using Synapse SQL, Spark notebooks such as PySpark or equivalent technologies Ttranslating requirements into effective data ...

collecting, transforming, and loading data into various data stores. Build and maintain data warehousing and data lake solutions Develop and deploy data models that support various business requirements Lead the design of data solutions with quality, automation … governance Expertise in developing Data Warehouses In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh Strong knowledge of data architecture and data modelling practices Cost ...

Data Architect Hybrid - Staffordshire (2-3 days a week ideally, but can be flexible for the right person) £70-90,000 based on experience About the Organisation Join a nationally recognised organisation that is significantly investing in its data and AI capabilities as part … data, innovation and continuous improvement Technology You'll Work With Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines and orchestration Architecture & Governance: Enterprise data ...

platform that directly supports board-level decision making. The technology stack is Microsoft-led, with an Azure environment, Azure Data Lake, Power BI, and Power Apps, alongside a bespoke operational system and an ERP that need to be integrated. Key Responsibilities Design and build … modern Azure-based data platform, including: Azure Data Lake Data ingestion pipelines Data modelling and transformation Automate ingestion of data from: Bespoke operational systems ERP systems High-volume transactional sources (1,000+ transactions per hour) Establish robust data ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies (event hub). Version control (Git), Agile Delivery, and DevOps ...

role will involve working closely with business users, developing modern reporting solutions, and strengthening our data platform across our data lake and data warehouse environments. Key Responsibilities: Reporting Deliver MI and BI reporting across the business. Analyse and report on data … semantic models, stored procedures, views, tables, and underlying source data. Develop, maintain, and expand ETL pipelines for ingestion into the data lake and data warehouse. Liaise with third parties regarding file deliveries and resolve import or data quality issues. Perform log and error ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

Data Architect Harrogate- Hybrid workingUp to £80,000 (DOE) + Benefits Are you an experienced Data Architect looking to shape the data foundations of a modern, forward-thinking organisation? This is a rare opportunity to take ownership of enterprise-wide data architecture … play a central role in how data is structured, governed, protected, and leveraged across the business. In this role, you'll define the organisation's data vision and turn strategic goals into real, scalable data capabilities - ensuring data is trusted, secure ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

distribution keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue …/Iceberg for low-cost, serverless analytics. Manage Glue Data Catalog integrations and table schema management. 5. Storage (S3) & Data Lake Architecture Design secure, cost-efficient S3 data lake structures (bronze/silver/gold zones). Implement data lifecycle ...

Data Architect 3 days a week onsite in London 35hr working week with flexible working hours We're looking for an experienced Data Architect to join a well-established company who are going through an enterprise-wide modernisation programme. This is a brand-new role within … Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture ...

Data Architect 3 days a week onsite in Sunderland 35hr working week with flexible working hours We're looking for an experienced Data Architect to join a well-established company who are going through an enterprise-wide modernisation programme. This is a brand-new role within … Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture ...

Overview We are seeking a highly skilled Data Analyst to play a pivotal role in transforming Chambers into a truly data-driven insights business. Working within a dedicated data team alongside analysts, data engineers and AI engineers, you will translate business needs … Python, Databricks and visualisation tools (Power BI, Tableau). Investigate and reconcile data across operational databases, the data lake, and the lakehouse to support business and data governance needs. Develop and maintain business intelligence dashboards across various domains Collaborate closely with stakeholders ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

make a significant impact from day one. Role Responsibilities Design and build a modern Azure-based data platform (Data Lake, ingestion pipelines, modelling, transformation). Lead data-driven projects across the organisation, ensuring timely delivery. Automate ingestion from ERP, CRM, bespoke operational systems … experience as a Data Engineer or in a similar role. Strong Azure background, ideally including Data Factory, Data Lake, Databricks, Synapse (or similar). Solid understanding of SQL, Python, ETL/ELT, data warehousing, and data modelling. Experience integrating ...

Databricks Architect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

Databricks Architect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

Databricks A rchitect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

looking for a highly skilled Senior Data Engineer to lead the design and build of our new enterprise data platform using Microsoft Fabric. This is a hands-on role focused on creating a scalable, secure and future-ready data warehouse to enable robust analytics … principles. Ability to design scalable data architectures aligned to business needs. Desirable: Previously worked with Databricks, Azure Synapse, Azure Data Lake, or equivalent cloud platforms. Knowledge of data governance and security frameworks. Exposure to DevOps/DataOps practices (e.g., CI/CD, environments ...