1 to 25 of 140 Data Lake Jobs in England

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data warehouse ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices Develop and optimise data lake and data warehouse architectures on AWS Ensure high standards of data quality, governance, security and accessibility across data ...

flows within Microsoft Fabric and Azure Integrate data from third-party systems and internal platforms into the data lake environment Build scalable data models and semantic layers for business reporting Build and optimise SQL queries, data models and dimensional … schemas for reporting Support the continued growth of the organisation's data lake and analytics platform Analyse and interpret data to identify trends and insights that support business decision-making Work with business stakeholders to understand data needs and deliver actionable insights Manage ...

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience Contract Type: Permanent We're looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data … robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data ...

Azure Databricks, enabling seamless integration with multiple data sources. Lead greenfield implementations of the Lakehouse framework. Work with Azure Data Lake, Azure Data Factory, and cloud storage services. Implement robust partitioning, clustering and optimisation strategies. Define and select the appropriate data …/knowledge/experience: Experience designing ETL/ELT flows and building pipelines using Azure Databricks. Hands‐on experience with Azure Data Lake, Azure Data Factory, and integrating multiple source systems. Strong experience implementing Lakehouse architecture in greenfield environments. Expertise in data modelling ...

Location Leeds About the job Job summary We are currently looking for a Lead Data Architect to join our Strategy and Architecture Function within the Digital and Technology Group . This is a full-time opportunity, on a permanent basis. The role will be based … lies at the heart of the Agency and is responsible for delivering an optimised IT infrastructure and maximising the secure use of data to enable our scientists, inspectors, and the rest of the organisation to deliver world class services which can improve outcomes for patients and the general ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree ...

secure, reliable, and efficient data pipelines using Azure Synapse Analytics, Azure Data Factory, PySpark, and Azure Data Lake Storage. The engineer will work closely with cross functional teams to translate business requirements into technical solutions that support analytics, reporting, and data … Synapse Analytics. Implement incremental loads, CDC, and real-time data ingestion when needed. Architect and manage datasets in Azure Data Lake Storage (ADLS Gen2). Optimize data storage formats (Delta, Parquet, Avro, ORC) for performance and cost. Maintain and optimize Synapse SQL Pools ...

Months The Role Your Responsibilities: (Up to 10, Avoid repetition) Experience as Solution Designer and should be currently working on Data Lake (Big Data) based projects. Guide the full lifecycle of a BI solution, including requirements impact analysis, platform selection, technical architecture design, application design … with proven expertise in delivering challenging assignment. Provide thought leadership for Data Management, Data Migration Strategy and Data Lake Solutions. Good knowledge on Data Modelling and able to translate Business requirements to Design and Data Models, technical designs ...

architectural Experience with: Microsoft Fabric (OneLake, Data Engineering, Data Warehouse, Real-Time Analytics, Power BI). Azure Databricks (Delta Lake, Spark, Unity Catalog, MLflow). Azure Synapse Analytics (Dedicated & Serverless SQL) Data ingestion (ADF, Synapse Pipelines, Databricks Workflows). Azure Data Lake Storage Gen2 Strong understanding of Lakehouse architecture, medallion patterns, batch and streaming data processing AI & Advanced Analytics Experience: Des igning AI-ready enterprise data platforms. Experience with: Machine Learning pipelines and MLOps o Generative AI and Retrieval-Augmented Generation (RAG) Vector search ...

outcomes Design & Deliver end-to-end Azure data solutions using services such as Azure SQL, Data Factory, Data Lake, Cosmos DB, and Power BI Model & Optimise scalable data structures, pipelines, and performance tuning Secure & Govern data platforms in line … principles Hands-on expertise with Azure data services such as Azure SQL Database, Azure Data Factory, Azure Data Lake, Cosmos DB, and Power BI Experience designing scalable, high-performance data architectures and optimising pipelines Strong understanding of data governance ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … platform ensuring reliable data across the organisation Extensive hands-on experience designing and delivering scalable, resilient cloud-based data lake platforms using modern lakehouse architectures Drive better data governance through the creation and embedding of principles and processes Build and maintain ...

reliability for operational and reporting systems. Modern Data Platform Development Contribute to the build and enhancement of a data lake/lakehouse architecture. Work with AWS tools such as S3, Glue and Lambda. Develop robust, scalable data pipelines. Prepare clean, structured datasets … visualisation tools (Tableau desirable). Strong analytical, problem-solving and communication skills. Knowledge of data warehousing and/or data lake concepts. Any Data DevOps experience (e.g., Terraform, GitHub) would be highly beneficial. Experience & Behaviours You'll bring experience in a similar data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

Responsibilities Define the architecture and blueprint for a federated data platform built on Databricks Design and shape a centralised data lake architecture Translate business and PE investment metrics into measurable data engineering KPIs Identify data gaps, data availability issues … Architecture roles Strong experience with Databricks Deep understanding of data transformation, modelling, and engineering logic Experience designing data lake/lakehouse architectures Ability to translate business objectives into data architecture and KPIs Experience building data platform roadmaps and delivery ...

Senior Data & Analytics Consultant - Fully Remote - Microsoft partner £60,000 - £70,000 + Bonus and the chance to have shares in the business as they move to an employee owned model. A well established MS partner who are experiencing growth through a very strong project pipeline are looking … Senior Data & Analytics Consultant to their team. The Senior Data & Analytics Consultant will play a key role in helping their customers turn data into meaningful insight and measurable impact. In this role, you will design and deliver robust data and analytics solutions ...

strategic data leader ready to shape the future of a modern, digitally-enabled building society? Dudley Building Society is looking for an exceptional Head of Data to lead our enterprise-wide data strategy and transform how data enables insight, innovation, regulatory confidence … Azure and Fabric data platforms and Microsoft Purview governance environment. Oversee architecture, roadmap and optimisation across Azure Data Lake, Data Factory, Databricks, Synapse, SQL, Fabric Lakehouse and Power BI. Ensure data platforms meet regulatory and best-practice expectations (GDPR, PRA/ ...

Data Architect The Data Architect will play a vital role in shaping and implementing data strategies within the financial services industry. Based in London, this permanent position offers an excellent opportunity to design and manage data architecture for a forward-thinking organisation. … Client Details Data Architect This organisation operates within the financial services industry and is recognised for its innovative approach to data driven solutions. As a mid-sized company, they focus on analytics and strive to deliver exceptional results to their clients and stakeholders. Description Data ...

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Senior Data Engineer Location: Warwick (Hybrid Working) Contract: 6 Months Role Overview Our client is seeking a skilled Senior Data Engineer to lead … design, development, and maintenance of data integration solutions and data warehouse environments. This role will focus on building and optimising ETL/ELT pipelines, supporting data warehousing initiatives, and ensuring the quality, performance, and reliability of large-scale data systems. The successful ...

Associate Director, Master Data Management Solution Architect, Engineering, AI & Data, Technology & Transformation Basic information Location London Business Line Job Type Permanent/FTC Date published 10-Dec-2025 Connect to your Industry Do you want to be at the heart of some of the biggest … reference data management, and stewardship workflows Strong proficiency with cloud-native data services (Azure Purview/ADF, AWS Glue/Lake Formation, GCP DataPlex) and modern integration technologies (APIs, streaming, ETL/ELT). Solid understanding of data governance, data lineage ...

HEAD OF ERP DATA (MAT COVER) LONDON/HYBRID UP TO £90,000 This is a rare opportunity to lead a data function through a major transformation at a global consumer brand. You will play a critical role in stabilising, shaping, and optimising their product … supply chain data ecosystem as they implement a new ERP platform and enhance their BI and data environment. ROLES AND RESPONSIBILITIES: The Head of ERP Data will: • Lead and develop a data team covering data engineering and master data. • Oversee ...