2 of 2 Delta Lake Jobs in South London

experience of data factory: complex orchestration, parameterization, event-based triggers, retry and failure handling, meta-driven ingestion Significant knowledge and experience of Lakehouse: delta lake, table optimisation, travel time, schema evolution Significant knowledge and experience of Spark/Notebooks and warehousing Significant knowledge and experience on how Fabric … DirectQuery Significant knowledge and experience of Identity & Access, data security, compliance Significant knowledge and experience of performance and cost engineering: query optimisation, file sizing, delta compaction, caching, capacity load patterns, capacity pooling. Significant knowledge and experience of Kimball vs data Vault vs Lakehouse, dimensional modelling, slowly changing dimensions ...

customer in Central London. Key ResponsibilitiesData Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2).Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely … ecosystem (OneLake, Data Factory, Fabric Lakehouse).Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark).Security & Compliance: Direct experience implementing security controls ...