Lead Data Engineer
- Hiring Organisation
- Quilter
- Location
- London, UK
- Employment Type
- Full-time
Management, Delta Live Tables, Spark Declarative Pipelines and platform optimisation. Microsoft Fabric: Lakehouse, Data Warehouse, Real-Time Intelligence, Semantic Models, and Fabric administration concepts. Azure: ADLS Gen2, Azure Data Factory, Key Vault, Functions, Azure Monitor, and broader Azure data services. Spark: Deep understanding of Spark internals … distributed computing principles, optimisation techniques and features, performance tuning. Languages: Advanced Python and SQL development skills; Scala experience beneficial. CI/CD & DevOps: Azure DevOps, Git-based development workflows, Infrastructure as Code, automated testing, and deployment automation. Orchestration: Databricks Workflows, Azure Data Factory, Fabric pipelines, and other enterprise ...