Lead Data Engineer (Databricks)
- Hiring Organisation
- United Utilities
- Location
- Olney, Buckinghamshire, United Kingdom
- Salary
- £ 70 K
governed data across the organisation.You’ll:Design and develop scalable batch and streaming data pipelines using Databricks, Spark and Delta LakeImplement medallion architecture (bronze / silver / gold) to ensure data quality, lineage and efficient consumptionOptimise Spark jobs and workflows to meet near real-time monitoring SLAsBuild … deliver high-quality, well-documented datasetsMonitor, troubleshoot and continuously improve production pipelines for reliability, performance and cost efficiencyChampion best practices across CI / CD, testing, version control and documentationAct as a technical leader and mentor, raising standards across the data engineering communityWhat you’ll bringEssentialDeep ...