Lead Data Engineer (Azure/Databricks)
- Location
- Sheffield, England, United Kingdom
data transformation layer (post-event bus) in Databricks. Move from ad-hoc scripts to software engineering standards (CI/CD, testing, modular code). Modelling Implementation: Support the implementation of the “Unified Name Space” (UNS) across the data estate, to include schema and path standardisation; machine hierarchies and semantic … Analytics (via Databricks/MLflow), unblocking the Data Science team. Mentorship: Upskill the existing team in good practices (dbt, git workflows, SQL optimisation, data modelling). Experience & Background Pragmatic Architect: Capable of making trade-offs between “academic perfection” and “business value”. They must align architecture ...