Lead Data Engineer (Azure/Databricks)
- Location
- Sheffield, England, United Kingdom
data transformation layer (post-event bus) in Databricks. Move from ad-hoc scripts to software engineering standards (CI/CD, testing, modular code). Modelling Implementation: Support the implementation of the “Unified Name Space” (UNS) across the data estate, to include schema and path standardisation; machine hierarchies and semantic … more than moving JSON blobs. You have strong opinions on schema design, data standardisation, and ideally have worked with graph data or hierarchical models. Code Quality: You treat data pipelines as software. You use git, CI/CD, and automated testing. You can teach these practices ...