Senior Data Engineer
- Location
- Manchester, England, United Kingdom
organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion / Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. Support the migration and re-platforming … . Experience with data governance and cataloguing using Databricks Unity Catalog (access control, lineage, discoverability). Experience with Azure DevOps, including branching and release / deployment strategies; Git, CI / CD and DevOps Pipelines. Hands on experience developing and supporting commercial enterprise data solutions ...