Lead Data Engineer
- Hiring Organisation
- Staffworx Limited
- Location
- United Kingdom
- Employment Type
- Contract, Work From Home
Catalog structure, access controls and lineage, and integrate with Microsoft Purview Set engineering standards for code quality, testing, data quality controls, CI / CD and environment promotion Automate deployment with Databricks Asset Bundles, Terraform or Bicep, and Azure DevOps or GitHub Actions Tune performance … Delta Lake, Unity Catalog, medallion architecture, Databricks Workflows and Auto Loader Declarative pipelines (Delta Live Tables or Lakeflow) and Structured Streaming CI / CD for Databricks using Databricks Asset Bundles, Azure DevOps or GitHub Actions, and Terraform or Bicep Azure Data Factory, Azure SQL, Data ...