Lead Data Engineer
- Hiring Organisation
- Staffworx Limited
- Location
- United Kingdom
- Employment Type
- Contract, Work From Home
quality, testing, data quality controls, CI/CD and environment promotion Automate deployment with Databricks Asset Bundles, Terraform or Bicep, and Azure DevOps or GitHub Actions Tune performance and cost, including Spark optimisation and cluster and warehouse design Mentor engineers within the client team, including code reviews … Auto Loader Declarative pipelines (Delta Live Tables or Lakeflow) and Structured Streaming CI/CD for Databricks using Databricks Asset Bundles, Azure DevOps or GitHub Actions, and Terraform or Bicep Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Entra ID, Key Vault, private endpoints, RBAC Experience ...