Databricks Platform Lead

Azure Databricks Platform Lead Hybrid | Slough

Are you a Databricks expert with deep knowledge of both data infrastructure and engineering

We’re looking for a Databricks Champion to take ownership of an enterprise-scale Azure Databricks environment — driving performance, governance, connectivity, and cost optimisation across the platform.

This is a client-facing, hands-on role that combines cloud engineering, data architecture, and platform operations. You’ll work closely with security, DevOps, data, and networking teams — and must be comfortable engaging senior stakeholders and driving best practices across the board.

Location: Hybrid with travel to Slough (a few days per week)

Start: ASAP

Type: Full time permenant

What You’ll Be Doing:
  • Manage & optimise Azure Databricks workspaces (VNet Injection, private endpoints, cluster config, performance tuning, cost control)
  • Design and implement Unity Catalog for governance, access control, data lineage, and auditing
  • Integrate Entra ID for SSO, SCIM, credential passthrough, Key Vault, and ACLs
  • Build secure networking (VNet peering, NSGs, DNS/routing, firewalls)
  • Orchestrate data pipelines with ADF Databricks
  • Configure and troubleshoot ADLS Gen2 access, mounts, and credential passthrough
  • Implement monitoring, alerting, DR, and platform health checks
  • Define and share best practices, architecture documents, and runbooks
  • Act as SME, collaborating across teams and representing the Databricks function in architecture reviews
Key Skills:
  • Expert in Azure Databricks administration, Unity Catalog, Delta Lake, Spark
  • Strong knowledge of Azure Data Factory, ADLS Gen2, Key Vault, and Azure networking
  • Skilled in CI/CD automation (Azure DevOps, GitHub Actions), scripting (Python, PowerShell, CLI)
  • Proven experience with enterprise-grade cloud security, RBAC, and data access governance
  • Able to work closely with internal stakeholders and communicate complex ideas clearly
  • Certifications (bonus): Azure Architect, Databricks Certified Data Engineer

This role is urgent, so if you’re a hands-on Databricks leader who can hit the ground running and enjoys working in hybrid client-facing environments, get in touch today.

#Databricks #Azure #ADF #DataEngineering #UnityCatalog #CloudInfrastructure #DevOps #AzureDatabricks #Hiring #ContractRoles #SloughJobs

Company
CODEVERSE LIMITED
Location
London, South East, England, United Kingdom
Hybrid / WFH Options
Employment Type
Full-Time
Salary
£70,000 - £100,000 per annum
Posted
Company
CODEVERSE LIMITED
Location
London, South East, England, United Kingdom
Hybrid / WFH Options
Employment Type
Full-Time
Salary
£70,000 - £100,000 per annum
Posted