Lead Data Platform Engineer (London Area)

Lead Data Platform Engineer (Databricks)

📍 UK-Based | Hybrid / Flexible Working

💰 £100k-£120k + package

💼 Top-Tier Consultancy | Enterprise Data Transformation | Cloud-Native Platforms

We’re working with a top-tier consultancy delivering large-scale data and digital transformation across regulated industries. They are seeking a Lead Data Platform Engineer to take ownership of the design, build, and leadership of modern data platforms, with a strong focus on Databricks and cloud-native tooling.

This is a hands-on technical leadership role — ideal for someone who’s equally comfortable designing robust data architectures, leading engineering teams, and engaging in strategic conversations around delivery, best practices, and platform evolution.

🔧 Key Responsibilities

• Lead the design and delivery of production-grade, cloud-native data platforms
• Work across multiple concurrent projects, setting direction and ensuring engineering excellence
• Collaborate with stakeholders, including involvement in pre-sales and delivery estimation (>£1m)
• Embed best practices for data engineering workflows using Databricks and IaC
• Ensure platforms meet resilience, recovery, security, and compliance standards
• Mentor engineers and contribute to capability growth across the team

✅ What You’ll Bring

• 10+ years in software/systems engineering roles
• 2+ years hands-on with Databricks (Professional-level certified)
• Proven track record leading engineering teams and delivering complex platforms
• Strong experience with Terraform and infrastructure-as-code best practices
• Background in designing both cloud-native and hybrid data architectures
• Solid understanding of cloud security, networking, and DR principles
• Experience working on major digital transformation or IT consolidation programmes

💻 Tech Stack / Tooling

• Databricks , Spark, Delta Lake
• Terraform , GitHub/GitLab, Azure DevOps
• Cloud-native services: e.g. GCP (Dataflow, BigQuery), Azure, or AWS equivalents
• Jira, Confluence
• CI/CD and DevSecOps best practices

🎓 Certifications (Preferred)

• Databricks Certified Professional (Data or ML Engineer), ideally also Architect-level
• Cloud architecture certification (AWS, Azure, or GCP)
• Degree or MSc in Computer Science, Software Engineering, or similar