Databricks Architect

Alvarium Talent is partnering with a fast-growing, independent Data and AI consultancy that specialises in delivering cutting-edge analytics, cloud data platforms, and AI solutions to enterprise clients across multiple sectors. Due to continued growth and demand for Databricks expertise, we are hiring a Databricks Architect to lead the design and delivery of modern Lakehouse architectures.

Role Purpose

As a Databricks Architect, you will play a pivotal role in shaping and delivering scalable, enterprise-grade data architectures using the Databricks Lakehouse platform. Acting as both a trusted advisor and hands-on technical leader, you will work closely with clients to translate business requirements into robust, secure, and high-performing data solutions. You’ll contribute to both delivery and pre-sales, influencing data strategy while ensuring best practices in governance, performance, and cost optimisation are embedded from day one.

Core Responsibilities

• Architect and deliver Databricks Lakehouse solutions across ingestion, transformation, and analytics layers
• Design scalable data platforms supporting AI, ML, and business intelligence use cases
• Engage stakeholders to gather requirements and present architectural decisions
• Lead end-to-end solution delivery, ensuring quality, performance, and security standards
• Optimise Databricks environments for cost efficiency and scalability
• Implement data governance frameworks, including lineage, cataloguing (Unity Catalog/Purview), and security
• Develop and maintain CI/CD pipelines using Azure DevOps, GitHub, or similar tools
• Support pre-sales activities including RFP responses, solution design, and Proofs of Concept (PoCs)
• Advocate best practices and contribute to reusable architecture frameworks

Role Requirements

Essential

• Proven experience designing and delivering Databricks Lakehouse architectures at enterprise scale
• Strong hands-on expertise in Spark, PySpark, SQL, and Python or Scala
• Deep understanding of data modelling (Kimball, Data Vault, 3NF)
• Experience building ETL pipelines using Databricks workflows and Delta Live Tables
• Cloud platform experience (Azure preferred, AWS or GCP acceptable)
• Experience implementing data governance, security (RBAC/IAM), and compliance frameworks
• Exposure to BI tools such as Power BI or Tableau
• Strong stakeholder management and client-facing consulting experience

Desirable

• Experience with Unity Catalog or Microsoft Purview
• Knowledge of ML/AI capabilities within Databricks (MLflow, AutoML)
• Experience with Infrastructure as Code (Terraform, ARM templates)
• Strong understanding of DevOps and CI/CD practices
• Databricks certifications (Data Engineer, ML, Lakehouse, or GenAI)

Why Apply

• Work with a high-growth consultancy at the forefront of Data & AI innovation
• Deliver cutting-edge Databricks and Lakehouse solutions across diverse industries
• Opportunity to influence enterprise data strategies and transformation programmes
• Strong emphasis on career progression, certifications, and continuous learning
• Collaborative, people-first culture with high levels of autonomy and impact