Enterprise Databricks Data Architect
DescriptionEnterprise Data Architect (Databricks / Azure Data Platform)Location: London (Hybrid, 1-2 days per week)Duration: Initial 6 months+Robert Half are supporting a leading global risk consulting firm organisation on a major Finance Data Lake, Self-Service Reporting and AI Enablement programme and are seeking an experienced Enterprise Data Architect with deep Databricks expertise. This is a hands-on architecture role requiring a strong blend of Enterprise Data Architecture, Data Modelling, Databricks Engineering, Azure Data Platform expertise and Dynamics 365 F&O integration experience. The successful candidate will be responsible for defining enterprise standards, implementing scalable data frameworks and ensuring a robust foundation for future AI-driven reporting and analytics.Key ResponsibilitiesDefine and own Enterprise Data Architecture principles, standards and best practicesDesign scalable Databricks Lakehouse solutions using Medallion Architecture (Bronze, Silver, Gold)Create enterprise-wide data models supporting Finance, Analytics and Reporting use casesDesign and implement reusable Data Engineering Frameworks and Solution AcceleratorsDevelop metadata-driven ingestion, transformation and orchestration frameworksDefine governance, lineage, security and cataloguing standards across the platformProvide architecture leadership across Databricks, Azure and Power BI ecosystemsWork closely with Finance, Data Engineering, Product and Business stakeholdersSupport AI and Agentic AI enablement by establishing trusted and governed data foundationsMentor engineering teams and promote engineering best practicesEssential ExperienceStrong Enterprise Data Architecture backgroundExperience designing and implementing Enterprise Data Frameworks, Standards and Architecture PatternsExpert Data Modelling skills (Conceptual, Logical, Physical and Dimensional)Extensive Azure Databricks experience within large-scale enterprise environmentsDatabricks Lakehouse Architecture and Medallion Design PatternsDatabricks Data Engineering using PySpark and Spark SQLDelta Live Tables (DLT)Unity Catalog implementation and governanceDatabricks WorkflowsDatabricks Asset Bundles (DABs)Databricks Solution AcceleratorsMetadata-Driven Ingestion and Orchestration FrameworksMLflow, Feature Store and MLOps FrameworksAzure Data Platform (ADLS, Azure Data Factory, Synapse, Databricks)Azure DevOps, CI/CD and Infrastructure as CodeEnterprise Data Governance, Data Quality and Data Lineage FrameworksExperience integrating Dynamics 365 Finance & Operations (D365 F&O) into enterprise data platformsExperience delivering Finance Data Lake, Data Warehouse or Lakehouse programmesStrong stakeholder engagement and solution design capabilitiesHighly DesirablePrevious experience working within specialist Databricks consultancies or Databricks partner organisationsMosaic AI and AI-enabled Data Platform deliveryAgentic AI / GenAI implementation within DatabricksMicrosoft FabricFinancial Services, Real Estate, Insurance or Retail sector experienceExperience leading Data Architecture workstreams within large transformation programmesExperience implementing self-service reporting and analytics platformsExperience supporting Power BI semantic models and enterprise reporting environmentsTechnical EnvironmentAzure DatabricksDelta Live Tables (DLT)Unity CatalogDatabricks Asset Bundles (DABs)Databricks WorkflowsPySparkSpark SQLMLflowMosaic AIAzure Data FactoryAzure SynapseAzure Data Lake StorageDynamics 365 Finance & Operations (D365 F&O)Azure DevOpsPower BITerraformCI/CDIdeal CandidateWe are particularly interested in Enterprise Data Architects who have built and implemented Databricks frameworks, metadata-driven architectures, reusable engineering patterns and enterprise-scale data platforms, rather than candidates with only high-level Databricks exposure. Experience working on large-scale Azure and Databricks transformation programmes, ideally involving Finance data and D365 F&O integrations, is highly desirable.Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: roberthalf.com/gb/en/privacy-notice.Requirementsdatabricks data enterprise archietct frameworkJob typeContractingIndustryIT