Databricks Implementation Consultant
We are seeking a Databricks Implementation Consultant / Architect for an initial 4-6 weeks contract. The primary objective of this role is to assess and recommend the optimal cloud platform (Azure or Google Cloud Platform) for implementing Databricks.
This will involve a detailed evaluation of both platforms against analytical requirements, cost models, security, compliance, and integration considerations, culminating in a clear recommendation for senior stakeholders
Role Overview
You will lead a comprehensive Cloud & Data Platform Assessment focused on defining a future-ready architecture and positioning Databricks as the core analytics layer. This role requires deep expertise in Databricks implementations across Azure and Google Cloud Platform (GCP).
Cloud & Data Platform Assessment:
- Review the existing data landscape, including CRM data in SQL Server, external datasets, geospatial sources, and BI consumption.
- Assess how shortlisted cloud platforms (Azure vs GCP) meet analytical requirements: large-scale data volumes (20M+ rows), mixed data types, NLP/AI workloads, geospatial analytics, and daily refresh needs.
- Compare Azure and GCP for architecture, security, Databricks integration, and compliance with data handling standards.
- Produce workload-based cost models for storage, compute, pipelines, and AI/NLP workloads.
- Define target architectures for each option, including high-level diagrams.
- Evaluate implementation complexity, operational overhead, and scalability.
Required Experience:
- Proven track record of end-to-end Databricks implementations in Azure and GCP.
- Strong expertise in lakehouse architecture, data engineering, and analytics frameworks.
- Hands-on experience as a Data Architect or Implementation Consultant.
- Delivery of AI and NLP workloads using cloud-native services.
- Ability to produce technical diagrams, cost models, and senior-level recommendations.
- Background in security, governance, and compliance design.
- Conducting architecture comparisons between Azure and GCP, including evaluating Databricks compatibility.
- Developing costed platform models aligned to specific workloads and Databricks usage.
- Performing security and compliance assessments for Databricks workloads.
- Identifying integration dependencies and risks across cloud platforms, Databricks, and existing systems.
- Producing clear recommendation papers for senior stakeholders, outlining preferred cloud platform and supporting rationale.
Contract Details:
- Fully Remote Engagement
- Inital 4-6 weeks Contract
- Competitive Day Rate - Outside IR35
Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: gb/en/privacy-notice.