Data Solution Architect
Principal Data Solution Architect (Databricks Specialist)
London, England (Hybrid – 2 days/week)
6 months initial contract
We are seeking a highly experienced Principal Data Solution Architect to lead the strategic design, modernization, and implementation of our enterprise data platforms. With a strong focus on the Databricks ecosystem, you will bridge the gap between complex business strategies and high-performance technical execution.
This is a high-visibility role requiring an architecture leader who can design scalable multi-cloud data lakehouses, establish technical vision, and collaborate closely with executive stakeholders and engineering teams alike.
Key Responsibilities
- Enterprise Data Strategy & Blueprinting: Develop robust blueprints for data management, defining comprehensive solution and integration architectures. Drive the migration from legacy frameworks to modern, cloud-native Databricks Lakehouse architectures.
- Technical Solution Definition: Evaluate, recommend, and implement advanced technologies for data warehousing and cloud platforms. Optimize large-scale data pipelines, streaming frameworks, and delta lake processing to maximize performance and efficiency.
- Cross-Functional Stakeholder Collaboration: Act as the primary technical liaison between engineering teams and business stakeholders. Translate complex business objectives into precise data requirements and technical roadmaps.
- Architecture Documentation & Design: Author comprehensive High-Level Design (HLD) and Technical Design Documents (TDD). Clearly communicate architectural visions, data flows, and infrastructure requirements to Tech Leads, Data Modellers, and Engineering teams.
- Governance, Security & Compliance: Architect secure data environments by enforcing strict data compliance, robust metadata management, enterprise-grade access controls (such as Unity Catalog), and rigorous security standards.
- Business Acumen & Alignment: Connect long-term organizational strategy directly to technical implementation, ensuring data platforms deliver measurable business value and ROI.
Technical Profile & Requirements
- Experience: 10+ years of dedicated experience in Data Architecture, Data Engineering, and Enterprise Solution Design.
- Databricks Expertise: Proven track record of architecting and deploying production-grade solutions on the Databricks platform, including extensive experience with Delta Lake, Unity Catalog, and spark-based processing.
- Cloud Infrastructure: Deep understanding of cloud data platforms and integration architectures across major cloud providers (AWS, Azure, or GCP).
- Data Modeling: Strong experience collaborating on conceptual, logical, and physical data models for both analytical and operational use cases.
- Communication: Exceptional communication skills with a proven ability to write rigorous technical documentation (HLDs/TDDs) and present technical concepts to non-technical executives.