Lead Data Platform Engineer
Lead Data Platform Engineer
UK Remote
Salary: £80,000 - £85,000
This is an opportunity to step into a highly influential Data Platform Engineering role where you will shape, optimise and own a modern Databricks Lakehouse environment. You will play a key role in driving engineering best practice, improving automation and enabling scalable data solutions across a growing data function.
The Company
They are a large, well‐established organisation known for combining deep technical expertise with a people‐first culture. With a nationwide presence and a modern approach to flexible working, they invest heavily in technology, innovation and colleague development. Their data function is expanding and plays a central role in supporting transformation, decision‐making and future AI initiatives. You will join a collaborative team that values engineering excellence, autonomy and continuous improvement.
The Role
As Lead Data Platform Engineer, you will:
• Develop and deploy Databricks Lakehouse platform solutions within Azure.
• Build and maintain automation for clusters, tagging, monitoring and platform operations.
• Architect and design end‐to‐end data platform solutions focused on scalability, security and reliability.
• Lead delivery using Databricks, PySpark, Spark SQL and Azure Data Factory.
• Drive DevOps best practices including CI/CD, automated testing and infrastructure as code.
• Collaborate closely with data engineers, ML engineers and wider technical teams to deliver robust platform capabilities.
• Take ownership of key data platform projects and influence engineering direction.
• Provide technical leadership and ensure standards, patterns and best practices are followed.
Your Skills and Experience
You will bring:
• Strong commercial experience in Azure and Databricks, with deep knowledge of Lakehouse architecture.
• Proficiency in PySpark, Python, SQL and Spark SQL.
• Strong DevOps engineering skills including CI/CD, automated testing and deployment pipelines.
• Experience with monitoring, logging and alerting solutions.
• Ability to design, build and optimise cloud platform solutions.
• Stakeholder management skills and confidence working across multiple teams.
• API development experience.
• Azure Data Factory knowledge is beneficial.
What They Offer
• Salary between £80,000 and £85,000 plus bonus.
• Comprehensive benefits package and annual pay review.
• Flexible by choice working environment with remote‐first culture.
• 35‐hour working week promoting genuine work‐life balance.
• Opportunities to shape platform strategy and contribute to future AI and automation initiatives.
How to Apply
If you are a strong Data Platform Engineer with deep Databricks expertise and want to take ownership of a modern Azure Lakehouse environment, please apply today.