Lead Data Platform Engineer
Lead Data Platform Engineer
Location: Remote (UK)
Salary: £85,000
This is a standout opportunity to take ownership of a modern Databricks-driven data platform for a highly respected organisation that is investing seriously in data engineering, automation, and best-in-class practices.
The Company
They are a large, well-established organisation with a strong reputation for delivering high-quality services across the UK. With thousands of employees and a modern, flexible working culture, they combine professional excellence with a supportive and people-focused environment.
Technology plays a key role in their long-term strategy, and the data function is highly invested, credible, and growing. You will join a collaborative team of data engineers, ML engineers, and platform specialists.
The Role
You will act as the go-to expert for the Databricks estate and Lakehouse platform, ensuring it is scalable, secure, automated, and built to best practice. You will work closely with engineers, architects, and senior stakeholders to build and enhance a robust data ecosystem in Azure.
Key responsibilities include:
- Designing and delivering end-to-end data platform solutions in Azure
- Developing and deploying the Lakehouse platform using Databricks
- Building automation for cluster management, integration runtimes, and infrastructure components
- Leading implementation with Databricks, PySpark, Spark SQL, and Azure Data Factory
- Creating APIs for integration and automation
- Driving CI/CD, automated testing, and DevOps best practice
Your Skills and Experience
You will have strong capability in:
- Azure and Databricks engineering
- PySpark, SQL, Python, and Spark SQL
- DevOps best practices including CI/CD, automation, and testing
- Infrastructure as code such as Terraform
- Stakeholder communication and cross-team collaboration
How to Apply
If you are a strong Data Platform Engineer with deep Databricks experience and want to lead a modern Azure Lakehouse platform, please apply with your CV!