Lead Data Engineer
Lead Data Engineer | London | £550/day to £650/day Outside IR35 | 12 Months
A leading rail operator is looking for a Lead Data Engineer to lead a team of 5-7 engineers as it moves its data products into a new, governed Databricks workspace.
The role is split roughly 50/50 between team leadership and hands-on engineering, supporting data products across Commercial, Operations and Customer teams.
Location - London, one day per week onsite
Rate - £550/day - £650/day, Outside IR35
Duration - 12-month contract, with potential for extension
What you'll do
- Lead and coach a team of data engineers, setting technical direction and driving delivery.
- Work with business stakeholders and data product owners to agree priorities and turn requirements into deliverable work.
- Stay hands-on with data modelling, pipeline design and code reviews, and set standards for testing, CI/CD and data quality.
- Build reusable Databricks templates and shared libraries, and prepare data products for use with AI tools such as Databricks Genie.
What you'll bring
- Strong hands-on experience with Databricks, Spark or PySpark, Python and SQL.
- At least 7 years in data engineering, including 2 years leading or mentoring engineers, with previous team leadership experience.
- The ability to engage technical and non-technical stakeholders, translate business priorities into engineering decisions and drive technical delivery.
- Strong data modelling skills and experience building production data products. Experience with Unity Catalog, Delta Lake and Lakeflow or Delta Live Tables is important.
- Fluent English is required. French is an advantage but optional.