Interim Lead Data Engineer
Lead Data Engineer – Platform Reset & Build
Location: North London (hybrid)
Contract: Interim
Rate:£800 per day (outside IR35)
A North London–based organisation is seeking an Interim Lead Data Engineer to reset the data engineering function and build a new, best-in-class data engineering capability.
This role is for a hands-on engineering leader. You will not be inheriting a greenfield environment, nor simply “running what exists”. The mandate is to review, fix, and rebuild data pipelines, engineering standards, and ways of working.
The Role
You will take ownership of the data engineering layer end to end, setting direction while remaining close to the code. The role combines technical depth, engineering leadership, and delivery discipline.
Key responsibilities include:
- Reviewing the current data engineering landscape and identifying structural weaknesses
- Resetting and rebuilding data pipelines, orchestration, and transformation layers
- Implementing engineering best practices across quality, testing, monitoring, CI/CD, and deployment
- Defining standards for scalability, reliability, performance, and cost control
- Working closely with data architects and stakeholders to translate designs into working pipelines
- Leading by example, remaining hands-on where needed to unblock delivery
- Uplifting the capability of existing engineers through clear standards and coaching
Required Experience
- Proven experience as a Lead or Principal Data Engineer on complex data platforms
- Strong background in resetting or remediating underperforming data estates
- Deep experience with modern cloud data engineering stacks (Azure preferred)
- Strong SQL, Python and data transformation experience
- Experience implementing engineering best practices rather than just delivering pipelines
- Confident communicator able to explain technical decisions to non-technical stakeholders
Why This Role
- Genuine mandate to fix and rebuild, not patch
- High visibility and real ownership over the data engineering function
- Opportunity to leave behind a sustainable, well-run engineering platform