Lead Data Engineer - London
Lead Data Engineer - London
London – Hybrid
Salary: Competitive dependent on experience
Ref: J13093
We are looking for a Lead Data Engineer to take ownership of a live data platform, ensuring pipelines and data products are stable, scalable and fit for purpose.
This is a hands on role with real ownership. You will keep critical data workflows running smoothly, resolve issues when they arise, and continuously improve how the platform operates.
What you will be doing
- Own the performance and reliability of production data pipelines
- Investigate and resolve issues across ingestion, transformation and orchestration
- Implement monitoring and improve visibility across data workflows
- Work closely with engineering, data and business teams to support delivery
- Drive improvements to data quality and overall platform robustness
- Support releases and changes into live environments
What we are looking for
- Strong experience building and supporting data pipelines in production
- Experience working with Palantir Foundry
- Proficiency in Python and large scale data processing (e.g. PySpark)
- Experience working within cloud environments such as AWS or GCP, Azure also considered
- Good understanding of end to end data workflows
- Strong problem solving skills and ability to resolve complex issues
- Clear and confident communicator, comfortable working with both technical teams and business stakeholders
Experience
- Background in data engineering within live, production environments
- Experience operating at a senior or lead level with ownership of systems
Apply now or get in touch for a confidential conversation.