Lead Data Engineering (Hands-on Python / Databricks)

Job Title: Technical Delivery Lead - Data Engineering Lead (Hands-on Python / Databricks) Contract: 6 months - Potentially extension. Location: London Hybrid (5 days in 10 in the office) Rate: Highly competitive Status: Inside IR35 Working pattern: Full time We are seeking an experienced Technical Delivery Lead with strong expertise in Python, Databricks, and Apache Spark to lead the successful delivery of enterprise-scale data engineering initiatives.. This is a hands-on leadership role combining technical delivery, solution design, and data engineering expertise. The successful candidate will lead the delivery of a greenfield data platform while remaining actively involved in development activities. Essential Skills Proven experience in Data Engineering or Software Engineering. Previous experience in a Technical Lead, Lead Data Engineer, or Technical Delivery Lead position. Strong hands-on expertise with Python. Extensive experience with Databricks, including Workflows, Notebooks, and Delta Lake. Strong experience with Apache Spark /PySpark. Proven track record building and optimising large-scale ETL/ELT pipelines. Strong understanding of modern data architecture and Lakehouse principles. Excellent SQL skills and experience working with distributed data systems. Experience working with cloud platforms such as AWS, Azure, or GCP. Strong Agile delivery experience. Experience leading technical teams and delivering complex ...