Databricks Platform Lead - Contract outside IR35 - Remote

Job Title: Databricks Platform Lead (Contract)

Location: Remote (UK-based)

Day Rate: Up to £525 p/d (Outside IR35)

Contract: 6-Month Rolling

We’re looking for a hands-on Databricks Platform Lead to join a global software vendor and take ownership of a modern data ecosystem, driving data engineering excellence, platform optimisation, and AI enablement . You’ll lead a team of 6+ engineers, set best practices, and ensure the Databricks platform is reliable, scalable, and cost-effective.

Key Responsibilities

• Lead, coach, and mentor data engineers, embedding modern AI-enabled practices.
• Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling).
• Redesign and optimise data pipelines for scalability, performance, and cost efficiency .
• Champion Python engineering best practices (testing, CI/CD, code reviews, AI-assisted coding).
• Drive DataOps & MLOps adoption, ensuring observability, governance, and end-to-end product lifecycle management.

What We’re Looking For

• 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale .
• Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow .
• Strong Python engineering background with modern CI/CD pipelines.
• Proven experience optimising Databricks for performance and cost.
• Track record of leading teams and influencing best practices.

Why Join?

• High-impact role : Shape and optimise a global Databricks platform.
• Cutting-edge practices : AI-assisted development, DataOps, and MLOps.
• Flexibility : Fully remote, UK-based contract.
• Rewarding terms : £525 p/d, outside IR35, with long-term extension potential.