Senior Data Engineer

Lead Data Engineer (Databricks Specialist)

Contract: 3–6 months

Day Rate: £600–£700 (Outside IR35)

Start Date: January 2026

Location: UK (Remote / Hybrid options)

We are representing a Databricks delivery partner who help organisations transform the way they use data, building scalable, modern data platforms and accelerating AI adoption through Databricks. We’re looking for a Lead Data Engineer who is exceptional with Databricks and ready to play a key role in designing, building, and delivering cutting-edge data solutions for enterprise clients.

This is a hands-on role for a seasoned engineer who can operate across architecture, delivery, and consulting.

Key responsibilities include:

• Design and build end-to-end data solutions on Databricks, using Spark, Python, SQL, and Delta Lake
• Apply software engineering best practices — TDD, CI/CD, version control, automation, and clean coding principles
• Work across the entire software development lifecycle, from design to deployment
• Engage directly with stakeholders, shaping requirements and influencing technical direction
• Lead delivery of complex data engineering initiatives, individually or with small teams
• Provide technical leadership, mentoring others, reviewing code, and driving best practices
• Collaborate with data scientists, architects, and business teams to deliver production-grade outcomes

Essential skills needed:

• Deep hands-on experience with Databricks (SQL, PySpark, Delta Lake, Unity Catalog, Workflows)
• Strong proficiency in Python and Spark
• Solid understanding of CI/CD pipelines, DevOps, and Infrastructure as Code
• Proven track record designing and delivering solutions from scratch
• Excellent communication and consulting skills, comfortable working with both technical and business stakeholders
• Strong problem-solving ability, commercial awareness, and a proactive approach to delivery

Start Date: January 2026

Duration: 3–6 months

Rate: £600–£700 per day (Outside IR35)

Location: UK-based (remote or hybrid depending on client)

If you’re a Databricks expert who thrives on solving complex problems, delivering real impact, and setting engineering standards, click apply now.