Data Engineering Tech Lead : Databricks Specialist

Exciting Opportunity for a Data Engineering Technical Lead with deep expertise in Azure Databricks to join a Global company on a 12 Month initial Contract.

Key Responsibilities:

• Design, build, and manage large-scale data platforms with a focus on ETL, Data Management, and Data Governance
• Develop and maintain Databricks Delta Live Tables (DLT) pipelines with strong emphasis on cost and performance optimisation
• Implement and manage structured streaming and real-time data processing solutions.
• Handle and process high volumes of data efficiently within Databricks
• Translate business requirements into technical delivery plans—including defining PBIs, tasks, and technical design documents
• Collaborate closely with business stakeholders to understand use cases and deliver high-quality, timely solutions
• Lead a technical delivery team of 7–10 members, providing direction, guidance, and support throughout the project lifecycle
• Ensure best practices are followed in data architecture, governance, and performance tuning
• Drive continuous improvement in data engineering processes and platform scalability

Required Skills & Experience:

• Proven experience in building multiple large-scale data platforms
• Deep expertise in Databricks, especially Delta Live Tables (DLT) and structured streaming
• Strong understanding of data governance, data modeling, and pipeline orchestration
• Hands-on experience optimising Databricks workloads for performance and cost
• Excellent communication and collaboration skills to bridge business and technical teams
• Prior experience leading data engineering teams or project delivery squads

This needs combining with a positive attitude and an ability to work within a large, globally dispersed project team in a multi-cultural environment. You also need to be a self-starter, a logical thinker and a quick learner, with strong initiative and excellent communication, interpersonal and presentation skills, able to write clearly and concisely. We believe in equality of opportunity for all job applicants regardless of gender, marital status, race, colour, nationality, ethnic origin, creed or religion, disability, sexual orientation or age.

With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews. Your search for a New Contract Assignment or for a New Permanent Job will be in safe hands with Eaglecliff Recruitment. Please telephone for an immediate response or email your CV for a quick response.

Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.