Data Technical Lead
Data Technical Lead Certain Advantage is hiring for a Data Technical Lead based in London.This role is on an initial contract basis until the end of the year and requires onsite working three days per week.The Company We’re working with a business undergoing significant cloud modernisation, transforming its data landscape to improve speed, agility, and technical capability. The PDE platform is a key initiative supporting the organisation’s future data vision, enabling consistent global reporting, near real-time access to curated datasets, and improved business decision-making through enhanced data capabilities.The Role: We are seeking a highly experienced Technical Lead with deep expertise in the Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms.You’ll be responsible for:
- Leading the design, development, and implementation of scalable data solutions across Azure and Databricks.
- Defining and driving data strategy, governance, quality standards, and platform best practices.
- Optimising platform performance and managing cloud costs, with a focus on Databricks streaming workloads.
- Providing end-to-end technical leadership from architecture through delivery and production support.
- Collaborating with business stakeholders to deliver solutions aligned with organisational goals.
- Strong experience leading data engineering or technical delivery teams within complex enterprise environments.
- Proven experience designing and delivering solutions using Azure and Databricks.
- A strong understanding of data architecture, governance, data quality, and cloud optimisation.
- Experience managing Databricks streaming workloads and improving platform performance.
- Experience within the financial trading domain, including knowledge of trading data models and related business processes.
- A track record of delivering complex data solutions from concept through to implementation and support.