Senior Databricks Engineer (Contract, £550-600 p/d)

Layke is working with a new client on a contract requirement for a Senior Data Engineer to support the next stage of a major data platform build.

We are looking for a hands-on Senior Data Engineer to support the continued development of an enterprise data and analytics platform built on Azure Databricks and Lakehouse architecture. The core Databricks architecture has already been established and initial data domains have been imported. This role is focused on engineering delivery, pipeline build, data quality, governance, and platform enhancement, rather than designing the architecture from scratch.

Key Responsibilities

• Build and maintain data pipelines within Azure Databricks and Azure Lakehouse environments.
• Work within established medallion architecture patterns.
• Develop data flows using Azure Data Factory, Python/PySpark, SQL, and Azure data services.
• Support data modelling, data integration, and data product development.
• Implement data quality, validation, lineage, and integrity controls.
• Work with business and technology stakeholders to document requirements and deliver technical solutions.
• Support reporting and analytics outputs, including Power BI where required.
• Work within CI/CD environments using Git.
• Ensure data governance, security, and regulatory requirements are reflected in platform delivery.

Required Experience

• 5+ years’ enterprise data engineering experience.
• Strong hands-on experience with Azure Databricks.
• Experience with lakehouse platforms and medallion architecture.
• Strong Azure Data Factory, Azure Data Lake, Python/PySpark, SQL, MS SQL/Azure SQL experience.
• Good understanding of data modelling, ETL/ELT, data quality, governance, and lineage.
• Experience working in financial services or another regulated environment.

Desirable Experience

• Wealth management, investment management, pensions, banking, or insurance experience.
• Experience on data integration, migration, or acquisition-related programmes.
• Power BI exposure.
• Unity Catalog or Databricks governance experience.

Contract details

• Role: Senior Data Engineer
• Contract: Initial contract engagement
• Location: UK remote with occasional Midlands presence possible
• Rate: £550-600 per day
• Start: within 4 weeks