Databricks Data Engineer

Data Engineer - Active SC, Databricks, PySpark

Up to £475 per day (Inside IR35)

Remote / London

6 months

My client is an International Consultancy who are recruiting for an Data Engineer with Active Security Clearance (SC) and strong Databricks and Azure experience to deliver and optimise Data engineering solutions.

Key requirements:

• Proven experience as a Data Engineer with Active Security Clearance (SC)
• Strong experience with Databricks, PySpark and Delta Lake
• Expertise in Jobs & Workflows, cluster tuning, and performance optimisation
• Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies)
• Hands-on with Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions
• Familiarity with CI/CD for Databricks deployments
• Strong troubleshooting in distributed Data environments
• Excellent communication and collaboration skills

Nice to have:

• Immediate availability
• Experience with enterprise-scale Databricks environments
• Knowledge of Azure Synapse, Power BI and cost optimisation strategies

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk