SC Cleared Databricks Engineer

Databricks Engineer - SC Cleared
Fully Remote
6-month initial contract
Start Date: 17th November 2025
£550 per day Inside IR35

We are seeking two SC Cleared Databricks Analysts to support a high-profile data engineering and analytics programme with one of our GovTech Consultancy clients.

The successful candidates will play a key role in designing, developing, and optimising data pipelines and analytics solutions using Databricks within a secure environment. You will work with large and complex datasets from UK and potentially international sources, enabling advanced analytics and data-driven insights to inform strategic decisions.
This role is highly technical and data-focused, requiring strong experience in Databricks, Spark, and related data engineering tools. While stakeholder engagement is minimal, you will need to align technical solutions with business objectives and ensure data integrity and compliance throughout.

Key Requirements

• Active SC Clearance (used within the last 12 months)
• Proven experience with Databricks (including notebooks, clusters, and job orchestration)
• Strong knowledge of Apache Spark, PySpark, and distributed data processing
• Experience building and optimising ETL pipelines and data workflows
• Familiarity with Delta Lake, SQL, and data modelling best practices
• Ability to work with large, complex datasets from multiple sources
• Comfortable working independently in a fully remote environment
• Strong understanding of Agile delivery (Scrum/Kanban)
• Excellent attention to detail and structured approach to analysis
• Ability to interpret business needs and translate them into scalable data solutions

Desirable

• Experience with Azure Databricks and related cloud services (Azure Data Lake, Data Factory)
• Knowledge of data governance, security, and compliance in government environments
• Familiarity with CI/CD pipelines for data engineering

This is an excellent opportunity for experienced Databricks Engineers with SC Clearance to apply their expertise in a meaningful, data-driven role within a secure government programme.

Please apply promptly as CVs will be shortlisted and sent to the client later this week.