Data Engineer (SC Cleared)

About Scrumconnect Consulting

Scrumconnect Consulting is a multi-award-winning digital consultancy recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of more than 40 million UK citizens. We are committed to user-centred design, agile delivery, and driving innovation in digital services that truly matter.

Role Overview

We are seeking an experienced Data Engineer to design, build, and maintain data products and a modern Strategic Data Platform. You will work within multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and continuous enhancement of data solutions.

This role is ideal for someone with strong Azure data engineering experience, excellent SQL and Python capability, and a passion for building scalable, reliable data platforms in complex environments.

Key Responsibilities

• Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse

• Manage the full data development life cycle within Agile delivery teams

• Integrate and automate workflows using Azure DevOps pipelines

• Develop dimension data models and semantic models to support Power BI analytics

• Create advanced dashboards, visualisations, and reporting solutions in Power BI

• Implement robust data governance, profiling, and quality checks to ensure accuracy and compliance

• Lead the migration of Legacy data systems to modern Azure-based platforms

• Apply dbt (with SQL databases) for data transformation, modelling, and workflow optimisation

• Collaborate with business stakeholders to translate requirements into scalable technical solutions

• Coach and mentor team members to strengthen data engineering best practices

Essential Skills & Experience

• Active SC Clearance (must be valid at time of application)

• Proven expertise with:

  • Azure Data Factory & Azure Synapse

  • Microsoft Azure & Azure DevOps

  • Power BI (including semantic modelling)

  • Python (including PySpark) and advanced SQL

  • dbt for SQL-based data transformation and modelling

  • Dimension data modelling

  • Terraform (Infrastructure as Code)

• Experience working with structured and unstructured data

• Strong background in Agile delivery environments

• Ability to translate business needs into effective technical solutions

• Proven experience delivering Legacy migration projects within complex organisations

• Excellent communication and stakeholder engagement skills

Desirable

• Azure certifications (Data Engineer, Data Scientist, or related)

• Knowledge of GDPR, data security, and governance best practices

Diversity & Inclusion

At Scrumconnect Consulting, we believe that diversity drives innovation. We are committed to creating an inclusive environment where every individual is valued, respected, and supported. We welcome applications from candidates of all backgrounds and actively encourage applications from women, people with disabilities, underrepresented communities, and those seeking flexible working arrangements .

As a Disability Confident Level 1 employer, we provide reasonable adjustments throughout the recruitment process and employment to ensure equal opportunity for all.