Lead Data Engineer (SC cleared)

About Scrumconnect Consulting

Scrumconnect Consulting is a multi-award-winning technology consulting firm, recognised with prestigious UK IT industry awards including Best Public Sector IT Project, Digital Transformation Project of the Year, and a Special Award for Organisational Excellence during the pandemic.
We deliver large-scale digital transformation programmes that positively impact over 40 million UK citizens, supporting critical national services through innovative, secure, and user-centred technology solutions.

Role Summary
We are looking for an experienced Data Engineer to support large-scale service modernisation within a major UK government programme.
This is not a traditional analytics or BI role.

Instead, the position sits at the heart of operational system replacement, focusing on designing and delivering robust, secure, and auditable data pipelines that enable safe migration from Legacy systems to modern digital services.
You will work closely with Data Architects, engineers, delivery teams, and policy stakeholders to ensure data integrity, accuracy, and traceability across live operational systems.

Key Responsibilities
Service Modernisation & Data Engineering

• Design, build, and maintain robust ETL/ELT pipelines supporting Legacy system replacement
• Develop secure and scalable data extraction processes from live production systems
• Implement field-level mappings and transformation logic aligned to target operational models.
• Ensure accurate integration between relational and NoSQL data stores.
• Build monitoring, error handling, and reconciliation controls to protect operational data

Data Migration & Cutover

• Deliver migration pipelines for historical and live transactional data
• Support parallel runs, cutover, and rollback strategies
• Implement reconciliation checks to ensure migrated data meets audit and quality standards
• Provide production support during go-live and stabilisation phases.

Data Integrity, Governance & Compliance

• Implement validation, transformation, and integrity controls.
• Ensure compliance with:
• Government data standards
• GDPR and data protection regulations
• Audit and retention policies
• Maintain traceability and lineage across data flows
• Collaborate with Data Architects to ensure alignment with operational data models

Essential Skills & Experience

• Active SC Clearance
• Proven experience delivering data engineering solutions in live production environments
• Strong experience supporting system replacement or service modernisation programmes
• Hands-on experience building operational and transactional data pipelines (not purely analytics)

Desirable Experience

• Experience working within UK Government or highly regulated environments
• Experience operating within GDS/DDaT delivery frameworks
• Experience supporting parallel run and controlled cutover approaches
• Exposure to integration with enterprise Data & Analytics platforms
• Experience with cloud platforms (AWS/Azure/GCP)
• Power BI exposure (advantageous but not core)

Our Commitment to Diversity & Inclusion
At Scrumconnect Consulting, we believe diversity drives innovation. We are committed to creating an inclusive environment where everyone is respected, valued, and supported.
We actively encourage applications from women, people with disabilities, individuals from under-represented communities, and those seeking flexible working arrangements.
As a Disability Confident Level 1 employer, we provide reasonable adjustments throughout the recruitment process and employment to ensure equal opportunity for all.