Lead Data Engineer
Role - Lead Data Engineer (Enterprise Data Platform (Microsoft Fabric)
Hybrid/ 2 days a week
Active SC Clearance
Role skills & responsibilities
- Team leadership & delivery: Set standards, direct engineers, review designs, unblock delivery, mentor the team; plan and coordinate across internal squads and suppliers; manage risks/issues to meet EDP milestones.
- Stakeholder coordination: Engage effectively with product owners, analysts and technology leads; report progress and risks to senior stakeholders and the SRO with concise status updates and decisions.
- Technical leadership: Own EDP architecture on Microsoft Fabric (Lakehouse/Warehouse patterns, OneLake organization); define and implement ingestion and transformation pipelines (Dataflows Gen2, Notebooks); establish modelling standards for the gold layer and semantic models; performance/cost optimization; lineage/observability; governance (RBAC/security, data retention).
- Multi‐source integration: Coordinate reliable ingestion/orchestration, testing and release practices.
- Operational readiness: Ensure documentation/run‐books and non‐functional requirements (security, resilience, performance) are met.
Current EDP milestone – Gold‐layer modelling (context for urgency)
- Country/facility risk parameter processing progressing; initial gold‐layer documentation produced.
- Bi‐weekly Golden Layer review cadence in place; test data preparation underway for report validation.
- Target outcome: baseline gold‐layer model components to enable consistent semantic models and reporting.