Data Engineer
Data Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35)
Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform.
You'll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams.
What you'll be doing:
- Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling
- Implementing source-to-target mappings and transformation logic for the migration
- Owning data validation, reconciliation, and defect resolution through migration test cycles
- Building reusable migration frameworks - ingestion pipelines, validation routines, error-handling
- Supporting CI/CD, Git-based release processes via Azure DevOps
What you'll bring:
- Extensive data engineering/integration/migration experience
- Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines
- Strong SQL - profiling, transformation, validation, reconciliation
- PySpark/Spark SQL notebook experience (Databricks or Fabric)
- Proven experience on a data migration project end-to-end (extraction through reconciliation)
- Microsoft Fabric experience is a bonus, not a requirement - strong Azure Databricks/Synapse background welcomed
Nice to have: Microsoft Purview, Delta Lake/medallion architecture, Key Vault/Managed Identities, Azure DE Associate or Databricks certification.