Senior Data Engineer - Microsoft Fabric & Azure
- Location
- Wigan, England, United Kingdom
Factory, including integration with legacy, cloud and on-premises data sources. Engineer reliable data pipelines and models: Design batch, incremental and near-real-time ETL/ELT using SQL, Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such …/Production workspace patterns. Advanced SQL, Python and PySpark, with practical experience of Delta/Parquet, medallion architecture and production-grade batch/incremental ETL/ELT. Strong Git and CI/CD experience using Azure DevOps and/or GitHub, including controlled release, testing, deployment, rollback and environment promotion ...