Senior Data Engineer
- Location
- Manchester, England, United Kingdom
Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. Support the migration and re-platforming of legacy SQL Server data warehouse ...