Senior Data Engineer
- Location
- Manchester, England, United Kingdom
pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. Support the migration and re-platforming of legacy SQL Server data warehouse processes as required. Challenge requirements … with Product Owners, Business Analysts, and Solution Architects to define product vision and technical roadmaps. Drive adoption of modern engineering practices, AI technologies, and automation opportunities across the team. Drive delivery of complex, end-to-end work items, seeking clarification of ambiguous specifications and proactively flagging risk of technical ...