Senior Data Engineer
- Hiring Organisation
- National Institute of Teaching
- Location
- Wakefield, West Yorkshire, Yorkshire, United Kingdom
- Employment Type
- Permanent, Work From Home
- Salary
- £55,000
Responsibilities Design, build and maintain Azure-based data pipelines to support the ingestion, transformation and curation of TED datasets. Develop and maintain Azure SQL databases and research-facing schemas across raw, transformed and curated data layers. Write efficient, secure and well-structured T-SQL to support ingestion, validation, transformation … handover. Essential Criteria Proven experience in data engineering, including building and maintaining production-grade data pipelines. Strong experience with Azure Data Factory and Azure SQL Server. Strong T-SQL skills, including schema design, stored procedures and query optimisation. Experience implementing validation, monitoring, logging and reconciliation controls within data pipelines. Strong ...