Senior Data Engineer
- Hiring Organisation
- Hays
- Location
- Cardiff, South Glamorgan, Wales, United Kingdom
- Employment Type
- Contract
- Contract Rate
- Up to £500.0 per day + £500 Per Day
reliable delivery of new data pipelines alongside ongoing operational stability.This is a hands-on engineering role focused on implementation, optimisation and support of Delta Lake pipelines across Bronze, Silver, Staging and Gold layers, operating within an established architectural framework. Key Responsibilities Develop and maintain data pipelines in Azure … Databricks using PySpark and SQL Build incremental processing using Delta Lake and Change Data Feed Extend and maintain watermark-driven CDC frameworks Implement and maintain Slowly Changing Dimension (SCD Type 2) logic Engineer time-aware joins and dimensional transformations Support optimisation of Spark workloads and Delta tables ...