Lead Data Engineer
- Hiring Organisation
- Canada Life UK
- Location
- Potters Bar, Hertfordshire, South East, United Kingdom
- Employment Type
- Part Time
workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established patterns. Apply security, access control and compliance standards for Azure and Databricks in collaboration with platform and security teams. Support monitoring, logging … Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous). Experience contributing to CI/CD pipelines (Azure DevOps, GitHub Actions, Terraform). Scripting and programming skills (Python advantageous). Good understanding of DevOps and automation concepts (e.g. YAML pipelines, IaC). Solid understanding of cloud security, compliance ...