Lead Data Engineer
- Hiring Organisation
- Canada Life UK
- Location
- City of London, London, United Kingdom
- Employment Type
- Part Time
data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established patterns. Apply security, access control and compliance standards for Azure and Databricks … pipelines (Azure DevOps, GitHub Actions, Terraform). Scripting and programming skills (Python advantageous). Good understanding of DevOps and automation concepts (e.g. YAML pipelines, IaC). Solid understanding of cloud security, compliance and governance principles. Experience working with Databricks and Azure in a product or Scaled Agile delivery environment. Qualifications ...