Senior Data Engineer
- Hiring Organisation
- Head Resourcing
- Location
- Milton, West Dunbartonshire, UK
- Employment Type
- Full-time
one. What You'll Be Doing Lakehouse Engineering (Azure + Databricks) Engineer scalable ELT pipelines using Lakeflow Declarative Pipelines, PySpark, and Spark SQL across a full Medallion Architecture (Bronze - Silver - Gold). Implement ingestion patterns for files, APIs, SaaS platforms (e.g. subscription billing), SQL sources, SharePoint and SFTP using …/SLIs, runbooks and cost-optimisation across the platform. DevOps & Platform Engineering Build CI/CD pipelines in Azure DevOps for notebooks, Lakeflow pipelines, SQL models and ADF artefacts. Ensure secure, enterprise-grade platform operation across Dev Prod, using private endpoints, managed identities and Key Vault. Contribute to platform standards ...