Lead Data Engineer
- Hiring Organisation
- FBI &TMT
- Location
- Kingston Upon Thames, Surrey, South East, United Kingdom
- Employment Type
- Permanent
- Salary
- £85,000
Databricks based data platform, ensuring reliability, performance and scalability * Design enterprise scale data architectures on Databricks and cloud platforms such as Azure, AWS or GCP * Define lakehouse standards, data modelling approaches and governance frameworks * Lead design of batch and streaming platforms using Delta Lake, Spark and related technologies … expertise in Databricks including Spark, Delta Lake and Databricks Workflows * Python and SQL proficiency * Infrastructure as code experience using Terraform, Bicep or CloudFormation * Cloud data platform experience, ideally Azure including Azure Data Factory, ADLS Gen2 and Azure DevOps * Strong understanding of data modelling, ETL and ELT patterns, distributed ...