Senior Data Engineer
- Location
- Greater London, England, United Kingdom
Senior Data Engineer | Azure Databricks | SC Cleared | London (Hybrid, 3 days on site) Build the data platform behind national economic analysis. We are hiring a Senior Data Engineer to develop and scale an Azure Databricks platform that powers monetary analysis, economic forecasting and modelling. The data you engineer feeds … data scientists. What you will be doing Designing and building scalable ingestion pipelines from APIs, relational databases and financial data providers into Azure Databricks Writing complex transformations in PySpark and Spark SQL, with Delta Lake as the storage foundation Tuning Databricks workloads for performance and cost, and embedding quality checks ...