Data Engineer
- Hiring Organisation
- Scottish and Southern Energy
- Location
- Perth, Perthshire, United Kingdom
- Salary
- £ 60 K
/silver/gold patterns, and model data optimised for BI and analytics, including Power BI integration through Databricks SQL.Use Databricks pipelines, jobs, notebooks, PySpark and SQL to perform large-scale transformations and implement data quality, monitoring and performance best practicesSupport Governance, Security & Compliance through Unity Catalog lineage, cataloguing … pipelines using Azure Databricks, and developing Delta Lake architectures using bronze/silver/gold patterns.Technical capability in large-scale data processing, including Python, PySpark and SQL for transformations and data quality, and designing performant BI/analytics data models with Power BI integration.About SSESSE has a bold ambition ...