Senior Data Engineer - West Yorkshire - £80k
- Hiring Organisation
- Exalto Consulting
- Location
- West Yorskhire, Bradford, West Yorkshire, United Kingdom
- Employment Type
- Permanent
using Microsoft Fabric • Build scalable data pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … business stakeholders Essential experience • Strong commercial experience with Microsoft Fabric • Hands on experience with Dataflow Gen2, Fabric Notebooks and Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from ...