1 of 1 Permanent Spark SQL Jobs in Staffordshire

acquire & transform raw data (bronze) into high-quality, BI-ready models (gold), ensure data quality and lineage, and enable fast, secure analytics through SQL warehouses and Unity Catalogues.The ideal candidate will work closely with key business stakeholders and our SI partners to gather requirements, optimise business processes … scalable solutions that drive business value.What does this role involve day to day Data Engineering· Design and implement batch/streaming pipelines (PySpark, Spark SQL, DLT, Auto Loader) across bronze, silver & gold layers.·Implement CDC patterns, incremental loads, tune partitioning, Z Order, OPTIMIZE/VACUUM.· Build ...