1 of 1 Spark SQL Jobs in South Yorkshire

Senior Data Engineer

Hiring Organisation
Tenth Revolution Group
Location
Doncaster, South Yorkshire, UK
Employment Type
Full-time
frameworks, and naming conventions Build metadata-driven ingestion pipelines for diverse sources including: Dynamics 365/Dataverse, Business Central, SharePoint-hosted Excel files, SQL/ODBC/legacy systems, REST/Graph APIs and event streams Develop PySpark/Spark SQL notebooks for advanced … technical knowledge transfer Required Experience Deep expertise in Microsoft Fabric (Lakehouse, Data Factory, Pipelines, Notebooks, Delta Lake, Semantic Models) Strong PySpark/Spark SQL skills for large-scale transformations Experience integrating with Dynamics 365, Dataverse, and Business Central Proven ability to implement CI/CD pipelines ...