2 of 2 Remote PySpark Jobs in Derbyshire

office. About you: You have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology ...

Dynamics 365/Dataverse, Business Central, SharePoint-hosted Excel files, SQL/ODBC/legacy systems, REST/Graph APIs and event streams Develop PySpark/Spark SQL notebooks for advanced data cleansing, transformation, and business logic Create production-ready semantic models for Power BI, including star schemas … through workshops, documentation, and technical knowledge transfer Required Experience Deep expertise in Microsoft Fabric (Lakehouse, Data Factory, Pipelines, Notebooks, Delta Lake, Semantic Models) Strong PySpark/Spark SQL skills for large-scale transformations Experience integrating with Dynamics 365, Dataverse, and Business Central Proven ability to implement CI/ ...