2 of 2 PySpark Jobs in Reading

team supporting Azure based Production Data & Analytics ETL/integration solutions (Fabric, Databricks, Synapse, Data Factory, Function Apps, Power BI etc) against SLAs Python, PySpark, Scala, Spark SQL Ability to identify and investigate complex problems and implement resolutions Direct contact with customers/end-users on the phone ...

able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. Designing and implementing Lakehouse architectures in Databricks to unify … Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python and PySpark for advanced data engineering, machine learning, and large-scale distributed processing within Databricks. Hands-on experience with Spark optimizations (Adaptive Query Execution, caching, partitioning ...