2 of 2 Apache Spark Jobs in Merton

plans and resource requirements accordingly. High proficiency in Python and SQL. Understanding of Snowflake's machine learning capabilities and integration with tools like Python, Spark, or DataRobot. Strong understanding of data governance, privacy, and security principles including IG and GDPR. Familiarity with version control tools (e.g. GitHub or Azure ...

improve reliability, maintainability, scalability and reuse.Your experience is likely to include several of the following: Microsoft Fabric Snowflake Azure OneLake Lakehouse architecture Data Factory Spark Python SQL ETL/ELT dimensional modelling Data Vault orchestration Git Azure DevOps/GitHub CI/CD Infrastructure as Code data quality MLOps … data they receive. Optimise Microsoft Fabric, Snowflake and Azure environments improve performance, scalability, resilience and resource utilisation across OneLake, Lakehouse, Data Factory, Spark/Notebooks, Snowflake and associated cloud services. Person Specification Qualifications Essential Educated to master's level or equivalent level of experience working at a senior level ...