2 of 2 Contract PySpark Jobs in Central London

schemas (both JSON and Spark), schema management etc Strong understanding of complex JSON manipulation Experience working with Data Pipelines using a custom Python/PySpark frameworks Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. … write basic scripts) LANGUAGES/FRAMEWORKS JSON YAML Python (as a programming language, not just able to write basic scripts) Pydantic experience DESIRABLE SQL PySpark Delta Lake Bash (both CLI usage and scripting) Git Markdown Scala DESIRABLE Azure SQL Server as a HIVE Metastore DESIRABLE TECHNOLOGIES Azure Databricks Apache More ❯

700pd - £750pd Outside IR35 Our client a prominent financial institution is searching for an experienced Data Engineer with strong Python, Scala, Databricks Spark and Pyspark Data Engineering skills. We are looking for someone who is not just a veteran in infrastructure rollouts but someone that can own, build, and … deliver solutions in distributed environments. Preferred skills/experience: 8yrs + Data Engineering Strong hands on coding experience with Python, Scala, Databricks Spark and Pyspark Demonstrable experience coding in distributed environments (i.e. like Databricks Sparks) Unity catalog Capital Markets Financial background If you wish to please reach out to More ❯