Data Engineer
- Hiring Organisation
- BrightBox Group
- Location
- United Kingdom
hold a valid and current passport. Technology requirements: Python 3/Pyspark 3/4 Python behave - for Behaviour Driven Development and testing Python coverage - Code coverage Strong knowledge of Databricks, including delta parquet data format and the medallion data architecture Strong knowledge of YAML. Understanding … Azure Devops Understanding of Git and code release best practices The role will be to design and build core python libraries for ingesting various data sets. The overarching concept of this solution is that the libraries will utilise YAML files to control the transformation of all data sets (there ...