Data Engineer - SC Cleared
United Kingdom
Brightbox GRP Ltd
using Python Behave to ensure data integrity and quality. - Collaborate with a separate team to release all development through Azure DevOps pipelines, maintaining a strong understanding of Git and code release best practises. Technology Requirements: - Proficient in Python 3 and Pyspark 3/4. - Experience with Python Behave for Behaviour Driven Development and testing. - Familiarity with Python Coverage for code coverage analysis. - Strong knowledge of Databricks, specifically with delta parquet data format and medallion data architecture. - In-depth understanding of YAML. - Familiarity with Azure DevOps and its functionalities. - Knowledge of Git and best practises for code release is advantageous. More ❯
Employment Type: Contract
Rate: £400 - £460 per day
Posted: