1 of 1 Data Structures Jobs in Abbots Langley

Data Engineer Skills and Technologies Data Engineering: Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc. Strong understanding of complex JSON manipulation. Experience working with Data Pipelines using a custom Python/PySpark frameworks. Strong understanding of the 4 core Data categories (Reference, Master … Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles. Experience managing data owners and access controls. Knowledge of row and column level security, GDPR, and handling sensitive datasets. Strong problem-solving and analytical skills, particularly able to demonstrate these intuitively. Required skills: Languages/Frameworks: JSON YAML Python … Delta Lake Bash (both CLI usage and scripting) Git Markdown Scala (bonus, not compulsory) Azure SQL Server as a HIVE Metastore (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration/Data Ingestion) JIRA Due to the nature and urgency of this post, candidates holding or who have held high-level security clearance More ❯