Data Engineer
- Location
- Newcastle upon Tyne, England, United Kingdom
monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models … Work within IAM policies and data governance standards appropriate to a regulated government environment. Technical skills requiredLanguages & analytics Python - primary language for pipeline development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data ...