Data Engineer
- Location
- Newcastle upon Tyne, England, United Kingdom
cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured, analytically trusted data assets. Infrastructure … slowly changing dimensions (SCD Types 1, 2, 3) Data analysis skills to identify root cause of issues within pipelines and data assets AWS services Amazon EMR - running Spark workloads and reviewing output logs Amazon Athena - ad hoc querying of data in S3 Amazon Textract and Comprehend - familiarity ...