Data Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- City, Newcastle Upon Tyne, United Kingdom
- Employment Type
- Any
- Salary
- GBP Annual
cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured, analytically trusted data assets. … slowly changing dimensions (SCD Types 1, 2, 3) Data analysis skills to identify root cause of issues within pipelines and data assets AWS services Amazon EMR - running Spark workloads and reviewing output logs Amazon Athena - ad hoc querying of data in S3 Amazon Textract and Comprehend - familiarity ...