Data Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- City, Newcastle Upon Tyne, United Kingdom
- Employment Type
- Permanent
- Salary
- GBP 65,000 - 75,000 Annual
maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable, well-governed data assets … reviewing output logs Amazon Athena - ad hoc querying of data in S3 Amazon Textract and Comprehend - familiarity with AI/ML document extraction and NLP services AWS S3, IAM, CloudWatch, EC2, ECR - core platform services used day-to-day AWS console proficiency - navigating, configuring, and monitoring services Understanding of Server ...