Data Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- City, Newcastle Upon Tyne, United Kingdom
- Employment Type
- Any
- Salary
- GBP Annual
stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable, well-governed data assets to downstream users. You will apply strong data analysis skills to identify root causes of data … client-side encryption patterns within AWS. Work within IAM policies and data governance standards appropriate to a regulated government environment. Technical skills required Languages & analytics Python primary language for pipeline development and data processing SQL used for querying, transformation, and validation across data stores PySpark for distributed data processing using ...