Data Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- London, United Kingdom
- Employment Type
- Any
- Salary
- GBP 65,000 - 70,000 Annual
Apache Spark Python AWS Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills … client-side encryption patterns within AWS. Work within IAM policies and data governance standards appropriate to a regulated government environment. Technical skills requiredLanguages & analytics Python - primary language for pipeline development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache ...