Data Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- City, Newcastle Upon Tyne, United Kingdom
- Employment Type
- Any
- Salary
- GBP Annual
responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow orchestration Configure and manage Apache Airflow DAGs for task orchestration, ensuring reliable scheduling, monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis ...