Data Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- Manchester, United Kingdom
- Employment Type
- Contract
- Contract Rate
- GBP Annual
responsibilities Data pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow orchestration Configure and manage Apache Airflow DAGs for task orchestration, ensuring reliable scheduling, monitoring, and execution of data processing workflows. Root cause analysis Perform data ...