Data Engineer
- Hiring Organisation
- Robert Walters
- Location
- Swansea, West Glamorgan, United Kingdom
- Employment Type
- Full-Time
- Salary
- £250.00 - £350.00 per day
data models, data warehouses and data integration solutions. Implement CI/CD processes and automated deployment pipelines. Use workflow orchestration tools such as Airflow, Prefect, Dagster or Cloud Composer. Monitor, troubleshoot and optimise platform and pipeline performance. Collaborate with technical and non-technical stakeholders to translate business requirements into robust … DevOps. Experience working in Agile delivery environments. Experience with cloud platforms, preferably Google Cloud Platform (GCP) . Experience with workflow orchestration tools including Airflow, Prefect, Dagster or Cloud Composer. Knowledge of containerisation technologies such as Docker. Experience working with large-scale datasets and distributed processing technologies such as Spark, Dataproc ...