AWS Cloud Data Engineer
- Hiring Organisation
- Capgemini
- Location
- Glasgow, Scotland, United Kingdom
testing and validation (e.g., schema tests, data quality checks). Manage data documentation and lineage within DBT. Design and develop scalable data pipelines using Databricks and Apache Spark. Build and optimize data workflows for batch and real-time processing. Transform and process large datasets using PySpark, SQL, and Delta Lake. ...