AWS Cloud Data Engineer
- Hiring Organisation
- Capgemini
- Location
- Glasgow, UK
that you will be unable to work at home 100% of the time. Your Role: Build and maintain data models using dbt. Write complex SQL transformations to clean and structure data. Develop modular, reusable data pipelines. Implement data testing and validation (e.g., schema tests, data quality checks). Manage data … pipelines using Databricks and Apache Spark. Build and optimize data workflows for batch and real-time processing. Transform and process large datasets using PySpark, SQL, and Delta Lake. Implement data ingestion from multiple sources (APIs, streaming, databases). Your Skills: Python proficiency. AWS : Cloud formation , Service Catalog , IAM , S3 , Glue ...