Cloud Data Loading Architect
- Hiring Organisation
- KBC Technologies Group
- Location
- Leeds, England, United Kingdom
Design and implement high-throughput, fault-tolerant ingestion pipelines for both batch and streaming data into BigQuery. Architect data ingestion solutions using GCS, Dataflow (Apache Beam), Pub/Sub, Dataproc, Cloud Composer (Airflow), and BigQuery Storage Write API . Define data loading frameworks , schema evolution strategies, mapping rules ...