1 of 1 GCP Data Engineer Jobs in the East of England

Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure on Google Cloud Platform (GCP). Reporting to our Data Scientist, your primary focus will be on building robust and scalable data pipelines to ingest … Responsibilities: Data Pipeline Development & Management: Design, develop, and maintain scalable and reliable data pipelines using Cloud Composer (Apache Airflow) on GCP, adhering to infrastructure-as-code principles. Implement data ingestion processes from diverse sources, including databases, APIs, flat files (eg, CSV exports from … volume, processing complexity, and query patterns. Implement data loss prevention (DLP) measures to identify and de-identify Personally Identifiable Information (PII). GCP Infrastructure Management: Manage and maintain GCP services, including Cloud Storage, BigQuery, Cloud Functions, Dataflow, Pub/Sub, and other relevant services, following best More ❯