5 of 5 Remote/Hybrid Cloud Composer Jobs in London

ingestion of structured and unstructured files (CSV, JSON, clinical exports, third‐party feeds) from a variety of sources including transactional Databases, cloud storage, and external APIs, applying robust validation, error handling, and schema management across the raw and curated data layers. Champion data quality, governance, and documentation : implement … variety of sources, including cloud storage buckets and third‐party exports. Desired but not essential skills and experience include Broader Google Cloud Platform ecosystem, like Cloud Run, Cloud Functions, Cloud Storage, Pub/Sub, and Cloud Scheduler Data ...

Provisioning with GCP Location: London, UK(Hybrid) Type of Hiring: Contract(6+ months) Job Description: Key technologies/products: GCP: BigQuery, Dataproc, Dataflow, Cloud Composer, Spanner, Pub/Sub, Dataplex. Data Architecture: Data Mesh, Data Products, Enterprise Data Models, Data Fabric, Event-Driven Architecture, Data Warehousing. … Data Fabric concepts Event-driven architectures Enterprise ingestion and transformation patterns Data interoperability and consumption readiness design principles. Cloud Data Engineering: Google Cloud Platform BigQuery Dataproc Dataflow Cloud Composer Spanner Pub/Sub Dataplex ELT and ETL architectures dbt-based transformation frameworks ...

Managing Consultant - C&M - Google Cloud (Technical Lead) You are pragmatic and already understand that building a platform is only part of what a cloud engineering entails. You can clearly communicate with both clients and peers, describing technical issues and solutions in both written and meeting … desired level. As a GCP Technical Lead, you’ll be a true subject matter expert for delivering ingenious solutions on the Google Cloud Platform. We’ll be looking at you to set direction and take responsibility for successfully achieving an outcome or deliverable. You may have a team ...

data models and cloud-based data infrastructure, while contributing to strong engineering practices and standards. The environment is heavily focused on Google Cloud Platform (GCP), with BigQuery, Dataform and Airflow/Cloud Composer forming key parts of the technology stack. WHAT … professionals. * Independently investigating technical problems where the requirements or solution may not initially be clearly defined. ESSENTIAL EXPERIENCE * Strong hands-on experience with Google Cloud Platform (GCP). * Strong experience with BigQuery. * Experience using Dataform. * Experience with Airflow/Cloud Composer. * Strong data engineering fundamentals, including ...

than our two-person data team can support. Our data platform runs on Google BigQuery, with dbt Core for transformation, Airflow 3 on Cloud Composer for orchestration, Airbyte and custom Python pipelines for ingestion, Terraform for infrastructure and GitHub Actions for CI/CD. Some pipelines … platform and standards you put in place. About you You will have experience building and operating production data infrastructure on a cloud data warehouse, owning pipelines end to end rather than working mainly on analytics or reporting. You will know enough of a modern data stack ...