Data Integration Platform Lead

Required experience & skills

  • Proven experience as a Technical Lead / Lead Engineer delivering data engineering or integration platforms in cloud environments.
  • Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow.
  • Solid experience on Google Cloud Platform, such as:
  • Data services (e.g., BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/or container platforms (e.g., GKE, Cloud Run)
  • IAM, networking, secrets management, and environment separation
  • Strong software engineering foundations: Python, APIs, configuration management, testing strategy, and performance tuning.
  • CI/CD expertise (pipeline tooling, release controls, automated quality gates) and Infrastructure-as-Code experience (e.g., Terraform).
  • Experience designing for reliability: retries, idempotency, dead-letter patterns, backpressure handling, and operational resilience.
  • Ability to translate complex technical topics for mixed audiences and drive alignment across teams.

Job Details

Company
Vallum Associates
Location
Sheffield, England, United Kingdom
Posted