2 of 2 Metadata Management Jobs in South Yorkshire

components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow , including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems with strong reliability and traceability. Drive … data quality controls (validation, reconciliation, exception handling) and operational runbooks. Platform engineering (multi-tenancy & scalability) Evolve the multi‐tenant architecture: tenant isolation, configuration management, metadata‐driven pipelines, and scalable runtime patterns. Optimise for performance, cost, and reliability across environments (dev/test/prod), including capacity planning ...

components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow, including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems with strong reliability and traceability. Drive … data quality controls (validation, reconciliation, exception handling) and operational runbooks. Platform engineering (multi-tenancy & scalability) Evolve the multi-tenant architecture: tenant isolation, configuration management, metadata-driven pipelines, and scalable runtime patterns. Optimise for performance, cost, and reliability across environments (dev/test/prod), including capacity planning ...