4 of 4 Apache Jobs in West London

skills; experience with Oracle databases . Experience designing and supporting ETL/ELT pipelines and data quality frameworks . Working knowledge of Autosys & Apache Airflow Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift) Familiarity with AWS S3 for large-scale data storage. Experience ...

frameworks, scripting). Experience supporting or validating ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of Autosys & Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift). Familiarity with ...

strong engineer who cares about performance, scalability and clean design. Key experience: Strong SQL and Python skills (pandas, NumPy, Spark) Hands-on experience with Apache Spark, Kafka, and Airflow Solid understanding of data warehousing and distributed computing Experience with Docker, Kubernetes, and CI/CD pipelines A problem-solving ...

Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components: o Data Factory (pipelines, orchestration) o Data Engineering (Lakehouse, notebooks, Apache Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake architecture ...