3 of 3 Apache Airflow Jobs in the Thames Valley

supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). (Preferred) Programming expertise in Python, Java, Scala, SQL, Spark, Unix shell scripting ...

cloud-native platforms in AWS and/or GCP.Experience designing and supporting data pipelines within complex technical environments.Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster.Experience implementing monitoring, logging, observability and platform governance practices.Strong understanding of software engineering principles, testing and deployment best practices.Ability to work collaboratively ...

code Requirements: - Must have strong, commercial AWS (contract) Data Engineering experience - Must bring solid knowledge of data warehousing and modelling - Experience with Airflow and infrastructure as a code (Terraform, CloudFormation) would be beneficial - Must have experience with Redshift Nice to have: - Experience with dbt/lake formation ...