3 of 3 Apache Airflow Jobs in Maidstone

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

production. Technical depth across: Cloud service providers: AWS, Azure Infrastructure-as-Code (IaC): Terraform, Ansible Platforms: Kubernetes (AWS EKS), AWS ECS, Docker Compose, Lambda, Airflow Observability: Elastic-Fluent-Kibana (EFK) stack, Prometheus, Jaegar/OpenTelemetry, Grafana Persistence layers: MySQL, PostgreSQL, MongoDB, Redis, Elasticsearch, Kafka Delivery pipelines: GitHub Actions ...