451 to 475 of 888 Apache Airflow Jobs

computational improvements Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others Acting as an expert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping ...

understanding of functional paradigms and type theory. Confident JVM knowledge. Modern programming languages knowledge in our primary languages (Java, Python, Clojure). Experience with Airflow or other Python‐based workflow orchestration tools. Proficiency in domain‐driven design and domain modeling. Exposure to Kubernetes, Docker, Linux, Kafka, RabbitMQ, or git. ...

tuning. Stay hands-on: design reviews, architecture decisions, and code where it matters most. What you’ll work with Compute & orchestration: Spark, Flink, Beam, Airflow, Dagster, Kafka, PubSub Storage & analytics: data lake and warehouse architectures, Parquet, Iceberg, Delta Lake, BigQuery, Snowflake Metadata & data quality: lineage systems, metadata management, Great ...

techniques such as DDP or FSDP.Experience with observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry. Experience with data pipeline orchestration tools such as Airflow, Flyte, Ray, Metaflow, or Argo Workflows. Experience with containerisation and infrastructure tooling such as Docker, Kubernetes, or Terraform. Experience profiling or optimising ML systems ...

such as DDP or FSDP. Experience with observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry. Experience with data pipeline orchestration tools such as Airflow, Flyte, Ray, Metaflow, or Argo Workflows. Experience with containerisation and infrastructure tooling such as Docker, Kubernetes, or Terraform.Experience profiling or optimising ML systems ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...