101 to 125 of 137 Permanent Apache Airflow Jobs

infrastructure: AWS and/or GCP, Kubernetes APIs and services: REST, gRPC Distributed systems: event-driven architectures, including Kafka Orchestration Frameworks: LangGraph, LangChain, AirFlow, etc Activities Integration of commercial and open-source LLMs into agentic workflows Agent and orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or CrewAI Model ...

maintainable and well-tested production code Desirable Experience Any exposure to the following would be beneficial: MLflow, Weights & Biases or similar experiment tracking tools Airflow, Prefect, Kubeflow or similar workflow orchestration platforms Kubernetes GPU-based workloads Time-series or telemetry data Distributed model training Edge, on-premise or resource ...

platform engineer and presenting a business case to a C‐minus‐1. Preferred, not required Experience with the modern data stack: Snowflake, Databricks, dbt, Airflow, BigQuery, Spark, or similar. Data observability, data quality, or AI observability experience is a strong plus. Familiarity with MEDDPICC, Command of the Message ...

mentality. You can take work beyond the analysis and get things done. Good to have: Experience in the Fintech domain Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Additional Information Some of our benefits: Base salary ...

Service Meshes etc.) Experience with configuration management tools (Ansible/Puppet/Kapitan/Terraform) Experience with distributed data platforms (Kafka/Flink/Airflow) Comfortable using cloud native and containerisation technologies (Kubernetes/Docker) Good Linux systems knowledge (experience with RHEL desirable) Broad knowledge across network technologies, server ...

including model deployment, monitoring, evaluation, and lifecycle management Strong hands‐on understanding of modern data and AI tooling, ideally including SQL, Python, Snowflake, dbt, Airflow, Metabase, Tableau, and AWS‐based data services Experience with data ingestion, streaming, and change data capture tooling, such as Fivetran, Estuary, or similar platforms … standards, and enablement for analytics engineers Ability to oversee API‐based and batch data extraction processes, particularly those built in Python and orchestrated using Airflow Understanding of machine learning tooling and lifecycle management, ideally including DVC, MLflow, Evidently AI, or equivalent platforms for experiment tracking, versioning, monitoring, and evaluation ...

Rust, and JavaScript/TypeScript stacks. The role focuses on enhancing a low-code platform for data transformation, validation and loading, with exposure to Airflow, Argo Workflows and Dagster, and AWS-driven infrastructure. #J-18808-Ljbffr ...

multiple teams. In this contract role, expect to define standards, build reusable data movement frameworks and drive best practices with AWS Glue, Spark and Airflow in a regulated environment. London-based with on-site presence three days a week. #J-18808-Ljbffr ...

clear, performant, and reliable queries to transform large complex datasets) You have experience building and owning automated data pipelines with tools like DBT/Airflow Identifying impactful opportunities and making them happen, triage requests by impact and you know when and how to adapt analysis scope to achieve ...

building and leading a team of engineers working in a related system. Experience with build, release and deployment infrastructure technologies such as Spinnaker, Jenkins, Airflow, Docker, Kubernetes, Terraform, Bazel, etc. Ability to attract, hire, and coach engineers who meet the Databricks hiring standards – can up‐level existing team ...

building and leading a team of engineers working in a related system. Experience with build, release and deployment infrastructure technologies such as Spinnaker, Jenkins, Airflow, Docker, Kubernetes, Terraform, Bazel, etc. Ability to attract, hire, and coach engineers who meet the Databricks hiring standards – can up‐level existing team ...

mechanics (order books vs AMMs, fee structures, market manipulation/anti-manipulation signals). Proficiency with SQL; experience with streaming systems (Kafka), workflow orchestration (Airflow), and cloud (AWS/GCP/Azure). Experience with Bayesian methods, probabilistic programming (Stan/PyMC), or ensemble methods. Familiarity with rigorous experimentation … online/offline evaluation, data leakage prevention, and model governance. Tech Stack Python, SQL, pandas/numpy/scipy, PyTorch/sklearn Airflow/dbt, Kafka (or equivalents), Postgres/BigQuery Docker, Kubernetes (optional), CI/CD (GitHub Actions) Observability: Prometheus/Grafana, OpenTelemetry (or equivalents) Locations and Right ...

recommendations, ranking and personalization across Bumble products. You will build production-grade models with PyTorch, craft end-to-end ML pipelines using Spark and Airflow, and deploy AI Agents based on Large Language Models, mentoring senior contributors and shaping responsible AI practices. #J-18808-Ljbffr ...

deliver scalable, production-grade Python services and APIs for research and operations. The role emphasizes modern cluster compute technologies (Kubernetes, Spark, Hadoop Yarn, Ray, Airflow) and strong proficiency in Python. A background in mathematics or computing is advantageous. #J-18808-Ljbffr ...

engineers across the firm. Ideal candidates have deep Python expertise, hands-on experience with modern cluster compute technologies (Kubernetes, Spark, Hadoop/Yarn, Ray, Airflow) and a track record of delivering scalable infrastructure in a multi-user #J-18808-Ljbffr ...

advanced proficiency in Python with extensive experience building production applications and services Experience with modern cluster compute technologies (e.g., Kubernetes, Spark, Hadoop Yarn, Ray, Airflow) Experience leading work in a formal software development environment in collaboration with other engineers Strong experience building platforms on the Linux operating system Self ...

Advanced proficiency in Python, with extensive professional experience in building production applications and services Experience of modern cluster compute - Kubernetes, Spark, Hadoop Yarn, Ray, Airflow are some of the technologies we use Experience leading work in a formal software development environment alongside other engineers in a collaborative manner Strong ...

topologies. Exposure to MLOps tooling and AI platform layers: experiment tracking (MLflow, W'B), model serving frameworks (Triton, vLLM), and pipeline orchestration (Kubeflow, Airflow). Familiarity with InfiniBand and high-performance networking as it relates to distributed training performance — sufficient to engage credibly with network and infrastructure teams ...

integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time … robust, production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

help strengthen pre- and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals ...

integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time … robust, production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

manage data models, schema structures and data reconciliation processes across multiple source systems. Build, maintain and improve orchestration frameworks using tools such as Airflow and dbt. Develop APIs from scratch to support data access, integration and product functionality. Work closely with AI engineers, machine learning specialists and software developers … schema management principles. Experience creating and maintaining APIs from the ground up, rather than simply integrating with existing APIs. Hands-on experience using Airflow, dbt or similar orchestration and transformation tools. Experience working with large, complex and varied datasets. Not the Right Fit If Your background is heavily focused ...