14 of 14 Dagster Jobs in the South West

solve. - Solid experience with modern data engineering tools and patterns, with real depth in several of SQL, Spark, Databricks/Delta Lake, orchestration tools (Dagster, Airflow, Temporal), and dbt. - Comfort with modern deployment practices: CI/CD, containerisation (Docker), and cloud-based infrastructure. It's a bonus ...

searching and filtering large scale data. Highly proficient working with Infrastructure as Code (Terraform, Ansible) Highly proficient in Python. Experience in orchestration tools like Dagster, Prefect and Airflow are advantageous. Experience with Spark, Databricks, data lakes/lakehouses. Knowledge of good data modelling and design patterns; in-depth knowledge ...

searching and filtering large scale data. Highly proficient working with Infrastructure as Code (Terraform, Ansible) Highly proficient in Python. Experience in orchestration tools like Dagster, Prefect and Airflow are advantageous. Experience with Spark, Databricks, data lakes/lakehouses. Knowledge of good data modelling and design patterns; in-depth knowledge ...

usage exports, AI vendor billing data, marketplace billing, or the FOCUS specification Experience with Google BigQuery, or with data pipelines and orchestration tooling (Dagster, Airflow) Experience building AI-powered product features (LLM integration, intelligent automation) Exposure to FinOps practices or cloud financial management products BA/BS degree ...

usage exports, AI vendor billing data, marketplace billing, or the FOCUS specification Experience with Google BigQuery, or with data pipelines and orchestration tooling (Dagster, Airflow) Experience building AI-powered product features (LLM integration, intelligent automation) Exposure to FinOps practices or cloud financial management products BA/BS degree ...

usage exports, AI vendor billing data, marketplace billing, or the FOCUS specification - Experience with Google BigQuery, or with data pipelines and orchestration tooling (Dagster, Airflow) - Experience building AI-powered product features (LLM integration, intelligent automation) - Exposure to FinOps practices or cloud financial management products - BA/BS degree ...

proficient in Python. Highly proficient in version control and Git/GitHub. Experience of workflow management tools, e.g. Nextflow, WDL/Cromwell, Airflow, Prefect, Dagster Understanding of containerisation (e.g. Docker) and deployment (e.g. Kubernetes). Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows and pipelines ...

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo's data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering workflows - code ...

write, read and reason about the performance of non-trivial analytical queries Hands-on experience building and operating data pipelines with an orchestration framework. Dagster or Airflow is highly desired; equivalent experience with Prefect, dbt or a comparable tool is relevant if you're ready to work in Dagster ...

write, read and reason about the performance of non-trivial analytical queries - Hands-on experience building and operating data pipelines with an orchestration framework. Dagster or Airflow is highly desired; equivalent experience with Prefect, dbt or a comparable tool is relevant if you're ready to work in Dagster ...

engineers on model development and deployment Desirable: Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt, Apache Iceberg, Trino, Dagster, Dask) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What the job involves Designing ...

failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days ...