14 of 14 Dagster Jobs in the East of England

quality ETL/ELT pipelines and automated data workflows. Experience integrating heterogeneous data sources, databases and APIs. Experience with workflow orchestration tooling (e.g. Airflow, Dagster or dbt) for scheduling and operating production data pipelines. Good understanding of data quality, metadata, lineage, testing and reproducibility. Ability to evaluate technical options ...

solve. Solid experience with modern data engineering tools and patterns, with real depth in several of SQL, Spark, Databricks/Delta Lake, orchestration tools (Dagster, Airflow, Temporal), and dbt. Comfort with modern deployment practices: CI/CD, containerisation (Docker), and cloud-based infrastructure. It's a bonus ...

searching and filtering large scale data. Highly proficient working with Infrastructure as Code (Terraform, Ansible) Highly proficient in Python. Experience in orchestration tools like Dagster, Prefect and Airflow are advantageous. Experience with Spark, Databricks, data lakes/lakehouses. Knowledge of good data modelling and design patterns; in-depth knowledge ...

usage exports, AI vendor billing data, marketplace billing, or the FOCUS specification Experience with Google BigQuery, or with data pipelines and orchestration tooling (Dagster, Airflow) Experience building AI-powered product features (LLM integration, intelligent automation) Exposure to FinOps practices or cloud financial management products BA/BS degree ...

proficient in Python. Highly proficient in version control and Git/GitHub. Experience of workflow management tools, e.g. Nextflow, WDL/Cromwell, Airflow, Prefect, Dagster Understanding of containerisation (e.g. Docker) and deployment (e.g. Kubernetes). Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows and pipelines ...

Parquet/Arrow, plus an analytical engine, e.g. DuckDB, or a warehouse such as Snowflake. Orchestrated batch pipelines you've operated, not just written: Dagster or Airflow, S3-based data flows, and a habit of testing outputs for correctness rather than only for exceptions. Applied ML in production: embeddings ...

analytics — ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with product ...

Broad experience with data streaming technologies, combining sources from adhoc batches through to real-time streams Experience establishing and developing ETL/ELT tooling (Dagster, dbt, AWS Glue, Airflow or equivalents) Experience developing and maintaining API endpoints and data interfaces for developers Understanding of Node.js and TypeScript, enabling ...

Batch, ECS, EKS, S3, RDS or Postgres, Athena, SageMaker, Bedrock, or equivalent services. Scientific workflow and data orchestration frameworks such as Nextflow, Dagster, Airflow or similar. Platform security, privacy or governance controls for sensitive biomedical or clinical data. Identity platforms and federation technologies such as Entra ...

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo's data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering workflows - code ...

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo's data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering workflows - code ...

write, read and reason about the performance of non-trivial analytical queries Hands-on experience building and operating data pipelines with an orchestration framework. Dagster or Airflow is highly desired; equivalent experience with Prefect, dbt or a comparable tool is relevant if you're ready to work in Dagster ...

engineers on model development and deployment Desirable: Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt, Apache Iceberg, Trino, Dagster, Dask) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What the job involves Designing ...

engineers on model development and deployment Desirable: Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt, Apache Iceberg, Trino, Dagster, Dask) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What the job involves Designing ...