4 of 4 Permanent Dagster Jobs in the Thames Valley

solve. Solid experience with modern data engineering tools and patterns, with real depth in several of SQL, Spark, Databricks/Delta Lake, orchestration tools (Dagster, Airflow, Temporal), and dbt. Comfort with modern deployment practices: CI/CD, containerisation (Docker), and cloud-based infrastructure. It's a bonus ...

searching and filtering large scale data. Highly proficient working with Infrastructure as Code (Terraform, Ansible) Highly proficient in Python. Experience in orchestration tools like Dagster, Prefect and Airflow are advantageous. Experience with Spark, Databricks, data lakes/lakehouses. Knowledge of good data modelling and design patterns; in-depth knowledge ...

write, read and reason about the performance of non-trivial analytical queries - Hands-on experience building and operating data pipelines with an orchestration framework. Dagster or Airflow is highly desired; equivalent experience with Prefect, dbt or a comparable tool is relevant if you're ready to work in Dagster ...

engineers on model development and deployment Desirable : Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt , Apache Iceberg, Trino, Dagster , Dask ) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What the job involves Designing ...