17 of 17 Permanent Dagster Jobs in the UK

relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL. Orchestration Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect. Data Quality and Lineage Familiarity with tools and techniques for data testing, documentation and lineage. Examples include Great Expectations or dbt. ...

building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability Understanding ...

/CD experience. Highly Desirable Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Order book reconstruction Tick-to-bar aggregation Airflow, Dagster, Prefect or MLflow Experience supporting quantitative research or trading systems Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs) What We're Looking ...

/or MS Fabric experience a bonus. Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life. Hands-on DataOps experience (eg. CI/CD, version control, IaC, etc. ...

delivering modern data platforms into large organisations. Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life Strong Snowflake experience is preferred, and Databricks experience would be a bonus ...

data platform, including data access patterns, integration with ML workflows, and performance-aware data consumption. Experience with workflow orchestration tools such as Prefect, Airflow, Dagster, or similar. Strong experience implementing IaC and CI/CD pipelines for software, data, and machine learning workflows. Strong Python engineering skills and experience ...

pipelines Solid understanding of integration patterns including REST APIs, webhooks, OAuth and event-driven architectures Experience with orchestration tools such as Airflow, Prefect or Dagster Familiarity with cloud environments (AWS, GCP or Azure) Experience with containerisation tools such as Docker and Kubernetes Proven experience integrating multiple business systems ...

optimised warehouse spend, storage strategies, or job efficiency, and treat compute as a resource to manage, not ignore Platform fluency: worked across orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark) AI Native: experienced in agentic coding workflows (context, harness, loop, and graph ...

similar databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph-based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning ...

This job is with AEG EUROPE, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Looking to take the next ...

explain complex technical issues to non-technical folks succinctly Bonus points if you have: Prior experience using or administering Apache Airflow, Autosys, UC4, Temporal, Dagster, or Prefect Proficiency in Python/Go. Enterprise data experience with or in regulated environments Experience with scripting/automation specifically infra (Pulumi, Terraform ...

inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time streaming (Kafka, Flink … data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). • Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With ...

Data Validation Specialist 3-6 Month Initial Contract, London/Hybrid 1-2 days per week on site, £Negotiable Rate (Inside IR35) We are seeking an experienced Data Validation Specialist to join a front-office ...

architecture for the Enterprise Data Platform, establishing and enforcing principles, standards, design patterns, governance and tooling strategies across the modern data stack (Snowflake, dbt, Dagster, Airbyte, etc.). Shape and deliver the data platform roadmap in partnership with the Director of Data Platform, ensuring alignment with wider … principal data architecture role (3+ years) Strong expertise in Snowflake (or similar cloud data platforms) Hands-on experience with modern data tooling, including dbt, Dagster (or equivalent), and Airbyte (or similar) Deep knowledge of data modelling approaches. Strong understanding of ELT/ETL patterns, pipeline design, and distributed data ...