16 of 16 Dagster Jobs in the UK

scripting/programming skills (Python required; Java/Scala/C++ a plus) Experience with orchestration and workflow tools (Airflow, Cloud Composer, Dagster, etc.) Familiarity with modern data stack components (BigQuery, dbt, Kafka/PubSub, Spark, etc.) Knowledge of data security, access control, and best practices for handling sensitive ...

pipelines) (please be clear on years and/or projects) Strong Python and SQL Experience with orchestration and transformation frameworks such as Airflow, dbt, Dagster , or similar Experience designing and delivering data platforms or lakehouse-style architectures Solid understanding of CI/CD for data engineering (e.g. GitHub Actions ...

Python and SQL. Strong experience building ETL pipelines and distributed data systems. Solid cloud experience — ideally AWS (open to GCP). Orchestration experience (Dagster, Airflow, or similar). Experience with modern data warehouses such as Snowflake, Redshift, or BigQuery. Infrastructure‐as‐code experience (Terraform or Pulumi). Strong data ...

with cloud-based ML tools (e.g. SageMaker), data and model versioning (e.g. DVC), CI/CD (e.g. GitHub Actions), workflow orchestration (e.g. Airflow/Dagster) and containerised solutions (e.g. Docker, ECS) nice to have Experience in code testing (unit, integration, end-to-end tests) Strong data engineering skills ...

structures, performance, and optimisation strategies Familiarity with GCP and ecosystem knowledge: BigQuery, Composer, Dataproc, Cloud Run, Dataplex Hands-on experience with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment Experience with analytical data modelling (star and snowflake schemas), DWH, ETL/ELT patterns ...

looking for Extensive experience in data engineering, including time in a lead role Strong Python and SQL skills Experience with orchestration tools (Airflow, Dagster, Prefect) Hands-on dbt , AWS, and modern data warehouses Strong data modelling and architectural capability Background scaling data platforms in high-growth environments Nice ...

analytical skills. Strong communication, and collaboration abilities. Preferred Qualifications Experience with columnar DB engines like Clikchouse, KDB/Q or similar Experience with Airflow, Dagster or similar tools. Exposure to container technologies: Docker, Podman etc Knowledge of 'big data' technologies (Hadoop, Spark, Parquet) Experience with TAQ data, and exchange ...

have Python (and ideally C#) programming skills You have experience with data modelling, ETL pipelines and data integration You have a good knowledge of Dagster, Airflow or similar orchestration tool You're collaborative and pragmatic with great stakeholder communication skills What's in it for you: Salary to £120k ...

Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol (MCP) for data ...

Strong data modelling experience e.g. dbt Ideally AWS/GCP background Data warehousing experience - e.g. Snowflake, BigQuery, Redshift IAC e.g. Terraform Orchestration experience e.g. dagster, airflow THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £120,000 On top of the salary there ...

Strong data modelling experience e.g. dbt Ideally AWS/GCP background Data warehousing experience - e.g. Snowflake, BigQuery, Redshift IAC e.g. Terraform Orchestration experience e.g. dagster, airflow THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £120,000 On top of the salary there ...

. ABOUT YOU You’ll thrive in this role if you have: Industry experience within biotech, pharma, or large-scale computational research. Expertise using Dagster and Nextflow. Experience designing and implementing scalable data pipelines for biological data. This role can be hybrid or remote with monthly office commitments. ...

technical strategy for the data function, owning the design, scalability, and long-term evolution of the data platform built on technologies such as Python, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, Docker, and Omni. You'll work end-to-end across the data lifecycle, from ingestion ...

Python Build and industrialise ML/optimisation algorithms using best-practice software engineering principles Implement automated data cleaning pipelines and workflow orchestration (e.g. Dagster) Integrate ML/optimisation models into full product stacks (data ingestion, UI, orchestration) Deploy solutions using CI/CD in a cloud environment Build robust … Ability to communicate complex technical concepts to non-technical stakeholders Nice to Have Experience with MLflow, DVC, SageMaker Workflow orchestration tools (Dagster/Airflow) Containerisation (Docker, ECS) Domain experience in transportation, airlines, operations, or network optimisation Qualifications Master’s degree in Data Science, ML, Operational Research OR 2+ years ...

that follow software best-practices (in Python) Implementing integrations between the core algorithm (machine-learning or optimization) and a workflow orchestration paradigm such as Dagster Implementing software in a cloud-based deployment pipeline with Continuous Integration/Continuous Deployment (CI/CD) principles Building logging , error handling, and automated … with cloud-based ML tools (e.g. SageMaker), data and model versioning (e.g. DVC), CI/CD (e.g. GitHub Actions), workflow orchestration (e.g. Airflow/Dagster) and containerised solutions (e.g. Docker, ECS) nice to have Experience in code testing (unit, integration, end-to-end tests) Strong data engineering skills ...

that follow software best-practices (in Python) Implementing integrations between the core algorithm (machine-learning or optimization) and a workflow orchestration paradigm such as Dagster Implementing software in a cloud-based deployment pipeline with Continuous Integration/Continuous Deployment (CI/CD) principles Building logging , error handling, and automated … with cloud-based ML tools (e.g. SageMaker), data and model versioning (e.g. DVC), CI/CD (e.g. GitHub Actions), workflow orchestration (e.g. Airflow/Dagster) and containerised solutions (e.g. Docker, ECS) nice to have Experience in code testing (unit, integration, end-to-end tests) Strong data engineering skills ...