51 to 61 of 61 Dagster Jobs

internals, not just the syntax. Hands-on experience with LLM orchestration frameworks such as LangChain or LangGraph (agent memory, tool calling, state management) Dagster in production (assets, sensors, partitions) or equivalent pipeline orchestration Strong backend fundamentals including API design, async programming, and database modelling You've built systems that ...

have:Experience with domain-specific workflow systems (e.g., Nextflow) for scaling high-throughput pipeline execution.Familiarity with general-purpose data orchestration and processing frameworks (e.g., Dagster, Apache Beam) for integrating research pipelines into a production platformFamiliarity with building and maintaining bioinformatics infrastructure on Google Cloud Platform (GCP).Familiarity with modern ...

models, data warehouses and data integration solutions. Implement CI/CD processes and automated deployment pipelines. Use workflow orchestration tools such as Airflow, Prefect, Dagster or Cloud Composer. Monitor, troubleshoot and optimise platform and pipeline performance. Collaborate with technical and non-technical stakeholders to translate business requirements into robust … Experience working in Agile delivery environments. Experience with cloud platforms, preferably Google Cloud Platform (GCP) . Experience with workflow orchestration tools including Airflow, Prefect, Dagster or Cloud Composer. Knowledge of containerisation technologies such as Docker. Experience working with large-scale datasets and distributed processing technologies such as Spark, Dataproc ...

models, data warehouses and data integration solutions. Implement CI/CD processes and automated deployment pipelines. Use workflow orchestration tools such as Airflow, Prefect, Dagster or Cloud Composer. Monitor, troubleshoot and optimise platform and pipeline performance. Collaborate with technical and non-technical stakeholders to translate business requirements into robust … Experience working in Agile delivery environments. Experience with cloud platforms, preferably Google Cloud Platform (GCP) . Experience with workflow orchestration tools including Airflow, Prefect, Dagster or Cloud Composer. Knowledge of containerisation technologies such as Docker. Experience working with large-scale datasets and distributed processing technologies such as Spark, Dataproc ...

relevance to secure engineering. Exposure to Agile working environments and DevSecOps practices Ideally experience securing data platforms such as Databricks, Dagster or Snowflake Eligible to work in the UK. This is an excellent opportunity for a Senior Application Security Engineer where you can make a meaningful impact ...

deployment experience. Experience building self-serve ML platforms or tools for non-expert users. Experience with lakeFS , DVC , MLflow , Weights & Biases , Kubernetes, Kubeflow, Flyte, Dagster, Airflow, or Argo. LLM application, context engineering, structured output, or LLM evaluation experience. Exposure to radar, AIS, EO/IR fusion, tracking, sensor fusion ...

will own the platform that ensures these models remain reliable, effective, and secure in production. You'll standardize our deployment patterns built around MLflow, Dagster, ECR, FastAPI, and EKS, making them the backbone for packaging, evaluating, releasing, serving, monitoring, and rolling back models across Hadrian's automated factories. What ...

will own the platform that ensures these models remain reliable, effective, and secure in production. You'll standardize our deployment patterns built around MLflow, Dagster, ECR, FastAPI, and EKS, making them the backbone for packaging, evaluating, releasing, serving, monitoring, and rolling back models across Hadrian's automated factories. What ...

will own the platform that ensures these models remain reliable, effective, and secure in production. You'll standardize our deployment patterns built around MLflow, Dagster, ECR, FastAPI, and EKS, making them the backbone for packaging, evaluating, releasing, serving, monitoring, and rolling back models across Hadrian's automated factories. What ...

contexts.Knowledge of ISO 27001 and its relevance to secure engineering.Exposure to Agile working environments and DevSecOps practicesIdeally experience securing data platforms such as Databricks, Dagster or SnowflakeEligible to work in the UK.What the role offers:80,000 DOE, negotiablePredominantly remote/hybrid workingLondon officeFull-time permanent positionExcellent benefits packageThis ...

relevance to secure engineering. Exposure to Agile working environments and DevSecOps practicesIdeally experience securing data platforms such as Databricks, Dagster or SnowflakeEligible to work in the UK.What the role offers:80,000 DOE, negotiablePredominantly remote/hybrid workingLondon officeFull-time permanent positionExcellent benefits packageThis is an excellent opportunity ...

simulation platformEffectively integrate machine-learned graphics subsystems into the simulation platformImplement production quality software in PythonAbout youEssential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applicationsExcellent development skills in PythonDeep knowledge of Kubernetes at the user levelGood sense of systems ...

simulation platformEffectively integrate machine-learned graphics subsystems into the simulation platformImplement production quality software in PythonAbout youEssential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applicationsExcellent development skills in PythonDeep knowledge of Kubernetes at the user levelGood sense of systems ...

Senior MLOps & Data EngineerLocation: Oxford Based (Hybrid)Type: PermanentSalary: 90,000 - 120,000 + Bonus + Equity + BenefitsThe Opportunity We're supporting an innovative biotechnology organisation that is investing heavily in the next generation ...

Senior MLOps & Data EngineerLocation: Oxford Based (Hybrid)Type: PermanentSalary: 90,000 - 120,000 + Bonus + Equity + BenefitsThe Opportunity We're supporting an innovative biotechnology organisation that is investing heavily in the next generation ...

responsibilities include: Designing and building scalable data pipelines using Python and SQL Developing solutions with Snowflake, dbt and modern orchestration tools such as Dagster or Airflow Building and improving cloud-native data infrastructure on AWS (or transferable GCP experience) Developing scalable data models and supporting the wider platform architecture … data platforms in fast-moving technology businesses. You'll ideally have: Strong Python and SQL experience Experience with Snowflake Experience using dbt Experience with Dagster, Airflow or another modern orchestration framework AWS experience (GCP also considered) Strong understanding of data modelling principles Experience building end-to-end data platforms ...

lineage, properties, hazards. These are hard models with real edge cases, and the abstractions you choose will outlive the code. Data pipelines and orchestration. Dagster pipelines feeding a versioned data lake and a warehouse serving multiple use cases, with the reproducibility and governance that scientific data demands. Reconciling sources … Data Working knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. ...

APIs, Kubernetes and containers. Develop security and policy-as-code capabilities using tools such as OPA. Help secure cloud and data platforms, including Databricks, Dagster and Snowflake. Support threat modelling and ISO 27001 activities. Operate and improve application security services and tooling. Work directly with developers to identify ...

freshness and coverage. Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling. Build and maintain data orchestration workflows using Dagster or similar. Develop internal QA and investigation tools to improve how data issues are identified and resolved. Use Python, SQL, dbt and BigQuery … Playwright or an equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial ...

failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

with multiple billions of dollars under management.As a Senior Data Engineer you'll build and optimise reliable data pipelines and integrations using Python, SQL, Dagster, Snowflake, DBT and C#, while leveraging agentic AI tooling to accelerate delivery. You'll play a key role in shaping a new Snowflake based … performance tuning)You have experience with data modelling, ELT pipelines and data integrationYou can code with Python and/or C#You're familiar with Dagster and DBTYou're collaborative and pragmatic, comfortable working directly with stakeholders and data users to understand problems and deliver effective solutionsYou have experience ...

maintaining data pipelines to process financial and ESG data.What this role will do:• Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines are efficient, reliable, and capable of handling terabytes of data.• Collaborate … PostgreSQL or Snowflake.• Substantial experience with core AWS products such as EC2, ECS, Lambda and RDS.• Familiarity with data orchestration technologies such as Dagster, or a strong desire to learn.• Familiarity with DBT or similar tools for data transformation, or a strong desire to learn.• Passion for automation, with ...

data pipelines to process financial and ESG data. What this role will do: Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines are efficient, reliable, and capable of handling terabytes of data. Collaborate … PostgreSQL or Snowflake. Substantial experience with core AWS products such as EC2, ECS, Lambda and RDS. Familiarity with data orchestration technologies such as Dagster, or a strong desire to learn. Familiarity with DBT or similar tools for data transformation, or a strong desire to learn. Passion for automation, with ...

Job Description Job Description About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and latency across both prefill and decode workloads. ...