51 to 60 of 60 Dagster Jobs

Senior MLOps & Data EngineerLocation: Oxford Based (Hybrid)Type: PermanentSalary: 90,000 - 120,000 + Bonus + Equity + BenefitsThe Opportunity We're supporting an innovative biotechnology organisation that is investing heavily in the next generation ...

responsibilities include: Designing and building scalable data pipelines using Python and SQL Developing solutions with Snowflake, dbt and modern orchestration tools such as Dagster or Airflow Building and improving cloud-native data infrastructure on AWS (or transferable GCP experience) Developing scalable data models and supporting the wider platform architecture … data platforms in fast-moving technology businesses. You'll ideally have: Strong Python and SQL experience Experience with Snowflake Experience using dbt Experience with Dagster, Airflow or another modern orchestration framework AWS experience (GCP also considered) Strong understanding of data modelling principles Experience building end-to-end data platforms ...

lineage, properties, hazards. These are hard models with real edge cases, and the abstractions you choose will outlive the code. Data pipelines and orchestration. Dagster pipelines feeding a versioned data lake and a warehouse serving multiple use cases, with the reproducibility and governance that scientific data demands. Reconciling sources … Data Working knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. ...

APIs, Kubernetes and containers. Develop security and policy-as-code capabilities using tools such as OPA. Help secure cloud and data platforms, including Databricks, Dagster and Snowflake. Support threat modelling and ISO 27001 activities. Operate and improve application security services and tooling. Work directly with developers to identify ...

freshness and coverage. Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling. Build and maintain data orchestration workflows using Dagster or similar. Develop internal QA and investigation tools to improve how data issues are identified and resolved. Use Python, SQL, dbt and BigQuery … Playwright or an equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial ...

failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

with multiple billions of dollars under management.As a Senior Data Engineer you'll build and optimise reliable data pipelines and integrations using Python, SQL, Dagster, Snowflake, DBT and C#, while leveraging agentic AI tooling to accelerate delivery. You'll play a key role in shaping a new Snowflake based … performance tuning)You have experience with data modelling, ELT pipelines and data integrationYou can code with Python and/or C#You're familiar with Dagster and DBTYou're collaborative and pragmatic, comfortable working directly with stakeholders and data users to understand problems and deliver effective solutionsYou have experience ...

maintaining data pipelines to process financial and ESG data.What this role will do:• Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines are efficient, reliable, and capable of handling terabytes of data.• Collaborate … PostgreSQL or Snowflake.• Substantial experience with core AWS products such as EC2, ECS, Lambda and RDS.• Familiarity with data orchestration technologies such as Dagster, or a strong desire to learn.• Familiarity with DBT or similar tools for data transformation, or a strong desire to learn.• Passion for automation, with ...

Job Description Job Description About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and latency across both prefill and decode workloads. ...