51 to 75 of 82 Dagster Jobs in England

tool interoperability Hands-on work with vector databases like Pinecone, Weaviate, Qdrant or pgvector Familiarity with distributed systems, workflow engines (Temporal, Airflow or Dagster) and event-driven architectures Experience with open-source LLMs or Small Language Models for custom deployments Knowledge of AI safety and governance: guardrails, output filtering ...

data pipelines, databases and warehouses Experience reconciling data from multiple, heterogeneous sources Hands-on experience with orchestration and transformation tools such as Airflow, Dagster or dbt Familiarity with columnar data systems such as ClickHouse or DuckDB Experience with distributed systems and third-party integrations A pragmatic mindset ...

that brings together data from our e‐commerce, manufacturing, fulfilment, and finance systems. We build on a modern, warehouse‐native stack — Snowflake, dbt, and Dagster — and we’re working towards a governed semantic layer so trusted metrics are defined once and consumed everywhere: dashboards, self‐service tools ...

platform that brings together data from our e-commerce, manufacturing, fulfilment, and finance systems.We build on a modern, warehouse-native stack — Snowflake, dbt, and Dagster — and we're working towards a governed semantic layer so trusted metrics are defined once and consumed everywhere: dashboards, self-service tools ...

credit risk concepts (PD, EAD, LGD), a solid grasp of modelling techniques like IV and SHAP, and comfort working across Snowflake, dbt, ZenML, Dagster and Weights & Biases. Experience in automated lending, price sensitivity modelling or CLV is a strong plus.Location and working policyDublin HQ or London, hybrid.The good stuff25 ...

internals, not just the syntax. Hands-on experience with LLM orchestration frameworks such as LangChain or LangGraph (agent memory, tool calling, state management) Dagster in production (assets, sensors, partitions) or equivalent pipeline orchestration Strong backend fundamentals including API design, async programming, and database modelling You've built systems that ...

monitor models, build cloud-native infra with Kubernetes, and drive CI/CD and observability to scale AI services. You will work with Dagster, Airflow, or Prefect, use Terraform or Bicep, and collaborate with data scientists #J-18808-Ljbffr ...

mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending) - Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone ...

Index construction and classification taxonomies. Working with model-derived inputs, understanding that NLP-generated exposures carry measurement error and revise over time. Task orchestration (Dagster or Airflow) and S3-based data flows. AWS fluency and CI/CD discipline. Competitive salary plus EMI share options 25 days holiday + ...

Multi threading Profiling Python/C/C++ and performance optimisation Networking Nice to have: Data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit ...

machine-learned graphics subsystems into the simulation platform Implement production quality software in Python About you Essential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applications Excellent development skills in Python Deep knowledge of Kubernetes at the user level Good sense ...

deployment experience. Experience building self-serve ML platforms or tools for non-expert users. Experience with lakeFS , DVC , MLflow , Weights & Biases , Kubernetes, Kubeflow, Flyte, Dagster, Airflow, or Argo. LLM application, context engineering, structured output, or LLM evaluation experience. Exposure to radar, AIS, EO/IR fusion, tracking, sensor fusion ...

optimised for analytics and scalability. Use Terraform and Infrastructure as Code (IaC) to automate deployments and manage cloud resources. Orchestrate workflows with Airflow or Dagster, ensuring reliability and visibility across data pipelines. Implement best practices in data governance, monitoring, and data quality. Collaborate with analytics, product, and engineering teams … building reliable, scalable data systems and enabling smarter business decisions, we’d love to hear from you. Keywords: SQL/BigQuery/Airflow/Dagster/Terraform/IAC/DataOps/Infrastructure/Platform Engineer/Data Engineer ...

Reality is a Series-A startup building a BIM Platform to transform construction. You will design, develop, and maintain Python-based data pipelines using Dagster, optimize data models, and craft SQL for pipelines and APIs. The role requires strong Python, SQL, and data modeling skills, with collaboration across cloud ...

communication and influencing skills, with experience mentoring senior engineers and aligning multiple technical teams. Desirable Experience with workflow-orchestration technologies such as Flyte, Airflow, Dagster or Argo. Experience building large-scale batch-inference or ML-platform systems, including model deployment and model registries. Knowledge of Spark, Databricks ...

Strong communication and influencing skills, with experience mentoring senior engineers and aligning multiple technical teams. DesirableExperience with workflow-orchestration technologies such as Flyte, Airflow, Dagster or Argo. Experience building large-scale batch-inference or ML-platform systems, including model deployment and model registries. Knowledge of Spark, Databricks ...

drive reliable ingestion, modelling, and orchestration to support data-driven features for customers globally. You will design dbt models and semantic layers, own Dagster orchestration, onboard new data sources at scale, and advance self-serve analytics with agentic workflows and #J-18808-Ljbffr ...

support of an AI agent to crunch data and help refine the AI agent for better outputs Get familiar with an orchestration tool (Dagster) to schedule data extraction and transformation Organise and structure raw data from a variety of sources Work with teams across the business to understand their ...

description. Nice to Have Experience with biological data: genomic sequences, protein structures, molecular data, or similar. Familiarity with our broader tech stack: Kubernetes, Dagster, or similar orchestration and infrastructure tools. Contributions to open-source ML frameworks or research codebases. Publications at major venues (e.g., NeurIPS, ICML, ICLR, or JMLR ...

failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

what. Better Collective runs a hub and spoke data organisation. A central data platform team owns the platform itself - MotherDuck, dbt, Dagster, DLT, the golden paths, the standards, the infrastructure. Paid Media Insights is a domain team, a spoke, that builds on it. The split is deliberate … think in tables. You are technically deep where it counts. Production pipelines in SQL and Python, modelling and orchestration tooling such as dbt and Dagster, cloud data warehousing, and a real feel for performance, cost and reliability at scale. Experience with paid media or attribution data, or with machine ...

freshness and coverage. Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling. Build and maintain data orchestration workflows using Dagster or similar. Develop internal QA and investigation tools to improve how data issues are identified and resolved. Use Python, SQL, dbt and BigQuery … Playwright or an equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial ...

improve production web scraping infrastructure (Playwright, proxy management, anti-bot handling) and keep scraper health visible and actionable Build and maintain data orchestration workflows (Dagster or similar) that are reliable and easy to debug Develop fast, pragmatic internal QA tools - using AI-assisted coding tools like Claude Code … evasion, and monitoring scraper health A fast, pragmatic builder mindset, fluent with AI-assisted coding tools (e.g. Claude Code) Experience with a data orchestrator - Dagster ideally, or Airflow/Prefect Nice to have UK planning or property domain knowledge Time Off Rest properly. 37 days off in total, including ...