20 of 20 Dagster Jobs in the UK excluding London

relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL.* **Orchestration** Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect.* **Data Quality and Lineage** Familiarity with tools and techniques for data testing, documentation and lineage. Examples include Great Expectations or dbt. ...

quality ETL/ELT pipelines and automated data workflows. Experience integrating heterogeneous data sources, databases and APIs. Experience with workflow orchestration tooling (e.g. Airflow, Dagster or dbt) for scheduling and operating production data pipelines. Good understanding of data quality, metadata, lineage, testing and reproducibility. Ability to evaluate technical options ...

control and code review methodologies. Experience delivering within modern DataOps environments. Data Orchestration & Observability Experience with tools such as: Airflow Azure Data Factory (ADF) Dagster Similar data orchestration and monitoring platforms Business Intelligence Experience with: Power BI Tableau Looker Semantic modelling and metrics layer concepts Agile Delivery Scrum, Kanban ...

clients. The Role You will: Own and develop the infrastructure supporting AI and ML services. Build and maintain orchestration pipelines using tools such as Dagster, Airflow or Prefect. Deploy, manage and optimise workloads in Kubernetes environments. Improve monitoring, observability and platform reliability. Implement infrastructure-as-code and CI/ ...

take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising ...

code technologies such as Terraform, Bicep, or Pulumi. Knowledge of monitoring and observability tooling such as Prometheus and Grafana. Experience with orchestration platforms including Dagster, Airflow, Prefect, or similar. BENEFITS The successful Senior MLOps Engineer will receive the following benefits: Salary between £75,000 - £85,000 - depending on experience ...

Parquet/Arrow, plus an analytical engine, e.g. DuckDB, or a warehouse such as Snowflake. Orchestrated batch pipelines you've operated, not just written: Dagster or Airflow, S3-based data flows, and a habit of testing outputs for correctness rather than only for exceptions. Applied ML in production: embeddings ...

analytics — ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with product ...

Batch, ECS, EKS, S3, RDS or Postgres, Athena, SageMaker, Bedrock, or equivalent services. Scientific workflow and data orchestration frameworks such as Nextflow, Dagster, Airflow or similar. Platform security, privacy or governance controls for sensitive biomedical or clinical data. Identity platforms and federation technologies such as Entra ...

platform and expanding their engineering capability. The Role Own and develop the MLOps infrastructure supporting AI services. Build and maintain orchestration pipelines using Dagster, Airflow, or Prefect. Deploy and manage ML workloads on Kubernetes and cloud platforms. Implement CI/CD, observability, and monitoring across production systems. Develop infrastructure ...

teamwork skills. Passion for building scalable in-house technology solutions using both custom and off-the-shelf tools. Nice to Have Experience with Dagster or similar orchestration platforms. Familiarity with CI/CD pipelines and tools such as GitHub Actions. Knowledge of REST and/or GraphQL APIs. Experience ...

interpersonal skills - comfortable working with Senior Architects, business leads, and cross-functional teams**Nice to Have*** Experience with Data Engineering concepts (ELT pipelines, Snowflake, Dagster)* Exposure to Snowflake as the analytics warehouse platform* Knowledge of SAP MDG (Master Data Governance) or equivalent MDM platforms* Experience in a manufacturing, semiconductor ...

mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending) - Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone ...

optimised for analytics and scalability. Use Terraform and Infrastructure as Code (IaC) to automate deployments and manage cloud resources. Orchestrate workflows with Airflow or Dagster, ensuring reliability and visibility across data pipelines. Implement best practices in data governance, monitoring, and data quality. Collaborate with analytics, product, and engineering teams … building reliable, scalable data systems and enabling smarter business decisions, we’d love to hear from you. Keywords: SQL/BigQuery/Airflow/Dagster/Terraform/IAC/DataOps/Infrastructure/Platform Engineer/Data Engineer ...

failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

lineage, properties, hazards. These are hard models with real edge cases, and the abstractions you choose will outlive the code. Data pipelines and orchestration. Dagster pipelines feeding a versioned data lake and a warehouse serving multiple use cases, with the reproducibility and governance that scientific data demands. Reconciling sources … Data Working knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. ...

At Bazaarvoice, we create smart shopping experiences. Through our expansive global network, product‐passionate community & enterprise technology, we connect thousands of brands and retailers with billions of consumers. Our solutions enable brands to connect with ...

infrastructure that powers a suite of AI and machine learning services. Design, build, and maintain production-grade ML orchestration pipelines using tools such as Dagster, Airflow, Prefect, or similar technologies. Deploy, monitor, and scale machine learning models and LLM-powered solutions in production environments. Build and maintain cloud-native … will have: Strong commercial experience in Python software engineering. Experience deploying and managing machine learning infrastructure in production. Knowledge of orchestration tools such as Dagster, Airflow, Prefect, or similar. Hands-on experience with Kubernetes and containerised workloads. Expertise in Infrastructure as Code using Terraform, Bicep, Pulumi, or comparable technologies. ...

Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days ...