76 to 82 of 82 Dagster Jobs in England

layer, and quality standards the data function depends on, with the validation and lineage to make them trustworthy downstream. Own orchestration and observability in Dagster, and onboarding new sources in a way that scales. Innovate on self-serve and AI-enabled analytics, from semantic models and agentic workflows … Deep, hands-on Snowflake and dbt experience: modelling, semantic layers, agents & skills, testing, performance and cost tuning. Production experience with a pipeline orchestrator, ideally Dagster (or similar Airflow, Prefect), including dependent workloads, partial failures, and observability. Modern cloud infrastructure (Azure/AWS/GCP) and Kubernetes experience deploying ...

multiple billions of dollars under management. As a Senior Data Engineer you'll build and optimise reliable data pipelines and integrations using Python, SQL, Dagster, Snowflake, DBT and C#, while leveraging agentic AI tooling to accelerate delivery. You'll play a key role in shaping a new Snowflake based … data modelling, ELT pipelines and data integrationYou can code with Python and/or C#You have experience within a finance environmentYou're familiar with Dagster and DBTYou're collaborative and pragmatic, comfortable working directly with stakeholders and data users to understand problems and deliver effective solutionsYou have experience ...

with cloud‐based ML tools (e.g., SageMaker), data and model versioning (e.g., DVC), CI/CD (e.g., GitHub Actions), workflow orchestration (e.g., Airflow/Dagster) and containerised solutions (e.g., Docker, ECS) nice to have Experience in code testing (unit, integration, end‐to‐end tests) Strong data engineering skills … that follow software best‐practices (in Python) Implement integrations between the core algorithm (machine‐learning or optimisation) and a workflow orchestration paradigm such as Dagster Implement software in a cloud‐based deployment pipeline with Continuous Integration/Continuous Deployment (CI/CD) principles Build logging, error handling, and automated ...

infrastructure that powers a suite of AI and machine learning services. Design, build, and maintain production-grade ML orchestration pipelines using tools such as Dagster, Airflow, Prefect, or similar technologies. Deploy, monitor, and scale machine learning models and LLM-powered solutions in production environments. Build and maintain cloud-native … will have: Strong commercial experience in Python software engineering. Experience deploying and managing machine learning infrastructure in production. Knowledge of orchestration tools such as Dagster, Airflow, Prefect, or similar. Hands-on experience with Kubernetes and containerised workloads. Expertise in Infrastructure as Code using Terraform, Bicep, Pulumi, or comparable technologies. ...

pipelines, electronics, embedded software and hardware, mechanical design and manufacturing, AI and computer vision, and data science. Задачи Design, develop, and maintain Python-based Dagster data pipelines Design and implement efficient data models for planned product features and application requirements Develop SQL queries and procedures for data pipelines … related field, or equivalent proven experience in database and data pipeline development Hands-on experience with code-driven orchestration tools such as Dagster or Airflow Solid experience with relational databases and SQL, preferably PostgreSQL Strong Python and OOP skills Experience modelling data for transactional and analytical systems Strong debugging ...

Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days ...

GitHub Actions and strengthening development tooling. Advising on securing APIs and other high‐risk system components. Assisting with securing our Data Platforms including Databricks, Dagster, Snowflake and the wider cloud environment. Developing security policy as code using OPA or similar and gaining adoption across teams. Documenting security processes … ideally AKS, along with broader container security. Experience of securing APIs and other exposed components. Ideally experience in securing data platforms such as Databricks, Dagster or Snowflake. Experience working directly with software engineering best practices including source control, unit testing, code reviews, design documentation and strong debugging and troubleshooting. ...