26 to 50 of 51 Remote/Hybrid Dagster Jobs

data model ing across the warehouse and set standards for how data is structured as we scale. Work mostly in Python and SQL, with Dagster as our orchestrator. Build and maintain the cloud infrastructure behind the platform, managed with Terraform. Work directly with stakeholders. Understand their problem, then deliver … experienced with modern cloud data platforms such as BigQuery, Snowflake, or Databricks. You've worked with data orchestration tools such as Dagster, Airflow, or Prefect. We use Dagster. You're comfortable owning cloud infrastructure. You can work with infrastructure-as-code such as Terraform and own the infrastructure your ...

usage data, billing, product analytics, and finance data, shaping architecture and standards as the team scales. You’ll predominantly use Python and SQL, with Dagster as our orchestrator, and own cloud infrastructure via Terraform. Collaboration across Finance, Product, and other teams is essential to deliver trusted data products. #J ...

contexts.Knowledge of ISO 27001 and its relevance to secure engineering.Exposure to Agile working environments and DevSecOps practicesIdeally experience securing data platforms such as Databricks, Dagster or SnowflakeEligible to work in the UK.What the role offers:80,000 DOE, negotiablePredominantly remote/hybrid workingLondon officeFull-time permanent positionExcellent benefits packageThis ...

have:Experience with domain-specific workflow systems (e.g., Nextflow) for scaling high-throughput pipeline execution.Familiarity with general-purpose data orchestration and processing frameworks (e.g., Dagster, Apache Beam) for integrating research pipelines into a production platformFamiliarity with building and maintaining bioinformatics infrastructure on Google Cloud Platform (GCP).Familiarity with modern ...

Index construction and classification taxonomies. Working with model-derived inputs, understanding that NLP-generated exposures carry measurement error and revise over time. Task orchestration (Dagster or Airflow) and S3-based data flows. AWS fluency and CI/CD discipline. Competitive salary plus EMI share options 25 days holiday + ...

evolve our cloud infrastructure and internal platform (primarily Azure/Kubernetes-based), including service-to-service communication and workflow orchestration layers (e.g. gRPC, Temporal, Dagster) that power product delivery. Make architectural decisions that shape how Cogna builds and operates software Work within and contribute to our Go/Python ...

simulation platformEffectively integrate machine-learned graphics subsystems into the simulation platformImplement production quality software in PythonAbout youEssential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applicationsExcellent development skills in PythonDeep knowledge of Kubernetes at the user levelGood sense of systems ...

# DataOps EngineerBirmingham, Bristol, Newcastle Bank House, Manchester, LondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 466851-en\_GB## **Who You'll Be Working With**As a DataOps Engineer at Capgemini, you will help ...

drive reliable ingestion, modelling, and orchestration to support data-driven features for customers globally. You will design dbt models and semantic layers, own Dagster orchestration, onboard new data sources at scale, and advance self-serve analytics with agentic workflows and #J-18808-Ljbffr ...

developing other engineers. Comfortable working within agile delivery environments. Curiosity for emerging technologies, tools, and best practices within the data ecosystem. Experience with DataDog, Dagster, Fivetran, or Tableau would be beneficial but is not essential. Our Tech Environment: Data Stack: Snowflake, dbt, SQL, Python, Fivetran, Dagster, DataDog, Tableau. ...

failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

responsibilities include: Designing and building scalable data pipelines using Python and SQL Developing solutions with Snowflake, dbt and modern orchestration tools such as Dagster or Airflow Building and improving cloud-native data infrastructure on AWS (or transferable GCP experience) Developing scalable data models and supporting the wider platform architecture … data platforms in fast-moving technology businesses. You'll ideally have: Strong Python and SQL experience Experience with Snowflake Experience using dbt Experience with Dagster, Airflow or another modern orchestration framework AWS experience (GCP also considered) Strong understanding of data modelling principles Experience building end-to-end data platforms ...

layer, and quality standards the data function depends on, with the validation and lineage to make them trustworthy downstream. Own orchestration and observability in Dagster, and onboarding new sources in a way that scales. Innovate on self-serve and AI-enabled analytics, from semantic models and agentic workflows … Deep, hands-on Snowflake and dbt experience: modelling, semantic layers, agents & skills, testing, performance and cost tuning. Production experience with a pipeline orchestrator, ideally Dagster (or similar Airflow, Prefect), including dependent workloads, partial failures, and observability. Modern cloud infrastructure (Azure/AWS/GCP) and Kubernetes experience deploying ...

lineage, properties, hazards. These are hard models with real edge cases, and the abstractions you choose will outlive the code. Data pipelines and orchestration. Dagster pipelines feeding a versioned data lake and a warehouse serving multiple use cases, with the reproducibility and governance that scientific data demands. Reconciling sources … Data Working knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. ...

freshness and coverage. Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling. Build and maintain data orchestration workflows using Dagster or similar. Develop internal QA and investigation tools to improve how data issues are identified and resolved. Use Python, SQL, dbt and BigQuery … Playwright or an equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial ...

improve production web scraping infrastructure (Playwright, proxy management, anti-bot handling) and keep scraper health visible and actionable Build and maintain data orchestration workflows (Dagster or similar) that are reliable and easy to debug Develop fast, pragmatic internal QA tools - using AI-assisted coding tools like Claude Code … evasion, and monitoring scraper health A fast, pragmatic builder mindset, fluent with AI-assisted coding tools (e.g. Claude Code) Experience with a data orchestrator - Dagster ideally, or Airflow/Prefect Nice to have UK planning or property domain knowledge Time Off Rest properly. 37 days off in total, including ...

with multiple billions of dollars under management.As a Senior Data Engineer you'll build and optimise reliable data pipelines and integrations using Python, SQL, Dagster, Snowflake, DBT and C#, while leveraging agentic AI tooling to accelerate delivery. You'll play a key role in shaping a new Snowflake based … performance tuning)You have experience with data modelling, ELT pipelines and data integrationYou can code with Python and/or C#You're familiar with Dagster and DBTYou're collaborative and pragmatic, comfortable working directly with stakeholders and data users to understand problems and deliver effective solutionsYou have experience ...

multiple billions of dollars under management. As a Senior Data Engineer you'll build and optimise reliable data pipelines and integrations using Python, SQL, Dagster, Snowflake, DBT and C#, while leveraging agentic AI tooling to accelerate delivery. You'll play a key role in shaping a new Snowflake based … pipelines and data integration You can code with Python and/or C# You have experience within a finance environment You're familiar with Dagster and DBT You're collaborative and pragmatic, comfortable working directly with stakeholders and data users to understand problems and deliver effective solutions You have ...

will work closely with our API/backend development and data pipeline team to create robust and efficient solutions. Responsibilities Design, develop, and maintain dagster-based data pipeline using Python. Design and implement efficient data models accommodating the planned product features and application requirements. Develop SQL queries and procedures … Keen in developing in‐house tech stacks as well as utilizing off‐the‐shelf components to build a robust solution. Preferred Qualifications Experience with Dagster or other data orchestration technologies. Familiarity with CI/CD pipelines, such as GitHub Actions and Luquibase. Knowledge of REST/GraphQL or other ...

GDPR; essential where AI outputs inform decisions about vulnerable people in health and social care. Design, build, and maintain production‐grade orchestration pipelines (Dagster) supporting model training, inference, and retraining, ensuring data from local authority systems is timely, accurate, and fit for purpose before it reaches ML services. Contribute … code (Terraform, Bicep or Pulumi) Implementing monitoring and observability for production systems, including metrics, alerting, logging, and dashboarding (e.g. Prometheus, Grafana) Pipeline orchestration using Dagster, Airflow, Prefect, or similar Bonus points if you have: Practical experience with model serving infrastructure – batch and/or real‐time inference at scale. ...

Job ID: 94172814480Posted: 2026-09-09Location: London, England, United KingdomCategory: Technology, Applications Development, ProfessionalCompany: CitiAbout the TeamJoin Citi’s GenAI Common Platform Engineering team and help build the technology powering Citi Assist — a Generative ...

About the Team Join Citi’s GenAI Common Platform Engineering team and help build the technology powering Citi Assist — a Generative AI assistant designed to transform how hundreds of thousands of Citi colleagues work. We ...

Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days ...