76 to 89 of 89 Dagster Jobs in the UK

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

what. Better Collective runs a hub and spoke data organisation. A central data platform team owns the platform itself - MotherDuck, dbt, Dagster, DLT, the golden paths, the standards, the infrastructure. Paid Media Insights is a domain team, a spoke, that builds on it. The split is deliberate … think in tables. You are technically deep where it counts. Production pipelines in SQL and Python, modelling and orchestration tooling such as dbt and Dagster, cloud data warehousing, and a real feel for performance, cost and reliability at scale. Experience with paid media or attribution data, or with machine ...

freshness and coverage. Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling. Build and maintain data orchestration workflows using Dagster or similar. Develop internal QA and investigation tools to improve how data issues are identified and resolved. Use Python, SQL, dbt and BigQuery … Playwright or an equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial ...

improve production web scraping infrastructure (Playwright, proxy management, anti-bot handling) and keep scraper health visible and actionable Build and maintain data orchestration workflows (Dagster or similar) that are reliable and easy to debug Develop fast, pragmatic internal QA tools - using AI-assisted coding tools like Claude Code … evasion, and monitoring scraper health A fast, pragmatic builder mindset, fluent with AI-assisted coding tools (e.g. Claude Code) Experience with a data orchestrator - Dagster ideally, or Airflow/Prefect Nice to have UK planning or property domain knowledge Time Off Rest properly. 37 days off in total, including ...

layer, and quality standards the data function depends on, with the validation and lineage to make them trustworthy downstream. Own orchestration and observability in Dagster, and onboarding new sources in a way that scales. Innovate on self-serve and AI-enabled analytics, from semantic models and agentic workflows … Deep, hands-on Snowflake and dbt experience: modelling, semantic layers, agents & skills, testing, performance and cost tuning. Production experience with a pipeline orchestrator, ideally Dagster (or similar Airflow, Prefect), including dependent workloads, partial failures, and observability. Modern cloud infrastructure (Azure/AWS/GCP) and Kubernetes experience deploying ...

lineage, properties, hazards. These are hard models with real edge cases, and the abstractions you choose will outlive the code. Data pipelines and orchestration. Dagster pipelines feeding a versioned data lake and a warehouse serving multiple use cases, with the reproducibility and governance that scientific data demands. Reconciling sources … Data Working knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. ...

At Bazaarvoice, we create smart shopping experiences. Through our expansive global network, product‐passionate community & enterprise technology, we connect thousands of brands and retailers with billions of consumers. Our solutions enable brands to connect with ...

multiple billions of dollars under management. As a Senior Data Engineer you'll build and optimise reliable data pipelines and integrations using Python, SQL, Dagster, Snowflake, DBT and C#, while leveraging agentic AI tooling to accelerate delivery. You'll play a key role in shaping a new Snowflake based … data modelling, ELT pipelines and data integrationYou can code with Python and/or C#You have experience within a finance environmentYou're familiar with Dagster and DBTYou're collaborative and pragmatic, comfortable working directly with stakeholders and data users to understand problems and deliver effective solutionsYou have experience ...

with cloud‐based ML tools (e.g., SageMaker), data and model versioning (e.g., DVC), CI/CD (e.g., GitHub Actions), workflow orchestration (e.g., Airflow/Dagster) and containerised solutions (e.g., Docker, ECS) nice to have Experience in code testing (unit, integration, end‐to‐end tests) Strong data engineering skills … that follow software best‐practices (in Python) Implement integrations between the core algorithm (machine‐learning or optimisation) and a workflow orchestration paradigm such as Dagster Implement software in a cloud‐based deployment pipeline with Continuous Integration/Continuous Deployment (CI/CD) principles Build logging, error handling, and automated ...

infrastructure that powers a suite of AI and machine learning services. Design, build, and maintain production-grade ML orchestration pipelines using tools such as Dagster, Airflow, Prefect, or similar technologies. Deploy, monitor, and scale machine learning models and LLM-powered solutions in production environments. Build and maintain cloud-native … will have: Strong commercial experience in Python software engineering. Experience deploying and managing machine learning infrastructure in production. Knowledge of orchestration tools such as Dagster, Airflow, Prefect, or similar. Hands-on experience with Kubernetes and containerised workloads. Expertise in Infrastructure as Code using Terraform, Bicep, Pulumi, or comparable technologies. ...

pipelines, electronics, embedded software and hardware, mechanical design and manufacturing, AI and computer vision, and data science. Задачи Design, develop, and maintain Python-based Dagster data pipelines Design and implement efficient data models for planned product features and application requirements Develop SQL queries and procedures for data pipelines … related field, or equivalent proven experience in database and data pipeline development Hands-on experience with code-driven orchestration tools such as Dagster or Airflow Solid experience with relational databases and SQL, preferably PostgreSQL Strong Python and OOP skills Experience modelling data for transactional and analytical systems Strong debugging ...

Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days ...

GitHub Actions and strengthening development tooling. Advising on securing APIs and other high‐risk system components. Assisting with securing our Data Platforms including Databricks, Dagster, Snowflake and the wider cloud environment. Developing security policy as code using OPA or similar and gaining adoption across teams. Documenting security processes … ideally AKS, along with broader container security. Experience of securing APIs and other exposed components. Ideally experience in securing data platforms such as Databricks, Dagster or Snowflake. Experience working directly with software engineering best practices including source control, unit testing, code reviews, design documentation and strong debugging and troubleshooting. ...