1 to 25 of 87 Permanent Dagster Jobs in the UK

data quality, testing, monitoring, and observability solutions, with tools such as Monte Carlo.Experience with workflow orchestration tools, preferably Prefect, or alternatives such as Airflow, Dagster, or Azure Data Factory.Understanding of event-driven architectures, distributed data processing, and large-scale data platforms.Experience with source control and CI/CD practices ...

compute and managed data services.Strong experience with modern data warehousing/lakehouse tools (e.g., Snowflake, BigQuery, Redshift, Databricks).Hands-on orchestration experience (e.g., Airflow, Dagster, Prefect) and CI/CD for data pipelines.Experience with streaming and event-driven data (e.g., Kafka, Kinesis, Pub/Sub) is highly desirable.Proficiency with ...

platforms (e.g., Apache Kafka, Kinesis).End-to-end exposure to data pipeline lifecycle development, including extensive experience with workflow orchestration tools (e.g., Apache Airflow, Dagster).Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg).Advanced SQL skills ...

relational or analytical storage (for example Kafka, Spark, PostgreSQL). Orchestration. Defining and running data workflows with modern orchestration frameworks (for example Airflow, Dagster or Prefect). Data quality and lineage. Tools and techniques for data testing, documentation and lineage (for example Great Expectations or dbt). AI, MLOps ...

relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL.* **Orchestration** Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect.* **Data Quality and Lineage** Familiarity with tools and techniques for data testing, documentation and lineage. Examples include Great Expectations or dbt. ...

technical stakeholders Strong communication, problem-solving and analytical skills Desirable Experience Experience with Azure, AWS or GCP Exposure to orchestration tools such as Airflow, Dagster or Fabric Pipelines Experience with Git, CI/CD pipelines and DataOps practices Knowledge of Microsoft Purview, Unity Catalog or similar governance tools Experience ...

quality ETL/ELT pipelines and automated data workflows. Experience integrating heterogeneous data sources, databases and APIs. Experience with workflow orchestration tooling (e.g. Airflow, Dagster or dbt) for scheduling and operating production data pipelines. Good understanding of data quality, metadata, lineage, testing and reproducibility. Ability to evaluate technical options ...

testing and data quality practice. A collaborative mindset and a genuine interest in building things well. Desirable Experience with orchestration tools such as Airflow, Dagster, Prefect or Azure Data Factory. Experience working within AWS, Azure, GCP or another enterprise cloud ecosystem. Experience with complex customer, transactional, digital or behavioural ...

across systems Hands-on experience with dbt or Dataform, building modular, tested data models Experience orchestrating data pipelines with a modern orchestrator such as Dagster, Airflow, or Prefect Solid knowledge of cloud platforms (GCP and/or AWS), with the ability to design and deploy data solutions at scale ...

Building Extract Transform and Load (ETL) pipeline (streaming/batch) using MPP frameworks (Spark, Beam, or other) Experience in orchestrating complex pipelines using Airflow, Dagster or other Proficiency in one or more programming languages: Python, Java, GO or other Experience with AWS or GCP and their products ...

.Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery ...

building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability Understanding ...

Transaction Monitoring Screening Risk Ratings Compliance Case Management Strong data governance, lineage and data quality experience Experience with dbt, Airflow, Azure Data Factory, Dagster or similar tooling CI/CD, Git and modern engineering practices Strong stakeholder engagement and communication skills #J-18808-Ljbffr ...

Transaction Monitoring Screening Risk Ratings Compliance Case Management Strong data governance, lineage and data quality experience Experience with dbt, Airflow, Azure Data Factory, Dagster or similar tooling CI/CD, Git and modern engineering practices Strong stakeholder engagement and communication skills Why Apply? Opportunity to help build a greenfield ...

data platforms, or significantly evolving existing ones.Experience with data quality and observability, using dbt or complementary tooling.Familiarity with orchestration tools such as Airflow, Dagster, or Prefect.Experience with semantic layers, metrics frameworks, or analytics consumption patterns.Exposure to data governance, access control, or analytics enablement at scale.Experience mentoring or supporting junior ...

data pipelines at scale Experience with a modern data stack (e.g. Snowflake, dbt, Fivetran, Debezium or similar) Experience with orchestration tools such as Airflow, Dagster or Prefect Proficiency in Python for building production data workflows Familiarity with data warehousing concepts and modelling patterns Experience working with cloud platforms ...

present data science concepts to non-technical audiences Desirable: Familiarity with modern data platforms including data lakes, lakehouses and workflow orchestration tools such as Dagster and dbt Knowledge of the property and casualty insurance industry including claims, underwriting, fraud detection or risk assessment Relevant AWS certifications such ...

technical stakeholders to the right data solutions Familiarity with using AI tools to accelerate your workflow Nice to Have Experience with orchestration tools like Dagster, Airflow, or similar Experience building real-time or near-real-time data pipelines Familiarity with machine learning workflows and feature engineering Experience embedded ...

metrics layers. Experience applying AI to Analytics Engineering workflows or developing AI-ready data products. Knowledge of orchestration and ingestion tools such as Airflow, Dagster or Fivetran. Python experience for automation or data engineering tasks. Experience working in regulated financial services or another highly data-driven organisation. Snowflake experience ...

just individual pipelinesExperience designing and operating production data platforms across cloud infrastructure, orchestration, ingestion and SQL transformation layersPractical experience with GCP, BigQuery, Terraform, Kubernetes, Dagster, dlt and dbt - or equivalent tools with the ability to articulate transferable reasoningDemonstrated ability to make and document architecture decisions that involve meaningful trade ...

Model and manage data across data warehouses and lakes and operational databases Build batch and streaming workflows, orchestrated with tools such as Airflow, Prefect, Dagster, or dbt Own data quality, validation, lineage, and observability ensuring the data feeding our models is accurate, timely, and trustworthy Engineer features and datasets … Technical Skills Python (essential) – pandas, NumPy, and the modern data/ML ecosystem SQL – advanced querying, modelling, and optimisation Data pipelines & orchestration – Airflow, Prefect, Dagster, or dbt Data warehouses/lakes – BigQuery, Snowflake, Redshift, or Databricks ML frameworks – PyTorch, TensorFlow, or scikit‐learn LLM & AI tooling – OpenAI, Anthropic; LangChain ...

experience with times series data, they use TimescaleDB but other experience with similar platforms is fine You have experience with Orchestration platforms such as Dagster or Airflow You're collaborative with great communication skills What's in it for you: Salary to £120k + bonus X3 weeks per year ...

unfamiliar logic into clean, intuitive data models without hand-holding Bonus Experience with ClickHouse or columnar databases Familiarity with cloud-based data orchestration tools (Dagster, Step Functions) CI/CD practices for data pipelines and transformations Experience operating databases at scale in a production environment Competitive salary ...

would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic and transparency of underlying code Owned a project across a whole software product ...

have experience with times series data, they use TimescaleDB but other experience with similar platforms is fineYou have experience with Orchestration platforms such as Dagster or AirflowYou're collaborative with great communication skillsWhat's in it for you:Salary to 120k + bonusX3 weeks per year work anywhere25 days ...