4 of 4 Permanent Dagster Jobs in Yorkshire

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo’s data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering workflows - code ...

shape how data engineering is done as the team scales. You will: Design, build, and maintain scalable data pipelines using Python, SQL, Snowflake, Dagster, dbt, and AWS. Own end to end data engineering projects from ingestion through to analytics enablement. Develop and optimise reliable SQL based data models. Help … engineering habits. Is highly capable with Python and SQL in real data engineering environments. Has experience with modern data tooling such as Snowflake, dbt, Dagster, Airflow, AWS, or similar. Understands data modelling principles and can apply them pragmatically. Cares about testing, monitoring, alerting, and data quality. Thrives ...

build and why. You'll own the full lifecycle of key Python integrations, driving architecture, performance, and feature direction across: Orchestration Platforms: Apache Airflow, Dagster, Prefect Transformation Tools: dbt, SQLMesh AI & LLM Ecosystem: LangChain, LlamaIndex, n8n, and broader AI tooling: embedding pipelines, retrieval-augmented generation with ClickHouse … ClickHouse's Python connector and SDK ecosystem, raising the bar on performance, reliability, and API design Build and maintain integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt) to enterprise-grade quality standards Drive the AI/LLM integration strategy: designing connectors and patterns that make ClickHouse ...

ingesting, transforming, and storing large volumes of data. Implement scalable, fault-tolerant systems using modern frameworks such as Spark, Temporal, Airflow o r Dagster . Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing workflows using tools such as Apache … Spark SQL preferred); experience with distributed data processing frameworks such as Spark, Flink, or Beam. Familiarity with orchestration frameworks (e.g., Airflow, Temporal, Dagster ) and workflow automation principles. Experience with cloud platforms (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes). Exposure to batch and streaming architectures and understanding ...