2 of 2 Remote/Hybrid Dagster Jobs in West Lothian

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo’s data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering workflows - code ...

build and why. You'll own the full lifecycle of key Python integrations, driving architecture, performance, and feature direction across: Orchestration Platforms: Apache Airflow, Dagster, Prefect Transformation Tools: dbt, SQLMesh AI & LLM Ecosystem: LangChain, LlamaIndex, n8n, and broader AI tooling: embedding pipelines, retrieval-augmented generation with ClickHouse … ClickHouse's Python connector and SDK ecosystem, raising the bar on performance, reliability, and API design Build and maintain integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt) to enterprise-grade quality standards Drive the AI/LLM integration strategy: designing connectors and patterns that make ClickHouse ...