1 to 25 of 54 Dagster Jobs in London

e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle development, including extensive experience with workflow orchestration tools (e.g., Apache Airflow, Dagster). Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg). Advanced ...

experience using Python and/or other modern programming languages. Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling. Solid understanding of data lakehouse, warehouse, and medallion architecture patterns. Experience applying DevOps and DataOps best practices including ...

looking for Advanced SQL, including writing complex queries, partitioning, clustering and cost-aware query optimisation . Experience of modern orchestration/ELT tooling, ideally Dagster and dbt. Strong Python for data engineering Solid understanding of data warehousing techniques; ETL/ELT processes and dimensional modelling. Experience designing data models ...

/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB, EMR, Athena) Hands-on experience with orchestration and workflow tools (Docker, Kubernetes, Airflow, Prefect, Dagster) Familiar with CI/CD pipelines, infrastructure as code, and DBT Able to explain complex data concepts clearly to non-technical stakeholders Why This Role Matters ...

data pipelines at scale Experience with a modern data stack (e.g. Snowflake, dbt, Fivetran, Debezium or similar) Experience with orchestration tools such as Airflow, Dagster or Prefect Proficiency in Python for building production data workflows Familiarity with data warehousing concepts and modelling patterns Experience working with cloud platforms ...

next. Cloud: AWS, GCP, Azure Ingestion: Fivetran, Airbyte, ... Warehouse and lakehouse: Snowflake, Databricks, BigQuery, Microsoft Fabric Transformation: dbt Orchestration: Airflow, Dagster, Prefect, ... BI and semantic layers: Power BI, Looker, Tableau, ... Activation and CDPs: Hightouch, Census, Segment, ... Nice to have Building the data side of agentic ...

technical stakeholders to the right data solutions Familiarity with using AI tools to accelerate your workflow Nice to Have: Experience with orchestration tools like Dagster, Airflow, or similar Experience building real-time or near-real-time data pipelines Familiarity with machine learning workflows and feature engineering Experience embedded ...

Clear communication skills, with the ability to translate business requirements into technical solutions. Technology Environment The wider stack includes Snowflake, dbt, SQL, Python, Fivetran, Dagster, Metaplane and Tableau, alongside AWS, Terraform and GitHub. You don't need experience with every tool listed. Strong SQL, commercial dbt experience and relevant ...

agreed timelines Clear, concise communication and confidence building relationships with business stakeholders Nice to have ETL or ELT pipeline design, including orchestration with Dagster and transformation with dbt Snowflake Cortex, including Agents, Search and LLM integration Experience building AI powered applications and conversational interfaces Azure App Service, authentication ...

Postgres plus a warehouse or analytics store such as BigQuery or ClickHouse. Experience with streaming (Kafka, Pub/Sub or similar) and orchestration (Airflow, Dagster or similar). Data modelling for audit trails, lineage and multi-tenant isolation. Security-minded handling of sensitive data. Nice to have Data work ...

comes with tests, and you leave things tidier than you found them. Depth in at least one of SQL, Spark, Databricks/Delta Lake, Dagster/Airflow/Temporal or dbt. Bonus if you’ve shaped any of them into something a model can query, through a metrics layer ...

hands‐on experience in at least one data area and one platform area below. Data experience Orchestration: operating pipelines with tools such as Airflow, Dagster or Prefect, including dependencies, retries, backfills, reruns or schema changes. Storage and modelling: designing schemas and storage for relational databases, warehouses or lakehouses ...

comes with tests, and you leave things tidier than you found them. Depth in at least one of SQL, Spark, Databricks/Delta Lake, Dagster/Airflow/Temporal or dbt. Bonus if you've shaped any of them into something a model can query, through a metrics layer ...

deliver outcomesStrong commercial awareness, including experience contributing to scoping, estimation and proposal developmentNice to haveSnowflake ecosystem experience with tools such as dbt, Airflow/Dagster, Matillion/Fivetran, Kafka/Kinesis/Event Hubs or similarExperience with Snowflake capabilities such as Snowpark, Streams & Tasks, Dynamic Tables, Data Sharing ...

would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic and transparency of underlying code Owned a project across a whole software product ...

just training models in notebooks), including familiarity with serving patterns (e.g., REST APIs, batch inference, event-driven) Experience with orchestration tools (e.g., Airflow, Dagster) and cloud-native ML platforms (e.g., AWS SageMaker, GCP Vertex AI) Ability to influence decision-making regarding infrastructure and tooling, balancing 'build vs. buy' discussions ...

data engineering experience with Spark, strong Python and SQL, extensive AWS services, and hands-on experience with orchestration tools (Docker, Kubernetes, Airflow, Prefect, Dagster). Hybrid work model in London. #J-18808-Ljbffr ...

Experience required: Strong SQL skills for transforming, cleaning and loading data Commercial Python, PySpark and Pandas experience Experience with orchestration tools such as Airflow, Dagster or Celery Practical experience with Spark and EMRHands-on knowledge of AWS services, including Lambda, RDS and S3 Experience using Claude Code as part ...

code Grasps new business domains quickly, translating unfamiliar logic into clean, intuitive data models Bonus: ClickHouse or columnar databases; cloud-based data orchestration (Dagster, Step Functions); CI/CD for data pipelines and transformations; operating databases at scale in production Competitive salary and eligibility for equity Biannual bonus scheme ...

e.g. AWS, GCP or Azure) Comfortable working in a Linux environment Nice to have: Advanced data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit ...

e.g. AWS, GCP or Azure) Comfortable working in a Linux environment Nice to have: Advanced data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit ...

experience working with core data science libraries (e.g. pandas/polars, scikit-learn) Familiar with cloud platforms (e.g. AWS) and orchestration tools (e.g. Airflow, Dagster) in relation to operationalising data science products Experience leveraging Snowflake ML and robust data pipelines to deliver scalable, production-ready data science solutions ...

experience with times series data, they use TimescaleDB but other experience with similar platforms is fine You have experience with Orchestration platforms such as Dagster or Airflow You're collaborative with great communication skills What's in it for you: Salary to £85k + bonus X3 weeks per year ...

with tools such as Looker, Tableau or Power BI Hands-on experience with dbt and Airflow Preferred Other pipeline and orchestration tools such as Dagster or Prefect, or in-house equivalents, will also be considered Experience building predictive models A background in a fintech, neobank, payments business or product ...

similar databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph–based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning ...