1 to 25 of 43 Remote/Hybrid Dagster Jobs in the UK

clearance as a condition of employment. Nice to have Experience with distributed data processing or streaming tools (e.g. Spark, Kafka) Workflow orchestration (e.g. Airflow, Dagster or similar) Working with LLMs, vector databases, embeddings or RAG patterns MLOps practices: model versioning, deployment and monitoring Containers and infrastructure as code (e.g. ...

looking for Advanced SQL, including writing complex queries, partitioning, clustering and cost-aware query optimisation . Experience of modern orchestration/ELT tooling, ideally Dagster and dbt. Strong Python for data engineering Solid understanding of data warehousing techniques; ETL/ELT processes and dimensional modelling. Experience designing data models ...

relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL.* **Orchestration** Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect.* **Data Quality and Lineage** Familiarity with tools and techniques for data testing, documentation and lineage. Examples include Great Expectations or dbt. ...

batch and streaming data pipelines using SQL, Python, PySpark, and Delta Lake. Familiarity with dbt for data transformations and orchestration tools such as Airflow, Dagster, or Prefect. Experience designing and delivering secure, resilient API, webhook, and event‐driven integrations. Strong understanding of engineering practices, including version control, CI/ ...

Databases: Experience with high-dimensional data retrieval using Milvus, Weaviate, or Pinecone (essential for RAG architectures). Data Orchestration: Familiarity with Airflow, Prefect, or Dagster for managing complex data movement and model training pipelines. Search & Discovery: Advanced ElasticSearch/OpenSearch for semantic search and large-scale indexing. AI Frameworks ...

Databases: Experience with high-dimensional data retrieval using Milvus, Weaviate, or Pinecone (essential for RAG architectures). Data Orchestration: Familiarity with Airflow, Prefect, or Dagster for managing complex data movement and model training pipelines. Search & Discovery: Advanced ElasticSearch/OpenSearch for semantic search and large-scale indexing. AI Frameworks ...

/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB, EMR, Athena) Hands-on experience with orchestration and workflow tools (Docker, Kubernetes, Airflow, Prefect, Dagster) Familiar with CI/CD pipelines, infrastructure as code, and DBT Able to explain complex data concepts clearly to non-technical stakeholders Why This Role Matters ...

next. Cloud: AWS, GCP, Azure Ingestion: Fivetran, Airbyte, ... Warehouse and lakehouse: Snowflake, Databricks, BigQuery, Microsoft Fabric Transformation: dbt Orchestration: Airflow, Dagster, Prefect, ... BI and semantic layers: Power BI, Looker, Tableau, ... Activation and CDPs: Hightouch, Census, Segment, ... Nice to have Building the data side of agentic ...

knowledge of data governance and privacy obligations, including GDPR Experience ensuring analytics outputs are accurate, documented, and appropriately controlled Valuable Extras Analytics engineering practice: Dagster, version control, CI/CD, and automated testing Experience with cloud data platforms, such as Snowflake or BigQuery Group Personal Pension Plan – 8% employer ...

knowledge of data governance and privacy obligations, including GDPR Experience ensuring analytics outputs are accurate, documented, and appropriately controlled Valuable Extras Analytics engineering practice: Dagster, version control, CI/CD, and automated testing Experience with cloud data platforms, such as Snowflake or BigQuery Group Personal Pension Plan – 8% employer ...

Clear communication skills, with the ability to translate business requirements into technical solutions. Technology Environment The wider stack includes Snowflake, dbt, SQL, Python, Fivetran, Dagster, Metaplane and Tableau, alongside AWS, Terraform and GitHub. You don't need experience with every tool listed. Strong SQL, commercial dbt experience and relevant ...

agreed timelines Clear, concise communication and confidence building relationships with business stakeholders Nice to have ETL or ELT pipeline design, including orchestration with Dagster and transformation with dbt Snowflake Cortex, including Agents, Search and LLM integration Experience building AI powered applications and conversational interfaces Azure App Service, authentication ...

comes with tests, and you leave things tidier than you found them. Depth in at least one of SQL, Spark, Databricks/Delta Lake, Dagster/Airflow/Temporal or dbt. Bonus if you’ve shaped any of them into something a model can query, through a metrics layer ...

hands‐on experience in at least one data area and one platform area below. Data experience Orchestration: operating pipelines with tools such as Airflow, Dagster or Prefect, including dependencies, retries, backfills, reruns or schema changes. Storage and modelling: designing schemas and storage for relational databases, warehouses or lakehouses ...

comes with tests, and you leave things tidier than you found them. Depth in at least one of SQL, Spark, Databricks/Delta Lake, Dagster/Airflow/Temporal or dbt. Bonus if you've shaped any of them into something a model can query, through a metrics layer ...

would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic and transparency of underlying code Owned a project across a whole software product ...

just training models in notebooks), including familiarity with serving patterns (e.g., REST APIs, batch inference, event-driven) Experience with orchestration tools (e.g., Airflow, Dagster) and cloud-native ML platforms (e.g., AWS SageMaker, GCP Vertex AI) Ability to influence decision-making regarding infrastructure and tooling, balancing 'build vs. buy' discussions ...

analytics - ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with product ...

analytics - ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with product ...

collaborating with Product, Analytics and Engineering in a fully remote UK setup. You will build scalable pipelines in Python and SQL, leverage Snowflake, dbt, Dagster or Airflow, and AWS, and contribute to data quality and monitoring. Startup/scale-up experience is a plus. #J-18808-Ljbffr ...

data engineering experience with Spark, strong Python and SQL, extensive AWS services, and hands-on experience with orchestration tools (Docker, Kubernetes, Airflow, Prefect, Dagster). Hybrid work model in London. #J-18808-Ljbffr ...

Experience required: Strong SQL skills for transforming, cleaning and loading data Commercial Python, PySpark and Pandas experience Experience with orchestration tools such as Airflow, Dagster or Celery Practical experience with Spark and EMRHands-on knowledge of AWS services, including Lambda, RDS and S3 Experience using Claude Code as part ...

code Grasps new business domains quickly, translating unfamiliar logic into clean, intuitive data models Bonus: ClickHouse or columnar databases; cloud-based data orchestration (Dagster, Step Functions); CI/CD for data pipelines and transformations; operating databases at scale in production Competitive salary and eligibility for equity Biannual bonus scheme ...

e.g. AWS, GCP or Azure) Comfortable working in a Linux environment Nice to have: Advanced data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit ...

e.g. AWS, GCP or Azure) Comfortable working in a Linux environment Nice to have: Advanced data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit ...