51 to 71 of 71 Dagster Jobs in London

Index construction and classification taxonomies. Working with model-derived inputs, understanding that NLP-generated exposures carry measurement error and revise over time. Task orchestration (Dagster or Airflow) and S3-based data flows. AWS fluency and CI/CD discipline. Competitive salary plus EMI share options 25 days holiday + ...

Multi threading Profiling Python/C/C++ and performance optimisation Networking Nice to have: Data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit ...

machine-learned graphics subsystems into the simulation platform Implement production quality software in Python About you Essential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applications Excellent development skills in Python Deep knowledge of Kubernetes at the user level Good sense ...

deployment experience. Experience building self-serve ML platforms or tools for non-expert users. Experience with lakeFS , DVC , MLflow , Weights & Biases , Kubernetes, Kubeflow, Flyte, Dagster, Airflow, or Argo. LLM application, context engineering, structured output, or LLM evaluation experience. Exposure to radar, AIS, EO/IR fusion, tracking, sensor fusion ...

optimised for analytics and scalability. Use Terraform and Infrastructure as Code (IaC) to automate deployments and manage cloud resources. Orchestrate workflows with Airflow or Dagster, ensuring reliability and visibility across data pipelines. Implement best practices in data governance, monitoring, and data quality. Collaborate with analytics, product, and engineering teams … building reliable, scalable data systems and enabling smarter business decisions, we’d love to hear from you. Keywords: SQL/BigQuery/Airflow/Dagster/Terraform/IAC/DataOps/Infrastructure/Platform Engineer/Data Engineer ...

Reality is a Series-A startup building a BIM Platform to transform construction. You will design, develop, and maintain Python-based data pipelines using Dagster, optimize data models, and craft SQL for pipelines and APIs. The role requires strong Python, SQL, and data modeling skills, with collaboration across cloud ...

communication and influencing skills, with experience mentoring senior engineers and aligning multiple technical teams. Desirable Experience with workflow-orchestration technologies such as Flyte, Airflow, Dagster or Argo. Experience building large-scale batch-inference or ML-platform systems, including model deployment and model registries. Knowledge of Spark, Databricks ...

Strong communication and influencing skills, with experience mentoring senior engineers and aligning multiple technical teams. DesirableExperience with workflow-orchestration technologies such as Flyte, Airflow, Dagster or Argo. Experience building large-scale batch-inference or ML-platform systems, including model deployment and model registries. Knowledge of Spark, Databricks ...

drive reliable ingestion, modelling, and orchestration to support data-driven features for customers globally. You will design dbt models and semantic layers, own Dagster orchestration, onboard new data sources at scale, and advance self-serve analytics with agentic workflows and #J-18808-Ljbffr ...

support of an AI agent to crunch data and help refine the AI agent for better outputs Get familiar with an orchestration tool (Dagster) to schedule data extraction and transformation Organise and structure raw data from a variety of sources Work with teams across the business to understand their ...

description. Nice to Have Experience with biological data: genomic sequences, protein structures, molecular data, or similar. Familiarity with our broader tech stack: Kubernetes, Dagster, or similar orchestration and infrastructure tools. Contributions to open-source ML frameworks or research codebases. Publications at major venues (e.g., NeurIPS, ICML, ICLR, or JMLR ...

inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink … data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting disparate ...

what. Better Collective runs a hub and spoke data organisation. A central data platform team owns the platform itself - MotherDuck, dbt, Dagster, DLT, the golden paths, the standards, the infrastructure. Paid Media Insights is a domain team, a spoke, that builds on it. The split is deliberate … think in tables. You are technically deep where it counts. Production pipelines in SQL and Python, modelling and orchestration tooling such as dbt and Dagster, cloud data warehousing, and a real feel for performance, cost and reliability at scale. Experience with paid media or attribution data, or with machine ...

freshness and coverage. Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling. Build and maintain data orchestration workflows using Dagster or similar. Develop internal QA and investigation tools to improve how data issues are identified and resolved. Use Python, SQL, dbt and BigQuery … Playwright or an equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial ...

improve production web scraping infrastructure (Playwright, proxy management, anti-bot handling) and keep scraper health visible and actionable Build and maintain data orchestration workflows (Dagster or similar) that are reliable and easy to debug Develop fast, pragmatic internal QA tools - using AI-assisted coding tools like Claude Code … evasion, and monitoring scraper health A fast, pragmatic builder mindset, fluent with AI-assisted coding tools (e.g. Claude Code) Experience with a data orchestrator - Dagster ideally, or Airflow/Prefect Nice to have UK planning or property domain knowledge Time Off Rest properly. 37 days off in total, including ...

layer, and quality standards the data function depends on, with the validation and lineage to make them trustworthy downstream. Own orchestration and observability in Dagster, and onboarding new sources in a way that scales. Innovate on self-serve and AI-enabled analytics, from semantic models and agentic workflows … Deep, hands-on Snowflake and dbt experience: modelling, semantic layers, agents & skills, testing, performance and cost tuning. Production experience with a pipeline orchestrator, ideally Dagster (or similar Airflow, Prefect), including dependent workloads, partial failures, and observability. Modern cloud infrastructure (Azure/AWS/GCP) and Kubernetes experience deploying ...

multiple billions of dollars under management. As a Senior Data Engineer you'll build and optimise reliable data pipelines and integrations using Python, SQL, Dagster, Snowflake, DBT and C#, while leveraging agentic AI tooling to accelerate delivery. You'll play a key role in shaping a new Snowflake based … data modelling, ELT pipelines and data integrationYou can code with Python and/or C#You have experience within a finance environmentYou're familiar with Dagster and DBTYou're collaborative and pragmatic, comfortable working directly with stakeholders and data users to understand problems and deliver effective solutionsYou have experience ...

with cloud‐based ML tools (e.g., SageMaker), data and model versioning (e.g., DVC), CI/CD (e.g., GitHub Actions), workflow orchestration (e.g., Airflow/Dagster) and containerised solutions (e.g., Docker, ECS) nice to have Experience in code testing (unit, integration, end‐to‐end tests) Strong data engineering skills … that follow software best‐practices (in Python) Implement integrations between the core algorithm (machine‐learning or optimisation) and a workflow orchestration paradigm such as Dagster Implement software in a cloud‐based deployment pipeline with Continuous Integration/Continuous Deployment (CI/CD) principles Build logging, error handling, and automated ...

infrastructure that powers a suite of AI and machine learning services. Design, build, and maintain production-grade ML orchestration pipelines using tools such as Dagster, Airflow, Prefect, or similar technologies. Deploy, monitor, and scale machine learning models and LLM-powered solutions in production environments. Build and maintain cloud-native … will have: Strong commercial experience in Python software engineering. Experience deploying and managing machine learning infrastructure in production. Knowledge of orchestration tools such as Dagster, Airflow, Prefect, or similar. Hands-on experience with Kubernetes and containerised workloads. Expertise in Infrastructure as Code using Terraform, Bicep, Pulumi, or comparable technologies. ...

pipelines, electronics, embedded software and hardware, mechanical design and manufacturing, AI and computer vision, and data science. Задачи Design, develop, and maintain Python-based Dagster data pipelines Design and implement efficient data models for planned product features and application requirements Develop SQL queries and procedures for data pipelines … related field, or equivalent proven experience in database and data pipeline development Hands-on experience with code-driven orchestration tools such as Dagster or Airflow Solid experience with relational databases and SQL, preferably PostgreSQL Strong Python and OOP skills Experience modelling data for transactional and analytical systems Strong debugging ...

GitHub Actions and strengthening development tooling. Advising on securing APIs and other high‐risk system components. Assisting with securing our Data Platforms including Databricks, Dagster, Snowflake and the wider cloud environment. Developing security policy as code using OPA or similar and gaining adoption across teams. Documenting security processes … ideally AKS, along with broader container security. Experience of securing APIs and other exposed components. Ideally experience in securing data platforms such as Databricks, Dagster or Snowflake. Experience working directly with software engineering best practices including source control, unit testing, code reviews, design documentation and strong debugging and troubleshooting. ...