AWS, Azure, GCP) Experience building ETL/ELT pipelines specifically using DBT for structured and semi-structured datasets Any orchestration toolings such as Airflow, Dagster, Azure Data Factory, Fivetran etc It will be nice to have: Software engineering background Exposure to building or deploying AI/ML models into More ❯
preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the More ❯
experience with ETL/ELT pipelines using dbt Hands-on experience with cloud platforms (AWS, Azure, or GCP) Familiarity with orchestration tools like Airflow, Dagster, or Azure Data Factory Desirable Skills Background in software engineering or DevOps practices (CI/CD, version control, testing) Experience with streaming technologies (e.g. More ❯
systems. You know how to create repeatable and reusable products. Experience with workflow management tools such as Nextflow, WDL/Cromwell, Airflow, Prefect and Dagster Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows and pipelines Understanding of common data transformation and storage formats, e.g. Apache More ❯
orchestration, evidenced by a thorough understanding of methodologies and significant hands-on experience using dbt, complemented by practical experience with orchestration tools such as Dagster or Airflow. Have a proven track record of successful semantic layer implementation, showcasing experience in the end-to-end implementation and management of a More ❯
global data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to handle structured and unstructured data. Implement ETL/ELT pipelines using Dagster, Airflow, or similar tools. Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development & DevOps: Strong programming and More ❯
retail, or the travel industry Experience designing and analysing large-scale A/B test experiments Mastery of workflow orchestration technologies such as Airflow, Dagster or Prefect Expert knowledge of technologies such as: Google Cloud Platform, particularly Vertex AI Docker and Kubernetes Infrastructure as Code Experience establishing data science More ❯
pipeline) About you: Strong Python Experience building complex data transformation pipelines Experience with Databricks at scale, preferably experience with Iceberg Experience with Airflow or dagster Experience with AWS & open source technologies on top of dataweave Desirable - Medical data exposure is useful but video/image data, not just tabular More ❯
that the list isn’t very long - as a founding engineer you will have the opportunity to shape the technology we use. Python AWS Dagster SQL DBT MLflow ML (LLM, RAG, etc.) Why Join Maiven? Work with Purpose: Tackle one of the most critical issues of our time - climate More ❯
the travel industry. Conducted and analysed large scale A/B experiments Experience mentoring team members Experience with workflow orchestration technologies such as Airflow, Dagster or Prefect Experience with technologies such as: Google Cloud Platform, particularly Vertex AI Docker and Kubernetes Perks of joining us: Company pension contributions at More ❯
the travel industry. Conducted and analysed large scale A/B experiments Experience mentoring team members Experience with workflow orchestration technologies such as Airflow, Dagster or Prefect Experience with technologies such as: Google Cloud Platform, particularly Vertex AI Docker and Kubernetes Perks of joining us: Company pension contributions at More ❯
Responsibilities Build the pipelines that put Freetrade's data to work, deploying jobs into our Kubernetes cluster, writing Python code to orchestrate them in Dagster, and modelling the data in our BigQuery data warehouse. Evolve our testing, alerting and quality monitoring capabilities to continuously improve the trust of our More ❯
agency to choose and work with the technologies you love. Our tech stack includes: Infra & monitoring: AWS (ECS, RDS, Elasticache, Lambda, etc.), Tinybird, Modal, Dagster, Langsmith, Datadog, Sentry, Incident.io. Languages & Frameworks: Typescript (Node.js), NestJS, Rails, React, Svelte. Other day-to-day Tools: Postman, Notion, Slack, Jira, Github, and more. More ❯
Are you passionate about revolutionising engineering with AI? Here at Monolith AI we're on a mission to empower engineers to use AI to solve even their most intractable physics problems. We've doubled in size over the last four More ❯
and Generative AI, including Large Language Models (LLMs). You’ll have proven experience developing AWS Cloud platforms end to end, orchestrating data using Dagster or similar as well as coding in Python and SQL. This is an exciting opportunity for someone looking to challenge themselves in a collaborative … Strong SQL skills for data transformation, cleaning, and loading. Strong coding experience with Python and Pandas. Experience of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc. Build processes supporting data transformation, data structures, metadata, dependency and workload management. Experience supporting and working with cross-functional teams in More ❯
and robust version control Setting up monitoring and alerting frameworks to track model drift, data quality, and inference health Leveraging orchestration tools such as Dagster, Airflow, or Prefect to manage and scale ML workflows Supporting ongoing infrastructure migration or optimisation initiatives (e.g. improving cost efficiency, latency, or reliability) Partnering … ML deployment , particularly on AWS , using services like ECS, EKS, Fargate, Lambda, S3, and more Familiarity with orchestration and workflow scheduling tools such as Dagster , Airflow , or Prefect Knowledge of CI/CD best practices and tools (e.g. GitHub Actions, Jenkins, CodePipeline) Exposure to monitoring and observability tools for More ❯
