or multiple systems. You know how to create repeatable and reusable products. Experience with workflow management tools such as Nextflow, WDL/Cromwell, Airflow, Prefect and Dagster Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows and pipelines Understanding of common data transformation and storage formats, e.g. More ❯
industry. Conducted and analysed large scale A/B experiments Experience mentoring team members Experience with workflow orchestration technologies such as Airflow, Dagster or Prefect Experience with technologies such as: Google Cloud Platform, particularly Vertex AI Docker and Kubernetes Perks of joining us: Company pension contributions at 5% Individualised training More ❯
of common data transformation and storage formats, e.g. Apache Parquet. Good understanding of cloud environments (ideally Azure), and workflow management systems (e.g. Dagster, Airflow, Prefect). Follow best practices like code review, clean code and unit tests. Familiar with version control and Git/GitHub. Understanding of containerisation (e.g. Docker More ❯
Bath, Somerset, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions Ltd
skills across: Python Python Frameworks (NumPy, Django, etc) Writing and implementing Code Testing Quality assurance Software tool deployment AWS (Lambda, AWS integrations etc) Metaflow & Prefect Key will be working with Raster Data This will be a 9 month contract Outside of IR35 paying £450 a day. The client is based More ❯
ensure scalable, efficient deployments Required Expertise Proven experience deploying ML models in production environments Experience having used ML pipeline orchestration tools, like Airflow, Metaflow, Prefect, Dagster, BentoML - Essential* Advanced skills in AWS SageMaker , cloud-based ML infrastructure Expert-level understanding of time series data modeling Proficiency in containerization (Docker) Strong More ❯
control Setting up monitoring and alerting frameworks to track model drift, data quality, and inference health Leveraging orchestration tools such as Dagster, Airflow, or Prefect to manage and scale ML workflows Supporting ongoing infrastructure migration or optimisation initiatives (e.g. improving cost efficiency, latency, or reliability) Partnering with product and engineering … on AWS , using services like ECS, EKS, Fargate, Lambda, S3, and more Familiarity with orchestration and workflow scheduling tools such as Dagster , Airflow , or Prefect Knowledge of CI/CD best practices and tools (e.g. GitHub Actions, Jenkins, CodePipeline) Exposure to monitoring and observability tools for ML systems (e.g. Prometheus More ❯
DroneDeploy). Develop and manage PostgreSQL-backed data layers and Azure-based file/media storage systems. Build and maintain async workflows using Redis, Prefect, and task queues. Contribute to architecture decisions and CI/CD processes for feature delivery and monitoring. Requirements: Proficiency in Python (Django) and JavaScript/… NGINX , and PostgreSQL . Familiarity with Kubernetes , Redis , cloud platforms (preferably Microsoft Azure), and containerized deployments. Understanding of asynchronous task systems (e.g., Celery or Prefect). Strong grasp of software architecture principles and performance optimization. Desirable skills: Experience with IoT data systems. Prior work with GIS/mapping interfaces or More ❯
Southmoor, Oxfordshire, United Kingdom Hybrid / WFH Options
Mars Recruitment
DroneDeploy). Develop and manage PostgreSQL-backed data layers and Azure-based file/media storage systems. Build and maintain async workflows using Redis, Prefect, and task queues. Contribute to architecture decisions and CI/CD processes for feature delivery and monitoring. Requirements: Proficiency in Python (Django) and JavaScript/… NGINX , and PostgreSQL . Familiarity with Kubernetes , Redis , cloud platforms (preferably Microsoft Azure), and containerized deployments. Understanding of asynchronous task systems (e.g., Celery or Prefect). Strong grasp of software architecture principles and performance optimization. Desirable skills: Experience with IoT data systems. Prior work with GIS/mapping interfaces or More ❯
Didcot, Abingdon, Oxfordshire, United Kingdom Hybrid / WFH Options
Mars Recruitment
DroneDeploy). Develop and manage PostgreSQL-backed data layers and Azure-based file/media storage systems. Build and maintain async workflows using Redis, Prefect, and task queues. Contribute to architecture decisions and CI/CD processes for feature delivery and monitoring. Requirements: Proficiency in Python (Django) and JavaScript/… NGINX , and PostgreSQL . Familiarity with Kubernetes , Redis , cloud platforms (preferably Microsoft Azure), and containerized deployments. Understanding of asynchronous task systems (e.g., Celery or Prefect). Strong grasp of software architecture principles and performance optimization. Desirable skills: Experience with IoT data systems. Prior work with GIS/mapping interfaces or More ❯