systems. Experience with Amazon Web Services cloud platform or another cloud platform. Proven work experience with containerization and orchestration tools such as Docker, Airflow, Prefect and Kubernetes. Knowledge of cybersecurity best practices. Excellent communication and collaboration skills. Ability to work effectively in a fast-paced and dynamic environment. Self-discipline More ❯
or multiple systems. You know how to create repeatable and reusable products. Experience with workflow management tools such as Nextflow, WDL/Cromwell, Airflow, Prefect and Dagster Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows and pipelines Understanding of common data transformation and storage formats, e.g. More ❯
the travel industry Experience designing and analysing large-scale A/B test experiments Mastery of workflow orchestration technologies such as Airflow, Dagster or Prefect Expert knowledge of technologies such as: Google Cloud Platform, particularly Vertex AI Docker and Kubernetes Infrastructure as Code Experience establishing data science best practices across More ❯
industry. Conducted and analysed large scale A/B experiments Experience mentoring team members Experience with workflow orchestration technologies such as Airflow, Dagster or Prefect Experience with technologies such as: Google Cloud Platform, particularly Vertex AI Docker and Kubernetes Perks of joining us: Company pension contributions at 5% Individualised training More ❯
industry. Conducted and analysed large scale A/B experiments Experience mentoring team members Experience with workflow orchestration technologies such as Airflow, Dagster or Prefect Experience with technologies such as: Google Cloud Platform, particularly Vertex AI Docker and Kubernetes Perks of joining us: Company pension contributions at 5% Individualised training More ❯
of common data transformation and storage formats, e.g. Apache Parquet. Good understanding of cloud environments (ideally Azure), and workflow management systems (e.g. Dagster, Airflow, Prefect). Follow best practices like code review, clean code and unit tests. Familiar with version control and Git/GitHub. Understanding of containerisation (e.g. Docker More ❯
Bath, Somerset, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions Ltd
skills across: Python Python Frameworks (NumPy, Django, etc) Writing and implementing Code Testing Quality assurance Software tool deployment AWS (Lambda, AWS integrations etc) Metaflow & Prefect Key will be working with Raster Data This will be a 9 month contract Outside of IR35 paying £450 a day. The client is based More ❯
skills across: Python Python Frameworks (NumPy, Django, etc) Writing and implementing Code Testing Quality assurance Software tool deployment AWS (Lambda, AWS integrations etc) Metaflow & Prefect Key will be working with Raster Data This will be a 9 month contract Outside of IR35 paying £450 a day. The client is based More ❯
ensure scalable, efficient deployments Required Expertise Proven experience deploying ML models in production environments Experience having used ML pipeline orchestration tools, like Airflow, Metaflow, Prefect, Dagster, BentoML - Essential* Advanced skills in AWS SageMaker , cloud-based ML infrastructure Expert-level understanding of time series data modeling Proficiency in containerization (Docker) Strong More ❯
Design and implement complex data pipelines and architectures. Utilising dbt and Prefect to automate and run your data pipelines. Collaborate with cross-functional teams to align data engineering efforts. Engaging with clients to identify available data and help them achieve business goals. Key Candidate Requirements Knowledge Advanced proficiency in programming More ❯
in venture capital. What We're Looking For Technical Excellence: Deep expertise in Python, React, and modern data technologies (e.g., BigQuery/GCP, dbt, Prefect, OpenAI, LookML/Looker, Glean). Proven Track Record: A history of building complex data products that drive business value, ideally in financial services, investment More ❯
in venture capital. What We're Looking For Technical Excellence: Deep expertise in Python, React, and modern data technologies (e.g., BigQuery/GCP, dbt, Prefect, OpenAI, LookML/Looker, Glean). Proven Track Record: A history of building complex data products that drive business value, ideally in financial services, investment More ❯
control Setting up monitoring and alerting frameworks to track model drift, data quality, and inference health Leveraging orchestration tools such as Dagster, Airflow, or Prefect to manage and scale ML workflows Supporting ongoing infrastructure migration or optimisation initiatives (e.g. improving cost efficiency, latency, or reliability) Partnering with product and engineering … on AWS , using services like ECS, EKS, Fargate, Lambda, S3, and more Familiarity with orchestration and workflow scheduling tools such as Dagster , Airflow , or Prefect Knowledge of CI/CD best practices and tools (e.g. GitHub Actions, Jenkins, CodePipeline) Exposure to monitoring and observability tools for ML systems (e.g. Prometheus More ❯
DroneDeploy). Develop and manage PostgreSQL-backed data layers and Azure-based file/media storage systems. Build and maintain async workflows using Redis, Prefect, and task queues. Contribute to architecture decisions and CI/CD processes for feature delivery and monitoring. Requirements: Proficiency in Python (Django) and JavaScript/… NGINX , and PostgreSQL . Familiarity with Kubernetes , Redis , cloud platforms (preferably Microsoft Azure), and containerized deployments. Understanding of asynchronous task systems (e.g., Celery or Prefect). Strong grasp of software architecture principles and performance optimization. Desirable skills: Experience with IoT data systems. Prior work with GIS/mapping interfaces or More ❯
the storing and processing of most of our data. You will work with other Data Engineers using tools such as Python, SQL, Airflow and Prefect to ensure quality and collaborate with other teams across the business. What you'll be working on: Implementing and supporting ETLs and Data Quality monitors … should apply if you have: 3+ years of data engineering, analytics or machine learning experience Advanced skills in Python and SQL Experience with Airflow, Prefect or other task orchestration tools Familiarity with modern data stack - you know the current trends and what tools to use for the job A proactive More ❯
