1 to 25 of 46 Prefect Jobs in the UK

Prefect builds and operates resilient, Pythonic orchestration and MCP platforms -- Prefect OSS , Prefect Cloud , FastMCP OSS, and Horizon -- used for mission-critical workloads. Our Vision: Prefect will define automation for the context era. Our Mission: Curate an intelligent context layer that delivers the right information at the right time. About … Prefect Prefect builds automation for an unpredictable world. The last decade of automation was about protecting workflows from unpredictability; in the agentic era, unpredictability is the point. Our mission is to give people confidence in automated work, whether that work is a mission-critical data pipeline or a fleet ...

Streaming technologies (Kafka, Kinesis, Flink, etc.) Containers and related services (Docker, Kubernetes, container Registries, etc) Data modelling approaches (Kimball, Imnon) Orchestration tools - Apache Airflow, Prefect or cloud-native tools Backend software development (Java, APIs, Scalability, Logging and Monitoring etc.) MLFlow and other MLOps/Machine Learning Engineering processes to support ...

columnar data formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Background in supply chain forecasting, enterprise AI, or retail analytics M.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

columnar data formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Background in supply chainforecasting, enterprise AI, or retail analytics M.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

Cloud Platform ecosystem, like Cloud Run, Cloud Functions, Cloud Storage, Pub/Sub, and Cloud Scheduler Data orchestration tools such as Cloud Composer (Airflow), Prefect, or equivalent Looker/Data Studio and “Conventional analytics” (aka. BQ agenta) Building or maintaining a data warehouse in a regulated or healthcare environment GDPR ...

Azure) and familiarity with containerization (Docker, Kubernetes). Familiarity with the modern data stack (e.g., Snowflake, Databricks) and workflow orchestrators (e.g., Airflow, Prefect). Knowledge of graph data technologies (Neo4j, TigerGraph) and their corresponding query languages. Exposure to machine learning applications, particularly in NLP or entity resolution. Experience ...

scale Experience with a modern data stack (e.g. Snowflake, dbt, Fivetran, Debezium or similar) Experience with orchestration tools such as Airflow, Dagster or Prefect Proficiency in Python for building production data workflows Familiarity with data warehousing concepts and modelling patterns Experience working with cloud platforms and infrastructure tooling Comfortable working ...

cloud data warehouse, including designing downstream data models Have used a cloud platform, ideally Azure, and orchestration tooling like Azure Data Factory, Airflow or Prefect Have a STEM or quantitative background and can engage confidently with researchers on modelling assumptions Can explain a technical problem to a non‐technical stakeholder ...

equivalent practical experience. Preferred Skills Experience with gradient-boosted tree models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi-cloud experience across AWS, GCP, and Azure. ...

DataOps Engineer delivering DataOps solutions in public sector or similarly regulated environments.* Developing, orchestrating and maintaining data pipelines using tools like Airflow, Prefect, or Dagster.* Containerising data applications using Docker and deploying them to Container Platforms (EKS, AKS and Kubernetes).* Implementing CI/CD pipelines for data applications.* Monitoring ...

Underpinnings Vector Databases: Experience with high-dimensional data retrieval using Milvus, Weaviate, or Pinecone (essential for RAG architectures). Data Orchestration: Familiarity with Airflow, Prefect, or Dagster for managing complex data movement and model training pipelines. Search & Discovery: Advanced ElasticSearch/OpenSearch for semantic search and large-scale indexing. ...

Underpinnings Vector Databases: Experience with high-dimensional data retrieval using Milvus, Weaviate, or Pinecone (essential for RAG architectures). Data Orchestration: Familiarity with Airflow, Prefect, or Dagster for managing complex data movement and model training pipelines. Search & Discovery: Advanced ElasticSearch/OpenSearch for semantic search and large-scale indexing. ...

knowledge of AWS/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB, EMR, Athena) Hands-on experience with orchestration and workflow tools (Docker, Kubernetes, Airflow, Prefect, Dagster) Familiar with CI/CD pipelines, infrastructure as code, and DBT Able to explain complex data concepts clearly to non-technical stakeholders Why This ...

coverage, and review standards high. Multi-Agent & Workflow Engines: Experience with A2A, agent frameworks (e.g., LangGraph, Google ADK), or durable workflow engines (e.g., Temporal, Prefect). Memory & Retrieval: Experience with agent memory designs (session, long-term, compaction), vector databases (e.g., pgvector, Qdrant), or hybrid search. Coding Agent Harnesses: Experience configuring ...

experience in at least one data area and one platform area below. Data experience Orchestration: operating pipelines with tools such as Airflow, Dagster or Prefect, including dependencies, retries, backfills, reruns or schema changes. Storage and modelling: designing schemas and storage for relational databases, warehouses or lakehouses, and understanding when each ...

Node.js, Java), frontend (React, Angular), APIs (REST/GraphQL) Machine Learning: Foundations of MLflow, Weights & Biases, LoRA, PEFT, SageMaker, Vertex AI, AzureML, Kubeflow, Airflow, Prefect, TorchServe, Triton, vLLM, SHAP, LIME, pandas, Spark, SQL LLM tooling: Familiarity with LangChain, Semantic Kernel, prompt chaining, vector search, and context management Performance & observability: Skilled ...

applying cloud-first engineering practices and making effective use of storage, compute and orchestration technologies. Working with tools such as Python, RDBMS, Prefect, Tableau, Semarchy, Aspera and Globus across data orchestration, visualisation, data management and secure data transfer. Developing and optimising data models, storage solutions and data products for performance ...

analytics Model and manage data across data warehouses and lakes and operational databases Build batch and streaming workflows, orchestrated with tools such as Airflow, Prefect, Dagster, or dbt Own data quality, validation, lineage, and observability ensuring the data feeding our models is accurate, timely, and trustworthy Engineer features and datasets … similar) Technical Skills Python (essential) – pandas, NumPy, and the modern data/ML ecosystem SQL – advanced querying, modelling, and optimisation Data pipelines & orchestration – Airflow, Prefect, Dagster, or dbt Data warehouses/lakes – BigQuery, Snowflake, Redshift, or Databricks ML frameworks – PyTorch, TensorFlow, or scikit‐learn LLM & AI tooling – OpenAI, Anthropic; LangChain ...

next. Cloud: AWS, GCP, Azure Ingestion: Fivetran, Airbyte, ... Warehouse and lakehouse: Snowflake, Databricks, BigQuery, Microsoft Fabric Transformation: dbt Orchestration: Airflow, Dagster, Prefect, ... BI and semantic layers: Power BI, Looker, Tableau, ... Activation and CDPs: Hightouch, Census, Segment, ... Nice to have Building the data side of agentic features ...

knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience ...

quantitative or technical discipline* Experience deploying AI/ML solutions at scale (recommendation engines, demand forecasting, etc.)* Familiarity with automation/orchestration platforms (Airflow, Prefect) and MLOps tooling* Prior success influencing global data‐culture change and promoting data‐centric decision makingPlease be advised that we are unable to provide visa ...

Azure) Comfortable working in a Linux environment Nice to have: Advanced data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit-learn, Pytorch, Tensorflow etc Experience ...

Azure) Comfortable working in a Linux environment Nice to have: Advanced data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit-learn, Pytorch, Tensorflow etc Experience ...

databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph–based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning or change‐data ...

building scalable data assets that can be used in BI and other user facing tools. Experience working with data pipeline orchestration tools like Prefect or Airflow and comfortable working with Python for data orchestration. Ability to communicate clearly with both technical and non-technical stakeholders, translating data into business value. ...