25 of 25 Prefect Jobs

columnar data formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Desirable Background in supply chain forecasting, enterprise AI, or retail analyticsM.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

working with a distributed team (London, Boston, and New York) and directly with researchers and vendors. Desirable QualificationsExperience with pipelines and orchestration (e.g., Airflow, Prefect, Dagster, or similar) - strongly preferred. Practical experience applying AI tools to data work (coding assistance, investigation, anomaly detection).Experience supporting production data pipelines and incident ...

experience in at least one data area and one platform area below. Data experience Orchestration: operating pipelines with tools such as Airflow, Dagster or Prefect, including dependencies, retries, backfills, reruns or schema changes. Storage and modelling: designing schemas and storage for relational databases, warehouses or lakehouses, and understanding when each ...

skillsets below - strength in one is enough: Hands-on: building AI/ML pipelines or prototypes; vector databases; prompt engineering; orchestration tools (Airflow/Prefect); Git Advisory: designing AI/data architectures; Agentic AI principles (LangGraph, CrewAI, AutoGen); mentoring specialists without formal authority; AI governance (security, privacy, observability) Desirable: cloud ...

PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc.). Strong experience with cloud platforms (AWS, GCP, or Azure), Docker, and Kubernetes. Solid coding practices ...

PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc.). Strong experience with cloud platforms (AWS, GCP, or Azure), Docker, and Kubernetes. Solid coding practices ...

snowflake schemas, normalization). Experience with version control systems (e.g., Git) and CI/CD practices. Familiarity with orchestration tools (e.g., Airflow, dbt Cloud, Prefect) is a plus. About Capgemini Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital ...

Athena preferred) Setting up and managing a cloud data warehouse (Redshift preferred) Hands-on working with Airflow or an equivalent orchestrator in production (Dagster, Prefect) Solid understanding of data modelling: dimensional modelling, slowly changing dimensions, and event-sourced schemas Other Desired Skills Knowledge of best practices and IT operations ...

Node.js, Java), frontend (React, Angular), APIs (REST/GraphQL) Machine Learning: Foundations of MLflow, Weights & Biases, LoRA, PEFT, SageMaker, Vertex AI, AzureML, Kubeflow, Airflow, Prefect, TorchServe, Triton, vLLM, SHAP, LIME, pandas, Spark, SQLLLM tooling: Familiarity with LangChain, Semantic Kernel, prompt chaining, vector search, and context management Performance & observability: Skilled ...

will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising ...

automationWorking knowledge of modern MLOps stacks including experiment tracking and artifact managementHands-on experience with orchestration tools (e.g., Kubeflow, Apache Airflow, Metaflow or Prefect)Demonstrated skills with Docker, Kubernetes and distributed deploymentsPractical knowledge of Infrastructure-as-Code (Terraform) and a major cloud provider (AWS, Azure or GCP)Familiarity with ...

take initiative. Desirable Experience with dashboarding/BI tools (Power BI, Tableau, Streamlit). Familiarity with Linux scripting or workflow orchestration tools (Airflow, Prefect). Exposure to financial markets , asset management, or consulting environments. This role would suit someone who is technically strong, logical, and ambitious, with the maturity ...

platforms (e.g., PostgreSQL, ClickHouse, MSSQL, Redis, FoundationDB).Familiarity with specific middleware (e.g., Kafka, Consul), HPC schedulers (e.g., Slurm), Kubernetes, or workflow orchestrators (e.g., Airflow, Prefect).Experience with on-premise deployments of development tools like GitLab, Artifactory, CICD, or JupyterHub. Knowledge of other programming languages such as Golang, Rust, or JavaScript. ...

their networking/security implications.You might also have:Experience with Kubernetes for cloud-burst or elastic compute scenarios.Familiarity with workflow orchestration tools (e.g. Prefect, Airflow, Dagster) — not required to design flows, but useful for understanding deployment/runtime needs.Exposure to high-performance/scientific/technical computing environments (HPC/ ...

networking/security implications. You might also have: Experience with Kubernetes for cloud-burst or elastic compute scenarios. Familiarity with workflow orchestration tools (e.g. Prefect, Airflow, Dagster) — not required to design flows, but useful for understanding deployment/runtime needs. Exposure to high-performance/scientific/technical computing environments ...

networking/security implications. You might also have: Experience with Kubernetes for cloud-burst or elastic compute scenarios. Familiarity with workflow orchestration tools (e.g. Prefect, Airflow, Dagster) — not required to design flows, but useful for understanding deployment/runtime needs. Exposure to high-performance/scientific/technical computing environments ...

Docker and Kubernetes experience, including deployment and management Previous experience working within air-gapped environments Strong understanding of APIs and microservices Experience with Prefect, Airflow or similar data pipeline/orchestration technologies Experience configuring and integrating workflow tooling such as Jira Experience with database and storage technologies such ...

probabilistic programming frameworks (e.g., PyMC, Stan, or TensorFlow Probability) Operating data science/ML workloads at scale using tools such as Argo Workflows, Prefect or similar Experience working with geospatial data (e.g., GeoPandas, Shapely, Rasterio) Knowledge of laser spectroscopy or optical sensing data Experience developing interactive visualisations or dashboards (e.g. ...

failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time streaming (Kafka … production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). • Experience connecting ...

Software Developer – Innovation (AI/ML, IoT & Digital Twins)We're looking for an innovative and hands-on Software Developer to join our growing Innovation team. This is a unique opportunity to work at the ...

Software Developer – Innovation (AI/ML, IoT & Digital Twins)We're looking for an innovative and hands-on Software Developer to join our growing Innovation team. This is a unique opportunity to work at the ...

cover specifics in interview.You will:Design and implement orchestration logic using a modern workflow engine (e.g. flows, subflows, and tasks in a Prefect-like system), decomposing monolithic pipelines into small, reusable, independently testable units.Apply solid software design principles (SOLID, separation of concerns, composition over inheritance) to keep orchestration code maintainable … calling out to external CLI tools/subprocesses safely.You might also have experience of the following:Direct experience with a workflow orchestration framework (Prefect, Airflow, Dagster, or similar).Experience with containerization (Docker, or HPC-oriented tools like Apptainer/Singularity).Exposure to systems that coordinate with external schedulers/queues ...

cover specifics in interview. You will: Design and implement orchestration logic using a modern workflow engine (e.g. flows, subflows, and tasks in a Prefect-like system), decomposing monolithic pipelines into small, reusable, independently testable units. Apply solid software design principles (SOLID, separation of concerns, composition over inheritance) to keep orchestration … calling out to external CLI tools/subprocesses safely. You might also have experience of the following: Direct experience with a workflow orchestration framework (Prefect, Airflow, Dagster, or similar).Experience with containerization (Docker, or HPC-oriented tools like Apptainer/Singularity).Exposure to systems that coordinate with external schedulers/ ...

Senior MLOps Engineer London (Hybrid) | £75,000 - £85,000 + Bonus + BenefitsThis is an opportunity to take ownership of the infrastructure powering a growing AI platform. You'll work across machine learning, NLP, and ...

Job ID: 6919Location: LondonSalary: 180,000-220,000 per yearPosted: 2026-07-08Software Developer – Risk Data PipelinesLondonCompetitive Salary + BonusNcounter is supporting a global quantitative investment manager whose risk platforms rely on high-quality ...