26 to 48 of 48 Prefect Jobs in the UK

databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph–based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning or change‐data ...

orchestration, transformation, storage, modelling, serving and monitoring. Design and oversee scalable batch and near-real‐time pipelines using tools such as Azure Data Factory, Prefect or Airflow. Maintain and evolve cloud and in-house database platforms, particularly Azure, Snowflake, Microsoft SQL Server, MongoDB and SQLite. Set up, configure and operate … auto‐suspend and auto‐resume configuration, performance tuning, access‐control design, monitoring and spend governance. Experience with orchestration tools such as Azure Data Factory, Prefect or Airflow. Strong experience administering or governing Power BI, SSRS and QlikView environments. Experience delivering machine‐learning, AI or intelligent‐automation solutions beyond proof ...

data products, focusing on reliable, scalable architectures. You'll work with SQL, Python, and cloud warehouses (BigQuery, Snowflake, Redshift) and orchestration tools (Airflow, Prefect, Dagster) while collaborating with analytics, data science, and product engineering to deliver impact across the organization. #J-18808-Ljbffr ...

years of data engineering experience with Spark, strong Python and SQL, extensive AWS services, and hands-on experience with orchestration tools (Docker, Kubernetes, Airflow, Prefect, Dagster). Hybrid work model in London. #J-18808-Ljbffr ...

automationWorking knowledge of modern MLOps stacks including experiment tracking and artifact managementHands-on experience with orchestration tools (e.g., Kubeflow, Apache Airflow, Metaflow or Prefect)Demonstrated skills with Docker, Kubernetes and distributed deploymentsPractical knowledge of Infrastructure-as-Code (Terraform) and a major cloud provider (AWS, Azure or GCP)Familiarity with ...

programming skills and production experience in Python. Experience building and maintaining data or ML pipelines with an orchestration tool such as Dagster (or Airflow, Prefect, etc.). Hands-on experience with common ML libraries and frameworks, e.g. PyTorch, scikit-learn, and gradient-boosting libraries such as XGBoost or LightGBM. Clear ...

scale Strong software engineering skills Experience delivering & maintaining production systems Experience with workflow orchestration for parallelised jobs; Flyte preferred, but Airflow, Prefect or similar tools are also relevant Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting Strong cloud ...

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Your locationYour locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Newcastle ...

threading Profiling Python/C/C++ and performance optimisation Networking Nice to have: Data engineering experience in Python, e.g. with libraries like Dagster, Prefect etc Experience optimising dataframe code, e.g. in Pandas or ideally Polars Experience of machine learning techniques and related libraries and frameworks e.g. scikit-learn, Pytorch ...

they do. Our tech stack is built of strongly typed Python, TypeScript, Next.js, React.js, MariaDB and Redis. Our data platform is built using DBT, Prefect, Fivetran and Snowflake. Our production services run on AWS and Vercel. We automate infrastructure and configuration using Pulumi and GitHub Actions. Our observability stack ...

As Lead Data Engineer at Superscript, you’ll be the technical and strategic owner of our data platform, the foundation that powers everything from business intelligence and underwriting models to machine learning predictions and data ...

with Supabase specifically, or with similar BaaS platforms. BigQuery experience. Familiarity with n8n. Equivalent experience with code‐first orchestrators such as Temporal, Airflow or Prefect is welcome. Design sensibility. You care how things look and feel, not just how they function. Experience replacing legacy or external vendor systems with ...

networking/security implications. You might also have: Experience with Kubernetes for cloud-burst or elastic compute scenarios. Familiarity with workflow orchestration tools (e.g. Prefect, Airflow, Dagster) — not required to design flows, but useful for understanding deployment/runtime needs. Exposure to high-performance/scientific/technical computing environments ...

build upon. Our angels include Dane Knecht (Cloudflare CTO), Lord Ara Darzi, and the Head of Microsoft AI Health. Tech stack: Python, Railway, AWS, Prefect, LakeFS, LLMs with Pydantic AI and evals. What You'll Work On You'd be a founding engineer on our team. The things ...

Troubleshoot integration failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...

cover specifics in interview. You will: Design and implement orchestration logic using a modern workflow engine (e.g. flows, subflows, and tasks in a Prefect-like system), decomposing monolithic pipelines into small, reusable, independently testable units. Apply solid software design principles (SOLID, separation of concerns, composition over inheritance) to keep orchestration … calling out to external CLI tools/subprocesses safely. You might also have experience of the following: Direct experience with a workflow orchestration framework (Prefect, Airflow, Dagster, or similar). Experience with containerization (Docker, or HPC-oriented tools like Apptainer/Singularity). Exposure to systems that coordinate with external ...

powers a suite of AI and machine learning services. Design, build, and maintain production-grade ML orchestration pipelines using tools such as Dagster, Airflow, Prefect, or similar technologies. Deploy, monitor, and scale machine learning models and LLM-powered solutions in production environments. Build and maintain cloud-native infrastructure using Kubernetes … Strong commercial experience in Python software engineering. Experience deploying and managing machine learning infrastructure in production. Knowledge of orchestration tools such as Dagster, Airflow, Prefect, or similar. Hands-on experience with Kubernetes and containerised workloads. Expertise in Infrastructure as Code using Terraform, Bicep, Pulumi, or comparable technologies. Experience building ...

wiring up the data flows. This is an in‐person role based in London. Technology Stack Our stack is Python (backend), React (frontend), Prefect (orchestration), and GraphQL (API layer). You don't need to be an expert in all of these, but Python proficiency is required and you should ...

Senior MLOps Engineer London (Hybrid) | £75,000 - £85,000 + Bonus + BenefitsThis is an opportunity to take ownership of the infrastructure powering a growing AI platform. You'll work across machine learning, NLP, and ...

Prefect is hiring a Developer Success Engineer to join the combined Prefect and Dagster support queue. You will diagnose and resolve technical issues in customer environments, own each issue through resolution, and contribute to documentation, tooling, and product feedback to reduce future volume. You’ll work the queue independently ...

Prefect is hiring a Developer Success Engineer to diagnose and resolve issues across Prefect and Dagster platforms. You will own cases end-to-end, build supporting docs and tooling, and contribute to a high-quality customer experience. You’ll work in a remote-first team, collaborating with engineers to reduce ...