22 of 22 Prefect Jobs in the UK

highly advantageous, particularly: Azure Data Factory Azure SQL Azure Data Lake/ADLS Azure DevOps Microsoft Fabric Azure Databricks Experience with PySpark, Airflow, Dagster, Prefect or other orchestration technologies would also be useful. We're particularly interested in people who have worked with modern data platforms and understand the principles ...

with MLOps practices: CI/CD for data and ML pipelines, automated testing, and infrastructure as code.Experience with modern data stack tooling — dbt, Airflow, Prefect, or equivalent orchestration and transformation frameworks.Experience with automation tooling such as Power Automate, Power Platform, or equivalent, and practical use of AI-assisted engineering tools ...

with MLOps practices: CI/CD for data and ML pipelines, automated testing, and infrastructure as code.Experience with modern data stack tooling — dbt, Airflow, Prefect, or equivalent orchestration and transformation frameworks.Experience with automation tooling such as Power Automate, Power Platform, or equivalent, and practical use of AI-assisted engineering tools ...

with MLOps practices: CI/CD for data and ML pipelines, automated testing, and infrastructure as code.Experience with modern data stack tooling — dbt, Airflow, Prefect, or equivalent orchestration and transformation frameworks.Experience with automation tooling such as Power Automate, Power Platform, or equivalent, and practical use of AI-assisted engineering tools ...

cloud platforms Experience with modern data platforms such as Databricks, Snowflake or Redshift Experience using orchestration tools such as Airflow, Azure Data Factory or Prefect Strong understanding of data warehousing and data modelling principles Excellent problem-solving skills with a delivery-focused mindset Comfortable working within cross-functional engineering teams ...

columnar data formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Desirable Background in supply chain forecasting, enterprise AI, or retail analyticsM.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

/CD experience. Highly Desirable Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Order book reconstruction Tick-to-bar aggregation Airflow, Dagster, Prefect or MLflow Experience supporting quantitative research or trading systems Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs) What We're Looking ...

data transformation tools (such as dbt). Pipeline mastery: Practical experience building and operating batch or streaming pipelines using orchestration tools like Airflow, Prefect, or Dagster. Strong communicator: Skilled at writing clear technical specifications and explaining complex trade-offs to both technical and non-technical colleagues. Growth mindset: Open ...

with Snowflake and/or MS Fabric experience a bonus.Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life.Hands-on DataOps experience (eg. CI/CD, version control, IaC, etc. ...

data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability Understanding of data quality ...

native platforms in AWS and/or GCP.Experience designing and supporting data pipelines within complex technical environments.Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster.Experience implementing monitoring, logging, observability and platform governance practices.Strong understanding of software engineering principles, testing and deployment best practices.Ability to work collaboratively with technical ...

disciplinary teams, delivering modern data platforms into large organisations. Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life Strong Snowflake experience is preferred, and Databricks experience would ...

Python used for reliable, well-tested systems (not exploratory notebooks).• Design and operation of large-scale ETL/ELT pipelines, including orchestration (Airflow, Prefect, or similar) and reliability patterns such as retries, backfills, and exactly-once semantics.• Deep experience with Azure, including AKS, Helm, EventHub, observability tools (e.g. ...

essential cross-team and cross-functional relationships necessary for the team’s successA plus if you haveKnowledge about observabilityFamiliarity with Airflow or Prefect - generating ad hoc ETL jobsIn the UK, the Base compensation range for this role is 91,755 - 110,106. Actual compensation may vary based on level, experience ...

operating large-scale data transfer pipelines at multi-TB or PB scaleExperience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be consideredExperience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting.Strong cloud platform skills ...

About GigsAt Gigs, we're building the operating system for mobile services—a platform that lets tech companies embed global connectivity into their products effortlessly.Just as Stripe lets any business add a payment button in ...

Why Sony Interactive Entertainment Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As ...

platforms (e.g., PostgreSQL, ClickHouse, MSSQL, Redis, FoundationDB).Familiarity with specific middleware (e.g., Kafka, Consul), HPC schedulers (e.g., Slurm), Kubernetes, or workflow orchestrators (e.g., Airflow, Prefect).Experience with on-premise deployments of development tools like GitLab, Artifactory, CICD, or JupyterHub.Knowledge of other programming languages such as Golang, Rust, or JavaScript.Experience with ...

staking, or other on-chain systems- Full-stack development with Python (FastAPI)- Strong relational data modeling fundamentals- GitOps and Kubernetes- Job orchestration systems (Airflow, Prefect, etc.)For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at . California residents ...

failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time streaming (Kafka … production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). • Experience connecting ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...