8 of 8 Prefect Jobs in England

based environments. Azure Synapse, Databricks, Microsoft Fabric or equivalent. Python and/or PySpark. DBT or similar transformation framework. Data pipeline development and orchestration. Prefect, Airflow, Azure Data Factory or similar orchestration tooling. Source control using Git. Azure DevOps or equivalent CI/CD tooling. Cloud storage and secure data ...

data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability Understanding of data quality ...

case Build and maintain transformation layers in dbt (or equivalent), with appropriate testing, documentation and lineage Operate orchestration tooling (Airflow, Dagster, Prefect or equivalent) and the workflows around it Manage cloud data warehouses and lakehouses (Snowflake, BigQuery, Redshift, Synapse, Databricks) Implement data quality, testing, monitoring and observability across pipelines … Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent) Production experience with at least one major cloud warehouse/lakehouse (Snowflake, BigQuery, Redshift, Synapse, Databricks) Cloud platform experience (AWS, GCP, Azure) Solid data ...

Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka or other event ...

Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka or other event ...

databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph–based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning or change‐data ...

parts of our ML tech stack that you might not already know. Our current ML infrastructure includes: Python, PyTorch, Docker, Kubernetes, Ray, Weights & Biases, Prefect, BigQuery, Postgres, GCP, CUDA, and various model serving frameworks. Fluency in life sciences or drug discovery is a plus but not required to be considered. ...

Software Developer - Risk Data Pipelines London Competitive Salary + Bonus Ncounter is supporting a global quantitative investment manager whose risk platforms rely on high-quality, real-time data. This role sits within the engineering team ...