4 of 4 Prefect Jobs in the UK excluding London

based environments. Azure Synapse, Databricks, Microsoft Fabric or equivalent. Python and/or PySpark. DBT or similar transformation framework. Data pipeline development and orchestration. Prefect, Airflow, Azure Data Factory or similar orchestration tooling. Source control using Git. Azure DevOps or equivalent CI/CD tooling. Cloud storage and secure data ...

data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability Understanding of data quality ...

case Build and maintain transformation layers in dbt (or equivalent), with appropriate testing, documentation and lineage Operate orchestration tooling (Airflow, Dagster, Prefect or equivalent) and the workflows around it Manage cloud data warehouses and lakehouses (Snowflake, BigQuery, Redshift, Synapse, Databricks) Implement data quality, testing, monitoring and observability across pipelines … Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent) Production experience with at least one major cloud warehouse/lakehouse (Snowflake, BigQuery, Redshift, Synapse, Databricks) Cloud platform experience (AWS, GCP, Azure) Solid data ...

SENIOR DATA ENGINEER£63,500 - Hybrid Working (2 days a week in office) - Bridgend, Wales. Your new company The company is a not-for-profit housing association established in 2003 as the first large-scale ...