9 of 9 Remote/Hybrid Prefect Jobs

5+ years of experience in data engineering within production environments Strong Python and SQL skills Experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or similar Hands-on experience with transformation frameworks such as dbt or Spark Experience with cloud data warehouses such as Snowflake, BigQuery, Redshift, or Databricks ...

grade data pipelines Solid understanding of integration patterns including REST APIs, webhooks, OAuth and event-driven architectures Experience with orchestration tools such as Airflow, Prefect or Dagster Familiarity with cloud environments (AWS, GCP or Azure) Experience with containerisation tools such as Docker and Kubernetes Proven experience integrating multiple business systems ...

Synapse, Fabric, Databricks) Experience building ETL/ELT pipelines Python/PySpark (desirable) DBT or similar transformation tools Experience with orchestration tools (ADF, Airflow, Prefect) CI/CD, Git, and Azure DevOps If you are a hands-on Azure Data Engineer with experience working in secure or regulated environments ...

Synapse, Fabric, Databricks) Experience building ETL/ELT pipelines Python/PySpark (desirable) DBT or similar transformation tools Experience with orchestration tools (ADF, Airflow, Prefect) CI/CD, Git, and Azure DevOps If you are a hands-on Azure Data Engineer with experience working in secure or regulated environments ...

solutions meet business needs. Experience with data ingestion tools, like Fivetran. Advantageous Exposure to deploying applications with Kubernetes. Experience with Data Orchestrator tools (Airflow, Prefect, etc.). Experience with Data Observability tools (Montecarlo, Great Expectations, etc.). Experience with Data Catalog tools (Amundsen, OpenMetadata, etc.). Benefits Winning team ...

with CI/CD, microservices, TDD/BDD. Knowledge of secure system design. Desirable (AI & Data) Vector DBs: Milvus, Weaviate, Pinecone Data orchestration: Airflow, Prefect, Dagster Search: ElasticSearch/OpenSearch AI frameworks: LangChain, Hugging Face MLOps: MLflow, Kubeflow If you are looking for an opportunity to work on mission-critical ...

creating. You'll have experience with: AWS and cloud-native technologies Snowflake or similar cloud data platforms Data orchestration tools such as Airflow, Prefect or similar Amazon S3 and modern data architectures Postgres and semi-structured data models Event-driven architectures and scalable systems You'll understand how data enters ...

failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time streaming (Kafka … production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). • Experience connecting ...

SENIOR DATA ENGINEER £63k - Hybrid Working (2 days a week in office) - Bridgend, Wales. Your new company The company is a not-for-profit housing association established in 2003 as the first large-scale voluntary ...