18 of 18 Permanent Prefect Jobs

Experience with data quality frameworks, data governance, and compliance requirements. Familiarity with version control (Git), CI/CD pipelines, and workflow orchestration tools (Airflow, Prefect). Soft Skills Strong analytical and problem-solving mindset with attention to detail. Good team player with effective communication and storytelling with data and insights. ...

. Proficiency in Python and SQL for data manipulation and transformation. Experience with ETL/ELT development and orchestration tools (e.g., Apache Airflow, dbt, Prefect). Knowledge of data modelling, data warehousing, and lakehouse architectures. Familiarity with DevOps practices, CI/CD pipelines, and infrastructure-as-code. Strong problem-solving ...

Weaviate, FAISS, Milvus) Data & Engineering Excellence Lead the evolution of modern data platforms (Databricks, Snowflake, Synapse, BigQuery) Ensure robust data engineering practices (Airflow, dbt, Prefect) and governance (Collibra, Purview) Drive scalable lakehouse architectures (Delta Lake, Iceberg, Hudi) Cloud, Infrastructure & MLOps Champion multi-cloud engineering across Azure, AWS, and GCP Lead ...

across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity, and a mindset ...

5+ years of experience in data engineering within production environments Strong Python and SQL skills Experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or similar Hands-on experience with transformation frameworks such as dbt or Spark Experience with cloud data warehouses such as Snowflake, BigQuery, Redshift, or Databricks ...

security, and compliance concepts Data Ingestion Incremental and CDC ingestion methods REST APIs Familiarity (At least 1+ years of experience) with: Orchestration & scheduling tools (Prefect, Airflow is a plus) Qlik Replicate Other Requirements Ability to work collaboratively and productively with other team members to achieve Lennar's objectives. Thirst ...

grade data pipelines Solid understanding of integration patterns including REST APIs, webhooks, OAuth and event-driven architectures Experience with orchestration tools such as Airflow, Prefect or Dagster Familiarity with cloud environments (AWS, GCP or Azure) Experience with containerisation tools such as Docker and Kubernetes Proven experience integrating multiple business systems ...

solutions meet business needs. Experience with data ingestion tools, like Fivetran. Advantageous Exposure to deploying applications with Kubernetes. Experience with Data Orchestrator tools (Airflow, Prefect, etc.). Experience with Data Observability tools (Montecarlo, Great Expectations, etc.). Experience with Data Catalog tools (Amundsen, OpenMetadata, etc.). Benefits Winning team ...

will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will receive a salary ...

will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will receive a salary ...

with CI/CD, microservices, TDD/BDD. Knowledge of secure system design. Desirable (AI & Data) Vector DBs: Milvus, Weaviate, Pinecone Data orchestration: Airflow, Prefect, Dagster Search: ElasticSearch/OpenSearch AI frameworks: LangChain, Hugging Face MLOps: MLflow, Kubeflow If you are looking for an opportunity to work on mission-critical ...

distributed compute, GPU optimization, and MLOps architecture. Willingness to learn new parts of the ML tech stack – Python, PyTorch, Docker, Kubernetes, Ray, Weights & Biases, Prefect, BigQuery, Postgres, GCP, CUDA, and model serving frameworks. Fluency in life sciences or drug discovery is a plus. Working Location & Compensation: This is an office ...

creating. You'll have experience with: AWS and cloud-native technologies Snowflake or similar cloud data platforms Data orchestration tools such as Airflow, Prefect or similar Amazon S3 and modern data architectures Postgres and semi-structured data models Event-driven architectures and scalable systems You'll understand how data enters ...

sensor/energy/building data Python (NumPy, pandas, scikit-learn, etc.) Productionisation of models into scalable workflows MLOps practices (e.g. MLflow, Airflow/Prefect, Docker) Building reproducible, well-tested data science pipelines Working with noisy, real-world operational datasets Strong model evaluation, monitoring and deployment practices 📈 What Success Looks ...

complex data issues, guiding the team in troubleshooting and problem-solving efforts. Knowledge Extensive experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect) and data integration platforms (e.g., Apache Spark, Glue). Extensive experience working on AWS data stack i.e., Data engineering, Warehousing and AI/ML. Advocate best … related field. 7-10 years of experience in data engineering, with significant leadership and project management experience. AWS, Snowflake, Azure AWS Glue, AWS Appflow, Prefect, dbt, S3, Qlik SQL, Python, Java Exceptional ability to influence and engage senior leaders with data-driven insights. Expert in resolving complex, high-stakes problems ...

failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time streaming (Kafka … production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). • Experience connecting ...

SENIOR DATA ENGINEER £63k - Hybrid Working (2 days a week in office) - Bridgend, Wales. Your new company The company is a not-for-profit housing association established in 2003 as the first large-scale voluntary ...

across multiple regions. Technical Environment Experience across some of the following technologies is advantageous: AIops and enterprise automation frameworks Workflow orchestration platforms (Airflow, Argo, Prefect) Configuration and automation tools (Ansible, Salt, Puppet) ITSM and ITOM platforms Event-driven automation and runbook-as-code approaches Messaging technologies such as Kafka ...