21 of 21 Remote Prefect Jobs

/DatabricksAWS Glue/Redshift/EMRGoogle BigQuery/DataflowEnsure systems are secure, scalable, and cost-efficientData Pipeline & Workflow ManagementDevelop orchestration workflows (e.g., Airflow, Prefect, Azure Data Factory)Monitor and troubleshoot pipelines to ensure high availability and performanceImplement robust error handling, logging, and alertingData Quality & GovernanceEnsure data quality, integrity ...

analytical storage (for example Kafka, Spark, PostgreSQL). Orchestration. Defining and running data workflows with modern orchestration frameworks (for example Airflow, Dagster or Prefect). Data quality and lineage. Tools and techniques for data testing, documentation and lineage (for example Great Expectations or dbt). AI, MLOps and emerging LLMOps. ...

data transformation tools (such as dbt). Pipeline mastery: Practical experience building and operating batch or streaming pipelines using orchestration tools like Airflow, Prefect, or Dagster. Strong communicator: Skilled at writing clear technical specifications and explaining complex trade-offs to both technical and non-technical colleagues. Growth mindset: Open ...

DataOps Engineer delivering DataOps solutions in public sector or similarly regulated environments.* Developing, orchestrating and maintaining data pipelines using tools like Airflow, Prefect, or Dagster.* Containerising data applications using Docker and deploying them to Container Platforms (EKS, AKS and Kubernetes).* Implementing CI/CD pipelines for data applications.* Monitoring ...

experience: modelling, semantic layers, agents & skills, testing, performance and cost tuning. Production experience with a pipeline orchestrator, ideally Dagster (or similar Airflow, Prefect), including dependent workloads, partial failures, and observability. Modern cloud infrastructure (Azure/AWS/GCP) and Kubernetes experience deploying and operating containerised workloads, plus infrastructure as code ...

knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience ...

platforms Experience briefing, designing and implementing ETL solutions end-to-end, from requirements gathering through to deployment Experience with data orchestration tools (e.g. Airflow, Prefect) and building scalable data pipelines Strong Git and collaborative development skills (e.g. GitHub, GitLab) Strong understanding of data fundamentals: MDM, data integrity best practices, auditing ...

equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial data experience (PostGIS, GeoPandas ...

Machine Learning systems into production.Desirable experienceNVIDIA Jetson or other edge AI platforms.NVIDIA DeepStream, GStreamer or FFmpeg.Kubernetes, Kubeflow, ECS, Nomad or other container-orchestration platforms.Airflow, Prefect, Dagster, Metaflow or similar workflow tools.Kafka, Pulsar, Redis Streams, RabbitMQ or other event-driven technologies.Triton Inference Server, Ray Serve, TorchServe, BentoML or Seldon Core.DVC, LakeFS ...

fast, pragmatic builder mindset, fluent with AI-assisted coding tools (e.g. Claude Code) Experience with a data orchestrator - Dagster ideally, or Airflow/Prefect Nice to have UK planning or property domain knowledge Time Off Rest properly. 37 days off in total, including your birthday and a full Christmas shutdown ...

Bicep or Pulumi) Implementing monitoring and observability for production systems, including metrics, alerting, logging, and dashboarding (e.g. Prometheus, Grafana) Pipeline orchestration using Dagster, Airflow, Prefect, or similar Bonus points if you have: Practical experience with model serving infrastructure – batch and/or real‐time inference at scale. Experience operating multi ...

Have: Experience with Alteryx Server administration, including scheduling, publishing workflows, and managing concurrency Familiarity with workflow orchestration tools such as n8n, Apache Airflow, or Prefect Familiarity with cloud storage environments (AWS S3, SFTP, or similar) Experience with Python or equivalent scripting for lightweight automation tasks Familiarity with project management frameworks ...

essential cross-team and cross-functional relationships necessary for the team’s successA plus if you haveKnowledge about observabilityFamiliarity with Airflow or Prefect - generating ad hoc ETL jobsIn the UK, the Base compensation range for this role is 91,755 - 110,106. Actual compensation may vary based on level, experience ...

scale Strong software engineering skills Experience delivering & maintaining production systems Experience with workflow orchestration for parallelised jobs; Flyte preferred, but Airflow, Prefect or similar tools are also relevant Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting Strong cloud ...

ideally at multi-TB or PB scaleStrong software engineering skillsExperience delivering & maintaining production systemsExperience with workflow orchestration for parallelised jobs; Flyte preferred, but Airflow, Prefect or similar tools are also relevantExperience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alertingStrong ...

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Your locationYour locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Newcastle ...

About Gigs At Gigs, we're building the operating system for mobile services—a platform that lets tech companies embed global connectivity into their products effortlessly. Just as Stripe lets any business add a payment ...

About GigsAt Gigs, we're building the operating system for mobile services—a platform that lets tech companies embed global connectivity into their products effortlessly.Just as Stripe lets any business add a payment button in ...

Troubleshoot integration failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...