17 of 17 Prefect Jobs in London

Python and/or SQL in a production environment. Hands-on experience with modern data engineering frameworks such as: Apache Spark, Databricks Airflow/Prefect/Dagster Kafka/EventHub/Kinesis Experience building data solutions on at least one major cloud platform (AWS, Azure, or GCP). Strong understanding ...

best practices Familiarity with CI/CD processes and DevOps practices Preferred Qualifications Snowflake certifications (SnowPro Core, Advanced) Experience with orchestration tools (Airflow, Prefect, etc.) Knowledge of data governance and compliance frameworks Experience with real-time streaming tools (Kafka, Kinesis) Experience supporting BI tools such as Tableau or Power ...

regulatory compliance . Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI, Tableau, MicroStrategy). Experience ...

enterprise data landscape using modern platforms such as Databricks, Snowflake, Azure Synapse, and BigQuery. Oversee data engineering with Apache Airflow, dbt, and Prefect, ensuring performance, governance, and alignment with enterprise metadata standards (Collibra, Alation, Microsoft Purview). Drive adoption of Delta Lake, Iceberg, and Hudi to support scalable data lakehouse ...

across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity, and a mindset ...

market data, telemetry, pricing, events) Streaming exposure (Kafka/Event Hubs/Kinesis) Experience with Temporal (or similar orchestrators like Airflow/Dagster/Prefect) Any exposure to AI agents/automation tooling 👉 Apply ...

modern data warehousing technologies (e.g., Snowflake, BigQuery, Redshift, Databricks). Proven experience building production-ready pipelines using tools such as dbt, Airflow, Dagster, Prefect, or similar. Experience integrating data from HRIS and talent systems (e.g., Workday, BambooHR, Greenhouse, Lever, HiBob, Personio). Ability to work with highly sensitive data ...

data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses, and AWS. ...

with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol (MCP) for data ...

gapped environments, including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage ...

including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been scientifically proven ...

including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been scientifically proven ...

CloudSQL, BigQuery) Bare Metal Large datasets & geospatial data (PostGIS a plus) Infrastructure Terraform/Terragrunt GitHub Actions CI/CD Kubernetes Airflow/Prefect/SQLMesh Grafana What We’re Looking For 4+ years building production systems Strong React + Python experience Advanced SQL (performance tuning, large datasets) Experience deploying ...

CloudSQL, BigQuery) Bare Metal Large datasets & geospatial data (PostGIS a plus) Infrastructure Terraform/Terragrunt GitHub Actions CI/CD Kubernetes Airflow/Prefect/SQLMesh Grafana What We’re Looking For 4+ years building production systems Strong React + Python experience Advanced SQL (performance tuning, large datasets) Experience deploying ...

workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management of technical teams … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading and mentoring ...

workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management of technical teams … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading and mentoring ...

delivery rather than headcount substitution, aligning with Outside IR35 status . Key responsibilities include: Designing, building, and delivering data pipelines and orchestration workflows using Prefect or Airflow Developing Python-based services and APIs for data ingestion and enrichment Building and deploying containerised workloads using Docker and Kubernetes (or Swarm) Managing … experience: Active UKSV DV clearance (minimum 12 months remaining) Strong Python development experience in secure or restricted environments Proven delivery of data pipelines using Prefect or Airflow Hands-on experience with Docker, Kubernetes , and container orchestration Experience operating in air-gapped systems , managing builds without external connectivity Strong understanding ...