1 to 25 of 27 Prefect Jobs in the UK

across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity, and a mindset ...

snowflake schemas, normalization). Experience with version control systems (e.g., Git) and CI/CD practices. Familiarity with orchestration tools (e.g., Airflow, dbt Cloud, Prefect) is a plus. About Capgemini Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital ...

security and access control Experience designing scalable analytics and reporting solutions Nice to Have Medallion Architecture or Lakehouse experience Azure Data Factory, dbt or Prefect DataSecOps and cloud security experience AI/ML data preparation knowledge Experience leading technical projects or mentoring engineers You'll Thrive Here If You... Enjoy ...

data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability Understanding of data quality ...

/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud St or age).Exposure to workflow orchestration to ols (Apache Airflow, Prefect, or Da gs ter).Master's degree in Computer Science, Engineering, Information Technology, or a related f ield. ...

scratch or from pre-trained checkpoints. NLP specialism: named entity recognition, text classification, semantic similarity, topic modelling, or conversational AI. Data orchestration tools: Airflow, Prefect, Dagster. Experience working with Knowledge Graphs or ontologies in a production environment. Published work, open-source contributions, or a track record of writing or speaking ...

PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc.). Strong experience with cloud platforms (AWS, GCP, or Azure), Docker, and Kubernetes. Solid coding practices ...

PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc.). Strong experience with cloud platforms (AWS, GCP, or Azure), Docker, and Kubernetes. Solid coding practices ...

DataOps Engineer delivering DataOps solutions in public sector or similarly regulated environments. Developing, orchestrating and maintaining data pipelines using tools like Airflow, Prefect, or Dagster. Containerising data applications using Docker and deploying them to Container Platforms (EKS, AKS and Kubernetes). Implementing CI/CD pipelines for data applications. Monitoring ...

improve systems, processes, and products Desirable Experience Experience deploying and operating machine learning models in production Experience with ML orchestration tools such as Airflow, Prefect, Kubeflow, MLflow, or similar Exposure to geospatial data, scientific computing, environmental modelling, or natural resources applications Experience with observability, monitoring, and platform engineering practices Experience ...

case Build and maintain transformation layers in dbt (or equivalent), with appropriate testing, documentation and lineage Operate orchestration tooling (Airflow, Dagster, Prefect or equivalent) and the workflows around it Manage cloud data warehouses and lakehouses (Snowflake, BigQuery, Redshift, Synapse, Databricks) Implement data quality, testing, monitoring and observability across pipelines … Scala/Java where relevant) for pipeline development and tooling Hands-on experience with dbt or equivalent transformation tooling Orchestration experience (Airflow, Dagster, Prefect or equivalent) Production experience with at least one major cloud warehouse/lakehouse (Snowflake, BigQuery, Redshift, Synapse, Databricks) Cloud platform experience (AWS, GCP, Azure) Solid data ...

modelling Experience integrating messy external APIs and bulk datasets Strong Postgres Experience with a transformation framework ( dbt or SQLMesh ) and an orchestrator ( Dagster , Airflow, Prefect, or similar). Modern Python data tooling; DuckDB for analytical compute. Financial Services/Wealth domain would be ideal but not essential as well ...

will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising ...

that others can build upon our work Tech Stack: APIs & backend: Python, FastAPI, PostgreSQL Data & infrastructure: Snowflake, Docker, AWS (ECS, S3, etc.), Pulumi, Prefect, GitHub Actions Search: Vespa Data Science: PyTorch, Huggingface, Pydantic AI, Pandas, Spacy, Weights & Biases About You You have enthusiasm for: Building and deploying backend services that ...

with CI/CD, microservices, TDD/BDD. Knowledge of secure system design. Desirable (AI & Data) Vector DBs: Milvus, Weaviate, Pinecone Data orchestration: Airflow, Prefect, Dagster Search: ElasticSearch/OpenSearch AI frameworks: LangChain, Hugging Face MLOps: MLflow, Kubeflow If you are looking for an opportunity to work on mission-critical ...

take initiative. Desirable Experience with dashboarding/BI tools (Power BI, Tableau, Streamlit). Familiarity with Linux scripting or workflow orchestration tools (Airflow, Prefect). Exposure to financial markets , asset management, or consulting environments. This role would suit someone who is technically strong, logical, and ambitious, with the maturity ...

creating. You'll have experience with: AWS and cloud-native technologies Snowflake or similar cloud data platforms Data orchestration tools such as Airflow, Prefect or similar Amazon S3 and modern data architectures Postgres and semi-structured data models Designing and building event-driven architectures and scalable systems Building and operating ...

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With... ...

probabilistic programming frameworks (e.g., PyMC, Stan, or TensorFlow Probability) Operating data science/ML workloads at scale using tools such as Argo Workflows, Prefect or similar Experience working with geospatial data (e.g., GeoPandas, Shapely, Rasterio) Knowledge of laser spectroscopy or optical sensing data Experience developing interactive visualisations or dashboards (e.g. ...

textract, tesseract etc. Strong understanding of the use of neural networks, embeddings, transformers etc. Cloud platforms (AWS SageMaker, Azure ML; etc) Orchestration tools (e.g. Prefect; etc) Agentic toolkits (LangChain, LlamaIndex, AutoGen, Google Agentic Framework) Experience in productionizing AI applications. Strong programming skills in python and common AI frameworks Experience with ...

parts of our ML tech stack that you might not already know. Our current ML infrastructure includes: Python, PyTorch, Docker, Kubernetes, Ray, Weights & Biases, Prefect, BigQuery, Postgres, GCP, CUDA, and various model serving frameworks. Fluency in life sciences or drug discovery is a plus but not required to be considered. ...

share options • Working model: Fully remote (UK-based) with occasional travel • Stack: Python, LLMs, RAG, Neo4j, vector databases, Spark, dbt, Airflow/Dagster/Prefect, cloud warehouses • Sponsorship: Currently unavailable Interested? Please apply below. ...

across multiple regions. Technical Environment Experience across some of the following technologies is advantageous: AIops and enterprise automation frameworks Workflow orchestration platforms (Airflow, Argo, Prefect) Configuration and automation tools (Ansible, Salt, Puppet) ITSM and ITOM platforms Event-driven automation and runbook-as-code approaches Messaging technologies such as Kafka ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...

failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka … production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). Experience connecting ...