101 to 125 of 137 Apache Airflow Jobs in the UK excluding London

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

knowledge of Python and relevant libraries (LangChain, LangGraph, FastAPI, Pydantic, etc). • Experience in designing, building, testing, deploying and maintaining data pipelines (ideally using Airflow/Cloud Composer). • Experience in deploying DevOps processes (Github, Docker, CI/CD in GitHub Actions, deploying in GCP). What ...

operate effectively in a fast-paced, scaling organisation. Excellent communication skills and a collaborative approach. Desirable Skills Experience with analytics engineering tools (e.g., dbt, Airflow). Familiarity with experimentation frameworks and A/B testing platforms. Exposure to cloud-based data environments (e.g., Google Cloud Platform). Experience within ...

Adobe Analytics, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pipping and modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development ...

What We're Looking For Significant experience with Databricks (including Unity Catalog) Strong skills in Python, Spark, SQL Cloud expertise Knowledge of pipeline tools (Airflow, ADF) Leadership and problem-solving ability Ready to take the next step? Apply now and join us as our Senior Databricks Engineer ...

experienced team members and fostering a culture of knowledge sharing Communicating clearly and effectively with diverse technical and non-technical audiences Tech stack Python , Airflow , Terraform Azure (but open to other cloud experience) DBT (nice to have) Exposure to ML pipelines beneficial ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

workflows Nice to Have Knowledge of FinOps principles and cloud cost optimisation Experience with orchestration tools such as Azure Data Factory, Databricks Workflows, or Airflow Exposure to containerisation tools (Kubernetes, Docker) Experience with data cataloguing tools Familiarity with unit testing in data pipelines Awareness of MLOps practices ...

cybersecurity, threat intelligence, or offensive security tools). Deep technical expertise across: Cloud: AWS, Azure IaC: Terraform, Ansible Platforms: Kubernetes (EKS), ECS, Docker, Lambda, Airflow Observability: EFK, Prometheus, Grafana, Jaeger/OpenTelemetry Persistence: MySQL, PostgreSQL, MongoDB, Redis, Elasticsearch, Kafka Pipelines: GitHub Actions, AWS CodeBuild Runtimes: Python, Node.js, Golang Strong ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … monitoring. Required Skills 3 10 years experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift, EMR/Spark Apache Iceberg Python/SQL Experience in telecom data pipelines and handling large-scale structured/semi-structured data. Strong problem-solving, optimization, and debugging skills. ...