76 to 99 of 99 Apache Airflow Jobs in the North of England

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

workflows Nice to Have Knowledge of FinOps principles and cloud cost optimisation Experience with orchestration tools such as Azure Data Factory, Databricks Workflows, or Airflow Exposure to containerisation tools (Kubernetes, Docker) Experience with data cataloguing tools Familiarity with unit testing in data pipelines Awareness of MLOps practices ...

AI. Comfortable working in a fast-paced, agile environment. Excellent communication and collaboration skills. Nice to Have Experience with workflow orchestration tools (e.g., Temporal, Airflow). Familiarity with vector databases or semantic search tools. Experience building internal tooling or developer productivity enhancements using AI. Exposure to customer support ...

scheduling using workflow tools Build and deploy containerised and serverless data solutions Apply software engineering fundamentals to data engineering challenges Technology Stack Snowflake dbt Airflow SQL (strong focus) Cloud platforms (AWS, Azure, or GCP) Containers and Function Apps SQLMesh (or similar data transformation frameworks) Requirements 2–3 years’ experience … containers and serverless/function-based architectures Good communication skills and a collaborative mindset Nice to Have Experience with Snowflake in production Exposure to Airflow orchestration Understanding of data versioning and testing frameworks Experience working in agile or product-led teams ...

scheduling using workflow tools Build and deploy containerised and serverless data solutions Apply software engineering fundamentals to data engineering challenges Technology Stack Snowflake dbt Airflow SQL (strong focus) Cloud platforms (AWS, Azure, or GCP) Containers and Function Apps SQLMesh (or similar data transformation frameworks) Requirements 2-3 years' experience … containers and serverless/function-based architectures Good communication skills and a collaborative mindset Nice to Have Experience with Snowflake in production Exposure to Airflow orchestration ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...