76 to 100 of 105 Apache Airflow Jobs in England

Viya 4 Experience delivering large-scale migration programmes Desirable Knowledge of CI/CD pipelines and DevOps practices Experience integrating SAS with: o Airflow or alternative schedulers o Data platforms (eg Snowflake, Databricks) Understanding of data security and access models Experience in public sector/regulated environments (eg HMRC ...

versions to understand success metrics You have advanced SQL skills and the technical ability to debug and make configuration amendments within DBT data pipelines, Airflow experience is desirable You can translate data into actionable marketing insights You have good business acumen and understanding of marketing metrics, KPIs and attribution ...

Job Title : Analytical Engineer Target Start Date: ASAP Contract Type: Permanent Salary Range: £55,000 - £70,000 Location: Reigate - Hybrid Closing Date for applications: 26th May Analytical Engineer: We are looking for a talented Analytical ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

Terraform and Ansible Awareness of critical concepts in DevOps and previous experience working in a large, structured organisation Experience working with Linux Python scripting Airflow or Packer experience would be really nice to have What you'll get in return An exciting opportunity to join an international organisation ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

support investment, client, operational, regulatory and enterprise data You have a strong knowledge of SQL combined with modern tools such as Snowflake and Airflow You have a strong understanding of enterprise data architecture concepts, including data domains, conceptual and logical modelling, integration patterns, lineage, metadata and lifecycle management ...

right questions, and making reasonable bets. Bonus Experience with IoT/telemetry, energy data, or time-series workloads Familiarity with event-driven architectures, GraphQL, Airflow, or Python Personal interest in energy, climate tech, or automation Track record of owning complex systems end-to-end 5+ years of experience This ...

implement lakehouse architecture standards (medallion model: bronze, silver, gold), including governance, lineage, and data quality controls Design and manage secure data ingestion frameworks (e.g. Apache NiFi, APIs, SFTP/FTPS) for internal and external data sources Architect and maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake … Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure as code, automated testing, versioning, environment promotion) Mentor engineers on distributed ...

load balancers, VMware vSphere, HashiCorp Vault, Keycloak, ArgoCD, Helm Charts, SonarQube, Snyk. Implement object storage platforms using S3-compatible storage and MinIO. Setting up Apache Airflow, Cisco NSO, Itential at platform level. Develop, test and maintain backup and disaster recovery strategies. DevOps, CI/CD development and DevSecOps ...

warehousing concepts Familiarity with version control systems, particularly Git Desirable Skills: Experience with infrastructure as code tools such as Terraform or CloudFormation Exposure to Apache Spark for distributed data processing Familiarity with workflow orchestration tools such as Airflow or AWS Step Functions Understanding of containerisation using Docker Experience ...

moving away from legacy systems towards a scalable, cloud-native stack. What you'll be working on: Building and maintaining scalable data pipelines using Airflow and dbt Working across AWS cloud infrastructure Collaborating with analysts and data scientists to deliver reliable, clean data for downstream reporting and business decision … governance, and best practices across the team What they're looking for: Proven data engineering experience with strong Python and SQL Hands-on with Airflow and/or dbt Solid AWS experience Experience with ETL pipeline development at scale Comfortable working in Agile/Scrum environments Full right ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

grade Python services, batch and streaming pipelines, and scheduled workflows Build production-grade data pipelines – develop idempotent, observable, and cost-efficient pipelines using BigQuery, Airflow, Google Workflows, and Cloud Run Implement CI/CD for ML workloads – automated validation, monitoring, rollback strategies, and model lifecycle management Establish reliability … productionizing ML models in batch and/or real-time environments Hands-on experience with analytical data warehouses (BigQuery or equivalent) and workflow orchestration (Airflow or similar) Experience deploying ML systems on GCP, including Cloud Run, GCS, and IAM Infrastructure-as-Code experience (Terraform or equivalent) Experience with feature ...

data and analytics programmes, ensuring alignment with business goals, timelines, and quality standards. Planning, tracking, and managing complex technical dependencies across Snowflake, dbt, Airflow, and GitHub‐based development workflows. Collaborating closely with data engineering and analytics teams to support Snowflake architecture, performance optimisation, and cost management. Overseeing dbt project …/experience: Proven experience in a Technical Program Manager, Technical Project Manager, or similar role. Strong hands‐on understanding of Snowflake, dbt, GitHub, and Airflow in a production environment. Demonstrable experience delivering data engineering or analytics platform programmes. Solid understanding of modern data stacks, ETL pipelines, and cloud‐based ...

checks. Operational or production support mindset; experience in stabilizing live environments. Hands-on use of scheduling or workflow tools such as GitLab CI, Jenkins, Airflow, or Control M (or similar). Strong proficiency working with Linux platforms. Experience managing SSH servers. Ability to write and maintain Ansible scripts ...

growing environments Engineering-first mindset, ideally with a backend or software engineering background Desirable: Experience with Snowflake Orchestration tools such as Dagster or Airflow dbt for data transformation and modelling Apache Iceberg or modern table formats Background in high-growth, consumer-facing products SALARY AND BENEFITS Base salary ...

pipelines , enable analytics, and drive best practices across data engineering and CI/CD. What you’ll do Build/operate pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub Model and optimise BigQuery (partitioning, clustering, cost & performance) Deliver ELT with dbt (models, incremental loads, testing, documentation/… Improve data quality, monitoring, alerting, reliability and operational runbooks Must-have skills ✅ GCP: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Cloud Composer (Airflow) ✅ Strong SQL + Python (Spark/Java a plus) ✅ dbt for BigQuery + testing/data quality ✅ CI/CD (Jenkins/GitHub Actions/ ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...