76 to 100 of 103 Apache Airflow Jobs in England

images to registries, and ensures secure and efficient AKS cluster deployments. Implements infrastructure as code using Terraform, including network, security, and compute resources. Supports Airflow as part of platform orchestration. Collaborates closely with Data Engineers, MLOps Engineers, and Solution Architects to ensure the infrastructure and pipelines meet performance, scalability ...

Data Engineer – FinTech – Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

support investment, client, operational, regulatory and enterprise data You have a strong knowledge of SQL combined with modern tools such as Snowflake and Airflow You have a strong understanding of enterprise data architecture concepts, including data domains, conceptual and logical modelling, integration patterns, lineage, metadata and lifecycle management ...

Job Title : Analytical Engineer Target Start Date: ASAP Contract Type: Permanent Salary Range: £55,000 - £70,000 Location: Reigate - Hybrid Closing Date for applications: 26th May Analytical Engineer: We are looking for a talented Analytical ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

Terraform and Ansible Awareness of critical concepts in DevOps and previous experience working in a large, structured organisation Experience working with Linux Python scripting Airflow or Packer experience would be really nice to have What you'll get in returnAn exciting opportunity to join an international organisation in financial ...

Terraform and Ansible Awareness of critical concepts in DevOps and previous experience working in a large, structured organisation Experience working with Linux Python scripting Airflow or Packer experience would be really nice to have What you'll get in return An exciting opportunity to join an international organisation ...

versions to understand success metrics You have advanced SQL skills and the technical ability to debug and make configuration amendments within DBT data pipelines, Airflow experience is desirable You can translate data into actionable marketing insights You have good business acumen and understanding of marketing metrics, KPIs and attribution ...

right questions, and making reasonable bets. Bonus Experience with IoT/telemetry, energy data, or time-series workloads Familiarity with event-driven architectures, GraphQL, Airflow, or Python Personal interest in energy, climate tech, or automation Track record of owning complex systems end-to-end 5+ years of experience This ...

implement lakehouse architecture standards (medallion model: bronze, silver, gold), including governance, lineage, and data quality controls Design and manage secure data ingestion frameworks (e.g. Apache NiFi, APIs, SFTP/FTPS) for internal and external data sources Architect and maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake … Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure as code, automated testing, versioning, environment promotion) Mentor engineers on distributed ...

they build. What You’ll Do Build and own data pipelines that connect product, analytics, and operations Design scalable architectures using tools like dbt , Airflow , and Snowflake/BigQuery Work with engineers and product teams to make data easily accessible and actionable Help evolve their data warehouse and ensure … decisions across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity ...

load balancers, VMware vSphere, HashiCorp Vault, Keycloak, ArgoCD, Helm Charts, SonarQube, Snyk. Implement object storage platforms using S3-compatible storage and MinIO. Setting up Apache Airflow, Cisco NSO, Itential at platform level. Develop, test and maintain backup and disaster recovery strategies. DevOps, CI/CD development and DevSecOps ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

data and analytics programmes, ensuring alignment with business goals, timelines, and quality standards. Planning, tracking, and managing complex technical dependencies across Snowflake, dbt, Airflow, and GitHub‐based development workflows. Collaborating closely with data engineering and analytics teams to support Snowflake architecture, performance optimisation, and cost management. Overseeing dbt project …/experience: Proven experience in a Technical Program Manager, Technical Project Manager, or similar role. Strong hands‐on understanding of Snowflake, dbt, GitHub, and Airflow in a production environment. Demonstrable experience delivering data engineering or analytics platform programmes. Solid understanding of modern data stacks, ETL pipelines, and cloud‐based ...

checks. Operational or production support mindset; experience in stabilizing live environments. Hands-on use of scheduling or workflow tools such as GitLab CI, Jenkins, Airflow, or Control M (or similar). Strong proficiency working with Linux platforms. Experience managing SSH servers. Ability to write and maintain Ansible scripts ...

growing environments Engineering-first mindset, ideally with a backend or software engineering background Desirable: Experience with Snowflake Orchestration tools such as Dagster or Airflow dbt for data transformation and modelling Apache Iceberg or modern table formats Background in high-growth, consumer-facing products SALARY AND BENEFITS Base salary ...

grade Python services, batch and streaming pipelines, and scheduled workflows Build production-grade data pipelines – develop idempotent, observable, and cost-efficient pipelines using BigQuery, Airflow, Google Workflows, and Cloud Run Implement CI/CD for ML workloads – automated validation, monitoring, rollback strategies, and model lifecycle management Establish reliability … productionizing ML models in batch and/or real-time environments Hands-on experience with analytical data warehouses (BigQuery or equivalent) and workflow orchestration (Airflow or similar) Experience deploying ML systems on GCP, including Cloud Run, GCS, and IAM Infrastructure-as-Code experience (Terraform or equivalent) Experience with feature ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

Backend: Scala, Java (Python desirable) Frontend: HTML, CSS, JavaScript Frameworks: Play, Spark Data: Postgres, MongoDB, Hudi Cloud: AWS (S3, ECS, Aurora, Lambda) DevOps: Jenkins, Airflow, Terraform Monitoring: Kibana, Grafana Ways of working: Agile (Scrum/Kanban), CI/CD, 'you build it, you run it' What We're Looking … modern DevOps practices Experience working in Agile, multidisciplinary teams Strong analytical and problem-solving skills Clear communicator and collaborative team player Desirable Python, Docker, Airflow Big data tools (e.g. Spark, EMR) Experience with data platforms or risk/fraud systems How You'll Work Deliver value iteratively and early ...