76 to 100 of 112 Apache Airflow Jobs in England

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

right questions, and making reasonable bets. Bonus Experience with IoT/telemetry, energy data, or time-series workloads Familiarity with event-driven architectures, GraphQL, Airflow, or Python Personal interest in energy, climate tech, or automation Track record of owning complex systems end-to-end 5+ years of experience This ...

they build. What You’ll Do Build and own data pipelines that connect product, analytics, and operations Design scalable architectures using tools like dbt , Airflow , and Snowflake/BigQuery Work with engineers and product teams to make data easily accessible and actionable Help evolve their data warehouse and ensure … decisions across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

warehousing concepts Familiarity with version control systems, particularly Git Desirable Skills: Experience with infrastructure as code tools such as Terraform or CloudFormation Exposure to Apache Spark for distributed data processing Familiarity with workflow orchestration tools such as Airflow or AWS Step Functions Understanding of containerisation using Docker Experience ...

moving away from legacy systems towards a scalable, cloud-native stack. What you'll be working on: Building and maintaining scalable data pipelines using Airflow and dbt Working across AWS cloud infrastructure Collaborating with analysts and data scientists to deliver reliable, clean data for downstream reporting and business decision … governance, and best practices across the team What they're looking for: Proven data engineering experience with strong Python and SQL Hands-on with Airflow and/or dbt Solid AWS experience Experience with ETL pipeline development at scale Comfortable working in Agile/Scrum environments Full right ...

Hybrid) | Digital Transformation Consultancy Location : Manchester (Hybrid - 3 days a week) Package : £55k-£70k + Benefits Python | Cloud (AWS/Azure/GCP) | Kafka | Airflow | PostgreSQL | Observability This client builds mission‐critical digital platforms that make the UK smarter, safer, greener and healthier. They are a growing digital transformation … Design and implement scalable ETL/ELT pipelines and data models for enterprise platforms Build and operate event‐driven architectures (Kafka) and orchestrate workflows (Airflow) Implement data quality, testing and validation as first‐class concerns across pipelines Deliver monitoring and observability (Prometheus, Grafana or equivalent) and runbook automation Work ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

grade Python services, batch and streaming pipelines, and scheduled workflows Build production-grade data pipelines – develop idempotent, observable, and cost-efficient pipelines using BigQuery, Airflow, Google Workflows, and Cloud Run Implement CI/CD for ML workloads – automated validation, monitoring, rollback strategies, and model lifecycle management Establish reliability … productionizing ML models in batch and/or real-time environments Hands-on experience with analytical data warehouses (BigQuery or equivalent) and workflow orchestration (Airflow or similar) Experience deploying ML systems on GCP, including Cloud Run, GCS, and IAM Infrastructure-as-Code experience (Terraform or equivalent) Experience with feature ...

data and analytics programmes, ensuring alignment with business goals, timelines, and quality standards. Planning, tracking, and managing complex technical dependencies across Snowflake, dbt, Airflow, and GitHub‐based development workflows. Collaborating closely with data engineering and analytics teams to support Snowflake architecture, performance optimisation, and cost management. Overseeing dbt project …/experience: Proven experience in a Technical Program Manager, Technical Project Manager, or similar role. Strong hands‐on understanding of Snowflake, dbt, GitHub, and Airflow in a production environment. Demonstrable experience delivering data engineering or analytics platform programmes. Solid understanding of modern data stacks, ETL pipelines, and cloud‐based ...

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group ...

+ delivery). Strong command of APIs, event-driven patterns, queues, webhooks and orchestration methods. Hands‐on with Azure APIM, MuleSoft, Boomi, WSO2, Kafka, Airflow or similar. Understanding of data lineage, transformation and complex data flows. Enterprise security, IAM and API governance expertise. (Desirable) Exposure to Lloyd ...

GDPR) isn't a "nice to have"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making … well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance SQL and implement data ...

outputs into Tableau/Power BI • Improving data quality, reliability and observability across the platform • Building CI/CD processes and orchestration workflows using Airflow or similar tools • Working directly with investment, research, finance and asset management stakeholders • Helping the business improve efficiency through automation • Supporting future initiatives around … data engineering, analytics engineering or data platform work • Strong Python and SQL • Snowflake or similar cloud data warehouse experience • CI/CD experience • Airflow or similar orchestration experience • Strong understanding of data pipelines, modelling and automation • Experience working with reporting tools such as Tableau or Power BI • Confidence working ...

Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration … pipelines Strong SQL and Python skills, with hands-on experience building data pipelines Experience with DBT, Terraform, and version control (Git) Exposure to Airflow (or similar orchestration tools), Docker, and CI/CD practices Cloud experience in GCP (BigQuery preferred) or Azure/AWS environments Understanding of modern data ...

Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration … pipelines Strong SQL and Python skills, with hands-on experience building data pipelines Experience with DBT, Terraform, and version control (Git) Exposure to Airflow (or similar orchestration tools), Docker, and CI/CD practices Cloud experience in GCP (BigQuery preferred) or Azure/AWS environments Understanding of modern data ...

root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte DBT Apache Spark Grafana ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...