76 to 100 of 105 Apache Airflow Jobs in England

Senior Data Engineer (Ref: 196438)

Hiring Organisation
Forsyth Barnes
Location
City of London, London, United Kingdom
implement lakehouse architecture standards (medallion model: bronze, silver, gold), including governance, lineage, and data quality controls Design and manage secure data ingestion frameworks (e.g. Apache NiFi, APIs, SFTP/FTPS) for internal and external data sources Architect and maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake … Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure as code, automated testing, versioning, environment promotion) Mentor engineers on distributed ...

Senior Data Engineer | FX Trading House | London (Hybrid - 3 Days) | Up to £110,000 + Bonus & Benefits | West London

Hiring Organisation
VirtueTech Recruitment Group
Location
London Area, United Kingdom
cloud-agnostic environment, leveraging a mix of technologies including Databricks, Snowflake, Azure Fabric/Synapse, and a modern open-source stack such as Airflow, Kafka, and ClickHouse. Key Responsibilities Design, build, and maintain scalable data pipelines (primarily in Python) Architect and evolve a modern data platform (ingestion, lake, warehouse … consumption layers) Develop and optimise data warehousing solutions, including ClickHouse and cloud-based platforms Implement and manage data orchestration using Airflow and other open-source tools Contribute to a data mesh architecture, leveraging Kafka or similar messaging technologies Define and maintain data models and semantic layers for business consumption ...

Senior Data Engineer (AWS)

Hiring Organisation
Kinvr Digital
Location
City of London, London, United Kingdom
moving away from legacy systems towards a scalable, cloud-native stack. What you'll be working on: Building and maintaining scalable data pipelines using Airflow and dbt Working across AWS cloud infrastructure Collaborating with analysts and data scientists to deliver reliable, clean data for downstream reporting and business decision … governance, and best practices across the team What they're looking for: Proven data engineering experience with strong Python and SQL Hands-on with Airflow and/or dbt Solid AWS experience Experience with ETL pipeline development at scale Comfortable working in Agile/Scrum environments Full right ...

Lead Data Engineer - Hybrid working

Hiring Organisation
Ashdown Group
Location
Central London, London, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£90,000
ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

Data Engineer

Hiring Organisation
Akkodis
Location
Stevenage, England, United Kingdom
Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group ...

Head of Business Intelligence

Hiring Organisation
Talent International
Location
Bristol, Somerset, United Kingdom
Employment Type
Permanent
Salary
GBP 60,000 - 80,000 Annual
GDPR) isn't a "nice to have"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

Data DevOps Engineer

Hiring Organisation
Sanderson Recruitment
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£420 - £461 per day + Inside IR-35
warehousing concepts Familiarity with version control systems, particularly Git Desirable Skills: Experience with infrastructure as code tools such as Terraform or CloudFormation Exposure to Apache Spark for distributed data processing Familiarity with workflow orchestration tools such as Airflow or AWS Step Functions Understanding of containerisation using Docker Experience ...

Mid Level Data Engineer

Hiring Organisation
VIQU IT Recruitment
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£45,000 - £55,000 per annum
Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration … pipelines Strong SQL and Python skills, with hands-on experience building data pipelines Experience with DBT, Terraform, and version control (Git) Exposure to Airflow (or similar orchestration tools), Docker, and CI/CD practices Cloud experience in GCP (BigQuery preferred) or Azure/AWS environments Understanding of modern data ...

Mid Level Data Engineer

Hiring Organisation
VIQU IT
Location
Greater London, Ludford, Shropshire, United Kingdom
Employment Type
Permanent
Salary
£45000 - £55000/annum
Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration … pipelines Strong SQL and Python skills, with hands-on experience building data pipelines Experience with DBT, Terraform, and version control (Git) Exposure to Airflow (or similar orchestration tools), Docker, and CI/CD practices Cloud experience in GCP (BigQuery preferred) or Azure/AWS environments Understanding of modern data ...

Technical Program Manager

Hiring Organisation
Tata Consultancy Services
Location
City of London, London, United Kingdom
data and analytics programmes, ensuring alignment with business goals, timelines, and quality standards. Planning, tracking, and managing complex technical dependencies across Snowflake, dbt, Airflow, and GitHub‐based development workflows. Collaborating closely with data engineering and analytics teams to support Snowflake architecture, performance optimisation, and cost management. Overseeing dbt project …/experience: Proven experience in a Technical Program Manager, Technical Project Manager, or similar role. Strong hands‐on understanding of Snowflake, dbt, GitHub, and Airflow in a production environment. Demonstrable experience delivering data engineering or analytics platform programmes. Solid understanding of modern data stacks, ETL pipelines, and cloud‐based ...

Senior Data Engineer

Hiring Organisation
Talent Insights Group
Location
City of London, Greater London, UK
Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making … well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance SQL and implement data ...

Senior Data Operations Engineer

Hiring Organisation
Morson Edge
Location
City of London, London, United Kingdom
Employment Type
Contract, Work From Home
Contract Rate
£550 - 650 per day
root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte DBT Apache Spark Grafana ...

Senior Machine Learning Engineer

Hiring Organisation
Onsera Health
Location
London Area, United Kingdom
grade Python services, batch and streaming pipelines, and scheduled workflows Build production-grade data pipelines – develop idempotent, observable, and cost-efficient pipelines using BigQuery, Airflow, Google Workflows, and Cloud Run Implement CI/CD for ML workloads – automated validation, monitoring, rollback strategies, and model lifecycle management Establish reliability … productionizing ML models in batch and/or real-time environments Hands-on experience with analytical data warehouses (BigQuery or equivalent) and workflow orchestration (Airflow or similar) Experience deploying ML systems on GCP, including Cloud Run, GCS, and IAM Infrastructure-as-Code experience (Terraform or equivalent) Experience with feature ...

Senior Data Engineer (AWS, Airflow, DBT)

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
Nottingham, Nottinghamshire, England, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £100,000 per annum
EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

Senior Data Engineer (AWS, Airflow, DBT)

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
Manchester, Lancashire, England, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £100,000 per annum
EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

Senior Data Engineer (AWS, Airflow, DBT)

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
Birmingham, West Midlands, England, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £100,000 per annum
EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

Senior Data Engineer (AWS, Airflow, DBT)

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
Leeds, West Yorkshire, England, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £100,000 per annum
EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

Scala Engineer

Hiring Organisation
Sanderson Government and Defence
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£55 - £79 per hour
Backend: Scala, Java (Python desirable) Frontend: HTML, CSS, JavaScript Frameworks: Play, Spark Data: Postgres, MongoDB, Hudi Cloud: AWS (S3, ECS, Aurora, Lambda) DevOps: Jenkins, Airflow, Terraform Monitoring: Kibana, Grafana Ways of working: Agile (Scrum/Kanban), CI/CD, 'you build it, you run it' What We're Looking … modern DevOps practices Experience working in Agile, multidisciplinary teams Strong analytical and problem-solving skills Clear communicator and collaborative team player Desirable Python, Docker, Airflow Big data tools (e.g. Spark, EMR) Experience with data platforms or risk/fraud systems How You'll Work Deliver value iteratively and early ...

Business Development Manager - Construction

Hiring Organisation
Remarkable Jobs
Location
Wokingham, Berkshire, United Kingdom
Employment Type
Permanent
Salary
GBP 35,000 - 45,000 Annual
developing and growing sales of a range of high-quality testing and measurement instruments , used by engineers to assess building performance, air quality, airflow, temperature, pressure and environmental conditions. This role will be primarily office-based , focusing on developing client relationships, managing incoming enquiries and proactively identifying sales opportunities ...

Data Scientist High-Growth Technology Consultancy | Hybrid (UK)

Hiring Organisation
IT Graduate Recruitment
Location
North East, England, United Kingdom
Employment Type
Full-Time
Salary
Salary negotiable
these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex, large-scale … complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

Junior Analytics Engineer

Hiring Organisation
Hillarys HR
Location
Nottingham, Nottinghamshire, East Midlands, United Kingdom
Employment Type
Permanent
We're looking for an experienced Analytics Engineer to help shape our data foundations and deliver high quality, trusted insights across the business. You'll design and maintain scalable analytics models, ensure data quality, and ...

Data Engineer

Hiring Organisation
Stable
Location
Reading, England, United Kingdom
across batch and streaming workloads. Skilled in building and maintaining data-streaming pipelines (e.g., Kafka, Spark Streaming, or equivalent). Proficiency with Databricks and Apache Spark for large-scale data processing. Experience with Hadoop and/or wider Apache ecosystem tools (e.g., Kafka, NiFi, Airflow). Strong … multi-national environments. Key Responsibilities: Design, build, and optimise data ingestion, transformation, and integration pipelines. Implement scalable processing frameworks using Databricks, Spark, Hadoop, and Apache technologies. Develop and support real-time and near-real-time data-streaming pipelines for engineering and operational data. Integrate engineering datasets across ...

Data Engineer (Spark/ Kubernetes) (Financial Services)

Hiring Organisation
Hays Specialist Recruitment Limited
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£625 - £745 per day
financial services organisation Your new role We are seeking a Data Engineer to support the replacement of a legacy ETL tool with a modern Apache Spark based data platform. This is a hands-on engineering role focused on building and supporting Spark jobs, with an emphasis on performance, reliability … scalability.The role is focused on building nonperformance Apache Spark jobs, with a strong emphasis on performance optimisation. Working in containerised environments using Kubernetes is a key element also as well as experience across Python/Scala and Java.The role sits within a small Agile delivery team of four engineers ...

Data Engineering Manager

Hiring Organisation
Travelex
Location
City of London, London, United Kingdom
security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented … engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product ...

Head of Data Engineering - Hands-On - Up to £130k

Hiring Organisation
Oliver Bernard
Location
London Area, United Kingdom
Head of Data Engineering - SQL, Python, DBT, Airflow, Looker, AWS OB have once again partnered with a leading PropTech company, who are undergoing a Data transformation, and are looking for a hands-on Head of Data Engineering to come in and spearhead this, by taking full ownership of their … with a modern data stack, with a view to grow out a team in the near future. Head of Data Engineering - SQL, Python, DBT, Airflow, Looker, AWS Key skills and experience: Demonstrated experience with SQL & Python Knowledge of DBT, Airflow & Looker Snowflake experience or a similar Data warehousing ...