Period
to 19 September 2021

The following table provides summary statistics for contract job vacancies with a requirement for Apache Airflow skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Airflow over the 6 months to 19 September 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Airflow
UK
6 months to
19 Sep 2021
Same period 2020 Same period 2019
Rank 469 472 692
Rank change year-on-year +3 +220 +153
Contract jobs citing Apache Airflow 354 46 164
As % of all contract jobs advertised in the UK 0.45% 0.16% 0.18%
As % of the Application Platforms category 3.43% 1.03% 1.22%
Number of daily rates quoted 227 31 131
10th Percentile £463 £300 £431
25th Percentile £500 £425 £500
Median daily rate (50th Percentile) £550 £500 £525
Median % change year-on-year +10.00% -4.76% -6.67%
75th Percentile £675 £588 £650
90th Percentile £713 £675 £675
UK excluding London median daily rate £550 £475 £500
% change year-on-year +15.79% -5.00% +5.26%
Number of hourly rates quoted 2 0 2
10th Percentile " " "
25th Percentile £36.25 " £51.25
Median hourly rate £37.50 - £52.50
75th Percentile £38.75 " £53.75
90th Percentile " " "
UK excluding London median hourly rate - - £52.50

Apache Airflow is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for application platform skills.

All Application Platform Skills
UK
Contract vacancies with a requirement for application platform skills 10,309 4,466 13,462
As % of all contract IT jobs advertised in the UK 13.14% 15.11% 15.15%
Number of daily rates quoted 7,034 2,989 8,704
10th Percentile £300 £300 £263
25th Percentile £406 £381 £363
Median daily rate (50th Percentile) £500 £475 £460
Median % change year-on-year +5.26% +3.26% +2.22%
75th Percentile £590 £563 £556
90th Percentile £675 £655 £636
UK excluding London median daily rate £450 £450 £425
% change year-on-year - +5.88% -
Number of hourly rates quoted 181 113 310
10th Percentile £14.00 £12.63 £11.00
25th Percentile £16.28 £16.13 £14.00
Median hourly rate £24.50 £21.80 £20.87
Median % change year-on-year +12.39% +4.44% +4.36%
75th Percentile £53.75 £38.25 £39.71
90th Percentile £68.75 £59.50 £48.88
UK excluding London median hourly rate £22.18 £20.00 £20.50
% change year-on-year +10.90% -2.44% +7.89%

Apache Airflow
Job Vacancy Trend

Job postings citing Apache Airflow as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Airflow in the UK

Apache Airflow
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Apache Airflow.

Daily rate trend for Apache Airflow in the UK

Apache Airflow
Daily Rate Histogram

Daily rate distribution for jobs citing Apache Airflow over the 6 months to 19 September 2021.

Daily rate histogram for Apache Airflow in the UK

Apache Airflow
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Apache Airflow.

Hourly rate trend for Apache Airflow in the UK

Apache Airflow
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Airflow within the UK over the 6 months to 19 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -14 266 £575 +15.00% 68
London -27 214 £595 +19.00% 45
Work from Home -149 116 £588 +17.50% 5
UK excluding London -70 77 £550 +15.79% 29
Scotland - 31 £550 - 6
North of England - 18 £525 - 10
South East -69 13 £450 -14.29% 2
Yorkshire - 10 £550 - 2
North West - 5 £400 - 7
Wales - 5 £495 -
South West -36 3 £388 -11.93% 2
North East - 3 £525 - 1
Northern Ireland - 3 £475 -
East of England -39 2 - - 5
West Midlands - 2 £550 - 3
Midlands - 2 £550 - 4

For the 6 months to 19 September 2021, IT contractor jobs citing Apache Airflow also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Apache Airflow.

1 250 (70.62%) Python
2 211 (59.60%) AWS
3 173 (48.87%) SQL
4 143 (40.40%) Apache Spark
5 138 (38.98%) Kafka
6 135 (38.14%) Apache
7 123 (34.75%) Data Pipeline
8 122 (34.46%) Amazon S3
9 118 (33.33%) DevOps
10 113 (31.92%) Java
11 105 (29.66%) Data Engineering
12 103 (29.10%) Serverless
13 101 (28.53%) Agile Software Development
14 100 (28.25%) Azure
15 96 (27.12%) Databricks
16 83 (23.45%) Terraform
16 83 (23.45%) GCP
16 83 (23.45%) Analytics
16 83 (23.45%) ETL
17 82 (23.16%) Scala
18 80 (22.60%) Big Data
19 69 (19.49%) Data Warehouse
20 67 (18.93%) Finance
21 65 (18.36%) NoSQL
21 65 (18.36%) GitHub
22 64 (18.08%) Kubernetes
23 62 (17.51%) Hadoop
24 61 (17.23%) Data Modelling
25 60 (16.95%) Workflow
25 60 (16.95%) Data Science

Apache Airflow
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 143 (40.40%) Apache Spark
2 135 (38.14%) Apache
3 34 (9.60%) Luigi
4 15 (4.24%) Elasticsearch
4 15 (4.24%) SharePoint
5 11 (3.11%) Confluence
6 8 (2.26%) Cloud Foundry
7 7 (1.98%) Jupyter
8 6 (1.69%) Apache Pulsar
9 5 (1.41%) Mule
9 5 (1.41%) Oracle Workflow
10 4 (1.13%) SAS
11 1 (0.28%) DataSynapse
Applications
1 2 (0.56%) SPSS
Business Applications
1 7 (1.98%) SAP Oil and Gas
2 2 (0.56%) Dynamics AX
2 2 (0.56%) Dynamics CRM
2 2 (0.56%) NetSuite
2 2 (0.56%) Oracle EBS
Cloud Services
1 211 (59.60%) AWS
2 122 (34.46%) Amazon S3
3 103 (29.10%) Serverless
4 100 (28.25%) Azure
5 83 (23.45%) GCP
6 65 (18.36%) GitHub
7 52 (14.69%) Azure Functions
8 51 (14.41%) AWS Lambda
9 40 (11.30%) Slack
10 39 (11.02%) Amazon EC2
11 29 (8.19%) Azure Cosmos DB
12 28 (7.91%) Amazon EMR
13 20 (5.65%) AWS Step Functions
14 17 (4.80%) Amazon SQS
14 17 (4.80%) Power Platform
15 15 (4.24%) AWS CloudFormation
15 15 (4.24%) Snowflake
16 14 (3.95%) GitHub Actions
17 13 (3.67%) dbt
17 13 (3.67%) PaaS
Communications & Networking
1 8 (2.26%) Firewall
2 1 (0.28%) FTP
2 1 (0.28%) Kerberos
2 1 (0.28%) SSL
2 1 (0.28%) TCP/IP
Database & Business Intelligence
1 80 (22.60%) Big Data
2 69 (19.49%) Data Warehouse
3 65 (18.36%) NoSQL
4 62 (17.51%) Hadoop
5 58 (16.38%) BigQuery
6 51 (14.41%) Amazon Redshift
7 48 (13.56%) Amazon DynamoDB
8 43 (12.15%) PostgreSQL
9 40 (11.30%) Data Lake
10 36 (10.17%) Amazon Athena
11 35 (9.89%) Apache Hive
12 30 (8.47%) Amazon RDS
12 30 (8.47%) Apache Cassandra
13 26 (7.34%) Azkaban
14 24 (6.78%) Metadata
14 24 (6.78%) Tableau
15 22 (6.21%) Presto
16 21 (5.93%) Relational Database
17 18 (5.08%) Impala
17 18 (5.08%) Spark SQL
Development Applications
1 55 (15.54%) JIRA
2 41 (11.58%) Git (software)
3 32 (9.04%) Jenkins
4 26 (7.34%) GitLab
5 12 (3.39%) Sonatype Nexus
6 11 (3.11%) Artifactory
6 11 (3.11%) SonarQube
7 9 (2.54%) Bitbucket
8 7 (1.98%) Visual Studio Team System
9 6 (1.69%) ProC
9 6 (1.69%) RStudio
10 5 (1.41%) Oracle APEX
11 3 (0.85%) MLflow
12 2 (0.56%) CircleCI
13 1 (0.28%) Octopus Deploy
13 1 (0.28%) Pylint
13 1 (0.28%) Selenium
13 1 (0.28%) SpecFlow
13 1 (0.28%) utPLSQL
General
1 67 (18.93%) Finance
2 45 (12.71%) Social Skills
3 30 (8.47%) Front Office
4 26 (7.34%) Analytical Skills
5 24 (6.78%) Presentation Skills
6 14 (3.95%) Law
7 13 (3.67%) Banking
8 11 (3.11%) Publishing
9 8 (2.26%) Public Sector
10 6 (1.69%) Back Office
11 4 (1.13%) Marketing
12 3 (0.85%) Telecoms
13 2 (0.56%) Electronics
13 2 (0.56%) Games
13 2 (0.56%) Retail Banking
14 1 (0.28%) Financial Institution
14 1 (0.28%) Investment Banking
14 1 (0.28%) Organisational Skills
Job Titles
1 180 (50.85%) Data Engineer
2 49 (13.84%) AWS Engineer
3 44 (12.43%) Senior Data Engineer
4 39 (11.02%) Python Engineer
5 38 (10.73%) Software Engineer
6 37 (10.45%) Architect
7 35 (9.89%) Developer
8 24 (6.78%) Python Developer
9 23 (6.50%) Data Architect
10 22 (6.21%) Systems Engineer
11 21 (5.93%) Java Engineer
12 20 (5.65%) AWS Software Engineer
13 19 (5.37%) DevOps Engineer
13 19 (5.37%) Python Software Engineer
14 17 (4.80%) AWS Developer
14 17 (4.80%) Azure Engineer
14 17 (4.80%) Developer/Software Engineer
15 14 (3.95%) Senior Java Engineer
16 13 (3.67%) Cloud Engineer
16 13 (3.67%) Senior Systems Engineer
Libraries, Frameworks & Software Standards
1 138 (38.98%) Kafka
2 58 (16.38%) PySpark
3 23 (6.50%) Spark Streaming
3 23 (6.50%) Web Services
4 18 (5.08%) ARM Templates
5 17 (4.80%) AngularJS
5 17 (4.80%) Pandas
5 17 (4.80%) React
5 17 (4.80%) Vue.js
6 16 (4.52%) Apache NiFi
7 13 (3.67%) JSON
8 12 (3.39%) .NET
9 11 (3.11%) Apache Beam
10 10 (2.82%) ActiveMQ
10 10 (2.82%) Spring
10 10 (2.82%) Swagger
11 9 (2.54%) Velocity
12 8 (2.26%) ADO
12 8 (2.26%) Spring Boot
13 7 (1.98%) RabbitMQ
Miscellaneous
1 22 (6.21%) Management Information System
2 21 (5.93%) Data Structures
3 20 (5.65%) Equities
4 19 (5.37%) Derivative
4 19 (5.37%) Fixed Income
5 18 (5.08%) Foreign Exchange (FX)
6 16 (4.52%) Cloud Native
7 12 (3.39%) Data Centre
7 12 (3.39%) iPad
8 8 (2.26%) Replication
8 8 (2.26%) Virtual Team
9 7 (1.98%) Algorithms
10 6 (1.69%) Self-Motivation
11 3 (0.85%) Greenfield Project
11 3 (0.85%) NHS
11 3 (0.85%) Renewable Energy
12 2 (0.56%) Blog
12 2 (0.56%) Data Protection Act
12 2 (0.56%) Public Cloud
13 1 (0.28%) Hybrid Cloud
Operating Systems
1 13 (3.67%) Linux
2 7 (1.98%) Unix
3 2 (0.56%) Android
3 2 (0.56%) Apple iOS
Processes & Methodologies
1 123 (34.75%) Data Pipeline
2 118 (33.33%) DevOps
3 105 (29.66%) Data Engineering
4 101 (28.53%) Agile Software Development
5 83 (23.45%) Analytics
5 83 (23.45%) ETL
6 61 (17.23%) Data Modelling
7 60 (16.95%) Data Science
7 60 (16.95%) Workflow
8 57 (16.10%) Continuous Integration
8 57 (16.10%) Software Engineering
9 42 (11.86%) Continuous Delivery
10 38 (10.73%) Infrastructure as Code
11 36 (10.17%) Workflow Management
12 35 (9.89%) Event-Driven
13 34 (9.60%) Business Intelligence
13 34 (9.60%) Capacity Management
14 32 (9.04%) Migration
14 32 (9.04%) Runbook
14 32 (9.04%) Test Automation
Programming Languages
1 250 (70.62%) Python
2 173 (48.87%) SQL
3 113 (31.92%) Java
4 82 (23.16%) Scala
5 18 (5.08%) JavaScript
6 17 (4.80%) Kotlin
6 17 (4.80%) TypeScript
7 15 (4.24%) T-SQL
8 14 (3.95%) C++
9 9 (2.54%) PL/SQL
9 9 (2.54%) R
10 8 (2.26%) Shell Script
11 7 (1.98%) C#
12 5 (1.41%) Bash Shell
13 4 (1.13%) C
14 3 (0.85%) Ruby
15 2 (0.56%) Fortran
16 1 (0.28%) Go
Qualifications
1 24 (6.78%) Degree
2 20 (5.65%) Computer Science Degree
3 17 (4.80%) Security Cleared
4 14 (3.95%) SC Cleared
5 11 (3.11%) ISEB
6 4 (1.13%) BPSS Clearance
7 1 (0.28%) AWS Certification
7 1 (0.28%) CCA
7 1 (0.28%) DBS Check
7 1 (0.28%) MBA
Quality Assurance & Compliance
1 20 (5.65%) QA
2 10 (2.82%) Data Quality
3 1 (0.28%) Basel II
3 1 (0.28%) COBIT
System Software
1 44 (12.43%) Docker
2 14 (3.95%) Apache ZooKeeper
3 8 (2.26%) HDFS
4 6 (1.69%) Apache Flume
Systems Management
1 83 (23.45%) Terraform
2 64 (18.08%) Kubernetes
3 51 (14.41%) Grafana
4 38 (10.73%) Bosun
5 32 (9.04%) VictorOps
6 27 (7.63%) Ansible
7 19 (5.37%) Oozie
8 17 (4.80%) Rancher
9 9 (2.54%) Prometheus
10 7 (1.98%) Hadoop YARN
11 6 (1.69%) Opscode Chef
11 6 (1.69%) Puppet
12 3 (0.85%) Kibana
13 2 (0.56%) Tivoli
14 1 (0.28%) Argo
14 1 (0.28%) Oracle Enterprise Manager
Vendors
1 96 (27.12%) Databricks
2 53 (14.97%) Google
3 25 (7.06%) Microsoft
4 16 (4.52%) Cloudera
5 15 (4.24%) Oracle
6 12 (3.39%) SAP
7 10 (2.82%) Veracode
8 8 (2.26%) ServiceNow
8 8 (2.26%) Splunk
9 7 (1.98%) BiZZdesign
10 5 (1.41%) Confluent
11 4 (1.13%) Informatica
12 3 (0.85%) Alteryx
12 3 (0.85%) Guidewire
12 3 (0.85%) StreamSets
13 2 (0.56%) Atlassian
13 2 (0.56%) MicroStrategy
13 2 (0.56%) Talend
13 2 (0.56%) Teradata
14 1 (0.28%) IBM