Period
to 16 October 2019

The following table provides summary statistics for contract job vacancies with a requirement for Apache Airflow skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Airflow over the 6 months to 16 October 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Airflow
UK
6 months to
16 Oct 2019
Same period 2018 Same period 2017
Rank 655 840 859
Rank change year-on-year +185 +19 -
Contract jobs citing Apache Airflow 154 72 25
As % of all contract IT jobs advertised in the UK 0.18% 0.070% 0.025%
As % of the Application Platforms category 1.21% 0.42% 0.15%
Number of daily rates quoted 119 59 20
UK median daily rate £525 £575 £463
Median daily rate % change year-on-year -8.70% +24.32% -
10th Percentile £430 £421 £386
90th Percentile £675 £628 £541
UK excluding London median daily rate £500 £563 £438
% change year-on-year -11.11% +28.57% -
Number of hourly rates quoted 2 0 2
UK median hourly rate £52.50 - £19.30
10th Percentile £51.25 - £16.64
90th Percentile £53.75 - £21.95
UK excluding London median hourly rate £52.50 - £19.30

Apache Airflow is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for application platform skills.

All Application Platform Skills
UK
Contract vacancies with a requirement for application platform skills 12,734 17,207 16,625
As % of all contract IT jobs advertised in the UK 14.95% 16.68% 16.75%
Number of daily rates quoted 8,214 11,197 10,840
UK median daily rate £451 £450 £440
Median daily rate % change year-on-year +0.17% +2.27% +4.76%
10th Percentile £263 £270 £263
90th Percentile £631 £625 £600
UK excluding London median daily rate £425 £425 £400
% change year-on-year - +6.25% +2.56%
Number of hourly rates quoted 318 414 409
UK median hourly rate £21.50 £21.50 £20.00
Median hourly rate % change year-on-year - +7.50% -
10th Percentile £11.00 £12.00 £11.00
90th Percentile £50.85 £51.03 £48.75
UK excluding London median hourly rate £20.52 £21.13 £20.00
% change year-on-year -2.86% +5.63% -4.26%

Apache Airflow
Job Vacancy Trend

Job postings citing Apache Airflow as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Airflow in the UK

Apache Airflow
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Airflow.

Contractor daily rate trend for Apache Airflow in the UK

Apache Airflow
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Airflow over the 6 months to 16 October 2019.

Contractor daily rate histogram for Apache Airflow in the UK

Apache Airflow
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Apache Airflow.

Contractor hourly rate trend for Apache Airflow in the UK

Apache Airflow
Top 9 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Airflow within the UK over the 6 months to 16 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +166 149 £525 -8.70% 36
London +144 130 £538 -6.52% 34
UK excluding London +88 21 £500 -11.11% 2
South East - 11 £500 - 1
North of England - 4 £475 -
East of England +30 3 £650 +13.04%
Scotland +27 3 - -
North West - 3 - -
Yorkshire - 1 £475 -

For the 6 months to 16 October 2019, IT contractor jobs citing Apache Airflow also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Apache Airflow.

1 120 (77.92%) Python
2 92 (59.74%) GCP
3 87 (56.49%) AWS
4 85 (55.19%) Big Data
5 84 (54.55%) SQL
6 79 (51.30%) Apache Spark
7 74 (48.05%) Apache
8 69 (44.81%) Google
9 62 (40.26%) Agile Software Development
10 61 (39.61%) BigQuery
10 61 (39.61%) Data Science
11 53 (34.42%) Data Engineering
12 48 (31.17%) ETL
13 42 (27.27%) Data Warehouse
13 42 (27.27%) Kafka
14 40 (25.97%) Hadoop
15 39 (25.32%) Amazon Redshift
15 39 (25.32%) PySpark
16 38 (24.68%) Scala
17 36 (23.38%) DevOps
18 35 (22.73%) Java
19 33 (21.43%) Analytics
20 27 (17.53%) Azure
21 25 (16.23%) Machine Learning
21 25 (16.23%) Docker
21 25 (16.23%) Coaching
21 25 (16.23%) Business Intelligence
22 24 (15.58%) Finance
23 23 (14.94%) PostgreSQL
23 23 (14.94%) Data Modelling

Apache Airflow
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 79 (51.30%) Apache Spark
2 74 (48.05%) Apache
3 17 (11.04%) Luigi
4 6 (3.90%) Elasticsearch
5 4 (2.60%) Jupyter
6 2 (1.30%) Apache Pig
6 2 (1.30%) SAS
7 1 (0.65%) Confluence
7 1 (0.65%) Oracle Workflow
Business Applications
1 1 (0.65%) Distributed Ledger
Cloud Services
1 92 (59.74%) GCP
2 87 (56.49%) AWS
3 27 (17.53%) Azure
4 15 (9.74%) Amazon Kinesis
4 15 (9.74%) GitHub
5 13 (8.44%) Amazon EMR
5 13 (8.44%) AWS Lambda
5 13 (8.44%) Serverless
6 12 (7.79%) Amazon S3
7 7 (4.55%) Cloud Computing
8 6 (3.90%) AWS Data Pipeline
8 6 (3.90%) Google Analytics
8 6 (3.90%) Power Platform
9 5 (3.25%) Amazon SageMaker
10 4 (2.60%) Google Tag Manager
10 4 (2.60%) Tricentis Tosca
11 3 (1.95%) Qubole
12 2 (1.30%) Amazon EC2
12 2 (1.30%) Amazon EKS
12 2 (1.30%) AWS CloudFormation
Communications & Networking
1 1 (0.65%) HTTP
1 1 (0.65%) Skype
Database & Business Intelligence
1 85 (55.19%) Big Data
2 61 (39.61%) BigQuery
3 42 (27.27%) Data Warehouse
4 40 (25.97%) Hadoop
5 39 (25.32%) Amazon Redshift
6 23 (14.94%) PostgreSQL
7 19 (12.34%) Apache Hive
7 19 (12.34%) NoSQL
8 18 (11.69%) Snowflake Schema
8 18 (11.69%) SQL Server
9 17 (11.04%) Relational Database
10 15 (9.74%) Data Lake
11 12 (7.79%) Amazon Athena
12 11 (7.14%) Apache Cassandra
13 8 (5.19%) MongoDB
14 6 (3.90%) MySQL
14 6 (3.90%) Neo4j
14 6 (3.90%) Parquet
14 6 (3.90%) Power BI
14 6 (3.90%) RDBMS
Development Applications
1 23 (14.94%) Jenkins
2 16 (10.39%) Git (software)
3 8 (5.19%) Atlassian Bamboo
3 8 (5.19%) CircleCI
3 8 (5.19%) GitLab
3 8 (5.19%) ProC
4 5 (3.25%) JIRA
5 4 (2.60%) Selenium
6 3 (1.95%) IntelliJ
6 3 (1.95%) Maven
6 3 (1.95%) PyCharm
7 2 (1.30%) Bitbucket
7 2 (1.30%) Bitbucket Server
7 2 (1.30%) JUnit
7 2 (1.30%) Octopus Deploy
8 1 (0.65%) GoCD
General
1 24 (15.58%) Finance
2 12 (7.79%) Banking
3 9 (5.84%) Investment Banking
4 8 (5.19%) Legal
4 8 (5.19%) Marketing
4 8 (5.19%) Retail
5 6 (3.90%) Advertising
6 4 (2.60%) Games
7 3 (1.95%) Telecoms
8 1 (0.65%) Corporate Banking
8 1 (0.65%) Financial Institution
8 1 (0.65%) Retail Banking
Job Titles
1 109 (70.78%) Data Engineer
2 42 (27.27%) Python Engineer
3 40 (25.97%) Big Data Engineer
4 22 (14.29%) AWS Engineer
5 16 (10.39%) Cloud Engineer
6 14 (9.09%) Senior Data Engineer
7 13 (8.44%) Architect
8 8 (5.19%) Data Architect
8 8 (5.19%) Developer
9 5 (3.25%) Platform Engineer
10 4 (2.60%) Cloud Architect
10 4 (2.60%) Consultant
10 4 (2.60%) Data Consultant
10 4 (2.60%) Data Modeller
10 4 (2.60%) Head of Architecture
10 4 (2.60%) Head of Big Data
10 4 (2.60%) Head of Data Architecture
10 4 (2.60%) Head of Engineering
11 3 (1.95%) Cloud Developer
11 3 (1.95%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 42 (27.27%) Kafka
2 39 (25.32%) PySpark
3 13 (8.44%) Apache Beam
4 11 (7.14%) Apache NiFi
4 11 (7.14%) Spark Streaming
5 9 (5.84%) Pandas
6 7 (4.55%) Velocity
7 6 (3.90%) Web Services
8 4 (2.60%) Natural Language Processing
8 4 (2.60%) scikit-learn
8 4 (2.60%) TinkerPop
9 3 (1.95%) GraphQL
9 3 (1.95%) JSON
9 3 (1.95%) Node.js
9 3 (1.95%) REST
9 3 (1.95%) XML
10 2 (1.30%) PostGIS
10 2 (1.30%) Swagger
11 1 (0.65%) LAPP Stack
11 1 (0.65%) TensorFlow
Miscellaneous
1 11 (7.14%) Algorithms
2 7 (4.55%) Analytical Skills
3 6 (3.90%) Data Structures
3 6 (3.90%) Public Cloud
3 6 (3.90%) Self-Motivation
4 5 (3.25%) Greenfield Project
5 4 (2.60%) Linux Command Line
6 3 (1.95%) Online Games
7 2 (1.30%) Cloud Native
8 1 (0.65%) Hedge funds
8 1 (0.65%) Pricing Data
8 1 (0.65%) User Experience
Operating Systems
1 8 (5.19%) Linux
1 8 (5.19%) Unix
2 4 (2.60%) Windows
Processes & Methodologies
1 62 (40.26%) Agile Software Development
2 61 (39.61%) Data Science
3 53 (34.42%) Data Engineering
4 48 (31.17%) ETL
5 36 (23.38%) DevOps
6 33 (21.43%) Analytics
7 25 (16.23%) Business Intelligence
7 25 (16.23%) Coaching
7 25 (16.23%) Machine Learning
8 23 (14.94%) Data Modelling
9 22 (14.29%) Mentoring
10 21 (13.64%) Data Cleansing
11 15 (9.74%) Workflow
12 14 (9.09%) Continuous Delivery
13 12 (7.79%) Continuous Integration
13 12 (7.79%) Workflow Management
14 11 (7.14%) Kimball Methodology
14 11 (7.14%) Problem-Solving
14 11 (7.14%) TDD
15 10 (6.49%) Data Transformation
Programming Languages
1 120 (77.92%) Python
2 84 (54.55%) SQL
3 38 (24.68%) Scala
4 35 (22.73%) Java
5 16 (10.39%) Bash Shell
6 9 (5.84%) Go
7 5 (3.25%) C++
8 3 (1.95%) AWK
8 3 (1.95%) R
8 3 (1.95%) Ruby
8 3 (1.95%) sed
9 2 (1.30%) JavaScript
9 2 (1.30%) PL/SQL
10 1 (0.65%) C#
10 1 (0.65%) Perl
10 1 (0.65%) PHP
10 1 (0.65%) Shell Script
Qualifications
1 5 (3.25%) Degree
2 4 (2.60%) Computer Science Degree
3 3 (1.95%) SC Cleared
3 3 (1.95%) Security Cleared
4 2 (1.30%) PhD
5 1 (0.65%) Master's Degree
Quality Assurance & Compliance
1 6 (3.90%) Data Quality
2 4 (2.60%) GDPR
System Software
1 25 (16.23%) Docker
2 5 (3.25%) HDFS
3 1 (0.65%) Apache Flume
3 1 (0.65%) Apache ZooKeeper
Systems Management
1 23 (14.94%) Terraform
2 14 (9.09%) Kubernetes
3 8 (5.19%) Ansible
3 8 (5.19%) Oozie
4 4 (2.60%) Hadoop YARN
5 2 (1.30%) Puppet
6 1 (0.65%) Ambari
Vendors
1 69 (44.81%) Google
2 15 (9.74%) Tableau
3 9 (5.84%) Atlassian
4 7 (4.55%) Teradata
5 6 (3.90%) Talend
6 5 (3.25%) Informatica
6 5 (3.25%) Oracle
7 4 (2.60%) MapR
8 2 (1.30%) Cloudera
8 2 (1.30%) Hortonworks
8 2 (1.30%) Sage
8 2 (1.30%) Snowplow
8 2 (1.30%) StreamSets
8 2 (1.30%) Sybase
9 1 (0.65%) Ab Initio
9 1 (0.65%) Cognos
9 1 (0.65%) Databricks
9 1 (0.65%) SAP