Period
to 17 August 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 17 August 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
UK > England
6 months to
17 Aug 2019
Same period 2018 Same period 2017
Rank 694 669 649
Rank change year-on-year -25 -20 +189
Contract jobs citing Hadoop YARN 116 192 172
As % of all contract IT jobs advertised in England 0.14% 0.20% 0.19%
As % of the Systems Management category 0.93% 1.48% 1.70%
Number of daily rates quoted 69 142 114
England median daily rate £575 £525 £525
Median daily rate % change year-on-year +9.52% - -8.70%
10th Percentile £490 £488 £273
90th Percentile £710 £711 £646
UK median daily rate £575 £525 £525
% change year-on-year +9.52% - -8.70%
Number of hourly rates quoted 0 0 0
England median hourly rate - - -
UK median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for systems management skills.

All Systems Management Skills
England
Contract vacancies with a requirement for systems management skills 12,421 12,966 10,127
As % of all contract IT jobs advertised in England 14.94% 13.78% 11.48%
Number of daily rates quoted 8,389 8,772 6,759
England median daily rate £500 £490 £475
Median daily rate % change year-on-year +2.04% +3.16% +8.57%
10th Percentile £300 £289 £275
90th Percentile £675 £650 £613
UK median daily rate £500 £475 £460
% change year-on-year +5.26% +3.26% +8.24%
Number of hourly rates quoted 276 368 223
England median hourly rate £20.00 £19.25 £17.50
Median hourly rate % change year-on-year +3.90% +10.00% -17.96%
10th Percentile £12.00 £12.25 £10.55
90th Percentile £50.90 £48.48 £47.76
UK median hourly rate £20.95 £19.25 £17.50
% change year-on-year +8.82% +10.00% -22.22%

Hadoop YARN
Job Vacancy Trend in England

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop YARN in England

Hadoop YARN
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN in England.

Contractor daily rate trend for Hadoop YARN in England

Hadoop YARN
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Hadoop YARN in England over the 6 months to 17 August 2019.

Contractor daily rate histogram for Hadoop YARN in England

Hadoop YARN
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the England region over the 6 months to 17 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +2 74 £600 +14.29% 11
South East -12 21 £473 -5.50%
Midlands +41 11 £513 - 1
West Midlands - 11 £513 -
North of England +31 5 £575 +12.20% 1
Yorkshire +19 4 £575 +15.00%
South West -18 4 £485 -11.82%
North West +10 1 £525 - 1
Hadoop YARN
UK

For the 6 months to 17 August 2019, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop YARN.

1 92 (79.31%) Apache Spark
2 86 (74.14%) Hadoop
3 70 (60.34%) Apache Hive
3 70 (60.34%) Big Data
4 69 (59.48%) Python
5 61 (52.59%) Java
6 59 (50.86%) Agile Software Development
7 57 (49.14%) SQL
7 57 (49.14%) Linux
7 57 (49.14%) HBase
8 55 (47.41%) Kafka
9 52 (44.83%) HDFS
10 50 (43.10%) Unix
11 45 (38.79%) Jenkins
11 45 (38.79%) Scala
12 40 (34.48%) Impala
13 39 (33.62%) Git (software)
13 39 (33.62%) Apache
14 37 (31.90%) DevOps
15 32 (27.59%) TDD
16 31 (26.72%) Cloudera
17 30 (25.86%) Amazon AWS
17 30 (25.86%) Spring
17 30 (25.86%) Finance
18 27 (23.28%) Docker
19 26 (22.41%) Google Cloud Platform
19 26 (22.41%) Analytics
19 26 (22.41%) Linux Command Line
20 25 (21.55%) ETL
21 23 (19.83%) Shell Script

Hadoop YARN
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 92 (79.31%) Apache Spark
2 39 (33.62%) Apache
3 21 (18.10%) Elasticsearch
4 13 (11.21%) Apache Solr
5 6 (5.17%) JBoss
6 5 (4.31%) Apache Airflow
6 5 (4.31%) IIS
6 5 (4.31%) nginx
7 4 (3.45%) Apache Pig
7 4 (3.45%) Jupyter
8 2 (1.72%) Confluence
Cloud Services
1 30 (25.86%) Amazon AWS
2 26 (22.41%) Google Cloud Platform
3 22 (18.97%) GitHub
4 14 (12.07%) Microsoft Azure
5 11 (9.48%) Yarn
6 10 (8.62%) Amazon S3
7 9 (7.76%) Amazon EMR
8 6 (5.17%) Amazon EC2
8 6 (5.17%) Serverless
9 5 (4.31%) AWS Lambda
9 5 (4.31%) npm
10 4 (3.45%) Amazon CloudWatch
10 4 (3.45%) AWS CloudTrail
10 4 (3.45%) OpenShift
11 3 (2.59%) Cloud Computing
11 3 (2.59%) Virtual Private Cloud
12 2 (1.72%) Amazon ECS
12 2 (1.72%) Amazon Kinesis
12 2 (1.72%) AWS CloudFormation
12 2 (1.72%) AWS Fargate
Communications & Networking
1 17 (14.66%) Kerberos
2 12 (10.34%) SSL
3 9 (7.76%) DNS
4 5 (4.31%) HTTP
4 5 (4.31%) Reverse Proxy
5 4 (3.45%) SNMP
6 2 (1.72%) 2.5G
6 2 (1.72%) 2G
6 2 (1.72%) 3G
6 2 (1.72%) 4G
6 2 (1.72%) 5G
7 1 (0.86%) Internet
Database & Business Intelligence
1 86 (74.14%) Hadoop
2 70 (60.34%) Apache Hive
2 70 (60.34%) Big Data
3 57 (49.14%) HBase
4 40 (34.48%) Impala
5 22 (18.97%) Sqoop
6 16 (13.79%) Parquet
6 16 (13.79%) Spark SQL
7 15 (12.93%) Apache Cassandra
8 13 (11.21%) NoSQL
8 13 (11.21%) Presto
8 13 (11.21%) Relational Database
9 12 (10.34%) Data Lake
9 12 (10.34%) Data Warehouse
10 11 (9.48%) Flink
11 10 (8.62%) Pentaho
12 8 (6.90%) MongoDB
12 8 (6.90%) PostgreSQL
13 7 (6.03%) MySQL
13 7 (6.03%) SQL Server
Development Applications
1 45 (38.79%) Jenkins
2 39 (33.62%) Git (software)
3 23 (19.83%) JIRA
4 11 (9.48%) Gradle
4 11 (9.48%) Travis CI
5 10 (8.62%) Artifactory
6 9 (7.76%) webpack
7 7 (6.03%) Maven
8 6 (5.17%) JUnit
8 6 (5.17%) Selenium
9 5 (4.31%) gulp
10 4 (3.45%) Hudson
10 4 (3.45%) Vagrant
11 3 (2.59%) Visual Studio
12 2 (1.72%) Atlassian Bamboo
12 2 (1.72%) Cucumber
12 2 (1.72%) Gatling
12 2 (1.72%) JMeter
12 2 (1.72%) WebDriver
13 1 (0.86%) Sonatype Nexus
General
1 30 (25.86%) Finance
2 11 (9.48%) Banking
3 10 (8.62%) Retail Banking
4 8 (6.90%) Publishing
5 4 (3.45%) Legal
5 4 (3.45%) Telecoms
6 3 (2.59%) Retail
7 2 (1.72%) Electronics
7 2 (1.72%) Manufacturing
7 2 (1.72%) Marketing
8 1 (0.86%) Advertising
8 1 (0.86%) Investment Banking
Job Titles
1 48 (41.38%) Developer
2 46 (39.66%) Data Engineer
3 29 (25.00%) Java Developer
4 28 (24.14%) Big Data Engineer
5 19 (16.38%) Hadoop Developer
6 14 (12.07%) Big Data Developer
6 14 (12.07%) Java Hadoop Developer
7 12 (10.34%) Platform Engineer
8 7 (6.03%) Full Stack Developer
9 6 (5.17%) Administrator
9 6 (5.17%) Scala Developer
9 6 (5.17%) Senior Developer
10 5 (4.31%) Apache Spark Developer
10 5 (4.31%) Architect
10 5 (4.31%) DevOps Engineer
10 5 (4.31%) Python Developer
11 4 (3.45%) AWS Engineer
11 4 (3.45%) Full Stack Web Developer
11 4 (3.45%) Hadoop Engineer
11 4 (3.45%) Java Scala Developer
Libraries, Frameworks & Software Standards
1 55 (47.41%) Kafka
2 30 (25.86%) Spring
3 22 (18.97%) Spark Streaming
4 18 (15.52%) PySpark
5 14 (12.07%) RESTful
6 13 (11.21%) REST
7 12 (10.34%) HTML
7 12 (10.34%) JSON
7 12 (10.34%) Middleware
7 12 (10.34%) RabbitMQ
7 12 (10.34%) Spring Boot
8 11 (9.48%) Apache Avro
8 11 (9.48%) HTML5
8 11 (9.48%) Node.js
9 10 (8.62%) AngularJS
9 10 (8.62%) React
10 7 (6.03%) Apache NiFi
10 7 (6.03%) J2EE
10 7 (6.03%) Pandas
10 7 (6.03%) Vue.js
Miscellaneous
1 26 (22.41%) Linux Command Line
2 11 (9.48%) Virtual Team
3 8 (6.90%) Enterprise Software
4 7 (6.03%) Algorithms
5 5 (4.31%) User Experience
6 4 (3.45%) Data Structures
7 2 (1.72%) Cloud Native
7 2 (1.72%) Market Risk
7 2 (1.72%) NHS
7 2 (1.72%) Replication
8 1 (0.86%) Credit Risk
8 1 (0.86%) Data Protection Act
8 1 (0.86%) Public Cloud
Operating Systems
1 57 (49.14%) Linux
2 50 (43.10%) Unix
3 5 (4.31%) Windows
4 4 (3.45%) CentOS
5 3 (2.59%) Red Hat Enterprise Linux
6 2 (1.72%) SUSE Linux Enterprise Server
Processes & Methodologies
1 59 (50.86%) Agile Software Development
2 37 (31.90%) DevOps
3 32 (27.59%) TDD
4 26 (22.41%) Analytics
5 25 (21.55%) ETL
6 22 (18.97%) Performance Tuning
7 20 (17.24%) BDD
7 20 (17.24%) Data Science
8 19 (16.38%) Continuous Integration
8 19 (16.38%) Unit Testing
9 16 (13.79%) Data Engineering
9 16 (13.79%) MapReduce
10 15 (12.93%) Functional Programming
11 14 (12.07%) Continuous Delivery
11 14 (12.07%) Data Modelling
12 12 (10.34%) Scrum
13 11 (9.48%) Benchmarking
13 11 (9.48%) Computer Science
13 11 (9.48%) OOP
13 11 (9.48%) Web Development
Programming Languages
1 69 (59.48%) Python
2 61 (52.59%) Java
3 57 (49.14%) SQL
4 45 (38.79%) Scala
5 23 (19.83%) Shell Script
6 18 (15.52%) Bash Shell
7 14 (12.07%) R
8 11 (9.48%) JavaScript
9 6 (5.17%) Java 8
10 5 (4.31%) ES6
10 5 (4.31%) TypeScript
11 4 (3.45%) Kotlin
12 3 (2.59%) C#
13 2 (1.72%) Perl
14 1 (0.86%) Korn
14 1 (0.86%) PowerShell
Qualifications
1 14 (12.07%) Security Cleared
2 12 (10.34%) SC Cleared
3 7 (6.03%) Degree
4 5 (4.31%) DV Cleared
Quality Assurance & Compliance
1 1 (0.86%) GDPR
System Software
1 52 (44.83%) HDFS
2 27 (23.28%) Docker
3 14 (12.07%) Apache Flume
4 12 (10.34%) Apache ZooKeeper
5 11 (9.48%) Active Directory
6 4 (3.45%) Samba
6 4 (3.45%) VirtualBox
6 4 (3.45%) VMware ESXi
6 4 (3.45%) VMware Infrastructure
Systems Management
1 22 (18.97%) Ansible
2 12 (10.34%) Terraform
3 10 (8.62%) Kubernetes
3 10 (8.62%) Oozie
4 6 (5.17%) Ambari
5 2 (1.72%) Kibana
5 2 (1.72%) logstash
6 1 (0.86%) Docker Swarm
6 1 (0.86%) Opscode Chef
6 1 (0.86%) Puppet
Vendors
1 31 (26.72%) Cloudera
2 19 (16.38%) Google
3 16 (13.79%) Oracle
4 15 (12.93%) Hortonworks
5 14 (12.07%) Microsoft
6 7 (6.03%) Tableau
7 5 (4.31%) Red Hat
8 4 (3.45%) Atlassian
8 4 (3.45%) Informatica
8 4 (3.45%) Teradata
8 4 (3.45%) VMware
9 3 (2.59%) Databricks
9 3 (2.59%) Splunk
9 3 (2.59%) Sybase
9 3 (2.59%) Talend
10 2 (1.72%) Datameer
10 2 (1.72%) SAP
10 2 (1.72%) Twitter
11 1 (0.86%) MapR
11 1 (0.86%) Solace