Period
to 20 July 2019

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 20 July 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
20 Jul 2019
Same period 2018 Same period 2017
Rank 717 705 727
Rank change year-on-year -12 +22 +142
Contract jobs citing Hadoop YARN 126 202 133
As % of all contract IT jobs advertised in the UK 0.14% 0.19% 0.14%
As % of the Systems Management category 0.91% 1.46% 1.26%
Number of daily rates quoted 73 137 77
UK median daily rate £575 £525 £500
Median daily rate % change year-on-year +9.52% +5.00% -16.67%
10th Percentile £492 £488 £350
90th Percentile £700 £700 £643
UK excluding London median daily rate £513 £500 £450
% change year-on-year +2.60% +11.11% -20.00%
Number of hourly rates quoted 0 0 0
UK median hourly rate - - -
UK excluding London median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Contract vacancies with a requirement for systems management skills 13,793 13,794 10,561
As % of all contract IT jobs advertised in the UK 14.80% 13.24% 11.09%
Number of daily rates quoted 9,261 9,168 6,976
UK median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +5.88%
10th Percentile £300 £275 £263
90th Percentile £675 £638 £602
UK excluding London median daily rate £450 £425 £420
% change year-on-year +5.88% +1.19% +8.39%
Number of hourly rates quoted 339 373 233
UK median hourly rate £21.00 £19.00 £19.00
Median hourly rate % change year-on-year +10.53% - -15.56%
10th Percentile £12.00 £12.00 £11.25
90th Percentile £47.57 £49.57 £47.90
UK excluding London median hourly rate £18.00 £17.50 £17.50
% change year-on-year +2.86% - -24.73%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN.

Contractor daily rate trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Hadoop YARN over the 6 months to 20 July 2019.

Contractor daily rate histogram for Hadoop YARN in the UK

Hadoop YARN
Top 11 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 20 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -40 123 £575 +9.52% 11
London +9 79 £600 +9.09% 9
UK excluding London -21 45 £513 +2.60% 3
South East -27 23 £473 -5.50% 1
Midlands +31 11 £513 -14.50%
West Midlands - 11 £513 -
North of England +31 6 £575 +12.20% 1
Yorkshire +29 5 £575 +15.00%
South West -19 3 £485 -11.82%
Scotland - 2 - - 1
North West +8 1 £525 - 1

For the 6 months to 20 July 2019, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Hadoop YARN.

1 101 (80.16%) Apache Spark
2 97 (76.98%) Hadoop
3 80 (63.49%) Apache Hive
4 76 (60.32%) Big Data
5 75 (59.52%) Python
6 70 (55.56%) Java
7 68 (53.97%) Agile Software Development
8 67 (53.17%) HBase
9 62 (49.21%) Kafka
9 62 (49.21%) HDFS
10 60 (47.62%) Linux
11 54 (42.86%) Unix
12 52 (41.27%) SQL
13 50 (39.68%) Scala
14 49 (38.89%) Impala
15 48 (38.10%) Jenkins
16 42 (33.33%) Git (software)
17 38 (30.16%) Apache
17 38 (30.16%) DevOps
18 37 (29.37%) TDD
19 34 (26.98%) Amazon AWS
19 34 (26.98%) Cloudera
20 31 (24.60%) Google Cloud Platform
21 30 (23.81%) Finance
22 29 (23.02%) Spring
22 29 (23.02%) Shell Script
23 27 (21.43%) Analytics
24 26 (20.63%) ETL
25 25 (19.84%) Google
25 25 (19.84%) GitHub

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 101 (80.16%) Apache Spark
2 38 (30.16%) Apache
3 23 (18.25%) Elasticsearch
4 18 (14.29%) Apache Solr
5 8 (6.35%) Jupyter
6 7 (5.56%) Apache Pig
7 6 (4.76%) JBoss
8 4 (3.17%) Apache Airflow
9 2 (1.59%) Confluence
9 2 (1.59%) IIS
9 2 (1.59%) nginx
10 1 (0.79%) Cloud Foundry
10 1 (0.79%) Oracle Workflow
Cloud Services
1 34 (26.98%) Amazon AWS
2 31 (24.60%) Google Cloud Platform
3 25 (19.84%) GitHub
4 16 (12.70%) Amazon S3
5 14 (11.11%) Microsoft Azure
6 13 (10.32%) Amazon EMR
7 10 (7.94%) Amazon EC2
8 8 (6.35%) Yarn
9 7 (5.56%) Serverless
10 6 (4.76%) AWS Lambda
11 5 (3.97%) Amazon CloudWatch
11 5 (3.97%) AWS CloudTrail
11 5 (3.97%) Virtual Private Cloud
12 4 (3.17%) Amazon Kinesis
12 4 (3.17%) Cloud Computing
13 3 (2.38%) Amazon ELB
14 2 (1.59%) Amazon ECS
14 2 (1.59%) AWS CloudFormation
14 2 (1.59%) AWS Fargate
14 2 (1.59%) npm
Communications & Networking
1 18 (14.29%) Kerberos
2 11 (8.73%) SSL
3 9 (7.14%) DNS
4 4 (3.17%) SNMP
5 2 (1.59%) 2.5G
5 2 (1.59%) 2G
5 2 (1.59%) 3G
5 2 (1.59%) 4G
5 2 (1.59%) 5G
5 2 (1.59%) HTTP
5 2 (1.59%) Reverse Proxy
6 1 (0.79%) Internet
6 1 (0.79%) SSH
Database & Business Intelligence
1 97 (76.98%) Hadoop
2 80 (63.49%) Apache Hive
3 76 (60.32%) Big Data
4 67 (53.17%) HBase
5 49 (38.89%) Impala
6 24 (19.05%) Sqoop
7 20 (15.87%) Parquet
8 18 (14.29%) Apache Cassandra
9 15 (11.90%) Spark SQL
10 13 (10.32%) Data Lake
10 13 (10.32%) NoSQL
10 13 (10.32%) Presto
10 13 (10.32%) Relational Database
11 12 (9.52%) Flink
12 11 (8.73%) Data Warehouse
13 10 (7.94%) MongoDB
13 10 (7.94%) Pentaho
14 9 (7.14%) PostgreSQL
15 7 (5.56%) MySQL
15 7 (5.56%) SQL Server
Development Applications
1 48 (38.10%) Jenkins
2 42 (33.33%) Git (software)
3 25 (19.84%) JIRA
4 13 (10.32%) Gradle
5 12 (9.52%) Artifactory
6 11 (8.73%) Travis CI
7 9 (7.14%) Maven
8 7 (5.56%) Selenium
9 6 (4.76%) JUnit
9 6 (4.76%) webpack
10 4 (3.17%) Hudson
10 4 (3.17%) Vagrant
11 3 (2.38%) Cucumber
11 3 (2.38%) Eclipse
11 3 (2.38%) Gatling
11 3 (2.38%) JMeter
11 3 (2.38%) WebDriver
12 2 (1.59%) Atlassian Bamboo
12 2 (1.59%) IntelliJ
12 2 (1.59%) TeamCity
General
1 30 (23.81%) Finance
2 11 (8.73%) Banking
3 10 (7.94%) Retail Banking
4 8 (6.35%) Publishing
5 5 (3.97%) Legal
6 4 (3.17%) Telecoms
7 3 (2.38%) Retail
8 2 (1.59%) Electronics
8 2 (1.59%) Manufacturing
8 2 (1.59%) Marketing
9 1 (0.79%) Advertising
9 1 (0.79%) Investment Banking
Job Titles
1 52 (41.27%) Data Engineer
2 45 (35.71%) Developer
3 31 (24.60%) Big Data Engineer
3 31 (24.60%) Java Developer
4 21 (16.67%) Hadoop Developer
5 16 (12.70%) Java Hadoop Developer
6 14 (11.11%) Big Data Developer
7 12 (9.52%) Platform Engineer
8 11 (8.73%) Administrator
9 8 (6.35%) Hadoop Administrator
10 6 (4.76%) Cloud Engineer
11 5 (3.97%) Apache Spark Developer
11 5 (3.97%) Architect
11 5 (3.97%) DevOps Engineer
11 5 (3.97%) Full Stack Developer
11 5 (3.97%) Hadoop Engineer
11 5 (3.97%) Python Developer
11 5 (3.97%) Senior Developer
12 4 (3.17%) AWS Engineer
12 4 (3.17%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 62 (49.21%) Kafka
2 29 (23.02%) Spring
3 25 (19.84%) Spark Streaming
4 20 (15.87%) PySpark
5 15 (11.90%) RESTful
6 14 (11.11%) Apache Avro
6 14 (11.11%) Middleware
6 14 (11.11%) RabbitMQ
7 12 (9.52%) JSON
8 10 (7.94%) Apache Tez
8 10 (7.94%) REST
9 9 (7.14%) HTML
9 9 (7.14%) Spring Boot
10 8 (6.35%) Apache NiFi
10 8 (6.35%) HTML5
10 8 (6.35%) Node.js
11 7 (5.56%) AngularJS
11 7 (5.56%) J2EE
11 7 (5.56%) React
11 7 (5.56%) Vue.js
Miscellaneous
1 25 (19.84%) Linux Command Line
2 13 (10.32%) Virtual Team
3 8 (6.35%) Enterprise Software
4 6 (4.76%) Algorithms
5 4 (3.17%) Data Structures
6 3 (2.38%) NHS
6 3 (2.38%) User Experience
7 2 (1.59%) Cloud Native
7 2 (1.59%) Market Risk
8 1 (0.79%) Analytical Skills
8 1 (0.79%) Credit Risk
8 1 (0.79%) Data Protection Act
8 1 (0.79%) Public Cloud
8 1 (0.79%) Replication
Operating Systems
1 60 (47.62%) Linux
2 54 (42.86%) Unix
3 5 (3.97%) Red Hat Enterprise Linux
4 4 (3.17%) CentOS
5 3 (2.38%) Windows
6 1 (0.79%) SUSE Linux Enterprise Server
Processes & Methodologies
1 68 (53.97%) Agile Software Development
2 38 (30.16%) DevOps
3 37 (29.37%) TDD
4 27 (21.43%) Analytics
5 26 (20.63%) ETL
6 25 (19.84%) BDD
7 24 (19.05%) Performance Tuning
8 23 (18.25%) Data Science
9 19 (15.08%) Continuous Integration
10 17 (13.49%) MapReduce
10 17 (13.49%) Unit Testing
11 16 (12.70%) Data Engineering
11 16 (12.70%) Data Modelling
12 15 (11.90%) Functional Programming
12 15 (11.90%) Scrum
13 13 (10.32%) Benchmarking
13 13 (10.32%) Kanban
14 12 (9.52%) Computer Science
14 12 (9.52%) Continuous Delivery
14 12 (9.52%) Deployment Automation
Programming Languages
1 75 (59.52%) Python
2 70 (55.56%) Java
3 52 (41.27%) SQL
4 50 (39.68%) Scala
5 29 (23.02%) Shell Script
6 19 (15.08%) Bash Shell
7 14 (11.11%) R
8 9 (7.14%) JavaScript
9 6 (4.76%) Java 8
10 4 (3.17%) Kotlin
11 2 (1.59%) ES6
11 2 (1.59%) Korn
11 2 (1.59%) PowerShell
11 2 (1.59%) TypeScript
12 1 (0.79%) Perl
12 1 (0.79%) Ruby
Qualifications
1 14 (11.11%) Security Cleared
2 12 (9.52%) SC Cleared
3 8 (6.35%) Degree
4 5 (3.97%) DV Cleared
5 1 (0.79%) Computer Science Degree
Quality Assurance & Compliance
1 2 (1.59%) GDPR
2 1 (0.79%) Data Quality
2 1 (0.79%) ISO/IEC 27001
2 1 (0.79%) QA
System Software
1 62 (49.21%) HDFS
2 22 (17.46%) Docker
3 18 (14.29%) Apache Flume
4 15 (11.90%) Apache ZooKeeper
5 12 (9.52%) Active Directory
6 4 (3.17%) Samba
6 4 (3.17%) VirtualBox
6 4 (3.17%) VMware ESXi
6 4 (3.17%) VMware Infrastructure
Systems Management
1 23 (18.25%) Ansible
2 13 (10.32%) Terraform
3 11 (8.73%) Oozie
4 9 (7.14%) Kubernetes
5 6 (4.76%) Ambari
6 4 (3.17%) Puppet
7 2 (1.59%) Kibana
7 2 (1.59%) logstash
7 2 (1.59%) Opscode Chef
8 1 (0.79%) Docker Swarm
8 1 (0.79%) Grafana
8 1 (0.79%) Tivoli
Vendors
1 34 (26.98%) Cloudera
2 25 (19.84%) Google
3 17 (13.49%) Hortonworks
4 16 (12.70%) Oracle
5 11 (8.73%) Microsoft
6 7 (5.56%) Tableau
7 6 (4.76%) Datameer
8 5 (3.97%) Red Hat
9 4 (3.17%) Atlassian
9 4 (3.17%) Databricks
9 4 (3.17%) Splunk
9 4 (3.17%) Teradata
9 4 (3.17%) VMware
10 3 (2.38%) Informatica
10 3 (2.38%) Talend
11 2 (1.59%) SAP
11 2 (1.59%) Twitter
12 1 (0.79%) Cognos
12 1 (0.79%) MapR
12 1 (0.79%) Solace