Period
to 17 January 2020

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 17 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
17 Jan 2020
Same period 2019 Same period 2018
Rank 659 674 709
Rank change year-on-year +15 +35 +23
Contract jobs citing Hadoop YARN 91 206 204
As % of all contract IT jobs advertised in the UK 0.12% 0.21% 0.20%
As % of the Systems Management category 0.86% 1.41% 1.70%
Number of daily rates quoted 53 135 146
UK median daily rate £530 £575 £511
Median daily rate % change year-on-year -7.83% +12.47% -11.09%
10th Percentile £425 £488 £391
90th Percentile £700 £775 £628
UK excluding London median daily rate £500 £550 £500
% change year-on-year -9.09% +10.00% -2.53%
Number of hourly rates quoted 0 0 0
UK median hourly rate - - -
UK excluding London median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Contract vacancies with a requirement for systems management skills 10,545 14,589 12,008
As % of all contract IT jobs advertised in the UK 14.48% 14.67% 11.97%
Number of daily rates quoted 7,104 9,742 8,150
UK median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% +5.56%
10th Percentile £263 £306 £269
90th Percentile £675 £650 £625
UK excluding London median daily rate £450 £450 £425
% change year-on-year - +5.88% +6.25%
Number of hourly rates quoted 300 370 274
UK median hourly rate £19.75 £17.50 £17.50
Median hourly rate % change year-on-year +12.86% - -12.50%
10th Percentile £12.98 £12.25 £11.08
90th Percentile £50.60 £47.90 £47.32
UK excluding London median hourly rate £18.00 £17.50 £15.73
% change year-on-year +2.86% +11.25% -17.75%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN.

Contractor daily rate trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Hadoop YARN over the 6 months to 17 January 2020.

Contractor daily rate histogram for Hadoop YARN in the UK

Hadoop YARN
Top 11 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 17 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +17 86 £530 -5.78% 11
UK excluding London +81 48 £500 -9.09% 6
London +28 43 £573 -4.58% 5
Midlands +64 14 £450 -
South West - 14 £525 - 2
West Midlands - 14 £450 -
Yorkshire - 12 £500 - 1
North of England - 12 £500 - 1
Scotland +26 5 - -
South East +10 2 £425 -22.73% 2
East of England +33 1 £580 - 1

For the 6 months to 17 January 2020, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Hadoop YARN.

1 82 (90.11%) Apache Spark
2 75 (82.42%) Apache Hive
3 69 (75.82%) Big Data
3 69 (75.82%) Hadoop
4 63 (69.23%) SQL
5 61 (67.03%) HDFS
6 53 (58.24%) Scala
7 51 (56.04%) Java
8 48 (52.75%) Python
9 47 (51.65%) Kafka
10 43 (47.25%) HBase
11 38 (41.76%) AWS
12 37 (40.66%) Agile Software Development
13 36 (39.56%) Linux
14 35 (38.46%) Azure
15 33 (36.26%) Jenkins
16 32 (35.16%) Migration
17 31 (34.07%) Git (software)
17 31 (34.07%) Impala
17 31 (34.07%) Cloudera
18 29 (31.87%) Hortonworks
19 26 (28.57%) Kerberos
19 26 (28.57%) Microsoft
20 24 (26.37%) Finance
20 24 (26.37%) Apache
20 24 (26.37%) Continuous Integration
20 24 (26.37%) Analytics
21 23 (25.27%) DevOps
22 22 (24.18%) Docker
22 22 (24.18%) Amazon Kinesis

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 82 (90.11%) Apache Spark
2 24 (26.37%) Apache
3 8 (8.79%) Jupyter
3 8 (8.79%) OpenStack
4 4 (4.40%) Apache Airflow
5 3 (3.30%) IIS
5 3 (3.30%) nginx
6 2 (2.20%) Apache Pig
6 2 (2.20%) Confluence
6 2 (2.20%) SAS
7 1 (1.10%) Apache Solr
7 1 (1.10%) Elasticsearch
Applications
1 6 (6.59%) Microsoft Excel
2 1 (1.10%) Chatbot
2 1 (1.10%) Microsoft Project
Business Applications
1 1 (1.10%) NetSuite
Cloud Services
1 38 (41.76%) AWS
2 35 (38.46%) Azure
3 22 (24.18%) Amazon Kinesis
4 13 (14.29%) GCP
5 8 (8.79%) Power Platform
6 6 (6.59%) Amazon EMR
7 4 (4.40%) IaaS
7 4 (4.40%) PaaS
8 3 (3.30%) npm
8 3 (3.30%) OpenShift
8 3 (3.30%) Yarn
9 2 (2.20%) Amazon S3
10 1 (1.10%) Amazon CloudWatch
10 1 (1.10%) AWS CloudFormation
10 1 (1.10%) AWS CloudTrail
10 1 (1.10%) AWS Lambda
10 1 (1.10%) AWS Step Functions
10 1 (1.10%) Dynamics 365
10 1 (1.10%) Serverless
Communications & Networking
1 26 (28.57%) Kerberos
2 18 (19.78%) SSL
3 14 (15.38%) DNS
4 5 (5.49%) HTTP
4 5 (5.49%) VPN
5 3 (3.30%) Reverse Proxy
6 2 (2.20%) Firewall
6 2 (2.20%) HTTPS
Database & Business Intelligence
1 75 (82.42%) Apache Hive
2 69 (75.82%) Big Data
2 69 (75.82%) Hadoop
3 43 (47.25%) HBase
4 31 (34.07%) Impala
5 15 (16.48%) Pentaho
6 14 (15.38%) Flink
6 14 (15.38%) MongoDB
6 14 (15.38%) SQL Server
7 13 (14.29%) NoSQL
7 13 (14.29%) Spark SQL
7 13 (14.29%) Sqoop
8 9 (9.89%) Apache Cassandra
9 8 (8.79%) Power BI
10 6 (6.59%) Neo4j
11 5 (5.49%) Data Warehouse
12 3 (3.30%) Relational Database
13 2 (2.20%) Cloudera CDH
13 2 (2.20%) Data Lake
13 2 (2.20%) Parquet
Development Applications
1 33 (36.26%) Jenkins
2 31 (34.07%) Git (software)
3 18 (19.78%) Artifactory
4 15 (16.48%) Maven
5 12 (13.19%) IBM UrbanCode
5 12 (13.19%) Sonatype Nexus
6 8 (8.79%) JIRA
7 5 (5.49%) Travis CI
8 3 (3.30%) Eclipse
8 3 (3.30%) gulp
8 3 (3.30%) IntelliJ
8 3 (3.30%) TeamCity
8 3 (3.30%) Visual Studio
8 3 (3.30%) webpack
9 2 (2.20%) JUnit
10 1 (1.10%) Atlassian Bamboo
10 1 (1.10%) Bitbucket Server
10 1 (1.10%) FishEye
General
1 24 (26.37%) Finance
2 14 (15.38%) Banking
3 12 (13.19%) Public Sector
4 5 (5.49%) Retail Banking
5 1 (1.10%) Games
Job Titles
1 47 (51.65%) Data Engineer
2 40 (43.96%) Big Data Engineer
3 16 (17.58%) Platform Engineer
4 15 (16.48%) Developer
5 10 (10.99%) Administrator
6 9 (9.89%) Architect
6 9 (9.89%) Big Data Architect
6 9 (9.89%) Data Architect
7 7 (7.69%) Hadoop Developer
8 6 (6.59%) Java Developer
8 6 (6.59%) Java Hadoop Developer
8 6 (6.59%) Python Engineer
9 5 (5.49%) Big Data Developer
9 5 (5.49%) DevOps Engineer
9 5 (5.49%) Hadoop Administrator
9 5 (5.49%) Hadoop Engineer
10 4 (4.40%) AWS Engineer
11 3 (3.30%) Scala Developer
11 3 (3.30%) Senior DevOps
11 3 (3.30%) Senior DevOps Engineer
Libraries, Frameworks & Software Standards
1 47 (51.65%) Kafka
2 14 (15.38%) PySpark
3 7 (7.69%) OAuth
3 7 (7.69%) Spring
4 6 (6.59%) RabbitMQ
5 4 (4.40%) HTML
5 4 (4.40%) HTML5
5 4 (4.40%) LDAP
5 4 (4.40%) React
5 4 (4.40%) SAML
5 4 (4.40%) Spark Streaming
6 3 (3.30%) Apache NiFi
6 3 (3.30%) CSS
6 3 (3.30%) GraphQL
6 3 (3.30%) NgRx
6 3 (3.30%) Node.js
6 3 (3.30%) Pandas
6 3 (3.30%) Redux
6 3 (3.30%) Spring Boot
6 3 (3.30%) Swagger
Miscellaneous
1 13 (14.29%) Analytical Skills
2 10 (10.99%) User Experience
3 8 (8.79%) Algorithms
3 8 (8.79%) Linux Command Line
3 8 (8.79%) Management Information System
3 8 (8.79%) Public Cloud
4 3 (3.30%) Data Centre
5 2 (2.20%) Clustering
5 2 (2.20%) Replication
6 1 (1.10%) Cloud Native
Operating Systems
1 36 (39.56%) Linux
2 15 (16.48%) Unix
3 10 (10.99%) Windows
4 7 (7.69%) Ubuntu
5 2 (2.20%) SUSE Linux Enterprise Server
6 1 (1.10%) CentOS
Processes & Methodologies
1 37 (40.66%) Agile Software Development
2 32 (35.16%) Migration
3 24 (26.37%) Analytics
3 24 (26.37%) Continuous Integration
4 23 (25.27%) DevOps
5 21 (23.08%) Data Modelling
5 21 (23.08%) Software Engineering
6 19 (20.88%) Scrum
7 17 (18.68%) Use Case
8 16 (17.58%) Functional Programming
8 16 (17.58%) TDD
9 15 (16.48%) DevSecOps
10 14 (15.38%) Computer Science
10 14 (15.38%) Data Science
10 14 (15.38%) ETL
10 14 (15.38%) Performance Tuning
11 13 (14.29%) Business Intelligence
12 12 (13.19%) Microservices
12 12 (13.19%) SDLC
13 11 (12.09%) Data Engineering
Programming Languages
1 63 (69.23%) SQL
2 53 (58.24%) Scala
3 51 (56.04%) Java
4 48 (52.75%) Python
5 19 (20.88%) Bash Shell
6 15 (16.48%) R
7 14 (15.38%) Go
7 14 (15.38%) Kotlin
8 11 (12.09%) Perl
9 9 (9.89%) C
10 4 (4.40%) JavaScript
10 4 (4.40%) Ruby
11 3 (3.30%) C#
11 3 (3.30%) ES6
11 3 (3.30%) HiveQL
11 3 (3.30%) TypeScript
12 2 (2.20%) Shell Script
13 1 (1.10%) PL/SQL
Qualifications
1 9 (9.89%) Computer Science Degree
1 9 (9.89%) Degree
2 6 (6.59%) SC Cleared
2 6 (6.59%) Security Cleared
3 2 (2.20%) BPSS Clearance
Quality Assurance & Compliance
1 3 (3.30%) QA
2 2 (2.20%) Data Quality
System Software
1 61 (67.03%) HDFS
2 22 (24.18%) Docker
3 17 (18.68%) Active Directory
4 2 (2.20%) Apache Flume
Systems Management
1 16 (17.58%) Ansible
2 15 (16.48%) Terraform
3 12 (13.19%) Oozie
4 10 (10.99%) Kubernetes
5 9 (9.89%) Ambari
6 4 (4.40%) Single Sign-On
7 3 (3.30%) Puppet
8 2 (2.20%) Opscode Chef
Vendors
1 31 (34.07%) Cloudera
2 29 (31.87%) Hortonworks
3 26 (28.57%) Microsoft
4 20 (21.98%) Tableau
5 9 (9.89%) Oracle
6 7 (7.69%) Foundry
6 7 (7.69%) Palantir
7 5 (5.49%) Teradata
8 3 (3.30%) Ab Initio
9 2 (2.20%) Google
9 2 (2.20%) Informatica
9 2 (2.20%) StreamSets
9 2 (2.20%) Sybase
10 1 (1.10%) Atlassian
10 1 (1.10%) JD Edwards