Period
to 21 October 2019

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 21 October 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
21 Oct 2019
Same period 2018 Same period 2017
Rank 709 698 712
Rank change year-on-year -11 +14 +114
Contract jobs citing Hadoop YARN 99 191 174
As % of all contract IT jobs advertised in the UK 0.12% 0.19% 0.18%
As % of the Systems Management category 0.80% 1.32% 1.52%
Number of daily rates quoted 61 154 131
UK median daily rate £550 £525 £525
Median daily rate % change year-on-year +4.76% - -4.55%
10th Percentile £430 £488 £325
90th Percentile £700 £759 £650
UK excluding London median daily rate £470 £500 £458
% change year-on-year -6.00% +9.29% -10.82%
Number of hourly rates quoted 0 0 0
UK median hourly rate - - -
UK excluding London median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Contract vacancies with a requirement for systems management skills 12,440 14,458 11,479
As % of all contract IT jobs advertised in the UK 14.64% 14.13% 11.55%
Number of daily rates quoted 8,415 9,735 7,655
UK median daily rate £500 £500 £470
Median daily rate % change year-on-year - +6.38% +9.30%
10th Percentile £275 £293 £263
90th Percentile £675 £650 £613
UK excluding London median daily rate £450 £433 £413
% change year-on-year +4.05% +4.85% +4.43%
Number of hourly rates quoted 317 388 267
UK median hourly rate £21.15 £17.50 £18.00
Median hourly rate % change year-on-year +20.86% -2.78% -22.58%
10th Percentile £12.76 £12.25 £10.75
90th Percentile £50.10 £47.00 £47.50
UK excluding London median hourly rate £20.90 £17.50 £17.38
% change year-on-year +19.40% +0.72% -33.81%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN.

Contractor daily rate trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Hadoop YARN over the 6 months to 21 October 2019.

Contractor daily rate histogram for Hadoop YARN in the UK

Hadoop YARN
Top 9 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 21 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -13 92 £550 +4.76% 12
London +13 72 £573 +9.05% 8
UK excluding London +27 27 £470 -6.00% 5
Midlands +59 10 £460 - 1
West Midlands - 10 £460 - 1
Scotland +37 7 - - 1
North of England +49 5 £500 -9.09% 1
South West - 5 - - 1
Yorkshire - 5 £500 - 1

For the 6 months to 21 October 2019, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Hadoop YARN.

1 87 (87.88%) Apache Spark
2 77 (77.78%) Apache Hive
3 75 (75.76%) Hadoop
4 64 (64.65%) Python
5 61 (61.62%) Big Data
6 59 (59.60%) SQL
7 56 (56.57%) Scala
8 52 (52.53%) Java
9 48 (48.48%) Agile Software Development
9 48 (48.48%) HDFS
10 47 (47.47%) Kafka
10 47 (47.47%) Linux
11 39 (39.39%) Impala
12 36 (36.36%) HBase
13 34 (34.34%) DevOps
13 34 (34.34%) Unix
14 32 (32.32%) Jenkins
14 32 (32.32%) AWS
15 30 (30.30%) Cloudera
16 28 (28.28%) ETL
16 28 (28.28%) Finance
17 27 (27.27%) Migration
18 26 (26.26%) Apache
18 26 (26.26%) Analytics
19 25 (25.25%) Git (software)
19 25 (25.25%) Spark SQL
20 24 (24.24%) Hortonworks
20 24 (24.24%) Sqoop
21 23 (23.23%) Performance Tuning
22 22 (22.22%) Microsoft

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 87 (87.88%) Apache Spark
2 26 (26.26%) Apache
3 14 (14.14%) Elasticsearch
4 9 (9.09%) Jupyter
5 5 (5.05%) Apache Solr
5 5 (5.05%) IIS
5 5 (5.05%) nginx
6 4 (4.04%) Apache Airflow
6 4 (4.04%) Apache Pig
7 3 (3.03%) Confluence
8 2 (2.02%) SAS
Applications
1 6 (6.06%) Microsoft Excel
2 1 (1.01%) Microsoft Project
Cloud Services
1 32 (32.32%) AWS
2 20 (20.20%) Azure
3 15 (15.15%) Amazon Kinesis
4 14 (14.14%) GCP
5 11 (11.11%) Amazon EMR
6 10 (10.10%) GitHub
7 9 (9.09%) Amazon S3
8 8 (8.08%) Power Platform
9 5 (5.05%) npm
9 5 (5.05%) Yarn
10 4 (4.04%) Amazon CloudWatch
10 4 (4.04%) AWS CloudTrail
10 4 (4.04%) OpenShift
11 3 (3.03%) Amazon EC2
11 3 (3.03%) AWS Lambda
11 3 (3.03%) Serverless
12 2 (2.02%) Amazon ELB
12 2 (2.02%) AWS CloudFormation
12 2 (2.02%) Cloud Computing
12 2 (2.02%) Virtual Private Cloud
Communications & Networking
1 20 (20.20%) Kerberos
2 11 (11.11%) SSL
3 9 (9.09%) DNS
4 5 (5.05%) HTTP
4 5 (5.05%) Reverse Proxy
5 1 (1.01%) VPN
Database & Business Intelligence
1 77 (77.78%) Apache Hive
2 75 (75.76%) Hadoop
3 61 (61.62%) Big Data
4 39 (39.39%) Impala
5 36 (36.36%) HBase
6 25 (25.25%) Spark SQL
7 24 (24.24%) Sqoop
8 16 (16.16%) SQL Server
9 12 (12.12%) Data Lake
9 12 (12.12%) Presto
10 10 (10.10%) Data Warehouse
10 10 (10.10%) Flink
10 10 (10.10%) MongoDB
10 10 (10.10%) NoSQL
10 10 (10.10%) Pentaho
11 8 (8.08%) Power BI
12 7 (7.07%) Apache Cassandra
13 6 (6.06%) Neo4j
13 6 (6.06%) Parquet
13 6 (6.06%) Relational Database
Development Applications
1 32 (32.32%) Jenkins
2 25 (25.25%) Git (software)
3 22 (22.22%) JIRA
4 15 (15.15%) Artifactory
5 9 (9.09%) Travis CI
6 8 (8.08%) Maven
7 5 (5.05%) Eclipse
7 5 (5.05%) gulp
7 5 (5.05%) IntelliJ
7 5 (5.05%) TeamCity
8 4 (4.04%) Hudson
9 3 (3.03%) Sonatype Nexus
9 3 (3.03%) Visual Studio
9 3 (3.03%) webpack
10 2 (2.02%) Atlassian Bamboo
10 2 (2.02%) Gatling
10 2 (2.02%) IBM UrbanCode
10 2 (2.02%) JMeter
10 2 (2.02%) JUnit
10 2 (2.02%) Selenium
General
1 28 (28.28%) Finance
2 17 (17.17%) Banking
3 8 (8.08%) Retail Banking
4 7 (7.07%) Publishing
5 4 (4.04%) Legal
6 3 (3.03%) Public Sector
7 2 (2.02%) Retail
8 1 (1.01%) Games
Job Titles
1 50 (50.51%) Data Engineer
2 33 (33.33%) Big Data Engineer
3 25 (25.25%) Developer
4 13 (13.13%) Hadoop Developer
4 13 (13.13%) Platform Engineer
5 10 (10.10%) Administrator
5 10 (10.10%) Java Developer
6 8 (8.08%) Java Hadoop Developer
7 6 (6.06%) Big Data Developer
7 6 (6.06%) Python Developer
7 6 (6.06%) Python Engineer
8 5 (5.05%) Hadoop Engineer
8 5 (5.05%) Scala Developer
9 4 (4.04%) Architect
9 4 (4.04%) AWS Engineer
9 4 (4.04%) Full Stack Developer
9 4 (4.04%) Full Stack Web Developer
9 4 (4.04%) Hadoop Administrator
9 4 (4.04%) Web Developer
10 3 (3.03%) Data Architect
Libraries, Frameworks & Software Standards
1 47 (47.47%) Kafka
2 18 (18.18%) PySpark
2 18 (18.18%) Spark Streaming
3 12 (12.12%) RESTful
4 11 (11.11%) Spring
5 7 (7.07%) Pandas
6 6 (6.06%) Apache NiFi
6 6 (6.06%) HTML
6 6 (6.06%) HTML5
6 6 (6.06%) RabbitMQ
6 6 (6.06%) React
7 5 (5.05%) AngularJS
7 5 (5.05%) CSS
7 5 (5.05%) CSS3
7 5 (5.05%) Elastic Stack
7 5 (5.05%) Flask
7 5 (5.05%) GraphQL
7 5 (5.05%) Node.js
7 5 (5.05%) REST
7 5 (5.05%) Spring Boot
Miscellaneous
1 13 (13.13%) Algorithms
1 13 (13.13%) Linux Command Line
2 5 (5.05%) User Experience
3 3 (3.03%) Data Structures
4 2 (2.02%) Cloud Native
4 2 (2.02%) Clustering
4 2 (2.02%) Management Information System
4 2 (2.02%) NHS
4 2 (2.02%) Replication
5 1 (1.01%) Analytical Skills
Operating Systems
1 47 (47.47%) Linux
2 34 (34.34%) Unix
3 11 (11.11%) Windows
4 7 (7.07%) Ubuntu
5 5 (5.05%) CentOS
6 2 (2.02%) SUSE Linux Enterprise Server
Processes & Methodologies
1 48 (48.48%) Agile Software Development
2 34 (34.34%) DevOps
3 28 (28.28%) ETL
4 27 (27.27%) Migration
5 26 (26.26%) Analytics
6 23 (23.23%) Performance Tuning
7 19 (19.19%) Data Science
8 18 (18.18%) Data Engineering
9 17 (17.17%) Continuous Integration
9 17 (17.17%) Scrum
10 15 (15.15%) Functional Programming
10 15 (15.15%) TDD
11 14 (14.14%) Data Modelling
11 14 (14.14%) Deployment Automation
11 14 (14.14%) Performance Testing
12 13 (13.13%) SDLC
13 11 (11.11%) Computer Science
13 11 (11.11%) Continuous Delivery
13 11 (11.11%) MapReduce
13 11 (11.11%) Problem-Solving
Programming Languages
1 64 (64.65%) Python
2 59 (59.60%) SQL
3 56 (56.57%) Scala
4 52 (52.53%) Java
5 18 (18.18%) R
6 15 (15.15%) Bash Shell
7 8 (8.08%) Kotlin
7 8 (8.08%) Shell Script
8 6 (6.06%) Go
8 6 (6.06%) JavaScript
9 5 (5.05%) ES6
9 5 (5.05%) TypeScript
10 3 (3.03%) C#
10 3 (3.03%) HiveQL
10 3 (3.03%) Perl
11 2 (2.02%) C
12 1 (1.01%) PL/SQL
Qualifications
1 10 (10.10%) SC Cleared
1 10 (10.10%) Security Cleared
2 3 (3.03%) Degree
3 2 (2.02%) Computer Science Degree
Quality Assurance & Compliance
1 3 (3.03%) QA
System Software
1 48 (48.48%) HDFS
2 20 (20.20%) Docker
3 11 (11.11%) Active Directory
4 8 (8.08%) Apache Flume
5 4 (4.04%) Samba
5 4 (4.04%) VMware ESXi
5 4 (4.04%) VMware Infrastructure
Systems Management
1 20 (20.20%) Ansible
2 12 (12.12%) Terraform
3 11 (11.11%) Oozie
4 8 (8.08%) Ambari
5 7 (7.07%) Kubernetes
6 5 (5.05%) Puppet
7 1 (1.01%) Docker Swarm
7 1 (1.01%) Kibana
7 1 (1.01%) logstash
7 1 (1.01%) Opscode Chef
Vendors
1 30 (30.30%) Cloudera
2 24 (24.24%) Hortonworks
3 22 (22.22%) Microsoft
4 15 (15.15%) Oracle
5 14 (14.14%) Tableau
6 9 (9.09%) Google
7 7 (7.07%) Foundry
7 7 (7.07%) Palantir
7 7 (7.07%) Teradata
8 4 (4.04%) Informatica
8 4 (4.04%) Red Hat
8 4 (4.04%) VMware
9 3 (3.03%) Ab Initio
9 3 (3.03%) Databricks
10 2 (2.02%) Splunk
10 2 (2.02%) StreamSets
10 2 (2.02%) Sybase
10 2 (2.02%) Talend
10 2 (2.02%) Twitter
11 1 (1.01%) Solace