Period
to 22 May 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 22 May 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
England > London
6 months to
22 May 2018
Same period 2017 Same period 2016
Rank 514 450 568
Rank change year-on-year -64 +118 -26
Contract jobs citing Hadoop YARN 111 123 25
As % of all contract IT jobs advertised in London 0.24% 0.31% 0.058%
As % of the Systems Management category 1.81% 2.70% 0.55%
Number of daily rates quoted 75 86 18
London median daily rate £550 £550 £600
Median daily rate % change year-on-year - -8.33% -7.69%
10th Percentile £466 £411 £511
90th Percentile £723 £688 £781
England median daily rate £525 £530 £600
% change year-on-year -0.94% -11.67% -7.69%
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for systems management skills.

All Systems Management Skills
London
Contract vacancies with a requirement for systems management skills 6,128 4,563 4,562
As % of all contract IT jobs advertised in London 13.44% 11.60% 10.53%
Number of daily rates quoted 4,531 3,250 3,216
London median daily rate £525 £500 £463
Median daily rate % change year-on-year +5.00% +8.11% +5.71%
10th Percentile £313 £320 £300
90th Percentile £663 £638 £613
England median daily rate £498 £460 £425
% change year-on-year +8.15% +8.24% +6.25%
Number of hourly rates quoted 79 41 47
London median hourly rate £25.00 £25.00 £22.50
Median hourly rate % change year-on-year - +11.11% +19.36%
10th Percentile £13.25 £15.00 £17.00
90th Percentile £64.50 £47.00 £53.00
England median hourly rate £17.52 £22.00 £21.33
% change year-on-year -20.36% +3.14% +6.65%

Hadoop YARN
Job Vacancy Trend in London

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN in London.

Contractor daily rate trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop YARN in London over the 6 months to 22 May 2018.

Contractor daily rate histogram for Hadoop YARN in London

Hadoop YARN
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the London region over the 6 months to 22 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -38 17 £531 -8.45% 2
East London -7 10 £500 -13.04% 1
South London -54 5 £475 +18.75%
Hadoop YARN
England

For the 6 months to 22 May 2018, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop YARN.

1 106 (95.50%) Hadoop
2 97 (87.39%) Apache Spark
3 84 (75.68%) Apache Hive
4 76 (68.47%) HDFS
5 75 (67.57%) Big Data
6 72 (64.86%) Kafka
7 66 (59.46%) Python
8 64 (57.66%) Java
9 57 (51.35%) HBase
10 50 (45.05%) Linux
11 47 (42.34%) Hortonworks
12 45 (40.54%) Scala
13 40 (36.04%) Apache Flume
14 39 (35.14%) Oozie
14 39 (35.14%) ETL
14 39 (35.14%) Kerberos
15 38 (34.23%) Apache Solr
16 37 (33.33%) Amazon AWS
16 37 (33.33%) Apache Cassandra
17 36 (32.43%) SQL
18 35 (31.53%) MapReduce
19 34 (30.63%) Apache ZooKeeper
19 34 (30.63%) Sqoop
20 33 (29.73%) Ambari
20 33 (29.73%) Agile Software Development
20 33 (29.73%) DevOps
21 31 (27.93%) Jenkins
22 27 (24.32%) Ansible
22 27 (24.32%) Docker
23 26 (23.42%) Red Hat Enterprise Linux

Hadoop YARN
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 97 (87.39%) Apache Spark
2 38 (34.23%) Apache Solr
3 25 (22.52%) Apache
4 24 (21.62%) Apache Pig
5 17 (15.32%) Elasticsearch
6 11 (9.91%) Confluence
7 10 (9.01%) nginx
8 8 (7.21%) Tomcat
9 3 (2.70%) Oracle Coherence
10 1 (0.90%) Cloud Foundry
10 1 (0.90%) Jupyter
10 1 (0.90%) SAS
Applications
1 5 (4.50%) Microsoft Excel
1 5 (4.50%) MS Visio
Cloud Services
1 37 (33.33%) Amazon AWS
2 19 (17.12%) Microsoft Azure
3 17 (15.32%) Amazon S3
4 11 (9.91%) Amazon EC2
4 11 (9.91%) Google Cloud Platform
5 10 (9.01%) Virtual Private Cloud
6 6 (5.41%) Serverless
7 5 (4.50%) Amazon CloudWatch
7 5 (4.50%) Amazon ELB
7 5 (4.50%) AWS CloudTrail
7 5 (4.50%) AWS Lambda
8 3 (2.70%) Yarn
9 2 (1.80%) Amazon EMR
9 2 (1.80%) npm
10 1 (0.90%) Cloud Computing
10 1 (0.90%) GitHub
10 1 (0.90%) OpenShift
Communications & Networking
1 39 (35.14%) Kerberos
2 26 (23.42%) SSL
3 11 (9.91%) VPN
4 6 (5.41%) DNS
4 6 (5.41%) ICMP
4 6 (5.41%) TCP/IP
5 5 (4.50%) OpenLDAP
6 3 (2.70%) Network Security
7 2 (1.80%) Firewall
8 1 (0.90%) HTTP
8 1 (0.90%) Multicast
Database & Business Intelligence
1 106 (95.50%) Hadoop
2 84 (75.68%) Apache Hive
3 75 (67.57%) Big Data
4 57 (51.35%) HBase
5 37 (33.33%) Apache Cassandra
6 34 (30.63%) Sqoop
7 22 (19.82%) NoSQL
8 21 (18.92%) MongoDB
9 16 (14.41%) Relational Database
10 14 (12.61%) Data Warehouse
11 12 (10.81%) MySQL
11 12 (10.81%) PostgreSQL
12 9 (8.11%) Flink
12 9 (8.11%) Impala
13 8 (7.21%) Parquet
13 8 (7.21%) RDBMS
13 8 (7.21%) SQL Server
14 7 (6.31%) Neo4j
14 7 (6.31%) Redis
15 6 (5.41%) Amazon Redshift
Development Applications
1 31 (27.93%) Jenkins
2 24 (21.62%) Git (software)
3 12 (10.81%) Artifactory
4 11 (9.91%) JIRA
5 9 (8.11%) TeamCity
6 8 (7.21%) JUnit
6 8 (7.21%) Maven
7 6 (5.41%) FishEye
7 6 (5.41%) SonarQube
7 6 (5.41%) Sonatype Nexus
8 4 (3.60%) Gradle
9 3 (2.70%) Cucumber
9 3 (2.70%) Eclipse
9 3 (2.70%) IntelliJ
10 1 (0.90%) Atlassian Bamboo
10 1 (0.90%) GitLab
10 1 (0.90%) Jasmine
10 1 (0.90%) jMock
10 1 (0.90%) Mocha
10 1 (0.90%) Subversion
General
1 18 (16.22%) Finance
2 15 (13.51%) Banking
3 8 (7.21%) Retail
4 7 (6.31%) Investment Banking
5 6 (5.41%) Games
Job Titles
1 32 (28.83%) Data Engineer
2 31 (27.93%) Developer
3 25 (22.52%) Big Data Developer
4 24 (21.62%) Big Data Engineer
5 21 (18.92%) Consultant
6 14 (12.61%) Platform Engineer
7 13 (11.71%) DevOps Engineer
8 12 (10.81%) Architect
8 12 (10.81%) Data Architect
8 12 (10.81%) Hadoop Consultant
8 12 (10.81%) Hadoop Engineer
9 11 (9.91%) Big Data Architect
9 11 (9.91%) Principal Consultant
10 10 (9.01%) Python Engineer
11 9 (8.11%) Hadoop Developer
12 8 (7.21%) AWS Engineer
13 7 (6.31%) Administrator
13 7 (6.31%) Java Developer
14 6 (5.41%) Hadoop Administrator
15 5 (4.50%) Lead Architect
Libraries, Frameworks & Software Standards
1 72 (64.86%) Kafka
2 11 (9.91%) Elastic Stack
3 10 (9.01%) J2EE
3 10 (9.01%) LEMP Stack
4 9 (8.11%) React
5 8 (7.21%) Samza
5 8 (7.21%) TensorFlow
6 7 (6.31%) HTML
6 7 (6.31%) HTML5
6 7 (6.31%) Keras
6 7 (6.31%) MLlib
6 7 (6.31%) Node.js
6 7 (6.31%) scikit-learn
7 6 (5.41%) Natural Language Processing
7 6 (5.41%) Play Framework
7 6 (5.41%) XML
8 5 (4.50%) LAMP
8 5 (4.50%) LAPP Stack
9 4 (3.60%) Apache Avro
9 4 (3.60%) Lucene
Miscellaneous
1 11 (9.91%) Algorithms
2 8 (7.21%) Analytical Skills
3 7 (6.31%) Fintech
3 7 (6.31%) Public Cloud
4 5 (4.50%) Wiki
5 3 (2.70%) Credit Derivative
5 3 (2.70%) Replication
6 1 (0.90%) Derivative
6 1 (0.90%) Fixed Income
6 1 (0.90%) Foreign Exchange (FX)
6 1 (0.90%) Greenfield Project
6 1 (0.90%) Linux Command Line
6 1 (0.90%) Market Risk
Operating Systems
1 50 (45.05%) Linux
2 26 (23.42%) Red Hat Enterprise Linux
3 23 (20.72%) Unix
4 10 (9.01%) Windows
5 7 (6.31%) CentOS
6 5 (4.50%) CoreOS
7 2 (1.80%) Ubuntu
8 1 (0.90%) Debian
Processes & Methodologies
1 39 (35.14%) ETL
2 35 (31.53%) MapReduce
3 33 (29.73%) Agile Software Development
3 33 (29.73%) DevOps
4 26 (23.42%) Continuous Integration
5 19 (17.12%) Scrum
6 18 (16.22%) Data Engineering
7 17 (15.32%) Capacity Management
7 17 (15.32%) Change Management
8 15 (13.51%) Software Delivery
9 14 (12.61%) Data Science
9 14 (12.61%) Machine Learning
9 14 (12.61%) Test Automation
10 13 (11.71%) Analytics
11 12 (10.81%) Build Automation
12 11 (9.91%) Data Analysis
13 10 (9.01%) Business Intelligence
13 10 (9.01%) Open Source
14 9 (8.11%) OOP
14 9 (8.11%) Problem-Solving
Programming Languages
1 66 (59.46%) Python
2 64 (57.66%) Java
3 45 (40.54%) Scala
4 36 (32.43%) SQL
5 23 (20.72%) Bash Shell
6 20 (18.02%) Shell Script
7 13 (11.71%) Ruby
8 12 (10.81%) Go
9 10 (9.01%) Java 8
10 9 (8.11%) JavaScript
11 8 (7.21%) Perl
12 7 (6.31%) R
13 5 (4.50%) Korn
13 5 (4.50%) PowerShell
14 4 (3.60%) C++
15 2 (1.80%) C#
16 1 (0.90%) C
16 1 (0.90%) ES6
16 1 (0.90%) TypeScript
Qualifications
1 11 (9.91%) Security Cleared
2 10 (9.01%) SC Cleared
3 1 (0.90%) DV Cleared
Quality Assurance & Compliance
1 1 (0.90%) GCP
1 1 (0.90%) SLA
System Software
1 76 (68.47%) HDFS
2 40 (36.04%) Apache Flume
3 34 (30.63%) Apache ZooKeeper
4 27 (24.32%) Docker
5 21 (18.92%) Active Directory
6 5 (4.50%) Squid
7 1 (0.90%) etcd
Systems Management
1 39 (35.14%) Oozie
2 33 (29.73%) Ambari
3 27 (24.32%) Ansible
4 18 (16.22%) Apache Slider
5 15 (13.51%) Kubernetes
5 15 (13.51%) Terraform
6 13 (11.71%) Puppet
7 12 (10.81%) Consul
7 12 (10.81%) Prometheus
8 11 (9.91%) Sysdig
9 8 (7.21%) Opscode Chef
10 6 (5.41%) Host Intrusion Detection System
10 6 (5.41%) Kibana
10 6 (5.41%) Nagios
10 6 (5.41%) Network Intrusion Detection System
11 5 (4.50%) HAProxy
11 5 (4.50%) logstash
11 5 (4.50%) Packer
11 5 (4.50%) rkt
11 5 (4.50%) ZABBIX
Vendors
1 47 (42.34%) Hortonworks
2 25 (22.52%) Cloudera
3 14 (12.61%) Oracle
4 13 (11.71%) Tableau
5 11 (9.91%) Google
6 9 (8.11%) MapR
6 9 (8.11%) Microsoft
6 9 (8.11%) Splunk
7 6 (5.41%) Atlassian
7 6 (5.41%) Red Hat
8 5 (4.50%) ForgeRock
9 2 (1.80%) Sybase
10 1 (0.90%) Ab Initio
10 1 (0.90%) Actian
10 1 (0.90%) IBM
10 1 (0.90%) Reuters
10 1 (0.90%) Salesforce.com
10 1 (0.90%) SaltStack
10 1 (0.90%) SAP
10 1 (0.90%) Teradata