Period
to 20 October 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 20 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
England > London
6 months to
20 Oct 2018
Same period 2017 Same period 2016
Rank 484 500 590
Rank change year-on-year +16 +90 +4
Contract jobs citing Hadoop YARN 146 116 43
As % of all contract IT jobs advertised in London 0.32% 0.26% 0.096%
As % of the Systems Management category 2.08% 2.11% 0.80%
Number of daily rates quoted 115 88 33
London median daily rate £525 £543 £550
Median daily rate % change year-on-year -3.23% -1.36% -15.38%
10th Percentile £500 £400 £451
90th Percentile £775 £683 £675
England median daily rate £525 £525 £550
% change year-on-year - -4.55% -15.38%
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for systems management skills.

All Systems Management Skills
London
Contract vacancies with a requirement for systems management skills 7,028 5,497 5,404
As % of all contract IT jobs advertised in London 15.36% 12.20% 12.11%
Number of daily rates quoted 5,209 4,001 3,643
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +8.57%
10th Percentile £331 £313 £313
90th Percentile £675 £638 £618
England median daily rate £500 £475 £440
% change year-on-year +5.26% +7.95% +10.00%
Number of hourly rates quoted 76 46 56
London median hourly rate £20.00 £26.80 £20.00
Median hourly rate % change year-on-year -25.38% +34.01% +11.11%
10th Percentile £13.31 £12.00 £14.23
90th Percentile £46.62 £165.00 £31.88
England median hourly rate £17.50 £17.50 £22.50
% change year-on-year - -22.22% +7.14%

Hadoop YARN
Job Vacancy Trend in London

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN in London.

Contractor daily rate trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop YARN in London over the 6 months to 20 October 2018.

Contractor daily rate histogram for Hadoop YARN in London

Hadoop YARN
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the London region over the 6 months to 20 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -8 30 £525 -4.55%
South London -9 28 £525 -2.33% 2
East London -10 16 £500 -16.67%
West London -3 3 £550 +29.41% 2
Hadoop YARN
England

For the 6 months to 20 October 2018, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop YARN.

1 137 (93.84%) Hadoop
2 135 (92.47%) Apache Hive
3 127 (86.99%) Big Data
4 109 (74.66%) Python
5 100 (68.49%) Agile Software Development
6 91 (62.33%) HDFS
7 86 (58.90%) Apache Spark
8 84 (57.53%) Kafka
8 84 (57.53%) HBase
9 78 (53.42%) Ansible
9 78 (53.42%) Jenkins
9 78 (53.42%) SQL
10 77 (52.74%) Sqoop
11 76 (52.05%) Cloudera
12 75 (51.37%) Scrum
13 73 (50.00%) Unix
14 72 (49.32%) Amazon AWS
15 70 (47.95%) ETL
16 69 (47.26%) Java
17 64 (43.84%) Bash Shell
18 61 (41.78%) Impala
19 56 (38.36%) Test Automation
20 55 (37.67%) Continuous Integration
21 51 (34.93%) DevOps
22 50 (34.25%) Amazon S3
23 49 (33.56%) Data Analysis
23 49 (33.56%) Shell Script
24 46 (31.51%) Windows
24 46 (31.51%) Amazon EC2
24 46 (31.51%) Build Automation

Hadoop YARN
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 86 (58.90%) Apache Spark
2 29 (19.86%) Elasticsearch
3 26 (17.81%) Apache Solr
4 19 (13.01%) Apache
5 12 (8.22%) Confluence
6 10 (6.85%) Apache Pig
7 4 (2.74%) SAS
8 1 (0.68%) Cloud Foundry
8 1 (0.68%) nginx
Applications
1 45 (30.82%) Microsoft Excel
1 45 (30.82%) MS Visio
Cloud Services
1 72 (49.32%) Amazon AWS
2 50 (34.25%) Amazon S3
3 46 (31.51%) Amazon EC2
4 45 (30.82%) Virtual Private Cloud
5 21 (14.38%) GitHub
6 19 (13.01%) Google Cloud Platform
7 17 (11.64%) Microsoft Azure
8 7 (4.79%) Cloud Computing
9 5 (3.42%) IaaS
9 5 (3.42%) PaaS
10 3 (2.05%) IBM Cloud
11 2 (1.37%) Amazon EMR
11 2 (1.37%) npm
11 2 (1.37%) Yarn
12 1 (0.68%) OpenShift
12 1 (0.68%) Serverless
Communications & Networking
1 25 (17.12%) Kerberos
2 14 (9.59%) SSL
3 11 (7.53%) VPN
4 8 (5.48%) HTTP
5 6 (4.11%) Firewall
5 6 (4.11%) HTTPS
6 3 (2.05%) DNS
7 1 (0.68%) ICMP
7 1 (0.68%) TCP/IP
Database & Business Intelligence
1 137 (93.84%) Hadoop
2 135 (92.47%) Apache Hive
3 127 (86.99%) Big Data
4 84 (57.53%) HBase
5 77 (52.74%) Sqoop
6 61 (41.78%) Impala
7 45 (30.82%) SQL Server
8 20 (13.70%) Apache Cassandra
9 19 (13.01%) NoSQL
10 14 (9.59%) Presto
11 11 (7.53%) Data Warehouse
12 10 (6.85%) Data Lake
12 10 (6.85%) Parquet
12 10 (6.85%) Relational Database
13 7 (4.79%) Spark SQL
14 6 (4.11%) Amazon Redshift
14 6 (4.11%) Flink
14 6 (4.11%) MongoDB
14 6 (4.11%) PostgreSQL
14 6 (4.11%) QlikView
Development Applications
1 78 (53.42%) Jenkins
2 32 (21.92%) Git (software)
3 30 (20.55%) JIRA
4 5 (3.42%) TeamCity
5 4 (2.74%) FishEye
5 4 (2.74%) Gatling
5 4 (2.74%) Gradle
6 3 (2.05%) Maven
7 2 (1.37%) GitLab
7 2 (1.37%) Jasmine
7 2 (1.37%) Mocha
7 2 (1.37%) Travis CI
8 1 (0.68%) Artifactory
8 1 (0.68%) gulp
8 1 (0.68%) JUnit
8 1 (0.68%) SonarQube
General
1 24 (16.44%) Banking
2 14 (9.59%) Investment Banking
3 13 (8.90%) Finance
3 13 (8.90%) Publishing
4 7 (4.79%) Legal
5 4 (2.74%) Games
6 1 (0.68%) Retail
Job Titles
1 46 (31.51%) Platform Engineer
2 36 (24.66%) Developer
3 35 (23.97%) Data Engineer
4 31 (21.23%) Big Data Engineer
5 25 (17.12%) Big Data Developer
6 14 (9.59%) Java Developer
7 13 (8.90%) Hadoop Developer
7 13 (8.90%) Python Engineer
8 11 (7.53%) Architect
8 11 (7.53%) Big Data Architect
8 11 (7.53%) Data Architect
8 11 (7.53%) Hadoop Engineer
9 9 (6.16%) AWS Engineer
9 9 (6.16%) DevOps Engineer
10 6 (4.11%) AWS DevOps
10 6 (4.11%) AWS DevOps Engineer
10 6 (4.11%) Cloud Engineer
11 5 (3.42%) Consultant
11 5 (3.42%) Senior DevOps
12 4 (2.74%) Principal Consultant
Libraries, Frameworks & Software Standards
1 84 (57.53%) Kafka
2 31 (21.23%) Spark Streaming
3 15 (10.27%) RESTful
4 12 (8.22%) Elastic Stack
5 9 (6.16%) OAuth
6 7 (4.79%) PySpark
7 6 (4.11%) Apache Avro
7 6 (4.11%) HTML
7 6 (4.11%) HTML5
7 6 (4.11%) J2EE
7 6 (4.11%) LDAP
7 6 (4.11%) React
7 6 (4.11%) SAML
8 4 (2.74%) Natural Language Processing
8 4 (2.74%) Play Framework
8 4 (2.74%) XML
9 3 (2.05%) Node.js
9 3 (2.05%) OAuth2
10 2 (1.37%) Memcached
10 2 (1.37%) REST
Miscellaneous
1 45 (30.82%) Wiki
2 10 (6.85%) Analytical Skills
3 9 (6.16%) Greenfield Project
4 6 (4.11%) Algorithms
5 5 (3.42%) Data Centre
5 5 (3.42%) Fintech
6 3 (2.05%) Cyber Defence
6 3 (2.05%) Data Structures
7 2 (1.37%) Computer Science
7 2 (1.37%) Linux Command Line
7 2 (1.37%) Management Information System
7 2 (1.37%) Virtual Team
8 1 (0.68%) Public Cloud
Operating Systems
1 73 (50.00%) Unix
2 46 (31.51%) Windows
3 43 (29.45%) Linux
4 4 (2.74%) Red Hat Enterprise Linux
5 1 (0.68%) DC/OS
Processes & Methodologies
1 100 (68.49%) Agile Software Development
2 75 (51.37%) Scrum
3 70 (47.95%) ETL
4 56 (38.36%) Test Automation
5 55 (37.67%) Continuous Integration
6 51 (34.93%) DevOps
7 49 (33.56%) Data Analysis
8 46 (31.51%) Build Automation
9 45 (30.82%) Data Extraction
10 36 (24.66%) MapReduce
11 27 (18.49%) Business Intelligence
12 22 (15.07%) Data Science
13 21 (14.38%) TDD
14 17 (11.64%) BDD
15 16 (10.96%) Analytics
15 16 (10.96%) Data Modelling
15 16 (10.96%) Deployment Automation
16 14 (9.59%) SDLC
17 13 (8.90%) Information Security
17 13 (8.90%) Requirements Management
Programming Languages
1 109 (74.66%) Python
2 78 (53.42%) SQL
3 69 (47.26%) Java
4 64 (43.84%) Bash Shell
5 49 (33.56%) Shell Script
6 45 (30.82%) Korn
6 45 (30.82%) PowerShell
7 32 (21.92%) Scala
8 8 (5.48%) Java 8
9 7 (4.79%) R
10 6 (4.11%) JavaScript
11 4 (2.74%) C#
11 4 (2.74%) C++
11 4 (2.74%) Perl
12 2 (1.37%) Ruby
13 1 (0.68%) Clojure
13 1 (0.68%) Go
13 1 (0.68%) Haskell
Qualifications
1 4 (2.74%) SC Cleared
1 4 (2.74%) Security Cleared
2 1 (0.68%) Computer Science Degree
2 1 (0.68%) Degree
Quality Assurance & Compliance
1 6 (4.11%) Data Quality
1 6 (4.11%) GDPR
1 6 (4.11%) ISO/IEC 27001
2 4 (2.74%) QA
3 3 (2.05%) SLA
System Software
1 91 (62.33%) HDFS
2 20 (13.70%) Apache ZooKeeper
3 17 (11.64%) Apache Flume
4 16 (10.96%) Docker
5 4 (2.74%) Active Directory
6 1 (0.68%) Cronacle
Systems Management
1 78 (53.42%) Ansible
2 46 (31.51%) Opscode Chef
2 46 (31.51%) Puppet
3 45 (30.82%) Oozie
4 15 (10.27%) Ambari
5 12 (8.22%) Kubernetes
6 11 (7.53%) Kibana
7 10 (6.85%) logstash
7 10 (6.85%) Terraform
8 6 (4.11%) Single Sign-On
9 4 (2.74%) Apache Slider
10 3 (2.05%) Prometheus
11 1 (0.68%) Apache Brooklyn
11 1 (0.68%) Consul
11 1 (0.68%) Docker Swarm
11 1 (0.68%) Host Intrusion Detection System
11 1 (0.68%) Marathon
11 1 (0.68%) Mesos
11 1 (0.68%) Network Intrusion Detection System
11 1 (0.68%) Sysdig
Vendors
1 76 (52.05%) Cloudera
2 45 (30.82%) Oracle
3 26 (17.81%) Hortonworks
4 20 (13.70%) Google
4 20 (13.70%) Tableau
5 6 (4.11%) Cognos
6 4 (2.74%) Atlassian
6 4 (2.74%) Microsoft
7 3 (2.05%) IBM
7 3 (2.05%) MapR
7 3 (2.05%) Splunk
8 2 (1.37%) Facebook
8 2 (1.37%) Informatica
8 2 (1.37%) Salesforce.com
9 1 (0.68%) Red Hat