Period
to 13 December 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 13 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
England > London
6 months to
13 Dec 2018
Same period 2017 Same period 2016
Rank 484 532 539
Rank change year-on-year +48 +7 +45
Contract jobs citing Hadoop YARN 149 117 82
As % of all contract IT jobs advertised in London 0.32% 0.25% 0.18%
As % of the Systems Management category 2.00% 1.96% 1.49%
Number of daily rates quoted 116 89 63
London median daily rate £550 £550 £580
Median daily rate % change year-on-year - -5.17% -10.77%
10th Percentile £488 £400 £463
90th Percentile £775 £640 £713
England median daily rate £550 £525 £575
% change year-on-year +4.76% -8.70% -11.54%
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for systems management skills.

All Systems Management Skills
London
Contract vacancies with a requirement for systems management skills 7,434 5,957 5,492
As % of all contract IT jobs advertised in London 15.78% 12.54% 12.37%
Number of daily rates quoted 5,537 4,412 3,694
London median daily rate £538 £513 £484
Median daily rate % change year-on-year +4.88% +5.94% +7.50%
10th Percentile £350 £313 £313
90th Percentile £675 £638 £625
England median daily rate £500 £475 £450
% change year-on-year +5.26% +5.56% +7.78%
Number of hourly rates quoted 81 59 59
London median hourly rate £19.00 £25.50 £18.00
Median hourly rate % change year-on-year -25.49% +41.67% -10.00%
10th Percentile £13.31 £11.96 £13.00
90th Percentile £45.87 £165.00 £47.94
England median hourly rate £17.50 £17.07 £20.73
% change year-on-year +2.53% -17.67% +3.65%

Hadoop YARN
Job Vacancy Trend in London

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN in London.

Contractor daily rate trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop YARN in London over the 6 months to 13 December 2018.

Contractor daily rate histogram for Hadoop YARN in London

Hadoop YARN
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the London region over the 6 months to 13 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -12 32 £563 +2.27% 1
South London +5 31 £525 -2.33%
East London -30 10 £550 -8.33%
West London +1 7 £500 +17.65%
Hadoop YARN
England

For the 6 months to 13 December 2018, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop YARN.

1 136 (91.28%) Hadoop
2 129 (86.58%) Apache Hive
3 121 (81.21%) Big Data
4 106 (71.14%) Python
5 91 (61.07%) Agile Software Development
5 91 (61.07%) Apache Spark
6 89 (59.73%) Kafka
7 86 (57.72%) HBase
8 83 (55.70%) HDFS
9 74 (49.66%) Ansible
10 73 (48.99%) Jenkins
10 73 (48.99%) Java
11 70 (46.98%) SQL
11 70 (46.98%) Cloudera
12 68 (45.64%) Sqoop
13 67 (44.97%) Unix
14 64 (42.95%) ETL
15 62 (41.61%) Amazon AWS
16 60 (40.27%) Scrum
17 59 (39.60%) Impala
18 54 (36.24%) Bash Shell
19 49 (32.89%) Test Automation
19 49 (32.89%) Linux
20 48 (32.21%) DevOps
21 44 (29.53%) Continuous Integration
22 42 (28.19%) Shell Script
23 41 (27.52%) Spark Streaming
24 40 (26.85%) Scala
24 40 (26.85%) Amazon S3
25 39 (26.17%) Build Automation

Hadoop YARN
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 91 (61.07%) Apache Spark
2 34 (22.82%) Elasticsearch
3 22 (14.77%) Apache
4 14 (9.40%) Apache Solr
5 13 (8.72%) Apache Pig
5 13 (8.72%) Confluence
6 4 (2.68%) SAS
7 3 (2.01%) nginx
8 1 (0.67%) Jupyter
Applications
1 36 (24.16%) Microsoft Excel
1 36 (24.16%) MS Visio
Cloud Services
1 62 (41.61%) Amazon AWS
2 40 (26.85%) Amazon S3
3 37 (24.83%) Amazon EC2
4 36 (24.16%) Virtual Private Cloud
5 26 (17.45%) Microsoft Azure
6 22 (14.77%) GitHub
7 20 (13.42%) Google Cloud Platform
8 8 (5.37%) IaaS
9 7 (4.70%) PaaS
10 6 (4.03%) Cloud Computing
11 3 (2.01%) IBM Cloud
12 2 (1.34%) Amazon Kinesis
12 2 (1.34%) SaaS
13 1 (0.67%) Amazon EMR
Communications & Networking
1 19 (12.75%) Kerberos
2 15 (10.07%) VPN
3 11 (7.38%) SSL
4 9 (6.04%) Firewall
5 6 (4.03%) HTTP
5 6 (4.03%) HTTPS
6 5 (3.36%) DNS
7 3 (2.01%) ICMP
7 3 (2.01%) TCP/IP
8 1 (0.67%) LAN
8 1 (0.67%) WAN
Database & Business Intelligence
1 136 (91.28%) Hadoop
2 129 (86.58%) Apache Hive
3 121 (81.21%) Big Data
4 86 (57.72%) HBase
5 68 (45.64%) Sqoop
6 59 (39.60%) Impala
7 37 (24.83%) SQL Server
8 24 (16.11%) Apache Cassandra
9 17 (11.41%) NoSQL
10 14 (9.40%) Presto
11 13 (8.72%) Data Lake
12 10 (6.71%) Data Warehouse
12 10 (6.71%) Flink
12 10 (6.71%) MongoDB
13 9 (6.04%) Spark SQL
14 8 (5.37%) Parquet
14 8 (5.37%) Relational Database
15 6 (4.03%) Pentaho
15 6 (4.03%) PostgreSQL
15 6 (4.03%) QlikView
Development Applications
1 73 (48.99%) Jenkins
2 31 (20.81%) Git (software)
2 31 (20.81%) JIRA
3 4 (2.68%) TeamCity
4 3 (2.01%) Artifactory
4 3 (2.01%) FishEye
4 3 (2.01%) Gatling
4 3 (2.01%) SonarQube
5 2 (1.34%) GitLab
5 2 (1.34%) Gradle
5 2 (1.34%) MSBuild
5 2 (1.34%) Travis CI
5 2 (1.34%) Visual Studio
5 2 (1.34%) Visual Studio Team System
6 1 (0.67%) JUnit
General
1 19 (12.75%) Banking
2 14 (9.40%) Publishing
3 12 (8.05%) Finance
4 8 (5.37%) Investment Banking
5 7 (4.70%) Legal
6 3 (2.01%) Games
7 1 (0.67%) Retail
Job Titles
1 51 (34.23%) Data Engineer
2 41 (27.52%) Big Data Engineer
3 39 (26.17%) Platform Engineer
4 34 (22.82%) Developer
5 21 (14.09%) Big Data Developer
6 17 (11.41%) Python Engineer
7 16 (10.74%) Java Developer
8 13 (8.72%) DevOps Engineer
8 13 (8.72%) Hadoop Engineer
9 10 (6.71%) Architect
9 10 (6.71%) Hadoop Developer
10 9 (6.04%) Big Data Architect
10 9 (6.04%) Data Architect
11 7 (4.70%) Java Engineer
12 6 (4.03%) Cloud Engineer
12 6 (4.03%) Senior DevOps
13 5 (3.36%) AWS Engineer
13 5 (3.36%) Azure DevOps
13 5 (3.36%) Azure DevOps Engineer
13 5 (3.36%) Azure Engineer
Libraries, Frameworks & Software Standards
1 89 (59.73%) Kafka
2 41 (27.52%) Spark Streaming
3 16 (10.74%) Elastic Stack
4 14 (9.40%) RESTful
5 9 (6.04%) PySpark
6 8 (5.37%) LDAP
7 6 (4.03%) OAuth
7 6 (4.03%) SAML
8 5 (3.36%) Apache Avro
9 4 (2.68%) HTML
9 4 (2.68%) HTML5
9 4 (2.68%) Middleware
10 3 (2.01%) LEMP Stack
10 3 (2.01%) Natural Language Processing
10 3 (2.01%) Play Framework
10 3 (2.01%) React
10 3 (2.01%) Samza
10 3 (2.01%) XML
11 2 (1.34%) RabbitMQ
11 2 (1.34%) REST
Miscellaneous
1 36 (24.16%) Wiki
2 8 (5.37%) Analytical Skills
3 7 (4.70%) Algorithms
3 7 (4.70%) Greenfield Project
4 5 (3.36%) Data Centre
5 4 (2.68%) Fintech
6 3 (2.01%) Cyber Defence
6 3 (2.01%) Data Structures
6 3 (2.01%) Public Cloud
6 3 (2.01%) Virtual Team
7 2 (1.34%) Linux Command Line
7 2 (1.34%) Management Information System
Operating Systems
1 67 (44.97%) Unix
2 49 (32.89%) Linux
3 36 (24.16%) Windows
4 3 (2.01%) Red Hat Enterprise Linux
5 2 (1.34%) CoreOS
6 1 (0.67%) DC/OS
Processes & Methodologies
1 91 (61.07%) Agile Software Development
2 64 (42.95%) ETL
3 60 (40.27%) Scrum
4 49 (32.89%) Test Automation
5 48 (32.21%) DevOps
6 44 (29.53%) Continuous Integration
7 39 (26.17%) Build Automation
7 39 (26.17%) Data Analysis
8 36 (24.16%) Data Extraction
9 29 (19.46%) MapReduce
10 25 (16.78%) Business Intelligence
11 23 (15.44%) TDD
12 22 (14.77%) Data Science
13 20 (13.42%) BDD
14 17 (11.41%) Deployment Automation
15 16 (10.74%) Analytics
16 15 (10.07%) Data Modelling
16 15 (10.07%) Performance Tuning
17 14 (9.40%) Open Source
17 14 (9.40%) Requirements Management
Programming Languages
1 106 (71.14%) Python
2 73 (48.99%) Java
3 70 (46.98%) SQL
4 54 (36.24%) Bash Shell
5 42 (28.19%) Shell Script
6 40 (26.85%) Scala
7 36 (24.16%) Korn
7 36 (24.16%) PowerShell
8 9 (6.04%) R
9 4 (2.68%) C#
9 4 (2.68%) C++
9 4 (2.68%) Go
10 3 (2.01%) JavaScript
10 3 (2.01%) Perl
10 3 (2.01%) Ruby
11 2 (1.34%) Java 8
11 2 (1.34%) T-SQL
12 1 (0.67%) C
12 1 (0.67%) Clojure
12 1 (0.67%) Haskell
Qualifications
1 9 (6.04%) SC Cleared
1 9 (6.04%) Security Cleared
2 2 (1.34%) Computer Science Degree
2 2 (1.34%) Degree
Quality Assurance & Compliance
1 6 (4.03%) Data Quality
1 6 (4.03%) GDPR
1 6 (4.03%) ISO/IEC 27001
2 4 (2.68%) QA
2 4 (2.68%) SLA
System Software
1 83 (55.70%) HDFS
2 21 (14.09%) Apache ZooKeeper
3 17 (11.41%) Docker
4 15 (10.07%) Apache Flume
5 2 (1.34%) Active Directory
5 2 (1.34%) etcd
5 2 (1.34%) flannel
6 1 (0.67%) Cronacle
6 1 (0.67%) Oracle RAC
Systems Management
1 74 (49.66%) Ansible
2 38 (25.50%) Puppet
3 37 (24.83%) Oozie
3 37 (24.83%) Opscode Chef
4 23 (15.44%) Ambari
5 17 (11.41%) Kubernetes
6 12 (8.05%) Kibana
6 12 (8.05%) logstash
7 9 (6.04%) Terraform
8 6 (4.03%) Single Sign-On
9 5 (3.36%) Prometheus
10 3 (2.01%) Consul
10 3 (2.01%) HAProxy
10 3 (2.01%) Host Intrusion Detection System
10 3 (2.01%) Network Intrusion Detection System
10 3 (2.01%) Sysdig
11 2 (1.34%) Apache Slider
11 2 (1.34%) Grafana
11 2 (1.34%) rkt
11 2 (1.34%) Tivoli
Vendors
1 70 (46.98%) Cloudera
2 38 (25.50%) Oracle
3 28 (18.79%) Hortonworks
4 18 (12.08%) Google
5 17 (11.41%) Tableau
6 6 (4.03%) Cognos
7 5 (3.36%) Splunk
8 3 (2.01%) Atlassian
8 3 (2.01%) IBM
8 3 (2.01%) MapR
8 3 (2.01%) Microsoft
9 2 (1.34%) Informatica
10 1 (0.67%) Cisco
10 1 (0.67%) Datameer
10 1 (0.67%) Red Hat
10 1 (0.67%) Solace