Period
to 15 August 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 15 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
England > London
6 months to
15 Aug 2018
Same period 2017 Same period 2016
Rank 515 504 584
Rank change year-on-year -11 +80 +7
Contract jobs citing Hadoop YARN 124 113 40
As % of all contract IT jobs advertised in London 0.27% 0.27% 0.088%
As % of the Systems Management category 1.90% 2.18% 0.75%
Number of daily rates quoted 91 76 29
London median daily rate £525 £540 £575
Median daily rate % change year-on-year -2.78% -6.09% -20.69%
10th Percentile £500 £406 £455
90th Percentile £750 £675 £725
England median daily rate £525 £525 £575
% change year-on-year - -8.70% -20.69%
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for systems management skills.

All Systems Management Skills
London
Contract vacancies with a requirement for systems management skills 6,539 5,187 5,301
As % of all contract IT jobs advertised in London 14.37% 12.17% 11.68%
Number of daily rates quoted 4,831 3,723 3,705
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +11.76%
10th Percentile £313 £313 £310
90th Percentile £675 £638 £620
England median daily rate £490 £475 £438
% change year-on-year +3.16% +8.57% +9.38%
Number of hourly rates quoted 85 40 31
London median hourly rate £22.95 £26.05 £19.00
Median hourly rate % change year-on-year -11.91% +37.12% -5.00%
10th Percentile £14.80 £12.45 £14.45
90th Percentile £54.85 £50.52 £43.75
England median hourly rate £19.25 £17.39 £21.54
% change year-on-year +10.70% -19.27% +5.07%

Hadoop YARN
Job Vacancy Trend in London

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN in London.

Contractor daily rate trend for Hadoop YARN in London

Hadoop YARN
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop YARN in London over the 6 months to 15 August 2018.

Contractor daily rate histogram for Hadoop YARN in London

Hadoop YARN
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the London region over the 6 months to 15 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -7 30 £525 -4.55% 2
East London -10 14 £500 -13.04% 1
South London -28 14 £525 -
Hadoop YARN
England

For the 6 months to 15 August 2018, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop YARN.

1 120 (96.77%) Hadoop
2 113 (91.13%) Apache Hive
3 106 (85.48%) Big Data
4 90 (72.58%) Python
5 87 (70.16%) Apache Spark
6 82 (66.13%) HDFS
7 80 (64.52%) Kafka
8 71 (57.26%) Agile Software Development
9 70 (56.45%) Java
9 70 (56.45%) HBase
10 65 (52.42%) SQL
11 63 (50.81%) Amazon AWS
12 62 (50.00%) Sqoop
13 61 (49.19%) ETL
14 60 (48.39%) Ansible
15 58 (46.77%) Scrum
16 57 (45.97%) Unix
17 54 (43.55%) Jenkins
18 49 (39.52%) Cloudera
19 47 (37.90%) DevOps
19 47 (37.90%) Bash Shell
19 47 (37.90%) Linux
20 44 (35.48%) Continuous Integration
21 42 (33.87%) Oozie
22 40 (32.26%) Test Automation
23 38 (30.65%) Scala
23 38 (30.65%) Amazon S3
23 38 (30.65%) Data Analysis
24 37 (29.84%) Build Automation
25 35 (28.23%) Shell Script

Hadoop YARN
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 87 (70.16%) Apache Spark
2 31 (25.00%) Apache Solr
3 21 (16.94%) Elasticsearch
4 18 (14.52%) Apache Pig
5 17 (13.71%) Apache
6 11 (8.87%) Confluence
7 4 (3.23%) nginx
8 2 (1.61%) Tomcat
9 1 (0.81%) Cloud Foundry
9 1 (0.81%) SAS
Applications
1 31 (25.00%) Microsoft Excel
1 31 (25.00%) MS Visio
Cloud Services
1 63 (50.81%) Amazon AWS
2 38 (30.65%) Amazon S3
3 33 (26.61%) Amazon EC2
4 31 (25.00%) Virtual Private Cloud
5 20 (16.13%) Google Cloud Platform
6 14 (11.29%) GitHub
6 14 (11.29%) Microsoft Azure
7 5 (4.03%) Cloud Computing
8 3 (2.42%) IaaS
8 3 (2.42%) PaaS
8 3 (2.42%) Yarn
9 2 (1.61%) Amazon EMR
9 2 (1.61%) IBM Cloud
9 2 (1.61%) npm
10 1 (0.81%) OpenShift
10 1 (0.81%) Serverless
Communications & Networking
1 30 (24.19%) Kerberos
2 18 (14.52%) SSL
3 15 (12.10%) VPN
4 6 (4.84%) Firewall
4 6 (4.84%) HTTP
5 5 (4.03%) DNS
5 5 (4.03%) ICMP
5 5 (4.03%) TCP/IP
6 4 (3.23%) HTTPS
7 2 (1.61%) Network Security
8 1 (0.81%) Multicast
Database & Business Intelligence
1 120 (96.77%) Hadoop
2 113 (91.13%) Apache Hive
3 106 (85.48%) Big Data
4 70 (56.45%) HBase
5 62 (50.00%) Sqoop
6 34 (27.42%) Impala
7 33 (26.61%) SQL Server
8 23 (18.55%) Apache Cassandra
9 21 (16.94%) NoSQL
10 14 (11.29%) MongoDB
11 13 (10.48%) Relational Database
12 11 (8.87%) Data Warehouse
12 11 (8.87%) Parquet
13 9 (7.26%) Data Lake
13 9 (7.26%) PostgreSQL
13 9 (7.26%) Presto
14 8 (6.45%) Amazon Redshift
14 8 (6.45%) Flink
15 7 (5.65%) Data Mining
15 7 (5.65%) Redis
Development Applications
1 54 (43.55%) Jenkins
2 24 (19.35%) Git (software)
3 21 (16.94%) JIRA
4 7 (5.65%) FishEye
5 6 (4.84%) Maven
6 5 (4.03%) Artifactory
6 5 (4.03%) SonarQube
6 5 (4.03%) TeamCity
7 4 (3.23%) Gatling
7 4 (3.23%) Gradle
8 2 (1.61%) GitLab
8 2 (1.61%) Jasmine
8 2 (1.61%) JUnit
8 2 (1.61%) Mocha
8 2 (1.61%) Travis CI
9 1 (0.81%) Atlassian Bamboo
9 1 (0.81%) gulp
9 1 (0.81%) jMock
9 1 (0.81%) Subversion
General
1 25 (20.16%) Banking
2 18 (14.52%) Finance
3 15 (12.10%) Investment Banking
4 8 (6.45%) Publishing
5 7 (5.65%) Games
6 5 (4.03%) Legal
Job Titles
1 37 (29.84%) Developer
1 37 (29.84%) Platform Engineer
2 31 (25.00%) Big Data Developer
3 25 (20.16%) Big Data Engineer
3 25 (20.16%) Data Engineer
4 15 (12.10%) Hadoop Developer
5 11 (8.87%) Hadoop Engineer
6 10 (8.06%) DevOps Engineer
7 9 (7.26%) Architect
7 9 (7.26%) AWS Engineer
7 9 (7.26%) Big Data Architect
7 9 (7.26%) Data Architect
7 9 (7.26%) Java Developer
8 8 (6.45%) Consultant
9 6 (4.84%) AWS DevOps
9 6 (4.84%) AWS DevOps Engineer
9 6 (4.84%) Principal Consultant
9 6 (4.84%) Python Engineer
10 5 (4.03%) Hadoop Consultant
11 4 (3.23%) Administrator
Libraries, Frameworks & Software Standards
1 80 (64.52%) Kafka
2 17 (13.71%) Spark Streaming
3 11 (8.87%) Elastic Stack
3 11 (8.87%) J2EE
4 10 (8.06%) React
4 10 (8.06%) RESTful
5 9 (7.26%) HTML
5 9 (7.26%) HTML5
6 7 (5.65%) Natural Language Processing
6 7 (5.65%) OAuth
6 7 (5.65%) Play Framework
6 7 (5.65%) XML
7 6 (4.84%) Samza
8 5 (4.03%) Apache Avro
9 4 (3.23%) LDAP
9 4 (3.23%) LEMP Stack
9 4 (3.23%) Lucene
9 4 (3.23%) PySpark
9 4 (3.23%) SAML
9 4 (3.23%) Web Services
Miscellaneous
1 31 (25.00%) Wiki
2 13 (10.48%) Algorithms
3 12 (9.68%) Analytical Skills
4 8 (6.45%) Fintech
5 6 (4.84%) Public Cloud
6 5 (4.03%) Greenfield Project
7 3 (2.42%) Data Centre
7 3 (2.42%) Replication
8 2 (1.61%) Computer Science
8 2 (1.61%) Data Structures
9 1 (0.81%) Fixed Income
9 1 (0.81%) Foreign Exchange (FX)
9 1 (0.81%) Linux Command Line
9 1 (0.81%) Management Information System
9 1 (0.81%) Market Risk
9 1 (0.81%) Virtual Team
Operating Systems
1 57 (45.97%) Unix
2 47 (37.90%) Linux
3 33 (26.61%) Windows
4 7 (5.65%) Red Hat Enterprise Linux
5 1 (0.81%) CentOS
5 1 (0.81%) DC/OS
5 1 (0.81%) Ubuntu
Processes & Methodologies
1 71 (57.26%) Agile Software Development
2 61 (49.19%) ETL
3 58 (46.77%) Scrum
4 47 (37.90%) DevOps
5 44 (35.48%) Continuous Integration
6 40 (32.26%) Test Automation
7 38 (30.65%) Data Analysis
8 37 (29.84%) Build Automation
9 33 (26.61%) MapReduce
10 31 (25.00%) Data Extraction
11 24 (19.35%) Data Science
12 22 (17.74%) Business Intelligence
13 15 (12.10%) Analytics
14 14 (11.29%) Open Source
15 12 (9.68%) Data Modelling
15 12 (9.68%) Kanban
15 12 (9.68%) Software Delivery
16 11 (8.87%) Configuration Management
16 11 (8.87%) Problem-Solving
17 10 (8.06%) Software Engineering
Programming Languages
1 90 (72.58%) Python
2 70 (56.45%) Java
3 65 (52.42%) SQL
4 47 (37.90%) Bash Shell
5 38 (30.65%) Scala
6 35 (28.23%) Shell Script
7 31 (25.00%) Korn
7 31 (25.00%) PowerShell
8 10 (8.06%) Java 8
8 10 (8.06%) JavaScript
9 8 (6.45%) Perl
9 8 (6.45%) R
10 7 (5.65%) Ruby
11 6 (4.84%) Go
12 4 (3.23%) C++
13 2 (1.61%) C#
14 1 (0.81%) Clojure
14 1 (0.81%) ES6
14 1 (0.81%) Haskell
14 1 (0.81%) TypeScript
Qualifications
1 6 (4.84%) SC Cleared
1 6 (4.84%) Security Cleared
2 1 (0.81%) Computer Science Degree
2 1 (0.81%) Degree
2 1 (0.81%) DV Cleared
Quality Assurance & Compliance
1 4 (3.23%) GDPR
1 4 (3.23%) ISO/IEC 27001
2 3 (2.42%) Data Quality
2 3 (2.42%) GCP
3 1 (0.81%) SLA
System Software
1 82 (66.13%) HDFS
2 23 (18.55%) Apache ZooKeeper
3 17 (13.71%) Docker
4 16 (12.90%) Apache Flume
5 7 (5.65%) Active Directory
6 1 (0.81%) etcd
Systems Management
1 60 (48.39%) Ansible
2 42 (33.87%) Oozie
3 33 (26.61%) Opscode Chef
3 33 (26.61%) Puppet
4 22 (17.74%) Ambari
5 13 (10.48%) Terraform
6 12 (9.68%) Kubernetes
7 8 (6.45%) Prometheus
8 7 (5.65%) Apache Slider
9 6 (4.84%) Consul
9 6 (4.84%) Kibana
10 5 (4.03%) Host Intrusion Detection System
10 5 (4.03%) logstash
10 5 (4.03%) Network Intrusion Detection System
10 5 (4.03%) Sysdig
11 4 (3.23%) HAProxy
11 4 (3.23%) Single Sign-On
12 2 (1.61%) FreeIPA
12 2 (1.61%) Mesos
13 1 (0.81%) Apache Brooklyn
Vendors
1 49 (39.52%) Cloudera
2 31 (25.00%) Oracle
3 29 (23.39%) Hortonworks
4 21 (16.94%) Google
5 19 (15.32%) Tableau
6 7 (5.65%) Atlassian
7 5 (4.03%) Splunk
8 4 (3.23%) Cognos
9 3 (2.42%) MapR
10 2 (1.61%) Facebook
10 2 (1.61%) IBM
10 2 (1.61%) Salesforce.com
11 1 (0.81%) FXall
11 1 (0.81%) Microsoft
11 1 (0.81%) Red Hat
11 1 (0.81%) Reuters
11 1 (0.81%) Sybase