Period
to 20 November 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 20 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
Central London > City of London
6 months to
20 Nov 2019
Same period 2018 Same period 2017
Rank 206 224 227
Rank change year-on-year +18 +3 +17
Contract jobs citing Hadoop YARN 17 31 25
As % of all contract IT jobs advertised in the City of London 0.29% 0.44% 0.35%
As % of the Systems Management category 1.76% 2.62% 3.08%
Number of daily rates quoted 17 29 23
City of London median daily rate £650 £525 £550
Median daily rate % change year-on-year +23.81% -4.55% -12.00%
10th Percentile £525 £513 £415
90th Percentile £700 £720 £638
Central London median daily rate £650 £538 £550
% change year-on-year +20.93% -2.27% -12.00%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for systems management skills.

All Systems Management Skills
City of London
Contract vacancies with a requirement for systems management skills 967 1,182 811
As % of all contract IT jobs advertised in the City of London 16.45% 16.75% 11.44%
Number of daily rates quoted 785 956 658
City of London median daily rate £545 £525 £518
Median daily rate % change year-on-year +3.81% +1.45% +8.95%
10th Percentile £331 £300 £325
90th Percentile £688 £675 £663
Central London median daily rate £538 £525 £500
% change year-on-year +2.38% +5.00% +5.26%
Number of hourly rates quoted 17 29 6
City of London median hourly rate £20.50 £18.70 £22.25
Median hourly rate % change year-on-year +9.63% -15.96% -19.09%
10th Percentile £12.76 £14.80 £15.75
90th Percentile £50.31 £25.50 £47.50
Central London median hourly rate £20.50 £18.70 £19.00
% change year-on-year +9.63% -1.58% -30.91%

Hadoop YARN
Job Vacancy Trend in the City of London

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop YARN in the City of London

Hadoop YARN
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop YARN in the City of London.

Contractor daily rate trend for Hadoop YARN in the City of London

Hadoop YARN
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop YARN in the City of London over the 6 months to 20 November 2019.

Contractor daily rate histogram for Hadoop YARN in the City of London

For the 6 months to 20 November 2019, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop YARN.

1 17 (100.00%) Python
1 17 (100.00%) Hadoop
2 16 (94.12%) Apache Spark
3 14 (82.35%) SQL
4 13 (76.47%) Java
4 13 (76.47%) Agile Software Development
5 11 (64.71%) DevOps
5 11 (64.71%) Apache Hive
5 11 (64.71%) HBase
6 10 (58.82%) Finance
6 10 (58.82%) Unix
6 10 (58.82%) Scala
6 10 (58.82%) JIRA
7 9 (52.94%) Big Data
7 9 (52.94%) Kafka
7 9 (52.94%) Jenkins
7 9 (52.94%) HDFS
8 8 (47.06%) ETL
9 7 (41.18%) Spark SQL
9 7 (41.18%) Analytics
10 6 (35.29%) R
10 6 (35.29%) Presto
10 6 (35.29%) TDD
10 6 (35.29%) Performance Testing
10 6 (35.29%) Git (software)
10 6 (35.29%) Data Science
11 5 (29.41%) Computer Science
11 5 (29.41%) Spring
11 5 (29.41%) Retail Banking
11 5 (29.41%) Scrum

Hadoop YARN
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 16 (94.12%) Apache Spark
2 5 (29.41%) Apache
3 3 (17.65%) Elasticsearch
3 3 (17.65%) Jupyter
4 2 (11.76%) Confluence
Applications
1 1 (5.88%) Microsoft Excel
Cloud Services
1 4 (23.53%) GitHub
2 3 (17.65%) Amazon EMR
2 3 (17.65%) Amazon Kinesis
2 3 (17.65%) AWS
3 2 (11.76%) Amazon CloudWatch
3 2 (11.76%) Amazon S3
3 2 (11.76%) AWS CloudFormation
3 2 (11.76%) AWS CloudTrail
3 2 (11.76%) AWS Lambda
3 2 (11.76%) AWS Step Functions
3 2 (11.76%) GCP
3 2 (11.76%) Serverless
4 1 (5.88%) Power Platform
Communications & Networking
1 1 (5.88%) Kerberos
Database & Business Intelligence
1 17 (100.00%) Hadoop
2 11 (64.71%) Apache Hive
2 11 (64.71%) HBase
3 9 (52.94%) Big Data
4 7 (41.18%) Spark SQL
5 6 (35.29%) Presto
6 5 (29.41%) Sqoop
7 3 (17.65%) Data Lake
7 3 (17.65%) Impala
8 2 (11.76%) Amazon Athena
8 2 (11.76%) Apache Zeppelin
8 2 (11.76%) Data Warehouse
8 2 (11.76%) Parquet
9 1 (5.88%) Power BI
9 1 (5.88%) SQL Server
Development Applications
1 10 (58.82%) JIRA
2 9 (52.94%) Jenkins
3 6 (35.29%) Git (software)
4 5 (29.41%) Travis CI
5 2 (11.76%) Atlassian Bamboo
6 1 (5.88%) Hudson
General
1 10 (58.82%) Finance
2 5 (29.41%) Retail Banking
3 3 (17.65%) Banking
4 2 (11.76%) Publishing
Job Titles
1 9 (52.94%) Data Engineer
2 7 (41.18%) Developer
3 5 (29.41%) Hadoop Developer
3 5 (29.41%) Java Developer
3 5 (29.41%) Java Hadoop Developer
4 3 (17.65%) Hadoop Engineer
5 2 (11.76%) AWS Engineer
5 2 (11.76%) Big Data Developer
5 2 (11.76%) Java Engineer
5 2 (11.76%) Scala Developer
6 1 (5.88%) Big Data Engineer
6 1 (5.88%) Cloud Engineer
6 1 (5.88%) Python Engineer
6 1 (5.88%) Team Leader
Libraries, Frameworks & Software Standards
1 9 (52.94%) Kafka
2 5 (29.41%) PySpark
2 5 (29.41%) Spark Streaming
2 5 (29.41%) Spring
3 4 (23.53%) RESTful
4 2 (11.76%) Elastic Stack
4 2 (11.76%) JSON
4 2 (11.76%) Web Services
4 2 (11.76%) XML
5 1 (5.88%) LDAP
Miscellaneous
1 5 (29.41%) Linux Command Line
2 2 (11.76%) Cloud Native
3 1 (5.88%) Algorithms
Operating Systems
1 10 (58.82%) Unix
2 5 (29.41%) Linux
3 1 (5.88%) CentOS
Processes & Methodologies
1 13 (76.47%) Agile Software Development
2 11 (64.71%) DevOps
3 8 (47.06%) ETL
4 7 (41.18%) Analytics
5 6 (35.29%) Data Science
5 6 (35.29%) Performance Testing
5 6 (35.29%) TDD
6 5 (29.41%) Computer Science
6 5 (29.41%) Data Engineering
6 5 (29.41%) Data Modelling
6 5 (29.41%) Functional Programming
6 5 (29.41%) OOP
6 5 (29.41%) Performance Optimisation
6 5 (29.41%) Performance Tuning
6 5 (29.41%) Scrum
7 4 (23.53%) Deployment Automation
7 4 (23.53%) Mentoring
7 4 (23.53%) Test Automation
8 3 (17.65%) Sprint Retrospective
8 3 (17.65%) Sprint Review
Programming Languages
1 17 (100.00%) Python
2 14 (82.35%) SQL
3 13 (76.47%) Java
4 10 (58.82%) Scala
5 6 (35.29%) R
6 1 (5.88%) Bash Shell
6 1 (5.88%) HiveQL
6 1 (5.88%) Shell Script
Quality Assurance & Compliance
1 1 (5.88%) QA
System Software
1 9 (52.94%) HDFS
2 2 (11.76%) Docker
3 1 (5.88%) Samba
3 1 (5.88%) VMware ESXi
3 1 (5.88%) VMware Infrastructure
Systems Management
1 4 (23.53%) Ansible
2 2 (11.76%) Kubernetes
3 1 (5.88%) Ambari
Vendors
1 4 (23.53%) Tableau
2 2 (11.76%) Cloudera
2 2 (11.76%) Google
2 2 (11.76%) Hortonworks
3 1 (5.88%) Ab Initio
3 1 (5.88%) Foundry
3 1 (5.88%) Microsoft
3 1 (5.88%) Oracle
3 1 (5.88%) Palantir
3 1 (5.88%) Red Hat
3 1 (5.88%) Teradata
3 1 (5.88%) VMware