Period
to 20 July 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop YARN over the 6 months to 20 July 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
20 Jul 2018
Same period 2017 Same period 2016
Rank 1019 1158 1159
Rank change year-on-year +139 +1 +161
Permanent jobs citing Hadoop YARN 161 53 132
As % of all permanent IT jobs advertised in the UK 0.092% 0.030% 0.065%
As % of the Systems Management category 0.90% 0.33% 0.74%
Number of salaries quoted 102 30 87
UK median annual salary £70,000 £57,500 £60,000
Median salary % change year-on-year +21.74% -4.17% -29.41%
10th Percentile £49,000 £42,475 £38,250
90th Percentile £100,000 £102,750 £96,250
UK excluding London median annual salary £58,750 £55,000 £55,000
% change year-on-year +6.82% - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Permanent vacancies with a requirement for systems management skills 17,960 15,827 17,897
As % of all permanent IT jobs advertised in the UK 10.26% 8.93% 8.82%
Number of salaries quoted 14,210 12,763 14,498
UK median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +5.26%
10th Percentile £31,250 £30,000 £30,500
90th Percentile £85,000 £82,500 £75,000
UK excluding London median annual salary £47,500 £45,000 £42,500
% change year-on-year +5.56% +5.88% -

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop YARN.

Salary trend for Hadoop YARN in the UK

Hadoop YARN
Salary Histogram

The salary distribution of IT jobs citing Hadoop YARN over the 6 months to 20 July 2018.

Salary histogram for Hadoop YARN in the UK

Hadoop YARN
Top 12 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 20 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +145 156 £70,000 +22.81% 21
London +78 86 £80,000 +3.23% 13
UK excluding London +48 75 £58,750 +6.82% 13
South East +41 51 £65,000 +18.18% 4
Midlands +9 10 £55,000 -
East Midlands +16 7 £55,000 -
Scotland -20 5 - - 5
South West +5 4 £59,500 +32.22%
West Midlands +22 3 £58,102 +5.64%
North of England +12 3 £57,500 +7.48% 4
Yorkshire - 3 £57,500 - 2
East of England 0 2 £44,400 +18.40%

For the 6 months to 20 July 2018, IT jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop YARN.

1 149 (92.55%) Hadoop
2 145 (90.06%) Apache Hive
3 142 (88.20%) Big Data
4 115 (71.43%) Python
5 110 (68.32%) Kafka
6 109 (67.70%) Scala
7 100 (62.11%) Apache Spark
8 95 (59.01%) Java
9 92 (57.14%) Impala
10 88 (54.66%) MapReduce
11 86 (53.42%) HBase
12 81 (50.31%) Apache Flume
13 79 (49.07%) Cloudera
14 73 (45.34%) Agile Software Development
15 67 (41.61%) Machine Learning
16 63 (39.13%) Hortonworks
17 60 (37.27%) Git (software)
17 60 (37.27%) Data Warehouse
17 60 (37.27%) Linux
18 59 (36.65%) Sqoop
19 58 (36.02%) Apache Cassandra
20 57 (35.40%) Analytics
20 57 (35.40%) HDFS
21 56 (34.78%) Data Engineering
22 53 (32.92%) Jenkins
23 52 (32.30%) Data Science
24 45 (27.95%) Amazon AWS
25 44 (27.33%) Shell Script
26 43 (26.71%) Continuous Integration
27 41 (25.47%) TeamCity

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 100 (62.11%) Apache Spark
2 34 (21.12%) Elasticsearch
3 23 (14.29%) Apache Solr
4 22 (13.66%) Apache Pig
5 14 (8.70%) Apache
6 5 (3.11%) WordPress
7 3 (1.86%) CMS
7 3 (1.86%) Confluence
8 2 (1.24%) nginx
8 2 (1.24%) SAS
8 2 (1.24%) SugarCRM
9 1 (0.62%) Jupyter
9 1 (0.62%) Tomcat
Applications
1 2 (1.24%) Microsoft Excel
Cloud Services
1 45 (27.95%) Amazon AWS
2 19 (11.80%) Microsoft Azure
3 11 (6.83%) Amazon EMR
4 9 (5.59%) Amazon Kinesis
5 7 (4.35%) Yarn
6 6 (3.73%) GitHub
6 6 (3.73%) Google Cloud Platform
6 6 (3.73%) npm
7 4 (2.48%) Amazon S3
8 2 (1.24%) Amazon EC2
8 2 (1.24%) AWS Lambda
8 2 (1.24%) CloudFront
8 2 (1.24%) DigitalOcean
8 2 (1.24%) Serverless
Communications & Networking
1 5 (3.11%) HTTP
2 4 (2.48%) Kerberos
3 3 (1.86%) Firewall
4 2 (1.24%) DNS
4 2 (1.24%) SSH
4 2 (1.24%) SSL
4 2 (1.24%) TCP/IP
5 1 (0.62%) HTTPS
5 1 (0.62%) Network Security
Database & Business Intelligence
1 149 (92.55%) Hadoop
2 145 (90.06%) Apache Hive
3 142 (88.20%) Big Data
4 92 (57.14%) Impala
5 86 (53.42%) HBase
6 60 (37.27%) Data Warehouse
7 59 (36.65%) Sqoop
8 58 (36.02%) Apache Cassandra
9 37 (22.98%) NoSQL
10 34 (21.12%) Flink
11 29 (18.01%) PostgreSQL
12 19 (11.80%) Amazon Redshift
13 13 (8.07%) SQL Server
14 10 (6.21%) MySQL
15 9 (5.59%) Amazon Athena
15 9 (5.59%) Data Lake
15 9 (5.59%) MongoDB
16 7 (4.35%) Couchbase
16 7 (4.35%) CouchDB
17 6 (3.73%) OLAP
Development Applications
1 60 (37.27%) Git (software)
2 53 (32.92%) Jenkins
3 41 (25.47%) TeamCity
4 15 (9.32%) JUnit
5 6 (3.73%) webpack
6 3 (1.86%) Babel
6 3 (1.86%) JIRA
6 3 (1.86%) Maven
7 2 (1.24%) Android Studio
7 2 (1.24%) Bitbucket
7 2 (1.24%) GitLab
7 2 (1.24%) Grunt
7 2 (1.24%) gulp
7 2 (1.24%) TestNG
7 2 (1.24%) Travis CI
7 2 (1.24%) Vagrant
7 2 (1.24%) Xcode
8 1 (0.62%) Gradle
8 1 (0.62%) Jasmine
8 1 (0.62%) JHipster
General
1 17 (10.56%) Marketing
2 14 (8.70%) Telecoms
3 11 (6.83%) Finance
4 4 (2.48%) Retail
5 3 (1.86%) Games
6 2 (1.24%) Financial Institution
7 1 (0.62%) Banking
7 1 (0.62%) Electronics
7 1 (0.62%) Front Office
7 1 (0.62%) Manufacturing
Job Titles
1 102 (63.35%) Data Engineer
2 88 (54.66%) Big Data Engineer
3 56 (34.78%) Hadoop Engineer
4 32 (19.88%) Senior Data Engineer
5 27 (16.77%) Senior Hadoop Engineer
6 21 (13.04%) Architect
6 21 (13.04%) Data Architect
6 21 (13.04%) Developer
7 10 (6.21%) Big Data Architect
7 10 (6.21%) Big Data Developer
8 9 (5.59%) DevOps Engineer
9 7 (4.35%) Hadoop Developer
10 6 (3.73%) Administrator
10 6 (3.73%) Hadoop Administrator
10 6 (3.73%) Java Developer
11 5 (3.11%) Java Hadoop Developer
12 4 (2.48%) Apache Spark Developer
12 4 (2.48%) Java Engineer
13 3 (1.86%) MapReduce Engineer
13 3 (1.86%) QA Engineer
Libraries, Frameworks & Software Standards
1 110 (68.32%) Kafka
2 39 (24.22%) MLlib
2 39 (24.22%) TensorFlow
3 38 (23.60%) Keras
4 19 (11.80%) Spark Streaming
5 16 (9.94%) Elastic Stack
6 8 (4.97%) YAML
7 7 (4.35%) J2EE
7 7 (4.35%) REST
8 6 (3.73%) CSS
8 6 (3.73%) HTML
8 6 (3.73%) Node.js
9 5 (3.11%) Laravel
9 5 (3.11%) Sass
10 4 (2.48%) AngularJS
10 4 (2.48%) Apache Cordova
10 4 (2.48%) Jest
10 4 (2.48%) Redux
10 4 (2.48%) SOAP
11 3 (1.86%) Enzyme
Miscellaneous
1 27 (16.77%) User Experience
2 19 (11.80%) Greenfield Project
3 9 (5.59%) Tandem
4 6 (3.73%) Analytical Skills
5 5 (3.11%) Algorithms
6 3 (1.86%) Computer Science
6 3 (1.86%) Wiki
7 2 (1.24%) Fintech
7 2 (1.24%) Mobile App
8 1 (0.62%) iPhone
8 1 (0.62%) NHS
8 1 (0.62%) Replication
8 1 (0.62%) Self-Motivation
8 1 (0.62%) Virtual Team
Operating Systems
1 60 (37.27%) Linux
2 31 (19.25%) Unix
3 2 (1.24%) Android
3 2 (1.24%) VMS
3 2 (1.24%) Windows
Processes & Methodologies
1 88 (54.66%) MapReduce
2 73 (45.34%) Agile Software Development
3 67 (41.61%) Machine Learning
4 57 (35.40%) Analytics
5 56 (34.78%) Data Engineering
6 52 (32.30%) Data Science
7 43 (26.71%) Continuous Integration
8 41 (25.47%) Deep Learning
9 35 (21.74%) ETL
10 34 (21.12%) Software Delivery
11 28 (17.39%) Operations Research
12 20 (12.42%) Visualisation
13 19 (11.80%) DevOps
14 18 (11.18%) Data Ingestion
14 18 (11.18%) Scrum
15 17 (10.56%) Data Development
16 16 (9.94%) Resource Management
17 14 (8.70%) Data Integration
17 14 (8.70%) Digital Marketing
18 11 (6.83%) Test Automation
Programming Languages
1 115 (71.43%) Python
2 109 (67.70%) Scala
3 95 (59.01%) Java
4 44 (27.33%) Shell Script
5 41 (25.47%) Go
6 36 (22.36%) SQL
7 28 (17.39%) Bash Shell
8 10 (6.21%) JavaScript
9 8 (4.97%) R
10 5 (3.11%) ES6
10 5 (3.11%) PHP
11 4 (2.48%) C
11 4 (2.48%) C#
12 3 (1.86%) TypeScript
13 2 (1.24%) Perl
13 2 (1.24%) PHP 7
13 2 (1.24%) T-SQL
14 1 (0.62%) C++
14 1 (0.62%) Java 8
Qualifications
1 4 (2.48%) Degree
2 3 (1.86%) Computer Science Degree
2 3 (1.86%) Security Cleared
3 2 (1.24%) DV Cleared
3 2 (1.24%) PhD
3 2 (1.24%) SC Cleared
Quality Assurance & Compliance
1 6 (3.73%) Data Quality
2 5 (3.11%) QA
3 3 (1.86%) GCP
4 2 (1.24%) SLA
System Software
1 81 (50.31%) Apache Flume
2 57 (35.40%) HDFS
3 16 (9.94%) Docker
4 14 (8.70%) Apache ZooKeeper
5 8 (4.97%) Virtual Machines
6 2 (1.24%) Active Directory
Systems Management
1 29 (18.01%) Oozie
2 19 (11.80%) Mesos
3 11 (6.83%) Kubernetes
4 9 (5.59%) Ansible
5 5 (3.11%) Ambari
5 5 (3.11%) Opscode Chef
6 4 (2.48%) Puppet
7 2 (1.24%) cPanel
7 2 (1.24%) Docker Swarm
7 2 (1.24%) Prometheus
8 1 (0.62%) Kibana
8 1 (0.62%) Terraform
Vendors
1 79 (49.07%) Cloudera
2 63 (39.13%) Hortonworks
3 15 (9.32%) MapR
4 7 (4.35%) Databricks
4 7 (4.35%) Tableau
5 6 (3.73%) Oracle
6 5 (3.11%) Google
7 3 (1.86%) SAP
7 3 (1.86%) Talend
7 3 (1.86%) Vertica
8 2 (1.24%) Ab Initio
8 2 (1.24%) Actian
8 2 (1.24%) Alteryx
8 2 (1.24%) Informatica
8 2 (1.24%) Microsoft
8 2 (1.24%) MicroStrategy
8 2 (1.24%) ParAccel
8 2 (1.24%) Sybase
8 2 (1.24%) Teradata
9 1 (0.62%) Capita