Period
to 22 April 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop YARN over the 6 months to 22 April 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
22 Apr 2018
Same period 2017 Same period 2016
Rank 982 1123 1182
Rank change year-on-year +141 +59 +119
Permanent jobs citing Hadoop YARN 207 61 111
As % of all permanent IT jobs advertised in the UK 0.12% 0.036% 0.054%
As % of the Systems Management category 1.19% 0.41% 0.64%
Number of salaries quoted 156 37 76
UK median annual salary £75,000 £57,500 £57,500
Median salary % change year-on-year +30.43% - -28.13%
10th Percentile £57,500 £46,000 £38,250
90th Percentile £100,000 £84,500 £80,000
UK excluding London median annual salary £60,000 £55,000 £57,500
% change year-on-year +9.09% -4.35% -17.86%

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Permanent vacancies with a requirement for systems management skills 17,452 15,018 17,341
As % of all permanent IT jobs advertised in the UK 9.84% 8.77% 8.47%
Number of salaries quoted 13,874 12,155 14,034
UK median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +5.26%
10th Percentile £31,500 £30,750 £30,061
90th Percentile £84,750 £80,000 £75,000
UK excluding London median annual salary £47,500 £45,000 £42,500
% change year-on-year +5.56% +5.88% +1.19%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop YARN.

Salary trend for Hadoop YARN in the UK

Hadoop YARN
Salary Histogram

The salary distribution of IT jobs citing Hadoop YARN over the 6 months to 22 April 2018.

Salary histogram for Hadoop YARN in the UK

Hadoop YARN
Top 11 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 22 April 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +109 190 £75,000 +31.58% 17
London +104 136 £77,500 +10.71% 6
UK excluding London +5 70 £60,000 +9.09% 12
South East +14 34 £70,000 +27.27% 8
Scotland -26 16 - - 1
Midlands +13 15 £57,500 +4.55% 1
East Midlands +18 12 £57,500 -
South West -7 4 £50,000 -16.67%
West Midlands -1 3 £58,102 +5.64% 1
Yorkshire - 1 £52,500 - 1
North of England - 1 £52,500 - 2

For the 6 months to 22 April 2018, IT jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop YARN.

1 193 (93.24%) Hadoop
2 178 (85.99%) Big Data
3 176 (85.02%) Apache Hive
4 157 (75.85%) Apache Spark
5 133 (64.25%) Python
6 129 (62.32%) Kafka
7 126 (60.87%) HBase
7 126 (60.87%) Scala
8 94 (45.41%) Java
9 87 (42.03%) MapReduce
10 85 (41.06%) Impala
11 79 (38.16%) Apache Cassandra
12 77 (37.20%) Apache Flume
13 75 (36.23%) Agile Software Development
14 70 (33.82%) Cloudera
15 61 (29.47%) HDFS
16 59 (28.50%) Machine Learning
17 55 (26.57%) Amazon AWS
17 55 (26.57%) SQL
18 54 (26.09%) Linux
18 54 (26.09%) Sqoop
19 53 (25.60%) Analytics
20 50 (24.15%) Git (software)
21 49 (23.67%) Jenkins
21 49 (23.67%) Hortonworks
22 48 (23.19%) Data Engineering
23 47 (22.71%) Unix
23 47 (22.71%) Data Warehouse
24 46 (22.22%) Telecoms
25 45 (21.74%) Elasticsearch

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 157 (75.85%) Apache Spark
2 45 (21.74%) Elasticsearch
3 37 (17.87%) Apache Solr
4 15 (7.25%) Apache
5 11 (5.31%) Apache Pig
6 5 (2.42%) Confluence
7 3 (1.45%) Apache Airflow
8 2 (0.97%) Jupyter
9 1 (0.48%) CMS
9 1 (0.48%) SugarCRM
9 1 (0.48%) Tomcat
9 1 (0.48%) WordPress
Applications
1 1 (0.48%) Microsoft Excel
Cloud Services
1 55 (26.57%) Amazon AWS
2 24 (11.59%) Microsoft Azure
3 20 (9.66%) Amazon EMR
4 13 (6.28%) Amazon Kinesis
4 13 (6.28%) GitHub
5 4 (1.93%) Amazon S3
5 4 (1.93%) AWS Lambda
5 4 (1.93%) Google Cloud Platform
5 4 (1.93%) Serverless
6 3 (1.45%) Azure Data Factory
6 3 (1.45%) Yarn
7 2 (0.97%) IaaS
7 2 (0.97%) npm
7 2 (0.97%) PaaS
8 1 (0.48%) Amazon CloudWatch
Communications & Networking
1 14 (6.76%) HTTP
2 7 (3.38%) Kerberos
3 2 (0.97%) Firewall
3 2 (0.97%) SSL
4 1 (0.48%) HTTPS
4 1 (0.48%) Network Security
4 1 (0.48%) TCP/IP
Database & Business Intelligence
1 193 (93.24%) Hadoop
2 178 (85.99%) Big Data
3 176 (85.02%) Apache Hive
4 126 (60.87%) HBase
5 85 (41.06%) Impala
6 79 (38.16%) Apache Cassandra
7 54 (26.09%) Sqoop
8 47 (22.71%) Data Warehouse
9 43 (20.77%) Flink
10 37 (17.87%) NoSQL
11 23 (11.11%) SQL Server
12 19 (9.18%) PostgreSQL
13 17 (8.21%) MongoDB
14 14 (6.76%) Amazon Redshift
15 13 (6.28%) Amazon Athena
16 12 (5.80%) Relational Database
17 8 (3.86%) Data Lake
18 7 (3.38%) MySQL
18 7 (3.38%) OLAP
18 7 (3.38%) Power BI
Development Applications
1 50 (24.15%) Git (software)
2 49 (23.67%) Jenkins
3 29 (14.01%) TeamCity
4 11 (5.31%) JUnit
5 10 (4.83%) Maven
6 8 (3.86%) JIRA
7 5 (2.42%) Gradle
8 3 (1.45%) Bitbucket
8 3 (1.45%) Eclipse
9 2 (0.97%) FindBugs
9 2 (0.97%) Octopus Deploy
9 2 (0.97%) SonarQube
9 2 (0.97%) TestNG
9 2 (0.97%) Vagrant
9 2 (0.97%) Visual Studio Team System
9 2 (0.97%) webpack
10 1 (0.48%) Babel
10 1 (0.48%) JHipster
10 1 (0.48%) JIRA Agile
10 1 (0.48%) Travis CI
General
1 46 (22.22%) Telecoms
2 29 (14.01%) Finance
3 21 (10.14%) Marketing
4 7 (3.38%) Electronics
4 7 (3.38%) Manufacturing
5 4 (1.93%) Front Office
6 3 (1.45%) Financial Institution
7 2 (0.97%) Retail
8 1 (0.48%) Banking
8 1 (0.48%) Games
Job Titles
1 119 (57.49%) Data Engineer
2 93 (44.93%) Big Data Engineer
3 49 (23.67%) Hadoop Engineer
4 32 (15.46%) Architect
5 31 (14.98%) Developer
6 30 (14.49%) Data Architect
7 22 (10.63%) Big Data Developer
8 20 (9.66%) Big Data Architect
9 16 (7.73%) Senior Data Engineer
10 15 (7.25%) DevOps Engineer
10 15 (7.25%) Senior Hadoop Engineer
11 14 (6.76%) Java Developer
12 13 (6.28%) Hadoop Developer
12 13 (6.28%) QA Engineer
13 11 (5.31%) Java Hadoop Developer
14 5 (2.42%) Administrator
14 5 (2.42%) Apache Spark Developer
14 5 (2.42%) Hadoop Administrator
14 5 (2.42%) Java Engineer
15 3 (1.45%) Software Engineer
Libraries, Frameworks & Software Standards
1 129 (62.32%) Kafka
2 38 (18.36%) Spark Streaming
3 26 (12.56%) MLlib
3 26 (12.56%) TensorFlow
4 24 (11.59%) Keras
5 17 (8.21%) REST
6 16 (7.73%) Elastic Stack
7 12 (5.80%) YAML
8 8 (3.86%) Akka
9 7 (3.38%) J2EE
10 6 (2.90%) Apache Avro
10 6 (2.90%) GraphX
10 6 (2.90%) Spring
11 5 (2.42%) Lucene
11 5 (2.42%) Web Services
12 4 (1.93%) JSON
12 4 (1.93%) Middleware
13 3 (1.45%) AngularJS
13 3 (1.45%) Natural Language Processing
13 3 (1.45%) SOAP
Miscellaneous
1 20 (9.66%) Greenfield Project
2 17 (8.21%) User Experience
3 13 (6.28%) Analytical Skills
3 13 (6.28%) Tandem
4 11 (5.31%) Algorithms
5 8 (3.86%) Computer Science
6 3 (1.45%) Data Structures
6 3 (1.45%) Virtual Team
7 2 (0.97%) Data Centre
7 2 (0.97%) Fintech
7 2 (0.97%) Linux Command Line
7 2 (0.97%) Wiki
8 1 (0.48%) iPhone
8 1 (0.48%) NHS
8 1 (0.48%) Replication
8 1 (0.48%) Self-Motivation
Operating Systems
1 54 (26.09%) Linux
2 47 (22.71%) Unix
3 3 (1.45%) Windows
4 1 (0.48%) Mesosphere
Processes & Methodologies
1 87 (42.03%) MapReduce
2 75 (36.23%) Agile Software Development
3 59 (28.50%) Machine Learning
4 53 (25.60%) Analytics
5 48 (23.19%) Data Engineering
6 45 (21.74%) Data Science
7 43 (20.77%) ETL
8 39 (18.84%) Continuous Integration
9 31 (14.98%) DevOps
10 27 (13.04%) Deep Learning
10 27 (13.04%) Test Automation
11 26 (12.56%) Software Delivery
12 25 (12.08%) Visualisation
13 23 (11.11%) Data Integration
14 19 (9.18%) Business Intelligence
14 19 (9.18%) Data Ingestion
14 19 (9.18%) Data Modelling
15 18 (8.70%) Operations Research
15 18 (8.70%) Performance Tuning
15 18 (8.70%) Scrum
Programming Languages
1 133 (64.25%) Python
2 126 (60.87%) Scala
3 94 (45.41%) Java
4 55 (26.57%) SQL
5 44 (21.26%) Bash Shell
6 41 (19.81%) Shell Script
7 27 (13.04%) Go
8 11 (5.31%) R
9 7 (3.38%) C#
10 5 (2.42%) C
10 5 (2.42%) C++
10 5 (2.42%) T-SQL
11 4 (1.93%) Java 8
11 4 (1.93%) JavaScript
12 3 (1.45%) Perl
13 2 (0.97%) MATLAB
14 1 (0.48%) F#
14 1 (0.48%) HiveQL
14 1 (0.48%) PHP
14 1 (0.48%) TypeScript
Qualifications
1 8 (3.86%) Degree
2 5 (2.42%) Computer Science Degree
3 4 (1.93%) Security Cleared
4 3 (1.45%) SC Cleared
5 2 (0.97%) DV Cleared
5 2 (0.97%) PhD
6 1 (0.48%) CTC Cleared
Quality Assurance & Compliance
1 18 (8.70%) QA
2 11 (5.31%) Data Quality
3 2 (0.97%) GCP
4 1 (0.48%) SLA
System Software
1 77 (37.20%) Apache Flume
2 61 (29.47%) HDFS
3 26 (12.56%) Docker
4 10 (4.83%) Apache ZooKeeper
5 9 (4.35%) Virtual Machines
6 1 (0.48%) MapR-FS
Systems Management
1 36 (17.39%) Oozie
2 25 (12.08%) Mesos
3 19 (9.18%) Ansible
4 15 (7.25%) Kubernetes
5 5 (2.42%) Opscode Chef
6 4 (1.93%) Docker Swarm
6 4 (1.93%) Terraform
7 2 (0.97%) Ambari
8 1 (0.48%) Grafana
8 1 (0.48%) Kibana
8 1 (0.48%) Prometheus
8 1 (0.48%) Puppet
8 1 (0.48%) yum
Vendors
1 70 (33.82%) Cloudera
2 49 (23.67%) Hortonworks
3 16 (7.73%) Tableau
4 9 (4.35%) MapR
4 9 (4.35%) SAP
5 8 (3.86%) Oracle
6 6 (2.90%) Teradata
7 5 (2.42%) Google
8 4 (1.93%) Informatica
9 3 (1.45%) Ab Initio
9 3 (1.45%) Actian
9 3 (1.45%) MicroStrategy
9 3 (1.45%) ParAccel
9 3 (1.45%) Sybase
9 3 (1.45%) Vertica
10 2 (0.97%) Microsoft
10 2 (0.97%) Talend
10 2 (0.97%) Twitter
11 1 (0.48%) Alteryx
11 1 (0.48%) Capita