Period
to 25 September 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop YARN over the 6 months to 25 September 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
25 Sep 2018
Same period 2017 Same period 2016
Rank 1013 1133 1155
Rank change year-on-year +120 +22 +121
Permanent jobs citing Hadoop YARN 146 60 99
As % of all permanent IT jobs advertised in the UK 0.087% 0.034% 0.052%
As % of the Systems Management category 0.83% 0.38% 0.58%
Number of salaries quoted 77 43 61
UK median annual salary £67,500 £57,500 £60,000
Median salary % change year-on-year +17.39% -4.17% -29.41%
10th Percentile £45,690 £43,750 £36,250
90th Percentile £100,000 £97,000 £96,250
UK excluding London median annual salary £57,500 £55,000 £51,500
% change year-on-year +4.55% +6.80% -20.77%

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Permanent vacancies with a requirement for systems management skills 17,518 15,768 17,071
As % of all permanent IT jobs advertised in the UK 10.46% 8.94% 8.92%
Number of salaries quoted 13,986 12,814 13,888
UK median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +5.26%
10th Percentile £31,750 £31,000 £31,250
90th Percentile £85,000 £82,500 £77,500
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop YARN.

Salary trend for Hadoop YARN in the UK

Hadoop YARN
Salary Histogram

The salary distribution of IT jobs citing Hadoop YARN over the 6 months to 25 September 2018.

Salary histogram for Hadoop YARN in the UK

Hadoop YARN
Top 11 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 25 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +109 146 £67,500 +17.39% 23
UK excluding London +75 75 £57,500 +4.55% 12
London +79 71 £85,000 +11.48% 12
South East +54 59 £60,000 +9.09% 9
East of England +28 6 £44,400 +18.40%
Yorkshire +31 5 £65,000 +52.94%
North of England +18 5 £65,000 +28.71%
Midlands +21 4 £55,000 - 2
East Midlands +12 3 £55,000 - 2
South West +4 1 - -
West Midlands - 1 £70,000 -

For the 6 months to 25 September 2018, IT jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop YARN.

1 135 (92.47%) Hadoop
2 128 (87.67%) Apache Hive
3 120 (82.19%) Big Data
4 111 (76.03%) Python
5 110 (75.34%) Kafka
6 103 (70.55%) Apache Spark
7 86 (58.90%) Java
8 83 (56.85%) Scala
9 81 (55.48%) MapReduce
10 79 (54.11%) HBase
11 77 (52.74%) Apache Flume
12 75 (51.37%) Agile Software Development
12 75 (51.37%) Impala
13 64 (43.84%) Data Science
13 64 (43.84%) Cloudera
14 62 (42.47%) Analytics
15 57 (39.04%) Linux
16 56 (38.36%) Hortonworks
17 55 (37.67%) Data Engineering
18 54 (36.99%) Amazon AWS
19 53 (36.30%) Git (software)
19 53 (36.30%) Apache Cassandra
20 51 (34.93%) HDFS
21 48 (32.88%) Jenkins
22 46 (31.51%) NoSQL
23 44 (30.14%) Machine Learning
24 43 (29.45%) Sqoop
25 41 (28.08%) Data Warehouse
26 39 (26.71%) SQL
27 38 (26.03%) Scrum

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 103 (70.55%) Apache Spark
2 38 (26.03%) Elasticsearch
3 35 (23.97%) Apache Pig
4 34 (23.29%) Apache
5 24 (16.44%) Apache Solr
6 22 (15.07%) SAS
7 6 (4.11%) Cloud Foundry
7 6 (4.11%) JBoss
8 5 (3.42%) WordPress
9 3 (2.05%) CMS
10 2 (1.37%) nginx
11 1 (0.68%) Confluence
11 1 (0.68%) Jupyter
11 1 (0.68%) SugarCRM
Applications
1 1 (0.68%) Microsoft Excel
Cloud Services
1 54 (36.99%) Amazon AWS
2 31 (21.23%) Microsoft Azure
3 15 (10.27%) GitHub
4 7 (4.79%) Google Cloud Platform
5 5 (3.42%) npm
5 5 (3.42%) Yarn
6 4 (2.74%) Amazon S3
7 3 (2.05%) Amazon EMR
7 3 (2.05%) OpenShift
8 2 (1.37%) Amazon EC2
8 2 (1.37%) CloudFront
8 2 (1.37%) DigitalOcean
9 1 (0.68%) Amazon Kinesis
9 1 (0.68%) AWS Lambda
9 1 (0.68%) Serverless
Communications & Networking
1 7 (4.79%) Kerberos
2 6 (4.11%) DNS
2 6 (4.11%) Firewall
2 6 (4.11%) SSL
2 6 (4.11%) TCP/IP
3 2 (1.37%) SSH
4 1 (0.68%) HTTP
Database & Business Intelligence
1 135 (92.47%) Hadoop
2 128 (87.67%) Apache Hive
3 120 (82.19%) Big Data
4 79 (54.11%) HBase
5 75 (51.37%) Impala
6 53 (36.30%) Apache Cassandra
7 46 (31.51%) NoSQL
8 43 (29.45%) Sqoop
9 41 (28.08%) Data Warehouse
10 38 (26.03%) Flink
11 27 (18.49%) Amazon Redshift
12 24 (16.44%) Couchbase
12 24 (16.44%) CouchDB
13 23 (15.75%) Power BI
14 20 (13.70%) PostgreSQL
15 16 (10.96%) SAP HANA
15 16 (10.96%) Text Mining
16 9 (6.16%) Parquet
17 8 (5.48%) SQL Server
18 7 (4.79%) MySQL
Development Applications
1 53 (36.30%) Git (software)
2 48 (32.88%) Jenkins
3 29 (19.86%) TeamCity
4 9 (6.16%) Gradle
4 9 (6.16%) JUnit
5 5 (3.42%) webpack
6 4 (2.74%) JIRA
7 3 (2.05%) Babel
7 3 (2.05%) Sonatype Nexus
7 3 (2.05%) Subversion
8 2 (1.37%) Android Studio
8 2 (1.37%) GitLab
8 2 (1.37%) Grunt
8 2 (1.37%) gulp
8 2 (1.37%) Travis CI
8 2 (1.37%) Vagrant
8 2 (1.37%) Xcode
9 1 (0.68%) Maven
9 1 (0.68%) Mocha
9 1 (0.68%) TestNG
General
1 24 (16.44%) Finance
2 23 (15.75%) Retail
3 22 (15.07%) Telecoms
4 9 (6.16%) Games
5 8 (5.48%) Marketing
6 3 (2.05%) Financial Institution
7 1 (0.68%) Banking
Job Titles
1 84 (57.53%) Data Engineer
2 82 (56.16%) Big Data Engineer
3 37 (25.34%) Hadoop Engineer
4 31 (21.23%) Senior Data Engineer
5 19 (13.01%) Developer
5 19 (13.01%) Senior Hadoop Engineer
6 16 (10.96%) Data Scientist
7 9 (6.16%) Architect
7 9 (6.16%) Data Architect
7 9 (6.16%) Games Engineer
8 8 (5.48%) Senior Data Scientist
9 7 (4.79%) DevOps Engineer
9 7 (4.79%) Java Developer
10 6 (4.11%) Administrator
10 6 (4.11%) Hadoop Administrator
11 4 (2.74%) AWS DevOps
11 4 (2.74%) Lead DevOps
12 3 (2.05%) AWS DevOps Engineer
12 3 (2.05%) Lead DevOps Engineer
12 3 (2.05%) React Developer
Libraries, Frameworks & Software Standards
1 110 (75.34%) Kafka
2 27 (18.49%) MLlib
2 27 (18.49%) TensorFlow
3 26 (17.81%) Keras
4 16 (10.96%) D3.js
4 16 (10.96%) ggplot
5 13 (8.90%) Elastic Stack
6 12 (8.22%) Spark Streaming
7 10 (6.85%) JSON
7 10 (6.85%) Spring
8 9 (6.16%) .NET
8 9 (6.16%) Apache Avro
8 9 (6.16%) Middleware
9 8 (5.48%) REST
10 6 (4.11%) Drools
10 6 (4.11%) LDAP
10 6 (4.11%) RabbitMQ
10 6 (4.11%) SparkR
11 5 (3.42%) Laravel
11 5 (3.42%) Node.js
Miscellaneous
1 19 (13.01%) Algorithms
1 19 (13.01%) User Experience
2 16 (10.96%) Social Network
3 12 (8.22%) Greenfield Project
4 9 (6.16%) Linux Command Line
5 7 (4.79%) Virtual Team
6 3 (2.05%) Public Cloud
7 2 (1.37%) Computer Science
7 2 (1.37%) Mobile App
8 1 (0.68%) Analytical Skills
8 1 (0.68%) Fintech
8 1 (0.68%) NHS
8 1 (0.68%) Self-Motivation
8 1 (0.68%) Tandem
8 1 (0.68%) Wiki
Operating Systems
1 57 (39.04%) Linux
2 33 (22.60%) Unix
3 6 (4.11%) VMS
4 3 (2.05%) Red Hat Enterprise Linux
5 2 (1.37%) Android
5 2 (1.37%) Windows
Processes & Methodologies
1 81 (55.48%) MapReduce
2 75 (51.37%) Agile Software Development
3 64 (43.84%) Data Science
4 62 (42.47%) Analytics
5 55 (37.67%) Data Engineering
6 44 (30.14%) Machine Learning
7 38 (26.03%) Scrum
8 35 (23.97%) Continuous Integration
9 34 (23.29%) Operations Research
10 27 (18.49%) Kanban
11 26 (17.81%) Deep Learning
11 26 (17.81%) Visualisation
12 24 (16.44%) ETL
13 23 (15.75%) Business Intelligence
13 23 (15.75%) Software Delivery
14 22 (15.07%) Data Modelling
15 19 (13.01%) Artificial Intelligence
16 18 (12.33%) Data Ingestion
16 18 (12.33%) Data Visualisation
16 18 (12.33%) Mathematics
Programming Languages
1 111 (76.03%) Python
2 86 (58.90%) Java
3 83 (56.85%) Scala
4 39 (26.71%) SQL
5 35 (23.97%) Shell Script
6 26 (17.81%) Go
7 18 (12.33%) Bash Shell
8 17 (11.64%) R
9 9 (6.16%) C#
10 8 (5.48%) JavaScript
11 5 (3.42%) ES6
11 5 (3.42%) PHP
12 3 (2.05%) C
12 3 (2.05%) Ruby
12 3 (2.05%) TypeScript
13 2 (1.37%) Perl
13 2 (1.37%) PHP 7
14 1 (0.68%) T-SQL
Qualifications
1 27 (18.49%) Degree
2 2 (1.37%) Computer Science Degree
3 1 (0.68%) PhD
3 1 (0.68%) SC Cleared
3 1 (0.68%) Security Cleared
Quality Assurance & Compliance
1 14 (9.59%) QA
2 4 (2.74%) Data Quality
3 1 (0.68%) SLA
System Software
1 77 (52.74%) Apache Flume
2 51 (34.93%) HDFS
3 23 (15.75%) Apache ZooKeeper
4 16 (10.96%) Docker
5 9 (6.16%) Virtual Machines
6 6 (4.11%) Active Directory
Systems Management
1 38 (26.03%) Oozie
2 16 (10.96%) Mesos
3 11 (7.53%) Kubernetes
4 9 (6.16%) Ambari
4 9 (6.16%) Puppet
5 5 (3.42%) Opscode Chef
6 3 (2.05%) Ansible
6 3 (2.05%) ITRS Geneos
6 3 (2.05%) Sysdig
7 2 (1.37%) cPanel
7 2 (1.37%) Prometheus
8 1 (0.68%) Kibana
Vendors
1 64 (43.84%) Cloudera
2 56 (38.36%) Hortonworks
3 27 (18.49%) MapR
4 24 (16.44%) Databricks
5 22 (15.07%) SAP
6 20 (13.70%) Tableau
7 9 (6.16%) Oracle
8 5 (3.42%) Google
9 3 (2.05%) AppDynamics
9 3 (2.05%) Dynatrace
9 3 (2.05%) Microsoft
9 3 (2.05%) Red Hat
9 3 (2.05%) Talend
10 2 (1.37%) Ab Initio
10 2 (1.37%) Actian
10 2 (1.37%) Informatica
10 2 (1.37%) MicroStrategy
10 2 (1.37%) ParAccel
10 2 (1.37%) Sybase
10 2 (1.37%) Teradata