Period
to 20 November 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop YARN over the 6 months to 20 November 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
20 Nov 2018
Same period 2017 Same period 2016
Rank 962 1117 1134
Rank change year-on-year +155 +17 +136
Permanent jobs citing Hadoop YARN 179 89 101
As % of all permanent IT jobs advertised in the UK 0.11% 0.049% 0.054%
As % of the Systems Management category 1.01% 0.55% 0.60%
Number of salaries quoted 93 67 46
UK median annual salary £80,000 £70,000 £70,000
Median salary % change year-on-year +14.29% - -12.50%
10th Percentile £45,750 £46,500 £43,750
90th Percentile £110,000 £90,000 £96,250
UK excluding London median annual salary £63,750 £55,000 £51,500
% change year-on-year +15.91% +6.80% -20.77%

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Permanent vacancies with a requirement for systems management skills 17,803 16,097 16,748
As % of all permanent IT jobs advertised in the UK 10.91% 8.95% 8.95%
Number of salaries quoted 14,045 13,191 13,544
UK median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% -
10th Percentile £31,963 £31,250 £31,250
90th Percentile £86,250 £82,500 £78,750
UK excluding London median annual salary £49,039 £45,000 £45,000
% change year-on-year +8.97% - +5.88%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop YARN.

Salary trend for Hadoop YARN in the UK

Hadoop YARN
Salary Histogram

The salary distribution of IT jobs citing Hadoop YARN over the 6 months to 20 November 2018.

Salary histogram for Hadoop YARN in the UK

Hadoop YARN
Top 11 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 20 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +140 179 £80,000 +14.29% 16
London +90 92 £85,000 +11.48% 9
UK excluding London +124 87 £63,750 +15.91% 7
South East +65 61 £57,500 - 5
North of England +25 10 £100,000 +135.29%
Yorkshire +37 9 £100,000 +135.29%
East of England +28 6 £44,400 +18.40%
Midlands +37 5 £54,250 -22.50% 2
East Midlands +19 5 £54,250 - 2
South West +6 5 £50,000 -
North East - 5 £100,000 -

For the 6 months to 20 November 2018, IT jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop YARN.

1 165 (92.18%) Hadoop
2 154 (86.03%) Apache Spark
3 152 (84.92%) Apache Hive
4 151 (84.36%) Kafka
5 149 (83.24%) Big Data
6 142 (79.33%) Python
7 101 (56.42%) Java
8 94 (52.51%) HBase
9 92 (51.40%) Agile Software Development
9 92 (51.40%) Data Science
10 90 (50.28%) Scala
11 82 (45.81%) Amazon AWS
12 81 (45.25%) Apache Cassandra
12 81 (45.25%) Analytics
13 78 (43.58%) Impala
14 77 (43.02%) Apache Flume
14 77 (43.02%) MapReduce
15 76 (42.46%) NoSQL
16 74 (41.34%) Elasticsearch
17 72 (40.22%) Hortonworks
18 70 (39.11%) Cloudera
19 62 (34.64%) Data Engineering
20 60 (33.52%) SQL
21 59 (32.96%) Apache Pig
21 59 (32.96%) Oozie
22 57 (31.84%) Apache
22 57 (31.84%) Finance
22 57 (31.84%) Scrum
23 56 (31.28%) Degree
23 56 (31.28%) Flink

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (86.03%) Apache Spark
2 74 (41.34%) Elasticsearch
3 59 (32.96%) Apache Pig
4 57 (31.84%) Apache
5 43 (24.02%) SAS
6 36 (20.11%) Apache Solr
7 6 (3.35%) Cloud Foundry
7 6 (3.35%) JBoss
8 4 (2.23%) WordPress
9 3 (1.68%) nginx
10 2 (1.12%) CMS
11 1 (0.56%) Confluence
Applications
1 1 (0.56%) HipChat
Cloud Services
1 82 (45.81%) Amazon AWS
2 49 (27.37%) Microsoft Azure
3 12 (6.70%) GitHub
4 9 (5.03%) Google Cloud Platform
5 8 (4.47%) Amazon EMR
5 8 (4.47%) Amazon S3
5 8 (4.47%) Cloud Computing
6 7 (3.91%) AWS Lambda
7 6 (3.35%) AWS Data Pipeline
8 5 (2.79%) npm
8 5 (2.79%) Yarn
9 4 (2.23%) CloudFront
9 4 (2.23%) Serverless
10 3 (1.68%) OpenShift
11 2 (1.12%) Amazon CloudWatch
11 2 (1.12%) Amazon EC2
11 2 (1.12%) DigitalOcean
11 2 (1.12%) IaaS
11 2 (1.12%) PaaS
11 2 (1.12%) SaaS
Communications & Networking
1 8 (4.47%) Kerberos
2 6 (3.35%) DNS
2 6 (3.35%) Firewall
2 6 (3.35%) Internet
2 6 (3.35%) SSL
2 6 (3.35%) TCP/IP
3 2 (1.12%) SSH
3 2 (1.12%) VPN
4 1 (0.56%) HTTP
Database & Business Intelligence
1 165 (92.18%) Hadoop
2 152 (84.92%) Apache Hive
3 149 (83.24%) Big Data
4 94 (52.51%) HBase
5 81 (45.25%) Apache Cassandra
6 78 (43.58%) Impala
7 76 (42.46%) NoSQL
8 56 (31.28%) Flink
9 53 (29.61%) Amazon Redshift
10 45 (25.14%) Couchbase
10 45 (25.14%) CouchDB
11 42 (23.46%) Power BI
12 36 (20.11%) SAP HANA
12 36 (20.11%) Text Mining
13 24 (13.41%) Sqoop
14 22 (12.29%) Data Warehouse
15 19 (10.61%) PostgreSQL
16 13 (7.26%) Apache Zeppelin
17 9 (5.03%) Parquet
18 7 (3.91%) Spark SQL
Development Applications
1 39 (21.79%) Git (software)
2 32 (17.88%) Jenkins
3 16 (8.94%) TeamCity
4 9 (5.03%) Gradle
5 5 (2.79%) JIRA
6 4 (2.23%) Eclipse
6 4 (2.23%) IntelliJ
6 4 (2.23%) NetBeans
6 4 (2.23%) webpack
7 3 (1.68%) GitLab
7 3 (1.68%) JUnit
7 3 (1.68%) Sonatype Nexus
7 3 (1.68%) Subversion
7 3 (1.68%) Travis CI
8 2 (1.12%) Android Studio
8 2 (1.12%) Babel
8 2 (1.12%) Grunt
8 2 (1.12%) gulp
8 2 (1.12%) Vagrant
8 2 (1.12%) Xcode
General
1 57 (31.84%) Finance
2 44 (24.58%) Telecoms
3 42 (23.46%) Retail
4 15 (8.38%) Games
5 3 (1.68%) Marketing
6 2 (1.12%) Financial Institution
7 1 (0.56%) Banking
Job Titles
1 90 (50.28%) Data Engineer
2 88 (49.16%) Big Data Engineer
3 36 (20.11%) Data Scientist
4 31 (17.32%) Senior Data Engineer
5 26 (14.53%) Hadoop Engineer
6 23 (12.85%) Developer
7 22 (12.29%) Senior Data Scientist
8 15 (8.38%) Games Engineer
9 10 (5.59%) Java Developer
9 10 (5.59%) Senior Hadoop Engineer
10 9 (5.03%) Architect
11 7 (3.91%) Cloud Engineer
11 7 (3.91%) Senior Architect
11 7 (3.91%) Senior Cloud Engineer
12 6 (3.35%) Administrator
12 6 (3.35%) Applications Architect
12 6 (3.35%) AWS DevOps
12 6 (3.35%) DevOps Engineer
12 6 (3.35%) Hadoop Administrator
12 6 (3.35%) Senior Developer
Libraries, Frameworks & Software Standards
1 151 (84.36%) Kafka
2 36 (20.11%) D3.js
2 36 (20.11%) ggplot
3 22 (12.29%) Middleware
4 19 (10.61%) TensorFlow
5 16 (8.94%) Node.js
6 15 (8.38%) .NET
7 14 (7.82%) Elastic Stack
7 14 (7.82%) Spark Streaming
8 13 (7.26%) Keras
8 13 (7.26%) MLlib
8 13 (7.26%) Spring
9 11 (6.15%) JSON
10 10 (5.59%) RabbitMQ
11 9 (5.03%) Apache Avro
12 8 (4.47%) AngularJS
12 8 (4.47%) React
12 8 (4.47%) REST
13 6 (3.35%) Drools
13 6 (3.35%) SparkR
Miscellaneous
1 41 (22.91%) Algorithms
2 36 (20.11%) Social Network
3 14 (7.82%) User Experience
4 9 (5.03%) Linux Command Line
5 8 (4.47%) Computer Science
6 6 (3.35%) Cloud Native
6 6 (3.35%) Greenfield Project
6 6 (3.35%) Virtual Team
7 5 (2.79%) Public Cloud
8 3 (1.68%) Analytical Skills
9 2 (1.12%) Mobile App
10 1 (0.56%) Private Cloud
10 1 (0.56%) Wiki
Operating Systems
1 54 (30.17%) Linux
2 31 (17.32%) Unix
3 6 (3.35%) VMS
4 3 (1.68%) Red Hat Enterprise Linux
5 2 (1.12%) Android
6 1 (0.56%) Windows
Processes & Methodologies
1 92 (51.40%) Agile Software Development
1 92 (51.40%) Data Science
2 81 (45.25%) Analytics
3 77 (43.02%) MapReduce
4 62 (34.64%) Data Engineering
5 57 (31.84%) Scrum
6 48 (26.82%) Operations Research
7 47 (26.26%) Kanban
8 45 (25.14%) Data Modelling
8 45 (25.14%) Visualisation
9 41 (22.91%) Artificial Intelligence
10 40 (22.35%) Business Intelligence
11 39 (21.79%) Data Security
12 38 (21.23%) Data Visualisation
13 37 (20.67%) Random Forest
14 36 (20.11%) Data-Driven Decision Making
14 36 (20.11%) Decision-Making
14 36 (20.11%) Mathematics
14 36 (20.11%) Quantitative Research
14 36 (20.11%) Statistics
Programming Languages
1 142 (79.33%) Python
2 101 (56.42%) Java
3 90 (50.28%) Scala
4 60 (33.52%) SQL
5 36 (20.11%) R
6 22 (12.29%) Shell Script
7 20 (11.17%) Bash Shell
8 16 (8.94%) C#
9 13 (7.26%) Go
10 10 (5.59%) JavaScript
11 4 (2.23%) ES6
11 4 (2.23%) PHP
11 4 (2.23%) T-SQL
12 3 (1.68%) Ruby
13 2 (1.12%) PHP 7
13 2 (1.12%) TypeScript
14 1 (0.56%) C
Qualifications
1 56 (31.28%) Degree
2 6 (3.35%) Computer Science Degree
3 1 (0.56%) SC Cleared
3 1 (0.56%) Security Cleared
Quality Assurance & Compliance
1 14 (7.82%) QA
2 7 (3.91%) MiFID
3 1 (0.56%) Data Quality
System Software
1 77 (43.02%) Apache Flume
2 37 (20.67%) HDFS
3 28 (15.64%) Apache ZooKeeper
4 27 (15.08%) Docker
5 6 (3.35%) Active Directory
5 6 (3.35%) Virtual Machines
Systems Management
1 59 (32.96%) Oozie
2 16 (8.94%) Ambari
3 11 (6.15%) Ansible
3 11 (6.15%) Mesos
3 11 (6.15%) Puppet
4 10 (5.59%) Kibana
4 10 (5.59%) Kubernetes
5 6 (3.35%) logstash
5 6 (3.35%) Opscode Chef
6 5 (2.79%) Prometheus
7 3 (1.68%) ITRS Geneos
7 3 (1.68%) Sysdig
8 2 (1.12%) cPanel
8 2 (1.12%) Grafana
8 2 (1.12%) Terraform
Vendors
1 72 (40.22%) Hortonworks
2 70 (39.11%) Cloudera
3 48 (26.82%) MapR
4 45 (25.14%) Databricks
5 42 (23.46%) SAP
6 36 (20.11%) Tableau
7 7 (3.91%) Google
7 7 (3.91%) Solace
8 6 (3.35%) Oracle
8 6 (3.35%) TIBCO
9 3 (1.68%) AppDynamics
9 3 (1.68%) Dynatrace
9 3 (1.68%) Red Hat
10 2 (1.12%) Microsoft
10 2 (1.12%) Splunk
11 1 (0.56%) Facebook
11 1 (0.56%) Salesforce.com
11 1 (0.56%) Talend