Period
to 21 October 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop YARN over the 6 months to 21 October 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
21 Oct 2019
Same period 2018 Same period 2017
Rank 916 1007 1150
Rank change year-on-year +91 +143 -14
Permanent jobs citing Hadoop YARN 160 158 65
As % of all permanent IT jobs advertised in the UK 0.12% 0.097% 0.037%
As % of the Systems Management category 0.90% 0.91% 0.41%
Number of salaries quoted 144 84 47
UK median annual salary £79,750 £70,000 £60,000
Median salary % change year-on-year +13.93% +16.67% -14.29%
10th Percentile £49,125 £45,250 £43,750
90th Percentile £115,000 £110,000 £87,000
UK excluding London median annual salary £65,000 £61,250 £55,000
% change year-on-year +6.12% +11.36% +3.29%

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Permanent vacancies with a requirement for systems management skills 17,778 17,383 15,750
As % of all permanent IT jobs advertised in the UK 12.98% 10.63% 9.04%
Number of salaries quoted 13,415 13,743 12,875
UK median annual salary £57,500 £55,000 £52,500
Median salary % change year-on-year +4.55% +4.76% +5.00%
10th Percentile £32,000 £32,000 £31,250
90th Percentile £90,000 £85,000 £82,500
UK excluding London median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop YARN.

Salary trend for Hadoop YARN in the UK

Hadoop YARN
Salary Histogram

The salary distribution of IT jobs citing Hadoop YARN over the 6 months to 21 October 2019.

Salary histogram for Hadoop YARN in the UK

Hadoop YARN
Top 9 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 21 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +98 148 £80,000 +14.29% 12
London +119 112 £80,000 -5.88% 8
UK excluding London +22 43 £65,000 +6.12% 5
South West +27 12 £52,500 +10.53% 1
South East -25 12 £90,000 +53.19%
East of England +66 11 £70,000 +57.66% 1
Scotland - 7 £58,788 - 1
Midlands +23 1 - - 1
West Midlands - 1 - - 1

For the 6 months to 21 October 2019, IT jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop YARN.

1 138 (86.25%) Apache Hive
2 127 (79.38%) Big Data
3 124 (77.50%) Apache Spark
4 116 (72.50%) Hadoop
5 100 (62.50%) Python
6 94 (58.75%) HBase
7 93 (58.13%) Java
8 81 (50.63%) Agile Software Development
9 76 (47.50%) HDFS
10 70 (43.75%) Linux
11 66 (41.25%) Analytics
12 65 (40.63%) Impala
13 64 (40.00%) Azure
14 61 (38.13%) Scala
14 61 (38.13%) Hortonworks
15 60 (37.50%) AWS
16 59 (36.88%) SQL
17 48 (30.00%) Kafka
18 42 (26.25%) Docker
19 41 (25.63%) Data Analytics
20 38 (23.75%) Ansible
20 38 (23.75%) Oozie
21 35 (21.88%) Data Science
22 34 (21.25%) Sqoop
22 34 (21.25%) Bash Shell
23 33 (20.63%) NoSQL
23 33 (20.63%) Big Data Analytics
24 32 (20.00%) Jenkins
24 32 (20.00%) DevOps
24 32 (20.00%) Degree

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 124 (77.50%) Apache Spark
2 22 (13.75%) Apache Solr
2 22 (13.75%) Elasticsearch
3 10 (6.25%) Apache
3 10 (6.25%) Apache Pig
4 1 (0.63%) Cloud Foundry
4 1 (0.63%) Confluence
4 1 (0.63%) JBoss
Business Applications
1 3 (1.88%) Dynamics CRM
Cloud Services
1 64 (40.00%) Azure
2 60 (37.50%) AWS
3 20 (12.50%) IaaS
3 20 (12.50%) PaaS
4 17 (10.63%) Amazon S3
5 16 (10.00%) Amazon EMR
6 15 (9.38%) Amazon Kinesis
6 15 (9.38%) GCP
7 13 (8.13%) Azure Data Factory
8 9 (5.63%) Amazon EC2
8 9 (5.63%) SaaS
8 9 (5.63%) Serverless
9 3 (1.88%) Virtual Private Cloud
10 2 (1.25%) GitHub
Communications & Networking
1 15 (9.38%) Kerberos
2 11 (6.88%) VPN
3 10 (6.25%) Firewall
3 10 (6.25%) SSL
4 9 (5.63%) Internet
5 8 (5.00%) HTTP
6 7 (4.38%) HTTPS
7 1 (0.63%) DNS
Database & Business Intelligence
1 138 (86.25%) Apache Hive
2 127 (79.38%) Big Data
3 116 (72.50%) Hadoop
4 94 (58.75%) HBase
5 65 (40.63%) Impala
6 34 (21.25%) Sqoop
7 33 (20.63%) NoSQL
8 19 (11.88%) Apache Cassandra
8 19 (11.88%) Data Lake
8 19 (11.88%) Spark SQL
9 15 (9.38%) Amazon Redshift
9 15 (9.38%) Flink
10 14 (8.75%) PostgreSQL
11 13 (8.13%) Amazon DynamoDB
11 13 (8.13%) BigQuery
11 13 (8.13%) HDInsight
11 13 (8.13%) MySQL
11 13 (8.13%) SQL Server
12 12 (7.50%) Data Warehouse
12 12 (7.50%) Relational Database
Development Applications
1 32 (20.00%) Jenkins
2 20 (12.50%) Git (software)
3 17 (10.63%) JIRA
4 12 (7.50%) Artifactory
5 7 (4.38%) Eclipse
5 7 (4.38%) IntelliJ
5 7 (4.38%) NetBeans
6 3 (1.88%) Visual Studio Team System
7 2 (1.25%) Maven
7 2 (1.25%) Sonatype Nexus
8 1 (0.63%) Gradle
General
1 24 (15.00%) Finance
2 11 (6.88%) Telecoms
3 5 (3.13%) Retail
4 4 (2.50%) Legal
4 4 (2.50%) Public Sector
5 1 (0.63%) Banking
5 1 (0.63%) Retail Banking
Job Titles
1 69 (43.13%) Data Engineer
2 35 (21.88%) Senior Data Engineer
3 34 (21.25%) Architect
4 33 (20.63%) Data Architect
5 29 (18.13%) Developer
6 27 (16.88%) Java Developer
7 21 (13.13%) Big Data Developer
8 20 (12.50%) Big Data Engineer
9 19 (11.88%) Big Data Architect
9 19 (11.88%) Java Scala Developer
9 19 (11.88%) Scala Developer
10 15 (9.38%) Cloud Architect
11 14 (8.75%) QA Engineer
11 14 (8.75%) Senior QA Engineer
12 12 (7.50%) DevOps Engineer
13 11 (6.88%) Hadoop Engineer
13 11 (6.88%) Senior Hadoop Engineer
14 9 (5.63%) Senior DevOps
14 9 (5.63%) Senior DevOps Engineer
14 9 (5.63%) Systems Architect
Libraries, Frameworks & Software Standards
1 48 (30.00%) Kafka
2 20 (12.50%) OAuth
3 15 (9.38%) PySpark
4 13 (8.13%) Lambda Expressions
5 11 (6.88%) Elastic Stack
5 11 (6.88%) LDAP
5 11 (6.88%) SAML
6 10 (6.25%) JSON
7 9 (5.63%) Apache Beam
7 9 (5.63%) HTML
7 9 (5.63%) OAuth2
7 9 (5.63%) XML
8 8 (5.00%) J2EE
8 8 (5.00%) RabbitMQ
8 8 (5.00%) Spring
9 7 (4.38%) ActiveMQ
9 7 (4.38%) Hibernate
9 7 (4.38%) JPA
9 7 (4.38%) Node.js
9 7 (4.38%) Spring Boot
Miscellaneous
1 13 (8.13%) Algorithms
2 11 (6.88%) Data Centre
3 9 (5.63%) Public Cloud
4 6 (3.75%) Enterprise Software
5 4 (2.50%) Analytical Skills
5 4 (2.50%) Linux Command Line
5 4 (2.50%) Social Media
5 4 (2.50%) Social Network
6 3 (1.88%) Management Information System
7 2 (1.25%) Greenfield Project
Operating Systems
1 70 (43.75%) Linux
2 22 (13.75%) Unix
3 2 (1.25%) SUSE Linux Enterprise Server
4 1 (0.63%) Red Hat Enterprise Linux
Processes & Methodologies
1 81 (50.63%) Agile Software Development
2 66 (41.25%) Analytics
3 41 (25.63%) Data Analytics
4 35 (21.88%) Data Science
5 33 (20.63%) Big Data Analytics
6 32 (20.00%) DevOps
7 30 (18.75%) Use Case
8 24 (15.00%) Machine Learning
8 24 (15.00%) Microservices
8 24 (15.00%) TDD
9 21 (13.13%) Scrum
10 19 (11.88%) Data Engineering
11 17 (10.63%) MapReduce
11 17 (10.63%) Software Engineering
11 17 (10.63%) Validation
12 15 (9.38%) Acceptance Criteria
12 15 (9.38%) BDD
12 15 (9.38%) Pair Programming
12 15 (9.38%) Refactoring
12 15 (9.38%) Test Automation
Programming Languages
1 100 (62.50%) Python
2 93 (58.13%) Java
3 61 (38.13%) Scala
4 59 (36.88%) SQL
5 34 (21.25%) Bash Shell
6 15 (9.38%) C#
7 14 (8.75%) Shell Script
8 12 (7.50%) Ruby
9 8 (5.00%) JavaScript
10 7 (4.38%) T-SQL
11 4 (2.50%) Perl
12 3 (1.88%) PL/SQL
13 1 (0.63%) Clojure
Qualifications
1 32 (20.00%) Degree
2 17 (10.63%) Computer Science Degree
3 4 (2.50%) Numerate Degree
4 1 (0.63%) SC Cleared
4 1 (0.63%) Security Cleared
Quality Assurance & Compliance
1 24 (15.00%) Data Quality
2 16 (10.00%) QA
3 4 (2.50%) GDPR
3 4 (2.50%) ISO/IEC 27001
System Software
1 76 (47.50%) HDFS
2 42 (26.25%) Docker
3 13 (8.13%) Apache ZooKeeper
4 11 (6.88%) Apache Flume
5 1 (0.63%) Active Directory
5 1 (0.63%) KVM
5 1 (0.63%) Virtual Machines
Systems Management
1 38 (23.75%) Ansible
1 38 (23.75%) Oozie
2 23 (14.38%) Ambari
3 11 (6.88%) Single Sign-On
4 5 (3.13%) Puppet
4 5 (3.13%) Terraform
5 3 (1.88%) Chukwa
6 2 (1.25%) Mesos
7 1 (0.63%) Kubernetes
7 1 (0.63%) SELinux
Vendors
1 61 (38.13%) Hortonworks
2 29 (18.13%) Cloudera
3 18 (11.25%) Microsoft
4 13 (8.13%) Databricks
4 13 (8.13%) Google
4 13 (8.13%) Splunk
5 10 (6.25%) VMware
6 4 (2.50%) Informatica
6 4 (2.50%) Oracle
7 3 (1.88%) Salesforce.com
8 1 (0.63%) MapR
8 1 (0.63%) MicroStrategy
8 1 (0.63%) Red Hat
8 1 (0.63%) Tableau
8 1 (0.63%) Talend