Period
to 26 June 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop YARN over the 6 months to 26 June 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
26 Jun 2019
Same period 2018 Same period 2017
Rank 887 1017 1147
Rank change year-on-year +130 +130 +19
Permanent jobs citing Hadoop YARN 213 174 42
As % of all permanent IT jobs advertised in the UK 0.15% 0.100% 0.024%
As % of the Systems Management category 1.17% 0.99% 0.28%
Number of salaries quoted 176 117 26
UK median annual salary £85,000 £70,000 £57,000
Median salary % change year-on-year +21.43% +22.81% -5.00%
10th Percentile £48,750 £52,500 £43,250
90th Percentile £115,000 £100,000 £92,500
UK excluding London median annual salary £65,000 £60,000 £55,000
% change year-on-year +8.33% +9.09% -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Permanent vacancies with a requirement for systems management skills 18,229 17,604 15,267
As % of all permanent IT jobs advertised in the UK 12.62% 10.09% 8.79%
Number of salaries quoted 13,909 13,870 12,367
UK median annual salary £57,500 £55,000 £52,500
Median salary % change year-on-year +4.55% +4.76% +5.00%
10th Percentile £32,500 £31,250 £30,000
90th Percentile £90,000 £85,000 £81,250
UK excluding London median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% +5.88%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop YARN.

Salary trend for Hadoop YARN in the UK

Hadoop YARN
Salary Histogram

The salary distribution of IT jobs citing Hadoop YARN over the 6 months to 26 June 2019.

Salary histogram for Hadoop YARN in the UK

Hadoop YARN
Top 12 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 26 June 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +147 204 £85,000 +17.24% 2
London +160 163 £90,000 +14.29% 2
UK excluding London +29 47 £65,000 +8.33%
South West +35 14 £52,500 -11.76%
South East -13 12 £90,000 +38.46%
East of England +88 8 £70,000 +57.66%
Scotland +8 6 £67,500 -
Midlands +15 4 £55,000 -4.35%
North of England +32 3 £47,500 -9.52%
Yorkshire +11 3 £47,500 -9.52%
West Midlands +30 2 - -
East Midlands +29 2 £55,000 -4.35%

For the 6 months to 26 June 2019, IT jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop YARN.

1 180 (84.51%) Apache Spark
2 179 (84.04%) Apache Hive
3 170 (79.81%) Big Data
4 160 (75.12%) Hadoop
5 146 (68.54%) Python
6 145 (68.08%) Java
7 140 (65.73%) Agile Software Development
8 134 (62.91%) HBase
9 125 (58.69%) Scala
10 118 (55.40%) Kafka
11 117 (54.93%) Impala
12 108 (50.70%) Hortonworks
13 104 (48.83%) Analytics
13 104 (48.83%) Amazon AWS
14 94 (44.13%) MapReduce
15 90 (42.25%) Elasticsearch
16 85 (39.91%) Apache Cassandra
16 85 (39.91%) NoSQL
17 82 (38.50%) Apache Pig
17 82 (38.50%) Data Science
18 79 (37.09%) Scrum
19 75 (35.21%) Cloudera
20 74 (34.74%) Apache Flume
21 73 (34.27%) Oozie
21 73 (34.27%) Flink
22 66 (30.99%) HDFS
23 64 (30.05%) Amazon Redshift
24 62 (29.11%) Linux
25 60 (28.17%) SQL
26 59 (27.70%) MapR

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 180 (84.51%) Apache Spark
2 90 (42.25%) Elasticsearch
3 82 (38.50%) Apache Pig
4 55 (25.82%) Apache Solr
5 23 (10.80%) Apache
6 4 (1.88%) Confluence
7 2 (0.94%) Cloud Foundry
7 2 (0.94%) Mule
7 2 (0.94%) nginx
7 2 (0.94%) Tomcat
8 1 (0.47%) SAS
Business Applications
1 3 (1.41%) Dynamics CRM
Cloud Services
1 104 (48.83%) Amazon AWS
2 38 (17.84%) Microsoft Azure
3 30 (14.08%) Google Cloud Platform
4 14 (6.57%) Amazon Kinesis
5 11 (5.16%) PaaS
5 11 (5.16%) Serverless
6 10 (4.69%) Amazon EC2
6 10 (4.69%) Amazon S3
6 10 (4.69%) IaaS
7 9 (4.23%) Amazon EMR
7 9 (4.23%) SaaS
8 4 (1.88%) AWS CloudFormation
8 4 (1.88%) Cloud Computing
8 4 (1.88%) Yarn
9 3 (1.41%) GitHub
9 3 (1.41%) Virtual Private Cloud
10 2 (0.94%) npm
10 2 (0.94%) Slack
11 1 (0.47%) AWS Fargate
11 1 (0.47%) AWS Lambda
Communications & Networking
1 23 (10.80%) Internet
2 4 (1.88%) Kerberos
3 2 (0.94%) HTTP
3 2 (0.94%) SSH
3 2 (0.94%) SSL
3 2 (0.94%) VPN
4 1 (0.47%) DNS
4 1 (0.47%) Firewall
4 1 (0.47%) HTTPS
Database & Business Intelligence
1 179 (84.04%) Apache Hive
2 170 (79.81%) Big Data
3 160 (75.12%) Hadoop
4 134 (62.91%) HBase
5 117 (54.93%) Impala
6 85 (39.91%) Apache Cassandra
6 85 (39.91%) NoSQL
7 73 (34.27%) Flink
8 64 (30.05%) Amazon Redshift
9 59 (27.70%) Couchbase
9 59 (27.70%) CouchDB
10 43 (20.19%) Data Warehouse
11 33 (15.49%) Sqoop
12 29 (13.62%) BigQuery
13 21 (9.86%) Relational Database
14 20 (9.39%) Pentaho
14 20 (9.39%) PostgreSQL
15 19 (8.92%) DataStage
16 18 (8.45%) MySQL
17 17 (7.98%) SQL Server
Development Applications
1 34 (15.96%) Git (software)
2 28 (13.15%) Jenkins
3 17 (7.98%) Artifactory
4 11 (5.16%) Eclipse
4 11 (5.16%) IntelliJ
4 11 (5.16%) JIRA
4 11 (5.16%) NetBeans
5 6 (2.82%) Sonatype Nexus
6 4 (1.88%) Maven
6 4 (1.88%) webpack
7 3 (1.41%) Visual Studio Team System
8 2 (0.94%) Babel
8 2 (0.94%) Cucumber
8 2 (0.94%) JUnit
8 2 (0.94%) Mocha
8 2 (0.94%) Selenium
8 2 (0.94%) SonarQube
9 1 (0.47%) Travis CI
General
1 24 (11.27%) Finance
2 19 (8.92%) Banking
3 11 (5.16%) Telecoms
4 10 (4.69%) Games
5 7 (3.29%) Retail
6 5 (2.35%) Legal
7 1 (0.47%) Retail Banking
Job Titles
1 88 (41.31%) Data Engineer
2 49 (23.00%) Big Data Engineer
3 38 (17.84%) Architect
3 38 (17.84%) Developer
4 35 (16.43%) Data Architect
5 27 (12.68%) Senior Data Engineer
6 26 (12.21%) Big Data Architect
6 26 (12.21%) Java Developer
7 21 (9.86%) Senior Developer
8 17 (7.98%) Administrator
8 17 (7.98%) Data Administrator
9 15 (7.04%) Big Data Developer
9 15 (7.04%) Consultant
9 15 (7.04%) Java Scala Developer
9 15 (7.04%) Scala Developer
10 13 (6.10%) Data Consultant
11 12 (5.63%) Hadoop Engineer
12 11 (5.16%) Senior Java Developer
13 10 (4.69%) Games Engineer
14 9 (4.23%) Cloud Engineer
Libraries, Frameworks & Software Standards
1 118 (55.40%) Kafka
2 15 (7.04%) Apache NiFi
3 14 (6.57%) Node.js
4 13 (6.10%) HTML
4 13 (6.10%) Spring
4 13 (6.10%) Spring Boot
5 11 (5.16%) ActiveMQ
5 11 (5.16%) Hibernate
5 11 (5.16%) J2EE
5 11 (5.16%) JPA
5 11 (5.16%) JSON
5 11 (5.16%) RabbitMQ
5 11 (5.16%) SOAP
5 11 (5.16%) Spring Cloud
5 11 (5.16%) Web Services
6 10 (4.69%) .NET
6 10 (4.69%) OAuth
7 9 (4.23%) Apache Beam
7 9 (4.23%) OAuth2
7 9 (4.23%) XML
Miscellaneous
1 14 (6.57%) Analytical Skills
2 11 (5.16%) Cloud Native
3 9 (4.23%) Public Cloud
4 6 (2.82%) Enterprise Software
4 6 (2.82%) Linux Command Line
5 5 (2.35%) Social Media
6 3 (1.41%) User Experience
7 2 (0.94%) Mobile App
7 2 (0.94%) Online Banking
7 2 (0.94%) Social Network
7 2 (0.94%) Tandem
8 1 (0.47%) Algorithms
8 1 (0.47%) Data Centre
8 1 (0.47%) Data Structures
8 1 (0.47%) Greenfield Project
8 1 (0.47%) Reference Data
8 1 (0.47%) Replication
8 1 (0.47%) Wiki
Operating Systems
1 62 (29.11%) Linux
2 19 (8.92%) Unix
Processes & Methodologies
1 140 (65.73%) Agile Software Development
2 104 (48.83%) Analytics
3 94 (44.13%) MapReduce
4 82 (38.50%) Data Science
5 79 (37.09%) Scrum
6 51 (23.94%) Kanban
7 46 (21.60%) Data Analytics
8 44 (20.66%) Technology Roadmap
9 42 (19.72%) ETL
10 35 (16.43%) Big Data Analytics
11 32 (15.02%) DevOps
11 32 (15.02%) Use Case
12 25 (11.74%) Data Engineering
13 21 (9.86%) Microservices
14 19 (8.92%) Continuous Integration
14 19 (8.92%) Data Architecture
14 19 (8.92%) TDD
15 16 (7.51%) Stakeholder Management
16 15 (7.04%) Computer Science
16 15 (7.04%) Data Strategy
Programming Languages
1 146 (68.54%) Python
2 145 (68.08%) Java
3 125 (58.69%) Scala
4 60 (28.17%) SQL
5 26 (12.21%) Bash Shell
6 16 (7.51%) JavaScript
7 13 (6.10%) Shell Script
8 11 (5.16%) T-SQL
9 10 (4.69%) C#
10 3 (1.41%) PL/SQL
11 2 (0.94%) ES6
11 2 (0.94%) Groovy
11 2 (0.94%) Java 8
11 2 (0.94%) PHP
12 1 (0.47%) Perl
12 1 (0.47%) R
12 1 (0.47%) Ruby
Qualifications
1 40 (18.78%) Degree
2 29 (13.62%) Computer Science Degree
3 8 (3.76%) SC Cleared
3 8 (3.76%) Security Cleared
4 2 (0.94%) Master's Degree
5 1 (0.47%) Numerate Degree
Quality Assurance & Compliance
1 13 (6.10%) Data Quality
2 5 (2.35%) GDPR
2 5 (2.35%) ISO/IEC 27001
3 3 (1.41%) QA
4 2 (0.94%) WCAG
5 1 (0.47%) MiFID
System Software
1 74 (34.74%) Apache Flume
2 66 (30.99%) HDFS
3 46 (21.60%) Docker
4 13 (6.10%) Apache ZooKeeper
5 3 (1.41%) Active Directory
6 2 (0.94%) zsh
7 1 (0.47%) Virtual Servers
Systems Management
1 73 (34.27%) Oozie
2 34 (15.96%) Ansible
3 16 (7.51%) Ambari
4 5 (2.35%) Chukwa
4 5 (2.35%) Terraform
5 4 (1.88%) Mesos
6 3 (1.41%) Opscode Chef
7 1 (0.47%) Kibana
7 1 (0.47%) logstash
7 1 (0.47%) Puppet
7 1 (0.47%) Single Sign-On
Vendors
1 108 (50.70%) Hortonworks
2 75 (35.21%) Cloudera
3 59 (27.70%) Databricks
3 59 (27.70%) MapR
4 24 (11.27%) Informatica
4 24 (11.27%) Talend
5 19 (8.92%) Google
6 16 (7.51%) Oracle
6 16 (7.51%) Splunk
7 15 (7.04%) VMware
8 12 (5.63%) Microsoft
9 8 (3.76%) Guidewire
9 8 (3.76%) IBM
9 8 (3.76%) Netezza
9 8 (3.76%) Tableau
10 4 (1.88%) AppDynamics
11 3 (1.41%) Salesforce.com
12 2 (0.94%) Cadence
12 2 (0.94%) Cognizant
12 2 (0.94%) Red Hat