Period
to 17 February 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop YARN over the 6 months to 17 February 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
17 Feb 2019
Same period 2018 Same period 2017
Rank 892 1004 1132
Rank change year-on-year +112 +128 +118
Permanent jobs citing Hadoop YARN 216 177 68
As % of all permanent IT jobs advertised in the UK 0.14% 0.10% 0.039%
As % of the Systems Management category 1.27% 1.09% 0.44%
Number of salaries quoted 126 138 28
UK median annual salary £85,000 £75,000 £56,750
Median salary % change year-on-year +13.33% +32.16% -17.45%
10th Percentile £45,000 £52,500 £42,625
90th Percentile £110,000 £95,375 £75,000
UK excluding London median annual salary £66,250 £57,500 £51,500
% change year-on-year +15.22% +11.65% -10.43%

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Permanent vacancies with a requirement for systems management skills 17,020 16,166 15,421
As % of all permanent IT jobs advertised in the UK 11.38% 9.23% 8.78%
Number of salaries quoted 13,293 13,038 12,479
UK median annual salary £57,500 £52,500 £51,500
Median salary % change year-on-year +9.52% +1.94% +3.00%
10th Percentile £32,500 £31,250 £31,250
90th Percentile £87,500 £82,500 £80,000
UK excluding London median annual salary £50,000 £46,000 £45,000
% change year-on-year +8.70% +2.22% +4.65%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop YARN.

Salary trend for Hadoop YARN in the UK

Hadoop YARN
Salary Histogram

The salary distribution of IT jobs citing Hadoop YARN over the 6 months to 17 February 2019.

Salary histogram for Hadoop YARN in the UK

Hadoop YARN
Top 13 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 17 February 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +139 211 £85,000 +13.33% 17
London +81 133 £85,000 +9.68% 12
UK excluding London +84 80 £66,250 +15.22% 5
South East +62 49 £67,500 +17.39% 1
South West +17 10 £50,000 -
North of England +60 8 £100,000 +135.29% 4
Yorkshire +63 7 £100,000 +135.29% 3
Midlands +45 6 £53,500 -10.83%
East Midlands +10 5 £53,500 -6.96%
North East - 5 £100,000 -
East of England - 5 - -
Scotland -2 2 £67,500 -
West Midlands +46 1 - -

For the 6 months to 17 February 2019, IT jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop YARN.

1 202 (93.52%) Apache Spark
2 188 (87.04%) Hadoop
3 184 (85.19%) Big Data
4 182 (84.26%) Kafka
5 179 (82.87%) Apache Hive
6 173 (80.09%) Python
7 138 (63.89%) Java
8 128 (59.26%) HBase
9 125 (57.87%) Data Science
10 120 (55.56%) Amazon AWS
10 120 (55.56%) Agile Software Development
11 114 (52.78%) NoSQL
12 112 (51.85%) Apache Cassandra
13 111 (51.39%) Elasticsearch
14 109 (50.46%) Scala
15 105 (48.61%) Impala
16 99 (45.83%) Hortonworks
17 97 (44.91%) Cloudera
17 97 (44.91%) Apache Flume
18 93 (43.06%) Analytics
19 92 (42.59%) Apache Pig
20 91 (42.13%) Oozie
21 85 (39.35%) MapReduce
22 84 (38.89%) Amazon Redshift
23 81 (37.50%) Scrum
24 80 (37.04%) Flink
25 77 (35.65%) MapR
26 75 (34.72%) Kanban
27 73 (33.80%) CouchDB
27 73 (33.80%) Couchbase

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 202 (93.52%) Apache Spark
2 111 (51.39%) Elasticsearch
3 92 (42.59%) Apache Pig
4 70 (32.41%) Apache
5 56 (25.93%) Apache Solr
6 47 (21.76%) SAS
7 6 (2.78%) Cloud Foundry
8 4 (1.85%) JBoss
9 3 (1.39%) Confluence
9 3 (1.39%) nginx
10 2 (0.93%) Mule
10 2 (0.93%) Tomcat
Applications
1 1 (0.46%) HipChat
Cloud Services
1 120 (55.56%) Amazon AWS
2 55 (25.46%) Microsoft Azure
3 21 (9.72%) Amazon EMR
4 20 (9.26%) Amazon S3
5 18 (8.33%) Cloud Computing
6 11 (5.09%) AWS Lambda
7 10 (4.63%) GitHub
8 9 (4.17%) AWS Data Pipeline
8 9 (4.17%) Google Cloud Platform
9 6 (2.78%) Serverless
10 5 (2.31%) Yarn
11 4 (1.85%) AWS CloudFormation
11 4 (1.85%) PaaS
12 3 (1.39%) CloudFront
12 3 (1.39%) IaaS
12 3 (1.39%) npm
13 2 (0.93%) Amazon CloudWatch
13 2 (0.93%) SaaS
13 2 (0.93%) Slack
14 1 (0.46%) Amazon EC2
Communications & Networking
1 17 (7.87%) Internet
2 9 (4.17%) Kerberos
3 6 (2.78%) Firewall
3 6 (2.78%) SSL
4 5 (2.31%) DNS
4 5 (2.31%) TCP/IP
5 4 (1.85%) VPN
6 2 (0.93%) SSH
7 1 (0.46%) HTTP
7 1 (0.46%) HTTPS
Database & Business Intelligence
1 188 (87.04%) Hadoop
2 184 (85.19%) Big Data
3 179 (82.87%) Apache Hive
4 128 (59.26%) HBase
5 114 (52.78%) NoSQL
6 112 (51.85%) Apache Cassandra
7 105 (48.61%) Impala
8 84 (38.89%) Amazon Redshift
9 80 (37.04%) Flink
10 73 (33.80%) Couchbase
10 73 (33.80%) CouchDB
11 46 (21.30%) Power BI
12 41 (18.98%) SAP HANA
12 41 (18.98%) Text Mining
13 20 (9.26%) Data Warehouse
14 18 (8.33%) Sqoop
15 15 (6.94%) Apache Zeppelin
16 14 (6.48%) MongoDB
16 14 (6.48%) PostgreSQL
17 13 (6.02%) MySQL
Development Applications
1 33 (15.28%) Git (software)
2 20 (9.26%) Jenkins
3 10 (4.63%) Eclipse
3 10 (4.63%) IntelliJ
3 10 (4.63%) JIRA
3 10 (4.63%) NetBeans
4 7 (3.24%) Gradle
5 5 (2.31%) Sonatype Nexus
6 4 (1.85%) Artifactory
6 4 (1.85%) GitLab
6 4 (1.85%) Travis CI
6 4 (1.85%) webpack
7 3 (1.39%) Maven
8 2 (0.93%) Babel
8 2 (0.93%) Cucumber
8 2 (0.93%) JUnit
8 2 (0.93%) Mocha
8 2 (0.93%) Selenium
8 2 (0.93%) SonarQube
9 1 (0.46%) Atlassian Bamboo
General
1 67 (31.02%) Finance
2 55 (25.46%) Retail
3 47 (21.76%) Telecoms
4 17 (7.87%) Games
5 11 (5.09%) Banking
6 4 (1.85%) Legal
7 2 (0.93%) Financial Institution
Job Titles
1 100 (46.30%) Data Engineer
2 82 (37.96%) Big Data Engineer
3 41 (18.98%) Data Scientist
4 28 (12.96%) Senior Data Engineer
5 26 (12.04%) Developer
5 26 (12.04%) Senior Data Scientist
6 18 (8.33%) Architect
7 16 (7.41%) Games Engineer
8 15 (6.94%) Java Developer
9 13 (6.02%) Senior Developer
10 11 (5.09%) Senior Java Developer
11 10 (4.63%) Administrator
11 10 (4.63%) Data Architect
12 9 (4.17%) Cloud Engineer
12 9 (4.17%) Hadoop Engineer
13 8 (3.70%) Big Data Architect
14 7 (3.24%) Applications Architect
14 7 (3.24%) Senior Architect
15 5 (2.31%) Data Administrator
15 5 (2.31%) Hadoop Administrator
Libraries, Frameworks & Software Standards
1 182 (84.26%) Kafka
2 41 (18.98%) D3.js
2 41 (18.98%) ggplot
3 24 (11.11%) Middleware
4 20 (9.26%) Node.js
5 19 (8.80%) Spring
6 17 (7.87%) .NET
7 14 (6.48%) Elastic Stack
7 14 (6.48%) RabbitMQ
7 14 (6.48%) Spark Streaming
8 12 (5.56%) Spring Boot
9 11 (5.09%) JSON
9 11 (5.09%) PySpark
9 11 (5.09%) Web Services
10 10 (4.63%) ActiveMQ
10 10 (4.63%) Hibernate
10 10 (4.63%) JPA
10 10 (4.63%) LAMP
10 10 (4.63%) SOAP
10 10 (4.63%) Spring Cloud
Miscellaneous
1 45 (20.83%) Algorithms
2 41 (18.98%) Social Network
3 9 (4.17%) Linux Command Line
4 7 (3.24%) Cloud Native
4 7 (3.24%) Data Structures
4 7 (3.24%) User Experience
5 4 (1.85%) Virtual Team
6 3 (1.39%) Analytical Skills
6 3 (1.39%) Public Cloud
7 2 (0.93%) Mobile App
7 2 (0.93%) Online Banking
7 2 (0.93%) Tandem
8 1 (0.46%) Data Centre
8 1 (0.46%) Private Cloud
8 1 (0.46%) Reference Data
8 1 (0.46%) Social Media
8 1 (0.46%) Wiki
Operating Systems
1 63 (29.17%) Linux
2 20 (9.26%) Unix
3 5 (2.31%) VMS
4 1 (0.46%) Red Hat Enterprise Linux
4 1 (0.46%) Windows
Processes & Methodologies
1 125 (57.87%) Data Science
2 120 (55.56%) Agile Software Development
3 93 (43.06%) Analytics
4 85 (39.35%) MapReduce
5 81 (37.50%) Scrum
6 75 (34.72%) Kanban
7 61 (28.24%) Data Modelling
8 56 (25.93%) Data Engineering
9 51 (23.61%) Data Security
10 50 (23.15%) Artificial Intelligence
11 48 (22.22%) Visualisation
12 46 (21.30%) Business Intelligence
13 43 (19.91%) Data Visualisation
13 43 (19.91%) Operations Research
14 42 (19.44%) Random Forest
15 41 (18.98%) Data-Driven Decision Making
15 41 (18.98%) Decision-Making
15 41 (18.98%) Mathematics
15 41 (18.98%) Quantitative Research
15 41 (18.98%) Statistics
Programming Languages
1 173 (80.09%) Python
2 138 (63.89%) Java
3 109 (50.46%) Scala
4 73 (33.80%) SQL
5 41 (18.98%) R
6 18 (8.33%) Bash Shell
6 18 (8.33%) C#
6 18 (8.33%) Shell Script
7 15 (6.94%) JavaScript
8 10 (4.63%) T-SQL
9 2 (0.93%) ES6
9 2 (0.93%) Groovy
9 2 (0.93%) Java 8
9 2 (0.93%) PHP
9 2 (0.93%) Ruby
Qualifications
1 71 (32.87%) Degree
2 18 (8.33%) Computer Science Degree
3 2 (0.93%) Master's Degree
3 2 (0.93%) SC Cleared
3 2 (0.93%) Security Cleared
Quality Assurance & Compliance
1 13 (6.02%) QA
2 10 (4.63%) GDPR
2 10 (4.63%) MiFID
3 4 (1.85%) ISO/IEC 27001
4 3 (1.39%) Data Quality
5 2 (0.93%) WCAG
System Software
1 97 (44.91%) Apache Flume
2 51 (23.61%) HDFS
3 33 (15.28%) Docker
4 28 (12.96%) Apache ZooKeeper
5 7 (3.24%) Active Directory
6 5 (2.31%) Virtual Machines
7 2 (0.93%) zsh
Systems Management
1 91 (42.13%) Oozie
2 20 (9.26%) Ambari
2 20 (9.26%) Ansible
3 12 (5.56%) Kibana
4 9 (4.17%) logstash
5 8 (3.70%) Puppet
6 6 (2.78%) Kubernetes
6 6 (2.78%) Mesos
6 6 (2.78%) Prometheus
6 6 (2.78%) Terraform
7 5 (2.31%) Opscode Chef
8 2 (0.93%) Grafana
9 1 (0.46%) ITRS Geneos
9 1 (0.46%) Single Sign-On
9 1 (0.46%) Sysdig
Vendors
1 99 (45.83%) Hortonworks
2 97 (44.91%) Cloudera
3 77 (35.65%) MapR
4 73 (33.80%) Databricks
5 46 (21.30%) SAP
6 43 (19.91%) Tableau
7 15 (6.94%) Informatica
7 15 (6.94%) Talend
8 12 (5.56%) Oracle
9 10 (4.63%) Solace
10 9 (4.17%) TIBCO
11 8 (3.70%) Google
12 7 (3.24%) Teradata
13 5 (2.31%) AppDynamics
13 5 (2.31%) Splunk
14 4 (1.85%) VMware
15 3 (1.39%) Red Hat
16 2 (0.93%) Cadence
16 2 (0.93%) Cognizant
17 1 (0.46%) Dynatrace