Period
to 1 April 2020

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 1 April 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
1 Apr 2020
Same period 2019 Same period 2018
Rank 623 705 713
Rank change year-on-year +82 +8 -17
Contract jobs citing Hadoop YARN 65 176 184
As % of all contract jobs advertised in the UK 0.10% 0.18% 0.18%
As % of the Systems Management category 0.73% 1.24% 1.42%
Number of daily rates quoted 38 97 98
Median daily rate £557 £600 £525
Median daily rate % change year-on-year -7.13% +14.29% -4.55%
10th Percentile £458 £500 £463
90th Percentile £700 £753 £673
UK excluding London median daily rate £526 £550 £500
% change year-on-year -4.32% +10.00% +5.26%
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate - - -

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Contract vacancies with a requirement for systems management skills 8,922 14,202 12,920
As % of all contract IT jobs advertised in the UK 14.36% 14.74% 12.73%
Number of daily rates quoted 5,825 9,485 8,681
Median daily rate £500 £500 £483
Median daily rate % change year-on-year - +3.63% +7.22%
10th Percentile £263 £310 £270
90th Percentile £663 £663 £625
UK excluding London median daily rate £450 £450 £425
% change year-on-year - +5.88% +6.25%
Number of hourly rates quoted 303 349 279
Median hourly rate £20.00 £18.80 £17.50
Median hourly rate % change year-on-year +6.38% +7.43% -14.11%
10th Percentile £12.50 £12.00 £11.59
90th Percentile £48.53 £49.50 £47.83
Median hourly rate £18.00 £17.50 £15.50
% change year-on-year +2.86% +12.90% -20.51%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop YARN.

Daily rate trend for Hadoop YARN in the UK

Hadoop YARN
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop YARN over the 6 months to 1 April 2020.

Daily rate histogram for Hadoop YARN in the UK

Hadoop YARN
Top 10 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 1 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +81 65 £557 -7.13% 8
UK excluding London +85 38 £526 -4.32% 2
London +78 27 £663 +1.92% 6
South West +46 15 £528 -
North of England +65 12 £500 -13.04%
Yorkshire +52 12 £500 -13.04%
Midlands +76 8 £560 +6.67% 1
West Midlands +59 8 £560 -6.67% 1
South East +34 2 £425 -22.73% 1
East of England +33 1 £580 -

For the 6 months to 1 April 2020, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Hadoop YARN.

1 60 (92.31%) Apache Spark
2 53 (81.54%) Hadoop
3 52 (80.00%) Apache Hive
4 51 (78.46%) Big Data
5 48 (73.85%) HDFS
6 45 (69.23%) HBase
7 43 (66.15%) SQL
8 41 (63.08%) Java
9 38 (58.46%) Kafka
9 38 (58.46%) Scala
10 32 (49.23%) Jenkins
11 31 (47.69%) Python
11 31 (47.69%) Agile Software Development
12 28 (43.08%) Git (software)
13 26 (40.00%) Software Engineering
14 24 (36.92%) Azure
14 24 (36.92%) Analytics
15 23 (35.38%) Data Modelling
16 22 (33.85%) Hortonworks
16 22 (33.85%) AWS
17 21 (32.31%) TDD
17 21 (32.31%) Finance
18 20 (30.77%) Apache
19 19 (29.23%) Cloudera
19 19 (29.23%) Functional Programming
20 18 (27.69%) Computer Science
20 18 (27.69%) Kerberos
21 17 (26.15%) Linux
22 16 (24.62%) Scrum
22 16 (24.62%) Continuous Integration

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 60 (92.31%) Apache Spark
2 20 (30.77%) Apache
3 8 (12.31%) OpenStack
4 2 (3.08%) Apache Pig
5 1 (1.54%) Apache Airflow
5 1 (1.54%) Confluence
5 1 (1.54%) Jupyter
5 1 (1.54%) Luigi
5 1 (1.54%) SAS
5 1 (1.54%) SharePoint
Applications
1 1 (1.54%) Chatbot
1 1 (1.54%) Microsoft Project
1 1 (1.54%) MS Visio
Business Applications
1 1 (1.54%) NetSuite
Cloud Services
1 24 (36.92%) Azure
2 22 (33.85%) AWS
3 11 (16.92%) GCP
4 10 (15.38%) Amazon Kinesis
5 5 (7.69%) IaaS
5 5 (7.69%) PaaS
6 1 (1.54%) Amazon EC2
6 1 (1.54%) Amazon S3
6 1 (1.54%) Amazon SQS
6 1 (1.54%) AWS CloudFormation
6 1 (1.54%) Dynamics 365
6 1 (1.54%) Virtual Private Cloud
Communications & Networking
1 18 (27.69%) Kerberos
2 13 (20.00%) SSL
3 9 (13.85%) DNS
4 6 (9.23%) VPN
5 4 (6.15%) HTTP
5 4 (6.15%) HTTPS
6 3 (4.62%) Firewall
Database & Business Intelligence
1 53 (81.54%) Hadoop
2 52 (80.00%) Apache Hive
3 51 (78.46%) Big Data
4 45 (69.23%) HBase
5 14 (21.54%) Impala
6 12 (18.46%) Sqoop
7 10 (15.38%) MongoDB
7 10 (15.38%) NoSQL
8 9 (13.85%) Flink
8 9 (13.85%) Pentaho
9 8 (12.31%) Apache Cassandra
10 2 (3.08%) Cloudera CDH
10 2 (3.08%) SQL Server
11 1 (1.54%) Data Lake
11 1 (1.54%) Data Warehouse
11 1 (1.54%) SQL Navigator
11 1 (1.54%) SQL Server 2008
11 1 (1.54%) SQL Server 2017
11 1 (1.54%) SQL Server Analysis Services
11 1 (1.54%) SQL Server Integration Services
Development Applications
1 32 (49.23%) Jenkins
2 28 (43.08%) Git (software)
3 15 (23.08%) IBM UrbanCode
3 15 (23.08%) Maven
3 15 (23.08%) Sonatype Nexus
4 10 (15.38%) Artifactory
5 8 (12.31%) JIRA
6 6 (9.23%) Travis CI
7 1 (1.54%) Bitbucket
7 1 (1.54%) Cucumber
7 1 (1.54%) GitLab
7 1 (1.54%) JUnit
General
1 21 (32.31%) Finance
2 12 (18.46%) Public Sector
3 6 (9.23%) Banking
3 6 (9.23%) Retail Banking
4 1 (1.54%) Front Office
4 1 (1.54%) Legal
Job Titles
1 34 (52.31%) Data Engineer
2 31 (47.69%) Big Data Engineer
3 10 (15.38%) Developer
4 9 (13.85%) Platform Engineer
5 8 (12.31%) DevOps Engineer
6 7 (10.77%) Architect
6 7 (10.77%) Big Data Architect
6 7 (10.77%) Data Architect
6 7 (10.77%) Hadoop Developer
6 7 (10.77%) Java Developer
6 7 (10.77%) Java Hadoop Developer
7 5 (7.69%) Hadoop Engineer
8 4 (6.15%) Administrator
8 4 (6.15%) Senior Data Engineer
8 4 (6.15%) Senior DevOps
8 4 (6.15%) Senior DevOps Engineer
9 3 (4.62%) Big Data Developer
9 3 (4.62%) Hadoop Administrator
9 3 (4.62%) Senior Hadoop Engineer
10 2 (3.08%) Linux/Unix DevOps
Libraries, Frameworks & Software Standards
1 38 (58.46%) Kafka
2 10 (15.38%) PySpark
3 6 (9.23%) LDAP
3 6 (9.23%) OAuth
3 6 (9.23%) SAML
4 5 (7.69%) Spark Streaming
5 4 (6.15%) Spring
6 3 (4.62%) Elastic Stack
7 2 (3.08%) ADO
7 2 (3.08%) Akka
7 2 (3.08%) JSON
8 1 (1.54%) Apache NiFi
8 1 (1.54%) RabbitMQ
Miscellaneous
1 15 (23.08%) Analytical Skills
2 10 (15.38%) Management Information System
3 8 (12.31%) Public Cloud
4 7 (10.77%) User Experience
5 6 (9.23%) Linux Command Line
6 5 (7.69%) Data Centre
7 2 (3.08%) Clustering
7 2 (3.08%) Life Science
7 2 (3.08%) Semantic Web
8 1 (1.54%) Algorithms
8 1 (1.54%) Analytical Mindset
8 1 (1.54%) Enterprise Software
8 1 (1.54%) PMI
8 1 (1.54%) Self-Motivation
8 1 (1.54%) Wiki
Operating Systems
1 17 (26.15%) Linux
2 7 (10.77%) Unix
3 2 (3.08%) Ubuntu
3 2 (3.08%) Windows
4 1 (1.54%) CentOS
Processes & Methodologies
1 31 (47.69%) Agile Software Development
2 26 (40.00%) Software Engineering
3 24 (36.92%) Analytics
4 23 (35.38%) Data Modelling
5 21 (32.31%) TDD
6 19 (29.23%) Functional Programming
7 18 (27.69%) Computer Science
8 16 (24.62%) Continuous Integration
8 16 (24.62%) Microservices
8 16 (24.62%) Scrum
9 15 (23.08%) BDD
10 14 (21.54%) DevOps
11 12 (18.46%) Business Intelligence
11 12 (18.46%) Mentoring
11 12 (18.46%) Migration
11 12 (18.46%) Project Delivery
11 12 (18.46%) Stakeholder Management
11 12 (18.46%) Use Case
12 11 (16.92%) Performance Tuning
13 10 (15.38%) User Stories
Programming Languages
1 43 (66.15%) SQL
2 41 (63.08%) Java
3 38 (58.46%) Scala
4 31 (47.69%) Python
5 16 (24.62%) Bash Shell
6 10 (15.38%) C
6 10 (15.38%) Go
7 9 (13.85%) Kotlin
8 8 (12.31%) Perl
8 8 (12.31%) R
9 6 (9.23%) Ruby
10 1 (1.54%) PL/SQL
10 1 (1.54%) PowerShell
Qualifications
1 12 (18.46%) Computer Science Degree
1 12 (18.46%) Degree
2 2 (3.08%) BPSS Clearance
2 2 (3.08%) SC Cleared
2 2 (3.08%) Security Cleared
3 1 (1.54%) PMI Certification
Quality Assurance & Compliance
1 3 (4.62%) Data Quality
2 1 (1.54%) ISO/IEC 27001
System Software
1 48 (73.85%) HDFS
2 15 (23.08%) Docker
3 10 (15.38%) Active Directory
4 2 (3.08%) Apache Flume
Systems Management
1 14 (21.54%) Terraform
2 12 (18.46%) Oozie
3 11 (16.92%) Ansible
3 11 (16.92%) Kubernetes
4 9 (13.85%) Ambari
5 6 (9.23%) Single Sign-On
6 3 (4.62%) Opscode Chef
7 2 (3.08%) Puppet
Vendors
1 22 (33.85%) Hortonworks
2 19 (29.23%) Cloudera
3 10 (15.38%) Microsoft
4 8 (12.31%) Tableau
5 3 (4.62%) Google
6 1 (1.54%) Foundry
6 1 (1.54%) JD Edwards
6 1 (1.54%) Palantir
6 1 (1.54%) Splunk
6 1 (1.54%) StreamSets