Period
to 27 October 2021

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 27 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
UK
6 months to
27 Oct 2021
Same period 2020 Same period 2019
Rank 780 530 723
Rank change year-on-year -250 +193 -16
Contract jobs citing Hadoop YARN 45 10 94
As % of all contract jobs advertised in the UK 0.053% 0.031% 0.11%
As % of the Systems Management category 0.33% 0.19% 0.75%
Number of daily rates quoted 27 6 59
10th Percentile £391 £364 £429
25th Percentile £456 £385 £473
Median daily rate (50th Percentile) £575 £466 £550
Median % change year-on-year +23.32% -15.23% +4.76%
75th Percentile £675 £541 £675
90th Percentile £713 £578 £700
UK excluding London median daily rate £463 £410 £485
% change year-on-year +12.80% -15.46% -3.00%

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for systems management skills.

All Systems Management Skills
UK
Contract vacancies with a requirement for systems management skills 13,691 5,266 12,514
As % of all contract IT jobs advertised in the UK 16.06% 16.27% 14.84%
Number of daily rates quoted 9,818 3,620 8,613
10th Percentile £356 £313 £270
25th Percentile £450 £405 £388
Median daily rate (50th Percentile) £540 £500 £500
Median % change year-on-year +8.00% - +1.01%
75th Percentile £630 £588 £594
90th Percentile £700 £650 £675
UK excluding London median daily rate £475 £450 £450
% change year-on-year +5.56% - +3.45%
Number of hourly rates quoted 187 106 289
10th Percentile £14.25 £12.50 £12.49
25th Percentile £16.00 £14.06 £14.63
Median hourly rate £22.50 £19.75 £20.00
Median % change year-on-year +13.92% -1.25% +14.29%
75th Percentile £48.75 £40.00 £40.00
90th Percentile £64.50 £57.63 £50.00
UK excluding London median hourly rate £19.00 £18.88 £18.25
% change year-on-year +0.66% +3.42% +4.29%

Hadoop YARN
Job Vacancy Trend

Job postings citing Hadoop YARN as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop YARN in the UK

Hadoop YARN
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop YARN.

Daily rate trend for Hadoop YARN in the UK

Hadoop YARN
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop YARN over the 6 months to 27 October 2021.

Daily rate histogram for Hadoop YARN in the UK

Hadoop YARN
Top 8 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the UK over the 6 months to 27 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -209 40 £500 -5.66% 4
London -184 28 £575 -4.17% 4
Work from Home - 16 £598 - 1
UK excluding London -165 6 £463 +12.80%
Midlands -76 4 £406 +7.47%
East Midlands -31 3 £500 +32.28%
South West - 2 £463 -
West Midlands - 1 £313 -

For the 6 months to 27 October 2021, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Hadoop YARN.

1 43 (95.56%) Hadoop
2 40 (88.89%) Apache Spark
3 35 (77.78%) Apache Hive
4 27 (60.00%) SQL
5 26 (57.78%) HBase
5 26 (57.78%) Big Data
6 23 (51.11%) Cloudera
6 23 (51.11%) HDFS
6 23 (51.11%) Java
7 20 (44.44%) Data Modelling
7 20 (44.44%) Kafka
8 19 (42.22%) Python
9 18 (40.00%) Scala
9 18 (40.00%) DevOps
10 17 (37.78%) Kubernetes
11 15 (33.33%) Apache
11 15 (33.33%) Git (software)
11 15 (33.33%) Impala
11 15 (33.33%) Jenkins
12 14 (31.11%) Oozie
12 14 (31.11%) Agile Software Development
12 14 (31.11%) Linux
13 13 (28.89%) Azure
13 13 (28.89%) Hortonworks
14 12 (26.67%) Data Lake
14 12 (26.67%) AWS
14 12 (26.67%) Continuous Integration
15 11 (24.44%) Deployment Automation
15 11 (24.44%) Data Pipeline
15 11 (24.44%) Analytics

Hadoop YARN
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 40 (88.89%) Apache Spark
2 15 (33.33%) Apache
3 5 (11.11%) Apache Airflow
4 3 (6.67%) Elasticsearch
5 1 (2.22%) Apache Pig
5 1 (2.22%) Apache Solr
5 1 (2.22%) Confluence
5 1 (2.22%) SAS
5 1 (2.22%) Tomcat
Cloud Services
1 13 (28.89%) Azure
2 12 (26.67%) AWS
3 9 (20.00%) GitHub
4 7 (15.56%) Amazon S3
4 7 (15.56%) GCP
5 5 (11.11%) Azure App Service
5 5 (11.11%) Azure Key Vault
5 5 (11.11%) Azure Storage
6 3 (6.67%) OpenShift
7 2 (4.44%) Azure Data Factory
7 2 (4.44%) Power Platform
8 1 (2.22%) Google Data Studio
8 1 (2.22%) SaaS
8 1 (2.22%) Snowflake
Communications & Networking
1 8 (17.78%) HTTP
2 5 (11.11%) Firewall
2 5 (11.11%) HTTPS
2 5 (11.11%) SSL
3 3 (6.67%) Kerberos
4 1 (2.22%) FTP
Database & Business Intelligence
1 43 (95.56%) Hadoop
2 35 (77.78%) Apache Hive
3 26 (57.78%) Big Data
3 26 (57.78%) HBase
4 15 (33.33%) Impala
5 12 (26.67%) Data Lake
6 10 (22.22%) Relational Database
7 9 (20.00%) Spark SQL
8 7 (15.56%) RDBMS
8 7 (15.56%) Sqoop
9 6 (13.33%) Oracle Database
10 5 (11.11%) Metadata
10 5 (11.11%) NoSQL
11 4 (8.89%) Data Warehouse
12 3 (6.67%) Cloudera CDH
12 3 (6.67%) Metadata Repository
12 3 (6.67%) Presto
13 2 (4.44%) Data Vault
13 2 (4.44%) Power BI
13 2 (4.44%) Snowflake Schema
Development Applications
1 15 (33.33%) Git (software)
1 15 (33.33%) Jenkins
2 8 (17.78%) JIRA
2 8 (17.78%) Maven
3 5 (11.11%) IBM UrbanCode
3 5 (11.11%) Sonatype Nexus
4 4 (8.89%) Bitbucket
5 3 (6.67%) Artifactory
5 3 (6.67%) Eclipse
5 3 (6.67%) IntelliJ
5 3 (6.67%) JUnit
5 3 (6.67%) Mockito
5 3 (6.67%) TeamCity
6 1 (2.22%) ERwin
6 1 (2.22%) Subversion
General
1 8 (17.78%) Finance
2 7 (15.56%) Analytical Skills
2 7 (15.56%) Banking
3 5 (11.11%) Publishing
4 2 (4.44%) Games
4 2 (4.44%) Marketing
5 1 (2.22%) Front Office
5 1 (2.22%) Presentation Skills
5 1 (2.22%) Social Skills
5 1 (2.22%) Telecoms
Job Titles
1 16 (35.56%) Developer
2 14 (31.11%) Data Engineer
3 7 (15.56%) Big Data Engineer
4 6 (13.33%) Ab Initio Developer
4 6 (13.33%) Hadoop Engineer
4 6 (13.33%) Scala Developer
5 5 (11.11%) Cloud Engineer
6 4 (8.89%) Architect
6 4 (8.89%) Data Architect
7 3 (6.67%) Java Developer
7 3 (6.67%) Java Engineer
8 2 (4.44%) Administrator
8 2 (4.44%) Azure Architect
8 2 (4.44%) Azure Consultant
8 2 (4.44%) Azure Engineer
8 2 (4.44%) Cloud Administrator
8 2 (4.44%) Consultant
8 2 (4.44%) DevOps Consultant
8 2 (4.44%) DevOps Engineer
8 2 (4.44%) Machine Learning Engineer
Libraries, Frameworks & Software Standards
1 20 (44.44%) Kafka
2 9 (20.00%) RESTful
3 6 (13.33%) Elastic Stack
4 4 (8.89%) Spring
4 4 (8.89%) Web Services
5 3 (6.67%) Apache NiFi
5 3 (6.67%) WireMock
6 2 (4.44%) Pandas
6 2 (4.44%) PySpark
6 2 (4.44%) REST
6 2 (4.44%) Spark Streaming
7 1 (2.22%) Apache Avro
7 1 (2.22%) Flask
7 1 (2.22%) JDBC
7 1 (2.22%) MLlib
7 1 (2.22%) NumPy
7 1 (2.22%) Protocol Buffers
7 1 (2.22%) scikit-learn
7 1 (2.22%) SparkR
7 1 (2.22%) Spring Boot
Miscellaneous
1 5 (11.11%) Data Centre
2 1 (2.22%) Algorithms
2 1 (2.22%) Enterprise Software
2 1 (2.22%) Equities
2 1 (2.22%) Fixed Income
2 1 (2.22%) Foreign Exchange (FX)
2 1 (2.22%) Management Information System
2 1 (2.22%) Reference Data
2 1 (2.22%) Replication
Operating Systems
1 14 (31.11%) Linux
2 8 (17.78%) Unix
3 1 (2.22%) Red Hat Enterprise Linux
Processes & Methodologies
1 20 (44.44%) Data Modelling
2 18 (40.00%) DevOps
3 14 (31.11%) Agile Software Development
4 12 (26.67%) Continuous Integration
5 11 (24.44%) Analytics
5 11 (24.44%) Data Pipeline
5 11 (24.44%) Deployment Automation
6 9 (20.00%) ETL
6 9 (20.00%) Test Automation
7 8 (17.78%) Data Governance
7 8 (17.78%) Data Management
8 7 (15.56%) BDD
8 7 (15.56%) Data Engineering
8 7 (15.56%) Scrum
9 6 (13.33%) ETL Development
9 6 (13.33%) Functional Programming
9 6 (13.33%) Software Engineering
9 6 (13.33%) Task Automation
9 6 (13.33%) Use Case
10 5 (11.11%) Mentoring
Programming Languages
1 27 (60.00%) SQL
2 23 (51.11%) Java
3 19 (42.22%) Python
4 18 (40.00%) Scala
5 8 (17.78%) Shell Script
6 4 (8.89%) C
7 2 (4.44%) Bash Shell
Qualifications
1 1 (2.22%) CCA
1 1 (2.22%) SC Cleared
1 1 (2.22%) Security Cleared
Quality Assurance & Compliance
1 3 (6.67%) Data Quality
1 3 (6.67%) Sarbanes-Oxley
2 2 (4.44%) GDPR
System Software
1 23 (51.11%) HDFS
2 8 (17.78%) Apache ZooKeeper
3 5 (11.11%) Docker
Systems Management
1 17 (37.78%) Kubernetes
2 14 (31.11%) Oozie
3 7 (15.56%) Ansible
4 6 (13.33%) Ambari
5 2 (4.44%) Terraform
6 1 (2.22%) Kibana
6 1 (2.22%) logstash
6 1 (2.22%) Nagios
6 1 (2.22%) Opsview
6 1 (2.22%) Puppet
6 1 (2.22%) QRadar
Vendors
1 23 (51.11%) Cloudera
2 13 (28.89%) Hortonworks
3 9 (20.00%) Google
4 8 (17.78%) Oracle
5 6 (13.33%) Ab Initio
5 6 (13.33%) Teradata
6 4 (8.89%) Microsoft
7 1 (2.22%) Atlassian
7 1 (2.22%) CheckPoint
7 1 (2.22%) IBM
7 1 (2.22%) Informatica
7 1 (2.22%) LogRhythm
7 1 (2.22%) MicroStrategy
7 1 (2.22%) Red Hat
7 1 (2.22%) Salesforce.com
7 1 (2.22%) SAP
7 1 (2.22%) Splunk
7 1 (2.22%) StreamSets