Period
to 26 October 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop YARN skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop YARN over the 6 months to 26 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop YARN (MapReduce 2.0)
UK > England
6 months to
26 Oct 2021
Same period 2020 Same period 2019
Rank 697 494 689
Rank change year-on-year -203 +195 -12
Contract jobs citing Hadoop YARN 41 7 87
As % of all contract jobs advertised in England 0.060% 0.025% 0.11%
As % of the Systems Management category 0.38% 0.16% 0.77%
Number of daily rates quoted 25 4 59
10th Percentile £382 £418 £429
25th Percentile £450 £478 £473
Median daily rate (50th Percentile) £500 £530 £550
Median % change year-on-year -5.66% -3.64% +4.76%
75th Percentile £625 £561 £675
90th Percentile £713 £592 £700
UK median daily rate £575 £466 £550
% change year-on-year +23.32% -15.23% +4.76%

Hadoop YARN is in the Systems Management category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for systems management skills.

All Systems Management Skills
England
Contract vacancies with a requirement for systems management skills 10,897 4,444 11,353
As % of all contract IT jobs advertised in England 16.01% 16.10% 14.75%
Number of daily rates quoted 7,894 3,089 7,909
10th Percentile £350 £311 £275
25th Percentile £450 £405 £400
Median daily rate (50th Percentile) £550 £500 £500
Median % change year-on-year +10.00% - -
75th Percentile £638 £588 £600
90th Percentile £700 £663 £675
UK median daily rate £540 £500 £500
% change year-on-year +8.00% - +1.01%
Number of hourly rates quoted 164 84 243
10th Percentile £14.25 £12.63 £12.44
25th Percentile £16.00 £14.44 £14.13
Median hourly rate £20.00 £19.50 £18.75
Median % change year-on-year +2.56% +4.00% +7.14%
75th Percentile £46.50 £36.19 £28.75
90th Percentile £62.78 £51.40 £50.00
UK median hourly rate £23.00 £20.00 £20.00
% change year-on-year +15.00% - +14.29%

Hadoop YARN
Job Vacancy Trend in England

Job postings citing Hadoop YARN as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop YARN in England

Hadoop YARN
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop YARN in England.

Daily rate trend for Hadoop YARN in England

Hadoop YARN
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop YARN in England over the 6 months to 26 October 2021.

Daily rate histogram for Hadoop YARN in England

Hadoop YARN
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop YARN within the England region over the 6 months to 26 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -190 29 £575 -4.17% 4
Midlands -79 4 £406 +7.47%
East Midlands -31 3 £500 +32.28%
South West - 2 £463 -
West Midlands - 1 £313 -
Hadoop YARN
UK

For the 6 months to 26 October 2021, IT contractor jobs citing Hadoop YARN also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop YARN.

1 39 (95.12%) Hadoop
2 37 (90.24%) Apache Spark
3 31 (75.61%) Apache Hive
4 25 (60.98%) Big Data
5 24 (58.54%) SQL
6 23 (56.10%) Cloudera
6 23 (56.10%) HBase
7 22 (53.66%) HDFS
8 20 (48.78%) Java
9 18 (43.90%) Kafka
10 17 (41.46%) Scala
10 17 (41.46%) Data Modelling
11 16 (39.02%) Python
11 16 (39.02%) DevOps
12 15 (36.59%) Oozie
12 15 (36.59%) Kubernetes
13 14 (34.15%) Impala
14 13 (31.71%) Hortonworks
14 13 (31.71%) Jenkins
14 13 (31.71%) Azure
15 12 (29.27%) Git (software)
15 12 (29.27%) Continuous Integration
15 12 (29.27%) Agile Software Development
15 12 (29.27%) Apache
15 12 (29.27%) Analytics
16 10 (24.39%) Data Lake
16 10 (24.39%) Relational Database
16 10 (24.39%) AWS
17 9 (21.95%) Test Automation
17 9 (21.95%) Linux

Hadoop YARN
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 37 (90.24%) Apache Spark
2 12 (29.27%) Apache
3 6 (14.63%) Apache Airflow
4 3 (7.32%) Elasticsearch
5 1 (2.44%) Apache Pig
5 1 (2.44%) Apache Solr
5 1 (2.44%) Confluence
5 1 (2.44%) SAS
Cloud Services
1 13 (31.71%) Azure
2 10 (24.39%) AWS
3 8 (19.51%) Amazon S3
4 7 (17.07%) GitHub
5 5 (12.20%) Azure App Service
5 5 (12.20%) Azure Key Vault
5 5 (12.20%) Azure Storage
5 5 (12.20%) GCP
6 3 (7.32%) OpenShift
7 2 (4.88%) Azure Data Factory
7 2 (4.88%) Power Platform
8 1 (2.44%) Google Data Studio
8 1 (2.44%) SaaS
8 1 (2.44%) Snowflake
Communications & Networking
1 8 (19.51%) HTTP
2 5 (12.20%) Firewall
2 5 (12.20%) HTTPS
2 5 (12.20%) SSL
3 1 (2.44%) FTP
3 1 (2.44%) Kerberos
Database & Business Intelligence
1 39 (95.12%) Hadoop
2 31 (75.61%) Apache Hive
3 25 (60.98%) Big Data
4 23 (56.10%) HBase
5 14 (34.15%) Impala
6 10 (24.39%) Data Lake
6 10 (24.39%) Relational Database
7 7 (17.07%) RDBMS
7 7 (17.07%) Spark SQL
7 7 (17.07%) Sqoop
8 6 (14.63%) Oracle Database
9 5 (12.20%) Metadata
10 4 (9.76%) Data Warehouse
10 4 (9.76%) NoSQL
10 4 (9.76%) Presto
11 3 (7.32%) Metadata Repository
12 2 (4.88%) Cloudera CDH
12 2 (4.88%) Data Vault
12 2 (4.88%) KDB
12 2 (4.88%) Power BI
Development Applications
1 13 (31.71%) Jenkins
2 12 (29.27%) Git (software)
3 8 (19.51%) Maven
4 6 (14.63%) JIRA
5 5 (12.20%) IBM UrbanCode
5 5 (12.20%) Sonatype Nexus
6 4 (9.76%) Bitbucket
7 3 (7.32%) Artifactory
7 3 (7.32%) Eclipse
7 3 (7.32%) IntelliJ
7 3 (7.32%) JUnit
7 3 (7.32%) Mockito
7 3 (7.32%) TeamCity
8 1 (2.44%) ERwin
General
1 8 (19.51%) Finance
2 7 (17.07%) Analytical Skills
2 7 (17.07%) Banking
3 3 (7.32%) Publishing
4 2 (4.88%) Games
4 2 (4.88%) Marketing
5 1 (2.44%) Front Office
5 1 (2.44%) Presentation Skills
5 1 (2.44%) Social Skills
5 1 (2.44%) Telecoms
Job Titles
1 16 (39.02%) Developer
2 12 (29.27%) Data Engineer
3 6 (14.63%) Ab Initio Developer
3 6 (14.63%) Big Data Engineer
3 6 (14.63%) Scala Developer
4 5 (12.20%) Hadoop Engineer
5 4 (9.76%) Architect
5 4 (9.76%) Data Architect
6 3 (7.32%) Cloud Engineer
6 3 (7.32%) Java Developer
6 3 (7.32%) Java Engineer
7 2 (4.88%) Azure Architect
7 2 (4.88%) Azure Consultant
7 2 (4.88%) Azure DevOps Engineer
7 2 (4.88%) Azure Engineer
7 2 (4.88%) Consultant
7 2 (4.88%) DevOps Consultant
7 2 (4.88%) DevOps Engineer
7 2 (4.88%) Machine Learning Engineer
8 1 (2.44%) Data Warehouse Architect
Libraries, Frameworks & Software Standards
1 18 (43.90%) Kafka
2 7 (17.07%) RESTful
3 5 (12.20%) Spring
4 4 (9.76%) Elastic Stack
4 4 (9.76%) Web Services
5 3 (7.32%) Apache NiFi
5 3 (7.32%) WireMock
6 2 (4.88%) Pandas
6 2 (4.88%) PySpark
6 2 (4.88%) Spark Streaming
6 2 (4.88%) Spring Boot
7 1 (2.44%) Apache Avro
7 1 (2.44%) Flask
7 1 (2.44%) JDBC
7 1 (2.44%) JSON
7 1 (2.44%) Lucene
7 1 (2.44%) MLlib
7 1 (2.44%) Protocol Buffers
7 1 (2.44%) scikit-learn
7 1 (2.44%) SparkR
Miscellaneous
1 3 (7.32%) Data Centre
2 1 (2.44%) Algorithms
2 1 (2.44%) Enterprise Software
2 1 (2.44%) Equities
2 1 (2.44%) Fixed Income
2 1 (2.44%) Foreign Exchange (FX)
2 1 (2.44%) Management Information System
2 1 (2.44%) Reference Data
Operating Systems
1 9 (21.95%) Linux
2 5 (12.20%) Unix
3 1 (2.44%) Red Hat Enterprise Linux
Processes & Methodologies
1 17 (41.46%) Data Modelling
2 16 (39.02%) DevOps
3 12 (29.27%) Agile Software Development
3 12 (29.27%) Analytics
3 12 (29.27%) Continuous Integration
4 9 (21.95%) Deployment Automation
4 9 (21.95%) ETL
4 9 (21.95%) Test Automation
5 8 (19.51%) Data Management
5 8 (19.51%) Data Pipeline
6 7 (17.07%) BDD
6 7 (17.07%) Data Governance
7 6 (14.63%) ETL Development
7 6 (14.63%) Functional Programming
7 6 (14.63%) Microservices
7 6 (14.63%) Task Automation
7 6 (14.63%) Use Case
8 5 (12.20%) Data Engineering
8 5 (12.20%) Physical Data Model
8 5 (12.20%) Scrum
Programming Languages
1 24 (58.54%) SQL
2 20 (48.78%) Java
3 17 (41.46%) Scala
4 16 (39.02%) Python
5 8 (19.51%) Shell Script
6 4 (9.76%) C
7 1 (2.44%) Bash Shell
Qualifications
1 1 (2.44%) CCA
Quality Assurance & Compliance
1 3 (7.32%) Data Quality
1 3 (7.32%) Sarbanes-Oxley
2 2 (4.88%) GDPR
System Software
1 22 (53.66%) HDFS
2 7 (17.07%) Apache ZooKeeper
3 5 (12.20%) Docker
Systems Management
1 15 (36.59%) Kubernetes
1 15 (36.59%) Oozie
2 6 (14.63%) Ambari
3 3 (7.32%) Ansible
4 2 (4.88%) Terraform
5 1 (2.44%) Kibana
5 1 (2.44%) logstash
5 1 (2.44%) Nagios
5 1 (2.44%) Opsview
5 1 (2.44%) QRadar
Vendors
1 23 (56.10%) Cloudera
2 13 (31.71%) Hortonworks
3 7 (17.07%) Google
3 7 (17.07%) Oracle
4 6 (14.63%) Ab Initio
4 6 (14.63%) Teradata
5 5 (12.20%) Microsoft
6 1 (2.44%) Atlassian
6 1 (2.44%) CheckPoint
6 1 (2.44%) IBM
6 1 (2.44%) LogRhythm
6 1 (2.44%) MicroStrategy
6 1 (2.44%) Red Hat
6 1 (2.44%) StreamSets