Period
to 1 August 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 1 August 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
1 Aug 2021
Same period 2020 Same period 2019
Rank 194 178 148
Rank change year-on-year -16 -30 -24
Contract jobs citing Hadoop 816 480 1,566
As % of all contract jobs advertised in England 1.43% 1.49% 1.88%
As % of the Database & Business Intelligence category 6.62% 6.65% 8.25%
Number of daily rates quoted 483 337 1,089
10th Percentile £413 £401 £424
25th Percentile £475 £450 £480
Median daily rate (50th Percentile) £563 £550 £550
Median % change year-on-year +2.27% - -
75th Percentile £638 £650 £638
90th Percentile £716 £718 £700
UK median daily rate £563 £540 £550
% change year-on-year +4.17% -1.82% -
Number of hourly rates quoted 8 0 10
10th Percentile £17.23 " £32.50
25th Percentile £23.19 " £43.57
Median hourly rate £25.75 - £49.50
75th Percentile £33.38 " £51.72
90th Percentile £51.15 " £70.10
UK median hourly rate £26.00 - £49.86

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 12,332 7,213 18,982
As % of all contract IT jobs advertised in England 21.54% 22.34% 22.77%
Number of daily rates quoted 8,617 5,067 13,283
10th Percentile £338 £328 £325
25th Percentile £413 £413 £400
Median daily rate (50th Percentile) £520 £500 £480
Median % change year-on-year +4.00% +4.17% +1.05%
75th Percentile £625 £600 £575
90th Percentile £713 £700 £650
UK median daily rate £500 £500 £475
% change year-on-year - +5.26% +2.70%
Number of hourly rates quoted 182 106 227
10th Percentile £11.95 £13.18 £13.45
25th Percentile £19.00 £17.83 £18.00
Median hourly rate £26.25 £25.00 £30.00
Median % change year-on-year +5.00% -16.67% -
75th Percentile £49.48 £45.31 £52.40
90th Percentile £63.68 £65.44 £60.00
UK median hourly rate £27.00 £23.76 £30.00
% change year-on-year +13.64% -20.80% -

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop in England.

Daily rate trend for Hadoop in England

Hadoop
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop in England over the 6 months to 1 August 2021.

Daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Hadoop in England.

Hourly rate trend for Hadoop in England

Hadoop
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Hadoop in England over the 6 months to 1 August 2021.

Hourly rate histogram for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 1 August 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -6 494 £588 +6.82% 111
South East -7 86 £540 +8.00% 18
Midlands +6 73 £490 +12.97% 9
West Midlands +6 65 £475 +9.51% 7
North of England -79 48 £600 +14.29% 21
South West -25 23 £508 -21.92% 6
Yorkshire -20 17 £517 +8.79% 7
East of England -20 17 £575 +27.78% 2
North East - 17 £650 - 3
North West -83 15 £600 +14.29% 11
East Midlands -14 6 £530 - 2
Hadoop
UK

For the 6 months to 1 August 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 410 (50.25%) Apache Spark
2 384 (47.06%) Big Data
3 364 (44.61%) Python
4 339 (41.54%) SQL
5 315 (38.60%) AWS
6 296 (36.27%) Java
7 293 (35.91%) Apache Hive
8 266 (32.60%) Agile Software Development
9 229 (28.06%) Analytics
10 226 (27.70%) Kafka
11 211 (25.86%) Azure
12 208 (25.49%) DevOps
13 207 (25.37%) Scala
14 179 (21.94%) ETL
15 156 (19.12%) Social Skills
16 155 (19.00%) Kubernetes
17 154 (18.87%) Docker
18 152 (18.63%) Security Cleared
19 150 (18.38%) Finance
20 148 (18.14%) Cloudera
21 146 (17.89%) Jenkins
21 146 (17.89%) HDFS
22 142 (17.40%) Data Modelling
23 138 (16.91%) Scrum
24 134 (16.42%) Oracle
25 130 (15.93%) Git (software)
26 125 (15.32%) Business Intelligence
27 123 (15.07%) Data Pipeline
28 122 (14.95%) HBase
29 119 (14.58%) Terraform

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 410 (50.25%) Apache Spark
2 81 (9.93%) Apache
3 68 (8.33%) Confluence
4 59 (7.23%) Apache Airflow
5 52 (6.37%) SAS
6 48 (5.88%) Elasticsearch
7 21 (2.57%) Luigi
8 13 (1.59%) Apache Pig
9 11 (1.35%) Tomcat
10 9 (1.10%) nginx
10 9 (1.10%) WebSphere
11 7 (0.86%) JBoss
11 7 (0.86%) OpenStack
12 6 (0.74%) SharePoint
12 6 (0.74%) WebSphere Application Server
13 5 (0.61%) Apache Solr
14 4 (0.49%) Apache Pulsar
15 3 (0.37%) Jetty
16 2 (0.25%) Cloud Foundry
16 2 (0.25%) CMS
Applications
1 16 (1.96%) Spreadsheet
2 14 (1.72%) Microsoft Excel
3 5 (0.61%) SPSS
4 2 (0.25%) Microsoft Office
5 1 (0.12%) SPSS Modeler
Business Applications
1 2 (0.25%) Oracle BPM
2 1 (0.12%) Distributed Ledger
2 1 (0.12%) Oracle Cash Management
2 1 (0.12%) SAP FI-CA
2 1 (0.12%) SAP MDG
2 1 (0.12%) SAP MDM
2 1 (0.12%) SAP PSCD
Cloud Services
1 315 (38.60%) AWS
2 211 (25.86%) Azure
3 117 (14.34%) GCP
4 59 (7.23%) Serverless
5 58 (7.11%) Power Platform
6 50 (6.13%) Amazon S3
7 45 (5.51%) GitHub
8 43 (5.27%) Amazon EMR
9 37 (4.53%) Azure Cosmos DB
9 37 (4.53%) PaaS
10 34 (4.17%) Amazon EC2
11 32 (3.92%) Azure Data Factory
12 31 (3.80%) AWS Lambda
13 28 (3.43%) IaaS
14 27 (3.31%) Route 53
15 25 (3.06%) Amazon ECS
16 23 (2.82%) Azure Functions
17 22 (2.70%) Amazon EKS
18 19 (2.33%) OpenShift
19 14 (1.72%) Azure Synapse Analytics
Communications & Networking
1 16 (1.96%) Firewall
2 13 (1.59%) DNS
3 8 (0.98%) WAN
4 7 (0.86%) NAS
4 7 (0.86%) SAN
5 6 (0.74%) Cisco Nexus
5 6 (0.74%) FCoE
5 6 (0.74%) Fibre Channel
5 6 (0.74%) HTTP
5 6 (0.74%) iSCSI
5 6 (0.74%) Kerberos
5 6 (0.74%) LAN
5 6 (0.74%) Multicast
6 5 (0.61%) FTP
6 5 (0.61%) Internet
6 5 (0.61%) SSL
7 4 (0.49%) HTTPS
8 3 (0.37%) VSAN
9 2 (0.25%) Ethernet
9 2 (0.25%) VLAN
Database & Business Intelligence
1 384 (47.06%) Big Data
2 293 (35.91%) Apache Hive
3 122 (14.95%) HBase
4 119 (14.58%) Data Warehouse
5 111 (13.60%) PostgreSQL
6 107 (13.11%) Relational Database
7 94 (11.52%) NoSQL
8 89 (10.91%) Data Lake
8 89 (10.91%) MongoDB
9 77 (9.44%) MySQL
10 74 (9.07%) Impala
10 74 (9.07%) SQL Server
11 61 (7.48%) Tableau
12 58 (7.11%) Apache Cassandra
12 58 (7.11%) Power BI
13 57 (6.99%) Pentaho
14 48 (5.88%) Metadata
15 46 (5.64%) Spark SQL
16 36 (4.41%) Amazon Redshift
17 35 (4.29%) BigQuery
Development Applications
1 146 (17.89%) Jenkins
2 130 (15.93%) Git (software)
3 94 (11.52%) JIRA
4 44 (5.39%) GitLab
5 41 (5.02%) Bitbucket
6 31 (3.80%) Sonatype Nexus
7 24 (2.94%) Maven
8 21 (2.57%) Artifactory
9 15 (1.84%) TeamCity
10 12 (1.47%) Cucumber
11 11 (1.35%) Mockito
12 10 (1.23%) JUnit
12 10 (1.23%) Selenium
13 8 (0.98%) ERwin
13 8 (0.98%) IBM UrbanCode
13 8 (0.98%) Subversion
14 7 (0.86%) Gradle
15 6 (0.74%) WebDriver
16 5 (0.61%) ER Studio
16 5 (0.61%) Protractor
General
1 156 (19.12%) Social Skills
2 150 (18.38%) Finance
3 114 (13.97%) Banking
4 74 (9.07%) Analytical Skills
5 49 (6.00%) Public Sector
6 29 (3.55%) Presentation Skills
7 24 (2.94%) Investment Banking
8 21 (2.57%) Documentation Skills
9 18 (2.21%) Marketing
10 14 (1.72%) Retail
11 11 (1.35%) Front Office
11 11 (1.35%) Telecoms
12 10 (1.23%) Games
12 10 (1.23%) Legal
13 9 (1.10%) Financial Institution
14 7 (0.86%) Manufacturing
15 6 (0.74%) Electronics
16 5 (0.61%) French Language
16 5 (0.61%) Influencing Skills
16 5 (0.61%) Publishing
Job Titles
1 206 (25.25%) Data Engineer
2 172 (21.08%) Developer
3 111 (13.60%) Architect
4 63 (7.72%) DevOps Engineer
5 56 (6.86%) AWS Engineer
5 56 (6.86%) Big Data Engineer
6 51 (6.25%) Data Architect
7 40 (4.90%) Consultant
8 35 (4.29%) Java Developer
8 35 (4.29%) Scala Developer
9 34 (4.17%) Hadoop Engineer
10 33 (4.04%) Solutions Architect
11 32 (3.92%) Cloud Architect
11 32 (3.92%) Data Scientist
11 32 (3.92%) Hadoop Developer
12 29 (3.55%) AWS DevOps
13 27 (3.31%) Software Engineer
14 24 (2.94%) Analyst
15 23 (2.82%) AWS DevOps Engineer
15 23 (2.82%) Big Data Developer
Libraries, Frameworks & Software Standards
1 226 (27.70%) Kafka
2 66 (8.09%) PySpark
3 63 (7.72%) Spring
4 40 (4.90%) Spark Streaming
5 37 (4.53%) Web Services
6 35 (4.29%) JSON
7 33 (4.04%) Spring Boot
8 29 (3.55%) RESTful
9 25 (3.06%) Apache NiFi
10 20 (2.45%) Akka
10 20 (2.45%) TensorFlow
11 18 (2.21%) Apache Avro
12 16 (1.96%) .NET
13 15 (1.84%) AngularJS
13 15 (1.84%) HTML
13 15 (1.84%) REST
14 14 (1.72%) XML
15 13 (1.59%) Node.js
15 13 (1.59%) SAML
16 12 (1.47%) YAML
Miscellaneous
1 68 (8.33%) Data Structures
2 21 (2.57%) Algorithms
3 20 (2.45%) Linux Command Line
4 17 (2.08%) Data Centre
5 15 (1.84%) Management Information System
5 15 (1.84%) Public Cloud
6 14 (1.72%) Social Media
7 13 (1.59%) Data Protection Act
8 12 (1.47%) Cloud Native
8 12 (1.47%) PKI
8 12 (1.47%) Virtual Team
9 8 (0.98%) Hybrid Cloud
9 8 (0.98%) Self-Motivation
10 7 (0.86%) Analytical Mindset
10 7 (0.86%) Equities
10 7 (0.86%) iPad
11 6 (0.74%) Legacy Code
11 6 (0.74%) Legacy Systems
11 6 (0.74%) Reference Data
12 5 (0.61%) Cybercrime
Operating Systems
1 119 (14.58%) Unix
2 117 (14.34%) Linux
3 35 (4.29%) Windows
4 8 (0.98%) Ubuntu
5 7 (0.86%) CentOS
5 7 (0.86%) Solaris
6 6 (0.74%) Debian
7 5 (0.61%) VMS
8 4 (0.49%) CoreOS
9 3 (0.37%) Red Hat Enterprise Linux
10 2 (0.25%) Windows Server
11 1 (0.12%) AIX
11 1 (0.12%) MVS
11 1 (0.12%) SUSE
11 1 (0.12%) Windows 10
Processes & Methodologies
1 266 (32.60%) Agile Software Development
2 229 (28.06%) Analytics
3 208 (25.49%) DevOps
4 179 (21.94%) ETL
5 142 (17.40%) Data Modelling
6 138 (16.91%) Scrum
7 125 (15.32%) Business Intelligence
8 123 (15.07%) Data Pipeline
9 95 (11.64%) Computer Science
10 94 (11.52%) Data Engineering
10 94 (11.52%) Data Science
11 93 (11.40%) Software Engineering
12 84 (10.29%) Machine Learning
13 78 (9.56%) Data Analytics
14 77 (9.44%) Microservices
15 69 (8.46%) Migration
16 64 (7.84%) Problem-Solving
17 62 (7.60%) Open Source
17 62 (7.60%) Visualisation
18 58 (7.11%) TDD
Programming Languages
1 364 (44.61%) Python
2 339 (41.54%) SQL
3 296 (36.27%) Java
4 207 (25.37%) Scala
5 54 (6.62%) R
6 46 (5.64%) Shell Script
7 42 (5.15%) PL/SQL
8 29 (3.55%) JavaScript
9 28 (3.43%) HiveQL
10 24 (2.94%) Perl
11 23 (2.82%) Bash Shell
12 22 (2.70%) Groovy
13 19 (2.33%) C++
14 17 (2.08%) Go
15 14 (1.72%) C#
15 14 (1.72%) VBA
16 10 (1.23%) CQL
17 9 (1.10%) C
17 9 (1.10%) PowerShell
17 9 (1.10%) Ruby
Qualifications
1 152 (18.63%) Security Cleared
2 105 (12.87%) SC Cleared
3 78 (9.56%) Degree
4 41 (5.02%) Computer Science Degree
5 21 (2.57%) DV Cleared
6 12 (1.47%) BPSS Clearance
7 11 (1.35%) SAS Certification
8 7 (0.86%) PhD
9 6 (0.74%) CCA
10 4 (0.49%) Master's Degree
10 4 (0.49%) Numerate Degree
11 2 (0.25%) (ISC)2 CCSP
11 2 (0.25%) Cisco Certification
11 2 (0.25%) CISM
11 2 (0.25%) CISSP
12 1 (0.12%) CBAP
12 1 (0.12%) ISEB
12 1 (0.12%) ISTQB
12 1 (0.12%) ISTQB Foundation Certification
12 1 (0.12%) PMI Certification
Quality Assurance & Compliance
1 46 (5.64%) Data Quality
2 42 (5.15%) QA
3 11 (1.35%) SLA
4 10 (1.23%) GDPR
5 6 (0.74%) Disclosure Scotland
6 3 (0.37%) MiFID
7 2 (0.25%) COBIT
7 2 (0.25%) ISO/IEC 27001
7 2 (0.25%) NIST
7 2 (0.25%) Sarbanes-Oxley
8 1 (0.12%) Dodd-Frank
8 1 (0.12%) EMIR
8 1 (0.12%) ISO 20022
8 1 (0.12%) PMO
8 1 (0.12%) PSD2
8 1 (0.12%) TARGET2
System Software
1 154 (18.87%) Docker
2 146 (17.89%) HDFS
3 24 (2.94%) Apache ZooKeeper
4 14 (1.72%) VMware Infrastructure
5 10 (1.23%) Apache Flume
6 9 (1.10%) Active Directory
6 9 (1.10%) Oracle RAC
7 7 (0.86%) VMware NSX
8 6 (0.74%) Hyper-V
8 6 (0.74%) KVM
8 6 (0.74%) NFS
8 6 (0.74%) SRDF
8 6 (0.74%) Xen
9 3 (0.37%) vSphere
10 1 (0.12%) vCloud
10 1 (0.12%) VMware ESXi
Systems Management
1 155 (19.00%) Kubernetes
2 119 (14.58%) Terraform
3 107 (13.11%) Ansible
4 42 (5.15%) Hadoop YARN
5 40 (4.90%) Oozie
6 34 (4.17%) Puppet
7 32 (3.92%) Prometheus
8 29 (3.55%) Grafana
9 17 (2.08%) Ambari
10 16 (1.96%) Rancher
11 15 (1.84%) Control-M
12 9 (1.10%) Opscode Chef
13 6 (0.74%) Kibana
14 5 (0.61%) HAProxy
15 4 (0.49%) Active Directory Federation Services
15 4 (0.49%) Host Intrusion Detection System
15 4 (0.49%) logstash
15 4 (0.49%) Network Intrusion Detection System
16 2 (0.25%) Packer
16 2 (0.25%) vCenter Server
Vendors
1 148 (18.14%) Cloudera
2 134 (16.42%) Oracle
3 79 (9.68%) Google
4 68 (8.33%) Informatica
5 58 (7.11%) Microsoft
6 49 (6.00%) Databricks
7 46 (5.64%) Hortonworks
8 39 (4.78%) Talend
8 39 (4.78%) Teradata
9 21 (2.57%) Alteryx
10 20 (2.45%) IBM
10 20 (2.45%) Splunk
11 19 (2.33%) SAP
12 17 (2.08%) Ab Initio
13 16 (1.96%) VMware
14 15 (1.84%) StreamSets
15 14 (1.72%) Atlassian
16 13 (1.59%) Red Hat
17 12 (1.47%) Dynatrace
17 12 (1.47%) MapR