Period
to 21 October 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 21 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
21 Oct 2021
Same period 2020 Same period 2019
Rank 193 185 168
Rank change year-on-year -8 -17 -39
Contract jobs citing Hadoop 956 425 1,296
As % of all contract jobs advertised in England 1.41% 1.56% 1.67%
As % of the Database & Business Intelligence category 6.63% 6.84% 7.50%
Number of daily rates quoted 564 284 921
10th Percentile £416 £368 £425
25th Percentile £475 £432 £500
Median daily rate (50th Percentile) £563 £540 £550
Median % change year-on-year +4.17% -1.82% -
75th Percentile £673 £618 £650
90th Percentile £737 £675 £723
UK median daily rate £563 £525 £550
% change year-on-year +7.14% -4.55% +3.29%
Number of hourly rates quoted 10 2 7
10th Percentile £18.59 £21.90 £45.37
25th Percentile £24.75 £22.50 £48.28
Median hourly rate £26.00 £24.50 £49.86
Median % change year-on-year +6.12% -50.86% +7.81%
75th Percentile £44.06 £26.00 £51.15
90th Percentile £65.00 £26.30 £59.37
UK median hourly rate £26.00 £24.50 £49.93
% change year-on-year +6.12% -50.93% +5.12%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 14,425 6,217 17,269
As % of all contract IT jobs advertised in England 21.33% 22.84% 22.26%
Number of daily rates quoted 10,315 4,356 12,078
10th Percentile £350 £313 £325
25th Percentile £425 £400 £400
Median daily rate (50th Percentile) £525 £500 £480
Median % change year-on-year +5.00% +4.17% +1.05%
75th Percentile £631 £600 £575
90th Percentile £720 £675 £663
UK median daily rate £525 £495 £475
% change year-on-year +6.06% +4.21% -
Number of hourly rates quoted 190 98 230
10th Percentile £16.25 £12.63 £12.45
25th Percentile £22.56 £17.72 £17.00
Median hourly rate £34.25 £27.23 £30.00
Median % change year-on-year +25.78% -9.23% +1.69%
75th Percentile £58.52 £42.00 £49.78
90th Percentile £65.50 £55.00 £63.75
UK median hourly rate £35.00 £25.05 £30.00
% change year-on-year +39.75% -16.52% +7.66%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop in England.

Daily rate trend for Hadoop in England

Hadoop
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop in England over the 6 months to 21 October 2021.

Daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Hadoop in England.

Hourly rate trend for Hadoop in England

Hadoop
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Hadoop in England over the 6 months to 21 October 2021.

Hourly rate histogram for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 21 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -23 566 £575 +4.55% 105
South East -24 101 £525 +10.53% 25
Midlands -15 81 £500 +20.48% 31
West Midlands -13 75 £500 +16.28% 21
North of England -96 61 £513 +2.50% 13
East of England -29 31 £545 +14.74% 6
North East - 28 £608 - 3
South West -56 19 £600 -7.69% 5
Yorkshire -37 18 £505 +12.11% 1
North West -118 16 £511 +2.25% 9
East Midlands -35 6 £519 +50.00% 10
Hadoop
UK

For the 6 months to 21 October 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 520 (54.39%) Apache Spark
2 459 (48.01%) Big Data
3 414 (43.31%) SQL
4 380 (39.75%) Python
5 346 (36.19%) Apache Hive
6 345 (36.09%) AWS
7 316 (33.05%) Java
8 283 (29.60%) Kafka
9 282 (29.50%) Analytics
10 280 (29.29%) Agile Software Development
11 245 (25.63%) DevOps
12 238 (24.90%) ETL
13 233 (24.37%) Scala
14 230 (24.06%) Azure
15 195 (20.40%) HBase
16 190 (19.87%) Finance
17 189 (19.77%) Social Skills
18 188 (19.67%) Data Modelling
19 184 (19.25%) Docker
20 174 (18.20%) HDFS
21 171 (17.89%) Data Warehouse
22 161 (16.84%) Kubernetes
23 155 (16.21%) Jenkins
24 151 (15.79%) Git (software)
25 148 (15.48%) Security Cleared
26 147 (15.38%) Business Intelligence
27 145 (15.17%) Cloudera
28 140 (14.64%) Linux
29 131 (13.70%) Scrum
29 131 (13.70%) Terraform

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 520 (54.39%) Apache Spark
2 85 (8.89%) Apache
3 74 (7.74%) Elasticsearch
4 73 (7.64%) Confluence
5 66 (6.90%) SAS
6 49 (5.13%) Apache Airflow
7 27 (2.82%) Luigi
8 16 (1.67%) nginx
9 15 (1.57%) Apache Pig
9 15 (1.57%) OpenStack
10 7 (0.73%) Tomcat
11 5 (0.52%) Jupyter
12 4 (0.42%) JBoss
13 3 (0.31%) SharePoint
14 2 (0.21%) Apache Pulsar
14 2 (0.21%) CMS
14 2 (0.21%) WebSphere
14 2 (0.21%) WebSphere Application Server
15 1 (0.10%) Apache Solr
15 1 (0.10%) Mule
Applications
1 32 (3.35%) Microsoft Excel
2 17 (1.78%) Spreadsheet
3 5 (0.52%) SPSS
4 1 (0.10%) Microsoft Office
4 1 (0.10%) SPSS Modeler
Business Applications
1 2 (0.21%) Infor M3
2 1 (0.10%) Distributed Ledger
2 1 (0.10%) Oracle BPM
2 1 (0.10%) Oracle Cash Management
2 1 (0.10%) SAP FI-CA
2 1 (0.10%) SAP Oil and Gas
2 1 (0.10%) SAP PSCD
2 1 (0.10%) Workday HCM
Cloud Services
1 345 (36.09%) AWS
2 230 (24.06%) Azure
3 114 (11.92%) GCP
4 77 (8.05%) Amazon EMR
5 61 (6.38%) Serverless
6 56 (5.86%) Power Platform
7 55 (5.75%) Amazon EC2
7 55 (5.75%) Amazon S3
8 53 (5.54%) Azure Cosmos DB
9 49 (5.13%) Route 53
10 46 (4.81%) GitHub
11 43 (4.50%) Amazon EKS
12 42 (4.39%) Azure Data Factory
13 40 (4.18%) Amazon ECS
14 35 (3.66%) PaaS
15 33 (3.45%) Azure Functions
16 28 (2.93%) Snowflake
17 24 (2.51%) IaaS
18 23 (2.41%) AWS Lambda
19 17 (1.78%) Azure Synapse Analytics
Communications & Networking
1 29 (3.03%) DNS
2 15 (1.57%) Kerberos
3 14 (1.46%) Firewall
3 14 (1.46%) WAN
4 11 (1.15%) SSL
5 10 (1.05%) FTP
6 9 (0.94%) HTTP
7 7 (0.73%) Network Security
8 5 (0.52%) HTTPS
9 4 (0.42%) Internet
9 4 (0.42%) LAN
9 4 (0.42%) Multicast
9 4 (0.42%) SAN
9 4 (0.42%) VPN
10 3 (0.31%) NAS
11 2 (0.21%) Ethernet
11 2 (0.21%) FCoE
11 2 (0.21%) Fibre Channel
11 2 (0.21%) iSCSI
11 2 (0.21%) VLAN
Database & Business Intelligence
1 459 (48.01%) Big Data
2 346 (36.19%) Apache Hive
3 195 (20.40%) HBase
4 171 (17.89%) Data Warehouse
5 128 (13.39%) NoSQL
6 127 (13.28%) Data Lake
6 127 (13.28%) Relational Database
7 126 (13.18%) PostgreSQL
8 110 (11.51%) MongoDB
9 102 (10.67%) Tableau
10 93 (9.73%) MySQL
11 86 (9.00%) Apache Cassandra
12 82 (8.58%) Impala
13 69 (7.22%) SQL Server
14 66 (6.90%) Pentaho
15 57 (5.96%) Metadata
16 56 (5.86%) Power BI
17 46 (4.81%) RDBMS
18 44 (4.60%) Flink
19 42 (4.39%) Spark SQL
Development Applications
1 155 (16.21%) Jenkins
2 151 (15.79%) Git (software)
3 108 (11.30%) JIRA
4 53 (5.54%) Bitbucket
4 53 (5.54%) GitLab
5 22 (2.30%) Maven
5 22 (2.30%) Sonatype Nexus
6 21 (2.20%) Artifactory
7 17 (1.78%) ERwin
8 14 (1.46%) Mockito
9 13 (1.36%) JUnit
9 13 (1.36%) Subversion
10 12 (1.26%) TeamCity
11 11 (1.15%) ER Studio
12 8 (0.84%) WebDriver
13 6 (0.63%) Cucumber
14 5 (0.52%) IntelliJ
14 5 (0.52%) PowerDesigner
14 5 (0.52%) Selenium
14 5 (0.52%) Visual Studio
General
1 190 (19.87%) Finance
2 189 (19.77%) Social Skills
3 120 (12.55%) Banking
4 81 (8.47%) Analytical Skills
5 55 (5.75%) Public Sector
6 48 (5.02%) Presentation Skills
7 33 (3.45%) Retail
8 28 (2.93%) Investment Banking
9 25 (2.62%) Telecoms
10 22 (2.30%) Marketing
11 17 (1.78%) Legal
12 15 (1.57%) Documentation Skills
13 13 (1.36%) Financial Institution
14 10 (1.05%) Games
14 10 (1.05%) Manufacturing
15 9 (0.94%) Influencing Skills
16 7 (0.73%) Publishing
17 6 (0.63%) Law
18 5 (0.52%) Aerospace
18 5 (0.52%) Front Office
Job Titles
1 251 (26.26%) Data Engineer
2 200 (20.92%) Developer
3 118 (12.34%) Architect
4 92 (9.62%) DevOps Engineer
5 62 (6.49%) AWS Engineer
6 59 (6.17%) Data Architect
7 56 (5.86%) Big Data Engineer
8 43 (4.50%) Scala Developer
9 42 (4.39%) AWS DevOps
9 42 (4.39%) Hadoop Developer
10 40 (4.18%) AWS DevOps Engineer
11 36 (3.77%) Hadoop Engineer
12 31 (3.24%) Solutions Architect
13 30 (3.14%) Analyst
13 30 (3.14%) Data Manager
14 29 (3.03%) Consultant
15 28 (2.93%) Java Developer
16 27 (2.82%) Azure Engineer
17 26 (2.72%) Senior Developer
17 26 (2.72%) Software Engineer
Libraries, Frameworks & Software Standards
1 283 (29.60%) Kafka
2 76 (7.95%) PySpark
3 59 (6.17%) Spark Streaming
4 53 (5.54%) Spring
5 43 (4.50%) Apache NiFi
6 42 (4.39%) JSON
7 32 (3.35%) Spring Boot
8 29 (3.03%) Web Services
9 28 (2.93%) XML
10 27 (2.82%) REST
10 27 (2.82%) RESTful
11 26 (2.72%) ARM Templates
12 18 (1.88%) .NET
12 18 (1.88%) Akka
13 17 (1.78%) Apache Avro
14 16 (1.67%) JDBC
14 16 (1.67%) RabbitMQ
15 15 (1.57%) TensorFlow
16 13 (1.36%) OAuth
16 13 (1.36%) Swagger
Miscellaneous
1 59 (6.17%) Data Structures
2 41 (4.29%) Data Protection Act
3 24 (2.51%) PKI
4 22 (2.30%) Algorithms
5 19 (1.99%) Data Centre
5 19 (1.99%) Management Information System
6 16 (1.67%) Cloud Native
7 15 (1.57%) Hybrid Cloud
8 14 (1.46%) Public Cloud
9 13 (1.36%) Legacy Systems
9 13 (1.36%) Social Media
9 13 (1.36%) Virtual Team
10 12 (1.26%) Linux Command Line
10 12 (1.26%) Market Risk
11 10 (1.05%) Hedge funds
12 9 (0.94%) Reference Data
13 8 (0.84%) Derivative
13 8 (0.84%) Self-Motivation
14 6 (0.63%) Legacy Code
14 6 (0.63%) Private Cloud
Operating Systems
1 140 (14.64%) Linux
2 115 (12.03%) Unix
3 36 (3.77%) Windows
4 12 (1.26%) Debian
5 11 (1.15%) Red Hat Enterprise Linux
6 6 (0.63%) VMS
7 5 (0.52%) CoreOS
8 2 (0.21%) Solaris
8 2 (0.21%) Ubuntu
Processes & Methodologies
1 282 (29.50%) Analytics
2 280 (29.29%) Agile Software Development
3 245 (25.63%) DevOps
4 238 (24.90%) ETL
5 188 (19.67%) Data Modelling
6 147 (15.38%) Business Intelligence
7 131 (13.70%) Scrum
8 130 (13.60%) Data Pipeline
9 122 (12.76%) Data Engineering
10 104 (10.88%) Data Science
11 103 (10.77%) Data Analytics
12 102 (10.67%) Machine Learning
13 94 (9.83%) Microservices
14 92 (9.62%) Computer Science
15 85 (8.89%) Data Management
15 85 (8.89%) Software Engineering
16 82 (8.58%) Visualisation
17 80 (8.37%) Migration
18 77 (8.05%) Data Architecture
19 73 (7.64%) Open Source
Programming Languages
1 414 (43.31%) SQL
2 380 (39.75%) Python
3 316 (33.05%) Java
4 233 (24.37%) Scala
5 66 (6.90%) R
6 61 (6.38%) PL/SQL
7 56 (5.86%) Shell Script
8 41 (4.29%) HiveQL
9 35 (3.66%) Bash Shell
10 34 (3.56%) Perl
11 30 (3.14%) JavaScript
12 28 (2.93%) C++
13 24 (2.51%) Groovy
14 23 (2.41%) VBA
15 19 (1.99%) C#
16 17 (1.78%) PowerShell
17 16 (1.67%) C
18 13 (1.36%) Go
19 12 (1.26%) Java 8
20 11 (1.15%) CQL
Qualifications
1 148 (15.48%) Security Cleared
2 100 (10.46%) SC Cleared
3 89 (9.31%) Degree
4 52 (5.44%) Computer Science Degree
5 28 (2.93%) DV Cleared
6 19 (1.99%) BPSS Clearance
7 5 (0.52%) AWS Certification
7 5 (0.52%) SAS Certification
8 2 (0.21%) (ISC)2 CCSP
8 2 (0.21%) CCA
8 2 (0.21%) Cisco Certification
8 2 (0.21%) CISM
8 2 (0.21%) CISSP
8 2 (0.21%) ISTQB
8 2 (0.21%) TOGAF Certification
9 1 (0.10%) CBAP
9 1 (0.10%) DBS Check
9 1 (0.10%) ISTQB Advanced Certification
9 1 (0.10%) ISTQB Foundation Certification
9 1 (0.10%) Master's Degree
Quality Assurance & Compliance
1 64 (6.69%) Data Quality
2 42 (4.39%) QA
3 21 (2.20%) GDPR
4 6 (0.63%) Disclosure Scotland
5 5 (0.52%) MiFID
5 5 (0.52%) Sarbanes-Oxley
5 5 (0.52%) SLA
6 2 (0.21%) COBIT
6 2 (0.21%) ISO/IEC 27001
6 2 (0.21%) NIST
7 1 (0.10%) Dodd-Frank
7 1 (0.10%) EMIR
7 1 (0.10%) ISO 20022
7 1 (0.10%) NCSC
7 1 (0.10%) PSD2
7 1 (0.10%) TARGET2
System Software
1 184 (19.25%) Docker
2 174 (18.20%) HDFS
3 39 (4.08%) Apache ZooKeeper
4 11 (1.15%) Apache Flume
5 10 (1.05%) VMware Infrastructure
6 9 (0.94%) Active Directory
7 6 (0.63%) Oracle RAC
7 6 (0.63%) vCloud
7 6 (0.63%) VMware NSX
8 3 (0.31%) Active Directory Lightweight Directory Services
8 3 (0.31%) Hyper-V
9 2 (0.21%) KVM
9 2 (0.21%) NFS
9 2 (0.21%) SRDF
9 2 (0.21%) Virtual Machines
9 2 (0.21%) vSphere
9 2 (0.21%) Xen
10 1 (0.10%) VMware ESXi
Systems Management
1 161 (16.84%) Kubernetes
2 131 (13.70%) Terraform
3 100 (10.46%) Ansible
4 61 (6.38%) Prometheus
5 42 (4.39%) Oozie
6 39 (4.08%) Hadoop YARN
7 32 (3.35%) Puppet
8 31 (3.24%) Grafana
9 16 (1.67%) Rancher
10 13 (1.36%) Control-M
11 12 (1.26%) Kibana
12 11 (1.15%) Ambari
12 11 (1.15%) HAProxy
13 8 (0.84%) Consul
14 7 (0.73%) Opscode Chef
15 6 (0.63%) Fluentd
15 6 (0.63%) ZABBIX
16 5 (0.52%) Host Intrusion Detection System
16 5 (0.52%) Network Intrusion Detection System
17 4 (0.42%) logstash
Vendors
1 145 (15.17%) Cloudera
2 128 (13.39%) Oracle
3 100 (10.46%) Informatica
4 74 (7.74%) Google
5 73 (7.64%) Databricks
6 61 (6.38%) Microsoft
7 59 (6.17%) Hortonworks
8 44 (4.60%) Talend
9 43 (4.50%) Splunk
10 40 (4.18%) Teradata
11 38 (3.97%) Ab Initio
12 23 (2.41%) Alteryx
12 23 (2.41%) Red Hat
12 23 (2.41%) SAP
13 17 (1.78%) MapR
13 17 (1.78%) VMware
14 16 (1.67%) Adobe
14 16 (1.67%) Atlassian
15 15 (1.57%) MicroStrategy
16 13 (1.36%) Salesforce.com