Period
to 12 May 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 12 May 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
12 May 2021
Same period 2020 Same period 2019
Rank 187 183 125
Rank change year-on-year -4 -58 -7
Contract jobs citing Hadoop 625 649 1,760
As % of all contract jobs advertised in England 1.40% 1.42% 2.09%
As % of the Database & Business Intelligence category 6.66% 6.57% 9.19%
Number of daily rates quoted 371 464 1,219
10th Percentile £400 £409 £413
25th Percentile £473 £463 £488
Median daily rate (50th Percentile) £550 £550 £550
75th Percentile £625 £650 £638
90th Percentile £675 £721 £725
UK median daily rate £550 £550 £550
Number of hourly rates quoted 3 0 8
10th Percentile £16.60 " £32.50
25th Percentile £20.13 " £44.97
Median hourly rate £27.00 - £49.57
75th Percentile £41.50 " £60.63
90th Percentile £49.60 " £70.30
UK median hourly rate £27.00 - £50.00

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 9,381 9,874 19,141
As % of all contract IT jobs advertised in England 20.99% 21.55% 22.73%
Number of daily rates quoted 6,493 6,847 13,448
10th Percentile £325 £325 £325
25th Percentile £410 £400 £400
Median daily rate (50th Percentile) £500 £495 £488
Median % change year-on-year +1.01% +1.54% +2.63%
75th Percentile £600 £588 £575
90th Percentile £688 £675 £650
UK median daily rate £500 £475 £475
% change year-on-year +5.26% - +2.15%
Number of hourly rates quoted 165 146 208
10th Percentile £11.40 £13.75 £14.00
25th Percentile £18.50 £17.87 £17.91
Median hourly rate £24.64 £24.70 £31.25
Median % change year-on-year -0.24% -20.96% +4.17%
75th Percentile £49.41 £46.00 £47.50
90th Percentile £63.05 £61.13 £57.50
UK median hourly rate £26.50 £24.70 £30.00
% change year-on-year +7.29% -17.67% -

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop in England.

Daily rate trend for Hadoop in England

Hadoop
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop in England over the 6 months to 12 May 2021.

Daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Hadoop in England.

Hourly rate trend for Hadoop in England

Hadoop
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Hadoop in England over the 6 months to 12 May 2021.

Hourly rate histogram for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 12 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -21 372 £578 +5.00% 99
South East +43 75 £500 +1.52% 14
Midlands +26 52 £495 +11.11% 14
West Midlands +30 49 £491 +9.00% 10
North of England -19 32 £555 -8.26% 13
South West +20 30 £508 -9.42% 4
North West -24 18 £588 -9.62% 11
Yorkshire +16 14 £555 +16.84% 2
East of England +10 10 £550 +24.29% 10
East Midlands +13 1 £600 +71.43% 4
Hadoop
UK

For the 6 months to 12 May 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 346 (55.36%) Apache Spark
2 296 (47.36%) Big Data
3 255 (40.80%) Python
4 242 (38.72%) Java
5 239 (38.24%) SQL
6 231 (36.96%) Apache Hive
7 219 (35.04%) Agile Software Development
8 211 (33.76%) AWS
9 193 (30.88%) Scala
10 158 (25.28%) Kafka
11 147 (23.52%) DevOps
12 142 (22.72%) Analytics
13 134 (21.44%) Azure
14 131 (20.96%) Social Skills
15 130 (20.80%) ETL
16 128 (20.48%) Security Cleared
17 125 (20.00%) HDFS
18 124 (19.84%) Finance
19 123 (19.68%) Cloudera
20 113 (18.08%) SC Cleared
21 109 (17.44%) Scrum
22 105 (16.80%) Apache
23 102 (16.32%) Jenkins
24 101 (16.16%) Oracle
25 98 (15.68%) Ansible
26 95 (15.20%) Business Intelligence
27 92 (14.72%) Data Warehouse
28 90 (14.40%) Data Modelling
28 90 (14.40%) Linux
28 90 (14.40%) HBase

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 346 (55.36%) Apache Spark
2 105 (16.80%) Apache
3 54 (8.64%) Confluence
4 46 (7.36%) Apache Airflow
5 27 (4.32%) SAS
6 25 (4.00%) Elasticsearch
7 10 (1.60%) Apache Pig
8 8 (1.28%) Tomcat
9 7 (1.12%) WebSphere
10 5 (0.80%) Apache Solr
10 5 (0.80%) Luigi
11 4 (0.64%) Apache Pulsar
11 4 (0.64%) SharePoint
11 4 (0.64%) WebSphere Application Server
12 3 (0.48%) JBoss
12 3 (0.48%) Jetty
12 3 (0.48%) OpenStack
13 2 (0.32%) Camunda
13 2 (0.32%) CMS
14 1 (0.16%) Oracle Workflow
Applications
1 18 (2.88%) Spreadsheet
2 4 (0.64%) Microsoft Excel
2 4 (0.64%) Microsoft Office
3 3 (0.48%) SPSS
4 2 (0.32%) MS Visio
5 1 (0.16%) Microsoft PowerPoint
5 1 (0.16%) Stata
Business Applications
1 1 (0.16%) Oracle BPM
1 1 (0.16%) SAP CRM
1 1 (0.16%) SAP ERP
1 1 (0.16%) SAP IS-U
1 1 (0.16%) SAP MDG
1 1 (0.16%) SAP MDM
1 1 (0.16%) Traffica
Cloud Services
1 211 (33.76%) AWS
2 134 (21.44%) Azure
3 86 (13.76%) GCP
4 56 (8.96%) Amazon S3
5 51 (8.16%) Power Platform
6 33 (5.28%) Serverless
7 31 (4.96%) GitHub
8 27 (4.32%) Amazon EMR
9 26 (4.16%) AWS Lambda
10 24 (3.84%) Amazon EC2
10 24 (3.84%) PaaS
11 18 (2.88%) IaaS
12 14 (2.24%) OpenShift
13 13 (2.08%) Azure Data Factory
14 11 (1.76%) Azure Cosmos DB
15 9 (1.44%) Amazon CloudWatch
15 9 (1.44%) Amazon ECS
15 9 (1.44%) Route 53
16 8 (1.28%) Google Data Studio
17 7 (1.12%) Amazon EKS
Communications & Networking
1 11 (1.76%) Firewall
2 9 (1.44%) WAN
3 8 (1.28%) VSAN
4 5 (0.80%) DNS
4 5 (0.80%) Ethernet
4 5 (0.80%) Kerberos
4 5 (0.80%) VLAN
5 4 (0.64%) Cisco Nexus
5 4 (0.64%) FCoE
5 4 (0.64%) Fibre Channel
5 4 (0.64%) iSCSI
5 4 (0.64%) LAN
5 4 (0.64%) Multicast
5 4 (0.64%) NAS
5 4 (0.64%) Network Security
5 4 (0.64%) SAN
6 3 (0.48%) Remote Desktop
7 2 (0.32%) FTP
7 2 (0.32%) Internet
7 2 (0.32%) SMTP
Database & Business Intelligence
1 296 (47.36%) Big Data
2 231 (36.96%) Apache Hive
3 92 (14.72%) Data Warehouse
4 90 (14.40%) HBase
5 81 (12.96%) Relational Database
6 78 (12.48%) Impala
7 77 (12.32%) Data Lake
8 75 (12.00%) NoSQL
9 64 (10.24%) PostgreSQL
10 62 (9.92%) MongoDB
10 62 (9.92%) SQL Server
11 56 (8.96%) MySQL
12 51 (8.16%) Power BI
13 45 (7.20%) Pentaho
14 44 (7.04%) Amazon Redshift
14 44 (7.04%) Tableau
15 35 (5.60%) Apache Cassandra
16 33 (5.28%) Spark SQL
17 31 (4.96%) BigQuery
18 27 (4.32%) Amazon RDS
Development Applications
1 102 (16.32%) Jenkins
2 86 (13.76%) Git (software)
3 54 (8.64%) JIRA
4 35 (5.60%) Sonatype Nexus
5 25 (4.00%) Maven
6 20 (3.20%) GitLab
7 18 (2.88%) Bitbucket
8 15 (2.40%) TeamCity
9 14 (2.24%) IBM UrbanCode
10 13 (2.08%) Gradle
11 11 (1.76%) RStudio
12 9 (1.44%) Artifactory
13 8 (1.28%) Cucumber
14 7 (1.12%) Selenium
15 5 (0.80%) IntelliJ
15 5 (0.80%) Protractor
15 5 (0.80%) SonarQube
16 4 (0.64%) ERwin
16 4 (0.64%) ProC
17 3 (0.48%) Subversion
General
1 131 (20.96%) Social Skills
2 124 (19.84%) Finance
3 87 (13.92%) Banking
4 80 (12.80%) Analytical Skills
5 39 (6.24%) Investment Banking
6 35 (5.60%) Public Sector
7 27 (4.32%) Front Office
8 23 (3.68%) Presentation Skills
9 21 (3.36%) Documentation Skills
10 17 (2.72%) Marketing
11 9 (1.44%) Games
12 7 (1.12%) Influencing Skills
12 7 (1.12%) Retail
13 6 (0.96%) Legal
13 6 (0.96%) Manufacturing
13 6 (0.96%) Telecoms
14 5 (0.80%) French Language
14 5 (0.80%) Organisational Skills
15 4 (0.64%) Automotive
15 4 (0.64%) Financial Institution
Job Titles
1 156 (24.96%) Data Engineer
2 153 (24.48%) Developer
3 90 (14.40%) Architect
4 54 (8.64%) Big Data Engineer
5 43 (6.88%) Data Architect
6 41 (6.56%) Scala Developer
7 40 (6.40%) Java Developer
8 36 (5.76%) AWS Engineer
9 35 (5.60%) Hadoop Developer
10 31 (4.96%) Consultant
11 30 (4.80%) Apache Spark Developer
12 28 (4.48%) DevOps Engineer
12 28 (4.48%) Solutions Architect
13 26 (4.16%) Analyst
14 25 (4.00%) Data Scientist
14 25 (4.00%) Scala Engineer
15 23 (3.68%) Big Data Developer
16 21 (3.36%) Cloud Architect
16 21 (3.36%) Cloud Engineer
16 21 (3.36%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 158 (25.28%) Kafka
2 45 (7.20%) PySpark
3 42 (6.72%) Spring
4 27 (4.32%) Apache NiFi
5 26 (4.16%) Web Services
6 24 (3.84%) RESTful
7 22 (3.52%) JSON
7 22 (3.52%) Spark Streaming
8 17 (2.72%) TensorFlow
9 16 (2.56%) Spring Boot
10 15 (2.40%) XML
11 13 (2.08%) Node.js
12 12 (1.92%) AngularJS
12 12 (1.92%) RabbitMQ
13 11 (1.76%) Pandas
14 9 (1.44%) .NET
14 9 (1.44%) Apache Avro
14 9 (1.44%) PyTorch
15 8 (1.28%) HTML
15 8 (1.28%) SOAP
Miscellaneous
1 34 (5.44%) Data Structures
2 24 (3.84%) Linux Command Line
3 19 (3.04%) Algorithms
4 10 (1.60%) Equities
5 9 (1.44%) Analytical Mindset
5 9 (1.44%) Cloud Native
6 8 (1.28%) Self-Motivation
6 8 (1.28%) Virtual Team
7 7 (1.12%) Cybercrime
7 7 (1.12%) iPad
7 7 (1.12%) Management Information System
7 7 (1.12%) Social Media
8 6 (0.96%) VSAM
9 5 (0.80%) Data Centre
10 4 (0.64%) Clustering
10 4 (0.64%) Enterprise Software
10 4 (0.64%) Mobile Banking
10 4 (0.64%) Private Cloud
10 4 (0.64%) Public Cloud
10 4 (0.64%) Replication
Operating Systems
1 90 (14.40%) Linux
2 73 (11.68%) Unix
3 26 (4.16%) Windows
4 12 (1.92%) CentOS
5 11 (1.76%) Ubuntu
6 5 (0.80%) Solaris
7 3 (0.48%) Windows 10
7 3 (0.48%) Windows Server
8 2 (0.32%) AIX
8 2 (0.32%) Debian
8 2 (0.32%) Red Hat Enterprise Linux
8 2 (0.32%) SUSE
8 2 (0.32%) VMS
9 1 (0.16%) MVS
9 1 (0.16%) VME
Processes & Methodologies
1 219 (35.04%) Agile Software Development
2 147 (23.52%) DevOps
3 142 (22.72%) Analytics
4 130 (20.80%) ETL
5 109 (17.44%) Scrum
6 95 (15.20%) Business Intelligence
7 90 (14.40%) Data Modelling
7 90 (14.40%) Data Science
8 87 (13.92%) Data Pipeline
9 82 (13.12%) Computer Science
10 78 (12.48%) Data Engineering
11 76 (12.16%) TDD
12 66 (10.56%) Problem-Solving
13 65 (10.40%) BDD
14 63 (10.08%) Machine Learning
15 60 (9.60%) Software Engineering
16 58 (9.28%) Migration
17 54 (8.64%) Microservices
18 50 (8.00%) Visualisation
19 49 (7.84%) Mathematics
Programming Languages
1 255 (40.80%) Python
2 242 (38.72%) Java
3 239 (38.24%) SQL
4 193 (30.88%) Scala
5 37 (5.92%) R
6 32 (5.12%) Shell Script
7 24 (3.84%) JavaScript
8 17 (2.72%) C++
9 16 (2.56%) PL/SQL
10 13 (2.08%) C#
10 13 (2.08%) Go
11 10 (1.60%) Haskell
12 9 (1.44%) Elm
13 8 (1.28%) Bash Shell
14 7 (1.12%) HiveQL
15 6 (0.96%) C
15 6 (0.96%) Groovy
16 5 (0.80%) Ruby
17 4 (0.64%) Data Analysis Expressions (DAX)
17 4 (0.64%) Perl
Qualifications
1 128 (20.48%) Security Cleared
2 113 (18.08%) SC Cleared
3 71 (11.36%) Degree
4 23 (3.68%) Numerate Degree
5 18 (2.88%) Computer Science Degree
6 16 (2.56%) DV Cleared
7 8 (1.28%) AWS Certification
8 7 (1.12%) PhD
8 7 (1.12%) SAS Certification
9 6 (0.96%) Master's Degree
10 4 (0.64%) BPSS Clearance
10 4 (0.64%) CCA
11 1 (0.16%) TOGAF Certification
Quality Assurance & Compliance
1 33 (5.28%) QA
2 19 (3.04%) Data Quality
3 12 (1.92%) SLA
4 8 (1.28%) GDPR
5 2 (0.32%) Disclosure Scotland
6 1 (0.16%) ISO 20022
6 1 (0.16%) PCI DSS
6 1 (0.16%) PMO
6 1 (0.16%) SEPA
6 1 (0.16%) TARGET2
System Software
1 125 (20.00%) HDFS
2 81 (12.96%) Docker
3 17 (2.72%) Apache Flume
4 15 (2.40%) Apache ZooKeeper
5 12 (1.92%) Active Directory
6 8 (1.28%) VMware NSX
6 8 (1.28%) vSphere
7 7 (1.12%) VMware Infrastructure
8 5 (0.80%) Oracle RAC
9 4 (0.64%) Hyper-V
9 4 (0.64%) KVM
9 4 (0.64%) NFS
9 4 (0.64%) SRDF
9 4 (0.64%) Xen
10 3 (0.48%) VMware ESXi
11 2 (0.32%) Terminal Services
12 1 (0.16%) Virtual Machines
Systems Management
1 98 (15.68%) Ansible
2 89 (14.24%) Kubernetes
3 53 (8.48%) Terraform
4 39 (6.24%) Oozie
5 38 (6.08%) Hadoop YARN
6 20 (3.20%) Grafana
7 18 (2.88%) Puppet
8 13 (2.08%) Prometheus
9 10 (1.60%) Control-M
10 8 (1.28%) Ambari
10 8 (1.28%) Rancher
11 6 (0.96%) Opscode Chef
12 5 (0.80%) Microsoft Intune
12 5 (0.80%) vCenter Server
13 4 (0.64%) Consul
13 4 (0.64%) FreeIPA
14 3 (0.48%) Kibana
14 3 (0.48%) logstash
15 2 (0.32%) Packer
15 2 (0.32%) Red Hat Satellite
Vendors
1 123 (19.68%) Cloudera
2 101 (16.16%) Oracle
3 51 (8.16%) Google
4 49 (7.84%) Microsoft
5 35 (5.60%) Hortonworks
6 31 (4.96%) Talend
7 24 (3.84%) Teradata
8 19 (3.04%) Informatica
9 16 (2.56%) StreamSets
10 15 (2.40%) IBM
11 14 (2.24%) Databricks
12 11 (1.76%) Alteryx
12 11 (1.76%) MapR
13 10 (1.60%) Red Hat
13 10 (1.60%) SAP
14 9 (1.44%) Ab Initio
14 9 (1.44%) Cisco
14 9 (1.44%) EMC
15 8 (1.28%) VMware
16 7 (1.12%) Salesforce.com