Period
to 22 January 2021

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 22 January 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK
6 months to
22 Jan 2021
Same period 2020 Same period 2019
Rank 190 188 130
Rank change year-on-year -2 -58 -5
Contract jobs citing Hadoop 582 1,039 2,059
As % of all contract jobs advertised in the UK 1.38% 1.43% 2.07%
As % of the Database & Business Intelligence category 6.41% 6.74% 9.12%
Number of daily rates quoted 485 742 1,373
Median daily rate £525 £550 £550
Median daily rate % change year-on-year -4.55% - -
10th Percentile £359 £413 £413
90th Percentile £650 £715 £713
UK excluding London median daily rate £450 £525 £525
% change year-on-year -14.29% - +7.69%
Number of hourly rates quoted 4 0 2
Median hourly rate £33.00 - £50.00
10th Percentile £22.70 - £43.50
90th Percentile £40.00 - £56.50
UK excluding London median hourly rate £24.50 - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 9,086 15,425 22,586
As % of all contract IT jobs advertised in the UK 21.57% 21.22% 22.66%
Number of daily rates quoted 6,196 10,513 15,746
Median daily rate £480 £475 £475
Median daily rate % change year-on-year +1.05% - +5.32%
10th Percentile £313 £319 £317
90th Percentile £650 £663 £644
UK excluding London median daily rate £425 £438 £425
% change year-on-year -2.86% +2.94% +6.25%
Number of hourly rates quoted 162 210 226
Median hourly rate £26.00 £25.25 £26.65
Median hourly rate % change year-on-year +2.97% -5.25% -9.66%
10th Percentile £13.99 £12.00 £13.13
90th Percentile £59.88 £55.70 £55.00
Median hourly rate £23.47 £22.50 £26.05
% change year-on-year +4.31% -13.64% -19.22%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop.

Daily rate trend for Hadoop in the UK

Hadoop
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop over the 6 months to 22 January 2021.

Daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Hadoop.

Hourly rate trend for Hadoop in the UK

Hadoop
Hourly Rate Histogram

Hourly rate distribution of jobs citing Hadoop over the 6 months to 22 January 2021.

Hourly rate histogram for Hadoop in the UK

Hadoop
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 22 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -2 474 £533 -3.18% 157
London -22 275 £563 -2.17% 83
UK excluding London +29 206 £450 -14.29% 85
Work from Home -80 154 £540 +8.00% 37
North of England +50 78 £475 -13.64% 24
North West +44 61 £450 -18.18% 11
South East +53 50 £475 -2.56% 12
Midlands +62 33 £425 -12.82% 18
West Midlands +56 27 £432 -17.71% 12
Scotland +1 21 £400 -23.81% 9
Yorkshire +26 17 £525 +5.00% 13
South West +56 10 £475 -13.64% 10
Wales +26 9 £538 +7.50% 5
East Midlands +27 6 £346 -27.16% 6
East of England +22 6 £563 -6.25% 7
Northern Ireland - 2 £450 -

For the 6 months to 22 January 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Hadoop.

1 340 (58.42%) Apache Spark
2 287 (49.31%) Big Data
3 266 (45.70%) Python
4 240 (41.24%) Apache Hive
5 214 (36.77%) SQL
6 212 (36.43%) Java
7 184 (31.62%) AWS
8 181 (31.10%) Scala
9 165 (28.35%) Agile Software Development
10 164 (28.18%) DevOps
11 160 (27.49%) Security Cleared
12 158 (27.15%) HDFS
13 149 (25.60%) SC Cleared
14 144 (24.74%) Cloudera
15 143 (24.57%) Kafka
15 143 (24.57%) ETL
16 140 (24.05%) Azure
17 134 (23.02%) Jenkins
18 122 (20.96%) Ansible
19 118 (20.27%) Impala
19 118 (20.27%) Oracle
20 115 (19.76%) Git (software)
21 113 (19.42%) Analytics
22 110 (18.90%) Apache
23 94 (16.15%) Finance
24 90 (15.46%) Relational Database
25 87 (14.95%) Kubernetes
26 86 (14.78%) Linux
27 82 (14.09%) Docker
28 79 (13.57%) Data Science

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 340 (58.42%) Apache Spark
2 110 (18.90%) Apache
3 55 (9.45%) Confluence
4 35 (6.01%) Elasticsearch
5 23 (3.95%) SAS
6 22 (3.78%) Apache Airflow
7 20 (3.44%) Apache Pig
8 15 (2.58%) WebLogic
9 13 (2.23%) Mule
10 9 (1.55%) Tomcat
11 8 (1.37%) JBoss
11 8 (1.37%) Jetty
11 8 (1.37%) MQSeries
11 8 (1.37%) Oracle Self-Service HR
11 8 (1.37%) Red Hat Fuse
12 7 (1.20%) Jupyter
13 6 (1.03%) Cloud Foundry
14 3 (0.52%) Luigi
15 2 (0.34%) Apache Pulsar
15 2 (0.34%) Apache Synapse
Applications
1 39 (6.70%) Spreadsheet
2 15 (2.58%) Microsoft Excel
3 7 (1.20%) Stata
4 5 (0.86%) MS Visio
5 2 (0.34%) Chatbot
5 2 (0.34%) Microsoft Office
5 2 (0.34%) SPSS
6 1 (0.17%) Microsoft PowerPoint
Business Applications
1 8 (1.37%) Sparx Enterprise Architect
2 7 (1.20%) SAP FI-CA
3 2 (0.34%) Oracle BPM
4 1 (0.17%) SAP CRM
4 1 (0.17%) SAP ERP
4 1 (0.17%) SAP IS-U
4 1 (0.17%) Temenos T24
Cloud Services
1 184 (31.62%) AWS
2 140 (24.05%) Azure
3 75 (12.89%) Amazon S3
4 44 (7.56%) GCP
5 35 (6.01%) Amazon EMR
6 22 (3.78%) Serverless
7 18 (3.09%) Amazon EC2
7 18 (3.09%) GitHub
8 16 (2.75%) AWS Lambda
8 16 (2.75%) Power Platform
9 12 (2.06%) Azure Data Factory
10 11 (1.89%) PaaS
10 11 (1.89%) Virtual Private Cloud
11 9 (1.55%) Office 365
12 8 (1.37%) Amazon Kinesis
12 8 (1.37%) Azure Active Directory
12 8 (1.37%) IaaS
13 7 (1.20%) AWS Step Functions
14 6 (1.03%) Amazon EKS
14 6 (1.03%) AWS CloudFormation
Communications & Networking
1 14 (2.41%) SSL
2 9 (1.55%) Firewall
2 9 (1.55%) VSAN
3 8 (1.37%) Ethernet
3 8 (1.37%) Kerberos
3 8 (1.37%) SSH
3 8 (1.37%) VLAN
3 8 (1.37%) WAN
4 4 (0.69%) VPN
5 3 (0.52%) Network Security
6 2 (0.34%) DNS
6 2 (0.34%) Remote Desktop
6 2 (0.34%) SMTP
7 1 (0.17%) Internet
7 1 (0.17%) Software-Defined Networking
Database & Business Intelligence
1 287 (49.31%) Big Data
2 240 (41.24%) Apache Hive
3 118 (20.27%) Impala
4 90 (15.46%) Relational Database
5 79 (13.57%) NoSQL
6 77 (13.23%) MySQL
7 74 (12.71%) HBase
8 59 (10.14%) Data Warehouse
9 52 (8.93%) Data Lake
10 51 (8.76%) MongoDB
11 48 (8.25%) Pentaho
12 45 (7.73%) PostgreSQL
13 40 (6.87%) SQL Server
14 31 (5.33%) Apache Cassandra
15 29 (4.98%) Tableau
16 25 (4.30%) Spark SQL
17 24 (4.12%) Amazon Redshift
18 22 (3.78%) Amazon RDS
19 18 (3.09%) Amazon DynamoDB
19 18 (3.09%) Oracle Database
Development Applications
1 134 (23.02%) Jenkins
2 115 (19.76%) Git (software)
3 58 (9.97%) JIRA
4 34 (5.84%) Selenium
5 29 (4.98%) Sonatype Nexus
6 28 (4.81%) Maven
7 23 (3.95%) Cucumber
8 20 (3.44%) GitLab
9 17 (2.92%) TeamCity
10 13 (2.23%) Atlassian Bamboo
10 13 (2.23%) Gradle
10 13 (2.23%) RStudio
11 12 (2.06%) IntelliJ
12 11 (1.89%) IBM UrbanCode
13 9 (1.55%) Hudson
13 9 (1.55%) Vagrant
14 8 (1.37%) FishEye
14 8 (1.37%) Leiningen
14 8 (1.37%) Mercurial
14 8 (1.37%) Poseidon for UML
General
1 94 (16.15%) Finance
2 73 (12.54%) Banking
3 43 (7.39%) Public Sector
4 36 (6.19%) Investment Banking
5 33 (5.67%) Front Office
6 11 (1.89%) Retail
7 8 (1.37%) Manufacturing
7 8 (1.37%) Marketing
8 6 (1.03%) Retail Banking
9 5 (0.86%) Aerospace
9 5 (0.86%) Games
9 5 (0.86%) Legal
10 4 (0.69%) Financial Institution
11 3 (0.52%) Law
11 3 (0.52%) Telecoms
12 2 (0.34%) Automotive
12 2 (0.34%) Electronics
12 2 (0.34%) Military
12 2 (0.34%) Pharmaceutical
12 2 (0.34%) Publishing
Job Titles
1 169 (29.04%) Developer
2 145 (24.91%) Data Engineer
3 75 (12.89%) Architect
4 46 (7.90%) Java Developer
5 40 (6.87%) Scala Developer
6 36 (6.19%) Big Data Engineer
7 33 (5.67%) DevOps Engineer
8 29 (4.98%) AWS Engineer
8 29 (4.98%) Azure Engineer
8 29 (4.98%) Cloud Engineer
9 28 (4.81%) Data Architect
9 28 (4.81%) Solutions Architect
10 27 (4.64%) Hadoop Developer
11 26 (4.47%) Analyst
12 24 (4.12%) Administrator
12 24 (4.12%) Apache Spark Developer
13 22 (3.78%) Big Data Developer
14 20 (3.44%) Cloud Administrator
15 19 (3.26%) Hadoop Engineer
16 17 (2.92%) DevOps Administrator
Libraries, Frameworks & Software Standards
1 143 (24.57%) Kafka
2 47 (8.08%) PySpark
3 42 (7.22%) JSON
4 40 (6.87%) Spring
5 35 (6.01%) XML
6 26 (4.47%) RabbitMQ
7 23 (3.95%) Spark Streaming
8 20 (3.44%) Apache NiFi
8 20 (3.44%) Web Services
9 17 (2.92%) Node.js
10 16 (2.75%) REST
10 16 (2.75%) Spring Boot
11 15 (2.58%) React
12 14 (2.41%) SOAP
13 11 (1.89%) Apache Camel
14 10 (1.72%) ActiveMQ
15 9 (1.55%) .NET
15 9 (1.55%) AngularJS
15 9 (1.55%) HTML
16 8 (1.37%) Play Framework
Miscellaneous
1 60 (10.31%) Analytical Skills
2 17 (2.92%) Algorithms
3 13 (2.23%) Greenfield Project
4 12 (2.06%) Data Structures
4 12 (2.06%) Public Cloud
4 12 (2.06%) User Experience
5 11 (1.89%) Linux Command Line
6 9 (1.55%) Cloud Native
6 9 (1.55%) Self-Motivation
7 8 (1.37%) Derivative
8 7 (1.20%) Analytical Mindset
8 7 (1.20%) Credit Risk
8 7 (1.20%) Virtual Team
9 6 (1.03%) VSAM
10 5 (0.86%) Data Centre
10 5 (0.86%) Equities
10 5 (0.86%) Management Information System
11 4 (0.69%) Cybercrime
11 4 (0.69%) FMCG
11 4 (0.69%) Market Risk
Operating Systems
1 86 (14.78%) Linux
2 35 (6.01%) Windows
3 33 (5.67%) Unix
4 18 (3.09%) CentOS
5 16 (2.75%) Ubuntu
6 11 (1.89%) Red Hat Enterprise Linux
7 8 (1.37%) Android
7 8 (1.37%) Apple iOS
7 8 (1.37%) Debian
7 8 (1.37%) Mac OS X
8 2 (0.34%) VME
9 1 (0.17%) AIX
9 1 (0.17%) SUSE
9 1 (0.17%) Windows 10
9 1 (0.17%) Windows Server
Processes & Methodologies
1 165 (28.35%) Agile Software Development
2 164 (28.18%) DevOps
3 143 (24.57%) ETL
4 113 (19.42%) Analytics
5 79 (13.57%) Data Science
6 76 (13.06%) Scrum
7 73 (12.54%) TDD
8 69 (11.86%) Data Engineering
9 67 (11.51%) Data Modelling
10 64 (11.00%) Problem-Solving
11 63 (10.82%) Data Integration
12 60 (10.31%) Microservices
13 58 (9.97%) Machine Learning
14 57 (9.79%) Business Intelligence
15 56 (9.62%) Computer Science
16 52 (8.93%) Configuration Management
16 52 (8.93%) Data Ingestion
17 51 (8.76%) Test Automation
18 50 (8.59%) BDD
19 48 (8.25%) Continuous Integration
Programming Languages
1 266 (45.70%) Python
2 214 (36.77%) SQL
3 212 (36.43%) Java
4 181 (31.10%) Scala
5 48 (8.25%) R
6 38 (6.53%) Bash Shell
6 38 (6.53%) Shell Script
7 28 (4.81%) JavaScript
8 24 (4.12%) PL/SQL
9 23 (3.95%) C#
10 21 (3.61%) Perl
11 17 (2.92%) PowerShell
12 15 (2.58%) Groovy
13 13 (2.23%) C++
13 13 (2.23%) T-SQL
14 11 (1.89%) Kotlin
15 9 (1.55%) VBA
16 8 (1.37%) Clojure
16 8 (1.37%) ClojureScript
16 8 (1.37%) Ruby
Qualifications
1 160 (27.49%) Security Cleared
2 149 (25.60%) SC Cleared
3 59 (10.14%) Degree
4 26 (4.47%) Numerate Degree
5 16 (2.75%) AWS Certification
5 16 (2.75%) Computer Science Degree
6 14 (2.41%) TOGAF Certification
7 10 (1.72%) Master's Degree
8 9 (1.55%) DV Cleared
9 8 (1.37%) CCA
10 5 (0.86%) BPSS Clearance
11 4 (0.69%) PhD
12 2 (0.34%) ISEB
12 2 (0.34%) ISTQB
12 2 (0.34%) ISTQB Foundation Certification
Quality Assurance & Compliance
1 16 (2.75%) Data Quality
2 15 (2.58%) QA
3 10 (1.72%) SLA
4 6 (1.03%) GDPR
5 2 (0.34%) ISO 20022
5 2 (0.34%) PCI DSS
5 2 (0.34%) Sarbanes-Oxley
5 2 (0.34%) SEPA
5 2 (0.34%) TARGET2
6 1 (0.17%) IFRS
6 1 (0.17%) MiFID
6 1 (0.17%) Solvency II
System Software
1 158 (27.15%) HDFS
2 82 (14.09%) Docker
3 30 (5.15%) Apache ZooKeeper
4 21 (3.61%) Active Directory
5 14 (2.41%) Apache Flume
6 9 (1.55%) VMware NSX
6 9 (1.55%) vSphere
7 4 (0.69%) Active Directory Lightweight Directory Services
8 2 (0.34%) Terminal Services
8 2 (0.34%) Virtual Machines
9 1 (0.17%) NFS
9 1 (0.17%) VMware ESXi
9 1 (0.17%) VMware Infrastructure
Systems Management
1 122 (20.96%) Ansible
2 87 (14.95%) Kubernetes
3 48 (8.25%) Terraform
4 36 (6.19%) Hadoop YARN
5 32 (5.50%) Puppet
6 27 (4.64%) Oozie
7 13 (2.23%) Grafana
8 11 (1.89%) Prometheus
9 8 (1.37%) Microsoft Intune
9 8 (1.37%) Salt
9 8 (1.37%) vCenter Server
10 7 (1.20%) Consul
10 7 (1.20%) FreeIPA
10 7 (1.20%) Opscode Chef
10 7 (1.20%) Packer
11 3 (0.52%) Ambari
11 3 (0.52%) Kibana
11 3 (0.52%) Rancher
12 2 (0.34%) Control-M
12 2 (0.34%) Red Hat Satellite
Vendors
1 144 (24.74%) Cloudera
2 118 (20.27%) Oracle
3 53 (9.11%) Hortonworks
4 35 (6.01%) Microsoft
5 33 (5.67%) Informatica
6 25 (4.30%) Databricks
7 24 (4.12%) Google
8 23 (3.95%) Teradata
9 14 (2.41%) Red Hat
10 13 (2.23%) SAP
11 12 (2.06%) MuleSoft
11 12 (2.06%) TIBCO
12 11 (1.89%) Ab Initio
12 11 (1.89%) Splunk
12 11 (1.89%) StreamSets
13 10 (1.72%) Axway
13 10 (1.72%) EMC
13 10 (1.72%) Talend
14 9 (1.55%) Dell
15 8 (1.37%) Cisco