Period
to 5 March 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 5 March 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
5 Mar 2021
Same period 2020 Same period 2019
Rank 202 188 127
Rank change year-on-year -14 -61 -4
Contract jobs citing Hadoop 510 872 1,874
As % of all contract jobs advertised in England 1.31% 1.42% 2.07%
As % of the Database & Business Intelligence category 6.18% 6.61% 9.08%
Number of daily rates quoted 393 624 1,290
Median daily rate £550 £550 £550
10th Percentile £389 £413 £413
90th Percentile £658 £725 £713
UK median daily rate £540 £550 £550
% change year-on-year -1.82% - +2.33%
Number of hourly rates quoted 2 0 3
Median hourly rate £38.50 - £55.00
10th Percentile £27.90 - £44.50
90th Percentile £52.30 - £68.30
UK median hourly rate £40.00 - £55.00

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 8,247 13,202 20,644
As % of all contract IT jobs advertised in England 21.13% 21.56% 22.82%
Number of daily rates quoted 5,724 9,117 14,548
Median daily rate £495 £488 £485
Median daily rate % change year-on-year +1.54% +0.52% +2.11%
10th Percentile £313 £325 £325
90th Percentile £675 £675 £650
UK median daily rate £488 £475 £475
% change year-on-year +2.63% - +2.70%
Number of hourly rates quoted 143 184 210
Median hourly rate £25.00 £25.80 £31.25
Median hourly rate % change year-on-year -3.09% -17.45% -4.58%
10th Percentile £13.27 £13.83 £14.00
90th Percentile £61.65 £63.71 £56.50
Median hourly rate £26.00 £25.60 £27.50
% change year-on-year +1.58% -6.93% -16.03%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop in England.

Daily rate trend for Hadoop in England

Hadoop
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop in England over the 6 months to 5 March 2021.

Daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Hadoop in England.

Hourly rate trend for Hadoop in England

Hadoop
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Hadoop in England over the 6 months to 5 March 2021.

Hourly rate histogram for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 5 March 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -20 328 £575 - 105
South East +47 54 £475 - 11
North of England +7 37 £550 - 17
Midlands +45 35 £481 -1.44% 10
West Midlands +45 33 £475 -7.32% 9
North West +11 25 £500 -11.11% 7
South West +38 17 £500 -9.09% 9
Yorkshire +30 12 £555 +13.85% 9
East of England +31 7 £500 +12.99% 4
East Midlands +22 1 £350 -22.22% 1
Hadoop
UK

For the 6 months to 5 March 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 311 (60.98%) Apache Spark
2 232 (45.49%) Big Data
3 214 (41.96%) Apache Hive
4 213 (41.76%) Python
5 197 (38.63%) Java
6 187 (36.67%) SQL
7 170 (33.33%) Agile Software Development
8 157 (30.78%) Scala
9 154 (30.20%) AWS
10 141 (27.65%) HDFS
11 119 (23.33%) Security Cleared
12 117 (22.94%) Kafka
13 116 (22.75%) DevOps
14 111 (21.76%) SC Cleared
15 108 (21.18%) ETL
16 103 (20.20%) Cloudera
17 102 (20.00%) Finance
18 96 (18.82%) Jenkins
19 94 (18.43%) Analytics
19 94 (18.43%) Ansible
20 93 (18.24%) Azure
21 90 (17.65%) Apache
22 84 (16.47%) Linux
22 84 (16.47%) Impala
23 83 (16.27%) Oracle
24 82 (16.08%) HBase
25 81 (15.88%) Git (software)
26 78 (15.29%) Banking
27 71 (13.92%) Scrum
28 68 (13.33%) Data Science

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 311 (60.98%) Apache Spark
2 90 (17.65%) Apache
3 40 (7.84%) Confluence
4 30 (5.88%) Apache Airflow
5 21 (4.12%) Elasticsearch
6 18 (3.53%) Apache Pig
7 8 (1.57%) SAS
8 6 (1.18%) Tomcat
9 5 (0.98%) Jupyter
9 5 (0.98%) WebSphere
10 4 (0.78%) Apache Solr
10 4 (0.78%) Luigi
10 4 (0.78%) WebSphere Application Server
11 3 (0.59%) Oracle SOA Suite
12 2 (0.39%) Apache Synapse
12 2 (0.39%) Camunda
12 2 (0.39%) Mule
12 2 (0.39%) SharePoint
12 2 (0.39%) WebLogic
13 1 (0.20%) Oracle Workflow
Applications
1 22 (4.31%) Spreadsheet
2 8 (1.57%) Microsoft Excel
3 5 (0.98%) MS Visio
4 2 (0.39%) Chatbot
4 2 (0.39%) Microsoft Office
5 1 (0.20%) Microsoft PowerPoint
5 1 (0.20%) SPSS
5 1 (0.20%) Stata
Business Applications
1 3 (0.59%) Oracle BPM
2 2 (0.39%) SAP FI-CA
3 1 (0.20%) SAP CRM
3 1 (0.20%) SAP ERP
3 1 (0.20%) SAP IS-U
3 1 (0.20%) SAP MDG
3 1 (0.20%) SAP MDM
3 1 (0.20%) Traffica
Cloud Services
1 154 (30.20%) AWS
2 93 (18.24%) Azure
3 63 (12.35%) Amazon S3
4 46 (9.02%) GCP
5 36 (7.06%) Amazon EMR
6 30 (5.88%) Power Platform
7 28 (5.49%) Serverless
8 22 (4.31%) AWS Lambda
9 21 (4.12%) GitHub
10 19 (3.73%) Amazon EC2
11 17 (3.33%) PaaS
12 14 (2.75%) IaaS
13 10 (1.96%) Azure Data Factory
14 8 (1.57%) Amazon ECS
14 8 (1.57%) Azure Active Directory
14 8 (1.57%) OpenShift
15 7 (1.37%) AWS CloudFormation
15 7 (1.37%) AWS Step Functions
15 7 (1.37%) Microsoft 365
16 6 (1.18%) Route 53
Communications & Networking
1 12 (2.35%) WAN
2 11 (2.16%) VSAN
3 9 (1.76%) Firewall
4 8 (1.57%) Ethernet
4 8 (1.57%) VLAN
5 5 (0.98%) DNS
6 4 (0.78%) Cisco Nexus
6 4 (0.78%) FCoE
6 4 (0.78%) Fibre Channel
6 4 (0.78%) iSCSI
6 4 (0.78%) LAN
6 4 (0.78%) Multicast
6 4 (0.78%) NAS
6 4 (0.78%) SAN
7 3 (0.59%) Network Security
7 3 (0.59%) Remote Desktop
7 3 (0.59%) VPN
8 2 (0.39%) Kerberos
8 2 (0.39%) SMTP
9 1 (0.20%) Internet
Database & Business Intelligence
1 232 (45.49%) Big Data
2 214 (41.96%) Apache Hive
3 84 (16.47%) Impala
4 82 (16.08%) HBase
5 67 (13.14%) NoSQL
6 62 (12.16%) Data Lake
6 62 (12.16%) Data Warehouse
6 62 (12.16%) Relational Database
7 47 (9.22%) MySQL
8 45 (8.82%) Pentaho
9 38 (7.45%) MongoDB
10 36 (7.06%) PostgreSQL
11 33 (6.47%) Spark SQL
11 33 (6.47%) SQL Server
12 30 (5.88%) Amazon Redshift
12 30 (5.88%) Power BI
13 28 (5.49%) Apache Cassandra
14 27 (5.29%) Tableau
15 18 (3.53%) Amazon RDS
15 18 (3.53%) Presto
Development Applications
1 96 (18.82%) Jenkins
2 81 (15.88%) Git (software)
3 39 (7.65%) JIRA
4 29 (5.69%) Sonatype Nexus
5 19 (3.73%) Maven
6 16 (3.14%) TeamCity
7 12 (2.35%) Bitbucket
7 12 (2.35%) GitLab
7 12 (2.35%) Selenium
8 11 (2.16%) IBM UrbanCode
8 11 (2.16%) RStudio
9 10 (1.96%) Cucumber
9 10 (1.96%) Gradle
10 5 (0.98%) Atlassian Bamboo
10 5 (0.98%) ProC
11 4 (0.78%) Artifactory
11 4 (0.78%) IntelliJ
12 3 (0.59%) Hudson
12 3 (0.59%) MLflow
12 3 (0.59%) SonarQube
General
1 102 (20.00%) Finance
2 78 (15.29%) Banking
3 43 (8.43%) Investment Banking
4 34 (6.67%) Public Sector
5 33 (6.47%) Front Office
6 13 (2.55%) Marketing
7 9 (1.76%) Retail
8 7 (1.37%) Legal
9 5 (0.98%) Manufacturing
9 5 (0.98%) Telecoms
10 4 (0.78%) Financial Institution
10 4 (0.78%) Games
11 3 (0.59%) Automotive
11 3 (0.59%) Electronics
11 3 (0.59%) French Language
11 3 (0.59%) Retail Banking
12 2 (0.39%) Military
13 1 (0.20%) Billing
13 1 (0.20%) Law
13 1 (0.20%) Publishing
Job Titles
1 145 (28.43%) Developer
2 125 (24.51%) Data Engineer
3 77 (15.10%) Architect
4 45 (8.82%) Big Data Engineer
5 42 (8.24%) Java Developer
6 36 (7.06%) AWS Engineer
6 36 (7.06%) Scala Developer
7 34 (6.67%) Hadoop Developer
8 32 (6.27%) Data Architect
9 31 (6.08%) Solutions Architect
10 27 (5.29%) Apache Spark Developer
11 24 (4.71%) Cloud Engineer
12 21 (4.12%) Big Data Developer
12 21 (4.12%) Hadoop Engineer
13 20 (3.92%) Analyst
13 20 (3.92%) DevOps Engineer
14 19 (3.73%) Data Scientist
14 19 (3.73%) Scala Engineer
15 16 (3.14%) Big Data Architect
16 15 (2.94%) AWS Architect
Libraries, Frameworks & Software Standards
1 117 (22.94%) Kafka
2 32 (6.27%) PySpark
3 28 (5.49%) JSON
4 25 (4.90%) Spring
5 20 (3.92%) XML
6 16 (3.14%) Apache NiFi
6 16 (3.14%) Web Services
7 15 (2.94%) RESTful
8 14 (2.75%) Spark Streaming
9 12 (2.35%) Pandas
9 12 (2.35%) RabbitMQ
10 7 (1.37%) Middleware
10 7 (1.37%) NumPy
10 7 (1.37%) PyTorch
10 7 (1.37%) TensorFlow
11 6 (1.18%) Lambda Expressions
11 6 (1.18%) SOAP
12 5 (0.98%) AngularJS
12 5 (0.98%) Apache Avro
12 5 (0.98%) Natural Language Processing
Miscellaneous
1 46 (9.02%) Analytical Skills
2 19 (3.73%) Algorithms
3 16 (3.14%) Data Structures
4 15 (2.94%) Linux Command Line
5 10 (1.96%) Cloud Native
5 10 (1.96%) Public Cloud
6 8 (1.57%) Equities
7 7 (1.37%) Cybercrime
7 7 (1.37%) Greenfield Project
7 7 (1.37%) Virtual Team
8 6 (1.18%) Credit Risk
8 6 (1.18%) VSAM
9 5 (0.98%) Analytical Mindset
9 5 (0.98%) Management Information System
9 5 (0.98%) Replication
10 4 (0.78%) FMCG
10 4 (0.78%) PKI
10 4 (0.78%) Self-Motivation
11 3 (0.59%) Market Risk
11 3 (0.59%) User Experience
Operating Systems
1 84 (16.47%) Linux
2 47 (9.22%) Unix
3 31 (6.08%) Windows
4 14 (2.75%) Ubuntu
5 11 (2.16%) CentOS
6 5 (0.98%) Solaris
7 3 (0.59%) Windows 10
7 3 (0.59%) Windows Server
8 2 (0.39%) AIX
8 2 (0.39%) Red Hat Enterprise Linux
8 2 (0.39%) SUSE
9 1 (0.20%) VME
Processes & Methodologies
1 170 (33.33%) Agile Software Development
2 116 (22.75%) DevOps
3 108 (21.18%) ETL
4 94 (18.43%) Analytics
5 71 (13.92%) Scrum
6 68 (13.33%) Data Science
7 67 (13.14%) TDD
8 65 (12.75%) Data Modelling
9 62 (12.16%) BDD
10 61 (11.96%) Business Intelligence
11 58 (11.37%) Computer Science
12 57 (11.18%) Data Engineering
13 52 (10.20%) Problem-Solving
14 51 (10.00%) Machine Learning
15 48 (9.41%) Configuration Management
16 45 (8.82%) Data Ingestion
17 41 (8.04%) Mathematics
18 40 (7.84%) Continuous Integration
19 38 (7.45%) Data Integration
20 37 (7.25%) Microservices
Programming Languages
1 213 (41.76%) Python
2 197 (38.63%) Java
3 187 (36.67%) SQL
4 157 (30.78%) Scala
5 30 (5.88%) Shell Script
6 26 (5.10%) R
7 17 (3.33%) JavaScript
8 15 (2.94%) Bash Shell
9 14 (2.75%) C#
9 14 (2.75%) PL/SQL
10 11 (2.16%) Kotlin
11 9 (1.76%) Haskell
11 9 (1.76%) Perl
11 9 (1.76%) PowerShell
12 8 (1.57%) Elm
13 6 (1.18%) C++
13 6 (1.18%) Groovy
13 6 (1.18%) T-SQL
14 5 (0.98%) C
15 4 (0.78%) VBA
Qualifications
1 119 (23.33%) Security Cleared
2 111 (21.76%) SC Cleared
3 57 (11.18%) Degree
4 27 (5.29%) Numerate Degree
5 13 (2.55%) AWS Certification
5 13 (2.55%) Computer Science Degree
5 13 (2.55%) TOGAF Certification
6 7 (1.37%) PhD
7 3 (0.59%) Master's Degree
8 2 (0.39%) CCA
8 2 (0.39%) DV Cleared
9 1 (0.20%) BPSS Clearance
Quality Assurance & Compliance
1 21 (4.12%) QA
2 15 (2.94%) Data Quality
3 6 (1.18%) SLA
4 3 (0.59%) GDPR
5 2 (0.39%) ISO 20022
5 2 (0.39%) SEPA
5 2 (0.39%) TARGET2
6 1 (0.20%) IFRS
6 1 (0.20%) MiFID
6 1 (0.20%) PCI DSS
6 1 (0.20%) PMO
6 1 (0.20%) Solvency II
System Software
1 141 (27.65%) HDFS
2 53 (10.39%) Docker
3 21 (4.12%) Apache ZooKeeper
4 16 (3.14%) Active Directory
5 11 (2.16%) VMware NSX
5 11 (2.16%) vSphere
6 10 (1.96%) Apache Flume
7 7 (1.37%) VMware Infrastructure
8 5 (0.98%) Oracle RAC
9 4 (0.78%) Hyper-V
9 4 (0.78%) KVM
9 4 (0.78%) NFS
9 4 (0.78%) SRDF
9 4 (0.78%) Xen
10 3 (0.59%) Active Directory Lightweight Directory Services
10 3 (0.59%) VMware ESXi
11 2 (0.39%) Terminal Services
12 1 (0.20%) Virtual Machines
Systems Management
1 94 (18.43%) Ansible
2 59 (11.57%) Kubernetes
3 39 (7.65%) Terraform
4 35 (6.86%) Hadoop YARN
5 29 (5.69%) Oozie
6 18 (3.53%) Grafana
7 14 (2.75%) Puppet
8 12 (2.35%) Prometheus
9 8 (1.57%) Ambari
9 8 (1.57%) Microsoft Intune
9 8 (1.57%) vCenter Server
10 6 (1.18%) Opscode Chef
11 4 (0.78%) Consul
11 4 (0.78%) FreeIPA
12 3 (0.59%) Rancher
13 2 (0.39%) Kubeflow
13 2 (0.39%) Packer
13 2 (0.39%) Red Hat Satellite
13 2 (0.39%) SCCM
13 2 (0.39%) ZABBIX
Vendors
1 103 (20.20%) Cloudera
2 83 (16.27%) Oracle
3 36 (7.06%) Microsoft
4 33 (6.47%) Hortonworks
5 29 (5.69%) Google
6 24 (4.71%) Talend
7 22 (4.31%) Informatica
8 13 (2.55%) Teradata
9 12 (2.35%) Cisco
9 12 (2.35%) EMC
10 11 (2.16%) Ab Initio
10 11 (2.16%) Databricks
10 11 (2.16%) StreamSets
11 10 (1.96%) TIBCO
12 9 (1.76%) VMware
13 8 (1.57%) Atlassian
13 8 (1.57%) Dell
13 8 (1.57%) MapR
13 8 (1.57%) SAP
14 7 (1.37%) Red Hat