Period
to 3 June 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 3 June 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
3 Jun 2020
Same period 2019 Same period 2018
Rank 178 128 117
Rank change year-on-year -50 -11 -3
Contract jobs citing Hadoop 598 1,680 2,052
As % of all contract jobs advertised in England 1.48% 2.05% 2.22%
As % of the Database & Business Intelligence category 6.85% 9.08% 9.83%
Number of daily rates quoted 432 1,183 1,480
Median daily rate £550 £550 £550
10th Percentile £413 £419 £400
90th Percentile £725 £715 £681
UK median daily rate £550 £550 £550
Number of hourly rates quoted 9 16 9
Median hourly rate £35.00 £46.85 £45.00
Median hourly rate % change year-on-year -25.29% +4.11% -4.26%
UK median hourly rate £35.00 £49.13 £46.25
% change year-on-year -28.76% +6.23% -1.60%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 8,736 18,502 20,874
As % of all contract IT jobs advertised in England 21.60% 22.52% 22.60%
Number of daily rates quoted 5,799 12,806 14,631
Median daily rate £500 £485 £475
Median daily rate % change year-on-year +3.09% +2.11% +5.56%
10th Percentile £325 £325 £313
90th Percentile £687 £650 £638
UK median daily rate £490 £475 £473
% change year-on-year +3.16% +0.53% +8.00%
Number of hourly rates quoted 176 227 221
Median hourly rate £35.00 £35.00 £33.50
Median hourly rate % change year-on-year - +4.48% +11.67%
10th Percentile £15.97 £14.38 £14.00
90th Percentile £52.38 £57.50 £53.50
Median hourly rate £35.00 £35.00 £34.50
% change year-on-year - +1.45% +15.71%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop in England.

Daily rate trend for Hadoop in England

Hadoop
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop in England over the 6 months to 3 June 2020.

Daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Hadoop in England.

Hourly rate trend for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 3 June 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -46 333 £550 -4.35% 77
North of England -18 84 £625 +13.64% 11
South East -4 72 £500 - 11
North West +24 59 £650 +8.33% 7
South West +21 49 £564 +12.70% 5
Midlands +51 28 £396 -24.52% 3
East of England +42 24 £450 -20.00% 7
West Midlands +51 22 £437 -27.21%
Yorkshire -23 18 £475 -5.00% 4
East Midlands +23 5 £350 -27.27% 3
North East +25 4 £750 +53.85%
Hadoop
UK

For the 6 months to 3 June 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 342 (57.19%) Big Data
2 322 (53.85%) Python
3 296 (49.50%) Apache Spark
4 215 (35.95%) SQL
5 194 (32.44%) AWS
6 187 (31.27%) Agile Software Development
7 181 (30.27%) Analytics
8 177 (29.60%) DevOps
9 174 (29.10%) Java
10 159 (26.59%) Apache Hive
11 154 (25.75%) Cloudera
12 144 (24.08%) Kafka
13 139 (23.24%) Azure
14 132 (22.07%) Scala
15 120 (20.07%) ETL
16 116 (19.40%) Jenkins
17 113 (18.90%) Docker
18 108 (18.06%) Kubernetes
19 104 (17.39%) Finance
20 101 (16.89%) Data Modelling
21 95 (15.89%) NoSQL
21 95 (15.89%) Hortonworks
22 92 (15.38%) HBase
22 92 (15.38%) Business Intelligence
23 91 (15.22%) Security Cleared
24 89 (14.88%) Data Science
25 86 (14.38%) Linux
26 84 (14.05%) Terraform
27 82 (13.71%) GCP
28 80 (13.38%) Data Warehouse

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 296 (49.50%) Apache Spark
2 62 (10.37%) Apache
3 34 (5.69%) SAS
4 25 (4.18%) Confluence
5 20 (3.34%) Apache Pig
5 20 (3.34%) Elasticsearch
6 16 (2.68%) Jupyter
7 14 (2.34%) Apache Airflow
8 12 (2.01%) Tomcat
9 5 (0.84%) WebLogic
10 3 (0.50%) Apache Pulsar
10 3 (0.50%) Oracle Workflow
11 2 (0.33%) Jetty
11 2 (0.33%) Luigi
11 2 (0.33%) Tornado
12 1 (0.17%) Apache Solr
12 1 (0.17%) nginx
12 1 (0.17%) OpenStack
12 1 (0.17%) Oracle SOA Suite
12 1 (0.17%) WebSphere
Applications
1 7 (1.17%) Microsoft Excel
2 5 (0.84%) Microsoft Office
3 1 (0.17%) Chatbot
3 1 (0.17%) SPSS
3 1 (0.17%) Stata
Business Applications
1 4 (0.67%) SAP CRM
1 4 (0.67%) SAP ERP
1 4 (0.67%) SAP IS-U
2 3 (0.50%) SAP FI-CA
2 3 (0.50%) SAP PSCD
3 2 (0.33%) Hyperion Planning
3 2 (0.33%) SAP Oil and Gas
4 1 (0.17%) ENOVIA
4 1 (0.17%) FINCAD Analytics
4 1 (0.17%) Shopify
Cloud Services
1 194 (32.44%) AWS
2 139 (23.24%) Azure
3 82 (13.71%) GCP
4 33 (5.52%) Power Platform
5 26 (4.35%) PaaS
6 18 (3.01%) Cloud Computing
6 18 (3.01%) GitHub
7 15 (2.51%) IaaS
8 14 (2.34%) Serverless
9 12 (2.01%) Amazon Kinesis
10 11 (1.84%) Amazon EMR
10 11 (1.84%) Amazon S3
10 11 (1.84%) AWS Lambda
11 8 (1.34%) AWS CloudFormation
12 5 (0.84%) Amazon SageMaker
12 5 (0.84%) Azure Data Factory
13 4 (0.67%) OpenShift
14 3 (0.50%) Amazon EC2
14 3 (0.50%) Amazon Glacier
14 3 (0.50%) Virtual Private Cloud
Communications & Networking
1 22 (3.68%) Kerberos
2 7 (1.17%) HTTP
3 6 (1.00%) VPN
4 5 (0.84%) DNS
4 5 (0.84%) SSL
5 4 (0.67%) 5G
5 4 (0.67%) HTTPS
6 3 (0.50%) Firewall
7 2 (0.33%) Internet
7 2 (0.33%) TCP/IP
8 1 (0.17%) Broadband
8 1 (0.17%) MQTT
8 1 (0.17%) OpenLDAP
Database & Business Intelligence
1 342 (57.19%) Big Data
2 159 (26.59%) Apache Hive
3 95 (15.89%) NoSQL
4 92 (15.38%) HBase
5 80 (13.38%) Data Warehouse
6 57 (9.53%) Data Lake
7 55 (9.20%) Relational Database
8 54 (9.03%) Impala
9 50 (8.36%) Apache Cassandra
10 47 (7.86%) MongoDB
11 45 (7.53%) SQL Server
12 39 (6.52%) BigQuery
13 37 (6.19%) PostgreSQL
14 33 (5.52%) Power BI
15 30 (5.02%) Amazon Redshift
16 24 (4.01%) Sqoop
17 21 (3.51%) Pentaho
17 21 (3.51%) RDBMS
18 20 (3.34%) Data Mining
19 18 (3.01%) SQL Server Integration Services
Development Applications
1 116 (19.40%) Jenkins
2 80 (13.38%) Git (software)
3 43 (7.19%) JIRA
4 41 (6.86%) Maven
5 28 (4.68%) GitLab
6 27 (4.52%) Bitbucket
7 25 (4.18%) Artifactory
8 19 (3.18%) Sonatype Nexus
8 19 (3.18%) TeamCity
9 13 (2.17%) IBM UrbanCode
10 12 (2.01%) Visual Studio Team System
11 11 (1.84%) Visual Studio
12 9 (1.51%) Team Foundation Server
13 8 (1.34%) CircleCI
14 6 (1.00%) Selenium
14 6 (1.00%) SonarQube
15 5 (0.84%) Cucumber
15 5 (0.84%) ERwin
15 5 (0.84%) FindBugs
15 5 (0.84%) Mercurial
General
1 104 (17.39%) Finance
2 46 (7.69%) Banking
3 35 (5.85%) Telecoms
4 30 (5.02%) Public Sector
4 30 (5.02%) Retail
5 18 (3.01%) Marketing
6 13 (2.17%) Aerospace
7 11 (1.84%) Front Office
7 11 (1.84%) Legal
8 9 (1.51%) Investment Banking
9 6 (1.00%) Retail Banking
10 5 (0.84%) Manufacturing
11 4 (0.67%) Games
11 4 (0.67%) Pharmaceutical
12 3 (0.50%) Electronics
12 3 (0.50%) Law
13 2 (0.33%) Billing
13 2 (0.33%) Financial Institution
14 1 (0.17%) Automotive
14 1 (0.17%) Humanities
Job Titles
1 171 (28.60%) Data Engineer
2 112 (18.73%) Developer
3 74 (12.37%) Architect
3 74 (12.37%) Big Data Engineer
4 65 (10.87%) DevOps Engineer
5 53 (8.86%) Python Engineer
6 45 (7.53%) Data Architect
7 40 (6.69%) Data Scientist
8 36 (6.02%) Hadoop Engineer
9 35 (5.85%) Java Developer
10 32 (5.35%) Cloud Engineer
11 31 (5.18%) Analyst
12 29 (4.85%) Python Developer
13 27 (4.52%) AWS Engineer
14 25 (4.18%) Administrator
15 22 (3.68%) Big Data Developer
16 21 (3.51%) Azure Engineer
16 21 (3.51%) Senior Data Scientist
17 20 (3.34%) Cloud Architect
17 20 (3.34%) Software Engineer
Libraries, Frameworks & Software Standards
1 144 (24.08%) Kafka
2 74 (12.37%) PySpark
3 56 (9.36%) TensorFlow
4 49 (8.19%) Web Services
5 42 (7.02%) scikit-learn
6 26 (4.35%) Spring
7 25 (4.18%) Apache NiFi
8 24 (4.01%) Natural Language Processing
9 21 (3.51%) Spark Streaming
9 21 (3.51%) XML
10 18 (3.01%) H2O
11 17 (2.84%) Pandas
12 16 (2.68%) Spring Boot
13 15 (2.51%) LDAP
14 14 (2.34%) NumPy
14 14 (2.34%) RESTful
15 13 (2.17%) .NET
15 13 (2.17%) Elastic Stack
15 13 (2.17%) React
16 12 (2.01%) REST
Miscellaneous
1 49 (8.19%) Analytical Skills
2 42 (7.02%) Algorithms
3 17 (2.84%) Greenfield Project
3 17 (2.84%) Public Cloud
4 16 (2.68%) Cloud Native
4 16 (2.68%) Management Information System
5 15 (2.51%) Data Structures
6 14 (2.34%) Credit Risk
7 13 (2.17%) PKI
8 11 (1.84%) Self-Motivation
9 10 (1.67%) Social Media
10 9 (1.51%) Reference Data
11 8 (1.34%) Data Centre
11 8 (1.34%) Enterprise Software
11 8 (1.34%) Hedge funds
12 6 (1.00%) Derivative
12 6 (1.00%) Fixed Income
13 5 (0.84%) Analytical Mindset
13 5 (0.84%) User Experience
14 4 (0.67%) Linux Command Line
Operating Systems
1 86 (14.38%) Linux
2 41 (6.86%) Unix
3 20 (3.34%) Red Hat Enterprise Linux
4 19 (3.18%) CentOS
4 19 (3.18%) Windows
5 5 (0.84%) Debian
5 5 (0.84%) Ubuntu
6 1 (0.17%) DC/OS
6 1 (0.17%) VME
6 1 (0.17%) Windows Server
Processes & Methodologies
1 187 (31.27%) Agile Software Development
2 181 (30.27%) Analytics
3 177 (29.60%) DevOps
4 120 (20.07%) ETL
5 101 (16.89%) Data Modelling
6 92 (15.38%) Business Intelligence
7 89 (14.88%) Data Science
8 79 (13.21%) Machine Learning
9 78 (13.04%) Scrum
10 67 (11.20%) Software Engineering
11 66 (11.04%) Data Analytics
12 65 (10.87%) Data Engineering
13 60 (10.03%) Visualisation
14 56 (9.36%) Continuous Integration
15 46 (7.69%) Data Management
16 45 (7.53%) Migration
16 45 (7.53%) Open Source
17 44 (7.36%) Microservices
18 43 (7.19%) Data Visualisation
19 41 (6.86%) Computer Science
Programming Languages
1 322 (53.85%) Python
2 215 (35.95%) SQL
3 174 (29.10%) Java
4 132 (22.07%) Scala
5 40 (6.69%) Bash Shell
6 39 (6.52%) R
7 35 (5.85%) Shell Script
8 29 (4.85%) PL/SQL
9 26 (4.35%) Ruby
10 19 (3.18%) C#
10 19 (3.18%) JavaScript
11 18 (3.01%) Java 8
12 17 (2.84%) C
13 16 (2.68%) PowerShell
14 15 (2.51%) C++
15 14 (2.34%) Perl
16 12 (2.01%) Go
17 9 (1.51%) T-SQL
18 8 (1.34%) Groovy
19 7 (1.17%) Korn
Qualifications
1 91 (15.22%) Security Cleared
2 70 (11.71%) SC Cleared
3 34 (5.69%) Degree
4 24 (4.01%) CCA
5 23 (3.85%) Computer Science Degree
5 23 (3.85%) DV Cleared
6 4 (0.67%) AWS Certification
6 4 (0.67%) PMI Certification
7 3 (0.50%) ISEB
7 3 (0.50%) ISTQB
7 3 (0.50%) ISTQB Foundation Certification
8 2 (0.33%) BPSS Clearance
8 2 (0.33%) Master's Degree
8 2 (0.33%) Numerate Degree
8 2 (0.33%) PhD
9 1 (0.17%) CCIE
9 1 (0.17%) Cisco Certification
9 1 (0.17%) MBA
Quality Assurance & Compliance
1 24 (4.01%) Data Quality
2 3 (0.50%) QA
3 2 (0.33%) SLA
4 1 (0.17%) IFRS
4 1 (0.17%) ISO/IEC 27001
4 1 (0.17%) MiFID
System Software
1 113 (18.90%) Docker
2 79 (13.21%) HDFS
3 22 (3.68%) Apache ZooKeeper
4 21 (3.51%) Apache Flume
5 13 (2.17%) Active Directory
6 11 (1.84%) Virtual Machines
Systems Management
1 108 (18.06%) Kubernetes
2 84 (14.05%) Terraform
3 73 (12.21%) Ansible
4 33 (5.52%) Hadoop YARN
5 31 (5.18%) Puppet
6 23 (3.85%) Oozie
7 8 (1.34%) Packer
8 7 (1.17%) Ambari
8 7 (1.17%) logstash
9 6 (1.00%) Kibana
9 6 (1.00%) Single Sign-On
10 4 (0.67%) Grafana
11 3 (0.50%) Kubeflow
11 3 (0.50%) Opscode Chef
12 2 (0.33%) Control-M
13 1 (0.17%) Apache Brooklyn
13 1 (0.17%) Docker Swarm
13 1 (0.17%) Prometheus
13 1 (0.17%) Tivoli
13 1 (0.17%) ZABBIX
Vendors
1 154 (25.75%) Cloudera
2 95 (15.89%) Hortonworks
3 64 (10.70%) Oracle
4 53 (8.86%) Microsoft
5 40 (6.69%) Tableau
6 31 (5.18%) Google
7 28 (4.68%) Informatica
8 24 (4.01%) SAP
9 22 (3.68%) Databricks
10 21 (3.51%) MapR
10 21 (3.51%) Teradata
11 15 (2.51%) Red Hat
12 13 (2.17%) Ab Initio
13 12 (2.01%) VMware
14 8 (1.34%) IBM
14 8 (1.34%) StreamSets
14 8 (1.34%) Sybase
15 7 (1.17%) Talend
16 6 (1.00%) Splunk
17 4 (0.67%) Trillium