Period
to 1 October 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 1 October 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
1 Oct 2020
Same period 2019 Same period 2018
Rank 149 158 124
Rank change year-on-year +9 -34 -13
Contract jobs citing Hadoop 461 1,395 2,028
As % of all contract jobs advertised in England 1.78% 1.74% 2.18%
As % of the Database & Business Intelligence category 7.81% 7.98% 9.52%
Number of daily rates quoted 338 1,012 1,451
Median daily rate £550 £550 £550
10th Percentile £391 £425 £413
90th Percentile £700 £713 £688
UK median daily rate £540 £550 £538
% change year-on-year -1.82% +2.33% +2.38%
Number of hourly rates quoted 11 14 5
Median hourly rate £35.00 £43.53 £47.50
Median hourly rate % change year-on-year -19.60% -8.35% +35.71%
UK median hourly rate £35.00 £46.85 £56.25
% change year-on-year -25.29% -16.72% +60.71%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 5,906 17,488 21,303
As % of all contract IT jobs advertised in England 22.78% 21.84% 22.88%
Number of daily rates quoted 3,899 12,047 15,080
Median daily rate £500 £480 £475
Median daily rate % change year-on-year +4.17% +1.05% +5.56%
10th Percentile £313 £325 £313
90th Percentile £688 £663 £638
UK median daily rate £500 £475 £475
% change year-on-year +5.26% - +5.56%
Number of hourly rates quoted 128 236 217
Median hourly rate £35.00 £35.00 £30.00
Median hourly rate % change year-on-year - +16.67% -1.64%
10th Percentile £14.70 £12.69 £14.00
90th Percentile £51.75 £60.00 £56.00
Median hourly rate £35.00 £35.00 £30.00
% change year-on-year - +16.67% -

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop in England.

Daily rate trend for Hadoop in England

Hadoop
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop in England over the 6 months to 1 October 2020.

Daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Hadoop in England.

Hourly rate trend for Hadoop in England

Hadoop
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Hadoop in England over the 6 months to 1 October 2020.

Hourly rate histogram for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 1 October 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -28 250 £550 -4.35% 76
North of England +64 97 £525 - 7
North West +63 87 £525 -1.18% 3
South East +77 42 £475 -5.00% 14
Midlands +81 24 £430 -18.10% 19
South West +71 19 £650 +18.18% 6
West Midlands +74 18 £431 -21.64% 6
Yorkshire +36 8 £450 -10.00% 3
East of England +42 7 £463 -22.92% 2
East Midlands +43 6 £295 -43.81% 13
Hadoop
UK

For the 6 months to 1 October 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 245 (53.15%) Big Data
2 232 (50.33%) Python
3 211 (45.77%) Apache Spark
4 170 (36.88%) AWS
5 167 (36.23%) DevOps
6 155 (33.62%) Cloudera
7 152 (32.97%) SQL
8 151 (32.75%) Apache Hive
9 140 (30.37%) Security Cleared
10 139 (30.15%) Java
11 135 (29.28%) Jenkins
12 123 (26.68%) Azure
13 121 (26.25%) SC Cleared
14 113 (24.51%) Agile Software Development
15 107 (23.21%) Analytics
15 107 (23.21%) Docker
15 107 (23.21%) Kubernetes
16 104 (22.56%) Kafka
17 97 (21.04%) ETL
18 94 (20.39%) Git (software)
19 90 (19.52%) Ansible
20 85 (18.44%) Oracle
21 82 (17.79%) Impala
21 82 (17.79%) Terraform
22 79 (17.14%) HDFS
23 78 (16.92%) Linux
24 73 (15.84%) Scala
25 71 (15.40%) Hortonworks
26 64 (13.88%) Data Modelling
26 64 (13.88%) Data Science

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 211 (45.77%) Apache Spark
2 47 (10.20%) Apache
3 38 (8.24%) Confluence
4 23 (4.99%) Elasticsearch
5 22 (4.77%) Apache Pig
6 17 (3.69%) Mule
7 16 (3.47%) SAS
7 16 (3.47%) WebLogic
8 11 (2.39%) Apache Airflow
9 9 (1.95%) Tomcat
10 6 (1.30%) Cloud Foundry
10 6 (1.30%) Jupyter
11 5 (1.08%) JBoss
11 5 (1.08%) Jetty
11 5 (1.08%) MQSeries
11 5 (1.08%) Oracle Self-Service HR
11 5 (1.08%) Red Hat Fuse
12 2 (0.43%) Luigi
13 1 (0.22%) OpenStack
13 1 (0.22%) R Markdown
Applications
1 22 (4.77%) Spreadsheet
2 12 (2.60%) Microsoft Excel
3 2 (0.43%) MS Visio
3 2 (0.43%) SPSS
3 2 (0.43%) Stata
4 1 (0.22%) Microsoft PowerPoint
Business Applications
1 11 (2.39%) SAP FI-CA
2 6 (1.30%) Sparx Enterprise Architect
3 1 (0.22%) FINCAD Analytics
Cloud Services
1 170 (36.88%) AWS
2 123 (26.68%) Azure
3 44 (9.54%) GCP
4 27 (5.86%) Amazon S3
5 24 (5.21%) Power Platform
6 17 (3.69%) PaaS
7 15 (3.25%) Serverless
8 13 (2.82%) Azure Data Factory
9 11 (2.39%) IaaS
10 10 (2.17%) Virtual Private Cloud
11 8 (1.74%) Amazon EC2
11 8 (1.74%) Amazon EKS
12 7 (1.52%) AWS Lambda
12 7 (1.52%) GitHub
13 6 (1.30%) Amazon EMR
13 6 (1.30%) AWS CloudFormation
13 6 (1.30%) Slack
14 5 (1.08%) npm
15 4 (0.87%) Cloud Computing
15 4 (0.87%) SaaS
Communications & Networking
1 10 (2.17%) SSL
2 8 (1.74%) Kerberos
3 5 (1.08%) SSH
4 3 (0.65%) 5G
5 2 (0.43%) VPN
6 1 (0.22%) Internet
6 1 (0.22%) Network Security
6 1 (0.22%) Wi-Fi
Database & Business Intelligence
1 245 (53.15%) Big Data
2 151 (32.75%) Apache Hive
3 82 (17.79%) Impala
4 61 (13.23%) Relational Database
5 48 (10.41%) MySQL
6 46 (9.98%) MongoDB
7 40 (8.68%) HBase
8 38 (8.24%) NoSQL
9 29 (6.29%) Data Lake
9 29 (6.29%) Data Warehouse
9 29 (6.29%) SQL Server
10 25 (5.42%) Apache Cassandra
10 25 (5.42%) Pentaho
11 24 (5.21%) Power BI
12 21 (4.56%) SQL Server Integration Services
13 20 (4.34%) PostgreSQL
14 18 (3.90%) Oracle Database
15 14 (3.04%) Apache Accumulo
16 13 (2.82%) Data Mining
16 13 (2.82%) Spark SQL
Development Applications
1 135 (29.28%) Jenkins
2 94 (20.39%) Git (software)
3 38 (8.24%) JIRA
4 28 (6.07%) GitLab
5 27 (5.86%) Selenium
6 23 (4.99%) Cucumber
7 20 (4.34%) TeamCity
8 18 (3.90%) Maven
9 13 (2.82%) Bitbucket
10 11 (2.39%) Postman
10 11 (2.39%) SoapUI
10 11 (2.39%) Sonatype Nexus
10 11 (2.39%) Toad
10 11 (2.39%) Visual Studio
11 8 (1.74%) JUnit
12 7 (1.52%) Artifactory
13 6 (1.30%) Vagrant
14 5 (1.08%) FishEye
14 5 (1.08%) Gradle
14 5 (1.08%) Mercurial
General
1 63 (13.67%) Finance
2 46 (9.98%) Banking
3 27 (5.86%) Public Sector
4 22 (4.77%) Front Office
5 16 (3.47%) Investment Banking
5 16 (3.47%) Marketing
5 16 (3.47%) Retail
6 15 (3.25%) Aerospace
7 13 (2.82%) Telecoms
8 8 (1.74%) Manufacturing
9 7 (1.52%) Law
10 6 (1.30%) Legal
11 3 (0.65%) Games
11 3 (0.65%) Pharmaceutical
12 2 (0.43%) Electronics
12 2 (0.43%) Financial Institution
12 2 (0.43%) Military
13 1 (0.22%) Billing
Job Titles
1 105 (22.78%) Data Engineer
2 100 (21.69%) Developer
3 65 (14.10%) Architect
4 57 (12.36%) DevOps Engineer
5 39 (8.46%) Administrator
6 38 (8.24%) Big Data Engineer
7 31 (6.72%) Cloud Engineer
7 31 (6.72%) Python Engineer
8 26 (5.64%) Azure Engineer
8 26 (5.64%) Java Developer
9 25 (5.42%) Cloud Administrator
9 25 (5.42%) Python Developer
10 24 (5.21%) Data Architect
11 23 (4.99%) Hadoop Engineer
12 22 (4.77%) Analyst
13 21 (4.56%) Cloud Architect
14 20 (4.34%) DevOps Administrator
15 18 (3.90%) AWS DevOps
16 17 (3.69%) Data Scientist
17 16 (3.47%) Solutions Architect
Libraries, Frameworks & Software Standards
1 104 (22.56%) Kafka
2 39 (8.46%) PySpark
3 38 (8.24%) Web Services
4 34 (7.38%) Spring
5 29 (6.29%) JSON
6 23 (4.99%) XML
7 20 (4.34%) REST
8 18 (3.90%) RabbitMQ
9 17 (3.69%) TensorFlow
10 16 (3.47%) Spring Boot
11 15 (3.25%) Apache NiFi
11 15 (3.25%) React
11 15 (3.25%) SOAP
12 14 (3.04%) Spark Streaming
13 13 (2.82%) .NET
14 12 (2.60%) Node.js
14 12 (2.60%) scikit-learn
15 10 (2.17%) Elastic Stack
16 9 (1.95%) AngularJS
17 8 (1.74%) NumPy
Miscellaneous
1 37 (8.03%) Analytical Skills
2 27 (5.86%) Algorithms
3 16 (3.47%) Public Cloud
4 15 (3.25%) Greenfield Project
5 13 (2.82%) Cloud Native
6 12 (2.60%) Credit Risk
7 11 (2.39%) Derivative
7 11 (2.39%) FMCG
7 11 (2.39%) PKI
8 10 (2.17%) Data Structures
9 9 (1.95%) Analytical Mindset
9 9 (1.95%) User Experience
10 8 (1.74%) Fixed Income
11 7 (1.52%) Self-Motivation
12 6 (1.30%) Reference Data
13 5 (1.08%) Hedge funds
13 5 (1.08%) Virtual Team
14 4 (0.87%) Data Centre
15 3 (0.65%) Enterprise Software
15 3 (0.65%) Equities
Operating Systems
1 78 (16.92%) Linux
2 30 (6.51%) Unix
3 29 (6.29%) Windows
4 16 (3.47%) CentOS
4 16 (3.47%) Red Hat Enterprise Linux
5 5 (1.08%) Android
5 5 (1.08%) Apple iOS
5 5 (1.08%) Debian
5 5 (1.08%) Mac OS X
5 5 (1.08%) Ubuntu
6 1 (0.22%) Windows Server
Processes & Methodologies
1 167 (36.23%) DevOps
2 113 (24.51%) Agile Software Development
3 107 (23.21%) Analytics
4 97 (21.04%) ETL
5 64 (13.88%) Data Modelling
5 64 (13.88%) Data Science
6 56 (12.15%) Microservices
7 50 (10.85%) Business Intelligence
7 50 (10.85%) Scrum
8 48 (10.41%) Machine Learning
9 43 (9.33%) Visualisation
10 42 (9.11%) Data Engineering
11 41 (8.89%) Data Analytics
12 37 (8.03%) Problem-Solving
13 36 (7.81%) Test Automation
14 33 (7.16%) Computer Science
14 33 (7.16%) Continuous Integration
14 33 (7.16%) TDD
15 29 (6.29%) Continuous Delivery
16 28 (6.07%) Data Integration
Programming Languages
1 232 (50.33%) Python
2 152 (32.97%) SQL
3 139 (30.15%) Java
4 73 (15.84%) Scala
5 39 (8.46%) Bash Shell
6 38 (8.24%) Shell Script
7 27 (5.86%) R
8 25 (5.42%) PowerShell
9 21 (4.56%) Perl
10 20 (4.34%) JavaScript
11 18 (3.90%) C#
11 18 (3.90%) PL/SQL
12 16 (3.47%) C++
13 15 (3.25%) Ruby
14 14 (3.04%) Groovy
15 10 (2.17%) Kotlin
16 9 (1.95%) Java 8
17 6 (1.30%) Clojure
17 6 (1.30%) T-SQL
18 5 (1.08%) VBA
Qualifications
1 140 (30.37%) Security Cleared
2 121 (26.25%) SC Cleared
3 35 (7.59%) Degree
4 21 (4.56%) CCA
5 19 (4.12%) DV Cleared
5 19 (4.12%) Numerate Degree
6 12 (2.60%) TOGAF Certification
7 10 (2.17%) Computer Science Degree
8 8 (1.74%) Master's Degree
9 5 (1.08%) AWS Certification
10 4 (0.87%) ISEB
10 4 (0.87%) ISTQB
10 4 (0.87%) ISTQB Foundation Certification
11 3 (0.65%) BPSS Clearance
11 3 (0.65%) PMI Certification
12 2 (0.43%) PhD
13 1 (0.22%) CSPO
Quality Assurance & Compliance
1 9 (1.95%) Data Quality
2 3 (0.65%) SLA
3 2 (0.43%) Sarbanes-Oxley
4 1 (0.22%) CDISC
4 1 (0.22%) GDPR
4 1 (0.22%) ISO 20022
4 1 (0.22%) MiFID
4 1 (0.22%) PCI DSS
4 1 (0.22%) SEPA
4 1 (0.22%) TARGET2
System Software
1 107 (23.21%) Docker
2 79 (17.14%) HDFS
3 30 (6.51%) Apache ZooKeeper
4 22 (4.77%) Active Directory
5 11 (2.39%) Virtual Machines
6 7 (1.52%) Apache Flume
7 3 (0.65%) NFS
8 2 (0.43%) Active Directory Lightweight Directory Services
Systems Management
1 107 (23.21%) Kubernetes
2 90 (19.52%) Ansible
3 82 (17.79%) Terraform
4 35 (7.59%) Puppet
5 14 (3.04%) Packer
6 12 (2.60%) Oozie
7 7 (1.52%) Hadoop YARN
8 5 (1.08%) Opscode Chef
8 5 (1.08%) Salt
9 4 (0.87%) logstash
10 2 (0.43%) Kibana
10 2 (0.43%) Rancher
11 1 (0.22%) Ambari
11 1 (0.22%) Istio
11 1 (0.22%) Knative
11 1 (0.22%) Kubeflow
Vendors
1 155 (33.62%) Cloudera
2 85 (18.44%) Oracle
3 71 (15.40%) Hortonworks
4 43 (9.33%) Microsoft
5 37 (8.03%) Tableau
6 28 (6.07%) Informatica
7 27 (5.86%) Teradata
8 17 (3.69%) Databricks
9 16 (3.47%) Red Hat
9 16 (3.47%) SAP
10 14 (3.04%) Google
11 13 (2.82%) VMware
12 12 (2.60%) Splunk
13 11 (2.39%) Ab Initio
14 9 (1.95%) MuleSoft
15 8 (1.74%) IBM
16 7 (1.52%) StreamSets
16 7 (1.52%) TIBCO
17 6 (1.30%) AppDynamics
17 6 (1.30%) Sparx