Period
to 12 November 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 12 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
12 Nov 2019
Same period 2018 Same period 2017
Rank 169 128 113
Rank change year-on-year -41 -15 +6
Contract jobs citing Hadoop 1,212 2,005 2,078
As % of all contract IT jobs advertised in England 1.58% 2.13% 2.23%
As % of the Database & Business Intelligence category 7.33% 9.41% 10.09%
Number of daily rates quoted 850 1,370 1,454
England median daily rate £550 £550 £538
Median daily rate % change year-on-year - +2.33% +2.38%
10th Percentile £425 £413 £400
90th Percentile £723 £700 £675
UK median daily rate £550 £545 £530
% change year-on-year +0.92% +2.83% +0.95%
Number of hourly rates quoted 4 5 9
England median hourly rate £43.53 £47.50 £35.00
Median hourly rate % change year-on-year -8.35% +35.71% -23.50%
10th Percentile £36.13 £26.15 £16.56
90th Percentile £50.66 £137.05 £50.00
UK median hourly rate £43.53 £56.25 £35.00
% change year-on-year -22.61% +60.71% -23.50%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 16,546 21,313 20,587
As % of all contract IT jobs advertised in England 21.60% 22.67% 22.10%
Number of daily rates quoted 11,349 15,002 14,212
England median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +5.88%
10th Percentile £325 £319 £310
90th Percentile £663 £640 £638
UK median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 232 222 255
England median hourly rate £32.00 £32.99 £31.00
Median hourly rate % change year-on-year -2.99% +6.41% +10.71%
10th Percentile £14.00 £14.00 £14.25
90th Percentile £71.93 £57.20 £53.00
UK median hourly rate £32.50 £32.48 £30.50
% change year-on-year +0.08% +6.48% +8.23%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in England.

Contractor daily rate trend for Hadoop in England

Hadoop
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Hadoop in England over the 6 months to 12 November 2019.

Contractor daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in England.

Contractor hourly rate trend for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 12 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -39 733 £575 - 128
North of England +46 182 £525 +5.00% 20
South East -76 156 £500 -4.76% 43
North West +78 122 £538 +2.38% 13
Yorkshire -24 53 £481 -3.75% 6
South West -46 50 £600 +14.29% 28
East of England -10 47 £600 +21.52% 18
Midlands -1 34 £525 +13.51% 15
East Midlands -14 19 £525 +25.37% 6
West Midlands +28 15 £513 +7.89% 9
North East +25 8 £550 -22.15% 1
Hadoop
UK

For the 6 months to 12 November 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 715 (58.99%) Big Data
2 660 (54.46%) Python
3 659 (54.37%) Apache Spark
4 492 (40.59%) SQL
5 420 (34.65%) Java
6 386 (31.85%) AWS
7 378 (31.19%) Agile Software Development
8 348 (28.71%) Kafka
9 322 (26.57%) Analytics
10 314 (25.91%) Apache Hive
11 281 (23.18%) Scala
12 270 (22.28%) ETL
13 259 (21.37%) Data Science
14 257 (21.20%) DevOps
15 256 (21.12%) Finance
16 254 (20.96%) Docker
17 243 (20.05%) Linux
18 221 (18.23%) Azure
19 206 (17.00%) Cloudera
20 198 (16.34%) Jenkins
21 187 (15.43%) NoSQL
22 186 (15.35%) Kubernetes
23 180 (14.85%) Machine Learning
24 179 (14.77%) GCP
25 164 (13.53%) Data Warehouse
26 163 (13.45%) Data Modelling
27 159 (13.12%) Google
27 159 (13.12%) Ansible
28 152 (12.54%) HBase
29 150 (12.38%) Oracle

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 659 (54.37%) Apache Spark
2 112 (9.24%) Apache
3 96 (7.92%) SAS
4 71 (5.86%) Elasticsearch
5 36 (2.97%) Apache Airflow
5 36 (2.97%) Jupyter
6 34 (2.81%) JBoss
7 28 (2.31%) Confluence
7 28 (2.31%) Tomcat
8 20 (1.65%) Apache Pig
9 16 (1.32%) Jetty
10 13 (1.07%) Luigi
11 10 (0.83%) Pachyderm
11 10 (0.83%) SharePoint
12 9 (0.74%) Apache Solr
13 6 (0.50%) Oracle Self-Service HR
13 6 (0.50%) WebLogic
14 2 (0.17%) CMS
14 2 (0.17%) nginx
14 2 (0.17%) Tornado
Applications
1 23 (1.90%) Microsoft Excel
2 9 (0.74%) SPSS
3 7 (0.58%) Stata
4 6 (0.50%) Spreadsheet
5 5 (0.41%) Microsoft Office
6 2 (0.17%) MS Visio
7 1 (0.083%) Microsoft Project
Business Applications
1 11 (0.91%) SAP Oil and Gas
2 9 (0.74%) FINCAD Analytics
3 2 (0.17%) Oracle Subledger Accounting
3 2 (0.17%) Sparx Enterprise Architect
4 1 (0.083%) Cognos Business Intelligence
4 1 (0.083%) NetSuite
4 1 (0.083%) Oracle Receivables
4 1 (0.083%) SAP MDM
Cloud Services
1 386 (31.85%) AWS
2 221 (18.23%) Azure
3 179 (14.77%) GCP
4 83 (6.85%) Amazon EMR
5 62 (5.12%) Amazon S3
6 57 (4.70%) Serverless
7 52 (4.29%) Power Platform
8 47 (3.88%) AWS Lambda
9 44 (3.63%) GitHub
10 36 (2.97%) Amazon Kinesis
11 29 (2.39%) Amazon EC2
12 24 (1.98%) OpenShift
13 17 (1.40%) Amazon SQS
14 16 (1.32%) Azure Data Factory
14 16 (1.32%) Cloud Computing
15 14 (1.16%) AWS CloudFormation
16 13 (1.07%) Virtual Private Cloud
17 12 (0.99%) Amazon EKS
18 11 (0.91%) Amazon SageMaker
19 10 (0.83%) Amazon CloudWatch
Communications & Networking
1 19 (1.57%) Kerberos
2 17 (1.40%) SSH
3 12 (0.99%) Firewall
4 10 (0.83%) Internet
5 8 (0.66%) SSL
6 7 (0.58%) SAN
7 5 (0.41%) Wi-Fi
8 4 (0.33%) 5G
8 4 (0.33%) F5 BIG-IP GTM
8 4 (0.33%) F5 BIG-IP LTM
8 4 (0.33%) HTTP
8 4 (0.33%) Multicast
8 4 (0.33%) OpenLDAP
8 4 (0.33%) Radio Access Network
8 4 (0.33%) TCP/IP
9 3 (0.25%) 4G
9 3 (0.25%) Software-Defined Networking
9 3 (0.25%) Wireshark
10 2 (0.17%) Extranet
10 2 (0.17%) Intranet
Database & Business Intelligence
1 715 (58.99%) Big Data
2 314 (25.91%) Apache Hive
3 187 (15.43%) NoSQL
4 164 (13.53%) Data Warehouse
5 152 (12.54%) HBase
6 149 (12.29%) MongoDB
7 127 (10.48%) Data Lake
8 117 (9.65%) PostgreSQL
9 103 (8.50%) Impala
10 96 (7.92%) Relational Database
11 81 (6.68%) SQL Server
12 74 (6.11%) Amazon Redshift
12 74 (6.11%) Apache Cassandra
13 73 (6.02%) BigQuery
14 72 (5.94%) MySQL
15 58 (4.79%) Sqoop
16 52 (4.29%) Power BI
17 44 (3.63%) Spark SQL
18 42 (3.47%) Flink
19 41 (3.38%) Pentaho
Development Applications
1 198 (16.34%) Jenkins
2 146 (12.05%) Git (software)
3 92 (7.59%) JIRA
4 47 (3.88%) Maven
5 38 (3.14%) GitLab
6 37 (3.05%) Atlassian Bamboo
7 32 (2.64%) Cucumber
8 21 (1.73%) Gradle
9 17 (1.40%) Subversion
9 17 (1.40%) Vagrant
10 15 (1.24%) Mercurial
11 14 (1.16%) Sonatype Nexus
12 12 (0.99%) ERwin
12 12 (0.99%) SonarQube
12 12 (0.99%) Team Foundation Server
13 11 (0.91%) Ant
14 10 (0.83%) Bitbucket
14 10 (0.83%) PowerDesigner
14 10 (0.83%) Selenium
15 9 (0.74%) IntelliJ
General
1 256 (21.12%) Finance
2 99 (8.17%) Banking
3 48 (3.96%) Retail
4 42 (3.47%) Front Office
5 34 (2.81%) Investment Banking
6 24 (1.98%) Public Sector
7 23 (1.90%) Legal
8 20 (1.65%) Marketing
8 20 (1.65%) Telecoms
9 12 (0.99%) Pharmaceutical
10 10 (0.83%) Games
10 10 (0.83%) Publishing
10 10 (0.83%) Retail Banking
11 9 (0.74%) Financial Institution
12 5 (0.41%) Advertising
12 5 (0.41%) Manufacturing
13 4 (0.33%) Automotive
14 2 (0.17%) Aerospace
14 2 (0.17%) Greek Language
14 2 (0.17%) Military
Job Titles
1 353 (29.13%) Data Engineer
2 240 (19.80%) Developer
3 156 (12.87%) Architect
4 104 (8.58%) Big Data Engineer
5 98 (8.09%) Data Architect
6 86 (7.10%) Java Developer
7 85 (7.01%) Administrator
8 69 (5.69%) Python Engineer
9 66 (5.45%) Data Scientist
10 61 (5.03%) DevOps Engineer
11 60 (4.95%) Analyst
11 60 (4.95%) Hadoop Engineer
12 56 (4.62%) Python Developer
13 52 (4.29%) Big Data Developer
14 51 (4.21%) AWS Engineer
15 48 (3.96%) Java Engineer
16 47 (3.88%) Hadoop Developer
17 42 (3.47%) Big Data Architect
17 42 (3.47%) Senior Developer
18 41 (3.38%) Software Engineer
Libraries, Frameworks & Software Standards
1 348 (28.71%) Kafka
2 89 (7.34%) PySpark
3 81 (6.68%) Spring
4 56 (4.62%) Web Services
5 54 (4.46%) Spark Streaming
6 53 (4.37%) Pandas
7 52 (4.29%) Apache NiFi
8 51 (4.21%) React
9 46 (3.80%) REST
10 37 (3.05%) Hibernate
11 36 (2.97%) AngularJS
11 36 (2.97%) Flask
12 35 (2.89%) Natural Language Processing
12 35 (2.89%) RabbitMQ
13 32 (2.64%) RESTful
14 31 (2.56%) JSON
14 31 (2.56%) Spring Boot
15 28 (2.31%) Node.js
16 23 (1.90%) NumPy
17 22 (1.82%) XML
Miscellaneous
1 126 (10.40%) Algorithms
2 113 (9.32%) Analytical Skills
3 61 (5.03%) Data Structures
4 55 (4.54%) Greenfield Project
5 37 (3.05%) Self-Motivation
6 24 (1.98%) User Experience
7 23 (1.90%) Derivative
8 20 (1.65%) Virtual Team
9 19 (1.57%) Management Information System
10 18 (1.49%) Linux Command Line
11 16 (1.32%) Fixed Income
12 15 (1.24%) Cloud Native
12 15 (1.24%) Credit Risk
12 15 (1.24%) PKI
13 13 (1.07%) Hedge funds
14 12 (0.99%) Public Cloud
15 8 (0.66%) Clustering
15 8 (0.66%) Data Centre
15 8 (0.66%) Market Risk
15 8 (0.66%) Reference Data
Operating Systems
1 243 (20.05%) Linux
2 126 (10.40%) Unix
3 53 (4.37%) Windows
4 47 (3.88%) Red Hat Enterprise Linux
5 36 (2.97%) CentOS
6 27 (2.23%) Ubuntu
7 19 (1.57%) Windows Server
8 14 (1.16%) Debian
9 10 (0.83%) Android
9 10 (0.83%) Apple iOS
10 8 (0.66%) Mac OS X
11 3 (0.25%) Solaris
12 2 (0.17%) SUSE Linux Enterprise Server
13 1 (0.083%) AIX
13 1 (0.083%) CoreOS
13 1 (0.083%) Oracle Linux
13 1 (0.083%) Windows Server 2012
13 1 (0.083%) zOS
Processes & Methodologies
1 378 (31.19%) Agile Software Development
2 322 (26.57%) Analytics
3 270 (22.28%) ETL
4 259 (21.37%) Data Science
5 257 (21.20%) DevOps
6 180 (14.85%) Machine Learning
7 163 (13.45%) Data Modelling
8 147 (12.13%) Software Engineering
9 142 (11.72%) Migration
10 132 (10.89%) Business Intelligence
11 122 (10.07%) Microservices
11 122 (10.07%) Problem-Solving
12 120 (9.90%) Continuous Integration
13 119 (9.82%) Computer Science
14 114 (9.41%) TDD
15 100 (8.25%) Data Architecture
15 100 (8.25%) Scrum
16 98 (8.09%) Data Engineering
17 94 (7.76%) Visualisation
18 91 (7.51%) Open Source
Programming Languages
1 660 (54.46%) Python
2 492 (40.59%) SQL
3 420 (34.65%) Java
4 281 (23.18%) Scala
5 117 (9.65%) R
6 87 (7.18%) JavaScript
7 57 (4.70%) C++
8 48 (3.96%) Shell Script
9 47 (3.88%) Java 8
10 46 (3.80%) Bash Shell
11 44 (3.63%) C
12 43 (3.55%) C#
13 36 (2.97%) Perl
14 32 (2.64%) Ruby
15 26 (2.15%) Groovy
16 25 (2.06%) Go
17 24 (1.98%) PL/SQL
18 22 (1.82%) PowerShell
19 17 (1.40%) MATLAB
19 17 (1.40%) T-SQL
Qualifications
1 119 (9.82%) Security Cleared
2 103 (8.50%) Degree
3 72 (5.94%) SC Cleared
4 50 (4.13%) DV Cleared
5 46 (3.80%) Computer Science Degree
6 31 (2.56%) PhD
7 18 (1.49%) Master's Degree
8 15 (1.24%) CCA
9 9 (0.74%) Cisco Certification
10 8 (0.66%) BPSS Clearance
10 8 (0.66%) Numerate Degree
11 7 (0.58%) CISSP
11 7 (0.58%) TOGAF Certification
12 5 (0.41%) (ISC)2 CCSP
12 5 (0.41%) AWS Certification
12 5 (0.41%) CSSLP
12 5 (0.41%) DBS Check
12 5 (0.41%) ISSAP
12 5 (0.41%) SAS Certification
13 4 (0.33%) CCIE
Quality Assurance & Compliance
1 42 (3.47%) Data Quality
2 19 (1.57%) QA
3 13 (1.07%) Sarbanes-Oxley
4 7 (0.58%) GxP
5 6 (0.50%) ISO/IEC 27001
6 5 (0.41%) GDPR
6 5 (0.41%) PMO
7 4 (0.33%) Disclosure Scotland
8 3 (0.25%) PCI DSS
8 3 (0.25%) SLA
9 1 (0.083%) Basel III
9 1 (0.083%) EMIR
9 1 (0.083%) IFRS
9 1 (0.083%) IFRS 9
9 1 (0.083%) MiFID
System Software
1 254 (20.96%) Docker
2 128 (10.56%) HDFS
3 32 (2.64%) Apache Flume
4 20 (1.65%) Apache ZooKeeper
5 9 (0.74%) VirtualBox
6 8 (0.66%) Virtual Servers
7 7 (0.58%) Active Directory
7 7 (0.58%) Virtual Desktop
7 7 (0.58%) vSphere
8 4 (0.33%) VMware ESXi
9 2 (0.17%) Samba
9 2 (0.17%) VMware Infrastructure
Systems Management
1 186 (15.35%) Kubernetes
2 159 (13.12%) Ansible
3 121 (9.98%) Terraform
4 92 (7.59%) Puppet
5 67 (5.53%) Hadoop YARN
6 50 (4.13%) Oozie
7 35 (2.89%) Opscode Chef
8 20 (1.65%) Packer
9 14 (1.16%) Cobbler
10 10 (0.83%) ITRS Geneos
10 10 (0.83%) Kubeflow
10 10 (0.83%) Prometheus
11 9 (0.74%) Ambari
11 9 (0.74%) Docker Swarm
11 9 (0.74%) ZABBIX
12 8 (0.66%) Consul
12 8 (0.66%) Salt
13 7 (0.58%) Kibana
14 6 (0.50%) logstash
14 6 (0.50%) Mesos
Vendors
1 206 (17.00%) Cloudera
2 159 (13.12%) Google
3 150 (12.38%) Oracle
4 115 (9.49%) Hortonworks
5 89 (7.34%) Tableau
6 82 (6.77%) Microsoft
7 68 (5.61%) Informatica
8 59 (4.87%) Talend
9 57 (4.70%) Teradata
10 43 (3.55%) Red Hat
11 37 (3.05%) Databricks
12 30 (2.48%) SAP
13 28 (2.31%) Splunk
14 22 (1.82%) Atlassian
14 22 (1.82%) MapR
15 16 (1.32%) IBM
15 16 (1.32%) Palantir
16 15 (1.24%) Sybase
17 14 (1.16%) Ab Initio
17 14 (1.16%) Alteryx