Period
to 21 August 2017

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 21 August 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK
6 months to
21 Aug 2017
Same period 2016 Same period 2015
Rank 110 156 239
Rank change year-on-year +46 +83 +132
Contract jobs citing Hadoop 2126 1838 1137
As % of all contract IT jobs advertised in the UK 2.22% 1.69% 1.00%
As % of the Database & Business Intelligence category 9.80% 7.63% 4.32%
Number of daily rates quoted 1417 1226 780
UK median daily rate £525 £525 £545
Median daily rate % change year-on-year - -3.67% +3.81%
10th Percentile £375 £363 £363
90th Percentile £675 £713 £700
UK excluding London median daily rate £450 £460 £475
% change year-on-year -2.17% -3.16% +5.56%
Number of hourly rates quoted 7 9 6
UK median hourly rate £35.00 £45.00 £28.00
Median hourly rate % change year-on-year -22.22% +60.71% -12.50%
10th Percentile £16.49 £35.40 £25.25
90th Percentile £50.00 £46.15 £44.28
UK excluding London median hourly rate £35.00 £45.00 £28.00
% change year-on-year -22.22% +60.71% -

Hadoop is in the database and business intelligence skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database and business intelligence skills.

Contract Database & Business Intelligence Skills
UK
Contract job vacancies with a requirement for database and business intelligence skills 21698 24076 26293
As % of all contract IT job vacancies advertised in the UK 22.65% 22.20% 23.16%
Number of daily rates quoted 14438 16130 17100
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +3.90%
10th Percentile £300 £281 £263
90th Percentile £625 £600 £575
UK excluding London median daily rate £400 £375 £365
% change year-on-year +6.67% +2.74% +4.29%
Number of hourly rates quoted 255 382 382
UK median hourly rate £31.00 £28.50 £27.64
Median hourly rate % change year-on-year +8.77% +3.11% +0.51%
10th Percentile £11.48 £11.50 £14.00
90th Percentile £52.50 £48.71 £53.59
UK excluding London median hourly rate £31.50 £29.53 £28.13
% change year-on-year +6.69% +4.98% +0.45%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop.

Contractor daily rate trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Hadoop over the 6 months to 21 August 2017.

Contractor daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop.

Contractor hourly rate trend for Hadoop in the UK

Hadoop
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Hadoop over the 6 months to 21 August 2017.

Contractor hourly rate histogram for Hadoop in the UK

Hadoop
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 21 August 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +38 2026 £525 - 218
London +18 1404 £550 - 153
UK excluding London +57 699 £450 -2.17% 75
South East +51 268 £441 -3.29% 16
North of England +29 107 £500 - 24
South West +36 102 £450 - 7
East of England +17 88 £450 +28.57% 10
Scotland +64 62 £444 -11.25% 8
Yorkshire -8 56 £500 -4.76% 6
Midlands +2 47 £525 +10.53% 8
North West +33 46 £600 +37.93% 16
West Midlands +11 34 £496 -0.89% 5
Northern Ireland -34 19 £463 - 2
North East +53 13 £610 -15.86% 2
East Midlands -11 13 £525 +16.67% 3
Wales +14 6 £388 -22.50%

For the 6 months to 21 August 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Hadoop.

1 1451 (68.25%) Big Data
2 1010 (47.51%) Apache Spark
3 983 (46.24%) Java
4 891 (41.91%) Agile Software Development
5 665 (31.28%) Apache Hive
6 648 (30.48%) Python
7 598 (28.13%) SQL
8 540 (25.40%) Kafka
9 535 (25.16%) HBase
10 517 (24.32%) Scala
11 480 (22.58%) Analytics
12 476 (22.39%) Linux
13 455 (21.40%) Finance
14 419 (19.71%) TDD
15 406 (19.10%) Scrum
16 380 (17.87%) Amazon AWS
17 375 (17.64%) DevOps
18 370 (17.40%) Cloudera
19 362 (17.03%) HDFS
20 352 (16.56%) ETL
21 318 (14.96%) MapReduce
22 315 (14.82%) Jenkins
23 314 (14.77%) NoSQL
24 312 (14.68%) Banking
25 299 (14.06%) Unix
26 293 (13.78%) Docker
27 277 (13.03%) Apache
28 274 (12.89%) JIRA
29 270 (12.70%) BDD
30 262 (12.32%) Git (software)

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1010 (47.51%) Apache Spark
2 277 (13.03%) Apache
3 168 (7.90%) Apache Pig
4 157 (7.38%) Elasticsearch
5 138 (6.49%) Confluence
6 135 (6.35%) SAS
7 132 (6.21%) Apache Solr
8 57 (2.68%) Tomcat
9 34 (1.60%) JBoss
10 24 (1.13%) WebSphere
11 23 (1.08%) OpenStack
12 21 (0.99%) nginx
13 20 (0.94%) Oracle SOA Suite
14 15 (0.71%) WebLogic
15 14 (0.66%) Apache Airflow
16 12 (0.56%) Cloud Foundry
17 11 (0.52%) GlassFish
17 11 (0.52%) WildFly
18 9 (0.42%) GemFire
19 8 (0.38%) Oracle Coherence
Applications
1 31 (1.46%) Microsoft Excel
2 27 (1.27%) SPSS
3 9 (0.42%) Microsoft Office
4 7 (0.33%) Stata
5 5 (0.24%) Microsoft PowerPoint
6 3 (0.14%) Pipeline Pilot
7 2 (0.094%) Microsoft Project
8 1 (0.047%) GNU Octave
8 1 (0.047%) HipChat
8 1 (0.047%) MS Visio
Business Applications
1 9 (0.42%) Actimize
2 4 (0.19%) Oracle BPM
3 3 (0.14%) Oracle Applications
4 2 (0.094%) WebTrends
5 1 (0.047%) Adobe Campaign
5 1 (0.047%) Dynamics CRM
5 1 (0.047%) Oracle Receivables
5 1 (0.047%) SAP HR
5 1 (0.047%) SAP Oil and Gas
5 1 (0.047%) Unica
Cloud Services
1 380 (17.87%) Amazon AWS
2 113 (5.32%) GitHub
3 111 (5.22%) Microsoft Azure
4 56 (2.63%) Amazon EC2
5 46 (2.16%) Amazon S3
6 40 (1.88%) Google Cloud Platform
7 36 (1.69%) PaaS
8 35 (1.65%) Virtual Private Cloud
9 34 (1.60%) Cloud Computing
10 27 (1.27%) Amazon EMR
11 20 (0.94%) IBM Cloud
12 19 (0.89%) IaaS
13 17 (0.80%) Bluemix
14 15 (0.71%) Amazon CloudWatch
15 13 (0.61%) SaaS
16 11 (0.52%) Google Analytics
17 9 (0.42%) Office 365
18 8 (0.38%) Adobe Analytics
19 7 (0.33%) Amazon Kinesis
19 7 (0.33%) AWS Lambda
Communications & Networking
1 141 (6.63%) Kerberos
2 35 (1.65%) LDAP
3 32 (1.51%) HTTP
4 30 (1.41%) Firewall
5 24 (1.13%) VPN
6 21 (0.99%) Network Security
7 19 (0.89%) LAN
8 18 (0.85%) WAN
9 13 (0.61%) Internet
9 13 (0.61%) NAS
9 13 (0.61%) SAN
10 12 (0.56%) SSL
11 11 (0.52%) DNS
12 10 (0.47%) DSL
13 7 (0.33%) tcpdump
13 7 (0.33%) Wireshark
14 6 (0.28%) AMQP
14 6 (0.28%) SSH
15 5 (0.24%) DMZ
15 5 (0.24%) OpenLDAP
Database & Business Intelligence
1 1451 (68.25%) Big Data
2 665 (31.28%) Apache Hive
3 535 (25.16%) HBase
4 314 (14.77%) NoSQL
5 244 (11.48%) MongoDB
6 226 (10.63%) Apache Cassandra
7 222 (10.44%) Impala
8 221 (10.40%) Data Warehouse
9 197 (9.27%) PostgreSQL
10 193 (9.08%) SQL Server
11 170 (8.00%) Sqoop
12 155 (7.29%) Relational Database
13 106 (4.99%) MySQL
14 70 (3.29%) Data Lake
15 67 (3.15%) RDBMS
16 58 (2.73%) Data Mining
17 49 (2.30%) BusinessObjects
17 49 (2.30%) QlikView
18 43 (2.02%) Amazon DynamoDB
18 43 (2.02%) Neo4j
Development Applications
1 315 (14.82%) Jenkins
2 274 (12.89%) JIRA
3 262 (12.32%) Git (software)
4 104 (4.89%) Cucumber
5 63 (2.96%) Maven
6 59 (2.78%) JUnit
7 50 (2.35%) IntelliJ
8 49 (2.30%) TeamCity
9 48 (2.26%) Vagrant
10 43 (2.02%) Talend Open Studio
11 37 (1.74%) GitLab
12 36 (1.69%) Team Foundation Server
13 31 (1.46%) Eclipse
14 28 (1.32%) Mockito
15 27 (1.27%) Hudson
16 26 (1.22%) Artifactory
16 26 (1.22%) Gradle
16 26 (1.22%) Subversion
17 23 (1.08%) Sonatype Nexus
18 22 (1.03%) Ant
General
1 455 (21.40%) Finance
2 312 (14.68%) Banking
3 122 (5.74%) Investment Banking
4 103 (4.84%) Marketing
5 95 (4.47%) Telecoms
6 79 (3.72%) Retail
7 65 (3.06%) Front Office
8 51 (2.40%) Electronics
8 51 (2.40%) Manufacturing
9 20 (0.94%) Legal
10 18 (0.85%) Retail Banking
11 13 (0.61%) Financial Institution
11 13 (0.61%) Games
12 9 (0.42%) Back Office
13 8 (0.38%) Pharmaceutical
14 7 (0.33%) Law
14 7 (0.33%) Publishing
15 4 (0.19%) Advertising
15 4 (0.19%) Corporate Banking
16 3 (0.14%) German Language
Job Titles
1 732 (34.43%) Developer
2 297 (13.97%) Java Developer
3 278 (13.08%) Data Engineer
4 276 (12.98%) Big Data Developer
5 255 (11.99%) Architect
6 234 (11.01%) Big Data Engineer
7 185 (8.70%) Analyst
8 178 (8.37%) Hadoop Developer
9 151 (7.10%) Hadoop Engineer
10 149 (7.01%) Data Architect
11 136 (6.40%) Scala Developer
12 122 (5.74%) DevOps Engineer
13 107 (5.03%) Administrator
14 101 (4.75%) Data Analyst
15 100 (4.70%) Senior Developer
16 88 (4.14%) Data Scientist
17 85 (4.00%) Big Data Architect
18 83 (3.90%) Consultant
19 79 (3.72%) Apache Spark Developer
20 72 (3.39%) Java Hadoop Developer
Libraries, Frameworks & Software Standards
1 540 (25.40%) Kafka
2 242 (11.38%) Spring
3 231 (10.87%) REST
4 163 (7.67%) Web Services
5 139 (6.54%) JSON
6 129 (6.07%) Spring Boot
7 122 (5.74%) RESTful
8 96 (4.52%) .NET
9 95 (4.47%) AngularJS
10 94 (4.42%) Apache Camel
11 81 (3.81%) Spark Streaming
12 78 (3.67%) RabbitMQ
13 74 (3.48%) HTML
14 72 (3.39%) Akka
15 70 (3.29%) XML
16 66 (3.10%) Hibernate
17 64 (3.01%) Middleware
18 62 (2.92%) Drools
19 61 (2.87%) Node.js
20 59 (2.78%) CSS
Miscellaneous
1 232 (10.91%) Analytical Skills
2 145 (6.82%) Algorithms
3 96 (4.52%) Computer Science
4 67 (3.15%) Greenfield Project
5 50 (2.35%) Data Structures
6 46 (2.16%) Market Risk
7 42 (1.98%) User Experience
8 39 (1.83%) Data Centre
9 37 (1.74%) Linux Command Line
10 36 (1.69%) Management Information System
11 31 (1.46%) Public Cloud
12 27 (1.27%) Foreign Exchange (FX)
13 25 (1.18%) Reference Data
14 23 (1.08%) Virtual Team
15 17 (0.80%) Credit Risk
15 17 (0.80%) Fintech
15 17 (0.80%) Replication
16 16 (0.75%) Equities
17 14 (0.66%) Blog
17 14 (0.66%) Derivative
Operating Systems
1 476 (22.39%) Linux
2 299 (14.06%) Unix
3 88 (4.14%) Red Hat Enterprise Linux
3 88 (4.14%) Windows
4 48 (2.26%) Ubuntu
5 40 (1.88%) CentOS
6 26 (1.22%) Debian
7 15 (0.71%) Apple iOS
8 13 (0.61%) Android
9 12 (0.56%) Solaris
9 12 (0.56%) Windows Vista
10 7 (0.33%) AIX
10 7 (0.33%) Windows Server
11 6 (0.28%) CoreOS
11 6 (0.28%) Fedora
12 5 (0.24%) Windows Server 2012
13 3 (0.14%) Windows Server 2003
14 2 (0.094%) Mac OS X
15 1 (0.047%) MVS
15 1 (0.047%) SUSE
Processes & Methodologies
1 891 (41.91%) Agile Software Development
2 480 (22.58%) Analytics
3 419 (19.71%) TDD
4 406 (19.10%) Scrum
5 375 (17.64%) DevOps
6 352 (16.56%) ETL
7 318 (14.96%) MapReduce
8 270 (12.70%) BDD
9 244 (11.48%) Continuous Integration
10 239 (11.24%) Data Modelling
11 230 (10.82%) Microservices
12 227 (10.68%) Open Source
13 225 (10.58%) Business Intelligence
14 196 (9.22%) Machine Learning
15 174 (8.18%) Data Architecture
16 170 (8.00%) Data Analytics
17 151 (7.10%) Test Automation
18 149 (7.01%) Visualisation
19 129 (6.07%) Software Engineering
20 114 (5.36%) Data Analysis
Programming Languages
1 983 (46.24%) Java
2 648 (30.48%) Python
3 598 (28.13%) SQL
4 517 (24.32%) Scala
5 203 (9.55%) R
6 159 (7.48%) Shell Script
7 137 (6.44%) JavaScript
8 102 (4.80%) C#
9 100 (4.70%) Bash Shell
10 64 (3.01%) Ruby
11 55 (2.59%) Perl
12 39 (1.83%) C++
13 30 (1.41%) Groovy
14 29 (1.36%) C
15 24 (1.13%) Go
16 22 (1.03%) PL/SQL
16 22 (1.03%) PowerShell
17 20 (0.94%) MATLAB
18 16 (0.75%) HiveQL
19 15 (0.71%) PHP
Qualifications
1 259 (12.18%) Security Cleared
2 196 (9.22%) SC Cleared
3 148 (6.96%) Degree
4 43 (2.02%) DV Cleared
5 35 (1.65%) Computer Science Degree
6 26 (1.22%) Master's Degree
7 19 (0.89%) PhD
8 16 (0.75%) CISSP
9 11 (0.52%) Microsoft Certification
10 10 (0.47%) CISM
11 9 (0.42%) Numerate Degree
12 8 (0.38%) MCITP
12 8 (0.38%) MCSE
13 7 (0.33%) BPSS Clearance
13 7 (0.33%) CESG Certified Professional
13 7 (0.33%) CISA
13 7 (0.33%) Cisco Certification
13 7 (0.33%) CLAS
14 6 (0.28%) CCNA
14 6 (0.28%) CCSP
Quality Assurance & Compliance
1 103 (4.84%) QA
2 93 (4.37%) Data Quality
3 13 (0.61%) GDPR
3 13 (0.61%) MiFID
4 10 (0.47%) PCI DSS
5 8 (0.38%) Actionable Recommendations
6 6 (0.28%) FedRAMP
6 6 (0.28%) JSP 440
7 5 (0.24%) Disclosure Scotland
7 5 (0.24%) SLA
8 4 (0.19%) Dodd-Frank
8 4 (0.19%) GCP
9 3 (0.14%) EMIR
9 3 (0.14%) ISAE 3402
9 3 (0.14%) ISO/IEC 27001
9 3 (0.14%) SSAE 16
10 2 (0.094%) Basel III
10 2 (0.094%) CDISC
11 1 (0.047%) IFRS
11 1 (0.047%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 362 (17.03%) HDFS
2 293 (13.78%) Docker
3 216 (10.16%) Apache Flume
4 137 (6.44%) Apache ZooKeeper
5 45 (2.12%) Active Directory
6 23 (1.08%) VMware Infrastructure
7 17 (0.80%) Virtual Machines
8 14 (0.66%) Hyper-V
9 8 (0.38%) OpenAM
10 7 (0.33%) etcd
10 7 (0.33%) flannel
10 7 (0.33%) Oracle RAC
11 4 (0.19%) NFS
11 4 (0.19%) Squid
11 4 (0.19%) vCloud
12 3 (0.14%) VMware ESXi
13 2 (0.094%) KVM
13 2 (0.094%) SRDF
13 2 (0.094%) vSphere
13 2 (0.094%) Xen
Systems Management
1 209 (9.83%) Ansible
2 162 (7.62%) Hadoop YARN
3 149 (7.01%) Kubernetes
4 148 (6.96%) Oozie
5 121 (5.69%) Puppet
6 111 (5.22%) Terraform
7 92 (4.33%) Opscode Chef
8 59 (2.78%) Ambari
9 31 (1.46%) Mesos
10 25 (1.18%) Kibana
11 24 (1.13%) Nagios
12 22 (1.03%) Prometheus
13 21 (0.99%) Graphite
13 21 (0.99%) ZABBIX
14 17 (0.80%) logstash
15 13 (0.61%) Control-M
16 8 (0.38%) Microsoft Clustering
16 8 (0.38%) SCCM
16 8 (0.38%) SCOM
17 7 (0.33%) Packer
Vendors
1 370 (17.40%) Cloudera
2 243 (11.43%) Oracle
3 140 (6.59%) Hortonworks
4 125 (5.88%) Tableau
5 97 (4.56%) Teradata
6 92 (4.33%) SAP
7 82 (3.86%) Microsoft
8 79 (3.72%) IBM
9 77 (3.62%) Google
10 75 (3.53%) Informatica
11 74 (3.48%) Red Hat
12 47 (2.21%) Splunk
13 43 (2.02%) Talend
14 42 (1.98%) MapR
15 39 (1.83%) VMware
16 34 (1.60%) Ab Initio
17 15 (0.71%) HP
17 15 (0.71%) MicroStrategy
18 14 (0.66%) Sybase
19 13 (0.61%) Atlassian