Period
to 17 November 2017

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 17 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
17 Nov 2017
Same period 2016 Same period 2015
Rank 110 115 206
Rank change year-on-year +5 +91 +111
Contract jobs citing Hadoop 2097 2145 1291
As % of all contract IT jobs advertised in England 2.22% 2.18% 1.23%
As % of the Database & Business Intelligence category 10.06% 9.65% 5.25%
Number of daily rates quoted 1476 1384 857
England median daily rate £538 £525 £525
Median daily rate % change year-on-year +2.38% - -
10th Percentile £400 £363 £371
90th Percentile £675 £700 £676
UK median daily rate £533 £525 £525
% change year-on-year +1.43% - -
Number of hourly rates quoted 10 7 5
England median hourly rate £32.75 £46.00 £37.50
Median hourly rate % change year-on-year -28.80% +22.67% +5.63%
10th Percentile £16.60 £39.58 £33.55
90th Percentile £47.75 £72.05 £49.00
UK median hourly rate £32.75 £46.00 £37.50
% change year-on-year -28.80% +22.67% +5.63%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 20838 22232 24572
As % of all contract IT jobs advertised in England 22.05% 22.59% 23.39%
Number of daily rates quoted 14415 14914 16340
England median daily rate £453 £425 £413
Median daily rate % change year-on-year +6.47% +3.03% +3.13%
10th Percentile £313 £288 £275
90th Percentile £638 £600 £588
UK median daily rate £450 £425 £400
% change year-on-year +5.88% +6.25% +1.27%
Number of hourly rates quoted 262 322 381
England median hourly rate £31.75 £28.00 £27.78
Median hourly rate % change year-on-year +13.39% +0.79% +15.75%
10th Percentile £14.28 £11.25 £12.00
90th Percentile £56.64 £48.68 £52.17
UK median hourly rate £31.23 £28.18 £28.50
% change year-on-year +10.82% -1.12% +16.33%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in England.

Contractor daily rate trend for Hadoop in England

Hadoop
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Hadoop in England over the 6 months to 17 November 2017.

Contractor daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in England.

Contractor hourly rate trend for Hadoop in England

Hadoop
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Hadoop in England over the 6 months to 17 November 2017.

Contractor hourly rate histogram for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 17 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -7 1410 £550 - 99
South East +43 340 £500 +11.11% 13
North of England +56 135 £508 +1.75% 24
South West +13 87 £453 -0.28% 7
East of England -4 79 £481 +37.50% 12
Yorkshire +21 70 £465 -3.13% 9
North West +37 68 £600 +17.07% 14
Midlands 0 40 £500 +5.26% 6
West Midlands -4 24 £475 -5.00% 4
East Midlands +1 16 £525 +23.53% 2
North East +74 15 £610 +22.00% 1
Hadoop
UK

For the 6 months to 17 November 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the England region with a requirement for Hadoop.

1 1511 (72.06%) Big Data
2 1110 (52.93%) Apache Spark
3 1001 (47.73%) Java
4 837 (39.91%) Agile Software Development
5 659 (31.43%) Python
6 605 (28.85%) Apache Hive
7 598 (28.52%) Kafka
8 592 (28.23%) SQL
9 559 (26.66%) HBase
10 487 (23.22%) TDD
11 481 (22.94%) Scala
12 468 (22.32%) Linux
13 454 (21.65%) Amazon AWS
14 441 (21.03%) Finance
15 439 (20.93%) Analytics
16 413 (19.69%) HDFS
17 410 (19.55%) Scrum
18 380 (18.12%) DevOps
19 360 (17.17%) NoSQL
20 343 (16.36%) Docker
21 336 (16.02%) Jenkins
22 327 (15.59%) MapReduce
23 324 (15.45%) Cloudera
24 311 (14.83%) Security Cleared
25 304 (14.50%) BDD
25 304 (14.50%) ETL
26 303 (14.45%) Banking
27 292 (13.92%) Spring
28 286 (13.64%) JIRA
29 262 (12.49%) Git (software)

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1110 (52.93%) Apache Spark
2 249 (11.87%) Apache
3 178 (8.49%) Confluence
4 131 (6.25%) Apache Pig
5 125 (5.96%) Elasticsearch
6 117 (5.58%) Apache Solr
7 96 (4.58%) SAS
8 84 (4.01%) Tomcat
9 56 (2.67%) JBoss
10 32 (1.53%) Jetty
11 29 (1.38%) Oracle SOA Suite
12 25 (1.19%) OpenStack
13 24 (1.14%) nginx
14 22 (1.05%) Apache Airflow
15 17 (0.81%) Cloud Foundry
16 16 (0.76%) GemFire
17 11 (0.52%) GlassFish
17 11 (0.52%) WebSphere
17 11 (0.52%) WildFly
18 10 (0.48%) Luigi
Applications
1 25 (1.19%) SPSS
2 24 (1.14%) Microsoft Excel
3 10 (0.48%) Microsoft Office
3 10 (0.48%) Pipeline Pilot
4 4 (0.19%) Stata
5 2 (0.095%) Microsoft Project
6 1 (0.048%) Adobe Illustrator
6 1 (0.048%) Gephi
6 1 (0.048%) GNU Octave
6 1 (0.048%) HipChat
6 1 (0.048%) Microsoft PowerPoint
6 1 (0.048%) MS Visio
6 1 (0.048%) Photoshop
Business Applications
1 13 (0.62%) Oracle BPM
2 2 (0.095%) SAP CRM
2 2 (0.095%) SAP HR
2 2 (0.095%) WebTrends
3 1 (0.048%) Dynamics CRM
Cloud Services
1 454 (21.65%) Amazon AWS
2 150 (7.15%) GitHub
3 125 (5.96%) Microsoft Azure
4 68 (3.24%) Google Cloud Platform
5 52 (2.48%) Amazon S3
6 45 (2.15%) Amazon EC2
7 42 (2.00%) PaaS
8 38 (1.81%) IBM Cloud
9 37 (1.76%) Bluemix
10 36 (1.72%) Amazon EMR
11 23 (1.10%) Virtual Private Cloud
12 21 (1.00%) Cloud Computing
12 21 (1.00%) SaaS
13 19 (0.91%) IaaS
14 15 (0.72%) Amazon Kinesis
14 15 (0.72%) AWS CloudFormation
15 14 (0.67%) Google Analytics
16 12 (0.57%) Amazon CloudWatch
17 10 (0.48%) OpenShift
17 10 (0.48%) Serverless
Communications & Networking
1 178 (8.49%) Kerberos
2 34 (1.62%) Network Security
3 22 (1.05%) LDAP
4 21 (1.00%) VPN
5 20 (0.95%) HTTP
6 17 (0.81%) Firewall
6 17 (0.81%) LAN
6 17 (0.81%) WAN
7 16 (0.76%) Internet
7 16 (0.76%) SSL
8 11 (0.52%) DSL
8 11 (0.52%) SAN
9 10 (0.48%) DNS
10 9 (0.43%) DMZ
10 9 (0.43%) NAS
11 7 (0.33%) AMQP
11 7 (0.33%) TCP/IP
12 5 (0.24%) ICMP
12 5 (0.24%) Remote Desktop
13 4 (0.19%) SSH
Database & Business Intelligence
1 1511 (72.06%) Big Data
2 605 (28.85%) Apache Hive
3 559 (26.66%) HBase
4 360 (17.17%) NoSQL
5 256 (12.21%) MongoDB
6 239 (11.40%) PostgreSQL
7 199 (9.49%) Data Warehouse
8 189 (9.01%) Impala
9 176 (8.39%) Apache Cassandra
10 169 (8.06%) SQL Server
11 167 (7.96%) Sqoop
12 150 (7.15%) Relational Database
13 92 (4.39%) Data Lake
13 92 (4.39%) MySQL
14 66 (3.15%) RDBMS
15 52 (2.48%) Data Mining
16 50 (2.38%) BusinessObjects
17 48 (2.29%) Amazon Redshift
18 44 (2.10%) Amazon DynamoDB
19 43 (2.05%) Oracle Database
Development Applications
1 336 (16.02%) Jenkins
2 286 (13.64%) JIRA
3 262 (12.49%) Git (software)
4 127 (6.06%) Cucumber
5 75 (3.58%) IntelliJ
6 56 (2.67%) Maven
7 45 (2.15%) TeamCity
8 44 (2.10%) JUnit
9 41 (1.96%) GitLab
10 38 (1.81%) Gradle
11 29 (1.38%) Team Foundation Server
11 29 (1.38%) Vagrant
12 28 (1.34%) Artifactory
13 24 (1.14%) Hudson
14 22 (1.05%) Eclipse
14 22 (1.05%) Sonatype Nexus
14 22 (1.05%) Talend Open Studio
15 21 (1.00%) Selenium
16 20 (0.95%) Subversion
17 17 (0.81%) Mockito
General
1 441 (21.03%) Finance
2 303 (14.45%) Banking
3 110 (5.25%) Telecoms
4 109 (5.20%) Marketing
5 105 (5.01%) Investment Banking
6 82 (3.91%) Retail
7 62 (2.96%) Electronics
8 61 (2.91%) Manufacturing
9 60 (2.86%) Front Office
10 28 (1.34%) Publishing
11 21 (1.00%) Retail Banking
12 17 (0.81%) Legal
13 15 (0.72%) Games
14 13 (0.62%) Pharmaceutical
15 9 (0.43%) Financial Institution
16 7 (0.33%) Law
17 5 (0.24%) Advertising
17 5 (0.24%) Back Office
18 4 (0.19%) Corporate Banking
19 3 (0.14%) Private Banking
Job Titles
1 716 (34.14%) Developer
2 338 (16.12%) Data Engineer
3 302 (14.40%) Java Developer
4 272 (12.97%) Architect
5 269 (12.83%) Big Data Engineer
6 268 (12.78%) Big Data Developer
7 172 (8.20%) Data Architect
8 169 (8.06%) Hadoop Engineer
9 160 (7.63%) Hadoop Developer
10 126 (6.01%) Data Scientist
11 125 (5.96%) Analyst
12 124 (5.91%) Scala Developer
13 110 (5.25%) DevOps Engineer
14 109 (5.20%) Big Data Architect
15 95 (4.53%) Senior Developer
16 85 (4.05%) Apache Spark Developer
17 76 (3.62%) Administrator
17 76 (3.62%) Consultant
18 71 (3.39%) Java Engineer
19 70 (3.34%) Data Analyst
Libraries, Frameworks & Software Standards
1 598 (28.52%) Kafka
2 292 (13.92%) Spring
3 258 (12.30%) REST
4 183 (8.73%) Spring Boot
5 159 (7.58%) Web Services
6 148 (7.06%) JSON
7 145 (6.91%) RESTful
8 119 (5.67%) Apache Camel
9 101 (4.82%) AngularJS
10 98 (4.67%) Hibernate
11 82 (3.91%) Spark Streaming
12 77 (3.67%) PySpark
13 74 (3.53%) Drools
14 71 (3.39%) RabbitMQ
15 70 (3.34%) XML
16 67 (3.20%) .NET
17 61 (2.91%) HTML
18 59 (2.81%) JMS
19 55 (2.62%) Akka
20 54 (2.58%) Elastic Stack
Miscellaneous
1 220 (10.49%) Analytical Skills
2 176 (8.39%) Algorithms
3 98 (4.67%) Greenfield Project
4 91 (4.34%) Computer Science
5 49 (2.34%) Market Risk
6 46 (2.19%) Data Centre
7 39 (1.86%) Management Information System
8 35 (1.67%) Data Structures
8 35 (1.67%) Fintech
9 32 (1.53%) Replication
9 32 (1.53%) User Experience
10 27 (1.29%) Public Cloud
10 27 (1.29%) Virtual Team
11 24 (1.14%) Linux Command Line
12 23 (1.10%) Foreign Exchange (FX)
13 18 (0.86%) Credit Risk
14 16 (0.76%) Derivative
15 15 (0.72%) Equities
16 14 (0.67%) Life Science
17 13 (0.62%) Reference Data
Operating Systems
1 468 (22.32%) Linux
2 243 (11.59%) Unix
3 76 (3.62%) Windows
4 75 (3.58%) Red Hat Enterprise Linux
5 38 (1.81%) CentOS
6 34 (1.62%) Ubuntu
7 18 (0.86%) Apple iOS
8 17 (0.81%) Android
9 9 (0.43%) Windows Server 2012
10 7 (0.33%) Windows Server
11 6 (0.29%) Solaris
11 6 (0.29%) VMS
12 5 (0.24%) AIX
12 5 (0.24%) Windows Vista
13 4 (0.19%) CoreOS
13 4 (0.19%) Mac OS X
14 3 (0.14%) Debian
15 2 (0.095%) SUSE
15 2 (0.095%) Windows Server 2003
16 1 (0.048%) MVS
Processes & Methodologies
1 837 (39.91%) Agile Software Development
2 487 (23.22%) TDD
3 439 (20.93%) Analytics
4 410 (19.55%) Scrum
5 380 (18.12%) DevOps
6 327 (15.59%) MapReduce
7 304 (14.50%) BDD
7 304 (14.50%) ETL
8 254 (12.11%) Microservices
9 250 (11.92%) Business Intelligence
10 246 (11.73%) Continuous Integration
11 239 (11.40%) Machine Learning
12 234 (11.16%) Open Source
13 213 (10.16%) Data Modelling
14 173 (8.25%) Data Architecture
15 166 (7.92%) Visualisation
16 155 (7.39%) Software Engineering
17 145 (6.91%) Kanban
18 131 (6.25%) Data Analytics
19 129 (6.15%) Test Automation
Programming Languages
1 1001 (47.73%) Java
2 659 (31.43%) Python
3 592 (28.23%) SQL
4 481 (22.94%) Scala
5 198 (9.44%) R
6 142 (6.77%) Shell Script
7 122 (5.82%) JavaScript
8 92 (4.39%) C#
9 88 (4.20%) Bash Shell
10 60 (2.86%) Ruby
11 43 (2.05%) C++
12 34 (1.62%) C
12 34 (1.62%) Groovy
12 34 (1.62%) Perl
13 31 (1.48%) PowerShell
14 30 (1.43%) Go
15 24 (1.14%) PL/SQL
16 21 (1.00%) MATLAB
16 21 (1.00%) T-SQL
17 20 (0.95%) PHP
Qualifications
1 311 (14.83%) Security Cleared
2 250 (11.92%) SC Cleared
3 133 (6.34%) Degree
4 43 (2.05%) DV Cleared
5 36 (1.72%) PhD
6 19 (0.91%) Computer Science Degree
7 16 (0.76%) Master's Degree
8 13 (0.62%) Numerate Degree
9 9 (0.43%) CISSP
10 7 (0.33%) BPSS Clearance
10 7 (0.33%) CESG Certified Professional
10 7 (0.33%) CLAS
10 7 (0.33%) DBS Check
10 7 (0.33%) Microsoft Certification
11 5 (0.24%) ISTQB
11 5 (0.24%) MCITP
11 5 (0.24%) MCSE
12 4 (0.19%) CCNA
12 4 (0.19%) Cisco Certification
12 4 (0.19%) VMware Certified Professional (VCP)
Quality Assurance & Compliance
1 82 (3.91%) QA
2 75 (3.58%) Data Quality
3 23 (1.10%) GDPR
4 10 (0.48%) GCP
5 9 (0.43%) MiFID
6 8 (0.38%) Actionable Recommendations
7 6 (0.29%) JSP 440
8 4 (0.19%) PCI DSS
9 3 (0.14%) Disclosure Scotland
9 3 (0.14%) Dodd-Frank
9 3 (0.14%) IFRS
9 3 (0.14%) IFRS 9
9 3 (0.14%) SLA
10 2 (0.095%) EMIR
10 2 (0.095%) FedRAMP
11 1 (0.048%) Basel III
11 1 (0.048%) COBIT
11 1 (0.048%) ISO/IEC 27001
11 1 (0.048%) NIST 800
11 1 (0.048%) PMO
System Software
1 413 (19.69%) HDFS
2 343 (16.36%) Docker
3 228 (10.87%) Apache Flume
4 121 (5.77%) Apache ZooKeeper
5 37 (1.76%) Active Directory
6 20 (0.95%) VMware Infrastructure
7 16 (0.76%) Virtual Machines
8 12 (0.57%) vCloud
9 7 (0.33%) Hyper-V
10 2 (0.095%) NFS
10 2 (0.095%) OpenAM
10 2 (0.095%) Oracle RAC
10 2 (0.095%) Veritas Volume Manager
10 2 (0.095%) VMware ESXi
11 1 (0.048%) etcd
11 1 (0.048%) flannel
11 1 (0.048%) Postfix
11 1 (0.048%) PowerHA
11 1 (0.048%) Squid
11 1 (0.048%) VirtualBox
Systems Management
1 252 (12.02%) Ansible
2 177 (8.44%) Kubernetes
3 166 (7.92%) Oozie
4 156 (7.44%) Hadoop YARN
5 149 (7.11%) Puppet
6 140 (6.68%) Terraform
7 113 (5.39%) Opscode Chef
8 110 (5.25%) Ambari
9 51 (2.43%) Mesos
10 24 (1.14%) Cobbler
10 24 (1.14%) ZABBIX
11 22 (1.05%) Kibana
12 19 (0.91%) ITRS Geneos
12 19 (0.91%) Prometheus
13 17 (0.81%) Graphite
14 16 (0.76%) Nagios
15 15 (0.72%) Control-M
16 11 (0.52%) Salt
17 10 (0.48%) logstash
18 6 (0.29%) HP Quality Center
Vendors
1 324 (15.45%) Cloudera
2 226 (10.78%) Oracle
3 181 (8.63%) Hortonworks
4 161 (7.68%) Tableau
5 110 (5.25%) SAP
6 101 (4.82%) Google
7 91 (4.34%) IBM
8 90 (4.29%) Microsoft
9 83 (3.96%) Red Hat
10 56 (2.67%) Teradata
11 55 (2.62%) Splunk
12 50 (2.38%) Informatica
13 41 (1.96%) MapR
14 39 (1.86%) VMware
15 24 (1.14%) AppDynamics
16 22 (1.05%) MicroStrategy
16 22 (1.05%) Talend
17 20 (0.95%) SaltStack
18 16 (0.76%) Atlassian
18 16 (0.76%) Netezza