Period
to 18 November 2017

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 18 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK
6 months to
18 Nov 2017
Same period 2016 Same period 2015
Rank 112 118 217
Rank change year-on-year +6 +99 +119
Contract jobs citing Hadoop 2193 2210 1337
As % of all contract IT jobs advertised in the UK 2.15% 2.09% 1.16%
As % of the Database & Business Intelligence category 9.73% 9.25% 5.00%
Number of daily rates quoted 1526 1425 884
UK median daily rate £533 £525 £525
Median daily rate % change year-on-year +1.43% - -
10th Percentile £388 £363 £363
90th Percentile £675 £700 £675
UK excluding London median daily rate £475 £470 £475
% change year-on-year +1.06% -1.05% +7.71%
Number of hourly rates quoted 10 7 5
UK median hourly rate £32.75 £46.00 £37.50
Median hourly rate % change year-on-year -28.80% +22.67% +5.63%
10th Percentile £16.60 £39.58 £33.55
90th Percentile £47.75 £72.05 £49.00
UK excluding London median hourly rate £32.75 £45.75 £36.78
% change year-on-year -28.42% +24.41% +3.59%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 22546 23891 26754
As % of all contract IT jobs advertised in the UK 22.08% 22.61% 23.28%
Number of daily rates quoted 15400 15864 17620
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +1.27%
10th Percentile £310 £285 £269
90th Percentile £625 £600 £575
UK excluding London median daily rate £400 £376 £375
% change year-on-year +6.45% +0.20% +7.14%
Number of hourly rates quoted 285 369 402
UK median hourly rate £31.15 £28.18 £29.00
Median hourly rate % change year-on-year +10.54% -2.83% +19.59%
10th Percentile £14.00 £10.00 £12.00
90th Percentile £58.00 £52.03 £52.47
UK excluding London median hourly rate £35.00 £28.18 £30.00
% change year-on-year +24.20% -6.07% +33.33%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop.

Contractor daily rate trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Hadoop over the 6 months to 18 November 2017.

Contractor daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop.

Contractor hourly rate trend for Hadoop in the UK

Hadoop
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Hadoop over the 6 months to 18 November 2017.

Contractor hourly rate histogram for Hadoop in the UK

Hadoop
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 18 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +5 2089 £538 +2.38% 162
London -10 1408 £550 - 100
UK excluding London +60 762 £475 +1.06% 66
South East +42 337 £500 +11.11% 13
North of England +60 134 £508 +1.50% 24
South West +22 87 £453 -1.09% 7
East of England -3 78 £481 +37.50% 12
Yorkshire +11 70 £465 -3.13% 9
North West +44 67 £600 +14.29% 14
Scotland +33 62 £406 -14.47% 2
Midlands -4 39 £500 +5.26% 6
West Midlands +9 24 £475 -5.00% 4
Northern Ireland -27 16 £414 -
North East +73 15 £610 +22.00% 1
East Midlands +3 15 £525 +23.53% 2
Wales +5 9 £550 +7.32% 2

For the 6 months to 18 November 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Hadoop.

1 1559 (71.09%) Big Data
2 1116 (50.89%) Apache Spark
3 1039 (47.38%) Java
4 882 (40.22%) Agile Software Development
5 679 (30.96%) Python
6 630 (28.73%) SQL
7 624 (28.45%) Apache Hive
8 611 (27.86%) Kafka
9 565 (25.76%) HBase
10 501 (22.85%) TDD
11 487 (22.21%) Scala
12 476 (21.71%) Linux
13 473 (21.57%) Finance
14 466 (21.25%) Amazon AWS
15 464 (21.16%) Analytics
16 424 (19.33%) Scrum
17 415 (18.92%) HDFS
18 387 (17.65%) DevOps
19 379 (17.28%) NoSQL
20 350 (15.96%) Docker
21 346 (15.78%) Cloudera
22 343 (15.64%) Jenkins
23 331 (15.09%) ETL
24 330 (15.05%) MapReduce
25 324 (14.77%) Security Cleared
26 320 (14.59%) Banking
27 314 (14.32%) BDD
28 305 (13.91%) Spring
29 297 (13.54%) JIRA
30 273 (12.45%) MongoDB

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1116 (50.89%) Apache Spark
2 251 (11.45%) Apache
3 182 (8.30%) Confluence
4 131 (5.97%) Apache Pig
5 130 (5.93%) Elasticsearch
6 121 (5.52%) Apache Solr
7 109 (4.97%) SAS
8 95 (4.33%) Tomcat
9 67 (3.06%) JBoss
10 40 (1.82%) Jetty
11 38 (1.73%) Oracle SOA Suite
12 26 (1.19%) WebSphere
13 25 (1.14%) OpenStack
14 24 (1.09%) nginx
15 22 (1.00%) Apache Airflow
16 20 (0.91%) WebLogic
17 17 (0.78%) Cloud Foundry
18 16 (0.73%) GemFire
19 11 (0.50%) GlassFish
19 11 (0.50%) WildFly
Applications
1 26 (1.19%) SPSS
2 24 (1.09%) Microsoft Excel
3 10 (0.46%) Microsoft Office
3 10 (0.46%) Pipeline Pilot
4 4 (0.18%) Stata
5 2 (0.091%) Microsoft Project
6 1 (0.046%) Adobe Illustrator
6 1 (0.046%) Gephi
6 1 (0.046%) GNU Octave
6 1 (0.046%) HipChat
6 1 (0.046%) Microsoft PowerPoint
6 1 (0.046%) MS Visio
6 1 (0.046%) Photoshop
Business Applications
1 17 (0.78%) Oracle BPM
2 10 (0.46%) Actimize
3 2 (0.091%) SAP CRM
3 2 (0.091%) SAP HR
3 2 (0.091%) WebTrends
4 1 (0.046%) Dynamics CRM
Cloud Services
1 466 (21.25%) Amazon AWS
2 150 (6.84%) GitHub
3 126 (5.75%) Microsoft Azure
4 67 (3.06%) Google Cloud Platform
5 52 (2.37%) Amazon S3
6 44 (2.01%) Amazon EC2
7 42 (1.92%) PaaS
8 38 (1.73%) IBM Cloud
9 37 (1.69%) Bluemix
10 36 (1.64%) Amazon EMR
11 23 (1.05%) Cloud Computing
12 22 (1.00%) Virtual Private Cloud
13 21 (0.96%) SaaS
14 19 (0.87%) IaaS
15 15 (0.68%) Amazon Kinesis
15 15 (0.68%) AWS CloudFormation
16 14 (0.64%) Google Analytics
17 12 (0.55%) Amazon CloudWatch
18 10 (0.46%) OpenShift
18 10 (0.46%) Serverless
Communications & Networking
1 177 (8.07%) Kerberos
2 34 (1.55%) Network Security
3 22 (1.00%) LDAP
4 21 (0.96%) VPN
5 20 (0.91%) HTTP
6 18 (0.82%) Internet
7 17 (0.78%) Firewall
7 17 (0.78%) LAN
7 17 (0.78%) SSL
7 17 (0.78%) WAN
8 14 (0.64%) AMQP
9 11 (0.50%) DSL
9 11 (0.50%) SAN
10 9 (0.41%) DMZ
10 9 (0.41%) DNS
10 9 (0.41%) NAS
11 7 (0.32%) TCP/IP
12 5 (0.23%) ICMP
12 5 (0.23%) Remote Desktop
13 4 (0.18%) SSH
Database & Business Intelligence
1 1559 (71.09%) Big Data
2 624 (28.45%) Apache Hive
3 565 (25.76%) HBase
4 379 (17.28%) NoSQL
5 273 (12.45%) MongoDB
6 244 (11.13%) PostgreSQL
7 219 (9.99%) Data Warehouse
8 192 (8.76%) Impala
9 187 (8.53%) SQL Server
10 180 (8.21%) Apache Cassandra
11 169 (7.71%) Sqoop
12 157 (7.16%) Relational Database
13 101 (4.61%) MySQL
14 94 (4.29%) Data Lake
15 69 (3.15%) RDBMS
16 62 (2.83%) Data Mining
17 52 (2.37%) Oracle Database
18 51 (2.33%) BusinessObjects
19 50 (2.28%) SQL Server Integration Services
20 48 (2.19%) Amazon Redshift
Development Applications
1 343 (15.64%) Jenkins
2 297 (13.54%) JIRA
3 268 (12.22%) Git (software)
4 137 (6.25%) Cucumber
5 77 (3.51%) IntelliJ
6 65 (2.96%) Maven
7 52 (2.37%) JUnit
8 49 (2.23%) TeamCity
9 41 (1.87%) GitLab
10 40 (1.82%) Gradle
11 37 (1.69%) Vagrant
12 31 (1.41%) Selenium
12 31 (1.41%) Team Foundation Server
13 30 (1.37%) Artifactory
14 27 (1.23%) Subversion
15 26 (1.19%) Hudson
16 24 (1.09%) Eclipse
16 24 (1.09%) Talend Open Studio
17 22 (1.00%) Bitbucket
17 22 (1.00%) Sonatype Nexus
General
1 473 (21.57%) Finance
2 320 (14.59%) Banking
3 111 (5.06%) Telecoms
4 110 (5.02%) Marketing
5 106 (4.83%) Investment Banking
6 82 (3.74%) Retail
7 62 (2.83%) Electronics
8 61 (2.78%) Manufacturing
9 60 (2.74%) Front Office
10 28 (1.28%) Publishing
11 27 (1.23%) Retail Banking
12 17 (0.78%) Legal
13 15 (0.68%) Games
14 13 (0.59%) Pharmaceutical
15 10 (0.46%) Financial Institution
16 7 (0.32%) Back Office
16 7 (0.32%) Law
17 5 (0.23%) Advertising
18 4 (0.18%) Corporate Banking
19 3 (0.14%) Private Banking
Job Titles
1 758 (34.56%) Developer
2 340 (15.50%) Data Engineer
3 324 (14.77%) Java Developer
4 292 (13.32%) Architect
5 276 (12.59%) Big Data Developer
6 270 (12.31%) Big Data Engineer
7 192 (8.76%) Data Architect
8 169 (7.71%) Hadoop Engineer
9 163 (7.43%) Hadoop Developer
10 137 (6.25%) Analyst
11 126 (5.75%) Data Scientist
12 123 (5.61%) Scala Developer
13 116 (5.29%) Big Data Architect
14 115 (5.24%) DevOps Engineer
15 99 (4.51%) Senior Developer
16 85 (3.88%) Apache Spark Developer
17 83 (3.78%) Consultant
18 76 (3.47%) Administrator
19 73 (3.33%) Data Analyst
20 72 (3.28%) Java Engineer
Libraries, Frameworks & Software Standards
1 611 (27.86%) Kafka
2 305 (13.91%) Spring
3 262 (11.95%) REST
4 184 (8.39%) Spring Boot
5 166 (7.57%) Web Services
6 151 (6.89%) JSON
6 151 (6.89%) RESTful
7 119 (5.43%) Apache Camel
8 109 (4.97%) Hibernate
9 104 (4.74%) AngularJS
10 83 (3.78%) Spark Streaming
11 81 (3.69%) XML
12 78 (3.56%) RabbitMQ
13 77 (3.51%) PySpark
14 74 (3.37%) Drools
14 74 (3.37%) HTML
15 70 (3.19%) .NET
15 70 (3.19%) JMS
16 62 (2.83%) HTML5
17 57 (2.60%) ActiveMQ
Miscellaneous
1 234 (10.67%) Analytical Skills
2 177 (8.07%) Algorithms
3 104 (4.74%) Computer Science
4 99 (4.51%) Greenfield Project
5 52 (2.37%) Market Risk
6 45 (2.05%) Data Centre
6 45 (2.05%) Data Structures
7 39 (1.78%) Management Information System
8 35 (1.60%) Fintech
9 32 (1.46%) Replication
10 31 (1.41%) User Experience
11 27 (1.23%) Linux Command Line
11 27 (1.23%) Public Cloud
11 27 (1.23%) Virtual Team
12 23 (1.05%) Foreign Exchange (FX)
13 19 (0.87%) Credit Risk
14 16 (0.73%) Derivative
15 15 (0.68%) Equities
16 14 (0.64%) Enterprise Software
16 14 (0.64%) Life Science
Operating Systems
1 476 (21.71%) Linux
2 250 (11.40%) Unix
3 79 (3.60%) Windows
4 74 (3.37%) Red Hat Enterprise Linux
5 38 (1.73%) CentOS
6 34 (1.55%) Ubuntu
7 18 (0.82%) Apple iOS
8 17 (0.78%) Android
9 9 (0.41%) Windows Server 2012
10 6 (0.27%) VMS
10 6 (0.27%) Windows Server
11 5 (0.23%) Solaris
11 5 (0.23%) Windows Vista
12 4 (0.18%) AIX
12 4 (0.18%) CoreOS
12 4 (0.18%) Mac OS X
13 3 (0.14%) Debian
14 2 (0.091%) SUSE
14 2 (0.091%) Windows Server 2003
15 1 (0.046%) MVS
Processes & Methodologies
1 882 (40.22%) Agile Software Development
2 501 (22.85%) TDD
3 464 (21.16%) Analytics
4 424 (19.33%) Scrum
5 387 (17.65%) DevOps
6 331 (15.09%) ETL
7 330 (15.05%) MapReduce
8 314 (14.32%) BDD
9 265 (12.08%) Business Intelligence
10 259 (11.81%) Microservices
11 248 (11.31%) Continuous Integration
12 242 (11.04%) Open Source
13 241 (10.99%) Machine Learning
14 227 (10.35%) Data Modelling
15 178 (8.12%) Data Architecture
16 173 (7.89%) Visualisation
17 163 (7.43%) Software Engineering
18 153 (6.98%) Kanban
19 143 (6.52%) Test Automation
20 140 (6.38%) Data Analytics
Programming Languages
1 1039 (47.38%) Java
2 679 (30.96%) Python
3 630 (28.73%) SQL
4 487 (22.21%) Scala
5 202 (9.21%) R
6 140 (6.38%) Shell Script
7 136 (6.20%) JavaScript
8 97 (4.42%) Bash Shell
9 94 (4.29%) C#
10 68 (3.10%) Ruby
11 43 (1.96%) C++
12 34 (1.55%) C
12 34 (1.55%) Groovy
12 34 (1.55%) Perl
13 30 (1.37%) Go
13 30 (1.37%) PowerShell
14 27 (1.23%) PL/SQL
15 22 (1.00%) T-SQL
16 21 (0.96%) MATLAB
17 20 (0.91%) PHP
Qualifications
1 324 (14.77%) Security Cleared
2 258 (11.76%) SC Cleared
3 141 (6.43%) Degree
4 43 (1.96%) DV Cleared
5 36 (1.64%) PhD
6 23 (1.05%) Computer Science Degree
7 16 (0.73%) Master's Degree
8 13 (0.59%) Numerate Degree
9 9 (0.41%) CISSP
10 8 (0.36%) Microsoft Certification
11 7 (0.32%) BPSS Clearance
11 7 (0.32%) CESG Certified Professional
11 7 (0.32%) CLAS
11 7 (0.32%) DBS Check
12 5 (0.23%) ISTQB
12 5 (0.23%) MCITP
12 5 (0.23%) MCSE
13 4 (0.18%) Cisco Certification
13 4 (0.18%) CTC Cleared
13 4 (0.18%) VMware Certified Professional (VCP)
Quality Assurance & Compliance
1 88 (4.01%) QA
2 77 (3.51%) Data Quality
3 24 (1.09%) GDPR
4 10 (0.46%) GCP
5 9 (0.41%) MiFID
6 8 (0.36%) Actionable Recommendations
7 6 (0.27%) JSP 440
8 5 (0.23%) PCI DSS
9 3 (0.14%) Disclosure Scotland
9 3 (0.14%) Dodd-Frank
9 3 (0.14%) IFRS
9 3 (0.14%) IFRS 9
9 3 (0.14%) SLA
10 2 (0.091%) COBIT
10 2 (0.091%) EMIR
10 2 (0.091%) FedRAMP
11 1 (0.046%) Basel III
11 1 (0.046%) CDISC
11 1 (0.046%) ISO/IEC 27001
11 1 (0.046%) NIST 800
System Software
1 415 (18.92%) HDFS
2 350 (15.96%) Docker
3 230 (10.49%) Apache Flume
4 122 (5.56%) Apache ZooKeeper
5 36 (1.64%) Active Directory
6 21 (0.96%) VMware Infrastructure
7 18 (0.82%) Virtual Machines
8 12 (0.55%) vCloud
9 9 (0.41%) Hyper-V
10 2 (0.091%) NFS
10 2 (0.091%) OpenAM
10 2 (0.091%) Veritas Volume Manager
10 2 (0.091%) VMware ESXi
11 1 (0.046%) etcd
11 1 (0.046%) flannel
11 1 (0.046%) Oracle RAC
11 1 (0.046%) Postfix
11 1 (0.046%) PowerHA
11 1 (0.046%) Squid
11 1 (0.046%) VirtualBox
Systems Management
1 258 (11.76%) Ansible
2 176 (8.03%) Kubernetes
3 170 (7.75%) Oozie
4 161 (7.34%) Puppet
5 155 (7.07%) Hadoop YARN
6 140 (6.38%) Terraform
7 119 (5.43%) Opscode Chef
8 114 (5.20%) Ambari
9 51 (2.33%) Mesos
10 32 (1.46%) Cobbler
11 28 (1.28%) ZABBIX
12 22 (1.00%) Kibana
13 19 (0.87%) ITRS Geneos
13 19 (0.87%) Prometheus
14 17 (0.78%) Graphite
15 16 (0.73%) Nagios
16 15 (0.68%) Control-M
17 11 (0.50%) Salt
18 10 (0.46%) logstash
19 6 (0.27%) Tivoli
Vendors
1 346 (15.78%) Cloudera
2 267 (12.18%) Oracle
3 180 (8.21%) Hortonworks
4 164 (7.48%) Tableau
5 114 (5.20%) SAP
6 100 (4.56%) Google
7 99 (4.51%) IBM
8 96 (4.38%) Microsoft
9 82 (3.74%) Red Hat
10 71 (3.24%) Teradata
11 64 (2.92%) Splunk
12 60 (2.74%) Informatica
13 41 (1.87%) MapR
14 40 (1.82%) VMware
15 24 (1.09%) AppDynamics
15 24 (1.09%) Talend
16 23 (1.05%) MicroStrategy
17 20 (0.91%) SaltStack
18 19 (0.87%) Atlassian
19 16 (0.73%) Netezza