The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 3 months to 26 May 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK
3 months to
26 May 2017
Same period 2016 Same period 2015
Rank 116 179 244
Rank change year-on-year +63 +65  
Contract jobs citing Hadoop 953 769 512
As % of all contract IT jobs advertised in the UK 2.06% 1.43% 0.94%
As % of the Database & Business Intelligence category 9.07% 6.63% 4.08%
Number of daily rates quoted 632 533 367
Median daily rate £500 £550 £545
Median daily rate % change year-on-year -9.09% +0.91%  
90% offered a daily rate of more than £371 £388 £400
10% offered a daily rate of more than £650 £700 £675
UK excluding London median daily rate £435 £490 £500
% change year-on-year -11.22% -2.00%  
Number of hourly rates quoted 2 4 4
Median hourly rate £50.00 £38.00 £26.00
Median hourly rate % change year-on-year +31.57% +46.15%  
UK excluding London median hourly rate £50.00 £38.00 £26.00
% change year-on-year +31.57% +46.15%  

Hadoop is in the database and business intelligence skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database and business intelligence skills.

Contract Database & Business Intelligence Skills
UK
Contract job vacancies with a requirement for database and business intelligence skills 10507 11607 12544
As % of all contract IT job vacancies advertised in the UK 22.71% 21.59% 23.11%
Number of daily rates quoted 6930 7865 8175
Median daily rate £438 £425 £400
Median daily rate % change year-on-year +2.94% +6.25%  
90% offered a daily rate of more than £313 £300 £275
10% offered a daily rate of more than £575 £600 £550
UK excluding London median daily rate £400 £388 £365
% change year-on-year +3.22% +6.16%  
Number of hourly rates quoted 118 179 160
Median hourly rate £37.50 £32.50 £23.00
Median hourly rate % change year-on-year +15.38% +41.30%  
90% offered a hourly rate of more than £13.00 £13.50 £15.30
10% offered a hourly rate of more than £50.00 £48.90 £46.03
UK excluding London median hourly rate £38.00 £33.08 £23.00
% change year-on-year +14.88% +43.81%  

Hadoop
Job Vacancy Trend

The job posting trend of jobs advertised citing Hadoop as a proportion of all contract or permanent IT jobs with a match in the Database & Business Intelligence category.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop.

Contractor daily rate trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Hadoop over the 3 months to 26 May 2017.

Contractor daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop.

Contractor hourly rate trend for Hadoop in the UK

Hadoop
Top 30 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 3 months to 26 May 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Last 3 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +64 902 £500 -9.09% 231
London +29 622 £525 -4.54% 147
South East +56 129 £405 -18.95% 25
City of London +38 105 £550 +2.32% 40
South West +39 59 £423 -3.97% 5
East of England +16 37 £425 -3.95% 13
Hampshire +32 36 £401 -27.18% 7
Surrey +16 31 £475 -5.00% 6
Somerset - 31 £418 - 3
Scotland +47 28 £475 -9.52% 6
Taunton - 27 £413 - 2
Edinburgh +38 25 £475 -2.56% 5
Buckinghamshire +1 25 £400 -23.80% 5
Norfolk +21 23 - - 2
Norwich +18 23 - - 2
Berkshire +30 21 £413 -5.71% 6
Milton Keynes +2 18 £400 -23.80% 5
North West +19 14 £550 +22.22% 23
West Midlands +2 14 £496 +7.73% 8
Reading +25 13 £450 -5.26% 3
Southampton - 13 £425 -
Essex -1 12 £435 +117.50% 5
Staines +5 11 - -
Northern Ireland -24 11 £463 -
County Antrim -25 11 £463 -
Belfast -25 11 £463 -
Manchester +8 9 £550 +17.02% 15
East Midlands -8 8 £525 +16.66% 3
Guildford - 8 £475 - 2
Croydon +10 7 £525 +59.40% 8

For the 6 months to 26 May 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Hadoop.

1 1276 (66.63%) Big Data
2 890 (46.48%) Apache Spark
3 839 (43.81%) Java
4 688 (35.93%) Agile Software Development
5 681 (35.56%) Python
6 603 (31.49%) Apache Hive
7 524 (27.36%) Scala
8 492 (25.69%) SQL
9 442 (23.08%) Linux
10 430 (22.45%) Analytics
11 419 (21.88%) Finance
12 356 (18.59%) HBase
13 344 (17.96%) DevOps
14 337 (17.60%) Kafka
15 315 (16.45%) Amazon AWS
16 314 (16.40%) ETL
17 301 (15.72%) Cloudera
18 293 (15.30%) Banking
19 284 (14.83%) NoSQL
20 269 (14.05%) Unix
21 268 (13.99%) HDFS
22 263 (13.73%) Scrum
23 261 (13.63%) TDD
24 256 (13.37%) Oracle
25 244 (12.74%) MapReduce
26 236 (12.32%) R
26 236 (12.32%) Data Warehouse
27 228 (11.91%) Business Intelligence
28 226 (11.80%) Apache Cassandra
29 211 (11.02%) Jenkins

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 890 (46.48%) Apache Spark
2 211 (11.02%) Apache
3 205 (10.70%) Apache Pig
4 156 (8.15%) SAS
5 139 (7.26%) Elasticsearch
6 62 (3.24%) Apache Solr
7 31 (1.62%) Tomcat
8 28 (1.46%) Confluence
9 21 (1.10%) Jupyter
9 21 (1.10%) WebSphere
10 19 (0.99%) nginx
11 17 (0.89%) Oracle Coherence
12 16 (0.84%) OpenStack
13 12 (0.63%) Cloud Foundry
13 12 (0.63%) WebLogic
14 10 (0.52%) SharePoint
15 8 (0.42%) Apache Airflow
15 8 (0.42%) DataSynapse
15 8 (0.42%) Oracle SOA Suite
16 7 (0.37%) JBoss
Applications
1 31 (1.62%) Microsoft Excel
1 31 (1.62%) SPSS
2 22 (1.15%) Microsoft Office
3 7 (0.37%) Microsoft PowerPoint
3 7 (0.37%) Stata
4 4 (0.21%) GNU Octave
4 4 (0.21%) MS Visio
5 2 (0.10%) Weka
6 1 (0.052%) HipChat
Business Applications
1 20 (1.04%) SAP Oil and Gas
2 8 (0.42%) Adobe Campaign
2 8 (0.42%) Unica
3 6 (0.31%) Dynamics CRM
4 3 (0.16%) Oracle Applications
5 2 (0.10%) Actimize
6 1 (0.052%) Oracle BPM
6 1 (0.052%) Oracle Receivables
6 1 (0.052%) SAP MDG
6 1 (0.052%) SAP MDM
Cloud Services
1 315 (16.45%) Amazon AWS
2 113 (5.90%) Microsoft Azure
3 60 (3.13%) Amazon EC2
4 51 (2.66%) Amazon S3
5 46 (2.40%) Amazon EMR
6 37 (1.93%) Cloud Computing
6 37 (1.93%) Google Cloud Platform
7 31 (1.62%) Virtual Private Cloud
8 29 (1.51%) GitHub
9 25 (1.31%) IaaS
10 22 (1.15%) PaaS
11 11 (0.57%) Adobe Analytics
11 11 (0.57%) Office 365
12 10 (0.52%) AWS Lambda
12 10 (0.52%) SaaS
13 8 (0.42%) Amazon CloudWatch
13 8 (0.42%) Amazon ELB
13 8 (0.42%) Amazon Kinesis
14 5 (0.26%) AWS CloudFormation
14 5 (0.26%) Sumo Logic
Communications & Networking
1 58 (3.03%) Kerberos
2 54 (2.82%) HTTP
3 35 (1.83%) Firewall
4 33 (1.72%) LDAP
5 29 (1.51%) DNS
6 22 (1.15%) Internet
6 22 (1.15%) TCP/IP
7 20 (1.04%) SSH
8 15 (0.78%) ICMP
9 14 (0.73%) Network Security
9 14 (0.73%) VPN
10 12 (0.63%) SNMP
11 10 (0.52%) SSL
12 8 (0.42%) NAS
12 8 (0.42%) SAN
13 7 (0.37%) LAN
13 7 (0.37%) SMTP
13 7 (0.37%) WAN
14 5 (0.26%) AMQP
14 5 (0.26%) FTP
Database & Business Intelligence
1 1276 (66.63%) Big Data
2 603 (31.49%) Apache Hive
3 356 (18.59%) HBase
4 284 (14.83%) NoSQL
5 236 (12.32%) Data Warehouse
6 226 (11.80%) Apache Cassandra
7 193 (10.08%) SQL Server
8 177 (9.24%) MongoDB
9 172 (8.98%) Impala
10 157 (8.20%) Relational Database
11 116 (6.06%) PostgreSQL
12 115 (6.01%) Sqoop
13 77 (4.02%) Data Lake
14 76 (3.97%) MySQL
15 73 (3.81%) RDBMS
16 62 (3.24%) QlikView
17 57 (2.98%) Neo4j
18 49 (2.56%) DB2
19 46 (2.40%) BusinessObjects
20 37 (1.93%) Data Mining
Development Applications
1 211 (11.02%) Jenkins
2 197 (10.29%) Git (software)
3 123 (6.42%) JIRA
4 86 (4.49%) Maven
5 48 (2.51%) Vagrant
6 47 (2.45%) Talend Open Studio
7 44 (2.30%) JUnit
8 31 (1.62%) Sonatype Nexus
9 27 (1.41%) Mockito
9 27 (1.41%) TeamCity
10 25 (1.31%) Eclipse
11 23 (1.20%) Gradle
12 22 (1.15%) Cucumber
13 21 (1.10%) Team Foundation Server
14 20 (1.04%) ERwin
14 20 (1.04%) Octopus Deploy
15 19 (0.99%) Ant
15 19 (0.99%) Hudson
16 16 (0.84%) Subversion
17 15 (0.78%) Visual Studio
General
1 419 (21.88%) Finance
2 293 (15.30%) Banking
3 112 (5.85%) Investment Banking
4 81 (4.23%) Retail
5 73 (3.81%) Marketing
6 57 (2.98%) Telecoms
7 56 (2.92%) Front Office
8 27 (1.41%) Legal
9 23 (1.20%) Retail Banking
10 22 (1.15%) Manufacturing
11 19 (0.99%) Electronics
12 16 (0.84%) Financial Institution
13 15 (0.78%) Games
14 7 (0.37%) Law
15 5 (0.26%) Automotive
15 5 (0.26%) Corporate Banking
15 5 (0.26%) Pharmaceutical
15 5 (0.26%) Publishing
16 3 (0.16%) Advertising
16 3 (0.16%) German Language
Job Titles
1 677 (35.35%) Developer
2 260 (13.58%) Big Data Developer
3 255 (13.32%) Java Developer
4 249 (13.00%) Data Engineer
5 227 (11.85%) Architect
6 219 (11.44%) Big Data Engineer
7 180 (9.40%) Hadoop Developer
8 176 (9.19%) Analyst
9 135 (7.05%) Data Architect
9 135 (7.05%) DevOps Engineer
9 135 (7.05%) Hadoop Engineer
10 123 (6.42%) Scala Developer
11 115 (6.01%) Consultant
12 112 (5.85%) Administrator
13 89 (4.65%) Data Analyst
14 84 (4.39%) Senior Developer
15 81 (4.23%) Data Scientist
16 75 (3.92%) Python Developer
17 73 (3.81%) Apache Spark Developer
18 71 (3.71%) Big Data Architect
Libraries, Frameworks & Software Standards
1 337 (17.60%) Kafka
2 122 (6.37%) Spring
3 110 (5.74%) Web Services
4 98 (5.12%) REST
5 88 (4.60%) HTML
6 87 (4.54%) .NET
7 81 (4.23%) AngularJS
8 70 (3.66%) CSS
9 66 (3.45%) Akka
10 58 (3.03%) JSON
10 58 (3.03%) Node.js
10 58 (3.03%) XML
11 55 (2.87%) Middleware
12 54 (2.82%) HTML5
12 54 (2.82%) RabbitMQ
13 51 (2.66%) RESTful
14 49 (2.56%) Spark Streaming
15 43 (2.25%) Elastic Stack
15 43 (2.25%) J2EE
16 38 (1.98%) CSS3
Miscellaneous
1 196 (10.23%) Analytical Skills
2 112 (5.85%) Algorithms
3 81 (4.23%) Computer Science
4 51 (2.66%) Greenfield Project
5 44 (2.30%) Data Structures
6 43 (2.25%) User Experience
7 42 (2.19%) Linux Command Line
8 41 (2.14%) Management Information System
9 35 (1.83%) Mainframe
9 35 (1.83%) Reference Data
10 26 (1.36%) Foreign Exchange (FX)
10 26 (1.36%) Public Cloud
11 25 (1.31%) Credit Risk
12 24 (1.25%) Fintech
13 22 (1.15%) Market Risk
14 21 (1.10%) Data Centre
15 18 (0.94%) Equities
16 17 (0.89%) Blog
17 16 (0.84%) Derivative
17 16 (0.84%) Replication
Operating Systems
1 442 (23.08%) Linux
2 269 (14.05%) Unix
3 108 (5.64%) Red Hat Enterprise Linux
4 96 (5.01%) Windows
5 58 (3.03%) CentOS
6 53 (2.77%) Ubuntu
7 44 (2.30%) Debian
8 16 (0.84%) Windows Vista
9 14 (0.73%) CoreOS
9 14 (0.73%) Solaris
10 8 (0.42%) Windows Server
11 7 (0.37%) AIX
11 7 (0.37%) MVS
12 6 (0.31%) Fedora
13 4 (0.21%) Apple iOS
14 3 (0.16%) Android
15 2 (0.10%) Mac OS X
16 1 (0.052%) Windows Server 2003
16 1 (0.052%) Windows Server 2008
Processes & Methodologies
1 688 (35.93%) Agile Software Development
2 430 (22.45%) Analytics
3 344 (17.96%) DevOps
4 314 (16.40%) ETL
5 263 (13.73%) Scrum
6 261 (13.63%) TDD
7 244 (12.74%) MapReduce
8 228 (11.91%) Business Intelligence
9 198 (10.34%) Data Modelling
10 196 (10.23%) Open Source
11 174 (9.09%) Data Analytics
12 172 (8.98%) Continuous Integration
13 171 (8.93%) Machine Learning
14 132 (6.89%) BDD
15 123 (6.42%) Test Automation
16 114 (5.95%) Data Analysis
17 113 (5.90%) Software Engineering
18 108 (5.64%) Microservices
19 107 (5.59%) E-Commerce
20 104 (5.43%) Data Management
Programming Languages
1 839 (43.81%) Java
2 681 (35.56%) Python
3 524 (27.36%) Scala
4 492 (25.69%) SQL
5 236 (12.32%) R
6 138 (7.21%) JavaScript
7 128 (6.68%) Bash Shell
8 108 (5.64%) Shell Script
9 93 (4.86%) Perl
10 88 (4.60%) C#
11 64 (3.34%) Ruby
12 57 (2.98%) C++
13 44 (2.30%) C
14 32 (1.67%) MATLAB
15 23 (1.20%) PL/SQL
16 19 (0.99%) PHP
16 19 (0.99%) T-SQL
17 15 (0.78%) Go
18 13 (0.68%) VB.NET
19 12 (0.63%) Groovy
Qualifications
1 183 (9.56%) Security Cleared
2 131 (6.84%) SC Cleared
3 130 (6.79%) Degree
4 47 (2.45%) DV Cleared
5 25 (1.31%) PhD
6 22 (1.15%) Master's Degree
7 16 (0.84%) BPSS Clearance
8 13 (0.68%) CISSP
9 8 (0.42%) Microsoft Certification
10 7 (0.37%) CESG Certified Professional
10 7 (0.37%) CISM
10 7 (0.37%) CLAS
10 7 (0.37%) Mathematical Degree
11 6 (0.31%) BC Cleared
12 5 (0.26%) ISEB
12 5 (0.26%) ISTQB
13 4 (0.21%) CCSP
13 4 (0.21%) Cisco Certification
13 4 (0.21%) MCITP
13 4 (0.21%) MCPD
Quality Assurance & Compliance
1 92 (4.80%) Data Quality
2 89 (4.65%) QA
3 16 (0.84%) MiFID
4 6 (0.31%) Disclosure Scotland
4 6 (0.31%) JSP 440
4 6 (0.31%) PCI DSS
5 4 (0.21%) FedRAMP
5 4 (0.21%) SLA
6 3 (0.16%) Cyber Essentials
6 3 (0.16%) GDPR
6 3 (0.16%) ISAE 3402
6 3 (0.16%) ISO/IEC 27001
6 3 (0.16%) Sarbanes-Oxley
6 3 (0.16%) Solvency II
6 3 (0.16%) SSAE 16
7 2 (0.10%) CDISC
7 2 (0.10%) Dodd-Frank
7 2 (0.10%) EMIR
7 2 (0.10%) GCP
8 1 (0.052%) COREP
System Software
1 268 (13.99%) HDFS
2 187 (9.77%) Docker
3 133 (6.95%) Apache Flume
4 81 (4.23%) Apache ZooKeeper
5 40 (2.09%) VMware Infrastructure
6 30 (1.57%) Active Directory
7 14 (0.73%) Virtual Machines
8 12 (0.63%) Oracle RAC
9 11 (0.57%) vCloud
10 8 (0.42%) Hyper-V
11 7 (0.37%) etcd
11 7 (0.37%) flannel
11 7 (0.37%) NFS
12 5 (0.26%) VirtualBox
13 4 (0.21%) KVM
13 4 (0.21%) Squid
13 4 (0.21%) SRDF
13 4 (0.21%) Xen
14 2 (0.10%) Ceph
14 2 (0.10%) vSphere
Systems Management
1 187 (9.77%) Ansible
2 156 (8.15%) Hadoop YARN
3 155 (8.09%) Puppet
4 137 (7.15%) Oozie
5 114 (5.95%) Opscode Chef
6 89 (4.65%) Kubernetes
7 59 (3.08%) Terraform
8 35 (1.83%) ZABBIX
9 33 (1.72%) Mesos
10 25 (1.31%) Nagios
11 24 (1.25%) Ambari
12 20 (1.04%) Kibana
12 20 (1.04%) SELinux
13 17 (0.89%) Salt
14 13 (0.68%) logstash
14 13 (0.68%) Packer
15 12 (0.63%) Consul
15 12 (0.63%) OpenAM
16 9 (0.47%) Rsyslog
16 9 (0.47%) yum
Vendors
1 301 (15.72%) Cloudera
2 256 (13.37%) Oracle
3 145 (7.57%) Hortonworks
4 111 (5.80%) Tableau
5 89 (4.65%) Teradata
6 82 (4.28%) Red Hat
7 75 (3.92%) Microsoft
8 68 (3.55%) Informatica
9 60 (3.13%) SAP
9 60 (3.13%) VMware
10 55 (2.87%) Google
11 52 (2.72%) IBM
12 47 (2.45%) Talend
13 45 (2.35%) Ab Initio
14 41 (2.14%) MicroStrategy
15 40 (2.09%) Splunk
16 35 (1.83%) MapR
17 22 (1.15%) Sybase
18 21 (1.10%) Netezza
19 20 (1.04%) Atlassian
London
Networking People
Rate: £500 - £600 per day
Posted: 1 hour ago
London
Explore Group
Rate: £400 - £450 per day
Posted: 20 hours ago
Greater Manchester
Spier Consulting Ltd
Rate: £400 - £420 per day
Posted: 21 hours ago
London
TEKsystems
Rate: £500 - £600 per day
Posted: Yesterday
City, London
Oliver Bernard
Rate: £550 - £600 per day
Posted: Yesterday
City, London
Explore Group
Rate: £399 - £501 per day
Posted: 13 hours ago
London
Lawrence Harvey
Rate: £450.00 - £525.00 per day
Posted: 21 hours ago
Bath, Avon
Austin Fraser
Rate: £400 - £500 per day
Posted: Yesterday
London
Morgan Mckinley
Rate: £0.00 per annum
Posted: 20 hours ago
City, London
La Fosse Associates
Rate: £550 - £650 per day
Posted: Yesterday
City, London
TEKsystems
Rate: £600 - £650 per day
Posted: 2 days ago
Hertfordshire
TEKsystems
Rate: £550 - £600 per annum
Posted: 2 days ago
London
Computer Futures
Rate: £400 - £450 per day + competitive
Posted: 2 days ago
London
Revolution Technology
Rate: From £500 to £600 per day
Posted: Yesterday
Milton Keynes, Buckinghamshire
Sopra Steria Recruitment
Rate: Competitive Day Rate
Posted: Yesterday
Croydon, Surrey
Netsource
Rate: Up to £550 per day
Posted: Yesterday
Reading, Berkshire
Seven Principles Consulting
Rate: From £400 to £500 per day
Posted: Yesterday
City, London
Spargonet Consulting Plc
Rate: £400 - £500 per day
Posted: 3 days ago
London
McGregor Boyall
Rate: £550 - £700 per day
Posted: 14 hours ago
London
Venturi
Rate: £500 - £650 per day
Posted: 2 days ago
Croydon, Surrey
LA International
Rate: £550 - £590 per day
Posted: 3 days ago
London
Gibbs S3
Rate: £400 - £500 per week
Posted: 2 days ago
London
Cititec
Rate: £575 - £600 per day
Posted: 6 days ago
Croydon, Surrey
KEYRESOURCE
Rate: £400 - £500 per annum
Posted: 2 days ago
City, London
Gibbs S3
Rate: £450 - £500 per day
Posted: Yesterday
London
People Source Consulting
Rate: £450 - £570 per day
Posted: 3 days ago
London
Elevate Direct
Rate: From £525 to £550 per day
Posted: 2 days ago
London
Testing Circle Ltd
Rate: £450 - £525 per day
Posted: 3 days ago
Croydon, Surrey
LA International
Posted: 3 days ago
London
People Source Consulting
Rate: £450 - £600 per day
Posted: 3 days ago