The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 3 months to 28 June 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
London / City of London
3 months to
28 Jun 2017
Same period 2016 Same period 2015
Rank 68 116 107
Rank change year-on-year +48 -9  
Contract jobs citing Hadoop 112 49 101
As % of all contract IT jobs advertised in the City of London 3.43% 1.46% 1.76%
As % of the Database & Business Intelligence category 13.40% 6.03% 6.85%
Number of daily rates quoted 104 40 85
Median daily rate £575 £575 £550
Median daily rate % change year-on-year - +4.54%  
90% offered a daily rate of more than £450 £424 £414
10% offered a daily rate of more than £713 £825 £678
UK excluding London median daily rate £436 £450 £450
% change year-on-year -3.05% -  
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate £50.00 £25.00 £26.00
% change year-on-year +100.00% -3.84%  

Hadoop is in the database and business intelligence skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database and business intelligence skills.

Contract Database & Business Intelligence Skills
City of London
Contract job vacancies with a requirement for database and business intelligence skills 836 813 1475
As % of all contract IT job vacancies advertised in the City of London 25.62% 24.15% 25.69%
Number of daily rates quoted 1450 1586 2933
Median daily rate £505 £475 £450
Median daily rate % change year-on-year +6.31% +5.55%  
90% offered a daily rate of more than £375 £330 £313
10% offered a daily rate of more than £675 £638 £625
UK excluding London median daily rate £400 £375 £350
% change year-on-year +6.66% +7.14%  
Number of hourly rates quoted 12 4 7
Median hourly rate £21.50 £17.88 £30.00
Median hourly rate % change year-on-year +20.27% -40.41%  
90% offered a hourly rate of more than £20.75 £16.13 £16.25
10% offered a hourly rate of more than £22.25 £19.50 £106.00
UK excluding London median hourly rate £38.00 £31.95 £26.00
% change year-on-year +18.93% +22.88%  

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 3 months to 28 June 2017.

Contractor daily rate histogram for Hadoop in the City of London

For the 6 months to 28 June 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region with a requirement for Hadoop.

1 148 (72.55%) Big Data
2 108 (52.94%) Apache Spark
3 105 (51.47%) Java
4 80 (39.22%) Python
5 79 (38.73%) Agile Software Development
6 60 (29.41%) Scala
7 59 (28.92%) Finance
8 58 (28.43%) Apache Hive
9 54 (26.47%) SQL
10 49 (24.02%) Banking
11 45 (22.06%) Linux
12 39 (19.12%) Analytics
12 39 (19.12%) Amazon AWS
13 37 (18.14%) DevOps
14 36 (17.65%) TDD
15 35 (17.16%) E-Commerce
15 35 (17.16%) Apache Cassandra
16 34 (16.67%) HBase
16 34 (16.67%) Apache
17 33 (16.18%) Kafka
18 31 (15.20%) Investment Banking
19 30 (14.71%) Scrum
20 28 (13.73%) ETL
21 27 (13.24%) HDFS
22 25 (12.25%) Akka
22 25 (12.25%) Data Warehouse
23 24 (11.76%) R
24 23 (11.27%) Data Modelling
25 22 (10.78%) Unix
25 22 (10.78%) Bash Shell

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 108 (52.94%) Apache Spark
2 34 (16.67%) Apache
3 20 (9.80%) Apache Pig
4 9 (4.41%) Elasticsearch
5 6 (2.94%) Apache Solr
6 4 (1.96%) Oracle Coherence
6 4 (1.96%) SAS
7 3 (1.47%) DataSynapse
8 2 (0.98%) Jupyter
9 1 (0.49%) Confluence
9 1 (0.49%) IPython
9 1 (0.49%) nginx
9 1 (0.49%) Tomcat
Applications
1 2 (0.98%) Microsoft Excel
1 2 (0.98%) SPSS
2 1 (0.49%) Microsoft Office
Cloud Services
1 39 (19.12%) Amazon AWS
2 14 (6.86%) Virtual Private Cloud
3 11 (5.39%) Amazon EMR
4 6 (2.94%) Microsoft Azure
5 5 (2.45%) Cloud Computing
6 3 (1.47%) Amazon EC2
6 3 (1.47%) Amazon S3
6 3 (1.47%) GitHub
7 2 (0.98%) Amazon CloudWatch
7 2 (0.98%) Bluemix
7 2 (0.98%) IBM Cloud
8 1 (0.49%) IaaS
8 1 (0.49%) PaaS
8 1 (0.49%) SaaS
Communications & Networking
1 5 (2.45%) Kerberos
2 3 (1.47%) HTTP
2 3 (1.47%) LDAP
2 3 (1.47%) SSL
3 2 (0.98%) DNS
3 2 (0.98%) DSL
4 1 (0.49%) DMZ
4 1 (0.49%) Network Security
4 1 (0.49%) SNMP
4 1 (0.49%) TCP/IP
Database & Business Intelligence
1 148 (72.55%) Big Data
2 58 (28.43%) Apache Hive
3 35 (17.16%) Apache Cassandra
4 34 (16.67%) HBase
5 25 (12.25%) Data Warehouse
6 20 (9.80%) MongoDB
6 20 (9.80%) NoSQL
7 13 (6.37%) Relational Database
7 13 (6.37%) Sqoop
8 12 (5.88%) SQL Server
9 9 (4.41%) Data Lake
10 8 (3.92%) Impala
10 8 (3.92%) PostgreSQL
10 8 (3.92%) RDBMS
11 7 (3.43%) MySQL
12 5 (2.45%) Power BI
12 5 (2.45%) QlikView
13 4 (1.96%) BusinessObjects
13 4 (1.96%) Neo4j
14 3 (1.47%) Mahout
Development Applications
1 17 (8.33%) Git (software)
1 17 (8.33%) Jenkins
2 11 (5.39%) Talend Open Studio
3 10 (4.90%) JIRA
4 7 (3.43%) Jasmine
4 7 (3.43%) Maven
5 5 (2.45%) JUnit
6 4 (1.96%) Eclipse
6 4 (1.96%) Mockito
7 3 (1.47%) Subversion
8 2 (0.98%) Artifactory
8 2 (0.98%) Atlassian Bamboo
8 2 (0.98%) ERwin
8 2 (0.98%) TeamCity
8 2 (0.98%) webpack
9 1 (0.49%) Babel
9 1 (0.49%) Bundler
9 1 (0.49%) gulp
9 1 (0.49%) Protractor
9 1 (0.49%) Travis CI
General
1 59 (28.92%) Finance
2 49 (24.02%) Banking
3 31 (15.20%) Investment Banking
4 10 (4.90%) Front Office
4 10 (4.90%) Retail
5 5 (2.45%) Marketing
6 2 (0.98%) Retail Banking
7 1 (0.49%) Advertising
7 1 (0.49%) Back Office
7 1 (0.49%) Games
7 1 (0.49%) Legal
7 1 (0.49%) Publishing
Job Titles
1 83 (40.69%) Developer
2 41 (20.10%) Big Data Developer
3 38 (18.63%) Java Developer
4 36 (17.65%) Scala Developer
5 29 (14.22%) Data Engineer
6 26 (12.75%) Big Data Engineer
7 22 (10.78%) Hadoop Developer
8 21 (10.29%) Analyst
9 20 (9.80%) Java Scala Developer
10 18 (8.82%) Architect
11 17 (8.33%) DevOps Engineer
12 15 (7.35%) Data Analyst
13 13 (6.37%) AWS Engineer
13 13 (6.37%) Java Hadoop Developer
13 13 (6.37%) Senior Developer
14 12 (5.88%) Data Architect
14 12 (5.88%) Data Scientist
15 10 (4.90%) AWS DevOps
15 10 (4.90%) Hadoop Engineer
16 9 (4.41%) Senior Scala Developer
Libraries, Frameworks & Software Standards
1 33 (16.18%) Kafka
2 25 (12.25%) Akka
3 18 (8.82%) Web Services
4 17 (8.33%) RESTful
5 9 (4.41%) Spring
6 7 (3.43%) .NET
6 7 (3.43%) JSON
6 7 (3.43%) Play Framework
7 6 (2.94%) Ajax
7 6 (2.94%) Cascading
7 6 (2.94%) jQuery
8 5 (2.45%) Middleware
8 5 (2.45%) REST
9 4 (1.96%) Apache Commons
9 4 (1.96%) Elastic Stack
9 4 (1.96%) Natural Language Processing
9 4 (1.96%) PySpark
10 3 (1.47%) D3.js
10 3 (1.47%) MLlib
10 3 (1.47%) RabbitMQ
Miscellaneous
1 22 (10.78%) Algorithms
2 10 (4.90%) Analytical Skills
2 10 (4.90%) Credit Risk
3 9 (4.41%) Computer Science
3 9 (4.41%) Market Risk
4 8 (3.92%) Greenfield Project
5 7 (3.43%) Foreign Exchange (FX)
6 5 (2.45%) Data Centre
7 4 (1.96%) Derivative
8 3 (1.47%) Equities
8 3 (1.47%) Fintech
9 2 (0.98%) Data Structures
9 2 (0.98%) Fixed Income
9 2 (0.98%) Grid Computing
9 2 (0.98%) Management Information System
9 2 (0.98%) Minimum Viable Product
9 2 (0.98%) Public Cloud
9 2 (0.98%) User Experience
10 1 (0.49%) Hybrid Cloud
10 1 (0.49%) Video Conferencing
Operating Systems
1 45 (22.06%) Linux
2 22 (10.78%) Unix
3 7 (3.43%) Windows
4 6 (2.94%) Red Hat Enterprise Linux
5 3 (1.47%) AIX
5 3 (1.47%) CentOS
5 3 (1.47%) Solaris
5 3 (1.47%) Windows Server
6 1 (0.49%) Android
6 1 (0.49%) Apple iOS
6 1 (0.49%) Fedora
6 1 (0.49%) Windows Server 2012
Processes & Methodologies
1 79 (38.73%) Agile Software Development
2 39 (19.12%) Analytics
3 37 (18.14%) DevOps
4 36 (17.65%) TDD
5 35 (17.16%) E-Commerce
6 30 (14.71%) Scrum
7 28 (13.73%) ETL
8 23 (11.27%) Data Modelling
9 20 (9.80%) Data Analytics
9 20 (9.80%) MapReduce
10 17 (8.33%) Machine Learning
11 15 (7.35%) Visualisation
12 12 (5.88%) BDD
12 12 (5.88%) Business Intelligence
12 12 (5.88%) Open Source
13 11 (5.39%) Data Analysis
13 11 (5.39%) Stakeholder Management
14 10 (4.90%) Multithreading
15 9 (4.41%) Data Visualisation
15 9 (4.41%) High Availability
Programming Languages
1 105 (51.47%) Java
2 80 (39.22%) Python
3 60 (29.41%) Scala
4 54 (26.47%) SQL
5 24 (11.76%) R
6 22 (10.78%) Bash Shell
7 12 (5.88%) Perl
8 11 (5.39%) JavaScript
9 9 (4.41%) C#
10 8 (3.92%) Shell Script
11 4 (1.96%) C++
11 4 (1.96%) Ruby
12 2 (0.98%) ES6
12 2 (0.98%) HiveQL
13 1 (0.49%) COBOL
13 1 (0.49%) Haskell
13 1 (0.49%) MATLAB
13 1 (0.49%) Pig Latin
13 1 (0.49%) PowerShell
13 1 (0.49%) SPARQL
Qualifications
1 12 (5.88%) Degree
2 4 (1.96%) Computer Science Degree
2 4 (1.96%) Security Cleared
3 2 (0.98%) DV Cleared
3 2 (0.98%) PhD
3 2 (0.98%) SC Cleared
4 1 (0.49%) Master's Degree
Quality Assurance & Compliance
1 12 (5.88%) Data Quality
2 5 (2.45%) MiFID
3 4 (1.96%) QA
4 1 (0.49%) GDPR
4 1 (0.49%) IFRS
4 1 (0.49%) IFRS 9
System Software
1 27 (13.24%) HDFS
2 18 (8.82%) Docker
3 12 (5.88%) Apache ZooKeeper
4 9 (4.41%) Apache Flume
5 5 (2.45%) Active Directory
6 3 (1.47%) Oracle RAC
6 3 (1.47%) VMware Infrastructure
Systems Management
1 13 (6.37%) Ansible
2 9 (4.41%) Hadoop YARN
3 8 (3.92%) Oozie
4 7 (3.43%) Puppet
4 7 (3.43%) Terraform
5 5 (2.45%) Kubernetes
6 3 (1.47%) Mesos
7 2 (0.98%) Ambari
7 2 (0.98%) Graphite
8 1 (0.49%) Control-M
8 1 (0.49%) Kibana
Vendors
1 18 (8.82%) Cloudera
2 17 (8.33%) Tableau
3 14 (6.86%) Oracle
4 12 (5.88%) Hortonworks
5 11 (5.39%) Talend
6 10 (4.90%) IBM
7 8 (3.92%) Microsoft
8 7 (3.43%) Red Hat
8 7 (3.43%) Teradata
9 5 (2.45%) Google
9 5 (2.45%) HP
10 4 (1.96%) Netezza
10 4 (1.96%) Splunk
11 3 (1.47%) Bloomberg
11 3 (1.47%) Citrix
11 3 (1.47%) Dell
11 3 (1.47%) MapR
11 3 (1.47%) Reuters
11 3 (1.47%) SAP
11 3 (1.47%) VMware
City, London
TEKsystems
Rate: Market Rate
Posted: 10 hours ago
City, London
McGregor Boyall
Rate: £525 - £550 per day
Posted: 9 hours ago
City, London
Venturi
Rate: £500 - £600 per day
Posted: 2 days ago
City, London
LA International
Posted: 2 days ago
City, London
Spencer Rose
Posted: 2 days ago
City, London
PBIT Consultants
Rate: From £450 to £500 per day
Posted: 5 days ago