Period
to 21 November 2017

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 21 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
21 Nov 2017
Same period 2016 Same period 2015
Rank 85 75 129
Rank change year-on-year -10 +54 +84
Contract jobs citing Hadoop 1427 1551 900
As % of all contract IT jobs advertised in London 3.03% 3.45% 1.93%
As % of the Database & Business Intelligence category 12.73% 14.85% 8.02%
Number of daily rates quoted 1062 1057 652
London median daily rate £550 £550 £550
10th Percentile £413 £411 £375
90th Percentile £700 £713 £700
England median daily rate £538 £525 £525
% change year-on-year +2.38% - -
Number of hourly rates quoted 0 1 1
London median hourly rate - £100.00 £37.50
Median hourly rate % change year-on-year - +166.67% -
England median hourly rate £32.75 £46.00 £37.50
% change year-on-year -28.80% +22.67% +2.74%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11208 10447 11224
As % of all contract IT jobs advertised in London 23.81% 23.25% 24.11%
Number of daily rates quoted 8320 7410 8007
London median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +5.88%
10th Percentile £355 £322 £304
90th Percentile £660 £638 £625
England median daily rate £460 £425 £413
% change year-on-year +8.24% +3.03% +3.13%
Number of hourly rates quoted 61 40 76
London median hourly rate £26.61 £28.69 £22.50
Median hourly rate % change year-on-year -7.27% +27.51% -18.18%
10th Percentile £18.25 £15.25 £14.88
90th Percentile £58.75 £82.58 £90.00
England median hourly rate £31.75 £28.00 £27.78
% change year-on-year +13.39% +0.79% +12.24%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 21 November 2017.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 21 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -12 247 £575 - 28
South London +16 152 £538 +29.52% 4
East London +2 24 £550 -4.35% 5
West London -27 15 £500 +4.17% 10
North London - 3 £500 - 3
Hadoop
England

For the 6 months to 21 November 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the London region with a requirement for Hadoop.

1 1043 (73.09%) Big Data
2 774 (54.24%) Java
3 736 (51.58%) Apache Spark
4 560 (39.24%) Agile Software Development
5 473 (33.15%) Python
6 424 (29.71%) HBase
7 422 (29.57%) Kafka
8 392 (27.47%) SQL
9 372 (26.07%) Apache Hive
10 361 (25.30%) Amazon AWS
11 358 (25.09%) Scala
12 344 (24.11%) TDD
13 311 (21.79%) HDFS
14 304 (21.30%) Finance
15 302 (21.16%) Linux
16 289 (20.25%) DevOps
17 287 (20.11%) Analytics
18 276 (19.34%) Scrum
19 272 (19.06%) NoSQL
20 260 (18.22%) Docker
21 240 (16.82%) BDD
22 235 (16.47%) Security Cleared
23 234 (16.40%) Jenkins
24 232 (16.26%) Microservices
25 231 (16.19%) JIRA
26 228 (15.98%) Banking
27 227 (15.91%) REST
28 212 (14.86%) MongoDB
28 212 (14.86%) Spring
29 205 (14.37%) MapReduce

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 736 (51.58%) Apache Spark
2 172 (12.05%) Apache
3 165 (11.56%) Confluence
4 106 (7.43%) Elasticsearch
5 102 (7.15%) Apache Solr
6 84 (5.89%) Apache Pig
7 61 (4.27%) Tomcat
8 50 (3.50%) SAS
9 39 (2.73%) JBoss
10 30 (2.10%) Jetty
11 14 (0.98%) OpenStack
12 13 (0.91%) nginx
13 11 (0.77%) Apache Airflow
14 10 (0.70%) Oracle Coherence
14 10 (0.70%) Oracle SOA Suite
15 8 (0.56%) IIS
15 8 (0.56%) WebSphere
16 5 (0.35%) Jupyter
16 5 (0.35%) SharePoint
17 4 (0.28%) WebLogic
Applications
1 17 (1.19%) SPSS
2 13 (0.91%) Microsoft Excel
3 3 (0.21%) Stata
4 2 (0.14%) Microsoft Office
5 1 (0.070%) Gephi
5 1 (0.070%) HipChat
Business Applications
1 7 (0.49%) Oracle BPM
2 2 (0.14%) SAP HR
2 2 (0.14%) WebTrends
3 1 (0.070%) Dynamics CRM
Cloud Services
1 361 (25.30%) Amazon AWS
2 90 (6.31%) GitHub
3 84 (5.89%) Microsoft Azure
4 48 (3.36%) Google Cloud Platform
5 47 (3.29%) Amazon S3
6 39 (2.73%) Amazon EC2
7 32 (2.24%) Bluemix
7 32 (2.24%) IBM Cloud
8 27 (1.89%) Amazon EMR
9 22 (1.54%) Virtual Private Cloud
10 21 (1.47%) SaaS
11 18 (1.26%) Cloud Computing
12 13 (0.91%) Amazon CloudWatch
13 12 (0.84%) IaaS
14 11 (0.77%) AWS CloudFormation
15 10 (0.70%) Amazon Kinesis
15 10 (0.70%) PaaS
16 9 (0.63%) Serverless
17 6 (0.42%) AWS Lambda
18 5 (0.35%) Azure Data Factory
Communications & Networking
1 146 (10.23%) Kerberos
2 24 (1.68%) Network Security
3 19 (1.33%) LDAP
4 18 (1.26%) HTTP
5 14 (0.98%) Firewall
6 13 (0.91%) Internet
6 13 (0.91%) SSL
7 11 (0.77%) DSL
8 9 (0.63%) DMZ
8 9 (0.63%) DNS
9 8 (0.56%) VPN
10 7 (0.49%) TCP/IP
11 5 (0.35%) ICMP
11 5 (0.35%) NAS
11 5 (0.35%) SAN
12 4 (0.28%) WAN
13 3 (0.21%) LAN
13 3 (0.21%) OpenLDAP
14 2 (0.14%) SNA
14 2 (0.14%) SSH
Database & Business Intelligence
1 1043 (73.09%) Big Data
2 424 (29.71%) HBase
3 372 (26.07%) Apache Hive
4 272 (19.06%) NoSQL
5 212 (14.86%) MongoDB
6 189 (13.24%) PostgreSQL
7 137 (9.60%) Apache Cassandra
8 129 (9.04%) Data Warehouse
9 113 (7.92%) Relational Database
10 93 (6.52%) SQL Server
11 83 (5.82%) Impala
12 69 (4.84%) Sqoop
13 65 (4.56%) MySQL
14 57 (3.99%) RDBMS
15 47 (3.29%) Data Lake
16 39 (2.73%) Data Mining
17 36 (2.52%) Amazon RDS
18 35 (2.45%) BusinessObjects
19 34 (2.38%) Oracle Database
20 32 (2.24%) Amazon DynamoDB
Development Applications
1 234 (16.40%) Jenkins
2 231 (16.19%) JIRA
3 149 (10.44%) Git (software)
4 98 (6.87%) Cucumber
5 59 (4.13%) IntelliJ
6 40 (2.80%) GitLab
7 32 (2.24%) Maven
8 31 (2.17%) TeamCity
9 29 (2.03%) Artifactory
10 19 (1.33%) Vagrant
11 18 (1.26%) JUnit
12 15 (1.05%) Mockito
13 12 (0.84%) Selenium
14 9 (0.63%) Ant
14 9 (0.63%) ERwin
14 9 (0.63%) SonarQube
14 9 (0.63%) Sonatype Nexus
14 9 (0.63%) Subversion
15 8 (0.56%) Gradle
15 8 (0.56%) WebDriver
General
1 304 (21.30%) Finance
2 228 (15.98%) Banking
3 106 (7.43%) Investment Banking
4 72 (5.05%) Marketing
5 62 (4.34%) Front Office
6 57 (3.99%) Retail
7 41 (2.87%) Telecoms
8 30 (2.10%) Manufacturing
9 29 (2.03%) Electronics
10 20 (1.40%) Publishing
11 14 (0.98%) Legal
12 13 (0.91%) Games
13 7 (0.49%) Law
13 7 (0.49%) Pharmaceutical
14 5 (0.35%) Advertising
14 5 (0.35%) Back Office
14 5 (0.35%) Retail Banking
15 3 (0.21%) Financial Institution
16 2 (0.14%) Private Banking
17 1 (0.070%) Music Industry
Job Titles
1 534 (37.42%) Developer
2 243 (17.03%) Data Engineer
3 235 (16.47%) Java Developer
4 215 (15.07%) Big Data Developer
5 194 (13.59%) Big Data Engineer
6 167 (11.70%) Architect
7 122 (8.55%) Hadoop Engineer
8 114 (7.99%) Data Architect
9 108 (7.57%) Hadoop Developer
10 98 (6.87%) Data Scientist
11 96 (6.73%) Scala Developer
12 84 (5.89%) Analyst
13 80 (5.61%) Senior Developer
14 78 (5.47%) DevOps Engineer
15 74 (5.19%) Big Data Architect
16 62 (4.34%) Java Engineer
17 58 (4.06%) Consultant
18 54 (3.78%) Apache Spark Developer
19 43 (3.01%) Data Analyst
20 42 (2.94%) AWS Engineer
Libraries, Frameworks & Software Standards
1 422 (29.57%) Kafka
2 227 (15.91%) REST
3 212 (14.86%) Spring
4 129 (9.04%) Web Services
5 128 (8.97%) Spring Boot
6 97 (6.80%) JSON
7 91 (6.38%) Apache Camel
8 87 (6.10%) Hibernate
9 83 (5.82%) AngularJS
10 77 (5.40%) RESTful
11 67 (4.70%) Drools
12 64 (4.48%) PySpark
13 51 (3.57%) HTML
14 49 (3.43%) Akka
15 48 (3.36%) .NET
16 46 (3.22%) HTML5
17 43 (3.01%) Samza
18 41 (2.87%) ActiveMQ
18 41 (2.87%) Elastic Stack
18 41 (2.87%) XML
Miscellaneous
1 157 (11.00%) Algorithms
2 152 (10.65%) Analytical Skills
3 76 (5.33%) Greenfield Project
4 74 (5.19%) Computer Science
5 50 (3.50%) Market Risk
6 32 (2.24%) Data Structures
7 26 (1.82%) User Experience
8 25 (1.75%) Fintech
9 23 (1.61%) Data Centre
9 23 (1.61%) Foreign Exchange (FX)
10 19 (1.33%) Management Information System
11 18 (1.26%) Credit Risk
11 18 (1.26%) Replication
12 17 (1.19%) Derivative
12 17 (1.19%) Public Cloud
13 15 (1.05%) Equities
14 11 (0.77%) Reference Data
15 9 (0.63%) Grid Computing
16 8 (0.56%) Digital Media
17 7 (0.49%) Virtual Team
Operating Systems
1 302 (21.16%) Linux
2 122 (8.55%) Unix
3 48 (3.36%) Windows
4 33 (2.31%) Red Hat Enterprise Linux
5 23 (1.61%) CentOS
6 16 (1.12%) Ubuntu
7 9 (0.63%) Windows Server 2012
8 5 (0.35%) Apple iOS
9 4 (0.28%) AIX
9 4 (0.28%) Android
9 4 (0.28%) CoreOS
9 4 (0.28%) Windows Server
10 3 (0.21%) Solaris
10 3 (0.21%) VMS
10 3 (0.21%) Windows Vista
11 1 (0.070%) Mac OS X
11 1 (0.070%) Windows Server 2008
Processes & Methodologies
1 560 (39.24%) Agile Software Development
2 344 (24.11%) TDD
3 289 (20.25%) DevOps
4 287 (20.11%) Analytics
5 276 (19.34%) Scrum
6 240 (16.82%) BDD
7 232 (16.26%) Microservices
8 205 (14.37%) MapReduce
9 189 (13.24%) Machine Learning
10 175 (12.26%) ETL
11 162 (11.35%) Continuous Integration
12 154 (10.79%) Open Source
13 148 (10.37%) Data Modelling
14 144 (10.09%) Business Intelligence
15 141 (9.88%) Data Architecture
16 121 (8.48%) Visualisation
17 94 (6.59%) Kanban
18 92 (6.45%) Multithreading
18 92 (6.45%) Software Engineering
19 85 (5.96%) Data Analytics
Programming Languages
1 774 (54.24%) Java
2 473 (33.15%) Python
3 392 (27.47%) SQL
4 358 (25.09%) Scala
5 150 (10.51%) R
6 103 (7.22%) JavaScript
7 76 (5.33%) Bash Shell
8 71 (4.98%) C#
9 55 (3.85%) Shell Script
10 35 (2.45%) Groovy
11 29 (2.03%) Ruby
12 24 (1.68%) PL/SQL
12 24 (1.68%) PowerShell
13 23 (1.61%) Go
14 20 (1.40%) C++
14 20 (1.40%) Perl
15 19 (1.33%) T-SQL
16 18 (1.26%) C
17 16 (1.12%) PHP
18 15 (1.05%) MATLAB
Qualifications
1 235 (16.47%) Security Cleared
2 189 (13.24%) SC Cleared
3 79 (5.54%) Degree
4 36 (2.52%) DV Cleared
5 24 (1.68%) PhD
6 19 (1.33%) Computer Science Degree
7 16 (1.12%) Master's Degree
8 10 (0.70%) Numerate Degree
9 6 (0.42%) DBS Check
10 4 (0.28%) CISSP
10 4 (0.28%) CTC Cleared
10 4 (0.28%) Microsoft Certification
11 3 (0.21%) CCNA
11 3 (0.21%) CCSP
11 3 (0.21%) CISA
11 3 (0.21%) Cisco Certification
11 3 (0.21%) CISM
11 3 (0.21%) ISTQB Foundation Certification
11 3 (0.21%) MCITP
11 3 (0.21%) MCSE
Quality Assurance & Compliance
1 52 (3.64%) Data Quality
2 40 (2.80%) QA
3 9 (0.63%) MiFID
4 8 (0.56%) Actionable Recommendations
5 7 (0.49%) GCP
6 5 (0.35%) GDPR
7 3 (0.21%) Dodd-Frank
7 3 (0.21%) IFRS
7 3 (0.21%) IFRS 9
8 2 (0.14%) EMIR
8 2 (0.14%) FedRAMP
8 2 (0.14%) PCI DSS
9 1 (0.070%) Basel III
9 1 (0.070%) COBIT
9 1 (0.070%) Disclosure Scotland
9 1 (0.070%) ISO/IEC 27001
9 1 (0.070%) NIST 800
9 1 (0.070%) SLA
System Software
1 311 (21.79%) HDFS
2 260 (18.22%) Docker
3 137 (9.60%) Apache Flume
4 84 (5.89%) Apache ZooKeeper
5 18 (1.26%) Active Directory
6 17 (1.19%) VMware Infrastructure
7 12 (0.84%) vCloud
8 10 (0.70%) Virtual Machines
9 5 (0.35%) Hyper-V
10 2 (0.14%) NFS
10 2 (0.14%) OpenAM
10 2 (0.14%) VMware ESXi
11 1 (0.070%) etcd
11 1 (0.070%) flannel
11 1 (0.070%) Oracle RAC
11 1 (0.070%) Postfix
11 1 (0.070%) PowerHA
11 1 (0.070%) Squid
11 1 (0.070%) VirtualBox
Systems Management
1 181 (12.68%) Ansible
2 159 (11.14%) Kubernetes
3 125 (8.76%) Puppet
4 122 (8.55%) Terraform
5 111 (7.78%) Oozie
6 100 (7.01%) Hadoop YARN
7 91 (6.38%) Opscode Chef
8 80 (5.61%) Ambari
9 27 (1.89%) Cobbler
10 24 (1.68%) Mesos
11 19 (1.33%) ITRS Geneos
11 19 (1.33%) ZABBIX
12 14 (0.98%) Nagios
13 13 (0.91%) Kibana
14 12 (0.84%) Graphite
15 11 (0.77%) Salt
16 7 (0.49%) logstash
17 4 (0.28%) Prometheus
18 3 (0.21%) Apache Slider
18 3 (0.21%) Microsoft Clustering
Vendors
1 160 (11.21%) Cloudera
2 146 (10.23%) Oracle
3 128 (8.97%) Hortonworks
4 116 (8.13%) Tableau
5 70 (4.91%) Google
6 58 (4.06%) IBM
7 55 (3.85%) SAP
8 53 (3.71%) Splunk
9 49 (3.43%) Microsoft
10 31 (2.17%) VMware
11 30 (2.10%) Teradata
12 28 (1.96%) MapR
13 25 (1.75%) AppDynamics
14 22 (1.54%) Red Hat
15 20 (1.40%) SaltStack
16 16 (1.12%) Informatica
17 14 (0.98%) MicroStrategy
18 12 (0.84%) Atlassian
19 10 (0.70%) Ab Initio
20 8 (0.56%) Sybase