Period
to 20 November 2017

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 20 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
20 Nov 2017
Same period 2016 Same period 2015
Rank 77 66 112
Rank change year-on-year -11 +46 +60
Contract jobs citing Hadoop 218 244 184
As % of all contract IT jobs advertised in the City of London 3.08% 3.70% 2.01%
As % of the Database & Business Intelligence category 12.59% 14.19% 7.73%
Number of daily rates quoted 191 201 162
City of London median daily rate £600 £575 £575
Median daily rate % change year-on-year +4.35% - +9.52%
10th Percentile £471 £438 £377
90th Percentile £725 £713 £725
Central London median daily rate £575 £575 £575
Number of hourly rates quoted 0 0 1
City of London median hourly rate - - £37.50
Central London median hourly rate - - £37.50

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1731 1720 2381
As % of all contract IT jobs advertised in the City of London 24.42% 26.08% 26.04%
Number of daily rates quoted 1405 1371 1908
City of London median daily rate £525 £475 £463
Median daily rate % change year-on-year +10.53% +2.70% +6.32%
10th Percentile £363 £325 £313
90th Percentile £700 £675 £638
Central London median daily rate £525 £475 £450
% change year-on-year +10.53% +5.56% +5.88%
Number of hourly rates quoted 11 1 9
City of London median hourly rate £27.50 £45.00 £25.00
Median hourly rate % change year-on-year -38.89% +80.00% -18.88%
10th Percentile £20.75 £42.50 £16.25
90th Percentile £33.25 £47.50 £70.75
Central London median hourly rate £25.99 £45.00 £21.98
% change year-on-year -42.24% +104.78% -25.46%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 20 November 2017.

Contractor daily rate histogram for Hadoop in the City of London

For the 6 months to 20 November 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region with a requirement for Hadoop.

1 168 (77.06%) Big Data
2 135 (61.93%) Apache Spark
3 118 (54.13%) Java
4 101 (46.33%) Apache Hive
5 90 (41.28%) Agile Software Development
6 85 (38.99%) Python
7 74 (33.94%) HDFS
8 72 (33.03%) Finance
9 71 (32.57%) SQL
9 71 (32.57%) Kafka
10 70 (32.11%) HBase
11 64 (29.36%) Banking
12 59 (27.06%) MapReduce
13 54 (24.77%) DevOps
14 53 (24.31%) Apache Flume
15 52 (23.85%) Scala
16 51 (23.39%) Oozie
17 47 (21.56%) Data Modelling
18 45 (20.64%) NoSQL
19 44 (20.18%) TDD
20 40 (18.35%) MongoDB
21 39 (17.89%) Analytics
21 39 (17.89%) Jenkins
21 39 (17.89%) Oracle
22 38 (17.43%) Amazon AWS
23 35 (16.06%) Apache
24 34 (15.60%) Docker
25 32 (14.68%) PostgreSQL
26 31 (14.22%) PySpark
27 30 (13.76%) Impala

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 135 (61.93%) Apache Spark
2 35 (16.06%) Apache
3 19 (8.72%) Elasticsearch
4 15 (6.88%) Apache Pig
5 12 (5.50%) Confluence
6 7 (3.21%) SAS
7 4 (1.83%) Apache Solr
8 3 (1.38%) Oracle Coherence
9 2 (0.92%) Tomcat
10 1 (0.46%) Apache Airflow
10 1 (0.46%) nginx
10 1 (0.46%) OpenStack
10 1 (0.46%) WebLogic
Applications
1 1 (0.46%) Microsoft Excel
Cloud Services
1 38 (17.43%) Amazon AWS
2 16 (7.34%) GitHub
3 15 (6.88%) Bluemix
3 15 (6.88%) IBM Cloud
4 6 (2.75%) Microsoft Azure
5 4 (1.83%) Virtual Private Cloud
6 3 (1.38%) Amazon S3
7 2 (0.92%) Amazon CloudWatch
7 2 (0.92%) Amazon EC2
8 1 (0.46%) Amazon EMR
8 1 (0.46%) Amazon Kinesis
8 1 (0.46%) AWS CloudFormation
8 1 (0.46%) Google Cloud Platform
8 1 (0.46%) IaaS
8 1 (0.46%) PaaS
8 1 (0.46%) SaaS
Communications & Networking
1 9 (4.13%) Kerberos
2 7 (3.21%) LDAP
3 6 (2.75%) DMZ
4 3 (1.38%) Network Security
5 2 (0.92%) DSL
5 2 (0.92%) HTTP
5 2 (0.92%) SSL
Database & Business Intelligence
1 168 (77.06%) Big Data
2 101 (46.33%) Apache Hive
3 70 (32.11%) HBase
4 45 (20.64%) NoSQL
5 40 (18.35%) MongoDB
6 32 (14.68%) PostgreSQL
7 30 (13.76%) Impala
8 27 (12.39%) Data Warehouse
9 25 (11.47%) Sqoop
10 24 (11.01%) Apache Cassandra
11 20 (9.17%) Relational Database
12 17 (7.80%) RDBMS
12 17 (7.80%) SQL Server
13 15 (6.88%) Oracle ODI
14 11 (5.05%) Oracle Database
15 5 (2.29%) MySQL
16 4 (1.83%) Amazon Redshift
16 4 (1.83%) QlikView
17 3 (1.38%) Amazon RDS
17 3 (1.38%) BigQuery
Development Applications
1 39 (17.89%) Jenkins
2 22 (10.09%) Git (software)
3 16 (7.34%) JIRA
4 10 (4.59%) TeamCity
5 5 (2.29%) Maven
6 4 (1.83%) Cucumber
7 3 (1.38%) SonarQube
7 3 (1.38%) Subversion
8 2 (0.92%) Artifactory
8 2 (0.92%) Eclipse
8 2 (0.92%) Jasmine
8 2 (0.92%) JUnit
8 2 (0.92%) Mockito
8 2 (0.92%) Travis CI
9 1 (0.46%) Codeship
9 1 (0.46%) ERwin
9 1 (0.46%) Mercurial
9 1 (0.46%) ProC
9 1 (0.46%) Talend Open Studio
General
1 72 (33.03%) Finance
2 64 (29.36%) Banking
3 29 (13.30%) Investment Banking
4 11 (5.05%) Front Office
5 5 (2.29%) Marketing
6 4 (1.83%) Publishing
7 3 (1.38%) Advertising
8 2 (0.92%) Back Office
8 2 (0.92%) Electronics
8 2 (0.92%) Manufacturing
8 2 (0.92%) Retail
8 2 (0.92%) Telecoms
9 1 (0.46%) Legal
Job Titles
1 67 (30.73%) Developer
2 27 (12.39%) Big Data Developer
2 27 (12.39%) Scala Developer
3 26 (11.93%) Java Engineer
4 23 (10.55%) Data Engineer
4 23 (10.55%) Hadoop Engineer
5 17 (7.80%) Analyst
6 16 (7.34%) Java Developer
7 14 (6.42%) Architect
7 14 (6.42%) Big Data Engineer
7 14 (6.42%) Hadoop Developer
7 14 (6.42%) Senior Developer
7 14 (6.42%) Senior Hadoop Engineer
7 14 (6.42%) Senior Java Engineer
8 11 (5.05%) Data Architect
8 11 (5.05%) Data Scientist
9 10 (4.59%) Apache Spark Developer
10 9 (4.13%) DevOps Engineer
11 8 (3.67%) SQL Developer
12 7 (3.21%) Data Analyst
Libraries, Frameworks & Software Standards
1 71 (32.57%) Kafka
2 31 (14.22%) PySpark
3 22 (10.09%) Akka
4 15 (6.88%) REST
5 14 (6.42%) JSON
5 14 (6.42%) RESTful
6 11 (5.05%) AngularJS
7 8 (3.67%) React
7 8 (3.67%) Redux
7 8 (3.67%) Twitter Bootstrap
8 7 (3.21%) Web Services
9 6 (2.75%) Play Framework
10 5 (2.29%) .NET
10 5 (2.29%) Guice
10 5 (2.29%) Hibernate
10 5 (2.29%) JPA
10 5 (2.29%) JSON Schema
10 5 (2.29%) Samza
11 4 (1.83%) Apache Avro
11 4 (1.83%) OpenCL
Miscellaneous
1 23 (10.55%) Analytical Skills
2 14 (6.42%) Market Risk
3 12 (5.50%) Algorithms
3 12 (5.50%) Data Centre
4 8 (3.67%) Credit Risk
4 8 (3.67%) Derivative
5 6 (2.75%) Computer Science
5 6 (2.75%) Greenfield Project
6 3 (1.38%) Equities
6 3 (1.38%) Fixed Income
6 3 (1.38%) Foreign Exchange (FX)
6 3 (1.38%) Grid Computing
6 3 (1.38%) Interest Rate Derivative
7 2 (0.92%) Replication
8 1 (0.46%) Clustering
8 1 (0.46%) Credit Derivative
8 1 (0.46%) Management Information System
8 1 (0.46%) Reference Data
8 1 (0.46%) Video Conferencing
8 1 (0.46%) Virtual Team
Operating Systems
1 28 (12.84%) Linux
2 25 (11.47%) Unix
3 11 (5.05%) Windows
4 6 (2.75%) Windows Server 2012
5 3 (1.38%) Red Hat Enterprise Linux
6 2 (0.92%) Android
6 2 (0.92%) Apple iOS
7 1 (0.46%) AIX
7 1 (0.46%) CentOS
Processes & Methodologies
1 90 (41.28%) Agile Software Development
2 59 (27.06%) MapReduce
3 54 (24.77%) DevOps
4 47 (21.56%) Data Modelling
5 44 (20.18%) TDD
6 39 (17.89%) Analytics
7 30 (13.76%) Open Source
8 29 (13.30%) Data Engineering
9 27 (12.39%) BDD
10 22 (10.09%) Business Intelligence
11 20 (9.17%) ETL
12 17 (7.80%) Multithreading
12 17 (7.80%) Scrum
13 15 (6.88%) Data Analysis
13 15 (6.88%) Use Case
14 12 (5.50%) Data Analytics
14 12 (5.50%) Microservices
15 11 (5.05%) Continuous Integration
15 11 (5.05%) Visualisation
16 10 (4.59%) Machine Learning
Programming Languages
1 118 (54.13%) Java
2 85 (38.99%) Python
3 71 (32.57%) SQL
4 52 (23.85%) Scala
5 20 (9.17%) Shell Script
6 18 (8.26%) R
7 12 (5.50%) JavaScript
7 12 (5.50%) PL/SQL
8 11 (5.05%) Bash Shell
9 9 (4.13%) C#
10 6 (2.75%) Groovy
10 6 (2.75%) PowerShell
11 2 (0.92%) COBOL
11 2 (0.92%) T-SQL
11 2 (0.92%) TypeScript
12 1 (0.46%) C
12 1 (0.46%) Data Analysis Expressions (DAX)
12 1 (0.46%) Go
12 1 (0.46%) PROC SQL
12 1 (0.46%) SAS Macro
Qualifications
1 10 (4.59%) Security Cleared
2 5 (2.29%) DV Cleared
3 4 (1.83%) Degree
3 4 (1.83%) SC Cleared
4 2 (0.92%) PhD
5 1 (0.46%) Computer Science Degree
Quality Assurance & Compliance
1 7 (3.21%) Data Quality
2 3 (1.38%) IFRS
2 3 (1.38%) IFRS 9
3 2 (0.92%) QA
4 1 (0.46%) MiFID
System Software
1 74 (33.94%) HDFS
2 53 (24.31%) Apache Flume
3 34 (15.60%) Docker
4 13 (5.96%) Apache ZooKeeper
5 6 (2.75%) Active Directory
Systems Management
1 51 (23.39%) Oozie
2 25 (11.47%) Ambari
3 21 (9.63%) Hadoop YARN
4 17 (7.80%) Kubernetes
5 15 (6.88%) Ansible
6 10 (4.59%) Puppet
7 5 (2.29%) Mesos
7 5 (2.29%) Opscode Chef
7 5 (2.29%) Terraform
8 2 (0.92%) Control-M
8 2 (0.92%) Graphite
8 2 (0.92%) ITRS Geneos
9 1 (0.46%) Apache Slider
9 1 (0.46%) ZABBIX
Vendors
1 39 (17.89%) Oracle
2 26 (11.93%) Tableau
3 18 (8.26%) Cloudera
4 17 (7.80%) IBM
5 7 (3.21%) Hortonworks
5 7 (3.21%) Teradata
6 5 (2.29%) Google
7 4 (1.83%) Microsoft
7 4 (1.83%) SAP
7 4 (1.83%) Splunk
8 3 (1.38%) Red Hat
8 3 (1.38%) SaltStack
9 2 (0.92%) Informatica
9 2 (0.92%) MapR
9 2 (0.92%) MicroStrategy
9 2 (0.92%) Palantir
10 1 (0.46%) Greenplum
10 1 (0.46%) Netezza
10 1 (0.46%) Nuix
10 1 (0.46%) Talend