Period
to 24 January 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 24 January 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
24 Jan 2018
Same period 2017 Same period 2016
Rank 86 50 113
Rank change year-on-year -36 +63 +39
Contract jobs citing Hadoop 196 256 126
As % of all contract IT jobs advertised in the City of London 2.75% 4.12% 1.83%
As % of the Database & Business Intelligence category 11.07% 14.82% 6.99%
Number of daily rates quoted 172 214 111
City of London median daily rate £600 £588 £550
Median daily rate % change year-on-year +2.13% +6.82% -
10th Percentile £468 £438 £363
90th Percentile £725 £700 £688
Central London median daily rate £575 £589 £550
% change year-on-year -2.34% +7.05% -
Number of hourly rates quoted 0 0 1
City of London median hourly rate - - £37.50
Central London median hourly rate - - £37.50

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,770 1,727 1,802
As % of all contract IT jobs advertised in the City of London 24.81% 27.79% 26.20%
Number of daily rates quoted 1,485 1,389 1,451
City of London median daily rate £525 £475 £475
Median daily rate % change year-on-year +10.53% - +11.76%
10th Percentile £363 £325 £313
90th Percentile £688 £663 £638
Central London median daily rate £513 £475 £475
% change year-on-year +7.89% - +11.76%
Number of hourly rates quoted 6 1 6
City of London median hourly rate £27.75 £45.00 £40.00
Median hourly rate % change year-on-year -38.33% +12.50% +21.21%
10th Percentile £23.38 £42.50 £27.75
90th Percentile £33.25 £47.50 £60.00
Central London median hourly rate £27.50 £45.00 £38.75
% change year-on-year -38.89% +16.13% +49.04%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 24 January 2018.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 24 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 1 £425 -
Hadoop
Central London

For the 6 months to 24 January 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 150 (76.53%) Big Data
2 133 (67.86%) Apache Spark
3 109 (55.61%) Java
4 102 (52.04%) Apache Hive
5 80 (40.82%) Python
6 79 (40.31%) HDFS
7 76 (38.78%) Kafka
8 67 (34.18%) Finance
8 67 (34.18%) Agile Software Development
9 65 (33.16%) HBase
10 63 (32.14%) SQL
11 61 (31.12%) Apache Flume
12 56 (28.57%) MapReduce
13 54 (27.55%) Banking
14 53 (27.04%) Oozie
15 50 (25.51%) Scala
16 42 (21.43%) Amazon AWS
17 41 (20.92%) Data Modelling
17 41 (20.92%) NoSQL
17 41 (20.92%) Analytics
18 40 (20.41%) DevOps
19 39 (19.90%) Oracle
20 33 (16.84%) Data Warehouse
20 33 (16.84%) Docker
20 33 (16.84%) Jenkins
21 32 (16.33%) MongoDB
21 32 (16.33%) Data Engineering
21 32 (16.33%) Apache
22 31 (15.82%) PostgreSQL
22 31 (15.82%) TDD

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 133 (67.86%) Apache Spark
2 32 (16.33%) Apache
3 18 (9.18%) Elasticsearch
4 10 (5.10%) Apache Pig
5 6 (3.06%) SAS
6 5 (2.55%) Confluence
7 4 (2.04%) Apache Solr
8 3 (1.53%) Oracle Coherence
8 3 (1.53%) Tomcat
9 2 (1.02%) IPython
9 2 (1.02%) Jupyter
9 2 (1.02%) nginx
10 1 (0.51%) Apache Airflow
10 1 (0.51%) Jetty
10 1 (0.51%) OpenStack
10 1 (0.51%) WebLogic
Applications
1 2 (1.02%) SPSS
Cloud Services
1 42 (21.43%) Amazon AWS
2 17 (8.67%) GitHub
3 14 (7.14%) Bluemix
3 14 (7.14%) IBM Cloud
4 12 (6.12%) Microsoft Azure
5 3 (1.53%) Amazon Kinesis
6 2 (1.02%) Amazon S3
6 2 (1.02%) Google Cloud Platform
7 1 (0.51%) Amazon EC2
7 1 (0.51%) Amazon EMR
7 1 (0.51%) AWS CloudFormation
7 1 (0.51%) AWS CloudTrail
7 1 (0.51%) AWS Lambda
7 1 (0.51%) Azure Active Directory
7 1 (0.51%) CloudFront
7 1 (0.51%) PaaS
7 1 (0.51%) Route 53
7 1 (0.51%) Serverless
7 1 (0.51%) Virtual Private Cloud
Communications & Networking
1 10 (5.10%) Kerberos
2 4 (2.04%) DMZ
3 3 (1.53%) SSL
4 1 (0.51%) Firewall
4 1 (0.51%) Network Security
4 1 (0.51%) SSH
Database & Business Intelligence
1 150 (76.53%) Big Data
2 102 (52.04%) Apache Hive
3 65 (33.16%) HBase
4 41 (20.92%) NoSQL
5 33 (16.84%) Data Warehouse
6 32 (16.33%) MongoDB
7 31 (15.82%) PostgreSQL
8 27 (13.78%) Impala
9 25 (12.76%) Sqoop
10 24 (12.24%) Relational Database
11 23 (11.73%) Apache Cassandra
12 16 (8.16%) RDBMS
13 14 (7.14%) Oracle ODI
14 12 (6.12%) SQL Server
15 11 (5.61%) Oracle Database
16 9 (4.59%) Data Lake
17 7 (3.57%) Amazon Redshift
18 5 (2.55%) QlikView
19 3 (1.53%) SAS Enterprise Guide
19 3 (1.53%) SQL Server Integration Services
Development Applications
1 33 (16.84%) Jenkins
2 11 (5.61%) Git (software)
3 7 (3.57%) TeamCity
4 5 (2.55%) JIRA
4 5 (2.55%) Maven
5 4 (2.04%) Cucumber
6 3 (1.53%) ERwin
6 3 (1.53%) JUnit
6 3 (1.53%) SonarQube
7 2 (1.02%) GoCD
7 2 (1.02%) Subversion
7 2 (1.02%) Travis CI
7 2 (1.02%) Vagrant
8 1 (0.51%) Babel
8 1 (0.51%) Bower
8 1 (0.51%) Codeship
8 1 (0.51%) Grunt
8 1 (0.51%) JConsole
8 1 (0.51%) JProfiler
8 1 (0.51%) VisualVM
General
1 67 (34.18%) Finance
2 54 (27.55%) Banking
3 15 (7.65%) Investment Banking
4 11 (5.61%) Front Office
5 8 (4.08%) Retail
6 6 (3.06%) Marketing
7 4 (2.04%) Advertising
7 4 (2.04%) Telecoms
8 2 (1.02%) Electronics
8 2 (1.02%) Manufacturing
8 2 (1.02%) Publishing
9 1 (0.51%) Automotive
9 1 (0.51%) Back Office
9 1 (0.51%) French Language
9 1 (0.51%) Games
9 1 (0.51%) Legal
9 1 (0.51%) Retail Banking
9 1 (0.51%) Spanish Language
Job Titles
1 41 (20.92%) Developer
2 29 (14.80%) Data Engineer
3 28 (14.29%) Java Engineer
4 25 (12.76%) Hadoop Engineer
5 21 (10.71%) Big Data Developer
6 15 (7.65%) Scala Developer
6 15 (7.65%) Senior Hadoop Engineer
6 15 (7.65%) Senior Java Engineer
7 13 (6.63%) Architect
7 13 (6.63%) Big Data Engineer
8 12 (6.12%) Data Scientist
9 11 (5.61%) Java Developer
10 10 (5.10%) Analyst
10 10 (5.10%) Data Architect
11 8 (4.08%) Apache Spark Developer
11 8 (4.08%) DevOps Engineer
12 7 (3.57%) Hadoop Developer
13 6 (3.06%) Cloud Engineer
14 5 (2.55%) Big Data Architect
14 5 (2.55%) Hadoop Administrator
Libraries, Frameworks & Software Standards
1 76 (38.78%) Kafka
2 28 (14.29%) PySpark
3 14 (7.14%) Akka
4 12 (6.12%) JSON
5 11 (5.61%) AngularJS
6 10 (5.10%) REST
6 10 (5.10%) RESTful
7 9 (4.59%) React
8 8 (4.08%) Redux
8 8 (4.08%) Twitter Bootstrap
9 6 (3.06%) Web Services
9 6 (3.06%) XML
10 5 (2.55%) LDAP
11 4 (2.04%) Apache Avro
11 4 (2.04%) Gherkin
11 4 (2.04%) Guice
11 4 (2.04%) Hibernate
11 4 (2.04%) JPA
11 4 (2.04%) OpenCL
11 4 (2.04%) Samza
Miscellaneous
1 27 (13.78%) Analytical Skills
2 13 (6.63%) Algorithms
3 11 (5.61%) Derivative
3 11 (5.61%) Market Risk
4 9 (4.59%) Data Centre
5 6 (3.06%) Computer Science
6 5 (2.55%) Credit Risk
7 4 (2.04%) Grid Computing
7 4 (2.04%) Replication
8 3 (1.53%) Equities
8 3 (1.53%) Fixed Income
8 3 (1.53%) Foreign Exchange (FX)
8 3 (1.53%) Interest Rate Derivative
9 2 (1.02%) Greenfield Project
9 2 (1.02%) iPad
9 2 (1.02%) Life Science
10 1 (0.51%) Analytical Mindset
10 1 (0.51%) Data Structures
10 1 (0.51%) Fintech
10 1 (0.51%) Wiki
Operating Systems
1 23 (11.73%) Linux
2 13 (6.63%) Unix
3 10 (5.10%) Windows
4 7 (3.57%) Red Hat Enterprise Linux
5 4 (2.04%) Windows Server 2012
6 3 (1.53%) Windows Server
7 2 (1.02%) Windows Server 2008
8 1 (0.51%) AIX
8 1 (0.51%) CentOS
8 1 (0.51%) DC/OS
Processes & Methodologies
1 67 (34.18%) Agile Software Development
2 56 (28.57%) MapReduce
3 41 (20.92%) Analytics
3 41 (20.92%) Data Modelling
4 40 (20.41%) DevOps
5 32 (16.33%) Data Engineering
6 31 (15.82%) TDD
7 28 (14.29%) Business Intelligence
8 27 (13.78%) ETL
9 25 (12.76%) Open Source
10 22 (11.22%) BDD
11 19 (9.69%) Machine Learning
12 16 (8.16%) Use Case
13 15 (7.65%) Multithreading
14 11 (5.61%) Scrum
15 10 (5.10%) Continuous Integration
15 10 (5.10%) Data Analytics
15 10 (5.10%) Microservices
15 10 (5.10%) Risk Management
16 9 (4.59%) Mentoring
Programming Languages
1 109 (55.61%) Java
2 80 (40.82%) Python
3 63 (32.14%) SQL
4 50 (25.51%) Scala
5 20 (10.20%) Shell Script
6 18 (9.18%) R
7 14 (7.14%) JavaScript
8 12 (6.12%) PL/SQL
9 6 (3.06%) Bash Shell
10 5 (2.55%) Groovy
10 5 (2.55%) PowerShell
11 4 (2.04%) C#
11 4 (2.04%) Haskell
12 3 (1.53%) C
13 2 (1.02%) Go
13 2 (1.02%) T-SQL
14 1 (0.51%) Data Analysis Expressions (DAX)
14 1 (0.51%) Julia
14 1 (0.51%) PROC SQL
14 1 (0.51%) SAS Macro
Qualifications
1 6 (3.06%) Security Cleared
2 3 (1.53%) Degree
2 3 (1.53%) DV Cleared
2 3 (1.53%) SC Cleared
3 2 (1.02%) PhD
4 1 (0.51%) Computer Science Degree
4 1 (0.51%) Numerate Degree
4 1 (0.51%) PRINCE2 Certification
Quality Assurance & Compliance
1 5 (2.55%) Data Quality
2 3 (1.53%) IFRS
2 3 (1.53%) IFRS 9
3 2 (1.02%) Dodd-Frank
3 2 (1.02%) EMIR
3 2 (1.02%) MiFID
3 2 (1.02%) QA
4 1 (0.51%) GCP
System Software
1 79 (40.31%) HDFS
2 61 (31.12%) Apache Flume
3 33 (16.84%) Docker
4 10 (5.10%) Apache ZooKeeper
5 7 (3.57%) Active Directory
6 1 (0.51%) Virtual Machines
Systems Management
1 53 (27.04%) Oozie
2 28 (14.29%) Ambari
3 22 (11.22%) Hadoop YARN
4 17 (8.67%) Kubernetes
5 8 (4.08%) Ansible
6 7 (3.57%) Mesos
7 6 (3.06%) Puppet
8 5 (2.55%) Opscode Chef
9 4 (2.04%) Apache Slider
10 3 (1.53%) Terraform
11 2 (1.02%) ITRS Geneos
12 1 (0.51%) Salt
12 1 (0.51%) ZABBIX
Vendors
1 39 (19.90%) Oracle
2 26 (13.27%) Tableau
3 20 (10.20%) Cloudera
4 19 (9.69%) Hortonworks
5 18 (9.18%) IBM
6 7 (3.57%) Microsoft
7 6 (3.06%) MapR
7 6 (3.06%) SAP
8 5 (2.55%) Informatica
9 4 (2.04%) Google
10 3 (1.53%) Splunk
10 3 (1.53%) Talend
10 3 (1.53%) Teradata
11 2 (1.02%) Ab Initio
11 2 (1.02%) Cognos
11 2 (1.02%) Embarcadero
11 2 (1.02%) MicroStrategy
11 2 (1.02%) Red Hat
11 2 (1.02%) Vertica
12 1 (0.51%) Sybase