Period
to 12 December 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 12 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
12 Dec 2018
Same period 2017 Same period 2016
Rank 83 88 57
Rank change year-on-year +5 -31 +49
Contract jobs citing Hadoop 224 210 262
As % of all contract IT jobs advertised in the City of London 3.14% 2.91% 3.99%
As % of the Database & Business Intelligence category 12.54% 11.80% 15.00%
Number of daily rates quoted 180 180 216
City of London median daily rate £575 £600 £580
Median daily rate % change year-on-year -4.17% +3.45% -1.28%
10th Percentile £499 £493 £438
90th Percentile £713 £725 £713
Central London median daily rate £575 £600 £580
% change year-on-year -4.17% +3.45% +0.87%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,786 1,779 1,747
As % of all contract IT jobs advertised in the City of London 25.04% 24.68% 26.63%
Number of daily rates quoted 1,427 1,459 1,392
City of London median daily rate £525 £525 £475
Median daily rate % change year-on-year - +10.53% -
10th Percentile £375 £370 £325
90th Percentile £675 £689 £663
Central London median daily rate £525 £525 £475
% change year-on-year - +10.53% +2.70%
Number of hourly rates quoted 11 9 1
City of London median hourly rate £35.00 £27.50 £45.00
Median hourly rate % change year-on-year +27.27% -38.89% +44.00%
10th Percentile £19.50 £20.75 £42.50
90th Percentile £42.19 £33.25 £47.50
Central London median hourly rate £35.00 £27.50 £45.00
% change year-on-year +27.27% -38.89% +91.59%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 12 December 2018.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 12 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 33 £550 -
Hadoop
Central London

For the 6 months to 12 December 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 160 (71.43%) Big Data
2 132 (58.93%) Apache Spark
3 121 (54.02%) Kafka
4 97 (43.30%) Python
5 95 (42.41%) Apache Hive
6 84 (37.50%) Java
7 82 (36.61%) Finance
8 75 (33.48%) SQL
9 66 (29.46%) Amazon AWS
10 62 (27.68%) Data Science
11 59 (26.34%) Agile Software Development
12 52 (23.21%) Machine Learning
13 51 (22.77%) Analytics
14 50 (22.32%) Data Modelling
15 47 (20.98%) Linux
16 46 (20.54%) Java 8
17 41 (18.30%) Git (software)
18 39 (17.41%) Elasticsearch
19 38 (16.96%) SQL Server
20 36 (16.07%) ETL
21 35 (15.63%) HDFS
21 35 (15.63%) Cloudera
22 32 (14.29%) AngularJS
22 32 (14.29%) Docker
22 32 (14.29%) Data Warehouse
22 32 (14.29%) Scala
22 32 (14.29%) Apache Cassandra
23 31 (13.84%) MongoDB
23 31 (13.84%) Microsoft Azure
23 31 (13.84%) Impala

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 132 (58.93%) Apache Spark
2 39 (17.41%) Elasticsearch
3 21 (9.38%) Apache
4 13 (5.80%) Confluence
5 9 (4.02%) SAS
6 6 (2.68%) Apache Pig
7 4 (1.79%) Cloud Foundry
8 2 (0.89%) Apache Airflow
8 2 (0.89%) Apache Solr
8 2 (0.89%) Luigi
9 1 (0.45%) SharePoint
Applications
1 12 (5.36%) Microsoft Excel
2 10 (4.46%) MS Visio
3 1 (0.45%) Spreadsheet
Business Applications
1 1 (0.45%) Dynamics NAV
Cloud Services
1 66 (29.46%) Amazon AWS
2 31 (13.84%) Microsoft Azure
3 18 (8.04%) Heroku
4 15 (6.70%) Google Cloud Platform
5 13 (5.80%) Amazon S3
6 12 (5.36%) Amazon EC2
7 10 (4.46%) Amazon EMR
7 10 (4.46%) Virtual Private Cloud
8 7 (3.13%) IBM Cloud
9 5 (2.23%) GitHub
10 2 (0.89%) AWS Lambda
10 2 (0.89%) Serverless
11 1 (0.45%) Adobe Analytics
11 1 (0.45%) Akamai
11 1 (0.45%) Amazon Kinesis
11 1 (0.45%) Azure Data Factory
11 1 (0.45%) iPaaS
11 1 (0.45%) PaaS
Communications & Networking
1 22 (9.82%) HTTP
2 19 (8.48%) SSL
3 18 (8.04%) DNS
3 18 (8.04%) FTP
3 18 (8.04%) TCP/IP
4 7 (3.13%) Kerberos
5 2 (0.89%) Firewall
6 1 (0.45%) Internet
6 1 (0.45%) LAN
6 1 (0.45%) SNA
6 1 (0.45%) X.509
Database & Business Intelligence
1 160 (71.43%) Big Data
2 95 (42.41%) Apache Hive
3 38 (16.96%) SQL Server
4 32 (14.29%) Apache Cassandra
4 32 (14.29%) Data Warehouse
5 31 (13.84%) Impala
5 31 (13.84%) MongoDB
6 27 (12.05%) NoSQL
7 23 (10.27%) HBase
8 22 (9.82%) Enterprise Data Warehouse
8 22 (9.82%) OLAP
9 21 (9.38%) OLAP Cube
9 21 (9.38%) Star Schema
10 19 (8.48%) Data Lake
10 19 (8.48%) Sqoop
11 18 (8.04%) Relational Database
12 17 (7.59%) Power BI
13 14 (6.25%) SQL Server Integration Services
14 13 (5.80%) Data Mining
15 10 (4.46%) Spotfire
Development Applications
1 41 (18.30%) Git (software)
2 30 (13.39%) Jenkins
3 21 (9.38%) GitLab
3 21 (9.38%) Maven
4 18 (8.04%) Gradle
4 18 (8.04%) gulp
5 17 (7.59%) JIRA
6 10 (4.46%) Subversion
7 9 (4.02%) Cucumber
8 8 (3.57%) Atlassian Bamboo
8 8 (3.57%) FishEye
8 8 (3.57%) jMock
8 8 (3.57%) JUnit
9 4 (1.79%) Sonatype Nexus
9 4 (1.79%) Visual Studio Team System
10 3 (1.34%) Artifactory
10 3 (1.34%) Visual Studio
11 2 (0.89%) Octopus Deploy
11 2 (0.89%) TeamCity
11 2 (0.89%) Travis CI
General
1 82 (36.61%) Finance
2 14 (6.25%) Banking
2 14 (6.25%) Front Office
2 14 (6.25%) Retail
3 3 (1.34%) Back Office
3 3 (1.34%) Legal
3 3 (1.34%) Publishing
4 2 (0.89%) Advertising
4 2 (0.89%) Financial Institution
4 2 (0.89%) Investment Banking
4 2 (0.89%) Marketing
4 2 (0.89%) Telecoms
5 1 (0.45%) Corporate Banking
5 1 (0.45%) Electronics
Job Titles
1 70 (31.25%) Data Engineer
2 63 (28.13%) Developer
3 41 (18.30%) Big Data Engineer
3 41 (18.30%) Hadoop Engineer
4 36 (16.07%) Java Developer
5 24 (10.71%) Senior Developer
6 19 (8.48%) Data Scientist
7 17 (7.59%) Senior Java Developer
8 15 (6.70%) Technical Leader
9 13 (5.80%) Java Engineer
9 13 (5.80%) Lead Developer
9 13 (5.80%) Lead Java Developer
9 13 (5.80%) Python Engineer
9 13 (5.80%) Senior Java Engineer
9 13 (5.80%) Technical Developer
10 12 (5.36%) DevOps Engineer
10 12 (5.36%) Elasticsearch Engineer
10 12 (5.36%) Senior Hadoop Engineer
11 11 (4.91%) Architect
11 11 (4.91%) Platform Engineer
Libraries, Frameworks & Software Standards
1 121 (54.02%) Kafka
2 32 (14.29%) AngularJS
3 22 (9.82%) REST
3 22 (9.82%) Spring
4 20 (8.93%) CSS
4 20 (8.93%) HTML
4 20 (8.93%) OAuth
4 20 (8.93%) OAuth2
5 19 (8.48%) HTML5
5 19 (8.48%) Spring Boot
6 18 (8.04%) Dropwizard
6 18 (8.04%) Ember.js
6 18 (8.04%) Guice
6 18 (8.04%) Ratpack
6 18 (8.04%) SOAP
7 10 (4.46%) PySpark
8 9 (4.02%) Natural Language Processing
9 8 (3.57%) Spark Streaming
10 7 (3.13%) TensorFlow
11 6 (2.68%) JSON
Miscellaneous
1 24 (10.71%) Algorithms
2 17 (7.59%) Greenfield Project
3 12 (5.36%) Analytical Skills
4 10 (4.46%) Wiki
5 5 (2.23%) Fintech
6 4 (1.79%) iPad
7 2 (0.89%) Management Information System
7 2 (0.89%) Private Cloud
7 2 (0.89%) User Experience
8 1 (0.45%) Cyberthreat
8 1 (0.45%) Data Centre
8 1 (0.45%) Derivative
8 1 (0.45%) Distributed Denial-of-Service
8 1 (0.45%) HoloLens
8 1 (0.45%) Media Streaming
8 1 (0.45%) PKI
8 1 (0.45%) Reference Data
8 1 (0.45%) Robotics
Operating Systems
1 47 (20.98%) Linux
2 24 (10.71%) Unix
3 10 (4.46%) Windows
4 6 (2.68%) Red Hat Enterprise Linux
5 2 (0.89%) Android
Processes & Methodologies
1 62 (27.68%) Data Science
2 59 (26.34%) Agile Software Development
3 52 (23.21%) Machine Learning
4 51 (22.77%) Analytics
5 50 (22.32%) Data Modelling
6 36 (16.07%) ETL
7 30 (13.39%) Business Intelligence
8 29 (12.95%) DevOps
9 28 (12.50%) Microservices
10 25 (11.16%) Scrum
10 25 (11.16%) Visualisation
11 22 (9.82%) Data Analysis
12 21 (9.38%) SQL Optimisation
12 21 (9.38%) TDD
13 18 (8.04%) Domain-Driven Design
13 18 (8.04%) OWASP
14 16 (7.14%) Continuous Integration
14 16 (7.14%) Data Integration
15 15 (6.70%) Artificial Intelligence
15 15 (6.70%) BDD
Programming Languages
1 97 (43.30%) Python
2 84 (37.50%) Java
3 75 (33.48%) SQL
4 46 (20.54%) Java 8
5 32 (14.29%) Scala
6 29 (12.95%) JavaScript
7 19 (8.48%) R
8 18 (8.04%) ES6
8 18 (8.04%) TypeScript
9 16 (7.14%) Bash Shell
10 14 (6.25%) Shell Script
11 12 (5.36%) PowerShell
12 10 (4.46%) Korn
12 10 (4.46%) MATLAB
13 7 (3.13%) C#
14 5 (2.23%) Groovy
15 3 (1.34%) Clojure
15 3 (1.34%) Kotlin
16 2 (0.89%) T-SQL
17 1 (0.45%) VBA
Qualifications
1 13 (5.80%) Degree
2 11 (4.91%) PhD
3 8 (3.57%) Master's Degree
4 1 (0.45%) Computer Science Degree
4 1 (0.45%) Numerate Degree
Quality Assurance & Compliance
1 26 (11.61%) Data Quality
2 5 (2.23%) QA
3 1 (0.45%) SLA
System Software
1 35 (15.63%) HDFS
2 32 (14.29%) Docker
3 20 (8.93%) Apache Flume
4 4 (1.79%) Active Directory
5 1 (0.45%) Apache ZooKeeper
Systems Management
1 28 (12.50%) Kubernetes
1 28 (12.50%) Oozie
2 25 (11.16%) Hadoop YARN
3 24 (10.71%) Ansible
4 18 (8.04%) Docker Swarm
5 13 (5.80%) Puppet
6 12 (5.36%) Opscode Chef
7 11 (4.91%) Terraform
8 6 (2.68%) Ambari
9 3 (1.34%) ITRS Geneos
9 3 (1.34%) Tivoli
10 2 (0.89%) Grafana
10 2 (0.89%) Prometheus
11 1 (0.45%) Apache Slider
11 1 (0.45%) Kibana
11 1 (0.45%) logstash
11 1 (0.45%) Salt
Vendors
1 35 (15.63%) Cloudera
2 30 (13.39%) Oracle
3 27 (12.05%) Hortonworks
4 17 (7.59%) Tableau
5 14 (6.25%) Google
6 13 (5.80%) Microsoft
6 13 (5.80%) Talend
7 8 (3.57%) Atlassian
7 8 (3.57%) Sybase
8 7 (3.13%) IBM
9 6 (2.68%) Alteryx
9 6 (2.68%) Informatica
9 6 (2.68%) MapR
10 5 (2.23%) Red Hat
11 3 (1.34%) Teradata
12 2 (0.89%) Ab Initio
13 1 (0.45%) Adobe
13 1 (0.45%) ION Trading
13 1 (0.45%) Salesforce.com
13 1 (0.45%) Splunk