Period
to 18 December 2018

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 18 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Tower Hamlets > Canary Wharf
6 months to
18 Dec 2018
Same period 2017 Same period 2016
Rank 19 39 29
Rank change year-on-year +20 -10 -3
Contract jobs citing Hadoop 54 13 12
As % of all contract IT jobs advertised in Canary Wharf 14.32% 4.35% 3.93%
As % of the Database & Business Intelligence category 33.13% 16.88% 17.39%
Number of daily rates quoted 40 5 9
Canary Wharf median daily rate £575 £563 £550
Median daily rate % change year-on-year +2.22% +2.27% +22.22%
10th Percentile £513 £528 £380
90th Percentile £650 £615 £613
Tower Hamlets median daily rate £575 £556 £575
% change year-on-year +3.37% -3.26% +21.05%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Canary Wharf
Contract vacancies with a requirement for database or business intelligence skills 163 77 69
As % of all contract IT jobs advertised in Canary Wharf 43.24% 25.75% 22.62%
Number of daily rates quoted 140 54 51
Canary Wharf median daily rate £575 £575 £475
Median daily rate % change year-on-year - +21.05% -5.00%
10th Percentile £438 £391 £313
90th Percentile £650 £650 £625
Tower Hamlets median daily rate £575 £575 £475
% change year-on-year - +21.05% -9.52%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop
Job Vacancy Trend in Canary Wharf

Job postings citing Hadoop as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Canary Wharf.

Contractor daily rate trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Hadoop in Canary Wharf over the 6 months to 18 December 2018.

Contractor daily rate histogram for Hadoop in Canary Wharf

For the 6 months to 18 December 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Hadoop.

1 50 (92.59%) Python
2 45 (83.33%) Amazon AWS
3 32 (59.26%) Java
3 32 (59.26%) DevOps
4 31 (57.41%) Ansible
5 29 (53.70%) RESTful
6 28 (51.85%) Docker
6 28 (51.85%) Microservices
6 28 (51.85%) Kubernetes
6 28 (51.85%) Terraform
6 28 (51.85%) Greenfield Project
7 22 (40.74%) Big Data
8 19 (35.19%) Analytics
9 16 (29.63%) Apache Hive
10 14 (25.93%) Deep Learning
11 13 (24.07%) Machine Learning
11 13 (24.07%) SQL
11 13 (24.07%) Finance
12 12 (22.22%) Apache Spark
12 12 (22.22%) Analytical Skills
13 11 (20.37%) Data Science
13 11 (20.37%) Data Analysis
13 11 (20.37%) Hortonworks
13 11 (20.37%) Statistical Modelling
13 11 (20.37%) Degree
14 10 (18.52%) Cloudera
14 10 (18.52%) Agile Software Development
14 10 (18.52%) Algorithms
14 10 (18.52%) Master's Degree
15 9 (16.67%) PySpark

Hadoop
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 12 (22.22%) Apache Spark
2 4 (7.41%) SAS
3 3 (5.56%) Elasticsearch
3 3 (5.56%) SharePoint
4 2 (3.70%) Apache Pig
4 2 (3.70%) Apache Solr
4 2 (3.70%) Confluence
5 1 (1.85%) Apache
Applications
1 1 (1.85%) Chatbot
1 1 (1.85%) Microsoft Excel
1 1 (1.85%) MS Visio
Business Applications
1 1 (1.85%) SAP Oil and Gas
Cloud Services
1 45 (83.33%) Amazon AWS
2 8 (14.81%) Amazon EMR
3 7 (12.96%) Microsoft Azure
4 4 (7.41%) Google Cloud Platform
5 3 (5.56%) Amazon S3
6 1 (1.85%) Amazon EC2
6 1 (1.85%) Azure Data Factory
6 1 (1.85%) Virtual Private Cloud
Communications & Networking
1 2 (3.70%) Kerberos
1 2 (3.70%) SSL
1 2 (3.70%) VPN
Database & Business Intelligence
1 22 (40.74%) Big Data
2 16 (29.63%) Apache Hive
3 7 (12.96%) NoSQL
3 7 (12.96%) Power BI
3 7 (12.96%) Relational Database
4 6 (11.11%) Data Warehouse
4 6 (11.11%) SQL Server
5 5 (9.26%) RDBMS
5 5 (9.26%) Spotfire
6 4 (7.41%) HBase
7 3 (5.56%) Data Lake
7 3 (5.56%) Data Mining
8 2 (3.70%) Amazon Redshift
8 2 (3.70%) Apache Cassandra
8 2 (3.70%) HDInsight
8 2 (3.70%) Parquet
9 1 (1.85%) BigQuery
9 1 (1.85%) Impala
9 1 (1.85%) Neo4j
9 1 (1.85%) Redis
Development Applications
1 6 (11.11%) Git (software)
2 4 (7.41%) Visual Studio Team System
3 2 (3.70%) FishEye
3 2 (3.70%) JIRA
4 1 (1.85%) Jenkins
General
1 13 (24.07%) Finance
2 2 (3.70%) Games
2 2 (3.70%) Marketing
3 1 (1.85%) Banking
3 1 (1.85%) Retail
Job Titles
1 28 (51.85%) AWS DevOps
1 28 (51.85%) AWS DevOps Engineer
1 28 (51.85%) AWS Engineer
1 28 (51.85%) DevOps Engineer
1 28 (51.85%) Hadoop Engineer
2 15 (27.78%) Data Engineer
3 14 (25.93%) Big Data Engineer
4 10 (18.52%) Python Engineer
5 4 (7.41%) Data Scientist
6 2 (3.70%) Big Data Developer
6 2 (3.70%) Developer
6 2 (3.70%) Financial Services Project Manager
6 2 (3.70%) Platform Manager
6 2 (3.70%) Project Manager
7 1 (1.85%) Analyst
7 1 (1.85%) Data Analyst
7 1 (1.85%) Java Engineer
7 1 (1.85%) Platform Architect
7 1 (1.85%) Platform Engineer
7 1 (1.85%) SAP Engineer
Libraries, Frameworks & Software Standards
1 29 (53.70%) RESTful
2 9 (16.67%) PySpark
3 4 (7.41%) OpenCV
3 4 (7.41%) Unity (Game Engine)
4 3 (5.56%) Kafka
4 3 (5.56%) Keras
4 3 (5.56%) Natural Language Processing
4 3 (5.56%) TensorFlow
5 2 (3.70%) Caffe
5 2 (3.70%) HTML
5 2 (3.70%) HTML5
5 2 (3.70%) Play Framework
5 2 (3.70%) React
5 2 (3.70%) Theano
5 2 (3.70%) XML
6 1 (1.85%) GraphX
6 1 (1.85%) scikit-learn
Miscellaneous
1 28 (51.85%) Greenfield Project
2 12 (22.22%) Analytical Skills
3 10 (18.52%) Algorithms
4 4 (7.41%) HoloLens
5 2 (3.70%) Fintech
6 1 (1.85%) Wiki
Operating Systems
1 3 (5.56%) Unix
2 1 (1.85%) Windows
Processes & Methodologies
1 32 (59.26%) DevOps
2 28 (51.85%) Microservices
3 19 (35.19%) Analytics
4 14 (25.93%) Deep Learning
5 13 (24.07%) Machine Learning
6 11 (20.37%) Data Analysis
6 11 (20.37%) Data Science
6 11 (20.37%) Statistical Modelling
7 10 (18.52%) Agile Software Development
8 8 (14.81%) ETL
8 8 (14.81%) Performance Optimisation
8 8 (14.81%) Predictive Analytics
8 8 (14.81%) Visualisation
9 7 (12.96%) Problem-Solving
10 5 (9.26%) Business Intelligence
10 5 (9.26%) Mathematics
11 4 (7.41%) Continuous Integration
11 4 (7.41%) Convolutional Neural Network
11 4 (7.41%) Open Source
12 3 (5.56%) Data Analytics
Programming Languages
1 50 (92.59%) Python
2 32 (59.26%) Java
3 13 (24.07%) SQL
4 8 (14.81%) MATLAB
4 8 (14.81%) Scala
5 6 (11.11%) R
6 3 (5.56%) Bash Shell
6 3 (5.56%) Perl
7 2 (3.70%) JavaScript
8 1 (1.85%) C#
8 1 (1.85%) Korn
8 1 (1.85%) PowerShell
8 1 (1.85%) Ruby
8 1 (1.85%) Shell Script
Qualifications
1 11 (20.37%) Degree
2 10 (18.52%) Master's Degree
3 2 (3.70%) PhD
4 1 (1.85%) Computer Science Degree
Quality Assurance & Compliance
1 2 (3.70%) QA
2 1 (1.85%) Data Quality
2 1 (1.85%) GDPR
System Software
1 28 (51.85%) Docker
2 3 (5.56%) HDFS
3 1 (1.85%) Apache Flume
Systems Management
1 31 (57.41%) Ansible
2 28 (51.85%) Kubernetes
2 28 (51.85%) Terraform
3 4 (7.41%) Hadoop YARN
4 1 (1.85%) Oozie
4 1 (1.85%) Opscode Chef
4 1 (1.85%) Puppet
Vendors
1 11 (20.37%) Hortonworks
2 10 (18.52%) Cloudera
3 7 (12.96%) Alteryx
4 5 (9.26%) Google
4 5 (9.26%) Oracle
4 5 (9.26%) Tableau
5 4 (7.41%) Databricks
6 3 (5.56%) Microsoft
7 2 (3.70%) Atlassian
7 2 (3.70%) IBM
8 1 (1.85%) Informatica
8 1 (1.85%) SAP
8 1 (1.85%) Talend