Period
to 18 July 2018

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 18 July 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Tower Hamlets > Canary Wharf
6 months to
18 Jul 2018
Same period 2017 Same period 2016
Rank 12 22 30
Rank change year-on-year +10 +8 +8
Contract jobs citing Big Data 54 19 9
As % of all contract IT jobs advertised in Canary Wharf 15.47% 8.15% 3.44%
As % of the Database & Business Intelligence category 34.84% 30.16% 13.43%
Number of daily rates quoted 21 13 5
Canary Wharf median daily rate £550 £650 £650
Median daily rate % change year-on-year -15.38% - -
10th Percentile £400 £535 £383
90th Percentile £575 £650 £675
Tower Hamlets median daily rate £550 £650 £650
% change year-on-year -15.38% - +13.04%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Canary Wharf
Contract vacancies with a requirement for database or business intelligence skills 155 63 67
As % of all contract IT jobs advertised in Canary Wharf 44.41% 27.04% 25.57%
Number of daily rates quoted 91 49 54
Canary Wharf median daily rate £513 £600 £475
Median daily rate % change year-on-year -14.58% +26.32% -
10th Percentile £413 £460 £321
90th Percentile £600 £755 £669
Tower Hamlets median daily rate £513 £600 £475
% change year-on-year -14.58% +26.32% -8.21%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Big Data
Job Vacancy Trend in Canary Wharf

Job postings citing Big Data as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Big Data in Canary Wharf

Big Data
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in Canary Wharf.

Contractor daily rate trend for Big Data in Canary Wharf

Big Data
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Big Data in Canary Wharf over the 6 months to 18 July 2018.

Contractor daily rate histogram for Big Data in Canary Wharf

For the 6 months to 18 July 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Big Data.

1 41 (75.93%) Python
1 41 (75.93%) Finance
2 40 (74.07%) SQL
3 38 (70.37%) Hadoop
4 34 (62.96%) Apache Spark
5 32 (59.26%) Analytics
6 30 (55.56%) Data Science
6 30 (55.56%) SQL Server
7 28 (51.85%) Scala
7 28 (51.85%) NoSQL
7 28 (51.85%) Relational Database
8 27 (50.00%) Algorithms
9 26 (48.15%) Git (software)
10 24 (44.44%) Visualisation
11 23 (42.59%) Amazon AWS
12 22 (40.74%) Open Source
12 22 (40.74%) RDBMS
13 21 (38.89%) Technical Architecture
13 21 (38.89%) Visual Studio Team System
14 20 (37.04%) Deep Learning
14 20 (37.04%) OpenCV
14 20 (37.04%) Convolutional Neural Network
15 18 (33.33%) HoloLens
15 18 (33.33%) Unity (Game Engine)
16 17 (31.48%) Agile Software Development
17 16 (29.63%) Computer Vision
18 15 (27.78%) Business Intelligence
18 15 (27.78%) Apache Hive
19 14 (25.93%) Microsoft Azure
19 14 (25.93%) Scrum

Big Data
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 34 (62.96%) Apache Spark
2 9 (16.67%) Apache Solr
3 7 (12.96%) Elasticsearch
4 5 (9.26%) Confluence
5 3 (5.56%) Apache Pig
6 1 (1.85%) Apache
Applications
1 6 (11.11%) Microsoft Excel
1 6 (11.11%) MS Visio
2 2 (3.70%) Adobe Illustrator
2 2 (3.70%) InVision
Business Applications
1 9 (16.67%) SAP Oil and Gas
Cloud Services
1 23 (42.59%) Amazon AWS
2 14 (25.93%) Microsoft Azure
3 12 (22.22%) Amazon S3
4 7 (12.96%) Amazon EC2
5 6 (11.11%) Virtual Private Cloud
6 2 (3.70%) Azure Data Factory
7 1 (1.85%) Amazon EMR
7 1 (1.85%) Google Cloud Platform
Communications & Networking
1 5 (9.26%) Kerberos
1 5 (9.26%) SSL
1 5 (9.26%) VPN
Database & Business Intelligence
1 38 (70.37%) Hadoop
2 30 (55.56%) SQL Server
3 28 (51.85%) NoSQL
3 28 (51.85%) Relational Database
4 22 (40.74%) RDBMS
5 15 (27.78%) Apache Hive
6 14 (25.93%) Power BI
7 11 (20.37%) HBase
8 9 (16.67%) Data Lake
8 9 (16.67%) Impala
8 9 (16.67%) Lumira
8 9 (16.67%) SAP BW
8 9 (16.67%) SAP HANA
8 9 (16.67%) Spotfire
9 8 (14.81%) Data Warehouse
10 7 (12.96%) Apache Cassandra
11 6 (11.11%) Data Mining
11 6 (11.11%) MongoDB
11 6 (11.11%) Parquet
11 6 (11.11%) Sqoop
Development Applications
1 26 (48.15%) Git (software)
2 21 (38.89%) Visual Studio Team System
3 7 (12.96%) Jenkins
4 5 (9.26%) FishEye
4 5 (9.26%) JIRA
5 1 (1.85%) GitLab
5 1 (1.85%) Subversion
5 1 (1.85%) Visual Studio
General
1 41 (75.93%) Finance
2 6 (11.11%) Games
3 2 (3.70%) Financial Institution
4 1 (1.85%) Marketing
Job Titles
1 20 (37.04%) Data Engineer
2 18 (33.33%) Big Data Engineer
3 8 (14.81%) Developer
4 6 (11.11%) Big Data Developer
4 6 (11.11%) Hadoop Developer
4 6 (11.11%) Platform Engineer
5 5 (9.26%) Analytics Consultant
5 5 (9.26%) Consultant
6 4 (7.41%) Designer
7 3 (5.56%) Architect
7 3 (5.56%) Big Data Consultant
7 3 (5.56%) Business Intelligence Architect
7 3 (5.56%) Data Architect
7 3 (5.56%) Data Consultant
8 2 (3.70%) Azure Consultant
8 2 (3.70%) Hadoop Consultant
8 2 (3.70%) Hadoop Specialist
8 2 (3.70%) Report Specialist
8 2 (3.70%) SAP HANA Consultant
8 2 (3.70%) SAP HANA Specialist
Libraries, Frameworks & Software Standards
1 20 (37.04%) OpenCV
2 18 (33.33%) Unity (Game Engine)
3 9 (16.67%) Kafka
4 7 (12.96%) HTML
4 7 (12.96%) HTML5
5 6 (11.11%) Natural Language Processing
5 6 (11.11%) Play Framework
5 6 (11.11%) React
5 6 (11.11%) XML
6 4 (7.41%) TensorFlow
7 3 (5.56%) CSS
8 2 (3.70%) CSS3
8 2 (3.70%) D3.js
8 2 (3.70%) JSON
8 2 (3.70%) Lucene
8 2 (3.70%) Spark Streaming
9 1 (1.85%) SAP Fiori
9 1 (1.85%) SAPUI5
9 1 (1.85%) scikit-learn
9 1 (1.85%) Theano
Miscellaneous
1 27 (50.00%) Algorithms
2 18 (33.33%) HoloLens
3 8 (14.81%) Analytical Skills
4 6 (11.11%) Fintech
4 6 (11.11%) Wiki
5 2 (3.70%) Self-Motivation
6 1 (1.85%) Clustering
6 1 (1.85%) Computer Science
6 1 (1.85%) Management Information System
6 1 (1.85%) Replication
6 1 (1.85%) User Experience
Operating Systems
1 12 (22.22%) Unix
2 6 (11.11%) Windows
3 1 (1.85%) CentOS
3 1 (1.85%) Linux
3 1 (1.85%) Red Hat Enterprise Linux
Processes & Methodologies
1 32 (59.26%) Analytics
2 30 (55.56%) Data Science
3 24 (44.44%) Visualisation
4 22 (40.74%) Open Source
5 21 (38.89%) Technical Architecture
6 20 (37.04%) Convolutional Neural Network
6 20 (37.04%) Deep Learning
7 17 (31.48%) Agile Software Development
8 16 (29.63%) Computer Vision
9 15 (27.78%) Business Intelligence
10 14 (25.93%) ETL
10 14 (25.93%) Scrum
11 12 (22.22%) Continuous Integration
11 12 (22.22%) Data Analysis
12 11 (20.37%) Data Visualisation
13 9 (16.67%) Data Engineering
14 8 (14.81%) DevOps
14 8 (14.81%) Machine Learning
15 7 (12.96%) Mathematics
15 7 (12.96%) Test Automation
Programming Languages
1 41 (75.93%) Python
2 40 (74.07%) SQL
3 28 (51.85%) Scala
4 14 (25.93%) JavaScript
5 13 (24.07%) Bash Shell
6 9 (16.67%) Java
7 7 (12.96%) Korn
7 7 (12.96%) Perl
8 6 (11.11%) PowerShell
8 6 (11.11%) R
8 6 (11.11%) Shell Script
9 4 (7.41%) MATLAB
10 3 (5.56%) C#
11 1 (1.85%) C
11 1 (1.85%) Ruby
Qualifications
1 3 (5.56%) Degree
2 1 (1.85%) Master's Degree
Quality Assurance & Compliance
1 1 (1.85%) GCP
1 1 (1.85%) GDPR
System Software
1 14 (25.93%) HDFS
2 3 (5.56%) Docker
3 1 (1.85%) Apache Flume
3 1 (1.85%) Apache ZooKeeper
Systems Management
1 12 (22.22%) Hadoop YARN
2 11 (20.37%) Ansible
3 6 (11.11%) Opscode Chef
3 6 (11.11%) Puppet
4 2 (3.70%) Kubernetes
5 1 (1.85%) Oozie
Vendors
1 9 (16.67%) SAP
2 8 (14.81%) Tableau
3 7 (12.96%) Cloudera
3 7 (12.96%) Oracle
4 6 (11.11%) Databricks
4 6 (11.11%) Microsoft
5 5 (9.26%) Alteryx
5 5 (9.26%) Atlassian
5 5 (9.26%) Hortonworks
6 3 (5.56%) Salesforce.com
6 3 (5.56%) Talend
7 2 (3.70%) Adobe