Period
to 16 January 2019

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 16 January 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Tower Hamlets > Canary Wharf
6 months to
16 Jan 2019
Same period 2018 Same period 2017
Rank 40 36 27
Rank change year-on-year -4 -9 -6
Contract jobs citing Big Data 30 14 12
As % of all contract IT jobs advertised in Canary Wharf 7.75% 4.61% 4.01%
As % of the Database & Business Intelligence category 16.76% 18.67% 16.22%
Number of daily rates quoted 21 8 8
Canary Wharf median daily rate £525 £600 £538
Median daily rate % change year-on-year -12.50% +11.63% +13.16%
10th Percentile £425 £543 £399
90th Percentile £825 £656 £588
Tower Hamlets median daily rate £525 £600 £563
% change year-on-year -12.50% +6.67% +12.50%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Canary Wharf
Contract vacancies with a requirement for database or business intelligence skills 179 75 74
As % of all contract IT jobs advertised in Canary Wharf 46.25% 24.67% 24.75%
Number of daily rates quoted 161 55 55
Canary Wharf median daily rate £575 £575 £500
Median daily rate % change year-on-year - +15.00% -
10th Percentile £463 £394 £340
90th Percentile £650 £650 £633
Tower Hamlets median daily rate £575 £575 £506
% change year-on-year - +13.58% +1.25%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Big Data
Job Vacancy Trend in Canary Wharf

Job postings citing Big Data as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Big Data in Canary Wharf

Big Data
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in Canary Wharf.

Contractor daily rate trend for Big Data in Canary Wharf

Big Data
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Big Data in Canary Wharf over the 6 months to 16 January 2019.

Contractor daily rate histogram for Big Data in Canary Wharf

For the 6 months to 16 January 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Big Data.

1 23 (76.67%) Hadoop
1 23 (76.67%) Analytics
2 22 (73.33%) Apache Hive
3 19 (63.33%) Python
3 19 (63.33%) Data Analysis
4 18 (60.00%) Amazon AWS
5 16 (53.33%) Machine Learning
5 16 (53.33%) Hortonworks
5 16 (53.33%) Analytical Skills
6 15 (50.00%) Statistical Modelling
6 15 (50.00%) Cloudera
7 14 (46.67%) PySpark
7 14 (46.67%) Deep Learning
7 14 (46.67%) Degree
8 13 (43.33%) Predictive Analytics
8 13 (43.33%) Amazon EMR
8 13 (43.33%) Master's Degree
8 13 (43.33%) Performance Optimisation
9 8 (26.67%) Continuous Integration
9 8 (26.67%) Agile Software Development
10 7 (23.33%) Data Warehouse
11 6 (20.00%) SQL
11 6 (20.00%) ETL
11 6 (20.00%) Apache Spark
12 5 (16.67%) HDFS
12 5 (16.67%) DevOps
12 5 (16.67%) Data Analytics
12 5 (16.67%) Java
12 5 (16.67%) Google
12 5 (16.67%) Google Cloud Platform

Big Data
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 6 (20.00%) Apache Spark
2 3 (10.00%) Apache
2 3 (10.00%) Apache Pig
2 3 (10.00%) Elasticsearch
3 2 (6.67%) Apache Solr
3 2 (6.67%) Confluence
Applications
1 3 (10.00%) Microsoft Excel
2 2 (6.67%) Spreadsheet
3 1 (3.33%) MS Visio
Business Applications
1 1 (3.33%) Distributed Ledger
Cloud Services
1 18 (60.00%) Amazon AWS
2 13 (43.33%) Amazon EMR
3 5 (16.67%) Google Cloud Platform
4 4 (13.33%) Microsoft Azure
5 3 (10.00%) Amazon S3
6 1 (3.33%) Amazon EC2
6 1 (3.33%) Virtual Private Cloud
Communications & Networking
1 2 (6.67%) Kerberos
1 2 (6.67%) SSL
1 2 (6.67%) VPN
Database & Business Intelligence
1 23 (76.67%) Hadoop
2 22 (73.33%) Apache Hive
3 7 (23.33%) Data Warehouse
4 4 (13.33%) SQL Server
5 3 (10.00%) BigQuery
5 3 (10.00%) Relational Database
5 3 (10.00%) Sqoop
6 2 (6.67%) Amazon Aurora
6 2 (6.67%) Amazon RDS
6 2 (6.67%) Amazon Redshift
6 2 (6.67%) Apache Cassandra
6 2 (6.67%) Data Lake
6 2 (6.67%) Data Mining
6 2 (6.67%) HBase
6 2 (6.67%) NoSQL
6 2 (6.67%) Parquet
6 2 (6.67%) Power BI
7 1 (3.33%) DB2
7 1 (3.33%) RDBMS
7 1 (3.33%) Text Mining
Development Applications
1 2 (6.67%) FishEye
1 2 (6.67%) Git (software)
1 2 (6.67%) JIRA
2 1 (3.33%) Jenkins
General
1 4 (13.33%) Finance
2 3 (10.00%) Banking
3 2 (6.67%) Back Office
3 2 (6.67%) Games
3 2 (6.67%) Marketing
Job Titles
1 15 (50.00%) Big Data Engineer
2 14 (46.67%) Data Engineer
2 14 (46.67%) Python Engineer
3 6 (20.00%) Architect
4 5 (16.67%) Developer
5 3 (10.00%) Big Data Architect
5 3 (10.00%) Cloud Architect
5 3 (10.00%) Data Architect
5 3 (10.00%) Digital Analytics Architect
5 3 (10.00%) Digital Architect
5 3 (10.00%) Platform Architect
5 3 (10.00%) Security Architect
5 3 (10.00%) Strategy Architect
6 2 (6.67%) Big Data Developer
6 2 (6.67%) Excel Developer
6 2 (6.67%) Financial Services Project Manager
6 2 (6.67%) Platform Manager
6 2 (6.67%) Project Manager
7 1 (3.33%) Analyst
7 1 (3.33%) Data Analyst
Libraries, Frameworks & Software Standards
1 14 (46.67%) PySpark
2 4 (13.33%) Apache NiFi
3 3 (10.00%) Apache Beam
3 3 (10.00%) Natural Language Processing
4 2 (6.67%) HTML
4 2 (6.67%) HTML5
4 2 (6.67%) Kafka
4 2 (6.67%) Play Framework
4 2 (6.67%) React
4 2 (6.67%) REST
4 2 (6.67%) XML
5 1 (3.33%) .NET
5 1 (3.33%) JSON
5 1 (3.33%) JSON-LD
Miscellaneous
1 16 (53.33%) Analytical Skills
2 3 (10.00%) Fintech
2 3 (10.00%) Wiki
3 2 (6.67%) Algorithms
3 2 (6.67%) User Experience
Operating Systems
1 3 (10.00%) Unix
2 1 (3.33%) Windows
Processes & Methodologies
1 23 (76.67%) Analytics
2 19 (63.33%) Data Analysis
3 16 (53.33%) Machine Learning
4 15 (50.00%) Statistical Modelling
5 14 (46.67%) Deep Learning
6 13 (43.33%) Performance Optimisation
6 13 (43.33%) Predictive Analytics
7 8 (26.67%) Agile Software Development
7 8 (26.67%) Continuous Integration
8 6 (20.00%) ETL
9 5 (16.67%) Data Analytics
9 5 (16.67%) DevOps
10 4 (13.33%) Business Intelligence
10 4 (13.33%) Problem-Solving
10 4 (13.33%) Test Automation
11 3 (10.00%) Data Extraction
11 3 (10.00%) Data Science
11 3 (10.00%) Deployment Automation
11 3 (10.00%) Scrum
11 3 (10.00%) Security Architecture
Programming Languages
1 19 (63.33%) Python
2 6 (20.00%) SQL
3 5 (16.67%) Java
4 4 (13.33%) Bash Shell
4 4 (13.33%) JavaScript
5 3 (10.00%) R
6 2 (6.67%) Korn
6 2 (6.67%) Perl
6 2 (6.67%) Scala
6 2 (6.67%) VBA
7 1 (3.33%) C#
7 1 (3.33%) PowerShell
7 1 (3.33%) Shell Script
7 1 (3.33%) SPARQL
Qualifications
1 14 (46.67%) Degree
2 13 (43.33%) Master's Degree
3 2 (6.67%) SC Cleared
3 2 (6.67%) Security Cleared
4 1 (3.33%) PhD
Quality Assurance & Compliance
1 2 (6.67%) QA
2 1 (3.33%) Data Quality
System Software
1 5 (16.67%) HDFS
Systems Management
1 4 (13.33%) Hadoop YARN
2 3 (10.00%) Ansible
3 1 (3.33%) Oozie
3 1 (3.33%) Opscode Chef
3 1 (3.33%) Puppet
Vendors
1 16 (53.33%) Hortonworks
2 15 (50.00%) Cloudera
3 5 (16.67%) Google
4 4 (13.33%) Tableau
5 2 (6.67%) Alteryx
5 2 (6.67%) Atlassian
5 2 (6.67%) IBM
5 2 (6.67%) MuleSoft
5 2 (6.67%) Oracle
6 1 (3.33%) Talend