Period
to 21 April 2019

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 21 April 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Tower Hamlets > Canary Wharf
6 months to
21 Apr 2019
Same period 2018 Same period 2017
Rank 14 28 33
Rank change year-on-year +14 +5 -10
Contract jobs citing Hadoop 62 21 8
As % of all contract IT jobs advertised in Canary Wharf 16.94% 7.27% 3.07%
As % of the Database & Business Intelligence category 32.98% 18.92% 11.59%
Number of daily rates quoted 54 15 7
Canary Wharf median daily rate £563 £550 £575
Median daily rate % change year-on-year +2.27% -4.35% +21.05%
10th Percentile £513 £550 £463
90th Percentile £650 £600 £638
Tower Hamlets median daily rate £563 £550 £575
% change year-on-year +2.27% -4.35% +21.05%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Canary Wharf
Contract vacancies with a requirement for database or business intelligence skills 188 111 69
As % of all contract IT jobs advertised in Canary Wharf 51.37% 38.41% 26.44%
Number of daily rates quoted 165 83 55
Canary Wharf median daily rate £550 £550 £573
Median daily rate % change year-on-year - -3.93% +19.27%
10th Percentile £500 £413 £435
90th Percentile £650 £650 £650
Tower Hamlets median daily rate £525 £550 £575
% change year-on-year -4.55% -4.35% +19.79%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Hadoop
Job Vacancy Trend in Canary Wharf

Job postings citing Hadoop as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in Canary Wharf.

Contractor daily rate trend for Hadoop in Canary Wharf

Hadoop
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Hadoop in Canary Wharf over the 6 months to 21 April 2019.

Contractor daily rate histogram for Hadoop in Canary Wharf

For the 6 months to 21 April 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Hadoop.

1 54 (87.10%) Python
1 54 (87.10%) Amazon AWS
2 35 (56.45%) Big Data
3 33 (53.23%) Apache Hive
4 32 (51.61%) DevOps
5 31 (50.00%) Analytics
6 28 (45.16%) Machine Learning
6 28 (45.16%) Ansible
6 28 (45.16%) Java
7 27 (43.55%) Data Analysis
7 27 (43.55%) Analytical Skills
7 27 (43.55%) Statistical Modelling
7 27 (43.55%) Hortonworks
8 26 (41.94%) Microservices
8 26 (41.94%) Kubernetes
8 26 (41.94%) Docker
8 26 (41.94%) Terraform
8 26 (41.94%) Greenfield Project
8 26 (41.94%) Degree
8 26 (41.94%) RESTful
9 25 (40.32%) Predictive Analytics
9 25 (40.32%) PySpark
9 25 (40.32%) Master's Degree
9 25 (40.32%) Performance Optimisation
9 25 (40.32%) Deep Learning
9 25 (40.32%) Amazon EMR
9 25 (40.32%) Cloudera
10 8 (12.90%) Data Warehouse
11 7 (11.29%) Apache Spark
11 7 (11.29%) Google Cloud Platform

Hadoop
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (11.29%) Apache Spark
2 5 (8.06%) Apache
3 4 (6.45%) Apache Pig
4 3 (4.84%) Elasticsearch
5 2 (3.23%) Apache Solr
5 2 (3.23%) Confluence
Cloud Services
1 54 (87.10%) Amazon AWS
2 25 (40.32%) Amazon EMR
3 7 (11.29%) Google Cloud Platform
4 2 (3.23%) Amazon S3
5 1 (1.61%) Microsoft Azure
Communications & Networking
1 2 (3.23%) Kerberos
1 2 (3.23%) SSL
1 2 (3.23%) VPN
2 1 (1.61%) Firewall
Database & Business Intelligence
1 35 (56.45%) Big Data
2 33 (53.23%) Apache Hive
3 8 (12.90%) Data Warehouse
4 4 (6.45%) BigQuery
5 3 (4.84%) Data Lake
6 2 (3.23%) Amazon Redshift
6 2 (3.23%) Apache Cassandra
6 2 (3.23%) Data Mining
6 2 (3.23%) HBase
6 2 (3.23%) NoSQL
6 2 (3.23%) Parquet
6 2 (3.23%) Power BI
6 2 (3.23%) Relational Database
Development Applications
1 2 (3.23%) Bitbucket Server
1 2 (3.23%) FishEye
1 2 (3.23%) Git (software)
1 2 (3.23%) JIRA
General
1 6 (9.68%) Finance
2 5 (8.06%) Banking
3 2 (3.23%) Financial Institution
3 2 (3.23%) Games
3 2 (3.23%) Marketing
4 1 (1.61%) Social Science
Job Titles
1 26 (41.94%) AWS DevOps
1 26 (41.94%) AWS DevOps Engineer
1 26 (41.94%) AWS Engineer
1 26 (41.94%) DevOps Engineer
1 26 (41.94%) Hadoop Engineer
2 25 (40.32%) Big Data Engineer
2 25 (40.32%) Data Engineer
2 25 (40.32%) Python Engineer
3 4 (6.45%) Architect
3 4 (6.45%) Cloud Architect
3 4 (6.45%) Platform Architect
4 2 (3.23%) Big Data Developer
4 2 (3.23%) Developer
4 2 (3.23%) Financial Services Project Manager
4 2 (3.23%) Platform Manager
4 2 (3.23%) Project Manager
5 1 (1.61%) Analyst
5 1 (1.61%) Data Analyst
5 1 (1.61%) Data Scientist
Libraries, Frameworks & Software Standards
1 26 (41.94%) RESTful
2 25 (40.32%) PySpark
3 4 (6.45%) Apache Beam
4 3 (4.84%) Natural Language Processing
5 2 (3.23%) Apache NiFi
5 2 (3.23%) HTML
5 2 (3.23%) HTML5
5 2 (3.23%) Kafka
5 2 (3.23%) Play Framework
5 2 (3.23%) React
5 2 (3.23%) XML
Miscellaneous
1 27 (43.55%) Analytical Skills
2 26 (41.94%) Greenfield Project
3 3 (4.84%) Algorithms
4 2 (3.23%) Fintech
5 1 (1.61%) Credit Risk
Operating Systems
1 2 (3.23%) Unix
Processes & Methodologies
1 32 (51.61%) DevOps
2 31 (50.00%) Analytics
3 28 (45.16%) Machine Learning
4 27 (43.55%) Data Analysis
4 27 (43.55%) Statistical Modelling
5 26 (41.94%) Microservices
6 25 (40.32%) Deep Learning
6 25 (40.32%) Performance Optimisation
6 25 (40.32%) Predictive Analytics
7 6 (9.68%) Continuous Integration
7 6 (9.68%) Data Analytics
7 6 (9.68%) ETL
8 4 (6.45%) Business Intelligence
8 4 (6.45%) Problem-Solving
9 3 (4.84%) Data Science
9 3 (4.84%) Project Management
10 2 (3.23%) Disruptive Innovation
10 2 (3.23%) ETL Development
10 2 (3.23%) Exploratory Data Analysis
10 2 (3.23%) Mathematical Modelling
Programming Languages
1 54 (87.10%) Python
2 28 (45.16%) Java
3 3 (4.84%) R
3 3 (4.84%) SQL
4 2 (3.23%) Bash Shell
4 2 (3.23%) JavaScript
4 2 (3.23%) Perl
4 2 (3.23%) Scala
Qualifications
1 26 (41.94%) Degree
2 25 (40.32%) Master's Degree
3 1 (1.61%) CEH
3 1 (1.61%) CISA
3 1 (1.61%) CISM
3 1 (1.61%) CISSP
3 1 (1.61%) Computer Science Degree
3 1 (1.61%) GIAC
3 1 (1.61%) OSCP
3 1 (1.61%) Security Cleared
Quality Assurance & Compliance
1 1 (1.61%) Data Quality
1 1 (1.61%) QA
1 1 (1.61%) Sarbanes-Oxley
System Software
1 26 (41.94%) Docker
2 2 (3.23%) HDFS
Systems Management
1 28 (45.16%) Ansible
2 26 (41.94%) Kubernetes
2 26 (41.94%) Terraform
3 2 (3.23%) Hadoop YARN
Vendors
1 27 (43.55%) Hortonworks
2 25 (40.32%) Cloudera
3 6 (9.68%) Google
4 4 (6.45%) Tableau
5 2 (3.23%) Alteryx
5 2 (3.23%) Atlassian
5 2 (3.23%) IBM