Period
to 16 January 2019

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 16 January 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark
Tower Hamlets > Canary Wharf
6 months to
16 Jan 2019
Same period 2018 Same period 2017
Rank 63 29 31
Rank change year-on-year -34 +2 +2
Contract jobs citing Apache Spark 7 21 8
As % of all contract IT jobs advertised in Canary Wharf 1.81% 6.91% 2.68%
As % of the Application Platforms category 4.43% 24.14% 10.39%
Number of daily rates quoted 1 14 5
Canary Wharf median daily rate £400 £600 £575
Median daily rate % change year-on-year -33.33% +4.35% +27.78%
Tower Hamlets median daily rate £400 £600 £575
% change year-on-year -33.33% +4.35% +27.78%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for application platform skills.

All Application Platform Skills
Canary Wharf
Contract vacancies with a requirement for application platform skills 158 87 77
As % of all contract IT jobs advertised in Canary Wharf 40.83% 28.62% 25.75%
Number of daily rates quoted 144 70 56
Canary Wharf median daily rate £550 £508 £450
Median daily rate % change year-on-year +8.37% +12.78% -10.00%
10th Percentile £475 £297 £286
90th Percentile £650 £625 £608
Tower Hamlets median daily rate £550 £515 £450
% change year-on-year +6.80% +14.44% -10.00%
Number of hourly rates quoted 0 0 1
Canary Wharf median hourly rate - - £47.50
Tower Hamlets median hourly rate - - £47.50

Apache Spark
Job Vacancy Trend in Canary Wharf

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Apache Spark in Canary Wharf

Apache Spark
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Spark in Canary Wharf.

Contractor daily rate trend for Apache Spark in Canary Wharf

For the 6 months to 16 January 2019, IT contractor jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Apache Spark.

1 6 (85.71%) ETL
1 6 (85.71%) Hadoop
1 6 (85.71%) Big Data
2 5 (71.43%) Apache Hive
2 5 (71.43%) Continuous Integration
2 5 (71.43%) Data Warehouse
2 5 (71.43%) DevOps
3 4 (57.14%) Analytics
3 4 (57.14%) Python
3 4 (57.14%) Google
4 3 (42.86%) Mathematics
4 3 (42.86%) Bash Shell
4 3 (42.86%) R
4 3 (42.86%) Scala
4 3 (42.86%) Machine Learning
4 3 (42.86%) Data Analytics
4 3 (42.86%) Apache
4 3 (42.86%) SQL
4 3 (42.86%) Finance
4 3 (42.86%) Banking
4 3 (42.86%) Apache Pig
4 3 (42.86%) Analytical Skills
4 3 (42.86%) Relational Database
4 3 (42.86%) Algorithms
4 3 (42.86%) BigQuery
4 3 (42.86%) Google Cloud Platform
4 3 (42.86%) Data Science
4 3 (42.86%) Problem-Solving
4 3 (42.86%) Apache Beam
5 2 (28.57%) Apache NiFi

Apache Spark
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 3 (42.86%) Apache
1 3 (42.86%) Apache Pig
2 2 (28.57%) Apache Solr
2 2 (28.57%) Confluence
2 2 (28.57%) Elasticsearch
3 1 (14.29%) SAS
3 1 (14.29%) SharePoint
Cloud Services
1 3 (42.86%) Google Cloud Platform
2 2 (28.57%) Amazon AWS
2 2 (28.57%) Amazon S3
Communications & Networking
1 2 (28.57%) Kerberos
1 2 (28.57%) SSL
1 2 (28.57%) VPN
Database & Business Intelligence
1 6 (85.71%) Big Data
1 6 (85.71%) Hadoop
2 5 (71.43%) Apache Hive
2 5 (71.43%) Data Warehouse
3 3 (42.86%) BigQuery
3 3 (42.86%) Relational Database
4 2 (28.57%) Amazon Redshift
4 2 (28.57%) Apache Cassandra
4 2 (28.57%) Data Lake
4 2 (28.57%) Data Mining
4 2 (28.57%) HBase
4 2 (28.57%) NoSQL
4 2 (28.57%) Parquet
4 2 (28.57%) Power BI
5 1 (14.29%) DB2
5 1 (14.29%) RDBMS
5 1 (14.29%) SQL Server
Development Applications
1 2 (28.57%) FishEye
1 2 (28.57%) Git (software)
1 2 (28.57%) JIRA
General
1 3 (42.86%) Banking
1 3 (42.86%) Finance
2 2 (28.57%) Games
Job Titles
1 3 (42.86%) Architect
1 3 (42.86%) Cloud Architect
1 3 (42.86%) Developer
1 3 (42.86%) Platform Architect
2 2 (28.57%) Big Data Developer
3 1 (14.29%) Data Scientist
3 1 (14.29%) Graduate
3 1 (14.29%) Junior
3 1 (14.29%) Junior Data Scientist
3 1 (14.29%) Talend Developer
Libraries, Frameworks & Software Standards
1 3 (42.86%) Apache Beam
2 2 (28.57%) Apache NiFi
2 2 (28.57%) HTML
2 2 (28.57%) HTML5
2 2 (28.57%) Kafka
2 2 (28.57%) Natural Language Processing
2 2 (28.57%) Play Framework
2 2 (28.57%) React
2 2 (28.57%) XML
3 1 (14.29%) Caffe
3 1 (14.29%) Keras
3 1 (14.29%) TensorFlow
3 1 (14.29%) Theano
Miscellaneous
1 3 (42.86%) Algorithms
1 3 (42.86%) Analytical Skills
2 2 (28.57%) Fintech
Operating Systems
1 2 (28.57%) Unix
Processes & Methodologies
1 6 (85.71%) ETL
2 5 (71.43%) Continuous Integration
2 5 (71.43%) DevOps
3 4 (57.14%) Analytics
4 3 (42.86%) Data Analytics
4 3 (42.86%) Data Science
4 3 (42.86%) Machine Learning
4 3 (42.86%) Mathematics
4 3 (42.86%) Problem-Solving
5 2 (28.57%) Agile Software Development
5 2 (28.57%) Business Intelligence
5 2 (28.57%) Data Analysis
5 2 (28.57%) Data Visualisation
5 2 (28.57%) Disruptive Innovation
5 2 (28.57%) Exploratory Data Analysis
5 2 (28.57%) Mathematical Modelling
5 2 (28.57%) Performance Tuning
5 2 (28.57%) Statistical Modelling
5 2 (28.57%) Technical Architecture
5 2 (28.57%) Visualisation
Programming Languages
1 4 (57.14%) Python
2 3 (42.86%) Bash Shell
2 3 (42.86%) R
2 3 (42.86%) Scala
2 3 (42.86%) SQL
3 2 (28.57%) Java
3 2 (28.57%) JavaScript
3 2 (28.57%) Perl
4 1 (14.29%) Korn
4 1 (14.29%) MATLAB
Qualifications
1 1 (14.29%) Degree
1 1 (14.29%) Master's Degree
1 1 (14.29%) PhD
System Software
1 2 (28.57%) HDFS
Systems Management
1 2 (28.57%) Ansible
1 2 (28.57%) Hadoop YARN
Vendors
1 4 (57.14%) Google
2 2 (28.57%) Atlassian
2 2 (28.57%) Hortonworks
2 2 (28.57%) Oracle
2 2 (28.57%) Tableau
3 1 (14.29%) Microsoft
3 1 (14.29%) Talend