Period
to 15 November 2018

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 15 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark
Tower Hamlets > Canary Wharf
6 months to
15 Nov 2018
Same period 2017 Same period 2016
Rank 40 28 35
Rank change year-on-year -12 +7 -1
Contract jobs citing Apache Spark 22 19 7
As % of all contract IT jobs advertised in Canary Wharf 6.63% 6.76% 2.19%
As % of the Application Platforms category 17.46% 19.39% 7.45%
Number of daily rates quoted 4 11 4
Canary Wharf median daily rate £400 £600 £538
Median daily rate % change year-on-year -33.33% +11.63% +19.44%
Tower Hamlets median daily rate £400 £575 £550
% change year-on-year -30.43% +4.55% +22.22%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for application platform skills.

All Application Platform Skills
Canary Wharf
Contract vacancies with a requirement for application platform skills 126 98 94
As % of all contract IT jobs advertised in Canary Wharf 37.95% 34.88% 29.47%
Number of daily rates quoted 96 68 70
Canary Wharf median daily rate £550 £508 £450
Median daily rate % change year-on-year +8.37% +12.78% -10.00%
10th Percentile £403 £335 £296
90th Percentile £600 £625 £607
Tower Hamlets median daily rate £550 £515 £450
% change year-on-year +6.80% +14.44% -10.00%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Apache Spark
Job Vacancy Trend in Canary Wharf

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Apache Spark in Canary Wharf

Apache Spark
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Spark in Canary Wharf.

Contractor daily rate trend for Apache Spark in Canary Wharf

Apache Spark
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Apache Spark in Canary Wharf over the 6 months to 15 November 2018.

Contractor daily rate histogram for Apache Spark in Canary Wharf

For the 6 months to 15 November 2018, IT contractor jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Apache Spark.

1 22 (100.00%) Python
2 20 (90.91%) Finance
2 20 (90.91%) Data Science
3 19 (86.36%) Algorithms
4 18 (81.82%) Big Data
4 18 (81.82%) Hadoop
5 17 (77.27%) Scala
5 17 (77.27%) SQL
5 17 (77.27%) Analytics
5 17 (77.27%) Relational Database
6 15 (68.18%) Deep Learning
6 15 (68.18%) NoSQL
6 15 (68.18%) RDBMS
6 15 (68.18%) Git (software)
7 14 (63.64%) SQL Server
8 13 (59.09%) Visual Studio Team System
8 13 (59.09%) Open Source
8 13 (59.09%) OpenCV
8 13 (59.09%) Convolutional Neural Network
9 11 (50.00%) Unity (Game Engine)
9 11 (50.00%) Technical Architecture
9 11 (50.00%) HoloLens
10 10 (45.45%) Data Engineering
11 9 (40.91%) Computer Vision
11 9 (40.91%) Agile Software Development
12 8 (36.36%) MATLAB
12 8 (36.36%) Visualisation
12 8 (36.36%) Amazon AWS
13 7 (31.82%) Microsoft Azure
13 7 (31.82%) Power BI

Apache Spark
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 4 (18.18%) Apache Solr
1 4 (18.18%) Elasticsearch
1 4 (18.18%) SAS
2 3 (13.64%) SharePoint
3 2 (9.09%) Confluence
Applications
1 1 (4.55%) Chatbot
Business Applications
1 1 (4.55%) SAP Oil and Gas
Cloud Services
1 8 (36.36%) Amazon AWS
2 7 (31.82%) Microsoft Azure
3 2 (9.09%) Amazon S3
4 1 (4.55%) Google Cloud Platform
Communications & Networking
1 2 (9.09%) Kerberos
1 2 (9.09%) SSL
1 2 (9.09%) VPN
Database & Business Intelligence
1 18 (81.82%) Big Data
1 18 (81.82%) Hadoop
2 17 (77.27%) Relational Database
3 15 (68.18%) NoSQL
3 15 (68.18%) RDBMS
4 14 (63.64%) SQL Server
5 7 (31.82%) Power BI
6 5 (22.73%) Spotfire
7 3 (13.64%) Data Lake
7 3 (13.64%) Data Mining
7 3 (13.64%) Data Warehouse
7 3 (13.64%) HBase
8 2 (9.09%) Amazon Redshift
8 2 (9.09%) Apache Cassandra
8 2 (9.09%) Apache Hive
8 2 (9.09%) DB2
8 2 (9.09%) Parquet
9 1 (4.55%) SAP BW
9 1 (4.55%) SQL Server Integration Services
9 1 (4.55%) Text Mining
Development Applications
1 15 (68.18%) Git (software)
2 13 (59.09%) Visual Studio Team System
3 2 (9.09%) FishEye
3 2 (9.09%) JIRA
General
1 20 (90.91%) Finance
2 2 (9.09%) Games
3 1 (4.55%) Retail
Job Titles
1 11 (50.00%) Data Engineer
2 10 (45.45%) Big Data Engineer
3 4 (18.18%) Data Scientist
3 4 (18.18%) Developer
4 3 (13.64%) Analytics Consultant
4 3 (13.64%) Big Data Consultant
4 3 (13.64%) Consultant
4 3 (13.64%) Data Consultant
5 2 (9.09%) Big Data Developer
5 2 (9.09%) Hadoop Developer
5 2 (9.09%) Talend Developer
6 1 (4.55%) Graduate
6 1 (4.55%) Junior
6 1 (4.55%) Junior Data Scientist
6 1 (4.55%) MATLAB Engineer
6 1 (4.55%) Python Engineer
6 1 (4.55%) SAP Engineer
Libraries, Frameworks & Software Standards
1 13 (59.09%) OpenCV
2 11 (50.00%) Unity (Game Engine)
3 5 (22.73%) Kafka
3 5 (22.73%) TensorFlow
4 3 (13.64%) Keras
4 3 (13.64%) Natural Language Processing
5 2 (9.09%) Caffe
5 2 (9.09%) HTML
5 2 (9.09%) HTML5
5 2 (9.09%) Play Framework
5 2 (9.09%) React
5 2 (9.09%) Spark Streaming
5 2 (9.09%) Theano
5 2 (9.09%) XML
6 1 (4.55%) GraphX
6 1 (4.55%) RESTful
6 1 (4.55%) scikit-learn
Miscellaneous
1 19 (86.36%) Algorithms
2 11 (50.00%) HoloLens
3 5 (22.73%) Analytical Skills
4 3 (13.64%) Computer Science
5 2 (9.09%) Fintech
5 2 (9.09%) Self-Motivation
Operating Systems
1 2 (9.09%) Unix
Processes & Methodologies
1 20 (90.91%) Data Science
2 17 (77.27%) Analytics
3 15 (68.18%) Deep Learning
4 13 (59.09%) Convolutional Neural Network
4 13 (59.09%) Open Source
5 11 (50.00%) Technical Architecture
6 10 (45.45%) Data Engineering
7 9 (40.91%) Agile Software Development
7 9 (40.91%) Computer Vision
8 8 (36.36%) Visualisation
9 6 (27.27%) ETL
10 5 (22.73%) DevOps
10 5 (22.73%) Machine Learning
10 5 (22.73%) Mathematics
11 4 (18.18%) Problem-Solving
12 3 (13.64%) Business Intelligence
12 3 (13.64%) Data Visualisation
12 3 (13.64%) Statistical Modelling
12 3 (13.64%) Statistics
13 2 (9.09%) Operations Research
Programming Languages
1 22 (100.00%) Python
2 17 (77.27%) Scala
2 17 (77.27%) SQL
3 8 (36.36%) MATLAB
4 6 (27.27%) R
5 4 (18.18%) Bash Shell
5 4 (18.18%) Java
6 2 (9.09%) C#
6 2 (9.09%) JavaScript
6 2 (9.09%) Korn
6 2 (9.09%) Perl
Qualifications
1 3 (13.64%) Degree
2 2 (9.09%) Master's Degree
2 2 (9.09%) PhD
3 1 (4.55%) Computer Science Degree
Quality Assurance & Compliance
1 1 (4.55%) GDPR
System Software
1 4 (18.18%) HDFS
2 2 (9.09%) Docker
3 1 (4.55%) Apache Flume
Systems Management
1 2 (9.09%) Ansible
1 2 (9.09%) Hadoop YARN
1 2 (9.09%) Kubernetes
Vendors
1 6 (27.27%) Databricks
1 6 (27.27%) Oracle
2 5 (22.73%) Alteryx
3 3 (13.64%) Microsoft
3 3 (13.64%) Tableau
3 3 (13.64%) Talend
4 2 (9.09%) Atlassian
4 2 (9.09%) Google
4 2 (9.09%) Hortonworks
5 1 (4.55%) Informatica
5 1 (4.55%) SAP