Period
to 20 July 2019

The following table provides summary statistics for contract job vacancies advertised in Canary Wharf with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 20 July 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark
Tower Hamlets > Canary Wharf
6 months to
20 Jul 2019
Same period 2018 Same period 2017
Rank 37 19 31
Rank change year-on-year -18 +12 -3
Contract jobs citing Apache Spark 9 43 10
As % of all contract IT jobs advertised in Canary Wharf 4.07% 12.15% 4.27%
As % of the Application Platforms category 20.93% 45.74% 15.38%
Number of daily rates quoted 7 16 6
Canary Wharf median daily rate £575 £550 £488
Median daily rate % change year-on-year +4.55% +12.82% -25.00%
10th Percentile £543 £400 £450
90th Percentile £655 £559 £566
Tower Hamlets median daily rate £575 £550 £516
% change year-on-year +4.55% +6.54% -20.58%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Canary Wharf with a requirement for application platform skills.

All Application Platform Skills
Canary Wharf
Contract vacancies with a requirement for application platform skills 43 94 65
As % of all contract IT jobs advertised in Canary Wharf 19.46% 26.55% 27.78%
Number of daily rates quoted 36 48 40
Canary Wharf median daily rate £525 £525 £488
Median daily rate % change year-on-year - +7.69% +8.33%
10th Percentile £390 £400 £311
90th Percentile £600 £636 £679
Tower Hamlets median daily rate £525 £525 £500
% change year-on-year - +5.00% +11.11%
Number of hourly rates quoted 0 0 0
Canary Wharf median hourly rate - - -
Tower Hamlets median hourly rate - - -

Apache Spark
Job Vacancy Trend in Canary Wharf

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Canary Wharf.

Job vacancy trend for Apache Spark in Canary Wharf

Apache Spark
Contractor Daily Rate Trend in Canary Wharf

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Spark in Canary Wharf.

Contractor daily rate trend for Apache Spark in Canary Wharf

Apache Spark
Contractor Daily Rate Histogram in Canary Wharf

The daily rate distribution of IT jobs citing Apache Spark in Canary Wharf over the 6 months to 20 July 2019.

Contractor daily rate histogram for Apache Spark in Canary Wharf

For the 6 months to 20 July 2019, IT contractor jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Canary Wharf region with a requirement for Apache Spark.

1 7 (77.78%) DevOps
2 6 (66.67%) Amazon AWS
3 5 (55.56%) Linux
3 5 (55.56%) Python
3 5 (55.56%) Hadoop
4 4 (44.44%) Agile Software Development
4 4 (44.44%) Apache
4 4 (44.44%) Big Data
5 3 (33.33%) CloudFront
5 3 (33.33%) Kafka
5 3 (33.33%) Git (software)
5 3 (33.33%) AWS Certification
5 3 (33.33%) Google Cloud Platform
5 3 (33.33%) Amazon Kinesis
5 3 (33.33%) AWS Lambda
5 3 (33.33%) Serverless
5 3 (33.33%) Windows
5 3 (33.33%) OOP
5 3 (33.33%) OO
5 3 (33.33%) SAP
5 3 (33.33%) IBM
5 3 (33.33%) Informatica
5 3 (33.33%) Finance
5 3 (33.33%) Scrum
5 3 (33.33%) IBM Sterling
5 3 (33.33%) Amazon S3
5 3 (33.33%) Computer Science
6 2 (22.22%) Banking
6 2 (22.22%) Continuous Integration
6 2 (22.22%) Google

Apache Spark
Co-occurring IT Skills in Canary Wharf by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 4 (44.44%) Apache
2 2 (22.22%) Apache Pig
3 1 (11.11%) Elasticsearch
Cloud Services
1 6 (66.67%) Amazon AWS
2 3 (33.33%) Amazon Kinesis
2 3 (33.33%) Amazon S3
2 3 (33.33%) AWS Lambda
2 3 (33.33%) CloudFront
2 3 (33.33%) Google Cloud Platform
2 3 (33.33%) Serverless
3 1 (11.11%) Microsoft Azure
Database & Business Intelligence
1 5 (55.56%) Hadoop
2 4 (44.44%) Big Data
3 2 (22.22%) Apache Hive
3 2 (22.22%) BigQuery
3 2 (22.22%) Data Warehouse
4 1 (11.11%) Relational Database
4 1 (11.11%) SQL Server
Development Applications
1 3 (33.33%) Git (software)
General
1 3 (33.33%) Finance
2 2 (22.22%) Banking
3 1 (11.11%) Financial Institution
3 1 (11.11%) Social Science
Job Titles
1 5 (55.56%) AWS Engineer
2 3 (33.33%) AWS DevOps
2 3 (33.33%) AWS DevOps Engineer
2 3 (33.33%) DevOps Engineer
2 3 (33.33%) Platform Engineer
3 2 (22.22%) Architect
3 2 (22.22%) Cloud Architect
3 2 (22.22%) Cloud Engineer
3 2 (22.22%) Lambda Engineer
3 2 (22.22%) Platform Architect
4 1 (11.11%) Data Scientist
4 1 (11.11%) Developer
4 1 (11.11%) Python Developer
Libraries, Frameworks & Software Standards
1 3 (33.33%) Kafka
2 2 (22.22%) Apache Beam
3 1 (11.11%) AngularJS
3 1 (11.11%) FIX Protocol
3 1 (11.11%) Natural Language Processing
3 1 (11.11%) React
Miscellaneous
1 1 (11.11%) Algorithms
1 1 (11.11%) Credit Risk
Operating Systems
1 5 (55.56%) Linux
2 3 (33.33%) Windows
3 2 (22.22%) Unix
Processes & Methodologies
1 7 (77.78%) DevOps
2 4 (44.44%) Agile Software Development
3 3 (33.33%) Computer Science
3 3 (33.33%) OO
3 3 (33.33%) OOP
3 3 (33.33%) Scrum
4 2 (22.22%) Analytics
4 2 (22.22%) Continuous Integration
4 2 (22.22%) Data Analytics
4 2 (22.22%) Data Development
4 2 (22.22%) ETL
5 1 (11.11%) Coaching
5 1 (11.11%) Data Engineering
5 1 (11.11%) Data Science
5 1 (11.11%) Operations Research
5 1 (11.11%) Physics
5 1 (11.11%) Project Management
5 1 (11.11%) Regression Testing
5 1 (11.11%) Statistics
5 1 (11.11%) TDD
Programming Languages
1 5 (55.56%) Python
2 2 (22.22%) Java
3 1 (11.11%) R
3 1 (11.11%) SQL
Qualifications
1 3 (33.33%) AWS Certification
2 1 (11.11%) Security Cleared
Quality Assurance & Compliance
1 1 (11.11%) EMIR
1 1 (11.11%) MiFID
Vendors
1 3 (33.33%) IBM
1 3 (33.33%) IBM Sterling
1 3 (33.33%) Informatica
1 3 (33.33%) SAP
2 2 (22.22%) Google
3 1 (11.11%) Tableau