Period
to 28 February 2020

The following table provides summary statistics for contract job vacancies advertised in Glasgow with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 28 February 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark
Scotland > Glasgow
6 months to
28 Feb 2020
Same period 2019 Same period 2018
Rank 63 109 83
Rank change year-on-year +46 -26 -7
Contract jobs citing Apache Spark 29 8 7
As % of all contract IT jobs advertised in Glasgow 2.36% 0.54% 0.58%
As % of the Application Platforms category 13.36% 3.83% 3.43%
Number of daily rates quoted 22 3 4
Glasgow median daily rate £575 £325 £450
Median daily rate % change year-on-year +76.92% -27.78% -
10th Percentile £513 £313 £350
90th Percentile £588 £368 £578
Scotland median daily rate £575 £500 £475
% change year-on-year +15.00% +5.26% +5.56%
Number of hourly rates quoted 0 0 0
Glasgow median hourly rate - - -
Scotland median hourly rate - - -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Glasgow with a requirement for application platform skills.

All Application Platform Skills
Glasgow
Contract vacancies with a requirement for application platform skills 217 209 204
As % of all contract IT jobs advertised in Glasgow 17.66% 14.02% 16.97%
Number of daily rates quoted 128 119 115
Glasgow median daily rate £450 £375 £363
Median daily rate % change year-on-year +20.00% +3.45% +2.11%
10th Percentile £256 £188 £208
90th Percentile £588 £543 £465
Scotland median daily rate £425 £400 £375
% change year-on-year +6.25% +6.67% +10.29%
Number of hourly rates quoted 6 8 4
Glasgow median hourly rate £23.00 £15.00 £17.93
Median hourly rate % change year-on-year +53.33% -16.34% -14.62%
10th Percentile £12.50 £12.25 £13.44
90th Percentile £80.88 £16.80 £20.85
Scotland median hourly rate £23.50 £15.00 £20.00
% change year-on-year +56.67% -25.00% +17.65%

Apache Spark
Job Vacancy Trend in Glasgow

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Glasgow.

Job vacancy trend for Apache Spark in Glasgow

Apache Spark
Contractor Daily Rate Trend in Glasgow

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Spark in Glasgow.

Contractor daily rate trend for Apache Spark in Glasgow

For the 6 months to 28 February 2020, IT contractor jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Glasgow region with a requirement for Apache Spark.

1 29 (100.00%) Hadoop
1 29 (100.00%) Kafka
2 27 (93.10%) Scala
3 26 (89.66%) Big Data
4 22 (75.86%) Spark SQL
4 22 (75.86%) Data Development
5 21 (72.41%) HBase
5 21 (72.41%) HDFS
5 21 (72.41%) Impala
6 20 (68.97%) Apache Hive
7 15 (51.72%) Banking
8 13 (44.83%) Investment Banking
9 7 (24.14%) Analytical Skills
9 7 (24.14%) Problem-Solving
10 6 (20.69%) Software Engineering
10 6 (20.69%) Finance
11 5 (17.24%) Data Management
11 5 (17.24%) ETL
11 5 (17.24%) Business Intelligence
11 5 (17.24%) Agile Software Development
12 4 (13.79%) Data Architecture
12 4 (13.79%) Data Quality
12 4 (13.79%) Metadata Management
12 4 (13.79%) Analytical Thinking
13 3 (10.34%) Spark Streaming
13 3 (10.34%) Performance Tuning
13 3 (10.34%) Hortonworks
13 3 (10.34%) Cloudera
13 3 (10.34%) Bash Shell
13 3 (10.34%) Shell Script

Apache Spark
Co-occurring IT Skills in Glasgow by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Database & Business Intelligence
1 29 (100.00%) Hadoop
2 26 (89.66%) Big Data
3 22 (75.86%) Spark SQL
4 21 (72.41%) HBase
4 21 (72.41%) Impala
5 20 (68.97%) Apache Hive
General
1 15 (51.72%) Banking
2 13 (44.83%) Investment Banking
3 6 (20.69%) Finance
Job Titles
1 29 (100.00%) Developer
2 24 (82.76%) Scala Developer
3 16 (55.17%) Apache Spark Developer
4 7 (24.14%) Hadoop Developer
5 4 (13.79%) Big Data Developer
6 2 (6.90%) Python Developer
6 2 (6.90%) Senior Developer
6 2 (6.90%) Senior Scala Developer
Libraries, Frameworks & Software Standards
1 29 (100.00%) Kafka
2 3 (10.34%) Spark Streaming
Miscellaneous
1 7 (24.14%) Analytical Skills
Operating Systems
1 3 (10.34%) Unix
Processes & Methodologies
1 22 (75.86%) Data Development
2 7 (24.14%) Problem-Solving
3 6 (20.69%) Software Engineering
4 5 (17.24%) Agile Software Development
4 5 (17.24%) Business Intelligence
4 5 (17.24%) Data Management
4 5 (17.24%) ETL
5 4 (13.79%) Analytical Thinking
5 4 (13.79%) Data Architecture
5 4 (13.79%) Metadata Management
6 3 (10.34%) Performance Tuning
7 2 (6.90%) Scrum
7 2 (6.90%) Test Automation
8 1 (3.45%) Continuous Integration
8 1 (3.45%) Unit Testing
Programming Languages
1 27 (93.10%) Scala
2 3 (10.34%) Bash Shell
2 3 (10.34%) Java
2 3 (10.34%) Shell Script
3 2 (6.90%) Python
4 1 (3.45%) SQL
Quality Assurance & Compliance
1 4 (13.79%) Data Quality
2 1 (3.45%) QA
System Software
1 21 (72.41%) HDFS
Vendors
1 3 (10.34%) Cloudera
1 3 (10.34%) Hortonworks