Period
to 22 October 2018

The following table provides summary statistics for contract job vacancies advertised in Glasgow with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 22 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark
Scotland > Glasgow
6 months to
22 Oct 2018
Same period 2017 Same period 2016
Rank 92 81 88
Rank change year-on-year -11 +7 +12
Contract jobs citing Apache Spark 21 17 6
As % of all contract IT jobs advertised in Glasgow 1.25% 1.28% 0.50%
As % of the Application Platforms category 8.68% 7.46% 2.79%
Number of daily rates quoted 7 10 4
Glasgow median daily rate £500 £525 £450
Median daily rate % change year-on-year -4.76% +16.67% -14.29%
10th Percentile £405 £350 £425
90th Percentile £573 £610 £475
Scotland median daily rate £425 £400 £450
% change year-on-year +6.25% -11.11% -14.29%
Number of hourly rates quoted 0 0 0
Glasgow median hourly rate - - -
Scotland median hourly rate - - -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Glasgow with a requirement for application platform skills.

All Application Platform Skills
Glasgow
Contract vacancies with a requirement for application platform skills 242 228 215
As % of all contract IT jobs advertised in Glasgow 14.43% 17.10% 17.96%
Number of daily rates quoted 115 118 115
Glasgow median daily rate £376 £388 £350
Median daily rate % change year-on-year -3.10% +10.71% +16.67%
10th Percentile £218 £242 £220
90th Percentile £525 £550 £475
Scotland median daily rate £393 £388 £350
% change year-on-year +1.29% +10.71% -
Number of hourly rates quoted 4 3 2
Glasgow median hourly rate £23.95 £20.00 £21.00
Median hourly rate % change year-on-year +19.75% -4.76% -6.67%
10th Percentile £13.72 £15.93 £19.50
90th Percentile £34.63 £24.10 £22.50
Scotland median hourly rate £17.50 £19.00 £21.25
% change year-on-year -7.89% -10.59% -15.00%

Apache Spark
Job Vacancy Trend in Glasgow

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Glasgow.

Job vacancy trend for Apache Spark in Glasgow

Apache Spark
Contractor Daily Rate Trend in Glasgow

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Spark in Glasgow.

Contractor daily rate trend for Apache Spark in Glasgow

Apache Spark
Contractor Daily Rate Histogram in Glasgow

The daily rate distribution of IT jobs citing Apache Spark in Glasgow over the 6 months to 22 October 2018.

Contractor daily rate histogram for Apache Spark in Glasgow

For the 6 months to 22 October 2018, IT contractor jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Glasgow region with a requirement for Apache Spark.

1 16 (76.19%) Java
2 15 (71.43%) Hadoop
3 14 (66.67%) Scala
4 13 (61.90%) Kafka
4 13 (61.90%) Impala
5 12 (57.14%) Analytics
6 11 (52.38%) Enterprise Software
6 11 (52.38%) Akka
6 11 (52.38%) Software Engineering
6 11 (52.38%) Java 8
7 10 (47.62%) Computer Science Degree
7 10 (47.62%) Degree
7 10 (47.62%) Computer Science
7 10 (47.62%) Games
7 10 (47.62%) MapReduce
8 9 (42.86%) Big Data
9 5 (23.81%) Agile Software Development
10 4 (19.05%) Spring
10 4 (19.05%) Data Modelling
11 3 (14.29%) SQL
11 3 (14.29%) Python
11 3 (14.29%) JIRA
11 3 (14.29%) Git (software)
11 3 (14.29%) Multithreading
11 3 (14.29%) Apache Cassandra
11 3 (14.29%) NoSQL
11 3 (14.29%) HDFS
11 3 (14.29%) Machine Learning
12 2 (9.52%) DataStax
12 2 (9.52%) Spark Streaming

Apache Spark
Co-occurring IT Skills in Glasgow by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1 (4.76%) Apache
1 1 (4.76%) Apache Airflow
Cloud Services
1 2 (9.52%) Microsoft Azure
2 1 (4.76%) Amazon AWS
2 1 (4.76%) Cloud Computing
2 1 (4.76%) IaaS
2 1 (4.76%) PaaS
Communications & Networking
1 1 (4.76%) Firewall
1 1 (4.76%) HTTP
1 1 (4.76%) HTTPS
1 1 (4.76%) Kerberos
1 1 (4.76%) SSL
1 1 (4.76%) VPN
Database & Business Intelligence
1 15 (71.43%) Hadoop
2 13 (61.90%) Impala
3 9 (42.86%) Big Data
4 3 (14.29%) Apache Cassandra
4 3 (14.29%) NoSQL
5 2 (9.52%) Apache Hive
5 2 (9.52%) Data Warehouse
5 2 (9.52%) DataStax
5 2 (9.52%) HBase
5 2 (9.52%) MongoDB
5 2 (9.52%) Relational Database
6 1 (4.76%) Apache Zeppelin
6 1 (4.76%) Azkaban
6 1 (4.76%) Data Lake
6 1 (4.76%) HDInsight
6 1 (4.76%) Power BI
6 1 (4.76%) QlikView
6 1 (4.76%) SQL Server Integration Services
6 1 (4.76%) SQL Server Reporting Services
6 1 (4.76%) Sqoop
Development Applications
1 3 (14.29%) Git (software)
1 3 (14.29%) JIRA
2 2 (9.52%) Bitbucket
2 2 (9.52%) git-flow
General
1 10 (47.62%) Games
2 1 (4.76%) Banking
2 1 (4.76%) Finance
2 1 (4.76%) Investment Banking
2 1 (4.76%) Legal
Job Titles
1 9 (42.86%) Scala Software Engineer
1 9 (42.86%) Software Engineer
2 7 (33.33%) Developer
3 5 (23.81%) Big Data Developer
4 3 (14.29%) Scala Developer
5 2 (9.52%) Data Modeller
5 2 (9.52%) Java Developer
5 2 (9.52%) Java Scala Developer
6 1 (4.76%) AWS DevOps
6 1 (4.76%) AWS DevOps Engineer
6 1 (4.76%) Azure DevOps
6 1 (4.76%) Azure DevOps Engineer
6 1 (4.76%) Data Architect
6 1 (4.76%) Data Engineer
6 1 (4.76%) Python Developer
6 1 (4.76%) Senior DevOps
6 1 (4.76%) Senior Hadoop Engineer
6 1 (4.76%) Senior Java Developer
6 1 (4.76%) Senior Java Scala Developer
6 1 (4.76%) Server Engineer
Libraries, Frameworks & Software Standards
1 13 (61.90%) Kafka
2 11 (52.38%) Akka
3 4 (19.05%) Spring
4 2 (9.52%) Spark Streaming
5 1 (4.76%) Angular 2
5 1 (4.76%) AngularJS
5 1 (4.76%) CSS
5 1 (4.76%) Hibernate
5 1 (4.76%) HTML
5 1 (4.76%) JSON
5 1 (4.76%) LDAP
5 1 (4.76%) OAuth
5 1 (4.76%) REST
5 1 (4.76%) RESTful
5 1 (4.76%) SAML
Miscellaneous
1 11 (52.38%) Enterprise Software
2 10 (47.62%) Computer Science
3 1 (4.76%) Cyberthreat
3 1 (4.76%) Data Centre
3 1 (4.76%) Linux Command Line
Operating Systems
1 2 (9.52%) Linux
2 1 (4.76%) Unix
Processes & Methodologies
1 12 (57.14%) Analytics
2 11 (52.38%) Software Engineering
3 10 (47.62%) MapReduce
4 5 (23.81%) Agile Software Development
5 4 (19.05%) Data Modelling
6 3 (14.29%) Machine Learning
6 3 (14.29%) Multithreading
7 2 (9.52%) Cybersecurity
7 2 (9.52%) ETL
7 2 (9.52%) Kanban
7 2 (9.52%) Multithreaded Programming
7 2 (9.52%) Performance Tuning
7 2 (9.52%) Scrum
7 2 (9.52%) UML
8 1 (4.76%) Continuous Delivery
8 1 (4.76%) Data Development
8 1 (4.76%) Data Ingestion
8 1 (4.76%) DevOps
8 1 (4.76%) SDLC
8 1 (4.76%) Software Delivery
Programming Languages
1 16 (76.19%) Java
2 14 (66.67%) Scala
3 11 (52.38%) Java 8
4 3 (14.29%) Python
4 3 (14.29%) SQL
5 1 (4.76%) C#
5 1 (4.76%) C++
5 1 (4.76%) JavaScript
5 1 (4.76%) Perl
Qualifications
1 10 (47.62%) Computer Science Degree
1 10 (47.62%) Degree
Quality Assurance & Compliance
1 1 (4.76%) Data Quality
1 1 (4.76%) GDPR
1 1 (4.76%) ISO/IEC 27001
System Software
1 3 (14.29%) HDFS
2 1 (4.76%) Docker
2 1 (4.76%) Virtual Servers
2 1 (4.76%) VMware ESXi
2 1 (4.76%) VMware Infrastructure
Systems Management
1 1 (4.76%) Ambari
1 1 (4.76%) Ansible
1 1 (4.76%) Hadoop YARN
1 1 (4.76%) Kibana
1 1 (4.76%) Kubernetes
1 1 (4.76%) Oozie
1 1 (4.76%) Single Sign-On
1 1 (4.76%) Terraform
Vendors
1 2 (9.52%) Hortonworks
1 2 (9.52%) Oracle
1 2 (9.52%) Splunk
1 2 (9.52%) Tableau
2 1 (4.76%) Cloudera
2 1 (4.76%) Cognos
2 1 (4.76%) Perforce
2 1 (4.76%) VMware