Period
to 17 June 2019

The following table provides summary statistics for permanent job vacancies advertised in Glasgow with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 17 June 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Glasgow
6 months to
17 Jun 2019
Same period 2018 Same period 2017
Rank 111 114 115
Rank change year-on-year +3 +1 +31
Permanent jobs citing Apache Spark 26 44 25
As % of all permanent IT jobs advertised in Glasgow 1.39% 1.85% 1.18%
As % of the Application Platforms category 8.47% 9.73% 8.62%
Number of salaries quoted 19 21 17
Glasgow median annual salary £57,000 £55,000 £80,000
Median salary % change year-on-year +3.64% -31.25% +52.38%
Scotland median annual salary £57,000 £55,000 £77,500
% change year-on-year +3.64% -29.03% +47.62%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Glasgow with a requirement for application platform skills.

All Application Platform Skills
Glasgow
Permanent vacancies with a requirement for application platform skills 307 452 290
As % of all permanent IT jobs advertised in Glasgow 16.44% 18.96% 13.71%
Number of salaries quoted 206 321 167
Glasgow median annual salary £42,500 £45,000 £44,000
Median salary % change year-on-year -5.56% +2.27% -2.22%
10th Percentile £30,000 £30,000 £25,950
90th Percentile £65,000 £67,500 £76,250
Scotland median annual salary £42,500 £45,000 £42,500
% change year-on-year -5.56% +5.88% -2.30%

Apache Spark
Job Vacancy Trend in Glasgow

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Glasgow.

Job vacancy trend for Apache Spark in Glasgow

Apache Spark
Salary Trend in Glasgow

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Glasgow.

Salary trend for Apache Spark in Glasgow

Apache Spark
Salary Histogram in Glasgow

The salary distribution of IT jobs citing Apache Spark in Glasgow over the 6 months to 17 June 2019.

Salary histogram for Apache Spark in Glasgow

For the 6 months to 17 June 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Glasgow region with a requirement for Apache Spark.

1 20 (76.92%) Hadoop
2 17 (65.38%) Big Data
3 15 (57.69%) Java
4 14 (53.85%) Microsoft Azure
4 14 (53.85%) NoSQL
5 13 (50.00%) Analytics
5 13 (50.00%) SQL
5 13 (50.00%) Python
6 11 (42.31%) ETL
7 10 (38.46%) Scala
8 9 (34.62%) Software Engineering
8 9 (34.62%) Apache Hive
9 8 (30.77%) Amazon AWS
9 8 (30.77%) Kafka
9 8 (30.77%) Data Engineering
9 8 (30.77%) Business Intelligence
10 7 (26.92%) Kubernetes
10 7 (26.92%) Docker
10 7 (26.92%) Data Analytics
11 6 (23.08%) Machine Learning
11 6 (23.08%) Open Source
11 6 (23.08%) Metadata Management
11 6 (23.08%) SQL Server
11 6 (23.08%) Agile Software Development
11 6 (23.08%) Data Management
11 6 (23.08%) Computer Science
11 6 (23.08%) Data Development
12 5 (19.23%) Data Science
12 5 (19.23%) Visualisation
12 5 (19.23%) Spring

Apache Spark
Co-occurring IT Skills in Glasgow by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 5 (19.23%) Apache
2 1 (3.85%) Elasticsearch
Cloud Services
1 14 (53.85%) Microsoft Azure
2 8 (30.77%) Amazon AWS
3 5 (19.23%) Amazon S3
4 3 (11.54%) Amazon EC2
4 3 (11.54%) AWS Lambda
4 3 (11.54%) Google Cloud Platform
4 3 (11.54%) Serverless
5 2 (7.69%) Amazon EMR
Communications & Networking
1 4 (15.38%) AMQP
2 2 (7.69%) Internet
3 1 (3.85%) HTTP
Database & Business Intelligence
1 20 (76.92%) Hadoop
2 17 (65.38%) Big Data
3 14 (53.85%) NoSQL
4 9 (34.62%) Apache Hive
5 6 (23.08%) SQL Server
6 4 (15.38%) Data Lake
6 4 (15.38%) Data Warehouse
6 4 (15.38%) Impala
6 4 (15.38%) Neo4j
7 3 (11.54%) Amazon RDS
8 2 (7.69%) PostgreSQL
8 2 (7.69%) Sqoop
9 1 (3.85%) Apache Cassandra
9 1 (3.85%) Data Mining
9 1 (3.85%) HBase
9 1 (3.85%) MongoDB
9 1 (3.85%) MySQL
9 1 (3.85%) Relational Database
Development Applications
1 2 (7.69%) Atlassian Bamboo
1 2 (7.69%) Jenkins
1 2 (7.69%) JIRA
2 1 (3.85%) Git (software)
General
1 4 (15.38%) Marketing
2 3 (11.54%) Legal
3 2 (7.69%) Finance
4 1 (3.85%) Manufacturing
4 1 (3.85%) Retail
Job Titles
1 12 (46.15%) Data Engineer
2 8 (30.77%) Developer
3 6 (23.08%) Big Data Engineer
4 5 (19.23%) Java Developer
5 3 (11.54%) Big Data Developer
6 2 (7.69%) Senior Data Engineer
7 1 (3.85%) Cloud Engineer
7 1 (3.85%) Data Scientist
7 1 (3.85%) ETL Developer
7 1 (3.85%) Java Engineer
7 1 (3.85%) Senior Developer
7 1 (3.85%) Senior ETL Developer
7 1 (3.85%) Team Leader
7 1 (3.85%) Technical Leader
Libraries, Frameworks & Software Standards
1 8 (30.77%) Kafka
2 5 (19.23%) Spring
3 4 (15.38%) Spring Boot
4 3 (11.54%) Natural Language Processing
4 3 (11.54%) PySpark
4 3 (11.54%) Velocity
5 2 (7.69%) AngularJS
5 2 (7.69%) LAPP Stack
5 2 (7.69%) Spark Streaming
5 2 (7.69%) TensorFlow
5 2 (7.69%) Web Services
6 1 (3.85%) Pandas
6 1 (3.85%) Sass
Miscellaneous
1 3 (11.54%) Digital Media
1 3 (11.54%) User Experience
2 2 (7.69%) Greenfield Project
2 2 (7.69%) Internet of Things
3 1 (3.85%) Algorithms
3 1 (3.85%) Analytical Skills
Operating Systems
1 3 (11.54%) Android
1 3 (11.54%) Apple iOS
2 2 (7.69%) Linux
3 1 (3.85%) Unix
Processes & Methodologies
1 13 (50.00%) Analytics
2 11 (42.31%) ETL
3 9 (34.62%) Software Engineering
4 8 (30.77%) Business Intelligence
4 8 (30.77%) Data Engineering
5 7 (26.92%) Data Analytics
6 6 (23.08%) Agile Software Development
6 6 (23.08%) Computer Science
6 6 (23.08%) Data Development
6 6 (23.08%) Data Management
6 6 (23.08%) Machine Learning
6 6 (23.08%) Metadata Management
6 6 (23.08%) Open Source
7 5 (19.23%) Artificial Intelligence
7 5 (19.23%) Data Science
7 5 (19.23%) OO
7 5 (19.23%) SDLC
7 5 (19.23%) Visualisation
8 4 (15.38%) DevOps
8 4 (15.38%) OOP
Programming Languages
1 15 (57.69%) Java
2 13 (50.00%) Python
2 13 (50.00%) SQL
3 10 (38.46%) Scala
4 5 (19.23%) R
5 4 (15.38%) Shell Script
6 3 (11.54%) Bash Shell
7 2 (7.69%) C++
7 2 (7.69%) JavaScript
8 1 (3.85%) HiveQL
8 1 (3.85%) Ruby
Qualifications
1 2 (7.69%) PhD
Quality Assurance & Compliance
1 5 (19.23%) Data Quality
2 2 (7.69%) GDPR
2 2 (7.69%) ISO/IEC 27001
2 2 (7.69%) QA
System Software
1 7 (26.92%) Docker
2 3 (11.54%) HDFS
3 2 (7.69%) Apache Flume
Systems Management
1 7 (26.92%) Kubernetes
2 3 (11.54%) Hadoop YARN
3 2 (7.69%) Docker Swarm
Vendors
1 5 (19.23%) Tableau
2 4 (15.38%) Cloudera
2 4 (15.38%) Hortonworks
3 3 (11.54%) Databricks
3 3 (11.54%) Microsoft
3 3 (11.54%) Roku
3 3 (11.54%) Virgin Media
4 2 (7.69%) Google
4 2 (7.69%) Oracle
5 1 (3.85%) Ab Initio