Period
to 13 December 2018

The following table provides summary statistics for permanent job vacancies advertised in Glasgow with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 13 December 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Glasgow
6 months to
13 Dec 2018
Same period 2017 Same period 2016
Rank 125 126 114
Rank change year-on-year +1 -12 +19
Permanent jobs citing Apache Spark 31 23 20
As % of all permanent IT jobs advertised in Glasgow 1.47% 1.00% 0.97%
As % of the Application Platforms category 9.20% 6.27% 5.49%
Number of salaries quoted 23 19 4
Glasgow median annual salary £50,000 £67,500 £47,500
Median salary % change year-on-year -25.93% +42.11% -17.39%
10th Percentile £42,500 £48,550 £37,250
90th Percentile £70,000 £80,000 £52,625
Scotland median annual salary £55,000 £65,000 £50,000
% change year-on-year -15.38% +30.00% -16.67%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Glasgow with a requirement for application platform skills.

All Application Platform Skills
Glasgow
Permanent vacancies with a requirement for application platform skills 337 367 364
As % of all permanent IT jobs advertised in Glasgow 15.95% 15.89% 17.73%
Number of salaries quoted 231 209 210
Glasgow median annual salary £45,000 £45,000 £45,000
10th Percentile £28,722 £31,700 £27,750
90th Percentile £57,500 £64,000 £57,500
Scotland median annual salary £45,000 £42,500 £45,000
% change year-on-year +5.88% -5.56% +6.55%

Apache Spark
Job Vacancy Trend in Glasgow

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Glasgow.

Job vacancy trend for Apache Spark in Glasgow

Apache Spark
Salary Trend in Glasgow

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Glasgow.

Salary trend for Apache Spark in Glasgow

Apache Spark
Salary Histogram in Glasgow

The salary distribution of IT jobs citing Apache Spark in Glasgow over the 6 months to 13 December 2018.

Salary histogram for Apache Spark in Glasgow

For the 6 months to 13 December 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Glasgow region with a requirement for Apache Spark.

1 23 (74.19%) Big Data
2 21 (67.74%) Python
3 18 (58.06%) Java
4 16 (51.61%) SQL
5 15 (48.39%) Hadoop
6 14 (45.16%) Mentoring
7 12 (38.71%) Analytics
8 11 (35.48%) Apache Hive
8 11 (35.48%) Artificial Intelligence
8 11 (35.48%) Software Engineering
9 10 (32.26%) Microsoft Azure
9 10 (32.26%) HBase
10 9 (29.03%) Agile Software Development
11 8 (25.81%) Kafka
11 8 (25.81%) NoSQL
12 7 (22.58%) R
12 7 (22.58%) Computer Science
12 7 (22.58%) Data Science
13 6 (19.35%) Data Development
13 6 (19.35%) SDLC
13 6 (19.35%) Test Automation
13 6 (19.35%) Docker
13 6 (19.35%) Data Analytics
13 6 (19.35%) Apache Cassandra
13 6 (19.35%) Finance
14 5 (16.13%) SQL Server
14 5 (16.13%) OOP
14 5 (16.13%) OO
14 5 (16.13%) SQL Server 2012
14 5 (16.13%) Analytical Skills

Apache Spark
Co-occurring IT Skills in Glasgow by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1 (3.23%) Apache Solr
1 1 (3.23%) Mule
Applications
1 1 (3.23%) Microsoft Office
Cloud Services
1 10 (32.26%) Microsoft Azure
2 4 (12.90%) Amazon AWS
3 2 (6.45%) Google Cloud Platform
4 1 (3.23%) AWS Lambda
4 1 (3.23%) Serverless
Communications & Networking
1 5 (16.13%) AMQP
2 1 (3.23%) Firewall
2 1 (3.23%) TCP/IP
Database & Business Intelligence
1 23 (74.19%) Big Data
2 15 (48.39%) Hadoop
3 11 (35.48%) Apache Hive
4 10 (32.26%) HBase
5 8 (25.81%) NoSQL
6 6 (19.35%) Apache Cassandra
7 5 (16.13%) SQL Server
7 5 (16.13%) SQL Server 2012
8 4 (12.90%) Data Lake
9 3 (9.68%) Impala
9 3 (9.68%) Sybase ASE
10 2 (6.45%) Data Mining
10 2 (6.45%) MongoDB
10 2 (6.45%) Parquet
Development Applications
1 3 (9.68%) Eclipse
1 3 (9.68%) Git (software)
1 3 (9.68%) Maven
2 2 (6.45%) FindBugs
2 2 (6.45%) IntelliJ
2 2 (6.45%) Jenkins
2 2 (6.45%) JUnit
2 2 (6.45%) Subversion
3 1 (3.23%) ERwin
General
1 6 (19.35%) Finance
2 4 (12.90%) Financial Institution
3 3 (9.68%) Banking
4 2 (6.45%) Manufacturing
5 1 (3.23%) Front Office
5 1 (3.23%) Investment Banking
5 1 (3.23%) Law
Job Titles
1 19 (61.29%) Developer
2 8 (25.81%) Big Data Developer
2 8 (25.81%) Java Developer
3 6 (19.35%) Development Manager
3 6 (19.35%) Technical Development Manager
3 6 (19.35%) Technical Leader
3 6 (19.35%) Technical Manager
4 4 (12.90%) Data Scientist
4 4 (12.90%) Hadoop Developer
5 3 (9.68%) SQL Developer
6 2 (6.45%) Big Data Engineer
6 2 (6.45%) Data Engineer
6 2 (6.45%) Integration Developer
6 2 (6.45%) Java Software Developer
6 2 (6.45%) MongoDB Developer
6 2 (6.45%) Senior Big Data Developer
6 2 (6.45%) Senior Data Scientist
6 2 (6.45%) Senior Developer
6 2 (6.45%) Software Developer
7 1 (3.23%) Data Science Leader
Libraries, Frameworks & Software Standards
1 8 (25.81%) Kafka
2 2 (6.45%) Apache Avro
2 2 (6.45%) Natural Language Processing
3 1 (3.23%) Apache Axis
3 1 (3.23%) Drools
3 1 (3.23%) Hibernate
3 1 (3.23%) REST
3 1 (3.23%) Spring
3 1 (3.23%) Spring Boot
Miscellaneous
1 5 (16.13%) Analytical Skills
1 5 (16.13%) Robotics
2 2 (6.45%) Cloud Native
2 2 (6.45%) Mainframe
3 1 (3.23%) Algorithms
3 1 (3.23%) Data Structures
3 1 (3.23%) Enterprise Software
3 1 (3.23%) Management Information System
3 1 (3.23%) Reference Data
Operating Systems
1 4 (12.90%) Linux
2 3 (9.68%) Unix
Processes & Methodologies
1 14 (45.16%) Mentoring
2 12 (38.71%) Analytics
3 11 (35.48%) Artificial Intelligence
3 11 (35.48%) Software Engineering
4 9 (29.03%) Agile Software Development
5 7 (22.58%) Computer Science
5 7 (22.58%) Data Science
6 6 (19.35%) Data Analytics
6 6 (19.35%) Data Development
6 6 (19.35%) SDLC
6 6 (19.35%) Test Automation
7 5 (16.13%) OO
7 5 (16.13%) OOP
7 5 (16.13%) Open Source
8 4 (12.90%) Machine Learning
9 3 (9.68%) Deep Learning
9 3 (9.68%) Use Case
10 2 (6.45%) Business Development
10 2 (6.45%) Multithreading
10 2 (6.45%) Refactoring
Programming Languages
1 21 (67.74%) Python
2 18 (58.06%) Java
3 16 (51.61%) SQL
4 7 (22.58%) R
5 3 (9.68%) Shell Script
5 3 (9.68%) T-SQL
6 2 (6.45%) Scala
7 1 (3.23%) Perl
Qualifications
1 2 (6.45%) Degree
1 2 (6.45%) PhD
System Software
1 6 (19.35%) Docker
2 4 (12.90%) HDFS
Systems Management
1 5 (16.13%) Kubernetes
Vendors
1 4 (12.90%) Cloudera
2 3 (9.68%) Sybase
3 2 (6.45%) Cognizant
3 2 (6.45%) Google
3 2 (6.45%) MuleSoft
3 2 (6.45%) Salesforce.com
3 2 (6.45%) SAP
4 1 (3.23%) IBM
4 1 (3.23%) Microsoft
4 1 (3.23%) Splunk