Period
to 18 July 2018

The following table provides summary statistics for permanent job vacancies advertised in Glasgow with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 18 July 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Glasgow
6 months to
18 Jul 2018
Same period 2017 Same period 2016
Rank 122 120 140
Rank change year-on-year -2 +20 +13
Permanent jobs citing Apache Spark 40 27 27
As % of all permanent IT jobs advertised in Glasgow 1.64% 1.22% 1.04%
As % of the Application Platforms category 8.85% 8.44% 5.05%
Number of salaries quoted 20 19 2
Glasgow median annual salary £53,750 £80,000 £52,500
Median salary % change year-on-year -32.81% +52.38% -
10th Percentile £42,150 £55,750 £48,750
90th Percentile £62,800 £80,000 £56,250
Scotland median annual salary £55,000 £77,500 £52,500
% change year-on-year -29.03% +47.62% -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Glasgow with a requirement for application platform skills.

All Application Platform Skills
Glasgow
Permanent vacancies with a requirement for application platform skills 452 320 535
As % of all permanent IT jobs advertised in Glasgow 18.58% 14.51% 20.53%
Number of salaries quoted 318 179 268
Glasgow median annual salary £45,000 £45,000 £45,000
10th Percentile £28,775 £26,700 £30,000
90th Percentile £65,150 £80,000 £65,000
Scotland median annual salary £45,000 £42,500 £45,000
% change year-on-year +5.88% -5.56% +12.50%

Apache Spark
Job Vacancy Trend in Glasgow

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Glasgow.

Job vacancy trend for Apache Spark in Glasgow

Apache Spark
Salary Trend in Glasgow

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Glasgow.

Salary trend for Apache Spark in Glasgow

Apache Spark
Salary Histogram in Glasgow

The salary distribution of IT jobs citing Apache Spark in Glasgow over the 6 months to 18 July 2018.

Salary histogram for Apache Spark in Glasgow

For the 6 months to 18 July 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Glasgow region with a requirement for Apache Spark.

1 29 (72.50%) SQL
2 25 (62.50%) Java
3 23 (57.50%) Hadoop
4 21 (52.50%) Spring
5 20 (50.00%) Hibernate
6 18 (45.00%) Python
6 18 (45.00%) Big Data
7 15 (37.50%) Finance
7 15 (37.50%) Amazon AWS
8 14 (35.00%) Apache Cassandra
8 14 (35.00%) Elasticsearch
8 14 (35.00%) Mentoring
9 13 (32.50%) User Experience
9 13 (32.50%) SDLC
9 13 (32.50%) NoSQL
10 12 (30.00%) Migration
10 12 (30.00%) ETL
11 11 (27.50%) Stakeholder Management
12 9 (22.50%) Agile Software Development
13 8 (20.00%) REST
13 8 (20.00%) Apache Hive
13 8 (20.00%) Amazon Redshift
13 8 (20.00%) HDFS
14 7 (17.50%) Translating Business Requirements
14 7 (17.50%) Collaborative Working
14 7 (17.50%) R
14 7 (17.50%) Microsoft Azure
14 7 (17.50%) Analytics
14 7 (17.50%) Apache Pig
14 7 (17.50%) Amazon EMR

Apache Spark
Co-occurring IT Skills in Glasgow by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 14 (35.00%) Elasticsearch
2 7 (17.50%) Apache Pig
2 7 (17.50%) SAS
3 1 (2.50%) Apache Qpid
3 1 (2.50%) Apache Solr
3 1 (2.50%) Mule
3 1 (2.50%) Tomcat
Cloud Services
1 15 (37.50%) Amazon AWS
2 7 (17.50%) Amazon EMR
2 7 (17.50%) Microsoft Azure
3 2 (5.00%) Cloud Computing
4 1 (2.50%) Amazon EC2
4 1 (2.50%) Amazon S3
4 1 (2.50%) AWS CloudFormation
4 1 (2.50%) AWS Lambda
4 1 (2.50%) GitHub
4 1 (2.50%) Google Analytics
4 1 (2.50%) Google Cloud Platform
4 1 (2.50%) Serverless
Communications & Networking
1 1 (2.50%) Firewall
1 1 (2.50%) TCP/IP
Database & Business Intelligence
1 23 (57.50%) Hadoop
2 18 (45.00%) Big Data
3 14 (35.00%) Apache Cassandra
4 13 (32.50%) NoSQL
5 8 (20.00%) Amazon Redshift
5 8 (20.00%) Apache Hive
6 7 (17.50%) Data Warehouse
6 7 (17.50%) SQL Server
7 6 (15.00%) SQL Server Analysis Services
7 6 (15.00%) SQL Server Integration Services
7 6 (15.00%) SQL Server Reporting Services
7 6 (15.00%) Sqoop
8 2 (5.00%) MongoDB
8 2 (5.00%) PostgreSQL
9 1 (2.50%) Amazon DynamoDB
9 1 (2.50%) HBase
9 1 (2.50%) MySQL
9 1 (2.50%) Pentaho
9 1 (2.50%) RDBMS
9 1 (2.50%) Relational Database
Development Applications
1 6 (15.00%) Git (software)
1 6 (15.00%) Maven
2 5 (12.50%) Eclipse
3 3 (7.50%) Jenkins
4 1 (2.50%) Ant
4 1 (2.50%) JUnit
4 1 (2.50%) Mockito
4 1 (2.50%) TestNG
General
1 15 (37.50%) Finance
2 2 (5.00%) Banking
3 1 (2.50%) Financial Institution
Job Titles
1 17 (42.50%) Developer
1 17 (42.50%) Java Developer
2 13 (32.50%) Python Developer
3 12 (30.00%) Senior Developer
3 12 (30.00%) Senior Java Developer
3 12 (30.00%) Senior Python Developer
4 11 (27.50%) Consultant
5 6 (15.00%) AWS Consultant
5 6 (15.00%) Designer
6 5 (12.50%) Big Data Consultant
6 5 (12.50%) Data Consultant
6 5 (12.50%) Java Consultant
7 2 (5.00%) Integration Developer
7 2 (5.00%) Java Software Developer
7 2 (5.00%) MongoDB Developer
7 2 (5.00%) Software Developer
7 2 (5.00%) Software Engineer
8 1 (2.50%) Angular Developer
8 1 (2.50%) Cloud Engineer
8 1 (2.50%) Data Engineer
Libraries, Frameworks & Software Standards
1 21 (52.50%) Spring
2 20 (50.00%) Hibernate
3 8 (20.00%) REST
4 6 (15.00%) J2EE
4 6 (15.00%) Spring Boot
5 5 (12.50%) Apache Axis
5 5 (12.50%) Drools
6 4 (10.00%) Kafka
7 1 (2.50%) Angular 2
7 1 (2.50%) AngularJS
7 1 (2.50%) Apache Flex
7 1 (2.50%) Apache Thrift
7 1 (2.50%) Elastic Stack
7 1 (2.50%) PostGIS
7 1 (2.50%) Protocol Buffers
7 1 (2.50%) Samza
7 1 (2.50%) SOAP
7 1 (2.50%) Struts
7 1 (2.50%) Swing
7 1 (2.50%) Web Services
Miscellaneous
1 13 (32.50%) User Experience
2 5 (12.50%) Enterprise Software
3 2 (5.00%) Analytical Mindset
3 2 (5.00%) Analytical Skills
3 2 (5.00%) Cloud Native
4 1 (2.50%) Algorithms
4 1 (2.50%) AS400
4 1 (2.50%) Computer Science
4 1 (2.50%) Data Centre
4 1 (2.50%) Public Cloud
4 1 (2.50%) Self-Motivation
4 1 (2.50%) Virtual Team
Operating Systems
1 4 (10.00%) Linux
2 2 (5.00%) Unix
3 1 (2.50%) CentOS
3 1 (2.50%) Red Hat Enterprise Linux
Processes & Methodologies
1 14 (35.00%) Mentoring
2 13 (32.50%) SDLC
3 12 (30.00%) ETL
3 12 (30.00%) Migration
4 11 (27.50%) Stakeholder Management
5 9 (22.50%) Agile Software Development
6 7 (17.50%) Analytics
6 7 (17.50%) Collaborative Working
6 7 (17.50%) Data Modelling
6 7 (17.50%) TDD
6 7 (17.50%) Translating Business Requirements
7 6 (15.00%) Continuous Integration
7 6 (15.00%) Data Analysis
7 6 (15.00%) Data Science
7 6 (15.00%) Microservices
7 6 (15.00%) OOA/OOD
7 6 (15.00%) Statistics
8 5 (12.50%) RAD
8 5 (12.50%) SOA
8 5 (12.50%) UML
Programming Languages
1 29 (72.50%) SQL
2 25 (62.50%) Java
3 18 (45.00%) Python
4 7 (17.50%) R
5 2 (5.00%) Ruby
5 2 (5.00%) Scala
6 1 (2.50%) Bash Shell
6 1 (2.50%) C#
6 1 (2.50%) Java 8
6 1 (2.50%) MATLAB
6 1 (2.50%) Perl
Qualifications
1 1 (2.50%) Computer Science Degree
1 1 (2.50%) Degree
Quality Assurance & Compliance
1 1 (2.50%) GCP
System Software
1 8 (20.00%) HDFS
2 6 (15.00%) Docker
3 1 (2.50%) Apache Flume
Systems Management
1 6 (15.00%) Oozie
2 3 (7.50%) Ansible
3 1 (2.50%) Control-M
3 1 (2.50%) Kibana
3 1 (2.50%) logstash
3 1 (2.50%) Mesos
3 1 (2.50%) Opscode Chef
3 1 (2.50%) Puppet
3 1 (2.50%) Salt
Vendors
1 2 (5.00%) MuleSoft
1 2 (5.00%) Sybase
2 1 (2.50%) Cloudera
2 1 (2.50%) Google
2 1 (2.50%) IBM
2 1 (2.50%) SAP
2 1 (2.50%) Splunk
2 1 (2.50%) Tableau