Period
to 15 October 2018

The following table provides summary statistics for permanent job vacancies advertised in Glasgow with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 15 October 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Glasgow
6 months to
15 Oct 2018
Same period 2017 Same period 2016
Rank 119 109 123
Rank change year-on-year -10 +14 +10
Permanent jobs citing Apache Spark 39 34 27
As % of all permanent IT jobs advertised in Glasgow 1.78% 1.53% 1.19%
As % of the Application Platforms category 10.57% 9.77% 6.63%
Number of salaries quoted 31 28 4
Glasgow median annual salary £52,500 £70,000 £47,500
Median salary % change year-on-year -25.00% +47.37% -20.83%
10th Percentile £42,250 £48,450 £37,250
90th Percentile £70,000 £80,000 £52,625
Scotland median annual salary £55,000 £68,750 £50,000
% change year-on-year -20.00% +37.50% -13.04%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Glasgow with a requirement for application platform skills.

All Application Platform Skills
Glasgow
Permanent vacancies with a requirement for application platform skills 369 348 407
As % of all permanent IT jobs advertised in Glasgow 16.80% 15.65% 17.89%
Number of salaries quoted 265 192 201
Glasgow median annual salary £45,000 £45,000 £45,000
10th Percentile £28,250 £31,250 £28,000
90th Percentile £60,000 £70,000 £64,750
Scotland median annual salary £45,000 £42,500 £45,000
% change year-on-year +5.88% -5.56% +11.11%

Apache Spark
Job Vacancy Trend in Glasgow

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Glasgow.

Job vacancy trend for Apache Spark in Glasgow

Apache Spark
Salary Trend in Glasgow

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Glasgow.

Salary trend for Apache Spark in Glasgow

Apache Spark
Salary Histogram in Glasgow

The salary distribution of IT jobs citing Apache Spark in Glasgow over the 6 months to 15 October 2018.

Salary histogram for Apache Spark in Glasgow

For the 6 months to 15 October 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Glasgow region with a requirement for Apache Spark.

1 29 (74.36%) Big Data
2 27 (69.23%) Hadoop
3 19 (48.72%) Python
4 18 (46.15%) Java
4 18 (46.15%) SQL
4 18 (46.15%) Apache Hive
4 18 (46.15%) Analytics
5 14 (35.90%) Mentoring
6 12 (30.77%) R
6 12 (30.77%) Amazon AWS
6 12 (30.77%) Artificial Intelligence
7 11 (28.21%) HBase
7 11 (28.21%) Agile Software Development
8 10 (25.64%) HDFS
9 9 (23.08%) Docker
9 9 (23.08%) Data Science
9 9 (23.08%) Microsoft Azure
9 9 (23.08%) Software Engineering
10 8 (20.51%) Git (software)
10 8 (20.51%) Maven
10 8 (20.51%) Eclipse
11 7 (17.95%) Apache Pig
11 7 (17.95%) Amazon Redshift
11 7 (17.95%) Microservices
11 7 (17.95%) ETL
11 7 (17.95%) Spring
11 7 (17.95%) TDD
11 7 (17.95%) Hibernate
11 7 (17.95%) Stakeholder Management
11 7 (17.95%) Continuous Integration

Apache Spark
Co-occurring IT Skills in Glasgow by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (17.95%) Apache Pig
2 6 (15.38%) SAS
3 2 (5.13%) Apache Solr
4 1 (2.56%) Mule
Cloud Services
1 12 (30.77%) Amazon AWS
2 9 (23.08%) Microsoft Azure
3 6 (15.38%) Amazon EMR
4 2 (5.13%) Google Cloud Platform
5 1 (2.56%) AWS Lambda
5 1 (2.56%) GitHub
5 1 (2.56%) Google Analytics
5 1 (2.56%) Serverless
Communications & Networking
1 2 (5.13%) AMQP
2 1 (2.56%) Firewall
2 1 (2.56%) TCP/IP
Database & Business Intelligence
1 29 (74.36%) Big Data
2 27 (69.23%) Hadoop
3 18 (46.15%) Apache Hive
4 11 (28.21%) HBase
5 7 (17.95%) Amazon Redshift
6 6 (15.38%) Apache Cassandra
6 6 (15.38%) SQL Server
6 6 (15.38%) Sqoop
7 5 (12.82%) Data Lake
7 5 (12.82%) SQL Server 2012
8 4 (10.26%) NoSQL
9 3 (7.69%) Impala
10 2 (5.13%) Data Mining
10 2 (5.13%) Data Warehouse
10 2 (5.13%) MongoDB
10 2 (5.13%) Parquet
11 1 (2.56%) PostgreSQL
11 1 (2.56%) SQL Server Analysis Services
11 1 (2.56%) SQL Server Integration Services
11 1 (2.56%) SQL Server Reporting Services
Development Applications
1 8 (20.51%) Eclipse
1 8 (20.51%) Git (software)
1 8 (20.51%) Maven
2 4 (10.26%) Jenkins
3 3 (7.69%) JUnit
4 2 (5.13%) FindBugs
4 2 (5.13%) IntelliJ
4 2 (5.13%) Subversion
5 1 (2.56%) ERwin
5 1 (2.56%) Mockito
5 1 (2.56%) TestNG
General
1 4 (10.26%) Banking
2 3 (7.69%) Finance
3 2 (5.13%) Manufacturing
4 1 (2.56%) Financial Institution
4 1 (2.56%) Front Office
4 1 (2.56%) Investment Banking
4 1 (2.56%) Law
Job Titles
1 14 (35.90%) Developer
2 11 (28.21%) Consultant
3 8 (20.51%) Big Data Developer
4 6 (15.38%) AWS Consultant
4 6 (15.38%) Development Manager
4 6 (15.38%) Java Developer
4 6 (15.38%) Technical Development Manager
4 6 (15.38%) Technical Leader
4 6 (15.38%) Technical Manager
5 5 (12.82%) Big Data Consultant
5 5 (12.82%) Data Consultant
5 5 (12.82%) Java Consultant
6 4 (10.26%) Hadoop Developer
7 3 (7.69%) Data Engineer
7 3 (7.69%) Data Scientist
8 2 (5.13%) Big Data Engineer
8 2 (5.13%) Integration Developer
8 2 (5.13%) MongoDB Developer
8 2 (5.13%) Senior Big Data Developer
8 2 (5.13%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 7 (17.95%) Hibernate
1 7 (17.95%) REST
1 7 (17.95%) Spring
2 6 (15.38%) Apache Axis
2 6 (15.38%) Drools
2 6 (15.38%) Kafka
2 6 (15.38%) Spring Boot
3 5 (12.82%) J2EE
4 2 (5.13%) Apache Avro
4 2 (5.13%) Natural Language Processing
5 1 (2.56%) SOAP
5 1 (2.56%) Struts
5 1 (2.56%) Swing
5 1 (2.56%) Web Services
Miscellaneous
1 6 (15.38%) Analytical Skills
1 6 (15.38%) Enterprise Software
2 5 (12.82%) Robotics
3 4 (10.26%) Computer Science
4 2 (5.13%) Analytical Mindset
4 2 (5.13%) Cloud Native
4 2 (5.13%) Mainframe
5 1 (2.56%) Management Information System
5 1 (2.56%) Public Cloud
5 1 (2.56%) Reference Data
5 1 (2.56%) Self-Motivation
Operating Systems
1 3 (7.69%) Unix
2 2 (5.13%) Linux
3 1 (2.56%) CentOS
3 1 (2.56%) Red Hat Enterprise Linux
Processes & Methodologies
1 18 (46.15%) Analytics
2 14 (35.90%) Mentoring
3 12 (30.77%) Artificial Intelligence
4 11 (28.21%) Agile Software Development
5 9 (23.08%) Data Science
5 9 (23.08%) Software Engineering
6 7 (17.95%) Continuous Integration
6 7 (17.95%) ETL
6 7 (17.95%) Microservices
6 7 (17.95%) Stakeholder Management
6 7 (17.95%) TDD
7 6 (15.38%) Data Analytics
7 6 (15.38%) Data Development
7 6 (15.38%) OOA/OOD
7 6 (15.38%) RAD
7 6 (15.38%) SOA
7 6 (15.38%) Test Automation
7 6 (15.38%) UML
8 5 (12.82%) Machine Learning
9 3 (7.69%) Use Case
Programming Languages
1 19 (48.72%) Python
2 18 (46.15%) Java
2 18 (46.15%) SQL
3 12 (30.77%) R
4 3 (7.69%) Shell Script
5 2 (5.13%) Scala
6 1 (2.56%) Bash Shell
6 1 (2.56%) Perl
6 1 (2.56%) Ruby
Qualifications
1 2 (5.13%) Degree
1 2 (5.13%) PhD
System Software
1 10 (25.64%) HDFS
2 9 (23.08%) Docker
3 1 (2.56%) Apache Flume
Systems Management
1 6 (15.38%) Oozie
2 2 (5.13%) Ansible
2 2 (5.13%) Kubernetes
3 1 (2.56%) Opscode Chef
3 1 (2.56%) Puppet
3 1 (2.56%) Salt
Vendors
1 4 (10.26%) Cloudera
2 2 (5.13%) Cognizant
2 2 (5.13%) Google
2 2 (5.13%) MuleSoft
2 2 (5.13%) Salesforce.com
2 2 (5.13%) SAP
3 1 (2.56%) IBM
3 1 (2.56%) Splunk
3 1 (2.56%) Tableau