Period
to 19 February 2019

The following table provides summary statistics for permanent job vacancies advertised in Edinburgh with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 19 February 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Edinburgh
6 months to
19 Feb 2019
Same period 2018 Same period 2017
Rank 106 106 116
Rank change year-on-year 0 +10 +25
Permanent jobs citing Apache Spark 34 45 15
As % of all permanent IT jobs advertised in Edinburgh 1.37% 1.66% 0.69%
As % of the Application Platforms category 10.12% 10.07% 4.27%
Number of salaries quoted 24 11 14
Edinburgh median annual salary £50,000 £45,000 £77,500
Median salary % change year-on-year +11.11% -41.94% +10.71%
10th Percentile £32,500 £32,500 £42,000
90th Percentile £76,750 £65,500 £87,500
Scotland median annual salary £50,000 £58,750 £65,250
% change year-on-year -14.89% -9.96% +18.64%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Edinburgh with a requirement for application platform skills.

All Application Platform Skills
Edinburgh
Permanent vacancies with a requirement for application platform skills 336 447 351
As % of all permanent IT jobs advertised in Edinburgh 13.58% 16.52% 16.22%
Number of salaries quoted 197 281 236
Edinburgh median annual salary £45,000 £42,500 £47,500
Median salary % change year-on-year +5.88% -10.53% +11.76%
10th Percentile £29,000 £30,000 £28,875
90th Percentile £70,000 £68,750 £66,250
Scotland median annual salary £45,000 £44,705 £45,000
% change year-on-year +0.66% -0.66% +5.88%

Apache Spark
Job Vacancy Trend in Edinburgh

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Edinburgh.

Job vacancy trend for Apache Spark in Edinburgh

Apache Spark
Salary Trend in Edinburgh

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Edinburgh.

Salary trend for Apache Spark in Edinburgh

Apache Spark
Salary Histogram in Edinburgh

The salary distribution of IT jobs citing Apache Spark in Edinburgh over the 6 months to 19 February 2019.

Salary histogram for Apache Spark in Edinburgh

For the 6 months to 19 February 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Edinburgh region with a requirement for Apache Spark.

1 29 (85.29%) Python
2 19 (55.88%) Agile Software Development
2 19 (55.88%) Scala
3 17 (50.00%) Hadoop
3 17 (50.00%) Data Science
4 16 (47.06%) Analytics
4 16 (47.06%) Software Engineering
4 16 (47.06%) Java
5 15 (44.12%) Big Data
6 14 (41.18%) Kafka
7 12 (35.29%) Machine Learning
7 12 (35.29%) Apache Cassandra
8 11 (32.35%) Finance
9 10 (29.41%) Degree
9 10 (29.41%) Analytical Skills
10 9 (26.47%) Continuous Delivery
10 9 (26.47%) Elastic Stack
10 9 (26.47%) Google
10 9 (26.47%) SQL
10 9 (26.47%) Linux
10 9 (26.47%) Test Automation
10 9 (26.47%) Computer Science
11 8 (23.53%) Open Source
11 8 (23.53%) Artifactory
11 8 (23.53%) GoCD
11 8 (23.53%) Kubernetes
11 8 (23.53%) PagerDuty
11 8 (23.53%) Prometheus
12 7 (20.59%) Pandas
12 7 (20.59%) NumPy

Apache Spark
Co-occurring IT Skills in Edinburgh by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 6 (17.65%) Apache Pig
1 6 (17.65%) Elasticsearch
2 3 (8.82%) SAS
3 2 (5.88%) Apache
4 1 (2.94%) Oracle SOA Suite
Applications
1 3 (8.82%) Microsoft Excel
1 3 (8.82%) Microsoft PowerPoint
1 3 (8.82%) MS Visio
Cloud Services
1 7 (20.59%) Amazon AWS
2 5 (14.71%) Cloud Computing
2 5 (14.71%) Google Analytics
3 4 (11.76%) Google Cloud Platform
4 3 (8.82%) Amazon S3
4 3 (8.82%) AWS Lambda
4 3 (8.82%) Serverless
5 2 (5.88%) Amazon EC2
5 2 (5.88%) Amazon EMR
5 2 (5.88%) AWS CloudFormation
5 2 (5.88%) GitHub
5 2 (5.88%) Microsoft Azure
6 1 (2.94%) Amazon Kinesis
Communications & Networking
1 1 (2.94%) Internet
Database & Business Intelligence
1 17 (50.00%) Hadoop
2 15 (44.12%) Big Data
3 12 (35.29%) Apache Cassandra
4 7 (20.59%) Apache Hive
4 7 (20.59%) PostgreSQL
5 5 (14.71%) Amazon Aurora
6 3 (8.82%) QlikView
6 3 (8.82%) SAS Visual Analytics
7 2 (5.88%) Amazon DynamoDB
7 2 (5.88%) Amazon Redshift
7 2 (5.88%) NoSQL
7 2 (5.88%) OpenTSDB
7 2 (5.88%) Parquet
8 1 (2.94%) Amazon RDS
8 1 (2.94%) Data Lake
8 1 (2.94%) Data Warehouse
8 1 (2.94%) Flink
8 1 (2.94%) SQL Server
Development Applications
1 8 (23.53%) Artifactory
1 8 (23.53%) GoCD
2 1 (2.94%) Pylint
General
1 11 (32.35%) Finance
2 7 (20.59%) Banking
3 3 (8.82%) Private Banking
3 3 (8.82%) Retail Banking
4 1 (2.94%) Games
Job Titles
1 8 (23.53%) Python Engineer
2 6 (17.65%) Software Engineer
3 5 (14.71%) Analyst
3 5 (14.71%) Senior Software Engineer
4 4 (11.76%) Junior
5 3 (8.82%) Development Manager
5 3 (8.82%) Principal Engineer
5 3 (8.82%) Principal Software Engineer
5 3 (8.82%) Product Manager
5 3 (8.82%) Senior Analyst
5 3 (8.82%) Technical Development Manager
5 3 (8.82%) Technical Leader
5 3 (8.82%) Technical Manager
6 2 (5.88%) Cloud Engineer
6 2 (5.88%) Data Engineer
6 2 (5.88%) Data Scientist
6 2 (5.88%) Senior Web Engineer
6 2 (5.88%) Web Engineer
7 1 (2.94%) Big Data Engineer
7 1 (2.94%) Junior Data Scientist
Libraries, Frameworks & Software Standards
1 14 (41.18%) Kafka
2 9 (26.47%) Elastic Stack
3 7 (20.59%) NumPy
3 7 (20.59%) Pandas
4 6 (17.65%) RESTful
5 4 (11.76%) AngularJS
6 3 (8.82%) Backbone.js
6 3 (8.82%) React
6 3 (8.82%) Vue.js
7 2 (5.88%) Apache Flex
7 2 (5.88%) Apache Thrift
7 2 (5.88%) PostGIS
7 2 (5.88%) Protocol Buffers
7 2 (5.88%) Samza
8 1 (2.94%) .NET
8 1 (2.94%) Apache Beam
8 1 (2.94%) ASP.NET
8 1 (2.94%) ASP.NET MVC
8 1 (2.94%) JSON
8 1 (2.94%) pytest
Miscellaneous
1 10 (29.41%) Analytical Skills
2 6 (17.65%) Management Information System
3 3 (8.82%) Enterprise Software
4 2 (5.88%) Cloud Native
4 2 (5.88%) Data Centre
4 2 (5.88%) Linux Command Line
5 1 (2.94%) Mobile Banking
5 1 (2.94%) Smart Meter
Operating Systems
1 9 (26.47%) Linux
2 3 (8.82%) Android
2 3 (8.82%) Apple iOS
Processes & Methodologies
1 19 (55.88%) Agile Software Development
2 17 (50.00%) Data Science
3 16 (47.06%) Analytics
3 16 (47.06%) Software Engineering
4 12 (35.29%) Machine Learning
5 9 (26.47%) Computer Science
5 9 (26.47%) Continuous Delivery
5 9 (26.47%) Test Automation
6 8 (23.53%) Open Source
7 7 (20.59%) Business Development
7 7 (20.59%) Continuous Improvement
8 6 (17.65%) Anti-Money Laundering
8 6 (17.65%) Risk Management
9 5 (14.71%) Data Analysis
9 5 (14.71%) Data Modelling
9 5 (14.71%) Regression Analysis
10 4 (11.76%) Decision Tree
10 4 (11.76%) Functional Programming
10 4 (11.76%) Information Security
10 4 (11.76%) Support Vector Machines
Programming Languages
1 29 (85.29%) Python
2 19 (55.88%) Scala
3 16 (47.06%) Java
4 9 (26.47%) SQL
5 7 (20.59%) R
6 6 (17.65%) C#
6 6 (17.65%) MATLAB
7 5 (14.71%) PL/SQL
8 4 (11.76%) JavaScript
9 2 (5.88%) Ruby
10 1 (2.94%) Delphi
Qualifications
1 10 (29.41%) Degree
2 3 (8.82%) Computer Science Degree
3 1 (2.94%) Master's Degree
3 1 (2.94%) PhD
Quality Assurance & Compliance
1 1 (2.94%) GDPR
System Software
1 6 (17.65%) Docker
2 2 (5.88%) HDFS
3 1 (2.94%) Samba
Systems Management
1 8 (23.53%) Kubernetes
1 8 (23.53%) Prometheus
2 6 (17.65%) Ambari
3 2 (5.88%) Ansible
3 2 (5.88%) Kibana
3 2 (5.88%) logstash
3 2 (5.88%) Mesos
4 1 (2.94%) Consul
4 1 (2.94%) Opscode Chef
4 1 (2.94%) Terraform
Vendors
1 9 (26.47%) Google
2 8 (23.53%) PagerDuty
3 6 (17.65%) Oracle
4 3 (8.82%) Platfora
4 3 (8.82%) Tableau
5 1 (2.94%) Informatica
5 1 (2.94%) Microsoft
5 1 (2.94%) Splunk