Period
to 16 January 2018

The following table provides summary statistics for permanent job vacancies advertised in Edinburgh with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 16 January 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Edinburgh
6 months to
16 Jan 2018
Same period 2017 Same period 2016
Rank 116 120 144
Rank change year-on-year +4 +24 +11
Permanent jobs citing Apache Spark 34 14 7
As % of all permanent IT jobs advertised in Edinburgh 1.31% 0.64% 0.25%
As % of the Application Platforms category 7.89% 4.12% 1.29%
Number of salaries quoted 8 9 5
Edinburgh median annual salary £45,000 £50,000 £60,000
Median salary % change year-on-year -10.00% -16.67% -25.00%
10th Percentile £36,000 £42,250 £55,000
90th Percentile £56,250 £87,500 £85,750
Scotland median annual salary £65,000 £50,000 £60,000
% change year-on-year +30.00% -16.67% -25.00%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Edinburgh with a requirement for application platform skills.

All Application Platform Skills
Edinburgh
Permanent vacancies with a requirement for application platform skills 431 340 544
As % of all permanent IT jobs advertised in Edinburgh 16.55% 15.64% 19.62%
Number of salaries quoted 264 238 381
Edinburgh median annual salary £41,500 £45,000 £42,500
Median salary % change year-on-year -7.78% +5.88% +6.25%
10th Percentile £30,250 £27,500 £25,000
90th Percentile £60,000 £63,250 £60,000
Scotland median annual salary £42,500 £45,000 £42,000
% change year-on-year -5.56% +7.14% +5.00%

Apache Spark
Job Vacancy Trend in Edinburgh

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Edinburgh.

Job vacancy trend for Apache Spark in Edinburgh

Apache Spark
Salary Trend in Edinburgh

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Edinburgh.

Salary trend for Apache Spark in Edinburgh

Apache Spark
Salary Histogram in Edinburgh

The salary distribution of IT jobs citing Apache Spark in Edinburgh over the 6 months to 16 January 2018.

Salary histogram for Apache Spark in Edinburgh

For the 6 months to 16 January 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the Edinburgh region with a requirement for Apache Spark.

1 26 (76.47%) Hadoop
2 17 (50.00%) Apache Hive
3 15 (44.12%) HBase
3 15 (44.12%) Machine Learning
3 15 (44.12%) Degree
4 14 (41.18%) Python
4 14 (41.18%) Apache Cassandra
5 13 (38.24%) Big Data
5 13 (38.24%) Kafka
6 12 (35.29%) ETL
6 12 (35.29%) PostgreSQL
7 11 (32.35%) MongoDB
8 10 (29.41%) R
8 10 (29.41%) Hadoop YARN
8 10 (29.41%) SQL
9 9 (26.47%) Java
9 9 (26.47%) HTTP
9 9 (26.47%) Statistics
9 9 (26.47%) Mathematics
9 9 (26.47%) Analytics
10 8 (23.53%) REST
10 8 (23.53%) Software Engineering
10 8 (23.53%) Agile Software Development
11 7 (20.59%) Computer Science
11 7 (20.59%) Data Modelling
11 7 (20.59%) Linux
12 6 (17.65%) Applied Mathematics
12 6 (17.65%) Google
12 6 (17.65%) Visualisation
12 6 (17.65%) NumPy

Apache Spark
Co-occurring IT Skills in Edinburgh by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 3 (8.82%) Elasticsearch
2 2 (5.88%) Apache
3 1 (2.94%) Jupyter
3 1 (2.94%) Oracle SOA Suite
3 1 (2.94%) SAS
Cloud Services
1 4 (11.76%) Google Cloud Platform
2 2 (5.88%) Amazon AWS
2 2 (5.88%) Amazon EMR
2 2 (5.88%) Google Analytics
Communications & Networking
1 9 (26.47%) HTTP
Database & Business Intelligence
1 26 (76.47%) Hadoop
2 17 (50.00%) Apache Hive
3 15 (44.12%) HBase
4 14 (41.18%) Apache Cassandra
5 13 (38.24%) Big Data
6 12 (35.29%) PostgreSQL
7 11 (32.35%) MongoDB
8 5 (14.71%) Data Warehouse
8 5 (14.71%) NoSQL
9 2 (5.88%) Aerospike
9 2 (5.88%) Amazon Redshift
9 2 (5.88%) Text Mining
10 1 (2.94%) Couchbase
10 1 (2.94%) Lumira
10 1 (2.94%) RDBMS
10 1 (2.94%) Relational Database
10 1 (2.94%) SQL Server
Development Applications
1 2 (5.88%) Jenkins
2 1 (2.94%) ERwin
General
1 4 (11.76%) Banking
2 3 (8.82%) Finance
Job Titles
1 13 (38.24%) Data Engineer
2 11 (32.35%) Data Scientist
3 4 (11.76%) Analyst
3 4 (11.76%) Data Analyst
4 3 (8.82%) Architect
4 3 (8.82%) Big Data Engineer
4 3 (8.82%) Software Engineer
5 2 (5.88%) Technical Architect
6 1 (2.94%) Cassandra Engineer
6 1 (2.94%) Data Architect
6 1 (2.94%) DevOps Engineer
6 1 (2.94%) E-Commerce Engineer
6 1 (2.94%) Hadoop Engineer
6 1 (2.94%) Java Engineer
6 1 (2.94%) Java Software Engineer
6 1 (2.94%) Quality Engineer
6 1 (2.94%) Real Time Engineer
6 1 (2.94%) Senior Architect
6 1 (2.94%) Senior Data Architect
6 1 (2.94%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 13 (38.24%) Kafka
2 8 (23.53%) REST
3 6 (17.65%) AngularJS
3 6 (17.65%) NumPy
4 4 (11.76%) MLlib
5 3 (8.82%) Django
5 3 (8.82%) scikit-learn
5 3 (8.82%) SciPy
6 2 (5.88%) HTML
6 2 (5.88%) HTML5
6 2 (5.88%) KnockoutJS
6 2 (5.88%) Node.js
6 2 (5.88%) Pandas
6 2 (5.88%) Play Framework
6 2 (5.88%) React
7 1 (2.94%) TensorFlow
Miscellaneous
1 7 (20.59%) Computer Science
2 3 (8.82%) Algorithms
2 3 (8.82%) Analytical Skills
3 1 (2.94%) Taxonomies
Operating Systems
1 7 (20.59%) Linux
Processes & Methodologies
1 15 (44.12%) Machine Learning
2 12 (35.29%) ETL
3 9 (26.47%) Analytics
3 9 (26.47%) Mathematics
3 9 (26.47%) Statistics
4 8 (23.53%) Agile Software Development
4 8 (23.53%) Software Engineering
5 7 (20.59%) Data Modelling
6 6 (17.65%) Applied Mathematics
6 6 (17.65%) Visualisation
7 5 (14.71%) Business Intelligence
7 5 (14.71%) Data Analysis
7 5 (14.71%) Statistical Analysis
8 4 (11.76%) Data Mapping
8 4 (11.76%) Kanban
8 4 (11.76%) Statistical Modelling
8 4 (11.76%) Validation
9 3 (8.82%) Operations Research
9 3 (8.82%) Physics
9 3 (8.82%) Prototyping
Programming Languages
1 14 (41.18%) Python
2 10 (29.41%) R
2 10 (29.41%) SQL
3 9 (26.47%) Java
4 6 (17.65%) Scala
5 3 (8.82%) C#
5 3 (8.82%) JavaScript
6 2 (5.88%) C
6 2 (5.88%) C++
7 1 (2.94%) MATLAB
Qualifications
1 15 (44.12%) Degree
2 3 (8.82%) PhD
3 1 (2.94%) Computer Science Degree
Quality Assurance & Compliance
1 1 (2.94%) Data Quality
System Software
1 1 (2.94%) Docker
Systems Management
1 10 (29.41%) Hadoop YARN
2 1 (2.94%) Ansible
2 1 (2.94%) Terraform
Vendors
1 6 (17.65%) Google
2 2 (5.88%) Microsoft
3 1 (2.94%) IBM
3 1 (2.94%) Oracle
3 1 (2.94%) SAP
3 1 (2.94%) Teradata