Period
to 25 June 2018

The following table provides summary statistics for permanent job vacancies advertised in Edinburgh with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 25 June 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Edinburgh
6 months to
25 Jun 2018
Same period 2017 Same period 2016
Rank 114 110 135
Rank change year-on-year -4 +25 -
Permanent jobs citing Apache Spark 34 29 13
As % of all permanent IT jobs advertised in Edinburgh 1.25% 1.23% 0.51%
As % of the Application Platforms category 8.95% 7.11% 2.51%
Number of salaries quoted 9 22 11
Edinburgh median annual salary £50,000 £71,250 £57,500
Median salary % change year-on-year -29.82% +23.91% -
10th Percentile £38,500 £42,625 £31,250
90th Percentile £74,400 £87,000 £77,500
Scotland median annual salary £55,000 £77,500 £52,500
% change year-on-year -29.03% +47.62% -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Edinburgh with a requirement for application platform skills.

All Application Platform Skills
Edinburgh
Permanent vacancies with a requirement for application platform skills 380 408 517
As % of all permanent IT jobs advertised in Edinburgh 13.99% 17.35% 20.41%
Number of salaries quoted 224 233 322
Edinburgh median annual salary £47,567 £42,500 £45,000
Median salary % change year-on-year +11.92% -5.56% +12.50%
10th Percentile £28,400 £27,500 £27,500
90th Percentile £70,000 £73,550 £71,250
Scotland median annual salary £45,000 £42,500 £45,000
% change year-on-year +5.88% -5.56% +12.50%

Apache Spark
Job Vacancy Trend in Edinburgh

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Edinburgh.

Job vacancy trend for Apache Spark in Edinburgh

Apache Spark
Salary Trend in Edinburgh

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Edinburgh.

Salary trend for Apache Spark in Edinburgh

Apache Spark
Salary Histogram in Edinburgh

The salary distribution of IT jobs citing Apache Spark in Edinburgh over the 6 months to 25 June 2018.

Salary histogram for Apache Spark in Edinburgh

For the 6 months to 25 June 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Edinburgh region with a requirement for Apache Spark.

1 26 (76.47%) Hadoop
2 16 (47.06%) Big Data
2 16 (47.06%) Python
3 15 (44.12%) Apache Hive
4 13 (38.24%) Kafka
4 13 (38.24%) HBase
5 12 (35.29%) Analytics
5 12 (35.29%) Apache Cassandra
6 11 (32.35%) Data Science
6 11 (32.35%) Degree
6 11 (32.35%) SQL
6 11 (32.35%) PostgreSQL
7 10 (29.41%) Agile Software Development
7 10 (29.41%) Machine Learning
8 9 (26.47%) R
8 9 (26.47%) MongoDB
8 9 (26.47%) ETL
8 9 (26.47%) Hadoop YARN
9 8 (23.53%) Java
9 8 (23.53%) Software Engineering
9 8 (23.53%) NoSQL
9 8 (23.53%) Visualisation
10 7 (20.59%) REST
10 7 (20.59%) Scala
10 7 (20.59%) Mathematics
10 7 (20.59%) JavaScript
10 7 (20.59%) HTTP
10 7 (20.59%) Problem-Solving
11 6 (17.65%) React
11 6 (17.65%) Elasticsearch

Apache Spark
Co-occurring IT Skills in Edinburgh by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 6 (17.65%) Elasticsearch
2 5 (14.71%) SAS
3 3 (8.82%) Apache Pig
4 1 (2.94%) Apache Solr
Cloud Services
1 6 (17.65%) Amazon AWS
2 3 (8.82%) Amazon EMR
2 3 (8.82%) Amazon S3
3 2 (5.88%) Amazon EC2
3 2 (5.88%) AWS Lambda
3 2 (5.88%) Serverless
4 1 (2.94%) AWS CloudFormation
4 1 (2.94%) AWS Data Pipeline
4 1 (2.94%) Cloud Computing
4 1 (2.94%) Cortana Intelligence Suite
4 1 (2.94%) Google Analytics
4 1 (2.94%) Google Cloud Platform
4 1 (2.94%) Microsoft Azure
Communications & Networking
1 7 (20.59%) HTTP
Database & Business Intelligence
1 26 (76.47%) Hadoop
2 16 (47.06%) Big Data
3 15 (44.12%) Apache Hive
4 13 (38.24%) HBase
5 12 (35.29%) Apache Cassandra
6 11 (32.35%) PostgreSQL
7 9 (26.47%) MongoDB
8 8 (23.53%) NoSQL
9 6 (17.65%) Data Warehouse
10 4 (11.76%) Amazon Redshift
11 2 (5.88%) Amazon DynamoDB
11 2 (5.88%) Sqoop
12 1 (2.94%) Aerospike
12 1 (2.94%) Amazon RDS
12 1 (2.94%) Lumira
12 1 (2.94%) Neo4j
12 1 (2.94%) OpenTSDB
12 1 (2.94%) Parquet
12 1 (2.94%) Power BI
12 1 (2.94%) Relational Database
Development Applications
1 3 (8.82%) Git (software)
2 2 (5.88%) Jenkins
3 1 (2.94%) JUnit
3 1 (2.94%) Maven
3 1 (2.94%) Mockito
3 1 (2.94%) TestNG
General
1 2 (5.88%) Advertising
1 2 (5.88%) Finance
Job Titles
1 12 (35.29%) Data Engineer
2 8 (23.53%) Data Scientist
3 4 (11.76%) Architect
3 4 (11.76%) Big Data Engineer
3 4 (11.76%) Technical Architect
4 3 (8.82%) Developer
4 3 (8.82%) Software Engineer
5 2 (5.88%) Analyst
5 2 (5.88%) AWS Consultant
5 2 (5.88%) Cassandra Engineer
5 2 (5.88%) Cloud Engineer
5 2 (5.88%) Consultant
5 2 (5.88%) Data Analyst
5 2 (5.88%) Software Developer
6 1 (2.94%) Asset Management Analyst
6 1 (2.94%) Big Data Software Engineer
6 1 (2.94%) Data Science Engineer
6 1 (2.94%) Machine Learning Scientist
6 1 (2.94%) NoSQL Engineer
6 1 (2.94%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 13 (38.24%) Kafka
2 7 (20.59%) REST
3 6 (17.65%) AngularJS
3 6 (17.65%) HTML
3 6 (17.65%) HTML5
3 6 (17.65%) React
4 4 (11.76%) KnockoutJS
4 4 (11.76%) MLlib
4 4 (11.76%) Node.js
4 4 (11.76%) NumPy
4 4 (11.76%) SciPy
5 2 (5.88%) CSS
5 2 (5.88%) D3.js
5 2 (5.88%) Django
5 2 (5.88%) Natural Language Processing
5 2 (5.88%) Twitter Bootstrap
6 1 (2.94%) SOAP
6 1 (2.94%) Struts
6 1 (2.94%) Swing
6 1 (2.94%) Web Services
Miscellaneous
1 4 (11.76%) Computer Science
2 3 (8.82%) Algorithms
2 3 (8.82%) Analytical Skills
3 1 (2.94%) Analytical Mindset
3 1 (2.94%) Cloud Native
3 1 (2.94%) Data Centre
3 1 (2.94%) Private Cloud
3 1 (2.94%) Public Cloud
Operating Systems
1 1 (2.94%) Linux
Processes & Methodologies
1 12 (35.29%) Analytics
2 11 (32.35%) Data Science
3 10 (29.41%) Agile Software Development
3 10 (29.41%) Machine Learning
4 9 (26.47%) ETL
5 8 (23.53%) Software Engineering
5 8 (23.53%) Visualisation
6 7 (20.59%) Mathematics
6 7 (20.59%) Problem-Solving
7 6 (17.65%) Scrum
8 5 (14.71%) Artificial Intelligence
8 5 (14.71%) Kanban
8 5 (14.71%) Microservices
9 4 (11.76%) Applied Mathematics
9 4 (11.76%) Creative Problem-Solving
9 4 (11.76%) Creative Thinking
9 4 (11.76%) Operations Research
9 4 (11.76%) SOA
9 4 (11.76%) Statistical Analysis
9 4 (11.76%) Statistics
Programming Languages
1 16 (47.06%) Python
2 11 (32.35%) SQL
3 9 (26.47%) R
4 8 (23.53%) Java
5 7 (20.59%) JavaScript
5 7 (20.59%) Scala
6 5 (14.71%) C#
7 2 (5.88%) MATLAB
7 2 (5.88%) PHP
7 2 (5.88%) Ruby
8 1 (2.94%) Go
Qualifications
1 11 (32.35%) Degree
2 2 (5.88%) Computer Science Degree
3 1 (2.94%) Numerate Degree
3 1 (2.94%) Security Cleared
Quality Assurance & Compliance
1 2 (5.88%) Data Quality
2 1 (2.94%) Dodd-Frank
2 1 (2.94%) EMIR
2 1 (2.94%) FATCA
2 1 (2.94%) MiFID
2 1 (2.94%) Solvency II
System Software
1 3 (8.82%) HDFS
2 1 (2.94%) Docker
2 1 (2.94%) Samba
Systems Management
1 9 (26.47%) Hadoop YARN
2 2 (5.88%) Ansible
2 2 (5.88%) Oozie
3 1 (2.94%) Kibana
3 1 (2.94%) logstash
3 1 (2.94%) Mesos
3 1 (2.94%) Opscode Chef
3 1 (2.94%) Terraform
Vendors
1 5 (14.71%) Microsoft
2 3 (8.82%) Google
3 1 (2.94%) Apple
3 1 (2.94%) IBM
3 1 (2.94%) SAP
3 1 (2.94%) Splunk
3 1 (2.94%) Tableau