Period
to 21 November 2018

The following table provides summary statistics for permanent job vacancies advertised in Edinburgh with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 21 November 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Edinburgh
6 months to
21 Nov 2018
Same period 2017 Same period 2016
Rank 119 130 127
Rank change year-on-year +11 -3 +32
Permanent jobs citing Apache Spark 37 26 12
As % of all permanent IT jobs advertised in Edinburgh 1.45% 0.96% 0.52%
As % of the Application Platforms category 10.31% 5.46% 3.36%
Number of salaries quoted 32 8 6
Edinburgh median annual salary £55,000 £45,000 £48,750
Median salary % change year-on-year +22.22% -7.69% -11.36%
10th Percentile £36,750 £37,500 £43,125
90th Percentile £69,500 £72,500 £50,625
Scotland median annual salary £55,000 £65,000 £50,000
% change year-on-year -15.38% +30.00% -9.09%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Edinburgh with a requirement for application platform skills.

All Application Platform Skills
Edinburgh
Permanent vacancies with a requirement for application platform skills 359 476 357
As % of all permanent IT jobs advertised in Edinburgh 14.09% 17.54% 15.42%
Number of salaries quoted 223 271 248
Edinburgh median annual salary £50,000 £41,500 £45,000
Median salary % change year-on-year +20.48% -7.78% +5.88%
10th Percentile £28,050 £30,000 £25,750
90th Percentile £70,000 £65,000 £62,500
Scotland median annual salary £45,000 £42,500 £45,000
% change year-on-year +5.88% -5.56% +7.14%

Apache Spark
Job Vacancy Trend in Edinburgh

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Edinburgh.

Job vacancy trend for Apache Spark in Edinburgh

Apache Spark
Salary Trend in Edinburgh

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Edinburgh.

Salary trend for Apache Spark in Edinburgh

Apache Spark
Salary Histogram in Edinburgh

The salary distribution of IT jobs citing Apache Spark in Edinburgh over the 6 months to 21 November 2018.

Salary histogram for Apache Spark in Edinburgh

For the 6 months to 21 November 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Edinburgh region with a requirement for Apache Spark.

1 33 (89.19%) Python
2 26 (70.27%) Java
3 24 (64.86%) Analytics
4 21 (56.76%) Agile Software Development
5 19 (51.35%) Software Engineering
6 15 (40.54%) Test Automation
6 15 (40.54%) Hadoop
7 14 (37.84%) Kafka
7 14 (37.84%) SQL
8 13 (35.14%) Big Data
8 13 (35.14%) Amazon AWS
9 12 (32.43%) Mentoring
9 12 (32.43%) Data Science
10 11 (29.73%) Scala
10 11 (29.73%) Apache Cassandra
10 11 (29.73%) JavaScript
11 10 (27.03%) Apache Hive
11 10 (27.03%) Computer Science
12 9 (24.32%) Data Analytics
12 9 (24.32%) Apache Pig
12 9 (24.32%) Amazon EMR
12 9 (24.32%) Degree
13 8 (21.62%) C#
13 8 (21.62%) AngularJS
13 8 (21.62%) Node.js
13 8 (21.62%) Amazon S3
14 7 (18.92%) Amazon EC2
14 7 (18.92%) ETL
14 7 (18.92%) Ruby
14 7 (18.92%) Serverless

Apache Spark
Co-occurring IT Skills in Edinburgh by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 9 (24.32%) Apache Pig
2 5 (13.51%) Apache
3 3 (8.11%) Elasticsearch
4 1 (2.70%) Apache Solr
4 1 (2.70%) SAS
Cloud Services
1 13 (35.14%) Amazon AWS
2 9 (24.32%) Amazon EMR
3 8 (21.62%) Amazon S3
4 7 (18.92%) Amazon EC2
4 7 (18.92%) AWS Lambda
4 7 (18.92%) Serverless
5 4 (10.81%) AWS CloudFormation
6 3 (8.11%) GitHub
7 2 (5.41%) Amazon CloudWatch
7 2 (5.41%) Amazon ElastiCache
7 2 (5.41%) Amazon ELB
7 2 (5.41%) AWS CodePipeline
7 2 (5.41%) AWS Elastic Beanstalk
7 2 (5.41%) Cloud Computing
7 2 (5.41%) Datadog
7 2 (5.41%) Google Analytics
7 2 (5.41%) Sumo Logic
7 2 (5.41%) Virtual Private Cloud
8 1 (2.70%) Google Cloud Platform
8 1 (2.70%) Microsoft Azure
Communications & Networking
1 5 (13.51%) Internet
2 1 (2.70%) DNS
Database & Business Intelligence
1 15 (40.54%) Hadoop
2 13 (35.14%) Big Data
3 11 (29.73%) Apache Cassandra
4 10 (27.03%) Apache Hive
5 7 (18.92%) Amazon Redshift
6 6 (16.22%) PostgreSQL
7 5 (13.51%) Amazon RDS
8 4 (10.81%) NoSQL
8 4 (10.81%) Sqoop
9 3 (8.11%) Amazon DynamoDB
9 3 (8.11%) Data Warehouse
9 3 (8.11%) MongoDB
10 2 (5.41%) OpenTSDB
10 2 (5.41%) Parquet
11 1 (2.70%) Apache Kudu
11 1 (2.70%) Data Lake
11 1 (2.70%) Data Mining
11 1 (2.70%) HBase
11 1 (2.70%) Impala
11 1 (2.70%) Presto
Development Applications
1 4 (10.81%) Git (software)
1 4 (10.81%) Jenkins
2 2 (5.41%) Artifactory
2 2 (5.41%) Atlassian Bamboo
2 2 (5.41%) Bitbucket
2 2 (5.41%) GitLab
2 2 (5.41%) GoCD
2 2 (5.41%) Travis CI
3 1 (2.70%) JUnit
3 1 (2.70%) Mockito
3 1 (2.70%) Pylint
3 1 (2.70%) TestNG
General
1 4 (10.81%) Banking
1 4 (10.81%) Finance
2 2 (5.41%) Advertising
3 1 (2.70%) Financial Institution
3 1 (2.70%) Games
Job Titles
1 8 (21.62%) Development Manager
1 8 (21.62%) Technical Development Manager
1 8 (21.62%) Technical Leader
1 8 (21.62%) Technical Manager
2 6 (16.22%) Software Engineer
3 5 (13.51%) Consultant
3 5 (13.51%) Junior
4 4 (10.81%) AWS Consultant
4 4 (10.81%) Cloud Engineer
4 4 (10.81%) Developer
4 4 (10.81%) Senior Cloud Engineer
5 3 (8.11%) AWS Engineer
5 3 (8.11%) Big Data Consultant
5 3 (8.11%) Data Consultant
5 3 (8.11%) Data Scientist
5 3 (8.11%) Senior Software Engineer
5 3 (8.11%) Software Developer
6 2 (5.41%) Lead Software Engineer
6 2 (5.41%) Software Team Leader
6 2 (5.41%) Web Engineer
Libraries, Frameworks & Software Standards
1 14 (37.84%) Kafka
2 8 (21.62%) AngularJS
2 8 (21.62%) Node.js
3 7 (18.92%) React
4 5 (13.51%) .NET
4 5 (13.51%) Elastic Stack
5 4 (10.81%) Web Services
6 2 (5.41%) Apache Flex
6 2 (5.41%) Apache Thrift
6 2 (5.41%) CSS
6 2 (5.41%) Django
6 2 (5.41%) HTML
6 2 (5.41%) HTML5
6 2 (5.41%) PostGIS
6 2 (5.41%) Protocol Buffers
6 2 (5.41%) Samza
6 2 (5.41%) Spring
6 2 (5.41%) Twitter Bootstrap
7 1 (2.70%) NumPy
7 1 (2.70%) Vue.js
Miscellaneous
1 10 (27.03%) Computer Science
2 3 (8.11%) Analytical Skills
2 3 (8.11%) Linux Command Line
3 2 (5.41%) Algorithms
3 2 (5.41%) Cloud Native
3 2 (5.41%) Data Centre
3 2 (5.41%) Enterprise Cloud
3 2 (5.41%) Public Cloud
4 1 (2.70%) Mobile Banking
4 1 (2.70%) Self-Motivation
4 1 (2.70%) Smart Meter
Operating Systems
1 6 (16.22%) Linux
2 1 (2.70%) Android
2 1 (2.70%) Apple iOS
2 1 (2.70%) CentOS
2 1 (2.70%) Red Hat Enterprise Linux
2 1 (2.70%) Ubuntu
Processes & Methodologies
1 24 (64.86%) Analytics
2 21 (56.76%) Agile Software Development
3 19 (51.35%) Software Engineering
4 15 (40.54%) Test Automation
5 12 (32.43%) Data Science
5 12 (32.43%) Mentoring
6 9 (24.32%) Data Analytics
7 7 (18.92%) ETL
7 7 (18.92%) Problem-Solving
8 6 (16.22%) Machine Learning
8 6 (16.22%) Microservices
8 6 (16.22%) OO
9 4 (10.81%) Coaching
9 4 (10.81%) Continuous Delivery
9 4 (10.81%) Data Modelling
9 4 (10.81%) Line Management
9 4 (10.81%) OOP
9 4 (10.81%) Open Source
9 4 (10.81%) Performance Management
9 4 (10.81%) Stakeholder Management
Programming Languages
1 33 (89.19%) Python
2 26 (70.27%) Java
3 14 (37.84%) SQL
4 11 (29.73%) JavaScript
4 11 (29.73%) Scala
5 8 (21.62%) C#
6 7 (18.92%) Ruby
7 6 (16.22%) R
8 5 (13.51%) Bash Shell
9 4 (10.81%) PHP
10 2 (5.41%) Go
11 1 (2.70%) MATLAB
11 1 (2.70%) PL/SQL
11 1 (2.70%) TypeScript
Qualifications
1 9 (24.32%) Degree
2 6 (16.22%) Computer Science Degree
3 1 (2.70%) Master's Degree
3 1 (2.70%) PhD
System Software
1 6 (16.22%) HDFS
2 5 (13.51%) Docker
Systems Management
1 7 (18.92%) Oozie
2 5 (13.51%) Ansible
2 5 (13.51%) Kubernetes
2 5 (13.51%) Terraform
3 4 (10.81%) Prometheus
4 3 (8.11%) Opscode Chef
4 3 (8.11%) Puppet
5 2 (5.41%) Grafana
5 2 (5.41%) Kibana
5 2 (5.41%) logstash
5 2 (5.41%) Mesos
5 2 (5.41%) Sysdig
6 1 (2.70%) Ambari
6 1 (2.70%) Consul
Vendors
1 3 (8.11%) Google
2 2 (5.41%) PagerDuty
2 2 (5.41%) Splunk
3 1 (2.70%) Cloudera
3 1 (2.70%) Informatica
3 1 (2.70%) Oracle
3 1 (2.70%) Red Hat