Period
to 18 September 2018

The following table provides summary statistics for permanent job vacancies advertised in Edinburgh with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 18 September 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
Scotland > Edinburgh
6 months to
18 Sep 2018
Same period 2017 Same period 2016
Rank 116 129 125
Rank change year-on-year +13 -4 +31
Permanent jobs citing Apache Spark 30 24 14
As % of all permanent IT jobs advertised in Edinburgh 1.19% 0.92% 0.59%
As % of the Application Platforms category 8.72% 5.27% 3.51%
Number of salaries quoted 25 12 9
Edinburgh median annual salary £55,000 £65,000 £50,000
Median salary % change year-on-year -15.38% +30.00% -9.09%
10th Percentile £50,000 £37,625 £38,750
90th Percentile £64,500 £76,125 £61,250
Scotland median annual salary £55,000 £70,000 £50,000
% change year-on-year -21.43% +40.00% -16.67%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Edinburgh with a requirement for application platform skills.

All Application Platform Skills
Edinburgh
Permanent vacancies with a requirement for application platform skills 344 455 399
As % of all permanent IT jobs advertised in Edinburgh 13.70% 17.35% 16.85%
Number of salaries quoted 212 244 263
Edinburgh median annual salary £50,000 £40,500 £45,000
Median salary % change year-on-year +23.46% -10.00% +12.50%
10th Percentile £28,250 £28,750 £25,750
90th Percentile £70,000 £66,250 £65,000
Scotland median annual salary £45,000 £42,500 £45,000
% change year-on-year +5.88% -5.56% +10.43%

Apache Spark
Job Vacancy Trend in Edinburgh

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Edinburgh.

Job vacancy trend for Apache Spark in Edinburgh

Apache Spark
Salary Trend in Edinburgh

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in Edinburgh.

Salary trend for Apache Spark in Edinburgh

Apache Spark
Salary Histogram in Edinburgh

The salary distribution of IT jobs citing Apache Spark in Edinburgh over the 6 months to 18 September 2018.

Salary histogram for Apache Spark in Edinburgh

For the 6 months to 18 September 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Edinburgh region with a requirement for Apache Spark.

1 25 (83.33%) Python
2 21 (70.00%) Java
2 21 (70.00%) Analytics
3 16 (53.33%) Agile Software Development
3 16 (53.33%) Software Engineering
4 14 (46.67%) Test Automation
5 13 (43.33%) Big Data
5 13 (43.33%) SQL
6 12 (40.00%) Hadoop
6 12 (40.00%) Mentoring
7 11 (36.67%) Amazon AWS
7 11 (36.67%) Kafka
7 11 (36.67%) JavaScript
8 10 (33.33%) Apache Hive
9 9 (30.00%) Apache Cassandra
9 9 (30.00%) Data Analytics
9 9 (30.00%) Apache Pig
10 8 (26.67%) Amazon EMR
10 8 (26.67%) Oozie
10 8 (26.67%) AngularJS
10 8 (26.67%) Node.js
10 8 (26.67%) ETL
11 7 (23.33%) NoSQL
11 7 (23.33%) Amazon S3
11 7 (23.33%) Scala
11 7 (23.33%) React
11 7 (23.33%) Problem-Solving
12 6 (20.00%) Data Science
12 6 (20.00%) Serverless
12 6 (20.00%) AWS Lambda

Apache Spark
Co-occurring IT Skills in Edinburgh by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 9 (30.00%) Apache Pig
2 5 (16.67%) Apache
3 2 (6.67%) Elasticsearch
3 2 (6.67%) SAS
4 1 (3.33%) Apache Solr
Cloud Services
1 11 (36.67%) Amazon AWS
2 8 (26.67%) Amazon EMR
3 7 (23.33%) Amazon S3
4 6 (20.00%) Amazon EC2
4 6 (20.00%) AWS Lambda
4 6 (20.00%) Serverless
5 2 (6.67%) Amazon CloudWatch
5 2 (6.67%) Amazon ElastiCache
5 2 (6.67%) Amazon ELB
5 2 (6.67%) AWS CloudFormation
5 2 (6.67%) AWS CodePipeline
5 2 (6.67%) AWS Elastic Beanstalk
5 2 (6.67%) Datadog
5 2 (6.67%) GitHub
5 2 (6.67%) Google Cloud Platform
5 2 (6.67%) Sumo Logic
5 2 (6.67%) Virtual Private Cloud
6 1 (3.33%) AWS Data Pipeline
6 1 (3.33%) Google Analytics
Communications & Networking
1 5 (16.67%) Internet
2 1 (3.33%) DNS
Database & Business Intelligence
1 13 (43.33%) Big Data
2 12 (40.00%) Hadoop
3 10 (33.33%) Apache Hive
4 9 (30.00%) Apache Cassandra
5 7 (23.33%) NoSQL
6 6 (20.00%) Amazon RDS
6 6 (20.00%) Amazon Redshift
7 5 (16.67%) PostgreSQL
7 5 (16.67%) Sqoop
8 3 (10.00%) Data Warehouse
8 3 (10.00%) MongoDB
9 2 (6.67%) Amazon DynamoDB
9 2 (6.67%) HBase
10 1 (3.33%) Apache Kudu
10 1 (3.33%) BigQuery
10 1 (3.33%) Data Lake
10 1 (3.33%) Data Mining
10 1 (3.33%) Impala
10 1 (3.33%) Presto
10 1 (3.33%) Relational Database
Development Applications
1 5 (16.67%) Git (software)
2 4 (13.33%) Jenkins
3 2 (6.67%) Atlassian Bamboo
3 2 (6.67%) Bitbucket
3 2 (6.67%) GitLab
3 2 (6.67%) Travis CI
4 1 (3.33%) JUnit
4 1 (3.33%) Maven
4 1 (3.33%) Mockito
4 1 (3.33%) TestNG
General
1 2 (6.67%) Advertising
2 1 (3.33%) Finance
2 1 (3.33%) Financial Institution
2 1 (3.33%) Games
Job Titles
1 8 (26.67%) Development Manager
1 8 (26.67%) Technical Development Manager
1 8 (26.67%) Technical Leader
1 8 (26.67%) Technical Manager
2 5 (16.67%) AWS Consultant
2 5 (16.67%) Consultant
3 4 (13.33%) Cloud Engineer
3 4 (13.33%) Software Engineer
4 3 (10.00%) AWS Engineer
4 3 (10.00%) Big Data Consultant
4 3 (10.00%) Data Consultant
4 3 (10.00%) Developer
4 3 (10.00%) Senior Cloud Engineer
5 2 (6.67%) Cloud Consultant
5 2 (6.67%) Data Engineer
5 2 (6.67%) Lead Software Engineer
5 2 (6.67%) Software Developer
5 2 (6.67%) Software Engineering Team Leader
5 2 (6.67%) Software Team Leader
5 2 (6.67%) Team Leader
Libraries, Frameworks & Software Standards
1 11 (36.67%) Kafka
2 8 (26.67%) AngularJS
2 8 (26.67%) Node.js
3 7 (23.33%) React
4 5 (16.67%) .NET
5 4 (13.33%) Web Services
6 2 (6.67%) CSS
6 2 (6.67%) Django
6 2 (6.67%) Elastic Stack
6 2 (6.67%) HTML
6 2 (6.67%) HTML5
6 2 (6.67%) Spring
6 2 (6.67%) Twitter Bootstrap
7 1 (3.33%) Ionic Framework
7 1 (3.33%) JSON
7 1 (3.33%) Natural Language Processing
7 1 (3.33%) RabbitMQ
7 1 (3.33%) REST
7 1 (3.33%) RESTful
7 1 (3.33%) Vue.js
Miscellaneous
1 6 (20.00%) Computer Science
2 3 (10.00%) Public Cloud
3 2 (6.67%) Algorithms
3 2 (6.67%) Enterprise Cloud
3 2 (6.67%) Linux Command Line
4 1 (3.33%) Analytical Mindset
4 1 (3.33%) Analytical Skills
4 1 (3.33%) Private Cloud
4 1 (3.33%) Self-Motivation
Operating Systems
1 6 (20.00%) Linux
2 1 (3.33%) Android
2 1 (3.33%) Apple iOS
2 1 (3.33%) CentOS
2 1 (3.33%) Red Hat Enterprise Linux
2 1 (3.33%) Ubuntu
Processes & Methodologies
1 21 (70.00%) Analytics
2 16 (53.33%) Agile Software Development
2 16 (53.33%) Software Engineering
3 14 (46.67%) Test Automation
4 12 (40.00%) Mentoring
5 9 (30.00%) Data Analytics
6 8 (26.67%) ETL
7 7 (23.33%) Problem-Solving
8 6 (20.00%) Data Science
8 6 (20.00%) Microservices
8 6 (20.00%) OO
9 4 (13.33%) Coaching
9 4 (13.33%) Line Management
9 4 (13.33%) OOP
9 4 (13.33%) Performance Management
9 4 (13.33%) Stakeholder Management
10 3 (10.00%) Deployment Automation
10 3 (10.00%) DevOps
10 3 (10.00%) Machine Learning
10 3 (10.00%) MapReduce
Programming Languages
1 25 (83.33%) Python
2 21 (70.00%) Java
3 13 (43.33%) SQL
4 11 (36.67%) JavaScript
5 7 (23.33%) Scala
6 6 (20.00%) C#
7 5 (16.67%) Bash Shell
7 5 (16.67%) R
7 5 (16.67%) Ruby
8 4 (13.33%) PHP
9 2 (6.67%) Go
10 1 (3.33%) TypeScript
Qualifications
1 6 (20.00%) Degree
2 5 (16.67%) Computer Science Degree
3 1 (3.33%) Numerate Degree
Quality Assurance & Compliance
1 1 (3.33%) GCP
System Software
1 5 (16.67%) HDFS
2 4 (13.33%) Docker
3 1 (3.33%) Samba
Systems Management
1 8 (26.67%) Oozie
2 6 (20.00%) Terraform
3 4 (13.33%) Opscode Chef
4 3 (10.00%) Ansible
4 3 (10.00%) Kubernetes
4 3 (10.00%) Puppet
5 2 (6.67%) Grafana
5 2 (6.67%) Prometheus
5 2 (6.67%) Sysdig
6 1 (3.33%) Consul
6 1 (3.33%) Hadoop YARN
Vendors
1 3 (10.00%) Google
2 2 (6.67%) Splunk
3 1 (3.33%) Cloudera
3 1 (3.33%) Red Hat