Apache Spark Jobs in Scotland

Apache Spark
UK > Scotland

The following table provides summary statistics for permanent job vacancies advertised in Scotland with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 41 191 164
Rank change year-on-year +150 -27 -35
Permanent jobs citing Apache Spark 621 30 84
As % of all permanent jobs advertised in Scotland 9.25% 0.63% 1.47%
As % of the Application Platforms category 49.25% 7.04% 10.40%
Number of salaries quoted 5 7 40
10th Percentile - £52,500 £37,500
25th Percentile £46,250 £53,750 £48,750
Median annual salary (50th Percentile) £47,500 £60,000 £60,000
Median % change year-on-year -20.83% - -14.29%
75th Percentile £52,884 £67,500 £68,275
90th Percentile - £74,000 £81,375
UK median annual salary £80,000 £87,500 £77,500
% change year-on-year -8.57% +12.90% +6.16%

All Application Platform Skills
Scotland

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Scotland with a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 1,261 426 808
As % of all permanent jobs advertised in Scotland 18.78% 8.99% 14.16%
Number of salaries quoted 222 270 374
10th Percentile £27,600 £26,250 £28,825
25th Percentile £32,500 £35,000 £36,527
Median annual salary (50th Percentile) £45,500 £50,119 £50,000
Median % change year-on-year -9.22% +0.24% +5.26%
75th Percentile £54,688 £65,000 £65,000
90th Percentile £73,675 £77,715 £71,250
UK median annual salary £50,000 £55,000 £54,000
% change year-on-year -9.09% +1.85% +2.86%

Apache Spark
Job Vacancy Trend in Scotland

Job postings citing Apache Spark as a proportion of all IT jobs advertised in Scotland.

Job vacancy trend for Apache Spark in Scotland

Apache Spark
Salary Trend in Scotland

3-month moving average salary quoted in jobs citing Apache Spark in Scotland.

Salary trend for Apache Spark in Scotland

Apache Spark
Job Locations in Scotland

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the Scotland region over the 6 months to 27 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Glasgow +95 592 £47,500 -38.71% 5
Edinburgh +55 26 £51,528 -14.12% 7
Midlothian - 3 - - 2
Apache Spark
UK

Apache Spark
Co-occurring Skills and Capabilities in Scotland by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 116 (18.68%) Apache
2 105 (16.91%) Apache Airflow
3 3 (0.48%) SAS
Cloud Services
1 469 (75.52%) AWS
2 74 (11.92%) Amazon SQS
3 67 (10.79%) Amazon EKS
4 51 (8.21%) Amazon EC2
4 51 (8.21%) Amazon ECS
4 51 (8.21%) Amazon EMR
4 51 (8.21%) AWS Lambda
4 51 (8.21%) Serverless
5 28 (4.51%) GCP
6 24 (3.86%) SaaS
7 23 (3.70%) Amazon S3
7 23 (3.70%) Google Docs
7 23 (3.70%) Lucidchart
7 23 (3.70%) Miro
7 23 (3.70%) Slack
8 5 (0.81%) Azure
9 3 (0.48%) Cloud Computing
9 3 (0.48%) Power Platform
10 1 (0.16%) Snowflake
Communications & Networking
1 18 (2.90%) DSL
Database & Business Intelligence
1 511 (82.29%) Big Data
2 350 (56.36%) NoSQL
3 261 (42.03%) Hadoop
4 131 (21.10%) Apache Hive
5 103 (16.59%) HBase
6 51 (8.21%) Electronic Patient Records
7 23 (3.70%) Elasticsearch
7 23 (3.70%) Redis
7 23 (3.70%) Scylla
8 21 (3.38%) Data Lake
9 18 (2.90%) DB2
9 18 (2.90%) MongoDB
9 18 (2.90%) Tableau
10 16 (2.58%) Impala
11 11 (1.77%) Flink
12 4 (0.64%) SQL Server
13 3 (0.48%) PostgreSQL
13 3 (0.48%) Power BI
14 2 (0.32%) Data Warehouse
15 1 (0.16%) Apache Cassandra
Development Applications
1 86 (13.85%) Bitbucket Server
1 86 (13.85%) Git
1 86 (13.85%) Jenkins
2 1 (0.16%) JUnit
General
1 612 (98.55%) Inclusion and Diversity
2 590 (95.01%) Finance
3 588 (94.69%) Law
4 304 (48.95%) Marketing
5 271 (43.64%) Legal
6 161 (25.93%) Influencing Skills
7 72 (11.59%) Financial Institution
8 34 (5.48%) Banking
9 28 (4.51%) Social Skills
10 20 (3.22%) Analytical Skills
11 19 (3.06%) Investment Banking
12 13 (2.09%) Private Banking
13 2 (0.32%) Presentation Skills
13 2 (0.32%) Retail
14 1 (0.16%) Games
Job Titles
1 531 (85.51%) Software Engineer
2 378 (60.87%) Big Data Engineer
2 378 (60.87%) Big Data Software Engineer
3 209 (33.66%) Scala Engineer
3 209 (33.66%) Scala Software Engineer
4 192 (30.92%) Java Engineer
4 192 (30.92%) Java Software Engineer
5 191 (30.76%) Data Engineer
6 182 (29.31%) Lead
6 182 (29.31%) Lead Software Engineer
7 181 (29.15%) AWS Engineer
7 181 (29.15%) AWS Software Engineer
8 148 (23.83%) Lead Big Data Engineer
9 119 (19.16%) Java Scala Software Engineer
10 116 (18.68%) Python Engineer
10 116 (18.68%) Python Software Engineer
11 96 (15.46%) Lead Java Engineer
12 88 (14.17%) Senior
13 85 (13.69%) Senior Software Engineer
14 69 (11.11%) Developer
Libraries, Frameworks & Software Standards
1 123 (19.81%) PySpark
2 93 (14.98%) Kafka
3 82 (13.20%) Spring
4 53 (8.53%) Spring Boot
5 26 (4.19%) React
6 23 (3.70%) AngularJS
6 23 (3.70%) GraphQL
7 16 (2.58%) JPA
7 16 (2.58%) REST
8 3 (0.48%) MLlib
8 3 (0.48%) MXNet
8 3 (0.48%) NumPy
8 3 (0.48%) PyTorch
8 3 (0.48%) scikit-learn
8 3 (0.48%) SciPy
8 3 (0.48%) TensorFlow
9 1 (0.16%) Apache NiFi
9 1 (0.16%) Web Services
Miscellaneous
1 219 (35.27%) Algorithms
2 186 (29.95%) Cloud Native
3 43 (6.92%) Legacy Code
4 36 (5.80%) Data Structures
5 35 (5.64%) Public Cloud
6 25 (4.03%) Management Information System
7 18 (2.90%) Product Ownership
8 10 (1.61%) Enterprise Software
9 7 (1.13%) Legacy Systems
10 4 (0.64%) Distributed Systems
11 3 (0.48%) Onboarding
12 2 (0.32%) Credit Risk
13 1 (0.16%) Distributed Applications
13 1 (0.16%) Distributed Computing
Operating Systems
1 102 (16.43%) Unix
2 1 (0.16%) Linux
Processes & Methodologies
1 615 (99.03%) Software Engineering
2 581 (93.56%) Agile
3 534 (85.99%) SDLC
4 493 (79.39%) CI/CD
5 492 (79.23%) Operational Stability
6 285 (45.89%) Machine Learning
7 284 (45.73%) Artificial Intelligence
8 280 (45.09%) Risk Management
9 264 (42.51%) Community of Practice
10 230 (37.04%) Performance Tuning
11 203 (32.69%) Continuous Improvement
12 197 (31.72%) Visualisation
13 168 (27.05%) Problem-Solving
14 153 (24.64%) Decision-Making
15 146 (23.51%) Microservices
16 104 (16.75%) Test Automation
17 94 (15.14%) Coaching
18 93 (14.98%) Mentoring
19 87 (14.01%) TDD
20 86 (13.85%) Open Source
Programming Languages
1 481 (77.46%) Java
2 429 (69.08%) SQL
3 322 (51.85%) Scala
4 299 (48.15%) Python
5 104 (16.75%) PL/SQL
6 24 (3.86%) Bash
6 24 (3.86%) Go
7 3 (0.48%) R
8 1 (0.16%) C++
Qualifications
1 18 (2.90%) Degree
2 3 (0.48%) PhD
Quality Assurance & Compliance
1 38 (6.12%) Data Quality
2 34 (5.48%) SLA
3 2 (0.32%) CRD IV
3 2 (0.32%) IFRS
3 2 (0.32%) IFRS 9
System Software
1 102 (16.43%) HDFS
2 1 (0.16%) Docker
Systems Management
1 91 (14.65%) Kubernetes
2 86 (13.85%) Terraform
3 1 (0.16%) Rancher
Vendors
1 150 (24.15%) Databricks
2 86 (13.85%) Informatica
3 72 (11.59%) Cloudera
4 27 (4.35%) Google
5 24 (3.86%) Dell
6 19 (3.06%) Oracle
7 18 (2.90%) Alteryx
7 18 (2.90%) Cognos
7 18 (2.90%) Sybase
8 1 (0.16%) Microsoft
8 1 (0.16%) StreamSets
8 1 (0.16%) Teradata