Apache Spark Jobs in Scotland

Apache Spark
UK > Scotland

The table below provides summary statistics for permanent job vacancies advertised in Scotland requiring Apache Spark skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Apache Spark over the 6 months leading up to 26 July 2024, comparing them to the same period in the previous two years.

6 months to
26 Jul 2024
Same period 2023 Same period 2022
Rank 51 197 195
Rank change year-on-year +146 -2 -46
Permanent jobs citing Apache Spark 336 13 56
As % of all permanent jobs advertised in Scotland 5.90% 0.34% 0.92%
As % of the Application Platforms category 38.75% 4.28% 7.01%
Number of salaries quoted 4 5 30
10th Percentile - £53,500 £31,000
25th Percentile £46,250 £55,000 £48,750
Median annual salary (50th Percentile) £47,500 £62,500 £56,250
Median % change year-on-year -24.00% +11.11% -10.00%
75th Percentile £48,750 £67,500 £65,000
90th Percentile - £109,748 £68,275
UK median annual salary £80,000 £85,000 £77,500
% change year-on-year -5.88% +9.68% +3.33%

All Application Platform Skills
Scotland

Apache Spark falls under the Application Platforms category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring application platform skills in Scotland.

Permanent vacancies with a requirement for application platform skills 867 304 799
As % of all permanent jobs advertised in Scotland 15.22% 8.01% 13.12%
Number of salaries quoted 189 221 365
10th Percentile £26,750 £28,500 £30,000
25th Percentile £31,250 £35,733 £36,250
Median annual salary (50th Percentile) £45,000 £47,557 £50,000
Median % change year-on-year -5.38% -4.89% +5.26%
75th Percentile £54,750 £64,654 £64,000
90th Percentile £69,000 £77,715 £75,831
UK median annual salary £52,500 £55,834 £55,000
% change year-on-year -5.97% +1.52% +4.76%

Apache Spark
Job Vacancy Trend in Scotland

Job postings citing Apache Spark as a proportion of all IT jobs advertised in Scotland.

Job vacancy trend for Apache Spark in Scotland

Apache Spark
Salary Trend in Scotland

3-month moving average salary quoted in jobs citing Apache Spark in Scotland.

Salary trend for Apache Spark in Scotland

Apache Spark
Job Locations in Scotland

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the Scotland region over the 6 months to 26 July 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Glasgow +83 329 £47,500 - 1
Edinburgh +29 4 - - 1
Midlothian - 3 - -
Apache Spark
UK

Apache Spark
Co-occurring Skills and Capabilities in Scotland by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 70 (20.83%) Apache Airflow
2 59 (17.56%) Apache
3 1 (0.30%) SAS
Cloud Services
1 253 (75.30%) AWS
2 33 (9.82%) Amazon SQS
3 29 (8.63%) Amazon EC2
3 29 (8.63%) Amazon ECS
3 29 (8.63%) Amazon EKS
3 29 (8.63%) Amazon EMR
3 29 (8.63%) AWS Lambda
3 29 (8.63%) Serverless
4 9 (2.68%) GCP
5 6 (1.79%) Azure
6 4 (1.19%) Amazon S3
6 4 (1.19%) Cloud Computing
6 4 (1.19%) Google Docs
6 4 (1.19%) Lucidchart
6 4 (1.19%) Miro
6 4 (1.19%) Power Platform
6 4 (1.19%) SaaS
6 4 (1.19%) Slack
7 1 (0.30%) Snowflake
Database & Business Intelligence
1 287 (85.42%) Big Data
2 209 (62.20%) NoSQL
3 129 (38.39%) Hadoop
4 74 (22.02%) Apache Hive
5 60 (17.86%) HBase
6 29 (8.63%) Electronic Patient Records
7 14 (4.17%) Impala
8 5 (1.49%) SQL Server
9 4 (1.19%) Data Lake
9 4 (1.19%) Elasticsearch
9 4 (1.19%) PostgreSQL
9 4 (1.19%) Power BI
9 4 (1.19%) Redis
9 4 (1.19%) Scylla
10 1 (0.30%) Data Warehouse
10 1 (0.30%) Relational Database
Development Applications
1 60 (17.86%) Bitbucket Server
1 60 (17.86%) Git
1 60 (17.86%) Jenkins
General
1 329 (97.92%) Inclusion and Diversity
2 324 (96.43%) Finance
2 324 (96.43%) Law
3 165 (49.11%) Legal
4 159 (47.32%) Marketing
5 93 (27.68%) Influencing Skills
6 33 (9.82%) Financial Institution
7 7 (2.08%) Social Skills
8 1 (0.30%) Banking
8 1 (0.30%) Games
8 1 (0.30%) Investment Banking
Job Titles
1 296 (88.10%) Software Engineer
2 242 (72.02%) Big Data Engineer
2 242 (72.02%) Big Data Software Engineer
3 131 (38.99%) Data Engineer
4 116 (34.52%) AWS Engineer
4 116 (34.52%) AWS Software Engineer
4 116 (34.52%) Scala Engineer
4 116 (34.52%) Scala Software Engineer
5 105 (31.25%) Lead
5 105 (31.25%) Lead Software Engineer
6 95 (28.27%) Lead Big Data Engineer
7 83 (24.70%) Java Engineer
7 83 (24.70%) Java Software Engineer
8 82 (24.40%) Python Engineer
8 82 (24.40%) Python Software Engineer
9 61 (18.15%) Java Scala Software Engineer
9 61 (18.15%) Lead Java Engineer
10 40 (11.90%) Senior
11 39 (11.61%) Senior Software Engineer
12 34 (10.12%) Lead Data Engineer
Libraries, Frameworks & Software Standards
1 80 (23.81%) PySpark
2 42 (12.50%) Kafka
3 21 (6.25%) Spring
3 21 (6.25%) Spring Boot
4 4 (1.19%) GraphQL
5 3 (0.89%) MLlib
5 3 (0.89%) MXNet
5 3 (0.89%) NumPy
5 3 (0.89%) PyTorch
5 3 (0.89%) scikit-learn
5 3 (0.89%) SciPy
5 3 (0.89%) TensorFlow
Miscellaneous
1 117 (34.82%) Algorithms
2 102 (30.36%) Cloud Native
3 21 (6.25%) Legacy Code
4 15 (4.46%) Public Cloud
5 4 (1.19%) Data Structures
6 3 (0.89%) Distributed Systems
6 3 (0.89%) Onboarding
7 1 (0.30%) Distributed Applications
7 1 (0.30%) Distributed Computing
Operating Systems
1 60 (17.86%) Unix
Processes & Methodologies
1 331 (98.51%) Software Engineering
2 325 (96.73%) Agile
3 302 (89.88%) SDLC
4 284 (84.52%) CI/CD
5 271 (80.65%) Operational Stability
6 165 (49.11%) Risk Management
7 153 (45.54%) Community of Practice
8 133 (39.58%) Artificial Intelligence
8 133 (39.58%) Machine Learning
9 122 (36.31%) Performance Tuning
10 115 (34.23%) Visualisation
11 110 (32.74%) Continuous Improvement
12 69 (20.54%) Problem-Solving
13 67 (19.94%) Coaching
13 67 (19.94%) Microservices
14 66 (19.64%) Mentoring
15 61 (18.15%) TDD
16 60 (17.86%) Batch Processing
16 60 (17.86%) Open Source
16 60 (17.86%) Test Automation
Programming Languages
1 234 (69.64%) SQL
2 218 (64.88%) Java
3 168 (50.00%) Scala
4 162 (48.21%) Python
5 60 (17.86%) PL/SQL
6 4 (1.19%) Bash
6 4 (1.19%) Go
7 1 (0.30%) C++
7 1 (0.30%) R
Qualifications
1 3 (0.89%) Degree
1 3 (0.89%) PhD
Quality Assurance & Compliance
1 15 (4.46%) Data Quality
2 14 (4.17%) SLA
System Software
1 60 (17.86%) HDFS
Systems Management
1 60 (17.86%) Terraform
2 40 (11.90%) Kubernetes
Vendors
1 80 (23.81%) Databricks
2 60 (17.86%) Informatica
3 30 (8.93%) Cloudera
4 8 (2.38%) Google
5 4 (1.19%) Dell
6 1 (0.30%) Microsoft
6 1 (0.30%) Oracle
6 1 (0.30%) Teradata