Period
to 18 September 2021

The following table provides summary statistics for permanent job vacancies advertised in the South West with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 18 September 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South West
6 months to
18 Sep 2021
Same period 2020 Same period 2019
Rank 251 178 170
Rank change year-on-year -73 -8 +95
Permanent jobs citing Apache Spark 46 20 182
As % of all permanent jobs advertised in the South West 0.60% 0.59% 1.81%
As % of the Application Platforms category 4.34% 3.77% 11.47%
Number of salaries quoted 38 6 148
10th Percentile £46,250 £39,500 £42,125
25th Percentile £51,250 £45,750 £47,500
Median annual salary (50th Percentile) £61,108 £49,000 £55,000
Median % change year-on-year +24.71% -10.91% -8.33%
75th Percentile £81,250 £55,250 £67,250
90th Percentile £99,500 £57,000 £73,530
England median annual salary £77,500 £75,000 £75,000
% change year-on-year +3.33% - +7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South West with a requirement for application platform skills.

All Application Platform Skills
South West
Permanent vacancies with a requirement for application platform skills 1,060 531 1,587
As % of all permanent IT jobs advertised in the South West 13.88% 15.72% 15.80%
Number of salaries quoted 669 447 1,240
10th Percentile £27,500 £29,000 £27,500
25th Percentile £34,000 £34,000 £32,688
Median annual salary (50th Percentile) £45,000 £42,500 £43,156
Median % change year-on-year +5.88% -1.52% +7.89%
75th Percentile £61,250 £55,125 £55,000
90th Percentile £72,500 £70,000 £66,250
England median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% -

Apache Spark
Job Vacancy Trend in the South West

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the South West.

Job vacancy trend for Apache Spark in the South West

Apache Spark
Salary Trend in the South West

3-month moving average salary quoted in jobs citing Apache Spark in the South West.

Salary trend for Apache Spark in the South West

Apache Spark
Salary Histogram in the South West

Salary distribution for jobs citing Apache Spark in the South West over the 6 months to 18 September 2021.

Salary histogram for Apache Spark in the South West

Apache Spark
Job Locations in the South West

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South West region over the 6 months to 18 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Bristol -69 36 £62,216 +30.98% 1
Gloucestershire - 6 £56,000 -
Wiltshire -10 2 £65,000 +28.71%
Somerset - 2 £61,250 -
Apache Spark
England

For the 6 months to 18 September 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South West region with a requirement for Apache Spark.

1 39 (84.78%) Python
2 32 (69.57%) SQL
3 29 (63.04%) Agile Software Development
4 24 (52.17%) Java
4 24 (52.17%) Analytics
5 22 (47.83%) Machine Learning
5 22 (47.83%) Social Skills
6 21 (45.65%) DevOps
6 21 (45.65%) Analytical Skills
6 21 (45.65%) Hadoop
7 20 (43.48%) Scala
7 20 (43.48%) Big Data
8 19 (41.30%) Retail
9 18 (39.13%) Degree
10 17 (36.96%) Kafka
10 17 (36.96%) AWS
10 17 (36.96%) GCP
10 17 (36.96%) Databricks
11 16 (34.78%) Data Science
12 15 (32.61%) Google
13 14 (30.43%) Computer Science
14 13 (28.26%) R
15 12 (26.09%) Mathematics
15 12 (26.09%) Retail Banking
15 12 (26.09%) Banking
16 11 (23.91%) Software Engineering
16 11 (23.91%) ETL
16 11 (23.91%) Azure
16 11 (23.91%) Amazon SageMaker
16 11 (23.91%) SDLC

Apache Spark
Co-occurring IT Skills in the South West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (15.22%) Apache
2 5 (10.87%) Elasticsearch
3 4 (8.70%) Jupyter
4 2 (4.35%) SAS
5 1 (2.17%) Oracle Application Server
Cloud Services
1 17 (36.96%) AWS
1 17 (36.96%) GCP
2 11 (23.91%) Amazon SageMaker
2 11 (23.91%) Azure
3 8 (17.39%) Amazon Kinesis
3 8 (17.39%) Power Platform
4 6 (13.04%) Amazon S3
4 6 (13.04%) Azure Data Factory
5 4 (8.70%) Amazon SQS
5 4 (8.70%) Snowflake
6 2 (4.35%) Amazon EMR
6 2 (4.35%) Azure Functions
6 2 (4.35%) Azure Logic Apps
6 2 (4.35%) Azure Sentinel
6 2 (4.35%) Serverless
7 1 (2.17%) AWS CloudFormation
7 1 (2.17%) GitHub
7 1 (2.17%) Google Analytics
7 1 (2.17%) Slack
Communications & Networking
1 1 (2.17%) HTTP
Database & Business Intelligence
1 21 (45.65%) Hadoop
2 20 (43.48%) Big Data
3 10 (21.74%) Data Mining
4 9 (19.57%) Data Warehouse
5 8 (17.39%) Apache Hive
5 8 (17.39%) Power BI
6 6 (13.04%) Data Lake
6 6 (13.04%) NoSQL
7 4 (8.70%) Amazon DynamoDB
7 4 (8.70%) Azure SQL Data Warehouse
7 4 (8.70%) BigQuery
7 4 (8.70%) BusinessObjects
8 3 (6.52%) PostgreSQL
8 3 (6.52%) SQL Server
9 2 (4.35%) Amazon RDS
9 2 (4.35%) Amazon Redshift
9 2 (4.35%) DataStage
9 2 (4.35%) MySQL
10 1 (2.17%) Oracle Database 12c
10 1 (2.17%) Oracle ODI
Development Applications
1 5 (10.87%) Jenkins
2 2 (4.35%) Git (software)
3 1 (2.17%) Atlassian Bamboo
3 1 (2.17%) CircleCI
3 1 (2.17%) GoCD
3 1 (2.17%) Oracle APEX
General
1 22 (47.83%) Social Skills
2 21 (45.65%) Analytical Skills
3 19 (41.30%) Retail
4 12 (26.09%) Banking
4 12 (26.09%) Retail Banking
5 4 (8.70%) Finance
5 4 (8.70%) Influencing Skills
6 3 (6.52%) Marketing
7 2 (4.35%) Czech Language
Job Titles
1 21 (45.65%) Data Engineer
2 11 (23.91%) Data Scientist
3 8 (17.39%) Big Data Engineer
4 7 (15.22%) Senior Data Engineer
5 5 (10.87%) Software Engineer
6 4 (8.70%) Analyst
6 4 (8.70%) Big Data Software Engineer
6 4 (8.70%) Data Analyst
6 4 (8.70%) Developer
6 4 (8.70%) Java Developer
6 4 (8.70%) Senior Software Engineer
7 3 (6.52%) Head of Data Science
8 2 (4.35%) Azure Engineer
8 2 (4.35%) Head of Analytics
8 2 (4.35%) Head of Marketing
8 2 (4.35%) Implementation Analyst
8 2 (4.35%) Implementation Manager
8 2 (4.35%) Machine Learning Engineer
8 2 (4.35%) Python Engineer
8 2 (4.35%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 17 (36.96%) Kafka
2 10 (21.74%) Keras
2 10 (21.74%) MLlib
2 10 (21.74%) TensorFlow
3 8 (17.39%) Apache Beam
4 6 (13.04%) Node.js
4 6 (13.04%) Spring Boot
5 4 (8.70%) Play Framework
5 4 (8.70%) RabbitMQ
5 4 (8.70%) Spring
6 2 (4.35%) GraphQL
6 2 (4.35%) PyTorch
7 1 (2.17%) .NET
7 1 (2.17%) Akka
7 1 (2.17%) JSON
7 1 (2.17%) Oracle GoldenGate
7 1 (2.17%) XML
Miscellaneous
1 10 (21.74%) Algorithms
2 4 (8.70%) Self-Motivation
3 2 (4.35%) Mainframe
Processes & Methodologies
1 29 (63.04%) Agile Software Development
2 24 (52.17%) Analytics
3 22 (47.83%) Machine Learning
4 21 (45.65%) DevOps
5 16 (34.78%) Data Science
6 14 (30.43%) Computer Science
7 12 (26.09%) Mathematics
8 11 (23.91%) ETL
8 11 (23.91%) SDLC
8 11 (23.91%) Software Engineering
9 10 (21.74%) Waterfall
10 9 (19.57%) Business Intelligence
10 9 (19.57%) Collaborative Filtering
10 9 (19.57%) Continuous Integration
10 9 (19.57%) Gradient Boosting
10 9 (19.57%) Kalman Filter
10 9 (19.57%) Random Forest
11 8 (17.39%) Data Engineering
11 8 (17.39%) Data Pipeline
11 8 (17.39%) Data Transformation
Programming Languages
1 39 (84.78%) Python
2 32 (69.57%) SQL
3 24 (52.17%) Java
4 20 (43.48%) Scala
5 13 (28.26%) R
6 4 (8.70%) HiveQL
7 3 (6.52%) C++
8 1 (2.17%) C#
8 1 (2.17%) Clojure
8 1 (2.17%) F#
8 1 (2.17%) PL/SQL
Qualifications
1 18 (39.13%) Degree
2 2 (4.35%) Computer Science Degree
Quality Assurance & Compliance
1 5 (10.87%) Data Quality
System Software
1 8 (17.39%) Apache Flume
2 1 (2.17%) Docker
Systems Management
1 5 (10.87%) Terraform
2 4 (8.70%) Ansible
3 2 (4.35%) Kubernetes
Vendors
1 17 (36.96%) Databricks
2 15 (32.61%) Google
3 6 (13.04%) IBM
3 6 (13.04%) Teradata
4 5 (10.87%) Microsoft
4 5 (10.87%) Oracle
5 4 (8.70%) Pega
5 4 (8.70%) Salesforce.com
5 4 (8.70%) SAP
6 2 (4.35%) MicroStrategy