Period
to 4 June 2020

The following table provides summary statistics for permanent job vacancies advertised in the South West with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 4 June 2020 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South West
6 months to
4 Jun 2020
Same period 2019 Same period 2018
Rank 210 197 247
Rank change year-on-year -13 +50 +4
Permanent jobs citing Apache Spark 28 137 101
As % of all permanent jobs advertised in the South West 0.50% 1.40% 0.95%
As % of the Application Platforms category 3.28% 9.08% 5.75%
Number of salaries quoted 11 109 83
Median annual salary £50,000 £55,000 £52,500
Median salary % change year-on-year -9.09% +4.76% -4.55%
10th Percentile £45,000 £40,846 £35,000
90th Percentile £78,750 £73,749 £70,000
England median annual salary £75,000 £75,000 £72,500
% change year-on-year - +3.45% +7.41%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South West with a requirement for application platform skills.

All Application Platform Skills
South West
Permanent vacancies with a requirement for application platform skills 853 1,509 1,756
As % of all permanent IT jobs advertised in the South West 15.29% 15.44% 16.50%
Number of salaries quoted 690 1,200 1,389
Median annual salary £45,000 £42,500 £40,000
Median salary % change year-on-year +5.88% +6.25% -
10th Percentile £27,750 £27,000 £26,250
90th Percentile £70,000 £61,250 £60,750
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +5.26%

Apache Spark
Job Vacancy Trend in the South West

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the South West.

Job vacancy trend for Apache Spark in the South West

Apache Spark
Salary Trend in the South West

3-month moving average salary quoted in jobs citing Apache Spark in the South West.

Salary trend for Apache Spark in the South West

Apache Spark
Salary Histogram in the South West

Salary distribution for jobs citing Apache Spark in the South West over the 6 months to 4 June 2020.

Salary histogram for Apache Spark in the South West

Apache Spark
Job Locations in the South West

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South West region over the 6 months to 4 June 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Bristol +38 13 £50,000 -9.09%
Wiltshire +24 12 £72,500 +17.28% 1
Gloucestershire -39 2 £44,500 -19.09%
Somerset +21 1 £65,000 -27.78%
Apache Spark
England

For the 6 months to 4 June 2020, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South West region with a requirement for Apache Spark.

1 24 (85.71%) Python
1 24 (85.71%) Hadoop
1 24 (85.71%) Big Data
2 20 (71.43%) Analytics
3 19 (67.86%) Docker
4 18 (64.29%) R
5 16 (57.14%) Agile Software Development
6 14 (50.00%) Scala
7 13 (46.43%) Analytical Skills
8 12 (42.86%) Project Delivery
8 12 (42.86%) Apache Hive
8 12 (42.86%) Machine Learning
8 12 (42.86%) Jenkins
8 12 (42.86%) Data Warehouse
8 12 (42.86%) SQL
9 11 (39.29%) Finance
9 11 (39.29%) Scrum
9 11 (39.29%) Teradata
10 10 (35.71%) Stakeholder Management
10 10 (35.71%) Kanban
10 10 (35.71%) Data Lake
10 10 (35.71%) DevOps
11 9 (32.14%) Data Strategy
11 9 (32.14%) Security Cleared
11 9 (32.14%) Cucumber
11 9 (32.14%) Continuous Improvement
11 9 (32.14%) Business Intelligence
11 9 (32.14%) Informatica
12 8 (28.57%) Artificial Intelligence
12 8 (28.57%) HBase

Apache Spark
Co-occurring IT Skills in the South West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 3 (10.71%) Apache
2 2 (7.14%) Elasticsearch
3 1 (3.57%) Apache Airflow
3 1 (3.57%) GlassFish
3 1 (3.57%) Tomcat
Applications
1 1 (3.57%) Gephi
Cloud Services
1 8 (28.57%) Azure
2 3 (10.71%) GCP
3 2 (7.14%) AWS
4 1 (3.57%) Cloud Computing
4 1 (3.57%) GitHub
Communications & Networking
1 1 (3.57%) DNS
1 1 (3.57%) Ethernet
1 1 (3.57%) Firewall
1 1 (3.57%) HTTP
1 1 (3.57%) Intrusion Detection
1 1 (3.57%) MPLS
1 1 (3.57%) SSL
1 1 (3.57%) VPN
Database & Business Intelligence
1 24 (85.71%) Big Data
1 24 (85.71%) Hadoop
2 12 (42.86%) Apache Hive
2 12 (42.86%) Data Warehouse
3 10 (35.71%) Data Lake
4 8 (28.57%) Apache Cassandra
4 8 (28.57%) HBase
5 7 (25.00%) KNIME
5 7 (25.00%) MongoDB
5 7 (25.00%) SQL Server
5 7 (25.00%) SQL Server 2016
5 7 (25.00%) SQL Server 2017
6 4 (14.29%) Amazon Redshift
7 3 (10.71%) BigQuery
8 2 (7.14%) Bigtable
8 2 (7.14%) Impala
8 2 (7.14%) Looker
8 2 (7.14%) MySQL
8 2 (7.14%) Oracle Reports
8 2 (7.14%) Relational Database
Development Applications
1 12 (42.86%) Jenkins
2 9 (32.14%) Cucumber
3 3 (10.71%) Git (software)
4 1 (3.57%) Bitbucket
4 1 (3.57%) Bitbucket Server
4 1 (3.57%) git-flow
4 1 (3.57%) IBM UrbanCode
4 1 (3.57%) JIRA
4 1 (3.57%) Maven
4 1 (3.57%) Sonatype Nexus
4 1 (3.57%) Visual Studio
General
1 11 (39.29%) Finance
2 7 (25.00%) Aerospace
3 2 (7.14%) Automotive
3 2 (7.14%) Public Sector
3 2 (7.14%) Retail
4 1 (3.57%) Games
4 1 (3.57%) Legal
Job Titles
1 21 (75.00%) Data Engineer
2 3 (10.71%) Hadoop Engineer
3 2 (7.14%) Big Data Engineer
3 2 (7.14%) Cloud Engineer
4 1 (3.57%) Analyst
4 1 (3.57%) Architect
4 1 (3.57%) Consultant
4 1 (3.57%) Data Analyst
4 1 (3.57%) Data Science Analyst
4 1 (3.57%) Developer
4 1 (3.57%) Lead Architect
4 1 (3.57%) Machine Learning Engineer
4 1 (3.57%) Python Developer
4 1 (3.57%) Python Engineer
4 1 (3.57%) Senior Developer
4 1 (3.57%) Senior Python Developer
4 1 (3.57%) Software Consultant
4 1 (3.57%) Software Engineer
4 1 (3.57%) Solutions Architect
4 1 (3.57%) Solutions Consultant
Libraries, Frameworks & Software Standards
1 4 (14.29%) Kafka
2 2 (7.14%) Node.js
3 1 (3.57%) AngularJS
3 1 (3.57%) CSS
3 1 (3.57%) CSS3
3 1 (3.57%) Django
3 1 (3.57%) Elastic Stack
3 1 (3.57%) HTML
3 1 (3.57%) HTML5
3 1 (3.57%) KnockoutJS
3 1 (3.57%) NumPy
3 1 (3.57%) Pandas
3 1 (3.57%) RabbitMQ
3 1 (3.57%) React
3 1 (3.57%) Samza
Miscellaneous
1 13 (46.43%) Analytical Skills
2 1 (3.57%) Analytical Mindset
2 1 (3.57%) Blog
2 1 (3.57%) Cyber Kill Chain
2 1 (3.57%) Management Information System
2 1 (3.57%) NHS
2 1 (3.57%) Social Media
2 1 (3.57%) User Experience
Operating Systems
1 1 (3.57%) Android
1 1 (3.57%) Apple iOS
1 1 (3.57%) Linux
1 1 (3.57%) Windows
Processes & Methodologies
1 20 (71.43%) Analytics
2 16 (57.14%) Agile Software Development
3 12 (42.86%) Machine Learning
3 12 (42.86%) Project Delivery
4 11 (39.29%) Scrum
5 10 (35.71%) DevOps
5 10 (35.71%) Kanban
5 10 (35.71%) Stakeholder Management
6 9 (32.14%) Business Intelligence
6 9 (32.14%) Continuous Improvement
6 9 (32.14%) Data Strategy
7 8 (28.57%) Artificial Intelligence
8 7 (25.00%) Business Analytics
8 7 (25.00%) Data Analytics
9 5 (17.86%) Data Science
9 5 (17.86%) Software Engineering
9 5 (17.86%) Visualisation
10 3 (10.71%) ETL
11 2 (7.14%) Computer Science
11 2 (7.14%) Validation
Programming Languages
1 24 (85.71%) Python
2 18 (64.29%) R
3 14 (50.00%) Scala
4 12 (42.86%) SQL
5 8 (28.57%) Perl
6 5 (17.86%) Java
7 3 (10.71%) C
8 2 (7.14%) C#
8 2 (7.14%) Go
9 1 (3.57%) Apple Swift
9 1 (3.57%) Bash Shell
9 1 (3.57%) C++
9 1 (3.57%) JavaScript
9 1 (3.57%) Objective-C
Qualifications
1 9 (32.14%) Security Cleared
2 7 (25.00%) SC Cleared
3 3 (10.71%) Degree
4 2 (7.14%) Computer Science Degree
4 2 (7.14%) DV Cleared
5 1 (3.57%) CCNA
5 1 (3.57%) CEH
5 1 (3.57%) Cisco Certification
5 1 (3.57%) CISSP
5 1 (3.57%) CompTIA Security+
5 1 (3.57%) GIAC
5 1 (3.57%) Linux+ Certification
5 1 (3.57%) MCSE
5 1 (3.57%) Microsoft Certification
5 1 (3.57%) Network+ Certification
5 1 (3.57%) SANS
5 1 (3.57%) SSCP
System Software
1 19 (67.86%) Docker
2 1 (3.57%) Apache Flume
2 1 (3.57%) HDFS
Systems Management
1 3 (10.71%) Kubernetes
2 1 (3.57%) Hadoop YARN
2 1 (3.57%) Kibana
2 1 (3.57%) Oozie
2 1 (3.57%) Opscode Chef
Vendors
1 11 (39.29%) Teradata
2 9 (32.14%) Informatica
3 8 (28.57%) Splunk
4 7 (25.00%) Microsoft
5 2 (7.14%) Google
5 2 (7.14%) Oracle
5 2 (7.14%) Tableau
6 1 (3.57%) BT
6 1 (3.57%) Hortonworks
6 1 (3.57%) Netezza