Period
to 31 March 2020

The following table provides summary statistics for permanent job vacancies advertised in the West Midlands with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 31 March 2020 with a comparison to the same period in the previous 2 years.

Apache Spark
England > West Midlands
6 months to
31 Mar 2020
Same period 2019 Same period 2018
Rank 214 266 298
Rank change year-on-year +52 +32 -55
Permanent jobs citing Apache Spark 36 25 26
As % of all permanent jobs advertised in the West Midlands 0.58% 0.32% 0.26%
As % of the Application Platforms category 4.30% 2.23% 1.67%
Number of salaries quoted 39 12 25
Median annual salary £55,000 £32,500 £60,000
Median salary % change year-on-year +69.23% -45.83% -
10th Percentile £45,000 £24,250 £42,000
90th Percentile £63,900 £77,375 £81,250
England median annual salary £72,500 £75,000 £70,000
% change year-on-year -3.33% +7.14% +3.70%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the West Midlands with a requirement for application platform skills.

All Application Platform Skills
West Midlands
Permanent vacancies with a requirement for application platform skills 837 1,123 1,554
As % of all permanent IT jobs advertised in the West Midlands 13.60% 14.18% 15.65%
Number of salaries quoted 692 853 1,215
Median annual salary £45,000 £42,500 £40,000
Median salary % change year-on-year +5.88% +6.25% +6.67%
10th Percentile £26,250 £25,800 £25,000
90th Percentile £67,500 £65,000 £60,000
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +6.38%

Apache Spark
Job Vacancy Trend in the West Midlands

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the West Midlands.

Job vacancy trend for Apache Spark in the West Midlands

Apache Spark
Salary Trend in the West Midlands

3-month moving average salary quoted in jobs citing Apache Spark in the West Midlands.

Salary trend for Apache Spark in the West Midlands

Apache Spark
Salary Histogram in the West Midlands

Salary distribution for jobs citing Apache Spark in the West Midlands over the 6 months to 31 March 2020.

Salary histogram for Apache Spark in the West Midlands

Apache Spark
Job Locations in the West Midlands

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the West Midlands region over the 6 months to 31 March 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Birmingham +37 12 £60,000 +140.00% 2
Solihull - 8 £59,750 -
Coventry +19 6 £52,500 -34.38%
Warwickshire +6 4 £50,000 +25.00%
Worcestershire +23 3 £70,000 -3.45%
Shropshire - 3 £52,500 - 3
Apache Spark
England

For the 6 months to 31 March 2020, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the West Midlands region with a requirement for Apache Spark.

1 34 (94.44%) Hadoop
2 28 (77.78%) SQL
2 28 (77.78%) Big Data
3 25 (69.44%) AWS
4 23 (63.89%) Agile Software Development
5 20 (55.56%) Python
6 13 (36.11%) Kafka
6 13 (36.11%) Analytics
7 12 (33.33%) Machine Learning
7 12 (33.33%) Apache Hive
7 12 (33.33%) Algorithms
7 12 (33.33%) Software Engineering
8 11 (30.56%) Scala
8 11 (30.56%) Git (software)
8 11 (30.56%) Data Science
9 10 (27.78%) Data Structures
9 10 (27.78%) Azure
9 10 (27.78%) REST
9 10 (27.78%) Data Analytics
9 10 (27.78%) Elasticsearch
9 10 (27.78%) JIRA
9 10 (27.78%) Scrum
10 9 (25.00%) Data Modelling
10 9 (25.00%) Java
11 8 (22.22%) .NET
11 8 (22.22%) .NET Core
12 7 (19.44%) GDPR
12 7 (19.44%) GCP
12 7 (19.44%) Microservices
12 7 (19.44%) Public Cloud

Apache Spark
Co-occurring IT Skills in the West Midlands by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (27.78%) Elasticsearch
2 3 (8.33%) Apache
2 3 (8.33%) Apache Solr
3 1 (2.78%) JBoss
3 1 (2.78%) Oracle SOA Suite
3 1 (2.78%) WildFly
Applications
1 1 (2.78%) Microsoft Excel
Cloud Services
1 25 (69.44%) AWS
2 10 (27.78%) Azure
3 7 (19.44%) GCP
3 7 (19.44%) PaaS
4 6 (16.67%) Amazon SageMaker
5 3 (8.33%) SaaS
6 1 (2.78%) Amazon EMR
6 1 (2.78%) Amazon Kinesis
6 1 (2.78%) Amazon S3
6 1 (2.78%) Microsoft Flow
6 1 (2.78%) Power Platform
6 1 (2.78%) PowerApps
Communications & Networking
1 5 (13.89%) 3G
1 5 (13.89%) 4G
1 5 (13.89%) 5G
1 5 (13.89%) Wi-Fi
2 3 (8.33%) SSL
3 2 (5.56%) LTE
3 2 (5.56%) WLAN
Database & Business Intelligence
1 34 (94.44%) Hadoop
2 28 (77.78%) Big Data
3 12 (33.33%) Apache Hive
4 6 (16.67%) Relational Database
5 4 (11.11%) Apache Cassandra
5 4 (11.11%) HBase
5 4 (11.11%) Impala
5 4 (11.11%) NoSQL
6 3 (8.33%) Data Warehouse
6 3 (8.33%) MongoDB
6 3 (8.33%) MySQL
6 3 (8.33%) Neo4j
6 3 (8.33%) Pentaho
6 3 (8.33%) PostgreSQL
7 2 (5.56%) Apache Accumulo
7 2 (5.56%) Data Lake
7 2 (5.56%) SQL Server
7 2 (5.56%) Sqoop
8 1 (2.78%) IBM InfoSphere
8 1 (2.78%) OrientDB
Development Applications
1 11 (30.56%) Git (software)
2 10 (27.78%) JIRA
3 7 (19.44%) Moq
4 4 (11.11%) git-flow
4 4 (11.11%) Subversion
5 3 (8.33%) Jenkins
6 2 (5.56%) Atlassian Bamboo
6 2 (5.56%) Maven
7 1 (2.78%) JBehave
7 1 (2.78%) JUnit
7 1 (2.78%) Mercurial
7 1 (2.78%) Mockito
7 1 (2.78%) Visual Studio Team System
General
1 5 (13.89%) Automotive
2 4 (11.11%) Electronics
2 4 (11.11%) Games
3 2 (5.56%) Finance
3 2 (5.56%) Telecoms
4 1 (2.78%) Banking
4 1 (2.78%) Publishing
4 1 (2.78%) Retail
Job Titles
1 15 (41.67%) Data Engineer
2 10 (27.78%) Software Engineer
3 9 (25.00%) Developer
4 7 (19.44%) Senior Software Engineer
5 6 (16.67%) Python Engineer
6 5 (13.89%) Senior Developer
7 4 (11.11%) Big Data Engineer
7 4 (11.11%) Developer/Software Engineer
7 4 (11.11%) Java Developer
7 4 (11.11%) Senior Software Developer
7 4 (11.11%) Software Developer
8 3 (8.33%) Big Data Software Engineer
8 3 (8.33%) Cybersecurity Engineer
8 3 (8.33%) Security Engineer
9 2 (5.56%) Architect
9 2 (5.56%) Big Data Architect
9 2 (5.56%) Big Data Solutions Architect
9 2 (5.56%) Data Architect
9 2 (5.56%) Principal Engineer
9 2 (5.56%) Principal Systems Engineer
Libraries, Frameworks & Software Standards
1 13 (36.11%) Kafka
2 10 (27.78%) REST
3 8 (22.22%) .NET
3 8 (22.22%) .NET Core
4 7 (19.44%) ASP.NET
4 7 (19.44%) Play Framework
5 6 (16.67%) MLlib
5 6 (16.67%) PySpark
5 6 (16.67%) scikit-learn
6 4 (11.11%) .NET Framework
6 4 (11.11%) Entity Framework
6 4 (11.11%) HTML
7 3 (8.33%) Spring
8 2 (5.56%) Hibernate
8 2 (5.56%) JSON
8 2 (5.56%) RESTful
8 2 (5.56%) Spring Boot
8 2 (5.56%) Web Services
8 2 (5.56%) XML
9 1 (2.78%) Natural Language Processing
Miscellaneous
1 12 (33.33%) Algorithms
2 10 (27.78%) Data Structures
3 7 (19.44%) Public Cloud
4 6 (16.67%) Analytical Skills
5 5 (13.89%) PKI
6 2 (5.56%) Greenfield Project
7 1 (2.78%) Mobile Banking
7 1 (2.78%) Self-Motivation
7 1 (2.78%) User Experience
Operating Systems
1 2 (5.56%) Linux
2 1 (2.78%) Windows
Processes & Methodologies
1 23 (63.89%) Agile Software Development
2 13 (36.11%) Analytics
3 12 (33.33%) Machine Learning
3 12 (33.33%) Software Engineering
4 11 (30.56%) Data Science
5 10 (27.78%) Data Analytics
5 10 (27.78%) Scrum
6 9 (25.00%) Data Modelling
7 7 (19.44%) Architectural Design
7 7 (19.44%) Artificial Intelligence
7 7 (19.44%) Microservices
8 6 (16.67%) Configuration Management
8 6 (16.67%) Systems Engineering
8 6 (16.67%) TDD
9 5 (13.89%) Business Intelligence
9 5 (13.89%) Continuous Deployment
9 5 (13.89%) DevOps
9 5 (13.89%) Mentoring
9 5 (13.89%) Telematics
9 5 (13.89%) V-Model
Programming Languages
1 28 (77.78%) SQL
2 20 (55.56%) Python
3 11 (30.56%) Scala
4 9 (25.00%) Java
5 7 (19.44%) C#
6 3 (8.33%) Bash Shell
6 3 (8.33%) C++
6 3 (8.33%) HiveQL
6 3 (8.33%) JavaScript
7 1 (2.78%) C
7 1 (2.78%) Java 8
7 1 (2.78%) MATLAB
7 1 (2.78%) R
7 1 (2.78%) T-SQL
7 1 (2.78%) VBA
Qualifications
1 3 (8.33%) Security Cleared
2 2 (5.56%) Degree
2 2 (5.56%) SC Cleared
3 1 (2.78%) DV Cleared
Quality Assurance & Compliance
1 7 (19.44%) GDPR
2 3 (8.33%) ISO 26262
3 1 (2.78%) Data Quality
System Software
1 4 (11.11%) HDFS
2 3 (8.33%) Apache ZooKeeper
3 1 (2.78%) Apache Flume
3 1 (2.78%) Docker
Systems Management
1 2 (5.56%) Ansible
1 2 (5.56%) Puppet
1 2 (5.56%) Salt
2 1 (2.78%) Hadoop YARN
2 1 (2.78%) Mesos
2 1 (2.78%) Oozie
Vendors
1 7 (19.44%) Google
2 5 (13.89%) Oracle
3 3 (8.33%) Cloudera
3 3 (8.33%) Splunk
4 1 (2.78%) Apple
4 1 (2.78%) IBM
4 1 (2.78%) Informatica
4 1 (2.78%) Microsoft
4 1 (2.78%) RapidMiner
4 1 (2.78%) Salesforce.com
4 1 (2.78%) StreamSets
4 1 (2.78%) Talend