Period
to 18 November 2019

The following table provides summary statistics for permanent job vacancies advertised in the East Midlands with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 18 November 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
England > East Midlands
6 months to
18 Nov 2019
Same period 2018 Same period 2017
Rank 119 147 207
Rank change year-on-year +28 +60 +37
Permanent jobs citing Apache Spark 84 80 21
As % of all permanent IT jobs advertised in the East Midlands 2.13% 1.73% 0.41%
As % of the Application Platforms category 15.27% 10.50% 2.55%
Number of salaries quoted 82 65 21
East Midlands median annual salary £72,500 £75,000 £42,500
Median salary % change year-on-year -3.33% +76.47% -5.56%
10th Percentile £56,250 £46,000 £32,000
90th Percentile £84,500 £110,000 £56,250
England median annual salary £72,500 £72,500 £67,000
% change year-on-year - +8.21% -0.74%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the East Midlands with a requirement for application platform skills.

All Application Platform Skills
East Midlands
Permanent vacancies with a requirement for application platform skills 550 762 824
As % of all permanent IT jobs advertised in the East Midlands 13.92% 16.53% 15.93%
Number of salaries quoted 478 602 654
East Midlands median annual salary £42,500 £42,500 £40,000
Median salary % change year-on-year - +6.25% -
10th Percentile £26,000 £26,250 £24,475
90th Percentile £74,125 £73,625 £61,000
England median annual salary £50,000 £50,000 £47,500
% change year-on-year - +5.26% +4.40%

Apache Spark
Job Vacancy Trend in the East Midlands

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the East Midlands.

Job vacancy trend for Apache Spark in the East Midlands

Apache Spark
Salary Trend in the East Midlands

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the East Midlands.

Salary trend for Apache Spark in the East Midlands

Apache Spark
Salary Histogram in the East Midlands

The salary distribution of IT jobs citing Apache Spark in the East Midlands over the 6 months to 18 November 2019.

Salary histogram for Apache Spark in the East Midlands

Apache Spark
Job Locations in the East Midlands

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the East Midlands region over the 6 months to 18 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Nottinghamshire +13 77 £72,500 -3.33% 5
Leicestershire - 3 £55,000 - 3
Northamptonshire +14 2 - -
Derbyshire - 2 £76,250 -
Apache Spark
England

For the 6 months to 18 November 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the East Midlands region with a requirement for Apache Spark.

1 79 (94.05%) Hadoop
2 77 (91.67%) Big Data
3 75 (89.29%) Java
4 74 (88.10%) Agile Software Development
5 73 (86.90%) HBase
6 59 (70.24%) Scala
6 59 (70.24%) Apache Hive
7 58 (69.05%) Impala
8 54 (64.29%) MapReduce
9 21 (25.00%) Analytics
10 20 (23.81%) Azure
11 18 (21.43%) AWS
12 16 (19.05%) GCP
13 15 (17.86%) Google
13 15 (17.86%) Finance
14 14 (16.67%) Software Engineering
14 14 (16.67%) C++
14 14 (16.67%) Problem-Solving
15 12 (14.29%) Flink
15 12 (14.29%) Elasticsearch
15 12 (14.29%) Computer Science
16 11 (13.10%) Kafka
17 10 (11.90%) Public Cloud
17 10 (11.90%) SQL
17 10 (11.90%) Web Services
17 10 (11.90%) Degree
17 10 (11.90%) Open Source
18 9 (10.71%) Computer Science Degree
19 7 (8.33%) Technical Leadership
19 7 (8.33%) Linux

Apache Spark
Co-occurring IT Skills in the East Midlands by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 12 (14.29%) Elasticsearch
2 2 (2.38%) Apache
3 1 (1.19%) Oracle Workflow
3 1 (1.19%) SAS
Cloud Services
1 20 (23.81%) Azure
2 18 (21.43%) AWS
3 16 (19.05%) GCP
4 3 (3.57%) Power Platform
5 2 (2.38%) Azure Machine Learning
5 2 (2.38%) Cloud Computing
5 2 (2.38%) IaaS
5 2 (2.38%) PaaS
5 2 (2.38%) SaaS
6 1 (1.19%) Amazon EMR
6 1 (1.19%) Azure Data Factory
Database & Business Intelligence
1 79 (94.05%) Hadoop
2 77 (91.67%) Big Data
3 73 (86.90%) HBase
4 59 (70.24%) Apache Hive
5 58 (69.05%) Impala
6 12 (14.29%) Flink
7 5 (5.95%) SQL Server
8 3 (3.57%) Azure SQL Data Warehouse
8 3 (3.57%) Data Warehouse
8 3 (3.57%) Power BI
8 3 (3.57%) SQL Server 2012
8 3 (3.57%) SQL Server Analysis Services
8 3 (3.57%) SQL Server Integration Services
8 3 (3.57%) SQL Server Reporting Services
9 2 (2.38%) Relational Database
9 2 (2.38%) Spark SQL
10 1 (1.19%) BigQuery
10 1 (1.19%) Couchbase
10 1 (1.19%) Data Mining
10 1 (1.19%) QlikView
Development Applications
1 4 (4.76%) Atlassian Bamboo
1 4 (4.76%) Git (software)
1 4 (4.76%) GitLab
1 4 (4.76%) Gradle
1 4 (4.76%) Jenkins
2 2 (2.38%) Team Foundation Server
General
1 15 (17.86%) Finance
2 1 (1.19%) Banking
Job Titles
1 55 (65.48%) Developer
2 51 (60.71%) Java Developer
3 47 (55.95%) Agile Developer
3 47 (55.95%) Agile Java Developer
4 20 (23.81%) Big Data Developer
5 18 (21.43%) Senior Developer
5 18 (21.43%) Senior Java Developer
6 17 (20.24%) Senior Agile Developer
6 17 (20.24%) Senior Agile Java Developer
6 17 (20.24%) Senior Big Data Developer
7 11 (13.10%) Big Data Engineer
7 11 (13.10%) Software Engineer
8 9 (10.71%) Java Engineer
8 9 (10.71%) Java Software Engineer
9 6 (7.14%) Lead Software Engineer
10 5 (5.95%) Big Data Software Engineer
10 5 (5.95%) Data Engineer
10 5 (5.95%) Senior Java Engineer
10 5 (5.95%) Senior Java Software Engineer
10 5 (5.95%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 11 (13.10%) Kafka
2 10 (11.90%) Web Services
3 2 (2.38%) Keras
3 2 (2.38%) React
3 2 (2.38%) TensorFlow
3 2 (2.38%) Theano
4 1 (1.19%) .NET
4 1 (1.19%) .NET Core
4 1 (1.19%) Apache NiFi
4 1 (1.19%) Dask
4 1 (1.19%) JMX
4 1 (1.19%) MDX
Miscellaneous
1 10 (11.90%) Public Cloud
2 6 (7.14%) Analytical Skills
2 6 (7.14%) Self-Motivation
3 4 (4.76%) Algorithms
4 2 (2.38%) Credit Risk
4 2 (2.38%) CUDA
4 2 (2.38%) Hybrid Cloud
5 1 (1.19%) Cloud Native
5 1 (1.19%) Embedded Systems
5 1 (1.19%) Virtual Team
Operating Systems
1 7 (8.33%) Linux
2 4 (4.76%) Unix
Processes & Methodologies
1 74 (88.10%) Agile Software Development
2 54 (64.29%) MapReduce
3 21 (25.00%) Analytics
4 14 (16.67%) Problem-Solving
4 14 (16.67%) Software Engineering
5 12 (14.29%) Computer Science
6 10 (11.90%) Open Source
7 7 (8.33%) Technical Leadership
7 7 (8.33%) Test Automation
7 7 (8.33%) Unit Testing
8 6 (7.14%) Machine Learning
8 6 (7.14%) Performance Tuning
8 6 (7.14%) Validation
9 5 (5.95%) Data Analytics
9 5 (5.95%) Low Latency
9 5 (5.95%) Mentoring
9 5 (5.95%) Scrum
10 4 (4.76%) Deployment Automation
10 4 (4.76%) Functional Programming
10 4 (4.76%) Integration Testing
Programming Languages
1 75 (89.29%) Java
2 59 (70.24%) Scala
3 14 (16.67%) C++
4 10 (11.90%) SQL
5 6 (7.14%) C#
5 6 (7.14%) Python
6 3 (3.57%) Data Analysis Expressions (DAX)
6 3 (3.57%) R
7 2 (2.38%) C
8 1 (1.19%) Java 8
8 1 (1.19%) T-SQL
8 1 (1.19%) VBA
Qualifications
1 10 (11.90%) Degree
2 9 (10.71%) Computer Science Degree
Quality Assurance & Compliance
1 3 (3.57%) Data Quality
1 3 (3.57%) GDPR
2 1 (1.19%) IFRS
2 1 (1.19%) IFRS 9
2 1 (1.19%) PMO
System Software
1 2 (2.38%) Apache ZooKeeper
1 2 (2.38%) HDFS
Systems Management
1 5 (5.95%) Oozie
2 4 (4.76%) Puppet
3 1 (1.19%) Grafana
3 1 (1.19%) Prometheus
Vendors
1 15 (17.86%) Google
2 3 (3.57%) Databricks
2 3 (3.57%) Oracle
3 1 (1.19%) Ab Initio
3 1 (1.19%) Confluent
3 1 (1.19%) Hyperion
3 1 (1.19%) Microsoft
3 1 (1.19%) SAP
3 1 (1.19%) SolarWinds
3 1 (1.19%) Teradata