Period
to 21 March 2019

The following table provides summary statistics for permanent job vacancies advertised in the East Midlands with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 21 March 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
England > East Midlands
6 months to
21 Mar 2019
Same period 2018 Same period 2017
Rank 161 198 204
Rank change year-on-year +37 +6 +41
Permanent jobs citing Apache Spark 47 43 41
As % of all permanent IT jobs advertised in the East Midlands 1.14% 0.81% 0.69%
As % of the Application Platforms category 6.74% 4.89% 4.34%
Number of salaries quoted 36 36 34
East Midlands median annual salary £75,000 £53,750 £42,500
Median salary % change year-on-year +39.53% +26.47% +13.33%
10th Percentile £36,250 £39,375 £23,350
90th Percentile £107,500 £106,250 £60,625
England median annual salary £75,000 £70,000 £67,500
% change year-on-year +7.14% +3.70% +3.85%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the East Midlands with a requirement for application platform skills.

All Application Platform Skills
East Midlands
Permanent vacancies with a requirement for application platform skills 697 880 945
As % of all permanent IT jobs advertised in the East Midlands 16.88% 16.53% 15.79%
Number of salaries quoted 500 726 697
East Midlands median annual salary £40,000 £40,000 £40,000
10th Percentile £24,750 £25,000 £24,150
90th Percentile £67,500 £60,000 £56,250
England median annual salary £50,000 £50,000 £47,000
% change year-on-year - +6.38% +4.44%

Apache Spark
Job Vacancy Trend in the East Midlands

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the East Midlands.

Job vacancy trend for Apache Spark in the East Midlands

Apache Spark
Salary Trend in the East Midlands

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the East Midlands.

Salary trend for Apache Spark in the East Midlands

Apache Spark
Salary Histogram in the East Midlands

The salary distribution of IT jobs citing Apache Spark in the East Midlands over the 6 months to 21 March 2019.

Salary histogram for Apache Spark in the East Midlands

Apache Spark
Job Locations in the East Midlands

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the East Midlands region over the 6 months to 21 March 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Nottinghamshire +42 33 £77,500 +40.91% 7
Northamptonshire +12 8 £69,250 -32.44% 2
Derbyshire +18 6 £37,500 -21.05% 3
Apache Spark
England

For the 6 months to 21 March 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the East Midlands region with a requirement for Apache Spark.

1 40 (85.11%) Hadoop
2 36 (76.60%) Big Data
3 35 (74.47%) Java
4 34 (72.34%) Agile Software Development
5 31 (65.96%) SQL
6 24 (51.06%) Apache Hive
6 24 (51.06%) HBase
7 23 (48.94%) Analytics
7 23 (48.94%) Degree
8 21 (44.68%) Finance
8 21 (44.68%) Impala
9 17 (36.17%) Computer Science
10 16 (34.04%) Scala
10 16 (34.04%) Amazon AWS
10 16 (34.04%) Software Engineering
11 14 (29.79%) MapReduce
12 12 (25.53%) Kafka
12 12 (25.53%) Test Automation
13 11 (23.40%) Continuous Integration
13 11 (23.40%) Performance Tuning
14 10 (21.28%) Problem-Solving
14 10 (21.28%) Technical Leadership
15 9 (19.15%) HDFS
15 9 (19.15%) Public Cloud
15 9 (19.15%) Python
16 8 (17.02%) JavaScript
16 8 (17.02%) C++
16 8 (17.02%) Unix
16 8 (17.02%) Git (software)
16 8 (17.02%) Oozie

Apache Spark
Co-occurring IT Skills in the East Midlands by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (14.89%) Elasticsearch
2 4 (8.51%) Apache
3 3 (6.38%) Apache Pig
4 1 (2.13%) Confluence
4 1 (2.13%) SAS
Applications
1 1 (2.13%) Chatbot
1 1 (2.13%) GNU Octave
Cloud Services
1 16 (34.04%) Amazon AWS
2 8 (17.02%) Google Cloud Platform
3 7 (14.89%) Microsoft Azure
4 1 (2.13%) Apigee
4 1 (2.13%) AWS Lambda
4 1 (2.13%) Cloud Computing
4 1 (2.13%) IBM Cloud
4 1 (2.13%) OpenShift
4 1 (2.13%) Serverless
Communications & Networking
1 1 (2.13%) Kerberos
Database & Business Intelligence
1 40 (85.11%) Hadoop
2 36 (76.60%) Big Data
3 24 (51.06%) Apache Hive
3 24 (51.06%) HBase
4 21 (44.68%) Impala
5 7 (14.89%) Apache Cassandra
5 7 (14.89%) NoSQL
6 5 (10.64%) Hazelcast
6 5 (10.64%) MySQL
6 5 (10.64%) PostgreSQL
6 5 (10.64%) Redis
7 4 (8.51%) Flink
8 2 (4.26%) Data Warehouse
8 2 (4.26%) Power BI
8 2 (4.26%) Spark SQL
8 2 (4.26%) Sqoop
9 1 (2.13%) MongoDB
9 1 (2.13%) SAP BW
9 1 (2.13%) SQL Server
9 1 (2.13%) Star Schema
Development Applications
1 8 (17.02%) Git (software)
2 6 (12.77%) Atlassian Bamboo
2 6 (12.77%) GitLab
2 6 (12.77%) Gradle
2 6 (12.77%) Jenkins
3 5 (10.64%) JUnit
4 1 (2.13%) Artifactory
4 1 (2.13%) Bitbucket
4 1 (2.13%) JIRA
General
1 21 (44.68%) Finance
2 1 (2.13%) Advertising
2 1 (2.13%) Banking
2 1 (2.13%) Marketing
Job Titles
1 29 (61.70%) Developer
2 17 (36.17%) Java Developer
3 13 (27.66%) Big Data Developer
4 11 (23.40%) Senior Big Data Developer
4 11 (23.40%) Senior Developer
5 7 (14.89%) Analytics Manager
6 6 (12.77%) Development Manager
7 5 (10.64%) Senior Java Developer
8 3 (6.38%) Hadoop Developer
8 3 (6.38%) Lead Developer
8 3 (6.38%) Lead Java Developer
9 2 (4.26%) Analytics Developer
9 2 (4.26%) Big Data Manager
9 2 (4.26%) Data Engineer
9 2 (4.26%) Java Engineer
9 2 (4.26%) Java Software Engineer
9 2 (4.26%) Software Engineer
10 1 (2.13%) Senior Architect
10 1 (2.13%) Senior Data Architect
10 1 (2.13%) Senior Java Engineer
Libraries, Frameworks & Software Standards
1 12 (25.53%) Kafka
2 5 (10.64%) AngularJS
2 5 (10.64%) CSS
2 5 (10.64%) Hibernate
2 5 (10.64%) HTML
2 5 (10.64%) HTML5
2 5 (10.64%) JPA
2 5 (10.64%) RabbitMQ
2 5 (10.64%) Spring
2 5 (10.64%) Spring Boot
2 5 (10.64%) Twitter Bootstrap
3 4 (8.51%) NumPy
3 4 (8.51%) Pandas
4 3 (6.38%) Apache NiFi
4 3 (6.38%) Elastic Stack
4 3 (6.38%) Spark Streaming
4 3 (6.38%) Web Services
5 2 (4.26%) HTML5 Canvas
5 2 (4.26%) Node.js
6 1 (2.13%) Natural Language Processing
Miscellaneous
1 9 (19.15%) Public Cloud
2 7 (14.89%) User Experience
3 6 (12.77%) Self-Motivation
4 5 (10.64%) Analytical Skills
5 4 (8.51%) Enterprise Software
6 1 (2.13%) Algorithms
6 1 (2.13%) Management Information System
6 1 (2.13%) Private Cloud
Operating Systems
1 8 (17.02%) Unix
2 7 (14.89%) Linux
Processes & Methodologies
1 34 (72.34%) Agile Software Development
2 23 (48.94%) Analytics
3 17 (36.17%) Computer Science
4 16 (34.04%) Software Engineering
5 14 (29.79%) MapReduce
6 12 (25.53%) Test Automation
7 11 (23.40%) Continuous Integration
7 11 (23.40%) Performance Tuning
8 10 (21.28%) Problem-Solving
8 10 (21.28%) Technical Leadership
9 6 (12.77%) Data Analysis
9 6 (12.77%) Deployment Automation
9 6 (12.77%) Functional Programming
9 6 (12.77%) Integration Testing
9 6 (12.77%) Unit Testing
9 6 (12.77%) Validation
10 5 (10.64%) Data Analytics
10 5 (10.64%) OO
10 5 (10.64%) Predictive Analytics
11 4 (8.51%) Machine Learning
Programming Languages
1 35 (74.47%) Java
2 31 (65.96%) SQL
3 16 (34.04%) Scala
4 9 (19.15%) Python
5 8 (17.02%) C++
5 8 (17.02%) JavaScript
6 5 (10.64%) Java 8
6 5 (10.64%) TypeScript
7 4 (8.51%) R
8 3 (6.38%) Ruby
9 1 (2.13%) C#
9 1 (2.13%) Go
9 1 (2.13%) MATLAB
Qualifications
1 23 (48.94%) Degree
2 7 (14.89%) Computer Science Degree
3 4 (8.51%) AWS Certification
4 3 (6.38%) Numerate Degree
Quality Assurance & Compliance
1 1 (2.13%) PMO
1 1 (2.13%) QA
System Software
1 9 (19.15%) HDFS
2 7 (14.89%) Apache Flume
3 1 (2.13%) Apache ZooKeeper
3 1 (2.13%) Docker
Systems Management
1 8 (17.02%) Oozie
2 6 (12.77%) Puppet
3 4 (8.51%) Hadoop YARN
4 3 (6.38%) Kibana
4 3 (6.38%) logstash
5 1 (2.13%) Kubernetes
Vendors
1 7 (14.89%) Google
2 2 (4.26%) Cloudera
2 2 (4.26%) Splunk
2 2 (4.26%) Tableau
3 1 (2.13%) Cisco
3 1 (2.13%) MapR
3 1 (2.13%) Reuters
3 1 (2.13%) SAP
3 1 (2.13%) ServiceNow