Period
to 25 June 2018

The following table provides summary statistics for permanent job vacancies advertised in the East Midlands with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 25 June 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
England > East Midlands
6 months to
25 Jun 2018
Same period 2017 Same period 2016
Rank 192 191 250
Rank change year-on-year -1 +59 +13
Permanent jobs citing Apache Spark 43 45 11
As % of all permanent IT jobs advertised in the East Midlands 0.83% 0.81% 0.17%
As % of the Application Platforms category 4.61% 4.92% 1.08%
Number of salaries quoted 39 38 6
East Midlands median annual salary £60,000 £42,500 £40,000
Median salary % change year-on-year +41.18% +6.25% -30.43%
10th Percentile £44,750 £30,000 £31,250
90th Percentile £106,250 £56,625 £72,500
England median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the East Midlands with a requirement for application platform skills.

All Application Platform Skills
East Midlands
Permanent vacancies with a requirement for application platform skills 933 915 1,018
As % of all permanent IT jobs advertised in the East Midlands 17.90% 16.44% 15.87%
Number of salaries quoted 792 698 773
East Midlands median annual salary £42,500 £40,000 £37,500
Median salary % change year-on-year +6.25% +6.67% -2.60%
10th Percentile £25,000 £22,500 £22,000
90th Percentile £61,250 £57,875 £55,000
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Apache Spark
Job Vacancy Trend in the East Midlands

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the East Midlands.

Job vacancy trend for Apache Spark in the East Midlands

Apache Spark
Salary Trend in the East Midlands

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the East Midlands.

Salary trend for Apache Spark in the East Midlands

Apache Spark
Salary Histogram in the East Midlands

The salary distribution of IT jobs citing Apache Spark in the East Midlands over the 6 months to 25 June 2018.

Salary histogram for Apache Spark in the East Midlands

Apache Spark
Job Locations in the East Midlands

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the East Midlands region over the 6 months to 25 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Nottinghamshire +16 21 £55,000 +4.76% 3
Northamptonshire - 12 £100,000 - 2
Derbyshire -31 7 £50,000 +17.65%
Apache Spark
England

For the 6 months to 25 June 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the East Midlands region with a requirement for Apache Spark.

1 36 (83.72%) Big Data
2 35 (81.40%) Hadoop
3 31 (72.09%) Agile Software Development
4 26 (60.47%) SQL
4 26 (60.47%) Data Warehouse
5 25 (58.14%) Java
6 23 (53.49%) Analytical Skills
7 17 (39.53%) Scala
8 15 (34.88%) Microsoft Azure
8 15 (34.88%) Business Intelligence
9 14 (32.56%) Problem-Solving
10 13 (30.23%) Data Engineering
10 13 (30.23%) Python
10 13 (30.23%) Data Modelling
10 13 (30.23%) SQL Server
11 12 (27.91%) Oracle
11 12 (27.91%) Data Management
12 11 (25.58%) HBase
12 11 (25.58%) Analytics
13 10 (23.26%) Talend
13 10 (23.26%) Cloudera
13 10 (23.26%) Amazon AWS
13 10 (23.26%) Microsoft
13 10 (23.26%) Informatica
14 9 (20.93%) Star Schema
14 9 (20.93%) Finance
14 9 (20.93%) Google
14 9 (20.93%) Open Source
14 9 (20.93%) NoSQL
14 9 (20.93%) Multithreading

Apache Spark
Co-occurring IT Skills in the East Midlands by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 6 (13.95%) SAS
2 1 (2.33%) Jetty
2 1 (2.33%) Tomcat
Applications
1 4 (9.30%) Microsoft Excel
Cloud Services
1 15 (34.88%) Microsoft Azure
2 10 (23.26%) Amazon AWS
3 9 (20.93%) Google Cloud Platform
3 9 (20.93%) IBM Cloud
4 4 (9.30%) Cloud Computing
Communications & Networking
1 2 (4.65%) Kerberos
2 1 (2.33%) TCP/IP
Database & Business Intelligence
1 36 (83.72%) Big Data
2 35 (81.40%) Hadoop
3 26 (60.47%) Data Warehouse
4 13 (30.23%) SQL Server
5 11 (25.58%) HBase
6 9 (20.93%) BigQuery
6 9 (20.93%) NoSQL
6 9 (20.93%) Star Schema
7 7 (16.28%) Data Mining
7 7 (16.28%) Oracle ODI
8 6 (13.95%) Oracle BI EE
8 6 (13.95%) Power BI
9 4 (9.30%) Apache Hive
9 4 (9.30%) Impala
9 4 (9.30%) Looker
9 4 (9.30%) SQL Server Analysis Services
9 4 (9.30%) SQL Server Integration Services
9 4 (9.30%) SQL Server Reporting Services
10 3 (6.98%) Pentaho
10 3 (6.98%) QlikView
General
1 9 (20.93%) Finance
2 7 (16.28%) Retail
3 6 (13.95%) Banking
3 6 (13.95%) Electronics
4 2 (4.65%) Investment Banking
4 2 (4.65%) Law
Job Titles
1 14 (32.56%) Developer
2 10 (23.26%) Big Data Developer
2 10 (23.26%) Java Developer
3 9 (20.93%) Data Engineer
3 9 (20.93%) Hadoop Developer
3 9 (20.93%) Java Hadoop Developer
4 7 (16.28%) Consultant
5 6 (13.95%) Big Data Engineer
5 6 (13.95%) OBIEE Consultant
6 5 (11.63%) Architect
7 4 (9.30%) Cloud Engineer
7 4 (9.30%) Data Architect
7 4 (9.30%) Head of Architecture
7 4 (9.30%) Head of Data Architecture
8 3 (6.98%) Senior Data Engineer
9 2 (4.65%) Apache Spark Developer
9 2 (4.65%) Java Scala Developer
9 2 (4.65%) Platform Manager
9 2 (4.65%) Scala Developer
10 1 (2.33%) C# Programmer
Libraries, Frameworks & Software Standards
1 7 (16.28%) JSON
1 7 (16.28%) XML
2 5 (11.63%) .NET
3 3 (6.98%) Kafka
4 2 (4.65%) Spark Streaming
5 1 (2.33%) .NET Framework
5 1 (2.33%) AngularJS
5 1 (2.33%) HTML
5 1 (2.33%) Node.js
5 1 (2.33%) React
Miscellaneous
1 23 (53.49%) Analytical Skills
2 8 (18.60%) Algorithms
3 6 (13.95%) Self-Motivation
4 4 (9.30%) Computer Science
4 4 (9.30%) Greenfield Project
5 1 (2.33%) Equities
5 1 (2.33%) Fintech
5 1 (2.33%) Fixed Income
5 1 (2.33%) Foreign Exchange (FX)
Operating Systems
1 6 (13.95%) Linux
2 2 (4.65%) Unix
Processes & Methodologies
1 31 (72.09%) Agile Software Development
2 15 (34.88%) Business Intelligence
3 14 (32.56%) Problem-Solving
4 13 (30.23%) Data Engineering
4 13 (30.23%) Data Modelling
5 12 (27.91%) Data Management
6 11 (25.58%) Analytics
7 9 (20.93%) Data Architecture
7 9 (20.93%) Multithreading
7 9 (20.93%) Open Source
8 8 (18.60%) Visualisation
9 7 (16.28%) Business Analytics
9 7 (16.28%) Data Integration
9 7 (16.28%) ETL
10 6 (13.95%) Integration Testing
10 6 (13.95%) MapReduce
10 6 (13.95%) Multithreaded Programming
10 6 (13.95%) Performance Testing
10 6 (13.95%) Scrum
10 6 (13.95%) Unit Testing
Programming Languages
1 26 (60.47%) SQL
2 25 (58.14%) Java
3 17 (39.53%) Scala
4 13 (30.23%) Python
5 7 (16.28%) PL/SQL
6 6 (13.95%) Shell Script
7 5 (11.63%) C#
8 4 (9.30%) PowerShell
9 2 (4.65%) VBA
10 1 (2.33%) C
10 1 (2.33%) Java 8
10 1 (2.33%) R
10 1 (2.33%) T-SQL
Qualifications
1 4 (9.30%) Degree
Quality Assurance & Compliance
1 3 (6.98%) GDPR
2 1 (2.33%) Data Quality
System Software
1 2 (4.65%) Apache Flume
1 2 (4.65%) Apache ZooKeeper
Systems Management
1 8 (18.60%) Hadoop YARN
2 2 (4.65%) Oozie
Vendors
1 12 (27.91%) Oracle
2 10 (23.26%) Cloudera
2 10 (23.26%) Informatica
2 10 (23.26%) Microsoft
2 10 (23.26%) Talend
3 9 (20.93%) Google
4 7 (16.28%) MapR
5 6 (13.95%) Tableau
6 2 (4.65%) Teradata
7 1 (2.33%) Alteryx