Period
to 25 June 2018

The following table provides summary statistics for permanent job vacancies advertised in the North West with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 25 June 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
England > North West
6 months to
25 Jun 2018
Same period 2017 Same period 2016
Rank 262 225 320
Rank change year-on-year -37 +95 +40
Permanent jobs citing Apache Spark 105 141 14
As % of all permanent IT jobs advertised in the North West 0.85% 1.09% 0.12%
As % of the Application Platforms category 5.24% 6.24% 0.72%
Number of salaries quoted 96 107 10
North West median annual salary £52,500 £55,000 £45,000
Median salary % change year-on-year -4.55% +22.22% -14.29%
10th Percentile £37,500 £29,000 £25,825
90th Percentile £81,250 £79,250 £80,000
England median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the North West with a requirement for application platform skills.

All Application Platform Skills
North West
Permanent vacancies with a requirement for application platform skills 2,003 2,259 1,933
As % of all permanent IT jobs advertised in the North West 16.15% 17.51% 17.21%
Number of salaries quoted 1,591 1,889 1,591
North West median annual salary £42,000 £40,000 £38,000
Median salary % change year-on-year +5.00% +5.26% +1.33%
10th Percentile £24,250 £23,750 £23,500
90th Percentile £66,250 £64,350 £57,500
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Apache Spark
Job Vacancy Trend in the North West

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Apache Spark in the North West

Apache Spark
Salary Trend in the North West

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the North West.

Salary trend for Apache Spark in the North West

Apache Spark
Salary Histogram in the North West

The salary distribution of IT jobs citing Apache Spark in the North West over the 6 months to 25 June 2018.

Salary histogram for Apache Spark in the North West

Apache Spark
Job Locations in the North West

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the North West region over the 6 months to 25 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Manchester -17 75 £50,000 -16.67% 9
Cheshire -10 27 £57,500 +4.55% 2
Merseyside +15 2 £60,000 +22.45% 2
Apache Spark
England

For the 6 months to 25 June 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the North West region with a requirement for Apache Spark.

1 90 (85.71%) Hadoop
2 85 (80.95%) Python
3 73 (69.52%) Big Data
4 60 (57.14%) Java
5 52 (49.52%) SQL
6 48 (45.71%) Agile Software Development
6 48 (45.71%) Scala
7 45 (42.86%) Machine Learning
8 44 (41.90%) Data Science
9 42 (40.00%) JavaScript
10 36 (34.29%) R
11 33 (31.43%) Continuous Integration
11 33 (31.43%) Software Engineering
12 32 (30.48%) Analytics
13 31 (29.52%) Docker
14 30 (28.57%) Analytical Skills
15 29 (27.62%) TDD
15 29 (27.62%) Problem-Solving
16 27 (25.71%) Retail
16 27 (25.71%) C#
17 26 (24.76%) Business Intelligence
17 26 (24.76%) Amazon AWS
18 25 (23.81%) Kubernetes
18 25 (23.81%) Finance
19 24 (22.86%) Ansible
20 23 (21.90%) Data Analysis
20 23 (21.90%) Marketing
21 22 (20.95%) Manufacturing
21 22 (20.95%) Programme Management
21 22 (20.95%) Electronics

Apache Spark
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 19 (18.10%) Apache Pig
2 10 (9.52%) SAS
3 4 (3.81%) Elasticsearch
4 2 (1.90%) Jupyter
5 1 (0.95%) Apache
5 1 (0.95%) Apache Solr
Cloud Services
1 26 (24.76%) Amazon AWS
2 15 (14.29%) Google Cloud Platform
3 11 (10.48%) Amazon S3
4 10 (9.52%) Microsoft Azure
5 9 (8.57%) SaaS
6 4 (3.81%) Cloud Computing
7 1 (0.95%) Amazon Kinesis
7 1 (0.95%) Google Analytics
Communications & Networking
1 4 (3.81%) Internet
Database & Business Intelligence
1 90 (85.71%) Hadoop
2 73 (69.52%) Big Data
3 20 (19.05%) NoSQL
4 18 (17.14%) Apache Hive
5 13 (12.38%) MongoDB
6 6 (5.71%) Data Warehouse
7 5 (4.76%) SQL Server
7 5 (4.76%) Text Mining
8 4 (3.81%) HBase
8 4 (3.81%) MySQL
9 3 (2.86%) Apache Cassandra
9 3 (2.86%) PostgreSQL
10 2 (1.90%) Data Mining
11 1 (0.95%) Apache Accumulo
11 1 (0.95%) Oracle OWB
11 1 (0.95%) Pentaho
11 1 (0.95%) RDBMS
11 1 (0.95%) SQL Server Integration Services
11 1 (0.95%) SQL Server Reporting Services
11 1 (0.95%) Sqoop
Development Applications
1 9 (8.57%) Cucumber
2 8 (7.62%) TeamCity
3 5 (4.76%) Git (software)
4 3 (2.86%) Selenium
5 2 (1.90%) Jenkins
5 2 (1.90%) SpecFlow
6 1 (0.95%) CA Release Automation
6 1 (0.95%) JIRA
6 1 (0.95%) JIRA Agile
6 1 (0.95%) JUnit
6 1 (0.95%) Mockito
6 1 (0.95%) TestNG
General
1 27 (25.71%) Retail
2 25 (23.81%) Finance
3 23 (21.90%) Marketing
4 22 (20.95%) Electronics
4 22 (20.95%) Manufacturing
4 22 (20.95%) Telecoms
5 1 (0.95%) Automotive
5 1 (0.95%) Banking
5 1 (0.95%) Investment Banking
5 1 (0.95%) Law
Job Titles
1 34 (32.38%) Data Scientist
2 15 (14.29%) Developer
3 14 (13.33%) Software Manager
4 13 (12.38%) Data Engineer
4 13 (12.38%) Engineering Manager
4 13 (12.38%) Software Engineering Manager
5 10 (9.52%) Analyst
5 10 (9.52%) Big Data Engineer
5 10 (9.52%) Java Developer
5 10 (9.52%) QA Analyst
6 9 (8.57%) Architect
6 9 (8.57%) Lead Developer
6 9 (8.57%) Senior Data Scientist
7 8 (7.62%) QA Automation Analyst
8 7 (6.67%) Lead Java Developer
9 6 (5.71%) Automation Test Analyst
9 6 (5.71%) QA Test Analyst
9 6 (5.71%) Test Analyst
10 5 (4.76%) Solutions Architect
10 5 (4.76%) Technical Architect
Libraries, Frameworks & Software Standards
1 16 (15.24%) AngularJS
1 16 (15.24%) CSS
1 16 (15.24%) HTML
2 14 (13.33%) HTML5
2 14 (13.33%) Kafka
3 13 (12.38%) REST
4 11 (10.48%) React
5 10 (9.52%) .NET
6 9 (8.57%) CSS3
6 9 (8.57%) Gherkin
6 9 (8.57%) Java EE
7 7 (6.67%) TensorFlow
8 6 (5.71%) Natural Language Processing
9 5 (4.76%) CoreNLP
9 5 (4.76%) JSON
9 5 (4.76%) Keras
9 5 (4.76%) RESTful
10 3 (2.86%) Hibernate
10 3 (2.86%) JMS
10 3 (2.86%) jQuery
Miscellaneous
1 30 (28.57%) Analytical Skills
2 22 (20.95%) Algorithms
3 16 (15.24%) Data Structures
4 15 (14.29%) Computer Science
5 9 (8.57%) Virtual Team
6 5 (4.76%) Social Media
7 4 (3.81%) Internet of Things
8 2 (1.90%) Video\Live Streaming
9 1 (0.95%) Analytical Mindset
9 1 (0.95%) Greenfield Project
9 1 (0.95%) Self-Motivation
Operating Systems
1 15 (14.29%) Linux
2 9 (8.57%) Windows
3 3 (2.86%) Unix
3 3 (2.86%) Windows 10
Processes & Methodologies
1 48 (45.71%) Agile Software Development
2 45 (42.86%) Machine Learning
3 44 (41.90%) Data Science
4 33 (31.43%) Continuous Integration
4 33 (31.43%) Software Engineering
5 32 (30.48%) Analytics
6 29 (27.62%) Problem-Solving
6 29 (27.62%) TDD
7 26 (24.76%) Business Intelligence
8 23 (21.90%) Data Analysis
9 22 (20.95%) Digital Marketing
9 22 (20.95%) Programme Management
10 18 (17.14%) Mathematics
11 17 (16.19%) Predictive Modelling
12 16 (15.24%) Mentoring
13 15 (14.29%) BDD
14 14 (13.33%) Data Engineering
14 14 (13.33%) Scrum
15 12 (11.43%) DevOps
15 12 (11.43%) Kanban
Programming Languages
1 85 (80.95%) Python
2 60 (57.14%) Java
3 52 (49.52%) SQL
4 48 (45.71%) Scala
5 42 (40.00%) JavaScript
6 36 (34.29%) R
7 27 (25.71%) C#
8 20 (19.05%) C++
9 16 (15.24%) HiveQL
9 16 (15.24%) Ruby
10 10 (9.52%) Perl
11 8 (7.62%) Bash Shell
12 3 (2.86%) C
13 1 (0.95%) Go
13 1 (0.95%) MATLAB
13 1 (0.95%) PL/SQL
13 1 (0.95%) T-SQL
Qualifications
1 12 (11.43%) Degree
2 8 (7.62%) Security Cleared
3 3 (2.86%) Postgraduate
4 2 (1.90%) Computer Science Degree
4 2 (1.90%) Numerate Degree
4 2 (1.90%) PhD
5 1 (0.95%) DV Cleared
5 1 (0.95%) Master's Degree
Quality Assurance & Compliance
1 12 (11.43%) GCP
2 11 (10.48%) QA
System Software
1 31 (29.52%) Docker
2 18 (17.14%) HDFS
3 1 (0.95%) Apache Flume
Systems Management
1 25 (23.81%) Kubernetes
2 24 (22.86%) Ansible
3 1 (0.95%) Oozie
3 1 (0.95%) Opscode Chef
3 1 (0.95%) Puppet
3 1 (0.95%) Terraform
Vendors
1 22 (20.95%) SAP
2 16 (15.24%) Google
3 9 (8.57%) Cloudera
4 6 (5.71%) Oracle
4 6 (5.71%) Talend
5 2 (1.90%) Atlassian
5 2 (1.90%) Informatica
5 2 (1.90%) Twitter
6 1 (0.95%) Capita
6 1 (0.95%) Cognos
6 1 (0.95%) Hortonworks
6 1 (0.95%) Splunk