Period
to 22 September 2017

The following table provides summary statistics for permanent job vacancies advertised in the North West with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 22 September 2017 with a comparison to the same period in the previous 2 years.

Apache Spark
England > North West
6 months to
22 Sep 2017
Same period 2016 Same period 2015
Rank 226 329 356
Rank change year-on-year +103 +27 +34
Permanent jobs citing Apache Spark 132 27 21
As % of all permanent IT jobs advertised in the North West 1.01% 0.23% 0.16%
As % of the Application Platforms category 5.63% 1.31% 0.83%
Number of salaries quoted 107 20 13
North West median annual salary £60,000 £47,500 £50,000
Median salary % change year-on-year +26.32% -5.00% -37.50%
10th Percentile £27,000 £30,750 £35,000
90th Percentile £77,500 £66,250 £115,000
England median annual salary £67,000 £65,000 £65,000
% change year-on-year +3.08% - -7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the North West with a requirement for application platform skills.

All Application Platform Skills
North West
Permanent vacancies with a requirement for application platform skills 2343 2055 2539
As % of all permanent IT jobs advertised in the North West 17.87% 17.23% 19.27%
Number of salaries quoted 1925 1723 2010
North West median annual salary £40,000 £40,000 £37,500
Median salary % change year-on-year - +6.67% +4.17%
10th Percentile £23,750 £24,520 £22,000
90th Percentile £64,400 £58,750 £55,000
England median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +4.65%

Apache Spark
Job Vacancy Trend in the North West

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Apache Spark in the North West

Apache Spark
Salary Trend in the North West

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the North West.

Salary trend for Apache Spark in the North West

Apache Spark
Salary Histogram in the North West

The salary distribution of IT jobs citing Apache Spark in the North West over the 6 months to 22 September 2017.

Salary histogram for Apache Spark in the North West

Apache Spark
Job Locations in the North West

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the North West region over the 6 months to 22 September 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Manchester +56 107 £60,000 +26.32% 3
Cheshire -21 14 £57,500 +15.00% 1
Merseyside - 5 £50,000 - 1
Apache Spark
England

For the 6 months to 22 September 2017, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the North West region with a requirement for Apache Spark.

1 110 (83.33%) Hadoop
1 110 (83.33%) Big Data
2 94 (71.21%) Python
3 91 (68.94%) Java
4 69 (52.27%) SQL
5 67 (50.76%) Open Source
6 64 (48.48%) Analytics
7 63 (47.73%) Agile Software Development
8 56 (42.42%) Amazon AWS
9 46 (34.85%) DevOps
9 46 (34.85%) Degree
10 44 (33.33%) Finance
10 44 (33.33%) Machine Learning
11 42 (31.82%) C++
11 42 (31.82%) Business Intelligence
12 39 (29.55%) Relational Database
13 37 (28.03%) Marketing
13 37 (28.03%) Software Engineering
14 36 (27.27%) Manufacturing
14 36 (27.27%) Programme Management
14 36 (27.27%) Electronics
14 36 (27.27%) Telecoms
14 36 (27.27%) SAP
14 36 (27.27%) Digital Marketing
15 35 (26.52%) Puppet
15 35 (26.52%) Opscode Chef
15 35 (26.52%) Data Analytics
16 34 (25.76%) Scala
17 31 (23.48%) Google
18 30 (22.73%) .NET

Apache Spark
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 30 (22.73%) Apache
2 22 (16.67%) Elasticsearch
3 20 (15.15%) Apache Pig
4 13 (9.85%) SAS
5 7 (5.30%) Confluence
5 7 (5.30%) OpenStack
6 3 (2.27%) Adobe Experience Manager
6 3 (2.27%) Apache Airflow
7 2 (1.52%) Apache Solr
7 2 (1.52%) Jupyter
8 1 (0.76%) Marvel
8 1 (0.76%) Tomcat
Applications
1 3 (2.27%) S-PLUS
1 3 (2.27%) SPSS
1 3 (2.27%) Stata
2 1 (0.76%) InVision
2 1 (0.76%) Weka
Cloud Services
1 56 (42.42%) Amazon AWS
2 30 (22.73%) Google Cloud Platform
3 28 (21.21%) Microsoft Azure
4 20 (15.15%) Amazon EMR
5 8 (6.06%) GitHub
6 2 (1.52%) Amazon CloudWatch
6 2 (1.52%) AWS CloudFormation
7 1 (0.76%) Amazon S3
Communications & Networking
1 1 (0.76%) HTTP
Database & Business Intelligence
1 110 (83.33%) Big Data
1 110 (83.33%) Hadoop
2 39 (29.55%) Relational Database
3 29 (21.97%) Apache Hive
3 29 (21.97%) SQL Server
4 24 (18.18%) MongoDB
5 20 (15.15%) Amazon Redshift
6 18 (13.64%) NoSQL
7 11 (8.33%) Apache Cassandra
7 11 (8.33%) RDBMS
8 10 (7.58%) Data Mining
8 10 (7.58%) HBase
9 8 (6.06%) Impala
10 7 (5.30%) CouchDB
10 7 (5.30%) MySQL
10 7 (5.30%) QlikView
11 5 (3.79%) Apache Accumulo
12 4 (3.03%) Amazon DynamoDB
12 4 (3.03%) Data Warehouse
12 4 (3.03%) Spark SQL
Development Applications
1 12 (9.09%) JIRA
2 10 (7.58%) Maven
3 9 (6.82%) Bitbucket
3 9 (6.82%) Git (software)
3 9 (6.82%) Jenkins
4 7 (5.30%) Gradle
4 7 (5.30%) Sonatype Nexus
4 7 (5.30%) Vagrant
5 6 (4.55%) EasyMock
5 6 (4.55%) JUnit
5 6 (4.55%) Talend Open Studio
6 3 (2.27%) Eclipse
6 3 (2.27%) GitLab
6 3 (2.27%) PyCharm
6 3 (2.27%) TeamCity
General
1 44 (33.33%) Finance
2 37 (28.03%) Marketing
3 36 (27.27%) Electronics
3 36 (27.27%) Manufacturing
3 36 (27.27%) Telecoms
4 7 (5.30%) Games
5 6 (4.55%) Aerospace
6 4 (3.03%) Advertising
6 4 (3.03%) Retail
7 2 (1.52%) Military
8 1 (0.76%) Automotive
Job Titles
1 42 (31.82%) Developer
2 30 (22.73%) Java Developer
3 29 (21.97%) Architect
4 26 (19.70%) Data Engineer
5 25 (18.94%) Cloud Architect
6 23 (17.42%) DevOps Architect
6 23 (17.42%) Lead DevOps
7 22 (16.67%) Software Developer
7 22 (16.67%) Software Engineer
8 17 (12.88%) Apache Spark Developer
8 17 (12.88%) Java Software Developer
9 14 (10.61%) Data Scientist
10 13 (9.85%) C# Developer
10 13 (9.85%) Java Scala Developer
10 13 (9.85%) Junior
10 13 (9.85%) Junior C# Developer
10 13 (9.85%) Junior Developer
10 13 (9.85%) Junior Java Developer
10 13 (9.85%) Python Developer
10 13 (9.85%) Scala Developer
Libraries, Frameworks & Software Standards
1 30 (22.73%) .NET
2 24 (18.18%) RabbitMQ
3 23 (17.42%) MSMQ
4 20 (15.15%) Spring
4 20 (15.15%) Web Services
5 19 (14.39%) Kafka
6 17 (12.88%) CSS
7 16 (12.12%) HTML
8 15 (11.36%) Hibernate
9 13 (9.85%) Java EE
10 10 (7.58%) CSS3
10 10 (7.58%) HTML5
11 9 (6.82%) Akka
11 9 (6.82%) RESTful
12 8 (6.06%) jQuery
13 7 (5.30%) JSON
13 7 (5.30%) Spring Boot
14 6 (4.55%) Natural Language Processing
15 5 (3.79%) AngularJS
15 5 (3.79%) Apache Camel
Miscellaneous
1 23 (17.42%) Public Cloud
2 21 (15.91%) Data Structures
3 14 (10.61%) Analytical Skills
3 14 (10.61%) Computer Science
4 9 (6.82%) Algorithms
5 8 (6.06%) User Experience
6 7 (5.30%) PKI
7 6 (4.55%) Cyberthreat
8 4 (3.03%) Linux Command Line
9 3 (2.27%) Mobile App
9 3 (2.27%) Social Media
10 2 (1.52%) Enterprise Software
10 2 (1.52%) Greenfield Project
11 1 (0.76%) FMCG
Operating Systems
1 27 (20.45%) Unix
2 26 (19.70%) Windows
3 20 (15.15%) Linux
Processes & Methodologies
1 67 (50.76%) Open Source
2 64 (48.48%) Analytics
3 63 (47.73%) Agile Software Development
4 46 (34.85%) DevOps
5 44 (33.33%) Machine Learning
6 42 (31.82%) Business Intelligence
7 37 (28.03%) Software Engineering
8 36 (27.27%) Digital Marketing
8 36 (27.27%) Programme Management
9 35 (26.52%) Data Analytics
10 29 (21.97%) Continuous Integration
10 29 (21.97%) Test Automation
11 27 (20.45%) MapReduce
12 25 (18.94%) OO
13 20 (15.15%) Data Acquisition
14 18 (13.64%) BDD
15 17 (12.88%) Scrum
16 15 (11.36%) Cybersecurity
16 15 (11.36%) TDD
17 14 (10.61%) Continuous Delivery
Programming Languages
1 94 (71.21%) Python
2 91 (68.94%) Java
3 69 (52.27%) SQL
4 42 (31.82%) C++
5 34 (25.76%) Scala
6 29 (21.97%) C#
7 27 (20.45%) Shell Script
8 23 (17.42%) Go
9 20 (15.15%) C
9 20 (15.15%) Clojure
9 20 (15.15%) Haskell
10 17 (12.88%) JavaScript
11 16 (12.12%) R
12 13 (9.85%) Perl
13 12 (9.09%) Ruby
14 8 (6.06%) MATLAB
15 4 (3.03%) T-SQL
Qualifications
1 46 (34.85%) Degree
2 10 (7.58%) Security Cleared
3 7 (5.30%) Computer Science Degree
3 7 (5.30%) DV Cleared
4 5 (3.79%) Numerate Degree
5 3 (2.27%) PhD
6 1 (0.76%) Master's Degree
Quality Assurance & Compliance
1 3 (2.27%) QA
2 1 (0.76%) Actionable Recommendations
2 1 (0.76%) GCP
System Software
1 21 (15.91%) Docker
2 9 (6.82%) HDFS
3 7 (5.30%) Hyper-V
3 7 (5.30%) VMware Infrastructure
4 3 (2.27%) Apache Flume
Systems Management
1 35 (26.52%) Opscode Chef
1 35 (26.52%) Puppet
2 26 (19.70%) Ansible
3 23 (17.42%) Mesos
4 11 (8.33%) Kubernetes
5 3 (2.27%) Ambari
6 2 (1.52%) Kibana
6 2 (1.52%) logstash
7 1 (0.76%) Oozie
7 1 (0.76%) ZABBIX
Vendors
1 36 (27.27%) SAP
2 31 (23.48%) Google
3 9 (6.82%) Oracle
4 7 (5.30%) Apigee
4 7 (5.30%) Tableau
4 7 (5.30%) VMware
5 6 (4.55%) Talend
6 5 (3.79%) Atlassian
6 5 (3.79%) Cloudera
7 4 (3.03%) Teradata
8 3 (2.27%) Adobe
8 3 (2.27%) Hortonworks
8 3 (2.27%) Splunk
9 2 (1.52%) Apple
10 1 (0.76%) IBM
10 1 (0.76%) Informatica
10 1 (0.76%) Microsoft