Period
to 24 November 2017

The following table provides summary statistics for permanent job vacancies advertised in the North West with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 24 November 2017 with a comparison to the same period in the previous 2 years.

Apache Spark
England > North West
6 months to
24 Nov 2017
Same period 2016 Same period 2015
Rank 274 298 356
Rank change year-on-year +24 +58 +23
Permanent jobs citing Apache Spark 107 63 10
As % of all permanent IT jobs advertised in the North West 0.81% 0.50% 0.077%
As % of the Application Platforms category 4.87% 2.73% 0.41%
Number of salaries quoted 80 59 4
North West median annual salary £50,000 £55,000 £40,000
Median salary % change year-on-year -9.09% +37.50% -50.00%
10th Percentile £26,250 £31,250 £33,250
90th Percentile £70,250 £76,300 £58,563
England median annual salary £67,000 £67,500 £65,000
% change year-on-year -0.74% +3.85% -7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the North West with a requirement for application platform skills.

All Application Platform Skills
North West
Permanent vacancies with a requirement for application platform skills 2199 2309 2462
As % of all permanent IT jobs advertised in the North West 16.60% 18.49% 18.86%
Number of salaries quoted 1795 1953 1983
North West median annual salary £40,000 £40,000 £37,500
Median salary % change year-on-year - +6.67% -
10th Percentile £23,500 £23,750 £22,500
90th Percentile £64,200 £59,500 £53,750
England median annual salary £47,500 £46,000 £45,000
% change year-on-year +3.26% +2.22% +5.88%

Apache Spark
Job Vacancy Trend in the North West

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the North West.

Job vacancy trend for Apache Spark in the North West

Apache Spark
Salary Trend in the North West

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the North West.

Salary trend for Apache Spark in the North West

Apache Spark
Salary Histogram in the North West

The salary distribution of IT jobs citing Apache Spark in the North West over the 6 months to 24 November 2017.

Salary histogram for Apache Spark in the North West

Apache Spark
Job Locations in the North West

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the North West region over the 6 months to 24 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Manchester +17 78 £52,500 -6.25% 12
Cheshire -19 17 £45,000 -10.00% 1
Merseyside - 8 £50,000 - 2
Apache Spark
England

For the 6 months to 24 November 2017, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the North West region with a requirement for Apache Spark.

1 85 (79.44%) Big Data
2 83 (77.57%) Hadoop
3 70 (65.42%) Python
4 63 (58.88%) Java
5 58 (54.21%) Agile Software Development
6 57 (53.27%) Analytics
7 50 (46.73%) SQL
8 44 (41.12%) Amazon AWS
9 40 (37.38%) Machine Learning
10 36 (33.64%) Open Source
10 36 (33.64%) Degree
10 36 (33.64%) DevOps
11 34 (31.78%) Scala
12 30 (28.04%) Apache Hive
12 30 (28.04%) Software Engineering
13 28 (26.17%) Data Analytics
13 28 (26.17%) Relational Database
14 26 (24.30%) Finance
15 24 (22.43%) Continuous Integration
16 23 (21.50%) Linux
17 22 (20.56%) MongoDB
18 21 (19.63%) C++
18 21 (19.63%) Spring
19 20 (18.69%) C#
19 20 (18.69%) SQL Server
19 20 (18.69%) Apache
19 20 (18.69%) Microsoft Azure
19 20 (18.69%) Opscode Chef
19 20 (18.69%) Puppet
20 19 (17.76%) Visualisation

Apache Spark
Co-occurring IT Skills in the North West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 20 (18.69%) Apache
2 17 (15.89%) Elasticsearch
3 15 (14.02%) Apache Pig
4 14 (13.08%) SAS
5 4 (3.74%) Confluence
5 4 (3.74%) OpenStack
6 3 (2.80%) Adobe Experience Manager
7 2 (1.87%) Jupyter
Applications
1 3 (2.80%) S-PLUS
1 3 (2.80%) SPSS
1 3 (2.80%) Stata
2 1 (0.93%) Weka
Cloud Services
1 44 (41.12%) Amazon AWS
2 20 (18.69%) Microsoft Azure
3 15 (14.02%) Amazon EMR
4 14 (13.08%) Google Cloud Platform
5 5 (4.67%) GitHub
6 4 (3.74%) Amazon CloudWatch
6 4 (3.74%) AWS CloudFormation
7 1 (0.93%) Amazon S3
Communications & Networking
1 4 (3.74%) Internet
2 1 (0.93%) HTTP
2 1 (0.93%) Skype
Database & Business Intelligence
1 85 (79.44%) Big Data
2 83 (77.57%) Hadoop
3 30 (28.04%) Apache Hive
4 28 (26.17%) Relational Database
5 22 (20.56%) MongoDB
6 20 (18.69%) SQL Server
7 15 (14.02%) Amazon Redshift
7 15 (14.02%) NoSQL
8 13 (12.15%) RDBMS
9 10 (9.35%) Data Mining
10 9 (8.41%) HBase
10 9 (8.41%) MySQL
10 9 (8.41%) QlikView
11 7 (6.54%) Apache Accumulo
12 6 (5.61%) Impala
13 5 (4.67%) Apache Cassandra
13 5 (4.67%) Sqoop
14 4 (3.74%) CouchDB
14 4 (3.74%) Data Lake
14 4 (3.74%) Data Warehouse
Development Applications
1 9 (8.41%) Git (software)
2 8 (7.48%) Bitbucket
2 8 (7.48%) Jenkins
2 8 (7.48%) JIRA
2 8 (7.48%) Maven
3 6 (5.61%) Gradle
4 4 (3.74%) Sonatype Nexus
4 4 (3.74%) Vagrant
5 2 (1.87%) Eclipse
5 2 (1.87%) Selenium
5 2 (1.87%) SoapUI
6 1 (0.93%) EasyMock
6 1 (0.93%) JUnit
6 1 (0.93%) Talend Open Studio
General
1 26 (24.30%) Finance
2 16 (14.95%) Marketing
3 15 (14.02%) Electronics
3 15 (14.02%) Manufacturing
3 15 (14.02%) Telecoms
4 6 (5.61%) Games
5 4 (3.74%) Advertising
5 4 (3.74%) Retail
6 3 (2.80%) Banking
6 3 (2.80%) Investment Banking
6 3 (2.80%) Law
7 2 (1.87%) Automotive
7 2 (1.87%) Corporate Banking
7 2 (1.87%) Military
7 2 (1.87%) Retail Banking
8 1 (0.93%) Aerospace
Job Titles
1 29 (27.10%) Developer
2 21 (19.63%) Software Engineer
3 20 (18.69%) Java Developer
4 19 (17.76%) Data Scientist
5 16 (14.95%) Architect
6 14 (13.08%) Cloud Architect
7 13 (12.15%) Junior
8 12 (11.21%) Apache Spark Developer
8 12 (11.21%) Data Engineer
8 12 (11.21%) DevOps Architect
8 12 (11.21%) Lead DevOps
9 11 (10.28%) C# Developer
9 11 (10.28%) Java Scala Developer
9 11 (10.28%) Junior C# Developer
9 11 (10.28%) Junior Developer
9 11 (10.28%) Junior Java Developer
9 11 (10.28%) Scala Developer
9 11 (10.28%) Software Developer
10 10 (9.35%) Python Developer
11 9 (8.41%) Lead Software Engineer
Libraries, Frameworks & Software Standards
1 21 (19.63%) Spring
2 19 (17.76%) Hibernate
3 17 (15.89%) Web Services
4 16 (14.95%) .NET
4 16 (14.95%) CSS
4 16 (14.95%) HTML
5 15 (14.02%) jQuery
6 14 (13.08%) Kafka
7 13 (12.15%) AngularJS
7 13 (12.15%) Node.js
7 13 (12.15%) RabbitMQ
8 12 (11.21%) MSMQ
9 11 (10.28%) CSS3
9 11 (10.28%) HTML5
10 10 (9.35%) Java EE
11 9 (8.41%) Akka
11 9 (8.41%) Apache Camel
11 9 (8.41%) LAMP
11 9 (8.41%) Middleware
12 8 (7.48%) RESTful
Miscellaneous
1 18 (16.82%) Analytical Skills
2 16 (14.95%) Data Structures
3 14 (13.08%) Computer Science
4 12 (11.21%) Public Cloud
5 10 (9.35%) Algorithms
6 9 (8.41%) PKI
7 5 (4.67%) User Experience
8 4 (3.74%) Internet of Things
8 4 (3.74%) Mobile App
9 3 (2.80%) Social Media
10 2 (1.87%) Data Centre
10 2 (1.87%) Robotics
11 1 (0.93%) Analytical Mindset
11 1 (0.93%) Cyberthreat
11 1 (0.93%) FMCG
11 1 (0.93%) Greenfield Project
11 1 (0.93%) Linux Command Line
Operating Systems
1 23 (21.50%) Linux
2 18 (16.82%) Windows
3 13 (12.15%) Unix
4 2 (1.87%) Android
4 2 (1.87%) Apple iOS
Processes & Methodologies
1 58 (54.21%) Agile Software Development
2 57 (53.27%) Analytics
3 40 (37.38%) Machine Learning
4 36 (33.64%) DevOps
4 36 (33.64%) Open Source
5 30 (28.04%) Software Engineering
6 28 (26.17%) Data Analytics
7 24 (22.43%) Continuous Integration
8 19 (17.76%) Business Intelligence
8 19 (17.76%) OO
8 19 (17.76%) Scrum
8 19 (17.76%) Visualisation
9 18 (16.82%) Test Automation
10 17 (15.89%) MapReduce
11 15 (14.02%) Data Acquisition
11 15 (14.02%) Digital Marketing
11 15 (14.02%) Programme Management
12 12 (11.21%) Continuous Improvement
12 12 (11.21%) E-Commerce
13 10 (9.35%) SDLC
Programming Languages
1 70 (65.42%) Python
2 63 (58.88%) Java
3 50 (46.73%) SQL
4 34 (31.78%) Scala
5 21 (19.63%) C++
6 20 (18.69%) C#
7 18 (16.82%) Haskell
8 17 (15.89%) C
8 17 (15.89%) R
9 16 (14.95%) JavaScript
10 15 (14.02%) Clojure
11 14 (13.08%) Go
11 14 (13.08%) Ruby
12 13 (12.15%) Shell Script
13 11 (10.28%) MATLAB
14 10 (9.35%) Perl
15 3 (2.80%) Erlang
16 1 (0.93%) Elixir
16 1 (0.93%) T-SQL
Qualifications
1 36 (33.64%) Degree
2 16 (14.95%) Security Cleared
3 14 (13.08%) DV Cleared
4 9 (8.41%) Numerate Degree
5 7 (6.54%) Computer Science Degree
6 4 (3.74%) PhD
7 1 (0.93%) Master's Degree
Quality Assurance & Compliance
1 3 (2.80%) QA
2 1 (0.93%) Actionable Recommendations
System Software
1 9 (8.41%) Hyper-V
1 9 (8.41%) VMware Infrastructure
2 8 (7.48%) Docker
3 6 (5.61%) HDFS
4 5 (4.67%) Apache Flume
Systems Management
1 20 (18.69%) Opscode Chef
1 20 (18.69%) Puppet
2 14 (13.08%) Mesos
3 12 (11.21%) Ansible
4 5 (4.67%) Ambari
5 4 (3.74%) Kubernetes
6 2 (1.87%) Oozie
7 1 (0.93%) ZABBIX
Vendors
1 17 (15.89%) Google
2 16 (14.95%) SAP
3 14 (13.08%) Oracle
4 9 (8.41%) VMware
5 8 (7.48%) Tableau
6 7 (6.54%) Apigee
7 5 (4.67%) Atlassian
8 4 (3.74%) Hortonworks
8 4 (3.74%) Teradata
9 3 (2.80%) Adobe
9 3 (2.80%) Splunk
10 2 (1.87%) Ab Initio
10 2 (1.87%) Alteryx
10 2 (1.87%) Datameer
10 2 (1.87%) Lavastorm
10 2 (1.87%) Twitter
11 1 (0.93%) Cloudera
11 1 (0.93%) Facebook
11 1 (0.93%) Talend