The following table provides summary statistics for permanent job vacancies with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 3 months to 30 April 2017 with a comparison to the same period in the previous 2 years.

Apache Spark
UK
3 months to
30 Apr 2017
Same period 2016 Same period 2015
Rank 289 359 752
Rank change year-on-year +70 +393  
Permanent jobs citing Apache Spark 955 911 236
As % of all permanent IT jobs advertised in the UK 1.11% 0.88% 0.21%
As % of the Application Platforms category 6.21% 4.65% 1.09%
Number of salaries quoted 788 752 209
Median salary £67,500 £65,000 £65,000
Median salary % change year-on-year +3.84% -  
90% offered a salary of more than £42,500 £42,500 £45,000
10% offered a salary of more than £95,000 £97,500 £90,000
UK excluding London median salary £57,500 £50,000 £52,500
% change year-on-year +15.00% -4.76%  

Apache Spark is in the application platform skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for application platform skills.

Application Platform Skills
UK
Permanent job vacancies with a requirement for application platform skills 15382 19608 21662
As % of all permanent IT job vacancies advertised in the UK 17.95% 18.98% 19.58%
Number of salaries quoted 12665 16628 17847
Median salary £47,500 £45,000 £45,000
Median salary % change year-on-year +5.55% -  
90% offered a salary of more than £29,000 £27,500 £27,500
10% offered a salary of more than £72,500 £70,000 £70,000
UK excluding London median salary £42,500 £40,000 £40,000
% change year-on-year +6.25% -  

Apache Spark
Job Vacancy Trend

The job posting trend of jobs advertised citing Apache Spark as a proportion of all permanent or contract IT jobs with a match in the Application Platforms category.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark.

Salary trend for Apache Spark in the UK

Apache Spark
Salary Histogram

The salary distribution of IT jobs citing Apache Spark over the 3 months to 30 April 2017.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 30 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 3 months to 30 April 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +72 907 £67,500 +3.84% 141
London +25 583 £70,000 - 98
South East +104 81 £65,000 +52.94% 9
City of London -17 59 £72,500 +5.45% 25
East of England +50 57 £50,000 -16.66% 8
North West +18 54 £62,000 +45.88% 14
South West +23 46 £55,000 +18.91% 3
Manchester +18 43 £66,000 +120.00% 11
East Midlands +45 30 £42,500 +6.25% 5
Yorkshire +34 29 £55,000 +15.78% 1
Surrey +61 28 £58,750 -9.61% 3
Scotland +27 27 £77,500 +47.61% 2
Essex - 26 £50,000 -
Oxfordshire +27 23 £65,000 +52.94% 1
Derbyshire - 22 £42,500 - 1
Derby - 22 £42,500 - 1
Cambridgeshire +11 21 £55,000 -8.33% 4
Gloucestershire +5 21 £50,000 +5.26% 1
Cambridge - 20 £55,000 - 4
Leeds +19 18 £58,750 +6.81%
West Yorkshire +15 18 £58,750 +23.68%
Bristol +5 16 £57,500 +43.75% 2
Hampshire +25 15 £67,500 +107.69% 1
Edinburgh +12 15 £77,500 +44.18% 2
Colchester - 14 £56,250 -
South Wales +21 13 £35,000 -6.66%
Wales +13 13 £35,000 -6.66%
West Midlands -25 13 £60,000 +4.34%
Cardiff +12 12 £35,000 -3.44%
Birmingham +31 11 £55,000 -38.88%

For the 6 months to 30 April 2017, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Apache Spark.

1 1378 (73.18%) Big Data
2 1344 (71.38%) Hadoop
3 1142 (60.65%) Java
4 951 (50.50%) Python
5 810 (43.02%) Agile Software Development
6 670 (35.58%) Scala
7 613 (32.55%) Apache Hive
8 603 (32.02%) Analytics
9 573 (30.43%) SQL
10 531 (28.20%) NoSQL
11 485 (25.76%) Machine Learning
12 470 (24.96%) Amazon AWS
13 467 (24.80%) MongoDB
14 433 (23.00%) Degree
15 432 (22.94%) Apache Cassandra
16 426 (22.62%) Kafka
17 413 (21.93%) Finance
18 376 (19.97%) Software Engineering
19 349 (18.53%) Linux
20 347 (18.43%) TDD
21 340 (18.06%) Apache
22 329 (17.47%) JavaScript
23 325 (17.26%) Computer Science
24 321 (17.05%) Elasticsearch
25 319 (16.94%) Scrum
26 303 (16.09%) HBase
27 301 (15.99%) R
28 296 (15.72%) Apache Pig
29 286 (15.19%) Algorithms
30 282 (14.98%) AngularJS

Apache Spark
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 340 (18.06%) Apache
2 321 (17.05%) Elasticsearch
3 296 (15.72%) Apache Pig
4 155 (8.23%) Tomcat
5 152 (8.07%) Apache Solr
6 96 (5.10%) JBoss
7 93 (4.94%) SAS
8 89 (4.73%) Jetty
9 87 (4.62%) OpenStack
10 73 (3.88%) WebLogic
11 68 (3.61%) WebSphere
12 31 (1.65%) Confluence
13 24 (1.27%) Apache Airflow
14 20 (1.06%) WebSphere Application Server
15 18 (0.96%) GlassFish
16 12 (0.64%) Cloud Foundry
17 11 (0.58%) MQSeries
18 7 (0.37%) Luigi
18 7 (0.37%) Oracle SOA Suite
19 6 (0.32%) Tornado
Applications
1 29 (1.54%) SPSS
2 17 (0.90%) Microsoft Excel
3 5 (0.27%) Stata
3 5 (0.27%) Weka
4 4 (0.21%) Spreadsheet
4 4 (0.21%) SPSS Modeler
5 3 (0.16%) S-PLUS
6 2 (0.11%) Gephi
7 1 (0.053%) InVision
Business Applications
1 30 (1.59%) SAP Oil and Gas
2 8 (0.42%) Sentinel
Cloud Services
1 470 (24.96%) Amazon AWS
2 183 (9.72%) Microsoft Azure
3 84 (4.46%) Google Cloud Platform
4 71 (3.77%) GitHub
5 47 (2.50%) Amazon EC2
5 47 (2.50%) Amazon Kinesis
6 40 (2.12%) Amazon S3
7 38 (2.02%) Amazon EMR
8 37 (1.96%) Cloud Computing
9 36 (1.91%) SaaS
10 22 (1.17%) IaaS
11 20 (1.06%) AWS Lambda
12 19 (1.01%) PaaS
13 8 (0.42%) OpenShift
14 7 (0.37%) Bluemix
14 7 (0.37%) Google App Engine
14 7 (0.37%) IBM Cloud
15 6 (0.32%) Office 365
16 5 (0.27%) Amazon CloudWatch
16 5 (0.27%) Amazon SQS
Communications & Networking
1 39 (2.07%) Internet
2 29 (1.54%) Kerberos
3 18 (0.96%) TCP/IP
4 17 (0.90%) HTTP
5 15 (0.80%) LDAP
6 10 (0.53%) DNS
7 6 (0.32%) LAN
7 6 (0.32%) WAN
8 5 (0.27%) FTP
8 5 (0.27%) Network Security
9 4 (0.21%) Software-Defined Networking
9 4 (0.21%) SSL
9 4 (0.21%) tcpdump
9 4 (0.21%) Wireshark
10 3 (0.16%) MVNO
10 3 (0.16%) SAN
10 3 (0.16%) Wireless
11 2 (0.11%) Multicast
12 1 (0.053%) Intranet
12 1 (0.053%) MQTT
Database & Business Intelligence
1 1378 (73.18%) Big Data
2 1344 (71.38%) Hadoop
3 613 (32.55%) Apache Hive
4 531 (28.20%) NoSQL
5 467 (24.80%) MongoDB
6 432 (22.94%) Apache Cassandra
7 303 (16.09%) HBase
8 273 (14.50%) MySQL
9 236 (12.53%) Relational Database
10 234 (12.43%) SQL Server
11 178 (9.45%) Redis
12 163 (8.66%) PostgreSQL
13 152 (8.07%) Impala
14 144 (7.65%) Data Warehouse
15 137 (7.28%) RDBMS
16 116 (6.16%) Data Mining
17 110 (5.84%) Neo4j
18 84 (4.46%) Sqoop
19 81 (4.30%) Couchbase
20 80 (4.25%) Amazon Redshift
Development Applications
1 145 (7.70%) Git (software)
2 119 (6.32%) Jenkins
3 77 (4.09%) Maven
4 47 (2.50%) Selenium
5 43 (2.28%) Vagrant
6 42 (2.23%) JUnit
7 38 (2.02%) JIRA
8 37 (1.96%) Talend Open Studio
9 25 (1.33%) Subversion
10 23 (1.22%) Mockito
11 21 (1.12%) Atlassian Bamboo
12 20 (1.06%) Ant
12 20 (1.06%) Gradle
13 17 (0.90%) Travis CI
14 16 (0.85%) Eclipse
14 16 (0.85%) Hudson
14 16 (0.85%) Jasmine
15 14 (0.74%) Gerrit
16 13 (0.69%) TeamCity
17 12 (0.64%) Grunt
General
1 413 (21.93%) Finance
2 229 (12.16%) Banking
3 157 (8.34%) Marketing
4 103 (5.47%) Retail
5 81 (4.30%) Games
6 71 (3.77%) Telecoms
7 67 (3.56%) Investment Banking
8 36 (1.91%) Manufacturing
9 34 (1.81%) Advertising
10 33 (1.75%) Electronics
11 28 (1.49%) Front Office
12 24 (1.27%) Military
13 20 (1.06%) Legal
14 18 (0.96%) Financial Institution
14 18 (0.96%) Pharmaceutical
15 12 (0.64%) Publishing
16 6 (0.32%) Aerospace
16 6 (0.32%) Billing
16 6 (0.32%) Retail Banking
17 5 (0.27%) Automotive
Job Titles
1 651 (34.57%) Developer
2 358 (19.01%) Java Developer
3 343 (18.22%) Data Engineer
4 238 (12.64%) Data Scientist
5 224 (11.90%) Architect
6 211 (11.21%) Big Data Engineer
7 185 (9.82%) Senior Developer
8 180 (9.56%) Software Engineer
9 145 (7.70%) Java Engineer
10 136 (7.22%) Data Architect
11 131 (6.96%) Scala Developer
12 129 (6.85%) Big Data Developer
13 105 (5.58%) Apache Spark Developer
14 103 (5.47%) Big Data Architect
15 101 (5.36%) Senior Java Developer
16 98 (5.20%) Hadoop Engineer
17 79 (4.20%) Software Developer
18 71 (3.77%) Hadoop Developer
19 70 (3.72%) Senior Data Scientist
20 64 (3.40%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 426 (22.62%) Kafka
2 282 (14.98%) AngularJS
3 207 (10.99%) Node.js
4 187 (9.93%) Spring
5 157 (8.34%) Web Services
6 152 (8.07%) React
7 147 (7.81%) HTML
8 123 (6.53%) REST
9 117 (6.21%) .NET
10 113 (6.00%) Lucene
11 101 (5.36%) HTML5
12 97 (5.15%) Elastic Stack
13 95 (5.05%) CSS
14 94 (4.99%) Hibernate
15 91 (4.83%) Java EE
16 66 (3.51%) RabbitMQ
17 63 (3.35%) Akka
17 63 (3.35%) SOAP
18 60 (3.19%) Middleware
18 60 (3.19%) XML
Miscellaneous
1 325 (17.26%) Computer Science
2 286 (15.19%) Algorithms
3 199 (10.57%) Analytical Skills
4 147 (7.81%) Greenfield Project
5 78 (4.14%) Fintech
6 67 (3.56%) Data Structures
7 49 (2.60%) Enterprise Software
8 41 (2.18%) Foreign Exchange (FX)
9 31 (1.65%) PKI
10 30 (1.59%) Credit Risk
11 26 (1.38%) Hedge funds
12 25 (1.33%) Mobile App
13 23 (1.22%) Semantic Web
14 21 (1.12%) Public Cloud
14 21 (1.12%) Replication
14 21 (1.12%) User Experience
15 20 (1.06%) Social Media
16 17 (0.90%) Derivative
17 16 (0.85%) Management Information System
18 15 (0.80%) Clustering
Operating Systems
1 349 (18.53%) Linux
2 112 (5.95%) Unix
3 62 (3.29%) Android
3 62 (3.29%) Apple iOS
4 46 (2.44%) Windows
5 21 (1.12%) Red Hat Enterprise Linux
6 14 (0.74%) CentOS
7 10 (0.53%) VMS
8 6 (0.32%) CoreOS
9 4 (0.21%) Windows Server
10 3 (0.16%) Ubuntu
11 2 (0.11%) Mac OS X
12 1 (0.053%) Debian
12 1 (0.053%) Mesosphere
12 1 (0.053%) Windows XP
Processes & Methodologies
1 810 (43.02%) Agile Software Development
2 603 (32.02%) Analytics
3 485 (25.76%) Machine Learning
4 376 (19.97%) Software Engineering
5 347 (18.43%) TDD
6 319 (16.94%) Scrum
7 262 (13.91%) Business Intelligence
8 260 (13.81%) DevOps
9 236 (12.53%) Open Source
10 219 (11.63%) Visualisation
11 217 (11.52%) Mathematics
12 212 (11.26%) MapReduce
13 209 (11.10%) ETL
14 193 (10.25%) Continuous Integration
15 190 (10.09%) Mentoring
16 169 (8.98%) Kanban
17 160 (8.50%) Multithreading
18 159 (8.44%) OO
19 154 (8.18%) Statistics
20 153 (8.13%) Data Analytics
Programming Languages
1 1142 (60.65%) Java
2 951 (50.50%) Python
3 670 (35.58%) Scala
4 573 (30.43%) SQL
5 329 (17.47%) JavaScript
6 301 (15.99%) R
7 267 (14.18%) C#
8 191 (10.14%) C++
9 147 (7.81%) Perl
10 107 (5.68%) C
11 96 (5.10%) Ruby
12 87 (4.62%) Bash Shell
13 82 (4.35%) Go
14 63 (3.35%) MATLAB
15 59 (3.13%) PHP
16 42 (2.23%) Shell Script
17 36 (1.91%) T-SQL
18 26 (1.38%) PL/SQL
19 22 (1.17%) Groovy
20 13 (0.69%) Haskell
Qualifications
1 433 (23.00%) Degree
2 131 (6.96%) PhD
3 65 (3.45%) Security Cleared
4 41 (2.18%) DV Cleared
5 16 (0.85%) SC Cleared
6 15 (0.80%) Postgraduate
7 11 (0.58%) CISSP
8 6 (0.32%) CEH
9 5 (0.27%) CISM
9 5 (0.27%) GCIH
9 5 (0.27%) ISTQB
9 5 (0.27%) ISTQB Foundation Certification
9 5 (0.27%) OSCP
10 3 (0.16%) Microsoft Certification
11 2 (0.11%) CCA
11 2 (0.11%) Citrix Certification
11 2 (0.11%) MCSA
11 2 (0.11%) MCSD
12 1 (0.053%) EMC Certification
12 1 (0.053%) ISEB
Quality Assurance & Compliance
1 91 (4.83%) QA
2 63 (3.35%) Data Quality
3 14 (0.74%) Sarbanes-Oxley
4 13 (0.69%) GCP
5 3 (0.16%) GPG13
5 3 (0.16%) ISO/IEC 27001
6 1 (0.053%) Actionable Recommendations
6 1 (0.053%) Basel III
6 1 (0.053%) Dodd-Frank
System Software
1 213 (11.31%) Docker
2 179 (9.51%) HDFS
3 106 (5.63%) Apache Flume
4 43 (2.28%) VMware Infrastructure
5 39 (2.07%) Apache ZooKeeper
5 39 (2.07%) Hyper-V
6 14 (0.74%) Virtual Machines
7 10 (0.53%) LXC
8 7 (0.37%) VirtualBox
9 5 (0.27%) Snort
10 2 (0.11%) etcd
10 2 (0.11%) KVM
11 1 (0.053%) Cronacle
11 1 (0.053%) GlusterFS
11 1 (0.053%) Xen
Systems Management
1 194 (10.30%) Ansible
2 185 (9.82%) Puppet
3 176 (9.35%) Opscode Chef
4 118 (6.27%) Kibana
5 102 (5.42%) Oozie
6 83 (4.41%) logstash
7 66 (3.51%) Salt
8 62 (3.29%) Kubernetes
9 55 (2.92%) Mesos
10 38 (2.02%) Hadoop YARN
11 15 (0.80%) Ambari
12 14 (0.74%) Nagios
13 13 (0.69%) Docker Swarm
13 13 (0.69%) Terraform
14 10 (0.53%) QRadar
14 10 (0.53%) ZABBIX
15 6 (0.32%) Capistrano
15 6 (0.32%) rkt
15 6 (0.32%) SCCM
16 5 (0.27%) Fluentd
Vendors
1 232 (12.32%) Oracle
2 110 (5.84%) Tableau
3 102 (5.42%) Google
4 98 (5.20%) Cloudera
5 83 (4.41%) Microsoft
6 69 (3.66%) Hortonworks
7 43 (2.28%) VMware
8 42 (2.23%) SAP
8 42 (2.23%) Splunk
9 41 (2.18%) Informatica
10 37 (1.96%) Talend
11 36 (1.91%) TIBCO
12 34 (1.81%) MapR
13 31 (1.65%) IBM
14 25 (1.33%) Teradata
15 24 (1.27%) Red Hat
16 17 (0.90%) Facebook
17 16 (0.85%) Apigee
17 16 (0.85%) New Relic
18 13 (0.69%) Alteryx
London
Computer Futures
Salary: £55000 - £65000 per annum + Competitive benefits
Posted: 9 hours ago
City, London
ANSON MCCADE
Salary: £45,000 - £120,000 + benefits
Posted: 2 days ago
London
ARC IT Recruitment Ltd
Salary: £60000 - £80000 per annum + Bonus + Benefits
Posted: 2 days ago
Brighton, East Sussex
ARC IT Recruitment Ltd
Salary: £35000 - £65000 per annum
Posted: 2 days ago
London
Cititec
Salary: £120000 - £130000 per annum + flexi Benefits + Bonus included
Posted: 2 days ago
City, London
Evolution Recruitment Solutions
Salary: 35,000 - 53,000 + Benefits
Posted: 2 days ago
East London
Digitech Resourcing Ltd
Salary: From £70,000 to £90,000 per annum £85,000, on-site gym, on-site cafe,
Posted: 3 days ago
City, London
TEKsystems
Salary: £60000 - £100000 per annum + benefits
Posted: 2 days ago
London
ARC IT Recruitment Ltd
Salary: £0.00 - £90000 per annum + Bonus + Benefits
Posted: 2 days ago
Nottingham, Nottinghamshire
Digitech Resourcing Ltd
Salary: From £40,000 to £50,000 per annum Salary negotiable - plus package
Posted: 3 days ago
London
onezeero.
Salary: £90000 - £120000 per annum + LTIP + Bonus
Posted: 3 days ago
London
ISL
Salary: £75000.00 - £80000.00 per annum + Benefits
Posted: 3 days ago
West London
Client Server
Salary: £70k to £85k + bonus + benefits
Posted: 3 days ago
London
Cititec
Salary: £110000 - £130000 per annum + flexi Benefits + Bonus
Posted: 4 days ago
Cambridge, Cambridgeshire
Empiric.com
Salary: Completely negotiable and excellent with comprehensive benefits
Posted: 5 days ago
Manchester, Lancashire
HAYS INFORMATION TECHNOLOGY
Salary: £35000.00 - £45000.00 per annum
Posted: 2 days ago
City, London
ANSON MCCADE
Salary: £45,000 - £60,000k plus brilliant package and unrivalled development
Posted: 4 days ago
Greater Manchester
ANSON MCCADE
Salary: £70,000 - £90,000k plus brilliant package and unrivalled development
Posted: 4 days ago
Newcastle Upon Tyne, Tyne and Wear
ANSON MCCADE
Salary: £70,000 - £90,000k plus brilliant package and unrivalled development
Posted: 4 days ago
Edinburgh & Lothians
ANSON MCCADE
Salary: £70,000 - £90,000k plus brilliant package and unrivalled development
Posted: 4 days ago
Belfast, County Antrim
Evolution Recruitment Solutions
Salary: 52,000-62,000 + Benefits
Posted: 3 days ago
London
Computer Futures
Salary: £60000 - £90000 per annum + competitive
Posted: 5 days ago
Manchester, Lancashire
Burns Sheehan
Salary: £25000.00 - £30000 per annum + benefits + flexible working
Posted: 2 days ago
City, London
Harrington Starr
Salary: £70000 - £90000 per annum
Posted: Yesterday
Bristol, Avon
Webrecruit
Salary: £Competitive Plus Excellent Benefits
Posted: 5 days ago
London
Burns Sheehan
Salary: £65000 - £75000 per annum
Posted: 6 days ago
Nottingham, Nottinghamshire
Ascent People Ltd
Salary: £40000 - £50000 per annum + Pension, Training
Posted: 5 days ago
London
Pioneer Search
Salary: £100000 - £120000 per annum + Bonus/Benefits
Posted: 4 days ago
City, London
Arrows Group
Salary: £80000 - £100000 per annum + negotiable
Posted: 4 days ago
London
Oliver Bernard
Salary: £70000 - £80000 per annum + 20% bonus, pension, healthcare etc.
Posted: 5 days ago