The following table provides summary statistics for permanent job vacancies with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 3 months to 25 June 2017 with a comparison to the same period in the previous 2 years.

Apache Spark
UK
3 months to
25 Jun 2017
Same period 2016 Same period 2015
Rank 269 368 680
Rank change year-on-year +99 +312  
Permanent jobs citing Apache Spark 1072 796 296
As % of all permanent IT jobs advertised in the UK 1.22% 0.82% 0.27%
As % of the Application Platforms category 6.74% 4.39% 1.36%
Number of salaries quoted 832 637 260
Median salary £67,500 £65,000 £70,000
Median salary % change year-on-year +3.84% -7.14%  
90% offered a salary of more than £42,500 £45,000 £47,250
10% offered a salary of more than £91,750 £100,000 £90,000
UK excluding London median salary £60,000 £57,500 £50,000
% change year-on-year +4.34% +15.00%  

Apache Spark is in the application platform skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for application platform skills.

Application Platform Skills
UK
Permanent job vacancies with a requirement for application platform skills 15895 18148 21815
As % of all permanent IT job vacancies advertised in the UK 18.05% 18.69% 19.71%
Number of salaries quoted 12894 15437 18093
Median salary £47,500 £45,000 £45,000
Median salary % change year-on-year +5.55% -  
90% offered a salary of more than £30,000 £28,500 £27,500
10% offered a salary of more than £75,000 £70,000 £70,000
UK excluding London median salary £42,500 £40,000 £40,000
% change year-on-year +6.25% -  

Apache Spark
Job Vacancy Trend

The job posting trend of jobs advertised citing Apache Spark as a proportion of all permanent or contract IT jobs with a match in the Application Platforms category.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark.

Salary trend for Apache Spark in the UK

Apache Spark
Salary Histogram

The salary distribution of IT jobs citing Apache Spark over the 3 months to 25 June 2017.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 30 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 3 months to 25 June 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +92 1026 £67,500 +3.84% 178
London +56 667 £70,000 - 125
South East +100 127 £65,000 +13.04% 17
North West +43 90 £60,000 +41.17% 9
Manchester +48 78 £60,000 +118.18% 5
City of London +8 67 £67,500 -8.47% 29
East of England +49 51 £50,000 -16.66% 9
Oxfordshire +38 36 £75,000 +36.36% 4
Scotland +30 33 £80,000 +60.00% 8
Hampshire +42 31 £66,250 +12.76% 8
East Midlands +44 26 £42,500 -34.61%
Cambridgeshire +14 24 £45,000 -25.00% 3
Cambridge +8 23 £45,000 -43.75% 3
Oxford +17 22 £82,500 +26.92% 3
South West -52 22 £55,000 +1.85% 2
Yorkshire +18 21 £55,000 -8.33% 12
Buckinghamshire - 18 £70,000 - 1
Milton Keynes - 18 £70,000 - 1
Surrey +30 17 £65,000 -7.14%
Glasgow +18 17 £80,000 - 3
Derbyshire +24 16 £42,500 -34.61%
West Yorkshire +16 16 £55,000 -2.22% 10
Leeds +7 16 £55,000 -8.33% 9
Derby - 16 £42,500 -
Edinburgh +9 15 £66,250 +32.50% 5
Brighton +21 14 £50,000 -16.66%
East Sussex +20 14 £50,000 -16.66%
Gloucestershire -21 12 £55,000 +1.85%
Bedfordshire - 12 £66,250 - 4
Berkshire +10 11 £61,250 +36.11% 3

For the 6 months to 25 June 2017, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Apache Spark.

1 1469 (73.67%) Big Data
2 1349 (67.65%) Hadoop
3 1220 (61.18%) Java
4 1048 (52.56%) Python
5 890 (44.63%) Agile Software Development
6 782 (39.22%) Scala
7 676 (33.90%) Analytics
8 605 (30.34%) SQL
9 548 (27.48%) Apache Hive
10 539 (27.03%) Machine Learning
11 531 (26.63%) Amazon AWS
12 509 (25.53%) Kafka
13 503 (25.23%) NoSQL
14 483 (24.22%) Apache Cassandra
15 432 (21.66%) Finance
16 417 (20.91%) Degree
17 412 (20.66%) MongoDB
18 370 (18.56%) Apache
19 368 (18.46%) TDD
20 362 (18.15%) Software Engineering
21 340 (17.05%) Scrum
21 340 (17.05%) JavaScript
22 335 (16.80%) Elasticsearch
23 332 (16.65%) Linux
24 325 (16.30%) R
25 320 (16.05%) Open Source
26 288 (14.44%) HBase
27 283 (14.19%) Computer Science
28 281 (14.09%) DevOps
29 277 (13.89%) Business Intelligence

Apache Spark
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 370 (18.56%) Apache
2 335 (16.80%) Elasticsearch
3 218 (10.93%) Apache Pig
4 161 (8.07%) Apache Solr
5 138 (6.92%) Tomcat
6 104 (5.22%) SAS
7 82 (4.11%) JBoss
8 75 (3.76%) OpenStack
9 71 (3.56%) WebLogic
10 70 (3.51%) Jetty
11 57 (2.86%) WebSphere
12 38 (1.91%) Confluence
13 29 (1.45%) Apache Airflow
14 22 (1.10%) WebSphere Application Server
15 21 (1.05%) GlassFish
16 12 (0.60%) Oracle SOA Suite
17 8 (0.40%) nginx
18 7 (0.35%) GemFire
18 7 (0.35%) Luigi
19 6 (0.30%) Cloud Foundry
Applications
1 24 (1.20%) SPSS
2 16 (0.80%) Microsoft Excel
3 6 (0.30%) Weka
4 5 (0.25%) Microsoft Office
4 5 (0.25%) Spreadsheet
5 4 (0.20%) Stata
6 3 (0.15%) Microsoft PowerPoint
6 3 (0.15%) S-PLUS
6 3 (0.15%) SPSS Modeler
7 1 (0.050%) Gephi
7 1 (0.050%) InVision
Business Applications
1 64 (3.21%) SAP Oil and Gas
2 3 (0.15%) Sentinel
3 1 (0.050%) Markit EDM
Cloud Services
1 531 (26.63%) Amazon AWS
2 201 (10.08%) Microsoft Azure
3 116 (5.82%) Google Cloud Platform
4 87 (4.36%) GitHub
5 63 (3.16%) Amazon EMR
6 55 (2.76%) Amazon Kinesis
7 50 (2.51%) Amazon EC2
8 42 (2.11%) Amazon S3
9 41 (2.06%) Cloud Computing
10 40 (2.01%) SaaS
11 16 (0.80%) AWS Lambda
12 15 (0.75%) IaaS
12 15 (0.75%) PaaS
13 8 (0.40%) Office 365
14 7 (0.35%) OpenShift
15 5 (0.25%) Azure Data Factory
15 5 (0.25%) Google Analytics
16 4 (0.20%) Bluemix
16 4 (0.20%) Google App Engine
16 4 (0.20%) IBM Cloud
Communications & Networking
1 41 (2.06%) Internet
2 16 (0.80%) Kerberos
3 13 (0.65%) LDAP
4 9 (0.45%) HTTP
5 8 (0.40%) LAN
5 8 (0.40%) Network Security
5 8 (0.40%) TCP/IP
5 8 (0.40%) WAN
6 6 (0.30%) DNS
6 6 (0.30%) Software-Defined Networking
7 5 (0.25%) AMQP
7 5 (0.25%) Wireshark
8 4 (0.20%) SNMP
8 4 (0.20%) Wireless
9 3 (0.15%) MVNO
10 2 (0.10%) FTP
10 2 (0.10%) SSL
11 1 (0.050%) Intranet
11 1 (0.050%) MQTT
11 1 (0.050%) tcpdump
Database & Business Intelligence
1 1469 (73.67%) Big Data
2 1349 (67.65%) Hadoop
3 548 (27.48%) Apache Hive
4 503 (25.23%) NoSQL
5 483 (24.22%) Apache Cassandra
6 412 (20.66%) MongoDB
7 288 (14.44%) HBase
8 248 (12.44%) Relational Database
9 242 (12.14%) MySQL
10 217 (10.88%) SQL Server
11 172 (8.63%) Data Warehouse
12 166 (8.32%) PostgreSQL
13 163 (8.17%) Redis
14 147 (7.37%) Impala
15 133 (6.67%) Data Mining
16 127 (6.37%) RDBMS
17 118 (5.92%) Amazon Redshift
18 79 (3.96%) Neo4j
19 78 (3.91%) Riak
20 74 (3.71%) Couchbase
Development Applications
1 197 (9.88%) Git (software)
2 148 (7.42%) Jenkins
3 95 (4.76%) Maven
4 69 (3.46%) JIRA
5 58 (2.91%) Selenium
6 50 (2.51%) JUnit
7 42 (2.11%) Talend Open Studio
8 37 (1.86%) Eclipse
9 35 (1.76%) Vagrant
10 32 (1.60%) Mockito
11 30 (1.50%) Subversion
12 27 (1.35%) Bitbucket
12 27 (1.35%) Gradle
13 26 (1.30%) TeamCity
14 25 (1.25%) Atlassian Bamboo
15 20 (1.00%) Travis CI
16 19 (0.95%) Ant
16 19 (0.95%) Hudson
17 18 (0.90%) Gerrit
17 18 (0.90%) JBehave
General
1 432 (21.66%) Finance
2 189 (9.48%) Banking
3 182 (9.13%) Marketing
4 98 (4.91%) Retail
5 91 (4.56%) Telecoms
6 86 (4.31%) Games
7 68 (3.41%) Manufacturing
8 67 (3.36%) Electronics
9 54 (2.71%) Investment Banking
10 34 (1.71%) Front Office
11 30 (1.50%) Advertising
12 26 (1.30%) Pharmaceutical
13 18 (0.90%) Legal
14 15 (0.75%) Publishing
15 13 (0.65%) Aerospace
16 12 (0.60%) Retail Banking
17 11 (0.55%) Financial Institution
17 11 (0.55%) Military
18 6 (0.30%) Billing
19 4 (0.20%) Spanish Language
Job Titles
1 675 (33.85%) Developer
2 367 (18.41%) Java Developer
3 353 (17.70%) Data Engineer
4 264 (13.24%) Data Scientist
5 235 (11.79%) Architect
6 212 (10.63%) Big Data Engineer
7 173 (8.68%) Software Engineer
8 159 (7.97%) Senior Developer
9 151 (7.57%) Scala Developer
10 126 (6.32%) Java Engineer
11 125 (6.27%) Big Data Developer
12 124 (6.22%) Data Architect
13 108 (5.42%) Hadoop Engineer
14 100 (5.02%) Apache Spark Developer
15 96 (4.81%) Big Data Architect
16 94 (4.71%) Software Developer
17 84 (4.21%) Senior Java Developer
18 64 (3.21%) Hadoop Developer
18 64 (3.21%) Senior Data Scientist
19 63 (3.16%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 509 (25.53%) Kafka
2 254 (12.74%) AngularJS
3 193 (9.68%) Web Services
4 183 (9.18%) Spring
5 180 (9.03%) Node.js
6 142 (7.12%) .NET
7 135 (6.77%) HTML
8 131 (6.57%) React
9 126 (6.32%) REST
10 124 (6.22%) Lucene
11 95 (4.76%) CSS
12 89 (4.46%) Hibernate
13 88 (4.41%) Elastic Stack
14 85 (4.26%) RabbitMQ
15 78 (3.91%) Akka
16 75 (3.76%) Java EE
17 72 (3.61%) XML
18 67 (3.36%) HTML5
19 65 (3.26%) Natural Language Processing
20 58 (2.91%) RESTful
Miscellaneous
1 283 (14.19%) Computer Science
2 249 (12.49%) Algorithms
2 249 (12.49%) Analytical Skills
3 144 (7.22%) Greenfield Project
4 71 (3.56%) Foreign Exchange (FX)
5 70 (3.51%) Data Structures
6 63 (3.16%) Fintech
7 53 (2.66%) Enterprise Software
8 27 (1.35%) Mobile App
8 27 (1.35%) Semantic Web
9 24 (1.20%) Public Cloud
10 23 (1.15%) Derivative
10 23 (1.15%) Hedge funds
11 21 (1.05%) Cyberthreat
12 20 (1.00%) Management Information System
13 19 (0.95%) Credit Risk
13 19 (0.95%) User Experience
14 17 (0.85%) PKI
15 15 (0.75%) Fixed Income
16 14 (0.70%) Cloud Native
Operating Systems
1 332 (16.65%) Linux
2 96 (4.81%) Unix
3 69 (3.46%) Windows
4 50 (2.51%) Android
5 49 (2.46%) Apple iOS
6 15 (0.75%) Red Hat Enterprise Linux
7 10 (0.50%) VMS
8 8 (0.40%) CentOS
9 5 (0.25%) Windows Server
10 4 (0.20%) CoreOS
10 4 (0.20%) Ubuntu
11 3 (0.15%) Mac OS X
12 1 (0.050%) Mesosphere
Processes & Methodologies
1 890 (44.63%) Agile Software Development
2 676 (33.90%) Analytics
3 539 (27.03%) Machine Learning
4 368 (18.46%) TDD
5 362 (18.15%) Software Engineering
6 340 (17.05%) Scrum
7 320 (16.05%) Open Source
8 281 (14.09%) DevOps
9 277 (13.89%) Business Intelligence
10 243 (12.19%) Continuous Integration
11 233 (11.69%) Visualisation
12 217 (10.88%) MapReduce
13 211 (10.58%) ETL
14 188 (9.43%) Data Analytics
15 187 (9.38%) Mentoring
16 183 (9.18%) Kanban
16 183 (9.18%) Mathematics
17 176 (8.83%) OO
18 159 (7.97%) Test Automation
19 157 (7.87%) Statistics
Programming Languages
1 1220 (61.18%) Java
2 1048 (52.56%) Python
3 782 (39.22%) Scala
4 605 (30.34%) SQL
5 340 (17.05%) JavaScript
6 325 (16.30%) R
7 269 (13.49%) C#
8 237 (11.89%) C++
9 122 (6.12%) Perl
10 116 (5.82%) C
11 88 (4.41%) Ruby
12 84 (4.21%) Go
13 75 (3.76%) Bash Shell
14 65 (3.26%) PHP
15 61 (3.06%) MATLAB
16 58 (2.91%) Shell Script
17 32 (1.60%) T-SQL
18 28 (1.40%) Clojure
18 28 (1.40%) Haskell
19 23 (1.15%) PL/SQL
Qualifications
1 417 (20.91%) Degree
2 131 (6.57%) PhD
3 116 (5.82%) Computer Science Degree
4 71 (3.56%) Security Cleared
5 54 (2.71%) Numerate Degree
6 44 (2.21%) Master's Degree
7 41 (2.06%) DV Cleared
8 20 (1.00%) SC Cleared
9 19 (0.95%) Postgraduate
10 5 (0.25%) CISSP
10 5 (0.25%) ISTQB
10 5 (0.25%) ISTQB Foundation Certification
11 3 (0.15%) CCA
11 3 (0.15%) CEH
11 3 (0.15%) GCIH
11 3 (0.15%) OSCP
12 2 (0.10%) CISM
12 2 (0.10%) Citrix Certification
12 2 (0.10%) Microsoft Certification
12 2 (0.10%) PMI Certification
Quality Assurance & Compliance
1 82 (4.11%) QA
2 72 (3.61%) Data Quality
3 16 (0.80%) GCP
4 14 (0.70%) Sarbanes-Oxley
5 2 (0.10%) Actionable Recommendations
5 2 (0.10%) GDPR
6 1 (0.050%) Basel III
6 1 (0.050%) Dodd-Frank
6 1 (0.050%) GPG13
6 1 (0.050%) ISO/IEC 27001
6 1 (0.050%) MiFID
6 1 (0.050%) PMO
System Software
1 252 (12.64%) Docker
2 163 (8.17%) HDFS
3 103 (5.17%) Apache Flume
4 27 (1.35%) Apache ZooKeeper
5 24 (1.20%) VMware Infrastructure
6 21 (1.05%) Hyper-V
7 11 (0.55%) Virtual Machines
8 10 (0.50%) LXC
9 6 (0.30%) VirtualBox
10 3 (0.15%) Snort
11 2 (0.10%) KVM
12 1 (0.050%) Active Directory
12 1 (0.050%) Cronacle
12 1 (0.050%) Xen
Systems Management
1 177 (8.88%) Puppet
2 175 (8.78%) Ansible
2 175 (8.78%) Opscode Chef
3 115 (5.77%) Kibana
4 81 (4.06%) Oozie
5 75 (3.76%) Mesos
6 71 (3.56%) logstash
7 62 (3.11%) Kubernetes
8 54 (2.71%) Salt
9 23 (1.15%) Terraform
10 20 (1.00%) Hadoop YARN
11 13 (0.65%) Ambari
12 9 (0.45%) Nagios
12 9 (0.45%) ZABBIX
13 8 (0.40%) SCCM
14 6 (0.30%) Capistrano
14 6 (0.30%) Microsoft Intune
15 5 (0.25%) Grafana
15 5 (0.25%) Graphite
15 5 (0.25%) QRadar
Vendors
1 181 (9.08%) Oracle
2 135 (6.77%) Google
3 117 (5.87%) Tableau
4 103 (5.17%) Cloudera
5 78 (3.91%) Microsoft
6 76 (3.81%) Hortonworks
7 72 (3.61%) SAP
8 42 (2.11%) MapR
8 42 (2.11%) Talend
9 36 (1.81%) Informatica
10 29 (1.45%) Splunk
10 29 (1.45%) TIBCO
11 26 (1.30%) Teradata
12 24 (1.20%) VMware
13 23 (1.15%) IBM
13 23 (1.15%) Red Hat
14 20 (1.00%) Apigee
15 14 (0.70%) Apple
16 13 (0.65%) Netezza
17 12 (0.60%) Vertica
UK
Venturi
Salary: £50000.00 - £90000.00 per annum + Bonus & Benefits
Posted: Yesterday
Leeds, West Yorkshire
Big Wednesday Digital Ltd
Salary: £45000 - £75000 per annum + Negotiable
Posted: 9 hours ago
London
Harrington Starr
Salary: £65000 - £85000 per annum + bonus + benefits
Posted: Yesterday
London
ARC IT Recruitment Ltd
Salary: £60000 - £80000 per annum + Bonus + Benefits
Posted: Yesterday
London
Mortimer Spinks
Salary: £35000 - £60000 per annum
Posted: 3 days ago
Leeds, West Yorkshire
Fruition IT Resources Limited
Salary: £40000 - £65000 per annum + Exceptional Benefits
Posted: 2 days ago
Aldershot, Hampshire
Austin Fraser
Salary: £50000 - £70000 per annum + Benefits and Bonus
Posted: 4 days ago
London
Venturi
Salary: £55000.00 - £80000.00 per annum + company benefits
Posted: 2 days ago
London
ARC IT Recruitment Ltd
Salary: £0.00 - £90000 per annum + Bonus + Benefits
Posted: Yesterday
City, London
Big Wednesday Digital Ltd
Salary: £45000 - £85000 per annum + Negotiable
Posted: Yesterday
City, London
Oliver Bernard
Salary: £50000 - £60000 per annum + benefits & stocks
Posted: 3 days ago
London
Opus Recruitment Solutions Ltd
Salary: £65000 - £90000 per annum, Benefits Benefits & Bonus included
Posted: Yesterday
London
Digitech Resourcing Ltd
Salary: From £70,000 to £90,000 per annum
Posted: 3 days ago
East London
Freshtechit
Salary: From £50,000 to £70,000 per annum
Posted: 2 days ago
Central London / West End
Client Server
Salary: £50k to £65k + benefits
Posted: 3 days ago
Glasgow, Lanarkshire
Net Talent
Salary: £45000 - £60000 per annum
Posted: 3 days ago
London
Burns Sheehan
Salary: £55000 - £65000 per annum
Posted: 2 days ago
City, London
Vadis People
Salary: circ £50,000 to £65,000
Posted: 2 days ago
London
Engage PSG
Salary: £80000 - £90000 per annum + 20% bonus
Posted: 4 days ago
Pudsey, West Yorkshire
Lloyds Banking Group
Salary: £53600 - £71500 per annum + Package
Posted: 3 days ago
London
FPSG Connect
Salary: Benefits
Posted: 3 days ago
City, London
Stott & May
Salary: £35000 - £50000 per annum
Posted: 3 days ago
Chippenham, Wiltshire
Stott & May
Salary: £35000 - £50000 per annum
Posted: 3 days ago
City, London
Coded People
Salary: £80000 - £90000 per annum
Posted: 5 days ago
City, London
Client Server
Salary: £95k to £120k + bonus + benefits
Posted: 2 days ago
West London
Harris Global
Salary: Up to £65,000 per annum + benefits
Posted: 2 days ago
Cambridge, Cambridgeshire
ECM Selection
Salary: to £70k (DoE) + top benefits & bonus
Posted: 3 days ago
Hampshire
Austin Fraser
Salary: £50000 - £55000 per annum + Great Benefits!
Posted: 3 days ago
London
Engage PSG
Salary: £75000 - £85000 per annum + 20% bonus
Posted: 4 days ago
London
Haybrook IT Resourcing Ltd
Salary: Up to £60,000 per annum
Posted: 4 days ago