The following table provides summary statistics for permanent job vacancies with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 3 months to 26 March 2017 with a comparison to the same period in the previous 2 years.

3 months to
26 Mar 2017
Same period 2016 Same period 2015
Apache Spark
UK
Rank 286 378 829
Rank change year-on-year +92 +451  
Permanent jobs citing Apache Spark 917 820 137
As % of all permanent IT jobs advertised in the UK 1.09% 0.79% 0.13%
As % of the Application Platforms category 6.17% 4.20% 0.66%
Number of salaries quoted 762 688 122
Median salary £66,000 £65,000 £63,750
Median salary % change year-on-year +1.53% +1.96%  
90% offered a salary of more than £45,000 £45,000 £45,000
10% offered a salary of more than £95,000 £97,500 £85,000
UK excluding London median salary £55,000 £50,000 £50,000
% change year-on-year +10.00% -  

Apache Spark is in the application platform skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for application platform skills.

Application Platform Skills
UK
Permanent job vacancies with a requirement for application platform skills 14869 19528 20885
As % of all permanent IT job vacancies advertised in the UK 17.71% 18.89% 19.62%
Number of salaries quoted 12343 16434 17321
Median salary £47,500 £45,000 £45,000
Median salary % change year-on-year +5.55% -  
90% offered a salary of more than £28,500 £27,500 £27,000
10% offered a salary of more than £72,500 £70,000 £70,000
UK excluding London median salary £40,000 £40,000 £40,000

Apache Spark
Job Vacancy Trend

The job posting trend of jobs advertised citing Apache Spark as a proportion of all permanent or contract IT jobs with a match in the Application Platforms category.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark.

Salary trend for Apache Spark in the UK

Apache Spark
Salary Histogram

The salary distribution of IT jobs citing Apache Spark over the 3 months to 26 March 2017.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 30 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 3 months to 26 March 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 3 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Last 3 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +95 876 £67,500 +3.84% 147
London +45 587 £70,000 +3.70% 100
City of London +9 70 £76,250 +22.00% 24
South East +94 67 £65,000 +39.78% 11
South West +47 53 £50,000 +17.64% 5
North West +34 51 £55,000 +10.00% 11
East of England +45 45 £55,000 -8.33% 10
Manchester +26 44 £56,250 +87.50% 9
West Midlands -6 27 £60,000 +4.34% 2
Surrey +59 24 £57,500 +5.50% 2
Scotland +37 23 £77,500 +47.61% 5
Birmingham +39 22 £55,000 -38.88%
Yorkshire +19 20 £55,000 +25.00% 5
Bristol +14 20 £55,000 +37.50% 2
Essex - 20 £50,000 - 1
East Midlands +22 19 £42,500 +13.33%
Oxfordshire +16 17 £65,000 +52.94% 3
Gloucestershire +13 17 £40,000 -15.78%
Cambridgeshire +17 15 £55,000 -8.33% 7
Cambridge - 15 £55,000 - 7
Edinburgh +10 14 £77,500 +34.78% 3
Derby - 14 £42,500 -
Derbyshire - 14 £42,500 -
Hampshire +38 13 £67,500 +107.69% 2
Berkshire +33 12 £68,750 +10.00% 4
West Yorkshire +22 12 £55,000 +25.00% 3
Leeds +16 12 £55,000 +11.11% 3
South Wales +20 11 £35,000 -3.44% 4
Wales +14 11 £35,000 -3.44% 4
Somerset +4 11 £40,000 -29.82% 1

Apache Spark
Top 30 Related IT Skills

For the 6 months to 26 March 2017, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Apache Spark.

1 1402 (74.10%) Hadoop
2 1396 (73.78%) Big Data
3 1131 (59.78%) Java
4 952 (50.32%) Python
5 810 (42.81%) Agile Software Development
6 649 (34.30%) Scala
7 637 (33.67%) Apache Hive
8 603 (31.87%) Analytics
9 574 (30.34%) SQL
10 525 (27.75%) NoSQL
11 480 (25.37%) Amazon AWS
12 472 (24.95%) MongoDB
13 466 (24.63%) Machine Learning
14 435 (22.99%) Finance
15 426 (22.52%) Degree
16 407 (21.51%) Apache Cassandra
17 381 (20.14%) Software Engineering
18 375 (19.82%) Kafka
19 358 (18.92%) TDD
19 358 (18.92%) Apache
20 344 (18.18%) Computer Science
21 342 (18.08%) Linux
22 335 (17.71%) Apache Pig
23 324 (17.12%) Elasticsearch
24 322 (17.02%) R
25 312 (16.49%) C#
26 310 (16.38%) JavaScript
27 308 (16.28%) Scrum
28 306 (16.17%) Algorithms
29 299 (15.80%) HBase

Apache Spark
Top Related IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 358 (18.92%) Apache
2 335 (17.71%) Apache Pig
3 324 (17.12%) Elasticsearch
4 150 (7.93%) Tomcat
5 144 (7.61%) Apache Solr
6 107 (5.66%) JBoss
7 102 (5.39%) Jetty
8 98 (5.18%) OpenStack
9 96 (5.07%) SAS
10 78 (4.12%) WebSphere
11 75 (3.96%) WebLogic
12 35 (1.85%) Confluence
13 18 (0.95%) Apache Airflow
14 16 (0.85%) WebSphere Application Server
15 15 (0.79%) Cloud Foundry
16 14 (0.74%) GlassFish
17 11 (0.58%) MQSeries
18 7 (0.37%) Luigi
19 6 (0.32%) Tornado
20 4 (0.21%) Jupyter
Applications
1 42 (2.22%) MS Excel
2 36 (1.90%) SPSS
3 7 (0.37%) Stata
4 5 (0.26%) SPSS Modeler
4 5 (0.26%) Weka
5 4 (0.21%) S-PLUS
5 4 (0.21%) Spreadsheet
6 2 (0.11%) Gephi
Business Applications
1 23 (1.22%) SAP Oil and Gas
2 8 (0.42%) Sentinel
Cloud Services
1 480 (25.37%) Amazon AWS
2 194 (10.25%) Microsoft Azure
3 71 (3.75%) Google Cloud Platform
4 69 (3.65%) GitHub
5 48 (2.54%) Amazon EC2
6 47 (2.48%) Cloud Computing
7 46 (2.43%) Amazon EMR
8 42 (2.22%) SaaS
9 40 (2.11%) Amazon Kinesis
9 40 (2.11%) Amazon S3
10 22 (1.16%) IaaS
11 20 (1.06%) AWS Lambda
12 18 (0.95%) PaaS
13 9 (0.48%) Google App Engine
14 8 (0.42%) IBM Cloud
15 7 (0.37%) Bluemix
16 5 (0.26%) Amazon CloudWatch
16 5 (0.26%) Amazon SQS
16 5 (0.26%) Google Analytics
16 5 (0.26%) OpenShift
Communications & Networking
1 35 (1.85%) Kerberos
2 32 (1.69%) Internet
3 27 (1.43%) HTTP
4 17 (0.90%) TCP/IP
5 13 (0.69%) LDAP
6 10 (0.53%) DNS
7 7 (0.37%) Network Security
8 6 (0.32%) SAN
9 5 (0.26%) FTP
10 4 (0.21%) LAN
10 4 (0.21%) SSL
10 4 (0.21%) tcpdump
10 4 (0.21%) WAN
10 4 (0.21%) Wireshark
11 3 (0.16%) MVNO
11 3 (0.16%) Software-Defined Networking
12 2 (0.11%) Intranet
12 2 (0.11%) Multicast
13 1 (0.053%) Wireless
Database & Business Intelligence
1 1402 (74.10%) Hadoop
2 1396 (73.78%) Big Data
3 637 (33.67%) Apache Hive
4 525 (27.75%) NoSQL
5 472 (24.95%) MongoDB
6 407 (21.51%) Apache Cassandra
7 299 (15.80%) HBase
8 285 (15.06%) MySQL
9 243 (12.84%) Relational Database
10 240 (12.68%) SQL Server
11 162 (8.56%) PostgreSQL
12 161 (8.51%) Redis
13 154 (8.14%) RDBMS
14 149 (7.88%) Impala
15 144 (7.61%) Data Warehouse
16 114 (6.03%) Data Mining
16 114 (6.03%) Neo4j
17 96 (5.07%) Sqoop
18 87 (4.60%) Amazon Redshift
19 86 (4.55%) Couchbase
Development Applications
1 138 (7.29%) Git (software)
2 101 (5.34%) Jenkins
3 64 (3.38%) Maven
4 53 (2.80%) Vagrant
5 42 (2.22%) Selenium
6 41 (2.17%) JIRA
7 34 (1.80%) JUnit
8 24 (1.27%) Talend Open Studio
9 22 (1.16%) Subversion
10 18 (0.95%) TeamCity
11 17 (0.90%) Ant
11 17 (0.90%) Atlassian Bamboo
12 15 (0.79%) Gradle
12 15 (0.79%) Jasmine
12 15 (0.79%) Travis CI
13 14 (0.74%) Mockito
14 13 (0.69%) Eclipse
14 13 (0.69%) Grunt
15 11 (0.58%) Hudson
15 11 (0.58%) Sonatype Nexus
General
1 435 (22.99%) Finance
2 246 (13.00%) Banking
3 152 (8.03%) Marketing
4 124 (6.55%) Retail
5 77 (4.07%) Games
6 69 (3.65%) Telecoms
7 61 (3.22%) Investment Banking
8 36 (1.90%) Military
9 34 (1.80%) Advertising
10 29 (1.53%) Front Office
10 29 (1.53%) Manufacturing
11 26 (1.37%) Electronics
12 21 (1.11%) Financial Institution
12 21 (1.11%) Legal
13 14 (0.74%) Automotive
14 13 (0.69%) Publishing
15 11 (0.58%) Pharmaceutical
16 6 (0.32%) Billing
17 5 (0.26%) Law
18 4 (0.21%) Aerospace
Job Titles
1 670 (35.41%) Developer
2 349 (18.45%) Java Developer
3 328 (17.34%) Data Engineer
4 251 (13.27%) Data Scientist
5 207 (10.94%) Architect
6 205 (10.84%) Big Data Engineer
7 192 (10.15%) Senior Developer
8 184 (9.73%) Software Engineer
9 136 (7.19%) Java Engineer
10 134 (7.08%) Data Architect
11 128 (6.77%) Big Data Developer
12 127 (6.71%) Scala Developer
13 103 (5.44%) Apache Spark Developer
13 103 (5.44%) Big Data Architect
14 96 (5.07%) Senior Java Developer
15 93 (4.92%) Hadoop Engineer
16 86 (4.55%) Senior Data Scientist
17 81 (4.28%) Software Developer
18 76 (4.02%) Hadoop Developer
19 65 (3.44%) Consultant
Libraries, Frameworks & Software Standards
1 375 (19.82%) Kafka
2 298 (15.75%) AngularJS
3 197 (10.41%) Node.js
4 183 (9.67%) Spring
5 168 (8.88%) HTML
6 153 (8.09%) React
7 137 (7.24%) Web Services
8 127 (6.71%) REST
9 121 (6.40%) HTML5
10 111 (5.87%) .NET
11 109 (5.76%) Lucene
12 101 (5.34%) CSS
13 99 (5.23%) Java EE
14 97 (5.13%) Elastic Stack
15 93 (4.92%) Hibernate
16 74 (3.91%) Middleware
17 68 (3.59%) Akka
18 66 (3.49%) CSS3
19 64 (3.38%) Apache Camel
20 62 (3.28%) RabbitMQ
Miscellaneous
1 344 (18.18%) Computer Science
2 306 (16.17%) Algorithms
3 188 (9.94%) Analytical Skills
4 87 (4.60%) Fintech
5 85 (4.49%) Data Structures
6 39 (2.06%) PKI
7 38 (2.01%) Enterprise Software
8 35 (1.85%) Credit Risk
8 35 (1.85%) Foreign Exchange (FX)
9 33 (1.74%) Hedge funds
10 21 (1.11%) Mobile App
11 20 (1.06%) Public Cloud
11 20 (1.06%) Replication
12 19 (1.00%) Clustering
12 19 (1.00%) User Experience
13 18 (0.95%) Social Media
14 17 (0.90%) Derivative
15 16 (0.85%) Management Information System
16 15 (0.79%) Data Centre
16 15 (0.79%) Semantic Web
Operating Systems
1 342 (18.08%) Linux
2 125 (6.61%) Unix
3 74 (3.91%) Android
3 74 (3.91%) Apple iOS
4 46 (2.43%) Windows
5 29 (1.53%) Red Hat Enterprise Linux
6 22 (1.16%) CentOS
7 7 (0.37%) VMS
8 6 (0.32%) CoreOS
9 5 (0.26%) Ubuntu
10 4 (0.21%) Debian
11 3 (0.16%) Windows Server
11 3 (0.16%) Windows XP
12 1 (0.053%) Mac OS X
Processes & Methodologies
1 810 (42.81%) Agile Software Development
2 603 (31.87%) Analytics
3 466 (24.63%) Machine Learning
4 381 (20.14%) Software Engineering
5 358 (18.92%) TDD
6 308 (16.28%) Scrum
7 273 (14.43%) Business Intelligence
8 255 (13.48%) DevOps
9 245 (12.95%) Mathematics
10 235 (12.42%) Visualisation
11 217 (11.47%) Open Source
12 216 (11.42%) MapReduce
13 208 (10.99%) Continuous Integration
14 207 (10.94%) Mentoring
15 201 (10.62%) ETL
16 184 (9.73%) Multithreading
17 177 (9.36%) Data Analytics
18 175 (9.25%) Statistics
19 174 (9.20%) OO
20 155 (8.19%) SDLC
Programming Languages
1 1131 (59.78%) Java
2 952 (50.32%) Python
3 649 (34.30%) Scala
4 574 (30.34%) SQL
5 322 (17.02%) R
6 312 (16.49%) C#
7 310 (16.38%) JavaScript
8 188 (9.94%) C++
9 172 (9.09%) Perl
10 123 (6.50%) C
11 111 (5.87%) Ruby
12 102 (5.39%) Bash Shell
13 98 (5.18%) Go
14 68 (3.59%) MATLAB
15 59 (3.12%) PHP
16 37 (1.96%) T-SQL
17 33 (1.74%) Shell Script
18 22 (1.16%) PL/SQL
19 16 (0.85%) Clojure
19 16 (0.85%) Groovy
Qualifications
1 426 (22.52%) Degree
2 147 (7.77%) PhD
3 70 (3.70%) Security Cleared
4 47 (2.48%) DV Cleared
5 15 (0.79%) SC Cleared
6 12 (0.63%) Postgraduate
7 11 (0.58%) CISSP
8 9 (0.48%) Microsoft Certification
9 8 (0.42%) MCTS
10 6 (0.32%) CEH
10 6 (0.32%) ISTQB
10 6 (0.32%) ISTQB Foundation Certification
11 5 (0.26%) CISM
11 5 (0.26%) GCIH
11 5 (0.26%) OSCP
12 1 (0.053%) CISA
12 1 (0.053%) EMC Certification
12 1 (0.053%) GCFA
12 1 (0.053%) GCIA
12 1 (0.053%) IIBA
Quality Assurance & Compliance
1 79 (4.18%) QA
2 57 (3.01%) Data Quality
3 12 (0.63%) Sarbanes-Oxley
4 9 (0.48%) GCP
5 3 (0.16%) GPG13
5 3 (0.16%) ISO/IEC 27001
6 2 (0.11%) SLA
7 1 (0.053%) Basel III
7 1 (0.053%) Dodd-Frank
7 1 (0.053%) IAS 39
7 1 (0.053%) IFRS
7 1 (0.053%) IFRS 9
System Software
1 201 (10.62%) Docker
2 188 (9.94%) HDFS
3 107 (5.66%) Apache Flume
4 56 (2.96%) VMware Infrastructure
5 52 (2.75%) Hyper-V
6 37 (1.96%) Apache ZooKeeper
7 20 (1.06%) Virtual Machines
8 9 (0.48%) VirtualBox
9 7 (0.37%) LXC
10 5 (0.26%) Snort
11 2 (0.11%) etcd
11 2 (0.11%) Oracle RAC
12 1 (0.053%) GlusterFS
12 1 (0.053%) Xen
Systems Management
1 205 (10.84%) Ansible
2 199 (10.52%) Puppet
3 182 (9.62%) Opscode Chef
4 115 (6.08%) Oozie
5 114 (6.03%) Kibana
6 87 (4.60%) logstash
7 79 (4.18%) Salt
8 55 (2.91%) Kubernetes
9 51 (2.70%) Hadoop YARN
10 48 (2.54%) Mesos
11 16 (0.85%) Docker Swarm
12 13 (0.69%) Ambari
13 12 (0.63%) Nagios
14 10 (0.53%) Terraform
15 9 (0.48%) QRadar
16 8 (0.42%) rkt
16 8 (0.42%) ZABBIX
17 6 (0.32%) Oracle ZFS
18 5 (0.26%) Fluentd
19 4 (0.21%) HP Fortify
Vendors
1 255 (13.48%) Oracle
2 106 (5.60%) Tableau
3 91 (4.81%) Cloudera
4 85 (4.49%) Google
5 80 (4.23%) Microsoft
6 71 (3.75%) Hortonworks
7 57 (3.01%) VMware
8 42 (2.22%) Splunk
9 35 (1.85%) SAP
9 35 (1.85%) TIBCO
10 31 (1.64%) Informatica
11 29 (1.53%) IBM
12 25 (1.32%) MapR
13 24 (1.27%) Talend
14 22 (1.16%) Red Hat
14 22 (1.16%) Teradata
15 15 (0.79%) Facebook
16 14 (0.74%) New Relic
17 13 (0.69%) Alteryx
17 13 (0.69%) Atlassian
Central London / West End
Initi8 Recruitment
Salary: £65000 - £75000 Per Annum plus 10% annual bonus
Posted: 14 hours ago
Central London / West End
Initi8 Recruitment
Salary: £55000 - £70000 Per Annum
Posted: 14 hours ago
Central London / West End
Initi8 Recruitment
Salary: £55000 - £70000 Per Annum plus 12.5 annual bonus + private medical
Posted: 2 hours ago
London
Cititec
Salary: £105000 - £115000 per annum + Bonuses + Benefits
Posted: Yesterday
London
Nicoll Curtin
Salary: £55000 - £80000.00 per annum + Bonus & Package
Posted: 2 days ago
London
Spencer Rose
Salary: £65000 per annum
Posted: 2 days ago
Central London / West End
Initi8 Recruitment
Salary: £60000 - £70000 Per Annum 10% annual bonus + private medical care
Posted: 14 hours ago
Cambridge, Cambridgeshire
Softweb Resourcing Limited
Salary: From £40,000 to £65,000 per annum Salary DOE + Benefits
Posted: 2 days ago
London
Venturi
Salary: £50000.00 - £70000.00 per annum + Bonus & Benefits
Posted: 2 days ago
Bristol, Avon
Mortimer Spinks
Salary: £55000 - £80000 per annum
Posted: 2 days ago
City, London
Big Wednesday Digital Ltd
Salary: £55000 - £95000 per annum + negotiable
Posted: 2 days ago
City, London
TEKsystems
Salary: £80000 - £95000 per annum + benefits + bonus
Posted: 2 days ago
London
Nicoll Curtin
Salary: £75000 - £120000.00 per annum + Bonus & Package
Posted: 3 days ago
London
Salt
Salary: £50000.00 - £55000.00 per annum
Posted: 3 days ago
Edinburgh, Midlothian
HAYS INFORMATION TECHNOLOGY
Salary: £60000.00 - £75000.00 per annum
Posted: 3 days ago
London
Engage PSG
Salary: £55000 - £65000 per annum + 10% bonus
Posted: 4 days ago
London
People Source Consulting
Salary: £48000 - £55000 per annum + bonus + benefits
Posted: 2 days ago
Cambridge, Cambridgeshire
Empiric.com
Salary: Completely negotiable and excellent with comprehensive benefits
Posted: 5 days ago
London
TEKsystems
Salary: £80000 - £90000 per annum + bonus and benefits
Posted: 3 days ago
London
ClearCube Consulting
Salary: From £40,000 to £65,000 per annum
Posted: 4 days ago
Central London / West End
ClearCube Consulting
Salary: From £50,000 to £70,000 per annum + Benefits
Posted: 4 days ago
City, London
Experis Ltd
Posted: 3 days ago
London
Client Server
Salary: £60k to £70k + benefits
Posted: 2 days ago
City, London
TEKsystems
Salary: £40000 - £70000 per annum + benefits + bonus
Posted: 3 days ago
Cardiff, South Glamorgan
CPS Group UK
Salary: £35000 per annum
Posted: 3 days ago
London
Opus Recruitment Solutions Ltd
Salary: £60000 - £100000 per annum, Benefits Benefits & Bonus included
Posted: 6 days ago
Hemel Hempstead, Hertfordshire
Churchill Frank
Salary: £75000 - £90000 per annum
Posted: 4 days ago
Hampshire
Austin Fraser
Salary: £60000.00 - £75000.00 per annum + Benefits
Posted: 3 days ago
London
Premier IT
Salary: £60000 - £100000 per annum
Posted: 3 days ago
London
Martin & Conley
Salary: COMPETITIVE SALARY + EXCELLENT BENEFITS
Posted: 2 days ago