Period
to 26 February 2020

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 26 February 2020 with a comparison to the same period in the previous 2 years.

Apache Spark
UK > UK excluding London
6 months to
26 Feb 2020
Same period 2019 Same period 2018
Rank 359 349 392
Rank change year-on-year -10 +43 +73
Permanent jobs citing Apache Spark 525 732 730
As % of all permanent IT jobs advertised in the UK excluding London 0.76% 0.86% 0.72%
As % of the Application Platforms category 5.24% 5.80% 4.42%
Number of salaries quoted 427 549 557
UK excluding London median annual salary £60,000 £62,138 £55,000
Median salary % change year-on-year -3.44% +12.98% -
10th Percentile £42,500 £37,500 £32,500
90th Percentile £85,000 £90,000 £83,000
UK median annual salary £72,500 £74,000 £70,000
% change year-on-year -2.03% +5.71% +3.70%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for application platform skills.

All Application Platform Skills
UK excluding London
Permanent vacancies with a requirement for application platform skills 10,016 12,612 16,533
As % of all permanent IT jobs advertised in the UK excluding London 14.55% 14.88% 16.30%
Number of salaries quoted 7,957 9,923 13,523
UK excluding London median annual salary £45,000 £43,000 £41,500
Median salary % change year-on-year +4.65% +3.61% +3.75%
10th Percentile £26,250 £26,250 £25,750
90th Percentile £70,000 £69,750 £65,000
UK median annual salary £50,000 £50,000 £47,500
% change year-on-year - +5.26% +5.56%

Apache Spark
Job Vacancy Trend in the UK excluding London

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Apache Spark in the UK excluding London

Apache Spark
Salary Trend in the UK excluding London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the UK excluding London.

Salary trend for Apache Spark in the UK excluding London

Apache Spark
Salary Histogram in the UK excluding London

The salary distribution of IT jobs citing Apache Spark in the UK excluding London over the 6 months to 26 February 2020.

Salary histogram for Apache Spark in the UK excluding London

Apache Spark
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK excluding London region over the 6 months to 26 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East +3 149 £60,000 -11.11% 29
North of England +9 117 £55,000 -15.38% 13
Midlands +60 110 £72,500 -3.33% 16
East Midlands +42 81 £73,750 -1.67% 6
East of England +54 55 £75,000 +3.45% 7
Yorkshire +40 55 £55,000 +10.73% 5
North West +14 55 £57,500 -17.86% 8
Scotland +3 45 £56,250 +12.50% 20
South West -59 42 £52,500 -4.98% 12
West Midlands +40 29 £60,000 +140.00% 10
North East +1 7 £54,671 -27.10%
Northern Ireland +12 3 £55,000 +29.41% 3
Wales -11 3 - - 2
Channel Islands +2 1 - -
Apache Spark
UK

For the 6 months to 26 February 2020, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Apache Spark.

1 394 (75.05%) Hadoop
2 356 (67.81%) Big Data
3 291 (55.43%) Python
4 257 (48.95%) Agile Software Development
5 249 (47.43%) Java
6 235 (44.76%) Analytics
7 204 (38.86%) SQL
8 186 (35.43%) Scala
9 179 (34.10%) Apache Hive
10 178 (33.90%) Kafka
11 175 (33.33%) AWS
12 133 (25.33%) Machine Learning
13 129 (24.57%) Data Science
14 121 (23.05%) Impala
15 116 (22.10%) Azure
16 109 (20.76%) Finance
17 106 (20.19%) Degree
18 104 (19.81%) Linux
19 102 (19.43%) HBase
20 101 (19.24%) Data Modelling
21 100 (19.05%) Data Engineering
22 99 (18.86%) GCP
23 98 (18.67%) Software Engineering
24 95 (18.10%) NoSQL
25 93 (17.71%) ETL
26 91 (17.33%) Business Intelligence
27 88 (16.76%) Elasticsearch
28 86 (16.38%) Analytical Skills
29 84 (16.00%) Data Warehouse
30 80 (15.24%) Apache

Apache Spark
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 88 (16.76%) Elasticsearch
2 80 (15.24%) Apache
3 31 (5.90%) Apache Solr
4 14 (2.67%) SAS
5 10 (1.90%) nginx
6 6 (1.14%) OpenStack
7 4 (0.76%) Apache Airflow
7 4 (0.76%) JBoss
7 4 (0.76%) Mule
7 4 (0.76%) WildFly
8 3 (0.57%) Apache Pig
8 3 (0.57%) Oracle SOA Suite
8 3 (0.57%) SharePoint
9 2 (0.38%) Camunda
9 2 (0.38%) Jupyter
9 2 (0.38%) Luigi
10 1 (0.19%) Confluence
10 1 (0.19%) GlassFish
10 1 (0.19%) Oracle Coherence
10 1 (0.19%) Tomcat
Applications
1 4 (0.76%) Gephi
2 3 (0.57%) Microsoft Excel
3 1 (0.19%) Microsoft Office
3 1 (0.19%) Microsoft PowerPoint
3 1 (0.19%) SPSS
3 1 (0.19%) Weka
Business Applications
1 5 (0.95%) Sparx Enterprise Architect
2 1 (0.19%) Magento
2 1 (0.19%) NetSuite
Cloud Services
1 175 (33.33%) AWS
2 116 (22.10%) Azure
3 99 (18.86%) GCP
4 29 (5.52%) Power Platform
5 22 (4.19%) Amazon EMR
6 20 (3.81%) Amazon S3
7 14 (2.67%) PaaS
8 13 (2.48%) Amazon Kinesis
9 12 (2.29%) Cloud Computing
10 10 (1.90%) SaaS
11 9 (1.71%) Azure Data Factory
12 8 (1.52%) IaaS
13 7 (1.33%) Amazon SageMaker
13 7 (1.33%) Azure Machine Learning
13 7 (1.33%) Serverless
14 6 (1.14%) OpenShift
14 6 (1.14%) Siri
15 4 (0.76%) AWS Lambda
15 4 (0.76%) Dynamics 365
15 4 (0.76%) GitHub
Communications & Networking
1 13 (2.48%) HTTP
2 9 (1.71%) Firewall
3 8 (1.52%) SSL
4 7 (1.33%) HTTPS
4 7 (1.33%) VPN
5 6 (1.14%) 5G
5 6 (1.14%) DNS
5 6 (1.14%) TCP/IP
6 5 (0.95%) 3G
6 5 (0.95%) 4G
6 5 (0.95%) Ethernet
6 5 (0.95%) MPLS
6 5 (0.95%) Wi-Fi
7 3 (0.57%) Intrusion Detection
8 2 (0.38%) Kerberos
8 2 (0.38%) LTE
8 2 (0.38%) SAN
8 2 (0.38%) WLAN
9 1 (0.19%) Network Security
Database & Business Intelligence
1 394 (75.05%) Hadoop
2 356 (67.81%) Big Data
3 179 (34.10%) Apache Hive
4 121 (23.05%) Impala
5 102 (19.43%) HBase
6 95 (18.10%) NoSQL
7 84 (16.00%) Data Warehouse
8 66 (12.57%) MongoDB
9 59 (11.24%) Apache Cassandra
10 47 (8.95%) PostgreSQL
11 43 (8.19%) SQL Server
12 41 (7.81%) Data Lake
13 37 (7.05%) Relational Database
14 33 (6.29%) Amazon Redshift
15 29 (5.52%) Power BI
16 28 (5.33%) Neo4j
17 26 (4.95%) Apache Kudu
18 24 (4.57%) Flink
18 24 (4.57%) MySQL
19 22 (4.19%) OLTP
Development Applications
1 79 (15.05%) Git (software)
2 47 (8.95%) Jenkins
3 36 (6.86%) JIRA
4 14 (2.67%) Atlassian Bamboo
5 13 (2.48%) git-flow
6 12 (2.29%) Bitbucket
6 12 (2.29%) Subversion
7 9 (1.71%) Mercurial
8 7 (1.33%) Gradle
8 7 (1.33%) Visual Studio Team System
9 6 (1.14%) GitLab
9 6 (1.14%) JUnit
9 6 (1.14%) Selenium
9 6 (1.14%) Sonatype Nexus
10 5 (0.95%) Bitbucket Server
10 5 (0.95%) Cucumber
10 5 (0.95%) Eclipse
10 5 (0.95%) SonarQube
10 5 (0.95%) Visual Studio
11 4 (0.76%) Moq
General
1 109 (20.76%) Finance
2 33 (6.29%) Telecoms
3 18 (3.43%) Retail
4 17 (3.24%) Public Sector
5 14 (2.67%) Marketing
6 13 (2.48%) Automotive
7 8 (1.52%) Electronics
7 8 (1.52%) Games
8 7 (1.33%) Legal
8 7 (1.33%) Manufacturing
9 6 (1.14%) Online Betting
10 5 (0.95%) Banking
11 4 (0.76%) Financial Institution
12 3 (0.57%) Advertising
13 2 (0.38%) Aerospace
14 1 (0.19%) Investment Banking
14 1 (0.19%) Pharmaceutical
14 1 (0.19%) Publishing
14 1 (0.19%) Retail Banking
Job Titles
1 150 (28.57%) Developer
2 142 (27.05%) Data Engineer
3 86 (16.38%) Java Developer
4 63 (12.00%) Senior Developer
5 62 (11.81%) Big Data Engineer
6 60 (11.43%) Architect
7 53 (10.10%) Senior Java Developer
8 51 (9.71%) Data Architect
9 48 (9.14%) Software Engineer
10 33 (6.29%) Agile Developer
10 33 (6.29%) Agile Java Developer
10 33 (6.29%) Big Data Developer
10 33 (6.29%) Data Scientist
11 26 (4.95%) Senior Big Data Developer
12 25 (4.76%) Analyst
13 22 (4.19%) Data Analyst
14 21 (4.00%) Senior Data Engineer
15 20 (3.81%) Big Data Architect
15 20 (3.81%) Lead Developer
15 20 (3.81%) Python Engineer
Libraries, Frameworks & Software Standards
1 178 (33.90%) Kafka
2 42 (8.00%) Node.js
3 36 (6.86%) Spring
4 30 (5.71%) .NET
5 28 (5.33%) REST
6 22 (4.19%) Web Services
7 21 (4.00%) Natural Language Processing
7 21 (4.00%) RabbitMQ
8 20 (3.81%) PySpark
8 20 (3.81%) React
9 18 (3.43%) AngularJS
9 18 (3.43%) J2EE
10 15 (2.86%) HTML
11 13 (2.48%) Elastic Stack
11 13 (2.48%) Spring Boot
11 13 (2.48%) TensorFlow
11 13 (2.48%) ZeroMQ
12 12 (2.29%) RESTful
13 11 (2.10%) CSS
13 11 (2.10%) MLlib
Miscellaneous
1 86 (16.38%) Analytical Skills
2 38 (7.24%) Algorithms
3 32 (6.10%) Greenfield Project
4 31 (5.90%) Public Cloud
5 19 (3.62%) Data Structures
6 17 (3.24%) Video on Demand
7 16 (3.05%) Self-Motivation
8 15 (2.86%) Enterprise Software
9 10 (1.90%) Blog
9 10 (1.90%) Cybercrime
10 9 (1.71%) Management Information System
10 9 (1.71%) User Experience
11 7 (1.33%) Linked Data
12 6 (1.14%) Analytical Mindset
12 6 (1.14%) Cloud Native
12 6 (1.14%) Hybrid Cloud
12 6 (1.14%) iPad
12 6 (1.14%) iPhone
13 5 (0.95%) Cyber Kill Chain
13 5 (0.95%) IBM Mainframe
Operating Systems
1 104 (19.81%) Linux
2 46 (8.76%) Unix
3 20 (3.81%) Windows
4 6 (1.14%) Android
4 6 (1.14%) Apple iOS
5 3 (0.57%) Red Hat Enterprise Linux
6 2 (0.38%) Windows Server
7 1 (0.19%) CoreOS
Processes & Methodologies
1 257 (48.95%) Agile Software Development
2 235 (44.76%) Analytics
3 133 (25.33%) Machine Learning
4 129 (24.57%) Data Science
5 101 (19.24%) Data Modelling
6 100 (19.05%) Data Engineering
7 98 (18.67%) Software Engineering
8 93 (17.71%) ETL
9 91 (17.33%) Business Intelligence
10 78 (14.86%) DevOps
11 75 (14.29%) Technical Leadership
12 70 (13.33%) Data Analytics
12 70 (13.33%) MapReduce
13 67 (12.76%) Scrum
14 57 (10.86%) Computer Science
15 52 (9.90%) Visualisation
16 49 (9.33%) Continuous Integration
17 48 (9.14%) Artificial Intelligence
17 48 (9.14%) Microservices
18 42 (8.00%) Data Analysis
Programming Languages
1 291 (55.43%) Python
2 249 (47.43%) Java
3 204 (38.86%) SQL
4 186 (35.43%) Scala
5 68 (12.95%) R
6 59 (11.24%) C++
7 57 (10.86%) JavaScript
8 34 (6.48%) Bash Shell
9 32 (6.10%) C
10 31 (5.90%) Shell Script
11 29 (5.52%) C#
12 19 (3.62%) MATLAB
13 17 (3.24%) Go
14 13 (2.48%) Perl
14 13 (2.48%) Ruby
15 8 (1.52%) PowerShell
16 7 (1.33%) PHP
17 5 (0.95%) PL/SQL
18 4 (0.76%) T-SQL
18 4 (0.76%) VBA
Qualifications
1 106 (20.19%) Degree
2 48 (9.14%) Security Cleared
3 39 (7.43%) SC Cleared
4 32 (6.10%) DV Cleared
5 31 (5.90%) Computer Science Degree
6 13 (2.48%) PhD
7 12 (2.29%) AWS Certification
8 8 (1.52%) CCNA
8 8 (1.52%) Cisco Certification
9 7 (1.33%) CISSP
9 7 (1.33%) CompTIA Security+
9 7 (1.33%) GIAC
9 7 (1.33%) Linux+ Certification
9 7 (1.33%) MCSE
9 7 (1.33%) Microsoft Certification
9 7 (1.33%) Network+ Certification
9 7 (1.33%) SANS
9 7 (1.33%) SSCP
10 6 (1.14%) Postgraduate
11 3 (0.57%) CEH
Quality Assurance & Compliance
1 24 (4.57%) Data Quality
2 16 (3.05%) QA
3 12 (2.29%) GDPR
4 3 (0.57%) CDISC
4 3 (0.57%) HL7
4 3 (0.57%) ISO 26262
5 2 (0.38%) Sarbanes-Oxley
5 2 (0.38%) SLA
6 1 (0.19%) ISO/IEC 27001
System Software
1 67 (12.76%) Docker
2 57 (10.86%) HDFS
3 31 (5.90%) Apache Flume
4 29 (5.52%) Apache ZooKeeper
5 3 (0.57%) VirtualBox
6 2 (0.38%) Active Directory
7 1 (0.19%) Hyper-V
7 1 (0.19%) VMware Infrastructure
Systems Management
1 55 (10.48%) Kubernetes
2 51 (9.71%) Oozie
3 44 (8.38%) Ansible
4 38 (7.24%) Puppet
5 20 (3.81%) Salt
6 18 (3.43%) Hadoop YARN
7 15 (2.86%) Terraform
8 11 (2.10%) Opscode Chef
9 8 (1.52%) Kibana
10 7 (1.33%) Docker Swarm
11 4 (0.76%) HP Fortify
12 3 (0.57%) Ambari
12 3 (0.57%) Grafana
13 2 (0.38%) Graphite
13 2 (0.38%) logstash
13 2 (0.38%) Mesos
13 2 (0.38%) Nagios
13 2 (0.38%) Opsview
13 2 (0.38%) Single Sign-On
14 1 (0.19%) Prometheus
Vendors
1 62 (11.81%) Google
2 44 (8.38%) Tableau
3 40 (7.62%) Cloudera
4 36 (6.86%) Oracle
5 25 (4.76%) Microsoft
6 23 (4.38%) Informatica
7 21 (4.00%) Databricks
8 20 (3.81%) Talend
9 14 (2.67%) Hortonworks
9 14 (2.67%) IBM
10 10 (1.90%) Splunk
11 9 (1.71%) SAP
12 8 (1.52%) Teradata
12 8 (1.52%) Vertica
13 6 (1.14%) Apple
13 6 (1.14%) MapR
13 6 (1.14%) TIBCO
13 6 (1.14%) VMware
14 5 (0.95%) Sparx
15 4 (0.76%) MicroStrategy