Period
to 21 October 2019

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 21 October 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South East
6 months to
21 Oct 2019
Same period 2018 Same period 2017
Rank 340 293 326
Rank change year-on-year -47 +33 +127
Permanent jobs citing Apache Spark 164 262 236
As % of all permanent IT jobs advertised in the South East 0.65% 0.91% 0.82%
As % of the Application Platforms category 4.37% 5.50% 4.56%
Number of salaries quoted 132 190 209
South East median annual salary £60,000 £58,000 £60,000
Median salary % change year-on-year +3.45% -3.33% +4.35%
10th Percentile £36,250 £38,750 £38,750
90th Percentile £85,000 £86,250 £84,000
England median annual salary £75,000 £70,000 £67,000
% change year-on-year +7.14% +4.48% +1.13%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for application platform skills.

All Application Platform Skills
South East
Permanent vacancies with a requirement for application platform skills 3,753 4,760 5,176
As % of all permanent IT jobs advertised in the South East 14.78% 16.46% 17.95%
Number of salaries quoted 2,987 3,991 4,353
South East median annual salary £47,500 £45,500 £42,500
Median salary % change year-on-year +4.40% +7.06% -3.41%
10th Percentile £27,000 £27,500 £25,500
90th Percentile £75,000 £70,000 £67,500
England median annual salary £50,000 £50,000 £47,500
% change year-on-year - +5.26% +5.56%

Apache Spark
Job Vacancy Trend in the South East

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Apache Spark in the South East

Apache Spark
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the South East.

Salary trend for Apache Spark in the South East

Apache Spark
Salary Histogram in the South East

The salary distribution of IT jobs citing Apache Spark in the South East over the 6 months to 21 October 2019.

Salary histogram for Apache Spark in the South East

Apache Spark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South East region over the 6 months to 21 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley -6 79 £62,500 +11.11% 12
Hampshire +25 62 £50,000 -33.33% 7
Berkshire +11 60 £62,500 -10.71% 10
Surrey -3 18 £77,500 +47.62% 1
Oxfordshire +22 12 £62,500 +13.64% 2
Buckinghamshire -13 7 £47,500 -24.00%
East Sussex -8 4 £37,500 -34.78% 1
Middlesex - 1 £60,000 -
Apache Spark
England

For the 6 months to 21 October 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for Apache Spark.

1 117 (71.34%) Hadoop
2 90 (54.88%) Python
3 89 (54.27%) Java
4 79 (48.17%) Agile Software Development
4 79 (48.17%) Analytics
5 75 (45.73%) Big Data
6 63 (38.41%) Data Science
7 59 (35.98%) Apache Cassandra
8 57 (34.76%) SQL
9 48 (29.27%) Apache
9 48 (29.27%) Scala
10 46 (28.05%) Software Engineering
11 43 (26.22%) ETL
11 43 (26.22%) NoSQL
12 42 (25.61%) Git (software)
12 42 (25.61%) Microservices
13 40 (24.39%) AWS
14 39 (23.78%) Algorithms
15 38 (23.17%) Docker
16 37 (22.56%) MongoDB
17 36 (21.95%) Machine Learning
17 36 (21.95%) Security Cleared
17 36 (21.95%) Data Warehouse
18 35 (21.34%) C#
18 35 (21.34%) Artificial Intelligence
19 33 (20.12%) Telecoms
19 33 (20.12%) Azure
20 32 (19.51%) Business Intelligence
21 31 (18.90%) Spring
21 31 (18.90%) DevOps

Apache Spark
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 48 (29.27%) Apache
2 23 (14.02%) Hyperledger
3 10 (6.10%) Elasticsearch
4 7 (4.27%) Apache Solr
4 7 (4.27%) SAS
5 5 (3.05%) Apache Pig
6 3 (1.83%) Jupyter
7 2 (1.22%) Apache Airflow
8 1 (0.61%) Cloud Foundry
8 1 (0.61%) Confluence
8 1 (0.61%) JBoss
8 1 (0.61%) OpenStack
Applications
1 1 (0.61%) Microsoft Excel
1 1 (0.61%) Microsoft Office
1 1 (0.61%) Microsoft PowerPoint
1 1 (0.61%) MS Visio
1 1 (0.61%) Weka
Cloud Services
1 40 (24.39%) AWS
2 33 (20.12%) Azure
3 19 (11.59%) GCP
4 14 (8.54%) Power Platform
5 6 (3.66%) Amazon EC2
5 6 (3.66%) Amazon EMR
5 6 (3.66%) Amazon S3
5 6 (3.66%) Data Lake Analytics
5 6 (3.66%) Dynamics 365
6 4 (2.44%) Azure Data Factory
6 4 (2.44%) Azure Machine Learning
6 4 (2.44%) Cloud Computing
6 4 (2.44%) Cortana Intelligence Suite
7 3 (1.83%) PaaS
7 3 (1.83%) SaaS
8 1 (0.61%) GitHub
8 1 (0.61%) Heroku
8 1 (0.61%) IaaS
8 1 (0.61%) OpenShift
Communications & Networking
1 2 (1.22%) SSL
2 1 (0.61%) VXLAN
Database & Business Intelligence
1 117 (71.34%) Hadoop
2 75 (45.73%) Big Data
3 59 (35.98%) Apache Cassandra
4 43 (26.22%) NoSQL
5 37 (22.56%) MongoDB
6 36 (21.95%) Data Warehouse
7 29 (17.68%) Apache Hive
8 23 (14.02%) Blockchain
9 16 (9.76%) Data Lake
10 14 (8.54%) Power BI
11 13 (7.93%) HBase
12 11 (6.71%) MySQL
12 11 (6.71%) Relational Database
13 9 (5.49%) Amazon Redshift
13 9 (5.49%) Geospatial Data
13 9 (5.49%) Neo4j
13 9 (5.49%) SQL Server
14 7 (4.27%) IBM InfoSphere
14 7 (4.27%) Impala
15 6 (3.66%) Amazon RDS
Development Applications
1 42 (25.61%) Git (software)
2 27 (16.46%) Bitbucket
3 10 (6.10%) JIRA
3 10 (6.10%) Visual Studio
4 9 (5.49%) Visual Studio Team System
5 8 (4.88%) Jenkins
6 6 (3.66%) Maven
7 2 (1.22%) GitLab
8 1 (0.61%) Gradle
General
1 33 (20.12%) Telecoms
2 24 (14.63%) Finance
3 21 (12.80%) Public Sector
4 6 (3.66%) Marketing
5 5 (3.05%) Electronics
5 5 (3.05%) Manufacturing
6 4 (2.44%) Retail
7 1 (0.61%) Banking
7 1 (0.61%) French Language
7 1 (0.61%) German Language
7 1 (0.61%) Legal
7 1 (0.61%) Retail Banking
Job Titles
1 36 (21.95%) Data Engineer
2 34 (20.73%) Developer
3 33 (20.12%) Software Engineer
4 25 (15.24%) Java Developer
5 22 (13.41%) Architect
6 21 (12.80%) Data Architect
6 21 (12.80%) Senior Developer
7 20 (12.20%) Senior Java Developer
8 13 (7.93%) Big Data Engineer
9 12 (7.32%) Senior Software Engineer
10 11 (6.71%) Python Engineer
11 10 (6.10%) Big Data Architect
11 10 (6.10%) Technical Leader
12 9 (5.49%) Data Scientist
12 9 (5.49%) Lead DevOps
12 9 (5.49%) Lead Software Engineer
12 9 (5.49%) Solutions Architect
13 8 (4.88%) AWS Engineer
13 8 (4.88%) Data Analytics Architect
14 5 (3.05%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 31 (18.90%) scikit-learn
1 31 (18.90%) Spring
2 30 (18.29%) Pandas
3 27 (16.46%) Akka
3 27 (16.46%) Spring Cloud
4 23 (14.02%) OAuth
4 23 (14.02%) RESTful
4 23 (14.02%) SAML
4 23 (14.02%) Swagger
5 22 (13.41%) Kafka
6 14 (8.54%) TensorFlow
7 9 (5.49%) Keras
8 8 (4.88%) J2EE
9 6 (3.66%) Apache NiFi
9 6 (3.66%) Spark Streaming
9 6 (3.66%) Theano
10 5 (3.05%) Natural Language Processing
11 4 (2.44%) Apache Drill
11 4 (2.44%) Dask
11 4 (2.44%) ZeroMQ
Miscellaneous
1 39 (23.78%) Algorithms
2 27 (16.46%) Private Cloud
2 27 (16.46%) Public Cloud
3 20 (12.20%) Analytical Skills
3 20 (12.20%) Video on Demand
4 10 (6.10%) Greenfield Project
5 8 (4.88%) Management Information System
6 7 (4.27%) Data Structures
6 7 (4.27%) Linked Data
7 6 (3.66%) Enterprise Software
8 3 (1.83%) Hybrid Cloud
8 3 (1.83%) IBM Mainframe
8 3 (1.83%) Mainframe
8 3 (1.83%) Reference Data
8 3 (1.83%) Self-Motivation
9 2 (1.22%) CUDA
9 2 (1.22%) Replication
9 2 (1.22%) Smart City
10 1 (0.61%) Cybercrime
10 1 (0.61%) Data Centre
Operating Systems
1 12 (7.32%) Linux
2 10 (6.10%) Windows
3 6 (3.66%) Unix
Processes & Methodologies
1 79 (48.17%) Agile Software Development
1 79 (48.17%) Analytics
2 63 (38.41%) Data Science
3 46 (28.05%) Software Engineering
4 43 (26.22%) ETL
5 42 (25.61%) Microservices
6 36 (21.95%) Machine Learning
7 35 (21.34%) Artificial Intelligence
8 32 (19.51%) Business Intelligence
9 31 (18.90%) DevOps
10 30 (18.29%) Open Source
11 23 (14.02%) API Development
11 23 (14.02%) Cryptography
12 22 (13.41%) Data Modelling
13 21 (12.80%) Data Architecture
14 19 (11.59%) Data Analytics
15 18 (10.98%) Computer Science
15 18 (10.98%) Data Engineering
15 18 (10.98%) Data Management
16 16 (9.76%) Data Integration
Programming Languages
1 90 (54.88%) Python
2 89 (54.27%) Java
3 57 (34.76%) SQL
4 48 (29.27%) Scala
5 35 (21.34%) C#
6 13 (7.93%) R
7 12 (7.32%) C++
8 9 (5.49%) Bash Shell
8 9 (5.49%) PowerShell
9 7 (4.27%) C
10 6 (3.66%) JavaScript
11 3 (1.83%) HiveQL
12 2 (1.22%) Java 8
12 2 (1.22%) Ruby
12 2 (1.22%) Shell Script
13 1 (0.61%) Go
13 1 (0.61%) MATLAB
13 1 (0.61%) Perl
13 1 (0.61%) PHP
Qualifications
1 36 (21.95%) Security Cleared
2 28 (17.07%) Degree
3 19 (11.59%) SC Cleared
4 10 (6.10%) DV Cleared
5 9 (5.49%) PhD
6 6 (3.66%) AWS Certification
7 5 (3.05%) Computer Science Degree
8 3 (1.83%) Numerate Degree
Quality Assurance & Compliance
1 18 (10.98%) Data Quality
2 7 (4.27%) QA
System Software
1 38 (23.17%) Docker
2 7 (4.27%) Apache ZooKeeper
3 6 (3.66%) HDFS
4 4 (2.44%) Apache Flume
5 1 (0.61%) Ceph
5 1 (0.61%) Virtual Servers
Systems Management
1 11 (6.71%) Kubernetes
1 11 (6.71%) Puppet
2 10 (6.10%) Hadoop YARN
3 7 (4.27%) Ansible
4 5 (3.05%) Oozie
4 5 (3.05%) Salt
5 4 (2.44%) Opscode Chef
5 4 (2.44%) Terraform
6 2 (1.22%) Kibana
6 2 (1.22%) logstash
7 1 (0.61%) Chukwa
7 1 (0.61%) Single Sign-On
Vendors
1 19 (11.59%) Microsoft
2 15 (9.15%) Oracle
3 9 (5.49%) SAP
4 8 (4.88%) Cloudera
4 8 (4.88%) Hortonworks
4 8 (4.88%) IBM
5 7 (4.27%) Tableau
6 6 (3.66%) Databricks
7 4 (2.44%) Google
7 4 (2.44%) Teradata
8 3 (1.83%) Informatica
8 3 (1.83%) MapR
8 3 (1.83%) TIBCO
8 3 (1.83%) Vertica
8 3 (1.83%) VMware
9 2 (1.22%) Talend
10 1 (0.61%) Adobe
10 1 (0.61%) Netezza
10 1 (0.61%) Paxata
10 1 (0.61%) StreamSets