Period
to 16 July 2019

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 16 July 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South East
6 months to
16 Jul 2019
Same period 2018 Same period 2017
Rank 351 315 343
Rank change year-on-year -36 +28 +144
Permanent jobs citing Apache Spark 160 256 212
As % of all permanent IT jobs advertised in the South East 0.60% 0.84% 0.71%
As % of the Application Platforms category 4.07% 4.88% 3.86%
Number of salaries quoted 112 214 179
South East median annual salary £68,750 £60,000 £65,000
Median salary % change year-on-year +14.58% -7.69% +15.56%
10th Percentile £46,375 £30,000 £41,250
90th Percentile £92,250 £86,250 £84,000
England median annual salary £75,000 £70,000 £67,500
% change year-on-year +7.14% +3.70% +3.85%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for application platform skills.

All Application Platform Skills
South East
Permanent vacancies with a requirement for application platform skills 3,935 5,242 5,496
As % of all permanent IT jobs advertised in the South East 14.77% 17.16% 18.37%
Number of salaries quoted 3,170 4,429 4,665
South East median annual salary £48,750 £45,000 £42,500
Median salary % change year-on-year +8.33% +5.88% -
10th Percentile £27,500 £27,000 £25,750
90th Percentile £73,750 £70,000 £65,625
England median annual salary £51,000 £50,000 £47,500
% change year-on-year +2.00% +5.26% +5.56%

Apache Spark
Job Vacancy Trend in the South East

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Apache Spark in the South East

Apache Spark
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the South East.

Salary trend for Apache Spark in the South East

Apache Spark
Salary Histogram in the South East

The salary distribution of IT jobs citing Apache Spark in the South East over the 6 months to 16 July 2019.

Salary histogram for Apache Spark in the South East

Apache Spark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South East region over the 6 months to 16 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley 0 75 £62,000 +3.33% 12
Berkshire +23 59 £62,500 +4.17% 8
Hampshire +25 56 £68,750 -1.79% 3
Surrey -13 21 £90,000 +50.00% 1
Oxfordshire +16 11 £65,000 +15.56% 2
East Sussex 0 6 £37,500 -36.17% 1
Buckinghamshire +7 5 £47,500 -19.15% 2
Middlesex +6 2 £75,000 +38.89%
Apache Spark
England

For the 6 months to 16 July 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for Apache Spark.

1 122 (76.25%) Hadoop
2 98 (61.25%) Big Data
3 91 (56.88%) Java
4 87 (54.38%) Agile Software Development
5 83 (51.88%) Python
6 74 (46.25%) SQL
7 70 (43.75%) Analytics
8 66 (41.25%) Data Science
9 63 (39.38%) Scala
10 59 (36.88%) Apache Cassandra
11 50 (31.25%) Amazon AWS
12 49 (30.63%) Software Engineering
13 47 (29.38%) ETL
13 47 (29.38%) NoSQL
14 46 (28.75%) Data Warehouse
15 45 (28.13%) Apache
15 45 (28.13%) Business Intelligence
15 45 (28.13%) Kafka
16 44 (27.50%) Microservices
17 42 (26.25%) MongoDB
17 42 (26.25%) Open Source
18 39 (24.38%) C#
18 39 (24.38%) Degree
19 37 (23.13%) Machine Learning
19 37 (23.13%) Algorithms
20 32 (20.00%) Git (software)
20 32 (20.00%) DevOps
21 31 (19.38%) Docker
21 31 (19.38%) Data Analytics
21 31 (19.38%) Oracle

Apache Spark
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 45 (28.13%) Apache
2 20 (12.50%) Hyperledger
3 14 (8.75%) Apache Pig
3 14 (8.75%) SAS
4 12 (7.50%) Elasticsearch
5 9 (5.63%) Apache Solr
6 3 (1.88%) Apache Airflow
7 1 (0.63%) Confluence
7 1 (0.63%) Jupyter
7 1 (0.63%) Luigi
7 1 (0.63%) OpenStack
Applications
1 2 (1.25%) Weka
2 1 (0.63%) Microsoft Excel
2 1 (0.63%) Microsoft Office
2 1 (0.63%) Microsoft PowerPoint
2 1 (0.63%) MS Visio
Cloud Services
1 50 (31.25%) Amazon AWS
2 21 (13.13%) Microsoft Azure
3 16 (10.00%) Google Cloud Platform
4 13 (8.13%) Amazon EMR
5 12 (7.50%) Amazon EC2
5 12 (7.50%) Cortana Intelligence Suite
6 11 (6.88%) Azure Data Factory
7 8 (5.00%) Amazon S3
8 6 (3.75%) Cloud Computing
9 5 (3.13%) Amazon Kinesis
9 5 (3.13%) AWS CloudFormation
9 5 (3.13%) Power Platform
9 5 (3.13%) SaaS
10 4 (2.50%) PaaS
10 4 (2.50%) Serverless
11 3 (1.88%) Azure Functions
11 3 (1.88%) Dynamics 365
12 1 (0.63%) Amazon ELB
12 1 (0.63%) Amazon SQS
12 1 (0.63%) OpenShift
Communications & Networking
1 2 (1.25%) SSL
2 1 (0.63%) MQTT
2 1 (0.63%) TCP/IP
2 1 (0.63%) VXLAN
Database & Business Intelligence
1 122 (76.25%) Hadoop
2 98 (61.25%) Big Data
3 59 (36.88%) Apache Cassandra
4 47 (29.38%) NoSQL
5 46 (28.75%) Data Warehouse
6 42 (26.25%) MongoDB
7 30 (18.75%) Apache Hive
8 20 (12.50%) Blockchain
9 19 (11.88%) Amazon Redshift
9 19 (11.88%) Data Lake
9 19 (11.88%) MySQL
10 16 (10.00%) Impala
11 14 (8.75%) Geospatial Data
11 14 (8.75%) HBase
12 13 (8.13%) Azure SQL Data Warehouse
12 13 (8.13%) Azure SQL Database
12 13 (8.13%) Cosmos DB
12 13 (8.13%) Neo4j
13 11 (6.88%) Base SAS
13 11 (6.88%) Looker
Development Applications
1 32 (20.00%) Git (software)
2 23 (14.38%) Bitbucket
3 15 (9.38%) Jenkins
4 11 (6.88%) Visual Studio
5 10 (6.25%) Maven
6 2 (1.25%) Visual Studio Team System
7 1 (0.63%) Cucumber
7 1 (0.63%) GitLab
7 1 (0.63%) gulp
7 1 (0.63%) JIRA
7 1 (0.63%) Protractor
7 1 (0.63%) Selenium
7 1 (0.63%) Sonatype Nexus
General
1 28 (17.50%) Telecoms
2 21 (13.13%) Finance
3 8 (5.00%) Marketing
4 6 (3.75%) Electronics
4 6 (3.75%) Manufacturing
5 5 (3.13%) Advertising
6 3 (1.88%) Retail
7 1 (0.63%) Aerospace
7 1 (0.63%) French Language
7 1 (0.63%) German Language
Job Titles
1 34 (21.25%) Software Engineer
2 25 (15.63%) Data Engineer
3 21 (13.13%) Developer
4 19 (11.88%) Architect
4 19 (11.88%) Development Manager
4 19 (11.88%) Senior Software Engineer
5 14 (8.75%) Data Architect
6 11 (6.88%) Data Manager
6 11 (6.88%) Java Developer
7 10 (6.25%) Java Engineer
7 10 (6.25%) Python Engineer
8 9 (5.63%) Big Data Architect
8 9 (5.63%) Senior Developer
8 9 (5.63%) Senior Java Developer
9 8 (5.00%) Big Data Engineer
9 8 (5.00%) Java Software Engineer
9 8 (5.00%) Lead Software Engineer
9 8 (5.00%) Senior Java Engineer
9 8 (5.00%) Senior Java Software Engineer
10 7 (4.38%) Data Analytics Architect
Libraries, Frameworks & Software Standards
1 45 (28.13%) Kafka
2 23 (14.38%) Akka
2 23 (14.38%) scikit-learn
2 23 (14.38%) Spring
2 23 (14.38%) Spring Cloud
3 22 (13.75%) SAML
4 21 (13.13%) Pandas
5 20 (12.50%) OAuth
5 20 (12.50%) RESTful
5 20 (12.50%) Swagger
6 14 (8.75%) Apache NiFi
7 10 (6.25%) .NET
8 9 (5.63%) TensorFlow
9 7 (4.38%) J2EE
9 7 (4.38%) Spark Streaming
10 6 (3.75%) AngularJS
11 5 (3.13%) Keras
11 5 (3.13%) Node.js
11 5 (3.13%) PySpark
12 4 (2.50%) REST
Miscellaneous
1 37 (23.13%) Algorithms
2 24 (15.00%) Private Cloud
3 23 (14.38%) Public Cloud
4 21 (13.13%) Analytical Skills
5 14 (8.75%) Video on Demand
6 8 (5.00%) Greenfield Project
7 6 (3.75%) Enterprise Software
8 5 (3.13%) Data Structures
8 5 (3.13%) Management Information System
8 5 (3.13%) Self-Motivation
9 2 (1.25%) Cybercrime
9 2 (1.25%) Replication
9 2 (1.25%) Virtual Team
10 1 (0.63%) Data Centre
10 1 (0.63%) FMCG
10 1 (0.63%) Hybrid Cloud
10 1 (0.63%) Life Science
Operating Systems
1 21 (13.13%) Linux
2 13 (8.13%) Windows
3 5 (3.13%) Unix
Processes & Methodologies
1 87 (54.38%) Agile Software Development
2 70 (43.75%) Analytics
3 66 (41.25%) Data Science
4 49 (30.63%) Software Engineering
5 47 (29.38%) ETL
6 45 (28.13%) Business Intelligence
7 44 (27.50%) Microservices
8 42 (26.25%) Open Source
9 37 (23.13%) Machine Learning
10 32 (20.00%) DevOps
11 31 (19.38%) Data Analytics
12 30 (18.75%) Data Modelling
13 28 (17.50%) Artificial Intelligence
14 23 (14.38%) Data Architecture
15 22 (13.75%) Scrum
16 21 (13.13%) API Development
17 20 (12.50%) Cryptography
17 20 (12.50%) Data Engineering
17 20 (12.50%) Data Ingestion
18 19 (11.88%) Statistics
Programming Languages
1 91 (56.88%) Java
2 83 (51.88%) Python
3 74 (46.25%) SQL
4 63 (39.38%) Scala
5 39 (24.38%) C#
6 13 (8.13%) R
7 11 (6.88%) JavaScript
8 9 (5.63%) C++
9 6 (3.75%) Bash Shell
9 6 (3.75%) C
10 4 (2.50%) HiveQL
10 4 (2.50%) PL/SQL
11 1 (0.63%) Go
11 1 (0.63%) MATLAB
11 1 (0.63%) PowerShell
11 1 (0.63%) Ruby
11 1 (0.63%) Shell Script
Qualifications
1 39 (24.38%) Degree
2 27 (16.88%) Security Cleared
3 16 (10.00%) SC Cleared
4 9 (5.63%) PhD
5 6 (3.75%) AWS Certification
5 6 (3.75%) Computer Science Degree
6 4 (2.50%) DV Cleared
6 4 (2.50%) Master's Degree
7 1 (0.63%) BPSS Clearance
7 1 (0.63%) Microsoft Certification
7 1 (0.63%) Numerate Degree
Quality Assurance & Compliance
1 17 (10.63%) Data Quality
System Software
1 31 (19.38%) Docker
2 6 (3.75%) Apache Flume
3 4 (2.50%) HDFS
4 3 (1.88%) Apache ZooKeeper
5 2 (1.25%) Virtual Servers
6 1 (0.63%) Active Directory
6 1 (0.63%) Ceph
6 1 (0.63%) Virtual Machines
Systems Management
1 19 (11.88%) Puppet
2 14 (8.75%) Opscode Chef
2 14 (8.75%) Terraform
3 11 (6.88%) Hadoop YARN
4 9 (5.63%) Kubernetes
5 8 (5.00%) Ansible
6 3 (1.88%) Chukwa
6 3 (1.88%) Oozie
6 3 (1.88%) Salt
7 1 (0.63%) Graphite
7 1 (0.63%) Icinga
7 1 (0.63%) Kibana
7 1 (0.63%) logstash
7 1 (0.63%) Prometheus
7 1 (0.63%) Single Sign-On
Vendors
1 31 (19.38%) Oracle
2 20 (12.50%) Microsoft
3 16 (10.00%) Teradata
4 15 (9.38%) Informatica
5 14 (8.75%) Databricks
6 11 (6.88%) Vertica
7 10 (6.25%) Tableau
8 7 (4.38%) SAP
9 4 (2.50%) Cloudera
9 4 (2.50%) Google
9 4 (2.50%) Hortonworks
9 4 (2.50%) IBM
9 4 (2.50%) Salesforce.com
10 2 (1.25%) Talend
11 1 (0.63%) Adobe
11 1 (0.63%) Netezza
11 1 (0.63%) Paxata
11 1 (0.63%) StreamSets
11 1 (0.63%) Sybase