Period
to 6 July 2020

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 6 July 2020 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South East
6 months to
6 Jul 2020
Same period 2019 Same period 2018
Rank 248 364 330
Rank change year-on-year +116 -34 +14
Permanent jobs citing Apache Spark 127 155 252
As % of all permanent jobs advertised in the South East 0.91% 0.58% 0.81%
As % of the Application Platforms category 6.61% 3.90% 4.71%
Number of salaries quoted 105 121 215
Median annual salary £67,500 £67,500 £60,000
Median salary % change year-on-year - +12.50% -7.69%
10th Percentile £46,250 £46,250 £30,000
90th Percentile £85,000 £90,000 £86,250
England median annual salary £75,000 £75,000 £70,000
% change year-on-year - +7.14% +3.70%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for application platform skills.

All Application Platform Skills
South East
Permanent vacancies with a requirement for application platform skills 1,922 3,977 5,355
As % of all permanent IT jobs advertised in the South East 13.76% 14.79% 17.24%
Number of salaries quoted 1,581 3,202 4,536
Median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +5.88%
10th Percentile £27,500 £27,500 £26,963
90th Percentile £78,750 £73,750 £70,000
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +5.26%

Apache Spark
Job Vacancy Trend in the South East

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the South East.

Job vacancy trend for Apache Spark in the South East

Apache Spark
Salary Trend in the South East

3-month moving average salary quoted in jobs citing Apache Spark in the South East.

Salary trend for Apache Spark in the South East

Apache Spark
Salary Histogram in the South East

Salary distribution for jobs citing Apache Spark in the South East over the 6 months to 6 July 2020.

Salary histogram for Apache Spark in the South East

Apache Spark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South East region over the 6 months to 6 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Hampshire +88 65 £82,500 +37.50% 2
Thames Valley +61 32 £60,000 -5.14% 4
Berkshire +50 23 £60,000 -6.25% 4
East Sussex +41 16 £67,500 +80.00%
West Sussex - 8 £77,500 - 1
Buckinghamshire +45 7 £51,250 +7.89%
Surrey +62 6 £70,000 -22.22%
Oxfordshire +21 2 £52,500 -19.23%
Apache Spark
England

For the 6 months to 6 July 2020, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for Apache Spark.

1 105 (82.68%) Hadoop
2 95 (74.80%) Big Data
3 72 (56.69%) Python
4 69 (54.33%) Java
5 52 (40.94%) AWS
6 45 (35.43%) Analytics
6 45 (35.43%) SQL
7 43 (33.86%) Kafka
7 43 (33.86%) MongoDB
8 42 (33.07%) Machine Learning
9 36 (28.35%) Apache
9 36 (28.35%) Data Analytics
10 34 (26.77%) Azure
10 34 (26.77%) Linux
11 33 (25.98%) Agile Software Development
11 33 (25.98%) NoSQL
12 32 (25.20%) DevOps
12 32 (25.20%) Degree
13 27 (21.26%) Scala
13 27 (21.26%) Security Cleared
14 26 (20.47%) SC Cleared
15 25 (19.69%) Apache Cassandra
16 24 (18.90%) Artificial Intelligence
16 24 (18.90%) Business Intelligence
17 23 (18.11%) R
18 22 (17.32%) Data Modelling
18 22 (17.32%) Data Science
19 20 (15.75%) Microservices
19 20 (15.75%) Spring
19 20 (15.75%) Bash Shell

Apache Spark
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 36 (28.35%) Apache
2 18 (14.17%) Elasticsearch
3 17 (13.39%) Apache Solr
4 8 (6.30%) Oracle Coherence
5 7 (5.51%) Cloud Foundry
6 6 (4.72%) Apache Pig
7 5 (3.94%) Camunda
7 5 (3.94%) JBoss
7 5 (3.94%) Jupyter
7 5 (3.94%) nginx
7 5 (3.94%) WildFly
8 4 (3.15%) SAS
9 3 (2.36%) Pachyderm
10 1 (0.79%) Apache Airflow
10 1 (0.79%) Oracle SOA Suite
Business Applications
1 5 (3.94%) SAP CRM
1 5 (3.94%) SAP ERP
1 5 (3.94%) SAP IS-U
Cloud Services
1 52 (40.94%) AWS
2 34 (26.77%) Azure
3 12 (9.45%) Power Platform
4 11 (8.66%) Amazon EC2
5 10 (7.87%) Amazon Kinesis
6 9 (7.09%) GCP
7 7 (5.51%) Azure Data Factory
8 6 (4.72%) Amazon EMR
8 6 (4.72%) Cortana Intelligence Suite
9 5 (3.94%) Amazon S3
9 5 (3.94%) Cloud Computing
10 3 (2.36%) GitHub
11 2 (1.57%) Heroku
Communications & Networking
1 3 (2.36%) SAN
2 1 (0.79%) 5G
2 1 (0.79%) DNS
2 1 (0.79%) DSL
2 1 (0.79%) HTTP
2 1 (0.79%) SSL
2 1 (0.79%) TCP/IP
Database & Business Intelligence
1 105 (82.68%) Hadoop
2 95 (74.80%) Big Data
3 43 (33.86%) MongoDB
4 33 (25.98%) NoSQL
5 25 (19.69%) Apache Cassandra
6 19 (14.96%) SQL Server
7 18 (14.17%) Neo4j
8 16 (12.60%) Apache Hive
8 16 (12.60%) Data Warehouse
9 15 (11.81%) Cosmos DB
10 14 (11.02%) HBase
11 12 (9.45%) Data Lake
11 12 (9.45%) Power BI
12 11 (8.66%) Amazon Redshift
12 11 (8.66%) Impala
13 10 (7.87%) MariaDB
14 9 (7.09%) SQL Server Reporting Services
15 8 (6.30%) Data Mining
15 8 (6.30%) DB2
15 8 (6.30%) QlikView
Development Applications
1 14 (11.02%) Jenkins
2 7 (5.51%) Git (software)
3 5 (3.94%) Sonatype Nexus
4 4 (3.15%) Gradle
4 4 (3.15%) JUnit
5 1 (0.79%) Travis CI
General
1 18 (14.17%) Finance
2 12 (9.45%) Marketing
3 10 (7.87%) Telecoms
4 8 (6.30%) Banking
5 7 (5.51%) Aerospace
6 2 (1.57%) Retail
7 1 (0.79%) Pharmaceutical
Job Titles
1 40 (31.50%) Developer
2 29 (22.83%) Data Engineer
3 22 (17.32%) Architect
4 17 (13.39%) Java Developer
5 12 (9.45%) Analyst
5 12 (9.45%) Big Data Engineer
5 12 (9.45%) Senior Developer
5 12 (9.45%) Senior Java Developer
6 10 (7.87%) Data Architect
7 9 (7.09%) Data Analyst
7 9 (7.09%) Data Scientist
8 8 (6.30%) Big Data Analyst
8 8 (6.30%) Database Architect
8 8 (6.30%) Enterprise Data Architect
8 8 (6.30%) Strategy Architect
9 6 (4.72%) Azure Developer
9 6 (4.72%) Big Data Developer
9 6 (4.72%) Senior Data Scientist
9 6 (4.72%) Software Engineer
10 5 (3.94%) Software Developer
Libraries, Frameworks & Software Standards
1 43 (33.86%) Kafka
2 20 (15.75%) Spring
3 19 (14.96%) Spring Boot
4 11 (8.66%) Apache NiFi
5 9 (7.09%) RabbitMQ
6 8 (6.30%) NumPy
6 8 (6.30%) Pandas
6 8 (6.30%) scikit-learn
6 8 (6.30%) SciPy
7 7 (5.51%) .NET
7 7 (5.51%) Drools
7 7 (5.51%) Lambda Expressions
7 7 (5.51%) Middleware
8 6 (4.72%) Natural Language Processing
9 5 (3.94%) AngularJS
9 5 (3.94%) H2O
9 5 (3.94%) REST
10 4 (3.15%) Elastic Stack
11 3 (2.36%) PySpark
12 2 (1.57%) Dask
Miscellaneous
1 19 (14.96%) Analytical Skills
2 16 (12.60%) Greenfield Project
3 8 (6.30%) Reinsurance
4 7 (5.51%) Algorithms
5 6 (4.72%) Analytical Mindset
6 4 (3.15%) Video on Demand
7 3 (2.36%) Blog
7 3 (2.36%) Public Cloud
8 2 (1.57%) Cybercrime
8 2 (1.57%) Enterprise Software
8 2 (1.57%) Mobile App
8 2 (1.57%) Virtual Team
9 1 (0.79%) Cloud Native
9 1 (0.79%) Driving Licence
Operating Systems
1 34 (26.77%) Linux
2 14 (11.02%) Windows
3 6 (4.72%) Unix
4 3 (2.36%) Windows Server
Processes & Methodologies
1 45 (35.43%) Analytics
2 42 (33.07%) Machine Learning
3 36 (28.35%) Data Analytics
4 33 (25.98%) Agile Software Development
5 32 (25.20%) DevOps
6 24 (18.90%) Artificial Intelligence
6 24 (18.90%) Business Intelligence
7 22 (17.32%) Data Modelling
7 22 (17.32%) Data Science
8 20 (15.75%) Microservices
9 19 (14.96%) ETL
10 17 (13.39%) Fintech
11 14 (11.02%) Business Analytics
12 13 (10.24%) Open Source
12 13 (10.24%) Technical Leadership
13 11 (8.66%) Data Architecture
13 11 (8.66%) Mathematics
13 11 (8.66%) Scaled Agile Framework
14 9 (7.09%) Problem-Solving
14 9 (7.09%) Software Engineering
Programming Languages
1 72 (56.69%) Python
2 69 (54.33%) Java
3 45 (35.43%) SQL
4 27 (21.26%) Scala
5 23 (18.11%) R
6 20 (15.75%) Bash Shell
7 16 (12.60%) C++
7 16 (12.60%) JavaScript
8 12 (9.45%) Korn
9 9 (7.09%) MATLAB
10 7 (5.51%) Perl
11 4 (3.15%) C
11 4 (3.15%) Groovy
12 2 (1.57%) Go
12 2 (1.57%) Ruby
13 1 (0.79%) C#
13 1 (0.79%) Data Analysis Expressions (DAX)
13 1 (0.79%) Elm
13 1 (0.79%) Java 8
Qualifications
1 32 (25.20%) Degree
2 27 (21.26%) Security Cleared
3 26 (20.47%) SC Cleared
4 12 (9.45%) DV Cleared
5 8 (6.30%) TOGAF Certification
6 6 (4.72%) Numerate Degree
7 2 (1.57%) Computer Science Degree
8 1 (0.79%) AWS Certification
8 1 (0.79%) PhD
Quality Assurance & Compliance
1 2 (1.57%) Data Quality
System Software
1 19 (14.96%) Docker
2 9 (7.09%) Apache ZooKeeper
3 6 (4.72%) HDFS
4 5 (3.94%) Active Directory
5 1 (0.79%) Apache Flume
5 1 (0.79%) Hyper-V
5 1 (0.79%) VMware Infrastructure
Systems Management
1 17 (13.39%) Ansible
2 15 (11.81%) Kubernetes
3 12 (9.45%) Puppet
4 8 (6.30%) Salt
4 8 (6.30%) Terraform
5 3 (2.36%) Kibana
5 3 (2.36%) Opscode Chef
6 2 (1.57%) Grafana
6 2 (1.57%) logstash
7 1 (0.79%) Oozie
Vendors
1 18 (14.17%) Microsoft
2 11 (8.66%) Databricks
2 11 (8.66%) Oracle
3 9 (7.09%) Splunk
4 8 (6.30%) Cognos
4 8 (6.30%) Netezza
4 8 (6.30%) Teradata
5 5 (3.94%) Cloudera
5 5 (3.94%) SAP
6 4 (3.15%) Hortonworks
6 4 (3.15%) MapR
6 4 (3.15%) Tableau
7 2 (1.57%) Google
7 2 (1.57%) Vertica
8 1 (0.79%) Cisco
8 1 (0.79%) Dell
8 1 (0.79%) HP
8 1 (0.79%) Huawei
8 1 (0.79%) IBM
8 1 (0.79%) VMware