Period
to 9 April 2020

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 9 April 2020 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South East
6 months to
9 Apr 2020
Same period 2019 Same period 2018
Rank 290 355 349
Rank change year-on-year +65 -6 +95
Permanent jobs citing Apache Spark 161 172 223
As % of all permanent jobs advertised in the South East 0.77% 0.64% 0.71%
As % of the Application Platforms category 5.45% 4.34% 4.13%
Number of salaries quoted 129 128 198
Median annual salary £60,000 £75,000 £60,000
Median salary % change year-on-year -20.00% +25.00% -7.69%
10th Percentile £42,500 £47,500 £29,625
90th Percentile £85,000 £87,500 £95,000
England median annual salary £72,500 £75,000 £70,000
% change year-on-year -3.33% +7.14% +6.06%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for application platform skills.

All Application Platform Skills
South East
Permanent vacancies with a requirement for application platform skills 2,953 3,967 5,400
As % of all permanent IT jobs advertised in the South East 14.13% 14.84% 17.09%
Number of salaries quoted 2,377 3,297 4,580
Median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +5.88%
10th Percentile £27,000 £27,500 £26,250
90th Percentile £76,250 £72,500 £67,500
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +5.26%

Apache Spark
Job Vacancy Trend in the South East

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the South East.

Job vacancy trend for Apache Spark in the South East

Apache Spark
Salary Trend in the South East

3-month moving average salary quoted in jobs citing Apache Spark in the South East.

Salary trend for Apache Spark in the South East

Apache Spark
Salary Histogram in the South East

Salary distribution for jobs citing Apache Spark in the South East over the 6 months to 9 April 2020.

Salary histogram for Apache Spark in the South East

Apache Spark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South East region over the 6 months to 9 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Hampshire +69 89 £50,000 -33.33% 2
Thames Valley +13 48 £60,000 -6.25% 7
Berkshire +20 35 £60,000 -6.25% 6
East Sussex +11 13 £67,500 +17.39% 1
Buckinghamshire +25 11 £52,500 -28.81%
West Sussex - 6 £77,500 - 2
Surrey +20 5 £67,500 -14.01% 1
Oxfordshire +17 2 £73,750 +5.36% 1
Apache Spark
England

For the 6 months to 9 April 2020, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for Apache Spark.

1 131 (81.37%) Hadoop
2 115 (71.43%) Big Data
3 92 (57.14%) Python
4 87 (54.04%) Java
5 78 (48.45%) Analytics
6 63 (39.13%) Agile Software Development
7 60 (37.27%) SQL
7 60 (37.27%) Machine Learning
8 53 (32.92%) MongoDB
9 51 (31.68%) AWS
10 47 (29.19%) Kafka
10 47 (29.19%) Data Analytics
11 45 (27.95%) Security Cleared
11 45 (27.95%) Apache
12 44 (27.33%) Degree
13 43 (26.71%) SC Cleared
14 40 (24.84%) Azure
14 40 (24.84%) Linux
14 40 (24.84%) DevOps
15 38 (23.60%) NoSQL
16 35 (21.74%) Elasticsearch
17 34 (21.12%) Apache Cassandra
18 31 (19.25%) Scala
19 30 (18.63%) Apache Solr
19 30 (18.63%) Technical Leadership
20 28 (17.39%) Data Science
20 28 (17.39%) Bash Shell
20 28 (17.39%) C++
21 27 (16.77%) Artificial Intelligence
21 27 (16.77%) R

Apache Spark
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 45 (27.95%) Apache
2 35 (21.74%) Elasticsearch
3 30 (18.63%) Apache Solr
4 6 (3.73%) Oracle Coherence
5 5 (3.11%) Camunda
5 5 (3.11%) JBoss
5 5 (3.11%) Jupyter
5 5 (3.11%) nginx
5 5 (3.11%) SAS
5 5 (3.11%) WildFly
6 4 (2.48%) Apache Pig
7 1 (0.62%) Apache Airflow
7 1 (0.62%) Oracle SOA Suite
Applications
1 1 (0.62%) Microsoft Excel
1 1 (0.62%) Microsoft Office
1 1 (0.62%) Microsoft PowerPoint
Business Applications
1 5 (3.11%) SAP CRM
1 5 (3.11%) SAP ERP
1 5 (3.11%) SAP IS-U
2 1 (0.62%) NetSuite
Cloud Services
1 51 (31.68%) AWS
2 40 (24.84%) Azure
3 17 (10.56%) Power Platform
4 14 (8.70%) GCP
5 5 (3.11%) Amazon Kinesis
5 5 (3.11%) Amazon S3
5 5 (3.11%) Cloud Computing
6 4 (2.48%) Azure Data Factory
7 3 (1.86%) Cortana Intelligence Suite
7 3 (1.86%) Data Lake Analytics
7 3 (1.86%) Heroku
7 3 (1.86%) SaaS
8 2 (1.24%) AWS Lambda
8 2 (1.24%) Serverless
9 1 (0.62%) Amazon EC2
9 1 (0.62%) Amazon EMR
9 1 (0.62%) Dynamics 365
9 1 (0.62%) GitHub
9 1 (0.62%) IaaS
9 1 (0.62%) PaaS
Communications & Networking
1 3 (1.86%) SAN
2 2 (1.24%) HTTP
3 1 (0.62%) 5G
3 1 (0.62%) DNS
3 1 (0.62%) SSL
3 1 (0.62%) TCP/IP
Database & Business Intelligence
1 131 (81.37%) Hadoop
2 115 (71.43%) Big Data
3 53 (32.92%) MongoDB
4 38 (23.60%) NoSQL
5 34 (21.12%) Apache Cassandra
6 27 (16.77%) Neo4j
7 20 (12.42%) Apache Accumulo
8 19 (11.80%) SQL Server
9 17 (10.56%) Power BI
10 16 (9.94%) Apache Hive
10 16 (9.94%) Data Warehouse
11 13 (8.07%) Data Lake
12 10 (6.21%) Cosmos DB
12 10 (6.21%) HBase
13 8 (4.97%) Amazon Redshift
13 8 (4.97%) Data Mining
13 8 (4.97%) IBM InfoSphere
13 8 (4.97%) SQL Server 2016
14 7 (4.35%) KNIME
14 7 (4.35%) SQL Server Reporting Services
Development Applications
1 9 (5.59%) Jenkins
2 6 (3.73%) Git (software)
3 5 (3.11%) JIRA
3 5 (3.11%) Visual Studio Team System
4 3 (1.86%) Visual Studio
5 2 (1.24%) Sonatype Nexus
6 1 (0.62%) Travis CI
General
1 23 (14.29%) Telecoms
2 17 (10.56%) Finance
3 13 (8.07%) Marketing
4 7 (4.35%) Aerospace
4 7 (4.35%) Banking
5 2 (1.24%) Public Sector
5 2 (1.24%) Retail
6 1 (0.62%) Pharmaceutical
6 1 (0.62%) Retail Banking
Job Titles
1 44 (27.33%) Developer
2 37 (22.98%) Data Engineer
3 31 (19.25%) Java Developer
4 21 (13.04%) Senior Developer
4 21 (13.04%) Senior Java Developer
5 20 (12.42%) Analyst
6 17 (10.56%) Architect
7 16 (9.94%) Data Analyst
8 15 (9.32%) Big Data Analyst
9 14 (8.70%) Data Architect
10 11 (6.83%) Big Data Engineer
10 11 (6.83%) Data Scientist
10 11 (6.83%) Software Engineer
11 10 (6.21%) Lead DevOps
12 7 (4.35%) Administrator
12 7 (4.35%) Big Data Architect
12 7 (4.35%) Systems Administrator
13 6 (3.73%) Database Architect
13 6 (3.73%) Enterprise Data Architect
13 6 (3.73%) Solutions Architect
Libraries, Frameworks & Software Standards
1 47 (29.19%) Kafka
2 18 (11.18%) Natural Language Processing
2 18 (11.18%) Spring
3 12 (7.45%) Spring Boot
4 11 (6.83%) .NET
5 8 (4.97%) Apache NiFi
5 8 (4.97%) NumPy
5 8 (4.97%) Pandas
5 8 (4.97%) REST
6 6 (3.73%) AngularJS
6 6 (3.73%) J2EE
6 6 (3.73%) scikit-learn
6 6 (3.73%) SciPy
6 6 (3.73%) ZeroMQ
7 5 (3.11%) Elastic Stack
7 5 (3.11%) PySpark
8 4 (2.48%) Node.js
8 4 (2.48%) Spark Streaming
9 3 (1.86%) HTML
9 3 (1.86%) RabbitMQ
Miscellaneous
1 25 (15.53%) Greenfield Project
2 24 (14.91%) Analytical Skills
3 12 (7.45%) Video on Demand
4 8 (4.97%) Algorithms
5 6 (3.73%) Analytical Mindset
5 6 (3.73%) Reinsurance
6 4 (2.48%) Cybercrime
7 3 (1.86%) Linked Data
7 3 (1.86%) Mobile App
8 2 (1.24%) BBC
8 2 (1.24%) Cloud Native
8 2 (1.24%) IBM Mainframe
8 2 (1.24%) Mainframe
8 2 (1.24%) Virtual Team
9 1 (0.62%) Cyber Defence
9 1 (0.62%) Cyberthreat
9 1 (0.62%) Reference Data
9 1 (0.62%) Semantic Web
Operating Systems
1 40 (24.84%) Linux
2 21 (13.04%) Windows
3 3 (1.86%) Windows Server
4 2 (1.24%) Unix
Processes & Methodologies
1 78 (48.45%) Analytics
2 63 (39.13%) Agile Software Development
3 60 (37.27%) Machine Learning
4 47 (29.19%) Data Analytics
5 40 (24.84%) DevOps
6 30 (18.63%) Technical Leadership
7 28 (17.39%) Data Science
8 27 (16.77%) Artificial Intelligence
9 25 (15.53%) Business Intelligence
9 25 (15.53%) Microservices
10 23 (14.29%) Data Modelling
11 22 (13.66%) ETL
12 21 (13.04%) Fintech
13 20 (12.42%) Business Development
14 18 (11.18%) Scaled Agile Framework
15 17 (10.56%) Software Engineering
16 14 (8.70%) Statistics
17 13 (8.07%) Visualisation
18 12 (7.45%) Data Management
18 12 (7.45%) Mathematics
Programming Languages
1 92 (57.14%) Python
2 87 (54.04%) Java
3 60 (37.27%) SQL
4 31 (19.25%) Scala
5 28 (17.39%) Bash Shell
5 28 (17.39%) C++
6 27 (16.77%) R
7 22 (13.66%) JavaScript
8 17 (10.56%) MATLAB
9 8 (4.97%) Perl
10 6 (3.73%) C
10 6 (3.73%) Korn
11 4 (2.48%) Go
11 4 (2.48%) PowerShell
11 4 (2.48%) Ruby
12 1 (0.62%) C#
12 1 (0.62%) Julia
12 1 (0.62%) PHP
12 1 (0.62%) SAS Macro
12 1 (0.62%) VBA
Qualifications
1 45 (27.95%) Security Cleared
2 44 (27.33%) Degree
3 43 (26.71%) SC Cleared
4 27 (16.77%) DV Cleared
5 6 (3.73%) Numerate Degree
5 6 (3.73%) TOGAF Certification
6 3 (1.86%) PhD
7 1 (0.62%) Computer Science Degree
Quality Assurance & Compliance
1 8 (4.97%) Data Quality
2 5 (3.11%) QA
System Software
1 22 (13.66%) Apache ZooKeeper
2 14 (8.70%) Docker
3 5 (3.11%) Active Directory
4 3 (1.86%) Apache Flume
5 2 (1.24%) HDFS
6 1 (0.62%) Hyper-V
6 1 (0.62%) VMware Infrastructure
Systems Management
1 25 (15.53%) Ansible
2 24 (14.91%) Puppet
3 20 (12.42%) Salt
4 8 (4.97%) Kubernetes
5 4 (2.48%) Kibana
6 3 (1.86%) Hadoop YARN
6 3 (1.86%) logstash
7 2 (1.24%) Grafana
7 2 (1.24%) Opscode Chef
8 1 (0.62%) Ambari
8 1 (0.62%) Oozie
8 1 (0.62%) Terraform
Vendors
1 21 (13.04%) Microsoft
2 17 (10.56%) Oracle
3 12 (7.45%) Tableau
4 8 (4.97%) IBM
4 8 (4.97%) Splunk
5 7 (4.35%) SAP
6 6 (3.73%) Cognos
6 6 (3.73%) Databricks
6 6 (3.73%) Netezza
6 6 (3.73%) Teradata
7 5 (3.11%) Google
8 4 (2.48%) Cloudera
9 3 (1.86%) Hortonworks
9 3 (1.86%) MapR
9 3 (1.86%) VMware
10 2 (1.24%) Palantir
10 2 (1.24%) Talend
10 2 (1.24%) TIBCO
10 2 (1.24%) Vertica
11 1 (0.62%) Huawei