Period
to 18 January 2019

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 18 January 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South East
6 months to
18 Jan 2019
Same period 2018 Same period 2017
Rank 314 354 473
Rank change year-on-year +40 +119 +93
Permanent jobs citing Apache Spark 218 203 109
As % of all permanent IT jobs advertised in the South East 0.81% 0.66% 0.34%
As % of the Application Platforms category 5.28% 3.83% 1.87%
Number of salaries quoted 140 182 78
South East median annual salary £65,000 £55,000 £58,500
Median salary % change year-on-year +18.18% -5.98% -2.50%
10th Percentile £45,000 £32,000 £38,200
90th Percentile £86,250 £85,000 £73,250
England median annual salary £75,000 £70,000 £67,500
% change year-on-year +7.14% +3.70% +3.85%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for application platform skills.

All Application Platform Skills
South East
Permanent vacancies with a requirement for application platform skills 4,127 5,306 5,842
As % of all permanent IT jobs advertised in the South East 15.42% 17.13% 18.29%
Number of salaries quoted 3,414 4,479 4,922
South East median annual salary £47,500 £42,500 £45,000
Median salary % change year-on-year +11.76% -5.56% +5.88%
10th Percentile £27,500 £25,850 £26,250
90th Percentile £71,250 £65,000 £65,000
England median annual salary £50,000 £48,000 £46,000
% change year-on-year +4.17% +4.35% +2.22%

Apache Spark
Job Vacancy Trend in the South East

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Apache Spark in the South East

Apache Spark
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the South East.

Salary trend for Apache Spark in the South East

Apache Spark
Salary Histogram in the South East

The salary distribution of IT jobs citing Apache Spark in the South East over the 6 months to 18 January 2019.

Salary histogram for Apache Spark in the South East

Apache Spark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South East region over the 6 months to 18 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +31 104 £62,500 +4.17% 19
Berkshire +39 83 £63,250 +5.42% 11
Surrey +55 51 £52,500 +31.25% 7
Hampshire -12 47 £75,000 +50.00% 12
Buckinghamshire 0 12 £66,250 +20.45% 2
Oxfordshire +13 9 £50,000 -16.67% 6
East Sussex - 6 £55,000 - 2
West Sussex -7 2 £65,000 -3.70%
Kent +22 1 - -
Apache Spark
England

For the 6 months to 18 January 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for Apache Spark.

1 155 (71.10%) Hadoop
2 127 (58.26%) Big Data
3 125 (57.34%) Python
4 114 (52.29%) Java
5 113 (51.83%) Analytics
6 109 (50.00%) SQL
7 95 (43.58%) Kafka
8 83 (38.07%) Apache
8 83 (38.07%) Microsoft Azure
9 79 (36.24%) Data Science
10 78 (35.78%) Apache Hive
11 74 (33.94%) Business Intelligence
12 73 (33.49%) R
13 71 (32.57%) Data Modelling
14 69 (31.65%) Linux
15 68 (31.19%) Degree
16 66 (30.28%) Mathematics
17 65 (29.82%) Visualisation
17 65 (29.82%) Telecoms
18 63 (28.90%) Agile Software Development
19 61 (27.98%) Artificial Intelligence
20 60 (27.52%) Tableau
21 59 (27.06%) Statistics
22 58 (26.61%) Finance
22 58 (26.61%) Power BI
23 56 (25.69%) Machine Learning
24 54 (24.77%) Decision-Making
24 54 (24.77%) Retail
25 51 (23.39%) SAS
25 51 (23.39%) Hadoop YARN

Apache Spark
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 83 (38.07%) Apache
2 51 (23.39%) SAS
3 18 (8.26%) Elasticsearch
4 8 (3.67%) Apache Pig
4 8 (3.67%) Cloud Foundry
5 7 (3.21%) Jupyter
6 6 (2.75%) JBoss
7 5 (2.29%) Apache Solr
7 5 (2.29%) Confluence
8 4 (1.83%) GemFire
9 2 (0.92%) SharePoint
9 2 (0.92%) Tomcat
10 1 (0.46%) Apache Airflow
Cloud Services
1 83 (38.07%) Microsoft Azure
2 44 (20.18%) Amazon AWS
3 15 (6.88%) GitHub
4 9 (4.13%) Google Cloud Platform
5 8 (3.67%) Cloud Computing
6 6 (2.75%) Azure Data Factory
7 4 (1.83%) Amazon EC2
7 4 (1.83%) Amazon EMR
7 4 (1.83%) Data Lake Analytics
8 3 (1.38%) PaaS
9 2 (0.92%) Cortana Intelligence Suite
10 1 (0.46%) Azure Functions
10 1 (0.46%) Azure Machine Learning
10 1 (0.46%) SaaS
10 1 (0.46%) Serverless
Communications & Networking
1 4 (1.83%) DAB
1 4 (1.83%) HTTP
2 1 (0.46%) DNS
2 1 (0.46%) MQTT
2 1 (0.46%) SAN
Database & Business Intelligence
1 155 (71.10%) Hadoop
2 127 (58.26%) Big Data
3 78 (35.78%) Apache Hive
4 58 (26.61%) Power BI
5 47 (21.56%) NoSQL
6 42 (19.27%) Text Mining
7 41 (18.81%) SAP HANA
8 35 (16.06%) SQL Server
9 33 (15.14%) Apache Cassandra
10 28 (12.84%) Data Lake
11 27 (12.39%) Data Warehouse
12 21 (9.63%) HBase
13 18 (8.26%) Impala
14 16 (7.34%) Relational Database
15 13 (5.96%) SQL Server Integration Services
16 12 (5.50%) MongoDB
17 10 (4.59%) Apache Kudu
18 9 (4.13%) Parquet
19 8 (3.67%) Cloudera CDH
19 8 (3.67%) Oracle Exadata
Development Applications
1 24 (11.01%) Git (software)
2 21 (9.63%) Visual Studio
3 17 (7.80%) Jenkins
4 13 (5.96%) JIRA
5 11 (5.05%) Gradle
6 7 (3.21%) Eclipse
7 5 (2.29%) Bitbucket
7 5 (2.29%) Visual Studio Team System
8 4 (1.83%) Axure RP
8 4 (1.83%) Subversion
8 4 (1.83%) Team Foundation Server
9 2 (0.92%) CircleCI
9 2 (0.92%) ERwin
9 2 (0.92%) JUnit
9 2 (0.92%) PowerDesigner
9 2 (0.92%) RStudio
10 1 (0.46%) Eclipse RCP
General
1 65 (29.82%) Telecoms
2 58 (26.61%) Finance
3 54 (24.77%) Retail
4 5 (2.29%) Marketing
5 3 (1.38%) Advertising
5 3 (1.38%) Banking
6 2 (0.92%) Financial Institution
7 1 (0.46%) Games
7 1 (0.46%) Law
7 1 (0.46%) Local Government
7 1 (0.46%) Military
Job Titles
1 61 (27.98%) Data Scientist
2 48 (22.02%) Developer
3 31 (14.22%) Senior Data Scientist
4 27 (12.39%) Data Engineer
5 22 (10.09%) Software Engineer
6 20 (9.17%) Architect
7 17 (7.80%) Java Developer
8 16 (7.34%) Software Developer
9 13 (5.96%) Data Architect
9 13 (5.96%) Senior Developer
10 11 (5.05%) Big Data Engineer
10 11 (5.05%) C++ Developer
10 11 (5.05%) C++ Software Developer
11 10 (4.59%) Big Data Developer
12 7 (3.21%) Consultant
12 7 (3.21%) Senior Consultant
12 7 (3.21%) Senior Technical Consultant
12 7 (3.21%) Technical Consultant
13 6 (2.75%) Big Data Architect
13 6 (2.75%) Systems Engineer
Libraries, Frameworks & Software Standards
1 95 (43.58%) Kafka
2 43 (19.72%) D3.js
3 41 (18.81%) ggplot
4 25 (11.47%) JSON
5 23 (10.55%) REST
6 19 (8.72%) Natural Language Processing
7 18 (8.26%) TensorFlow
8 15 (6.88%) Spring
9 12 (5.50%) Elastic Stack
10 11 (5.05%) Middleware
11 10 (4.59%) Spark Streaming
12 9 (4.13%) Apache Avro
12 9 (4.13%) RabbitMQ
13 8 (3.67%) Apache Tez
14 7 (3.21%) AngularJS
14 7 (3.21%) RESTful
15 6 (2.75%) Drools
15 6 (2.75%) J2EE
15 6 (2.75%) NumPy
15 6 (2.75%) SciPy
Miscellaneous
1 50 (22.94%) Algorithms
2 41 (18.81%) Social Network
3 26 (11.93%) Analytical Skills
4 19 (8.72%) Video on Demand
5 14 (6.42%) Greenfield Project
6 12 (5.50%) Linux Command Line
7 10 (4.59%) Virtual Team
8 8 (3.67%) Pricing Data
8 8 (3.67%) Self-Motivation
9 3 (1.38%) Life Science
10 2 (0.92%) Replication
10 2 (0.92%) User Experience
11 1 (0.46%) Data Structures
11 1 (0.46%) Management Information System
11 1 (0.46%) Mobile App
11 1 (0.46%) NHS
11 1 (0.46%) Public Cloud
11 1 (0.46%) Robotics
11 1 (0.46%) Social Media
Operating Systems
1 69 (31.65%) Linux
2 30 (13.76%) Windows
3 27 (12.39%) Unix
4 2 (0.92%) Red Hat Enterprise Linux
5 1 (0.46%) Android
5 1 (0.46%) Apple iOS
Processes & Methodologies
1 113 (51.83%) Analytics
2 79 (36.24%) Data Science
3 74 (33.94%) Business Intelligence
4 71 (32.57%) Data Modelling
5 66 (30.28%) Mathematics
6 65 (29.82%) Visualisation
7 63 (28.90%) Agile Software Development
8 61 (27.98%) Artificial Intelligence
9 59 (27.06%) Statistics
10 56 (25.69%) Machine Learning
11 54 (24.77%) Decision-Making
12 48 (22.02%) Data Engineering
13 46 (21.10%) Data Visualisation
14 42 (19.27%) Data Security
14 42 (19.27%) Econometrics
14 42 (19.27%) Operations Research
14 42 (19.27%) Quantitative Research
15 41 (18.81%) Data-Driven Decision Making
15 41 (18.81%) Random Forest
16 37 (16.97%) Open Source
Programming Languages
1 125 (57.34%) Python
2 114 (52.29%) Java
3 109 (50.00%) SQL
4 73 (33.49%) R
5 30 (13.76%) Scala
6 19 (8.72%) C#
7 18 (8.26%) C++
8 17 (7.80%) Shell Script
9 9 (4.13%) HiveQL
9 9 (4.13%) Perl
9 9 (4.13%) PowerShell
10 7 (3.21%) C
10 7 (3.21%) JavaScript
11 6 (2.75%) Bash Shell
12 5 (2.29%) Go
13 3 (1.38%) Ruby
14 1 (0.46%) F#
14 1 (0.46%) MATLAB
Qualifications
1 68 (31.19%) Degree
2 11 (5.05%) Security Cleared
3 10 (4.59%) PhD
4 8 (3.67%) Computer Science Degree
5 7 (3.21%) DV Cleared
6 4 (1.83%) SC Cleared
7 1 (0.46%) ISEB
7 1 (0.46%) Master's Degree
Quality Assurance & Compliance
1 19 (8.72%) QA
2 10 (4.59%) Data Quality
3 2 (0.92%) GDPR
4 1 (0.46%) SLA
System Software
1 15 (6.88%) HDFS
2 12 (5.50%) Apache ZooKeeper
3 10 (4.59%) Apache Flume
4 6 (2.75%) Docker
4 6 (2.75%) Virtual Machines
Systems Management
1 51 (23.39%) Hadoop YARN
2 17 (7.80%) Kibana
3 14 (6.42%) Ansible
4 11 (5.05%) Terraform
5 10 (4.59%) Puppet
6 7 (3.21%) Kubernetes
6 7 (3.21%) logstash
6 7 (3.21%) Oracle ZFS
7 5 (2.29%) Oozie
8 4 (1.83%) Rundeck
9 3 (1.38%) Opscode Chef
10 1 (0.46%) OMEGAMON
Vendors
1 60 (27.52%) Tableau
2 41 (18.81%) SAP
3 22 (10.09%) Microsoft
4 20 (9.17%) Hortonworks
5 19 (8.72%) Cloudera
6 16 (7.34%) Oracle
7 7 (3.21%) Atlassian
8 5 (2.29%) Alteryx
8 5 (2.29%) Google
8 5 (2.29%) RapidMiner
9 3 (1.38%) Ab Initio
9 3 (1.38%) Databricks
10 2 (0.92%) Jaspersoft
10 2 (0.92%) MicroStrategy
10 2 (0.92%) Netezza
10 2 (0.92%) Red Hat
10 2 (0.92%) Talend
11 1 (0.46%) MapR
11 1 (0.46%) New Relic
11 1 (0.46%) Splunk