Period
to 22 November 2018

The following table provides summary statistics for permanent job vacancies advertised in the South East with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 22 November 2018 with a comparison to the same period in the previous 2 years.

Apache Spark
England > South East
6 months to
22 Nov 2018
Same period 2017 Same period 2016
Rank 295 335 452
Rank change year-on-year +40 +117 +94
Permanent jobs citing Apache Spark 263 246 155
As % of all permanent IT jobs advertised in the South East 0.91% 0.80% 0.44%
As % of the Application Platforms category 5.70% 4.57% 2.38%
Number of salaries quoted 181 216 113
South East median annual salary £60,000 £60,000 £60,000
10th Percentile £44,250 £37,500 £39,500
90th Percentile £86,250 £84,000 £80,000
England median annual salary £72,500 £67,000 £67,500
% change year-on-year +8.21% -0.74% +3.85%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South East with a requirement for application platform skills.

All Application Platform Skills
South East
Permanent vacancies with a requirement for application platform skills 4,610 5,378 6,508
As % of all permanent IT jobs advertised in the South East 16.03% 17.46% 18.49%
Number of salaries quoted 3,867 4,526 5,559
South East median annual salary £47,500 £42,500 £45,000
Median salary % change year-on-year +11.76% -5.56% +5.88%
10th Percentile £27,500 £25,750 £26,750
90th Percentile £70,000 £65,750 £65,000
England median annual salary £50,000 £47,500 £46,000
% change year-on-year +5.26% +3.26% +2.22%

Apache Spark
Job Vacancy Trend in the South East

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Apache Spark in the South East

Apache Spark
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the South East.

Salary trend for Apache Spark in the South East

Apache Spark
Salary Histogram in the South East

The salary distribution of IT jobs citing Apache Spark in the South East over the 6 months to 22 November 2018.

Salary histogram for Apache Spark in the South East

Apache Spark
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the South East region over the 6 months to 22 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +20 130 £55,000 -15.38% 24
Berkshire +52 85 £65,000 +13.04% 16
Surrey +73 55 £52,500 +16.67% 10
Hampshire -28 47 £75,000 +42.32% 11
Oxfordshire -5 26 £55,000 -24.66% 6
Buckinghamshire -4 19 £62,500 -1.96% 2
East Sussex +7 14 £58,750 +17.50% 2
West Sussex 0 5 £30,000 -55.56%
Apache Spark
England

For the 6 months to 22 November 2018, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region with a requirement for Apache Spark.

1 190 (72.24%) Hadoop
2 162 (61.60%) Big Data
3 151 (57.41%) Python
4 138 (52.47%) Java
5 120 (45.63%) Analytics
6 116 (44.11%) SQL
7 105 (39.92%) Kafka
8 95 (36.12%) Apache Hive
9 90 (34.22%) Data Science
10 85 (32.32%) R
11 82 (31.18%) Apache
12 76 (28.90%) Linux
12 76 (28.90%) Microsoft Azure
13 74 (28.14%) Degree
13 74 (28.14%) Data Modelling
14 72 (27.38%) Agile Software Development
14 72 (27.38%) Machine Learning
15 68 (25.86%) Visualisation
16 65 (24.71%) Mathematics
16 65 (24.71%) Retail
17 63 (23.95%) Telecoms
17 63 (23.95%) Business Intelligence
18 62 (23.57%) Artificial Intelligence
19 60 (22.81%) Algorithms
20 58 (22.05%) Amazon AWS
21 56 (21.29%) NoSQL
22 52 (19.77%) ETL
23 51 (19.39%) Tableau
24 50 (19.01%) Statistics
25 49 (18.63%) Open Source

Apache Spark
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 82 (31.18%) Apache
2 43 (16.35%) SAS
3 27 (10.27%) Elasticsearch
4 14 (5.32%) Jupyter
5 9 (3.42%) Apache Pig
6 8 (3.04%) Apache Solr
6 8 (3.04%) Cloud Foundry
6 8 (3.04%) Confluence
7 6 (2.28%) JBoss
8 4 (1.52%) GemFire
9 2 (0.76%) SharePoint
9 2 (0.76%) Tomcat
10 1 (0.38%) Apache Airflow
Applications
1 1 (0.38%) GNU Octave
Cloud Services
1 76 (28.90%) Microsoft Azure
2 58 (22.05%) Amazon AWS
3 18 (6.84%) GitHub
4 10 (3.80%) Cloud Computing
5 6 (2.28%) Azure Data Factory
5 6 (2.28%) Cortana Intelligence Suite
6 5 (1.90%) Google Cloud Platform
6 5 (1.90%) PaaS
7 4 (1.52%) Amazon EC2
7 4 (1.52%) Amazon EMR
7 4 (1.52%) Amazon S3
8 3 (1.14%) Amazon ELB
8 3 (1.14%) Azure Functions
8 3 (1.14%) Azure Machine Learning
8 3 (1.14%) SaaS
8 3 (1.14%) Serverless
8 3 (1.14%) Slack
Communications & Networking
1 5 (1.90%) DAB
2 4 (1.52%) HTTP
3 3 (1.14%) Internet
4 1 (0.38%) SAN
4 1 (0.38%) SMS
4 1 (0.38%) TCP/IP
Database & Business Intelligence
1 190 (72.24%) Hadoop
2 162 (61.60%) Big Data
3 95 (36.12%) Apache Hive
4 56 (21.29%) NoSQL
5 47 (17.87%) Power BI
6 45 (17.11%) Apache Cassandra
7 38 (14.45%) SQL Server
8 36 (13.69%) SAP HANA
8 36 (13.69%) Text Mining
9 31 (11.79%) HBase
10 30 (11.41%) Data Warehouse
11 27 (10.27%) MongoDB
12 24 (9.13%) Data Lake
13 19 (7.22%) Impala
13 19 (7.22%) Relational Database
14 10 (3.80%) Azure SQL Database
15 9 (3.42%) Parquet
15 9 (3.42%) SQL Server Integration Services
16 8 (3.04%) Data Mining
16 8 (3.04%) RDBMS
Development Applications
1 23 (8.75%) Git (software)
1 23 (8.75%) Jenkins
2 21 (7.98%) Visual Studio
3 12 (4.56%) JIRA
4 11 (4.18%) Gradle
5 8 (3.04%) Bitbucket
5 8 (3.04%) Eclipse
6 4 (1.52%) ERwin
6 4 (1.52%) PowerDesigner
6 4 (1.52%) RStudio
6 4 (1.52%) Subversion
6 4 (1.52%) Team Foundation Server
7 3 (1.14%) Axure RP
7 3 (1.14%) CircleCI
7 3 (1.14%) Visual Studio Team System
8 2 (0.76%) Eclipse RCP
8 2 (0.76%) JUnit
General
1 65 (24.71%) Retail
2 63 (23.95%) Telecoms
3 48 (18.25%) Finance
4 7 (2.66%) Marketing
5 4 (1.52%) Advertising
6 3 (1.14%) Games
7 2 (0.76%) Financial Institution
8 1 (0.38%) Banking
8 1 (0.38%) Local Government
Job Titles
1 73 (27.76%) Developer
2 66 (25.10%) Data Scientist
3 29 (11.03%) Architect
3 29 (11.03%) Software Developer
4 28 (10.65%) Senior Data Scientist
5 25 (9.51%) Data Engineer
6 21 (7.98%) Software Engineer
7 20 (7.60%) Java Developer
8 18 (6.84%) Data Architect
8 18 (6.84%) Senior Developer
9 16 (6.08%) Big Data Engineer
10 14 (5.32%) C++ Developer
10 14 (5.32%) C++ Software Developer
11 13 (4.94%) Python Developer
12 11 (4.18%) Systems Engineer
13 10 (3.80%) Big Data Architect
14 9 (3.42%) Artificial Intelligence Architect
14 9 (3.42%) Big Data Developer
15 8 (3.04%) Analyst
15 8 (3.04%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 105 (39.92%) Kafka
2 39 (14.83%) D3.js
3 36 (13.69%) ggplot
4 26 (9.89%) TensorFlow
5 23 (8.75%) JSON
5 23 (8.75%) REST
6 22 (8.37%) Natural Language Processing
7 19 (7.22%) Elastic Stack
8 18 (6.84%) AngularJS
9 15 (5.70%) Spring
10 14 (5.32%) RESTful
11 12 (4.56%) Django
11 12 (4.56%) RabbitMQ
12 11 (4.18%) Middleware
13 10 (3.80%) Spark Streaming
13 10 (3.80%) SparkR
14 9 (3.42%) Apache Avro
14 9 (3.42%) Ruby on Rails
15 8 (3.04%) React
15 8 (3.04%) Web Services
Miscellaneous
1 60 (22.81%) Algorithms
2 36 (13.69%) Computer Science
2 36 (13.69%) Social Network
3 32 (12.17%) Analytical Skills
4 19 (7.22%) Greenfield Project
5 16 (6.08%) Video on Demand
6 12 (4.56%) Linux Command Line
7 10 (3.80%) Mobile App
8 9 (3.42%) Virtual Team
9 7 (2.66%) Data Structures
9 7 (2.66%) NHS
10 5 (1.90%) Pricing Data
11 4 (1.52%) Self-Motivation
12 3 (1.14%) Smart City
13 2 (0.76%) Life Science
13 2 (0.76%) Replication
13 2 (0.76%) User Experience
14 1 (0.38%) Cloud Native
14 1 (0.38%) Management Information System
14 1 (0.38%) Robotics
Operating Systems
1 76 (28.90%) Linux
2 32 (12.17%) Windows
3 25 (9.51%) Unix
4 7 (2.66%) Android
4 7 (2.66%) Apple iOS
5 3 (1.14%) Ubuntu
6 2 (0.76%) Red Hat Enterprise Linux
Processes & Methodologies
1 120 (45.63%) Analytics
2 90 (34.22%) Data Science
3 74 (28.14%) Data Modelling
4 72 (27.38%) Agile Software Development
4 72 (27.38%) Machine Learning
5 68 (25.86%) Visualisation
6 65 (24.71%) Mathematics
7 63 (23.95%) Business Intelligence
8 62 (23.57%) Artificial Intelligence
9 52 (19.77%) ETL
10 50 (19.01%) Statistics
11 49 (18.63%) Data Engineering
11 49 (18.63%) Decision-Making
11 49 (18.63%) Open Source
12 43 (16.35%) Data Analytics
13 39 (14.83%) Data Visualisation
13 39 (14.83%) DevOps
14 37 (14.07%) Data Security
14 37 (14.07%) Econometrics
14 37 (14.07%) Operations Research
Programming Languages
1 151 (57.41%) Python
2 138 (52.47%) Java
3 116 (44.11%) SQL
4 85 (32.32%) R
5 35 (13.31%) Scala
6 29 (11.03%) C++
7 20 (7.60%) C#
8 18 (6.84%) C
9 17 (6.46%) Shell Script
10 15 (5.70%) JavaScript
11 12 (4.56%) Ruby
12 9 (3.42%) Bash Shell
12 9 (3.42%) HiveQL
13 8 (3.04%) Go
13 8 (3.04%) PowerShell
14 5 (1.90%) MATLAB
14 5 (1.90%) Perl
15 3 (1.14%) Julia
15 3 (1.14%) PHP
15 3 (1.14%) PL/SQL
Qualifications
1 74 (28.14%) Degree
2 21 (7.98%) Security Cleared
3 18 (6.84%) PhD
4 17 (6.46%) DV Cleared
5 10 (3.80%) Computer Science Degree
6 4 (1.52%) SC Cleared
7 1 (0.38%) ISEB
7 1 (0.38%) Master's Degree
7 1 (0.38%) Numerate Degree
Quality Assurance & Compliance
1 15 (5.70%) QA
2 13 (4.94%) Data Quality
3 2 (0.76%) GDPR
4 1 (0.38%) SLA
System Software
1 26 (9.89%) HDFS
2 15 (5.70%) Apache Flume
3 13 (4.94%) Apache ZooKeeper
4 12 (4.56%) Virtual Machines
5 7 (2.66%) Docker
Systems Management
1 47 (17.87%) Hadoop YARN
2 26 (9.89%) Kibana
3 20 (7.60%) Puppet
4 11 (4.18%) logstash
5 9 (3.42%) Terraform
6 8 (3.04%) Ansible
7 7 (2.66%) Kubernetes
8 4 (1.52%) Oozie
8 4 (1.52%) Opscode Chef
8 4 (1.52%) Rundeck
9 3 (1.14%) Oracle ZFS
10 2 (0.76%) Ambari
11 1 (0.38%) OMEGAMON
Vendors
1 51 (19.39%) Tableau
2 36 (13.69%) SAP
3 26 (9.89%) Hortonworks
4 22 (8.37%) Cloudera
5 20 (7.60%) Microsoft
6 19 (7.22%) Oracle
7 16 (6.08%) Atlassian
8 7 (2.66%) Databricks
9 6 (2.28%) RapidMiner
10 5 (1.90%) Ab Initio
10 5 (1.90%) Alteryx
10 5 (1.90%) Talend
11 4 (1.52%) MicroStrategy
12 3 (1.14%) Google
13 2 (0.76%) Jaspersoft
13 2 (0.76%) Netezza
13 2 (0.76%) Red Hat
14 1 (0.38%) Informatica
14 1 (0.38%) New Relic
14 1 (0.38%) Teradata