Period
to 11 December 2019

The following table provides summary statistics for permanent job vacancies advertised in the East of England with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 11 December 2019 with a comparison to the same period in the previous 2 years.

Apache Spark
England > East of England
6 months to
11 Dec 2019
Same period 2018 Same period 2017
Rank 203 254 252
Rank change year-on-year +51 -2 +99
Permanent jobs citing Apache Spark 59 76 107
As % of all permanent IT jobs advertised in the East of England 0.89% 0.77% 0.88%
As % of the Application Platforms category 5.68% 5.07% 5.98%
Number of salaries quoted 49 58 52
East of England median annual salary £72,500 £66,750 £60,000
Median salary % change year-on-year +8.61% +11.25% +20.00%
10th Percentile £49,750 £36,525 £37,625
90th Percentile £81,000 £77,500 £81,250
England median annual salary £72,500 £75,000 £67,500
% change year-on-year -3.33% +11.11% -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the East of England with a requirement for application platform skills.

All Application Platform Skills
East of England
Permanent vacancies with a requirement for application platform skills 1,039 1,500 1,789
As % of all permanent IT jobs advertised in the East of England 15.70% 15.12% 14.72%
Number of salaries quoted 763 1,095 1,403
East of England median annual salary £45,000 £47,500 £45,000
Median salary % change year-on-year -5.26% +5.56% -1.10%
10th Percentile £26,250 £27,500 £26,250
90th Percentile £74,750 £72,500 £71,250
England median annual salary £50,000 £50,000 £47,500
% change year-on-year - +5.26% +2.43%

Apache Spark
Job Vacancy Trend in the East of England

Job postings citing Apache Spark as a percentage of all IT jobs advertised in the East of England.

Job vacancy trend for Apache Spark in the East of England

Apache Spark
Salary Trend in the East of England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Spark in the East of England.

Salary trend for Apache Spark in the East of England

Apache Spark
Salary Histogram in the East of England

The salary distribution of IT jobs citing Apache Spark in the East of England over the 6 months to 11 December 2019.

Salary histogram for Apache Spark in the East of England

Apache Spark
Job Locations in the East of England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the East of England region over the 6 months to 11 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Bedfordshire +19 26 £75,000 +12.36% 5
Suffolk +19 17 £50,000 -9.09% 2
Cambridgeshire +15 11 £80,000 +28.00% 9
Hertfordshire +54 5 £80,000 +10.34% 3
Apache Spark
England

For the 6 months to 11 December 2019, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the East of England region with a requirement for Apache Spark.

1 46 (77.97%) Python
1 46 (77.97%) Big Data
2 45 (76.27%) Apache Hive
3 42 (71.19%) Oozie
4 40 (67.80%) Scrum
5 37 (62.71%) Impala
6 36 (61.02%) Analytical Skills
7 34 (57.63%) Kafka
8 33 (55.93%) Agile Software Development
9 29 (49.15%) Data Modelling
10 28 (47.46%) Apache Flume
11 26 (44.07%) Linux
11 26 (44.07%) Hadoop
12 25 (42.37%) Visualisation
12 25 (42.37%) Git (software)
12 25 (42.37%) Data Science
13 23 (38.98%) Machine Learning
13 23 (38.98%) MapReduce
13 23 (38.98%) Unix
13 23 (38.98%) Shell Script
14 22 (37.29%) Analytics
14 22 (37.29%) Apache Kudu
15 21 (35.59%) R
16 18 (30.51%) Data Analysis
16 18 (30.51%) HDFS
17 17 (28.81%) Scala
18 16 (27.12%) Data Engineering
18 16 (27.12%) Cybersecurity
19 15 (25.42%) Conceptual Models
19 15 (25.42%) Data Warehouse

Apache Spark
Co-occurring IT Skills in the East of England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 6 (10.17%) Apache Solr
2 2 (3.39%) Elasticsearch
2 2 (3.39%) OpenStack
Applications
1 3 (5.08%) Gephi
Cloud Services
1 12 (20.34%) AWS
2 6 (10.17%) Amazon EMR
2 6 (10.17%) Amazon S3
2 6 (10.17%) Amazon SQS
2 6 (10.17%) Siri
3 4 (6.78%) Azure
4 2 (3.39%) GCP
4 2 (3.39%) OpenShift
4 2 (3.39%) Serverless
Communications & Networking
1 3 (5.08%) DNS
1 3 (5.08%) Ethernet
1 3 (5.08%) HTTP
1 3 (5.08%) MPLS
1 3 (5.08%) SSL
1 3 (5.08%) VPN
2 2 (3.39%) Firewall
2 2 (3.39%) HTTPS
2 2 (3.39%) TCP/IP
Database & Business Intelligence
1 46 (77.97%) Big Data
2 45 (76.27%) Apache Hive
3 37 (62.71%) Impala
4 26 (44.07%) Hadoop
5 22 (37.29%) Apache Kudu
6 15 (25.42%) Data Warehouse
7 13 (22.03%) OLTP
8 10 (16.95%) SQL Server
9 9 (15.25%) Relational Database
10 8 (13.56%) HBase
10 8 (13.56%) Sqoop
11 7 (11.86%) Amazon Redshift
11 7 (11.86%) MySQL
11 7 (11.86%) PostgreSQL
12 6 (10.17%) Amazon Aurora
12 6 (10.17%) Star Schema
13 4 (6.78%) Data Lake
14 3 (5.08%) Electronic Patient Records
14 3 (5.08%) NoSQL
14 3 (5.08%) Oracle BI EE
Development Applications
1 25 (42.37%) Git (software)
2 14 (23.73%) JIRA
3 13 (22.03%) Bitbucket
3 13 (22.03%) git-flow
4 11 (18.64%) Bitbucket Server
5 4 (6.78%) Jenkins
5 4 (6.78%) Sonatype Nexus
General
1 5 (8.47%) Finance
2 3 (5.08%) Legal
3 1 (1.69%) Aerospace
3 1 (1.69%) Automotive
3 1 (1.69%) Marketing
Job Titles
1 16 (27.12%) Data Scientist
2 15 (25.42%) Architect
3 12 (20.34%) Consultant
3 12 (20.34%) Data Architect
3 12 (20.34%) Data Engineer
4 10 (16.95%) Data Consultant
4 10 (16.95%) Hadoop Architect
5 8 (13.56%) Technical Architect
6 7 (11.86%) Senior Data Scientist
7 6 (10.17%) Analyst
7 6 (10.17%) Big Data Engineer
7 6 (10.17%) Data Analyst
7 6 (10.17%) Senior Data Engineer
8 5 (8.47%) Cloud Architect
9 4 (6.78%) Big Data Architect
9 4 (6.78%) Hadoop Engineer
10 3 (5.08%) Senior Hadoop Engineer
10 3 (5.08%) Tableau Architect
11 2 (3.39%) Automation Test Lead
11 2 (3.39%) Test Engineer
Libraries, Frameworks & Software Standards
1 34 (57.63%) Kafka
2 14 (23.73%) Elastic Stack
3 6 (10.17%) D3.js
3 6 (10.17%) ggplot
4 4 (6.78%) AngularJS
4 4 (6.78%) Node.js
4 4 (6.78%) React
5 2 (3.39%) .NET
5 2 (3.39%) ASP.NET
5 2 (3.39%) CSS
5 2 (3.39%) GraphQL
5 2 (3.39%) HTML
5 2 (3.39%) HTML5
5 2 (3.39%) REST
5 2 (3.39%) RESTful
5 2 (3.39%) Spring
5 2 (3.39%) Spring MVC
5 2 (3.39%) Vue.js
6 1 (1.69%) Natural Language Processing
Miscellaneous
1 36 (61.02%) Analytical Skills
2 14 (23.73%) Cyber Kill Chain
3 11 (18.64%) Analytical Mindset
4 6 (10.17%) Data Structures
4 6 (10.17%) iPad
4 6 (10.17%) iPhone
4 6 (10.17%) Self-Motivation
4 6 (10.17%) User Experience
5 3 (5.08%) Cybercrime
6 1 (1.69%) Algorithms
6 1 (1.69%) Cloud Native
6 1 (1.69%) Greenfield Project
Operating Systems
1 26 (44.07%) Linux
2 23 (38.98%) Unix
3 2 (3.39%) Android
3 2 (3.39%) Apple iOS
Processes & Methodologies
1 40 (67.80%) Scrum
2 33 (55.93%) Agile Software Development
3 29 (49.15%) Data Modelling
4 25 (42.37%) Data Science
4 25 (42.37%) Visualisation
5 23 (38.98%) Machine Learning
5 23 (38.98%) MapReduce
6 22 (37.29%) Analytics
7 18 (30.51%) Data Analysis
8 16 (27.12%) Cybersecurity
8 16 (27.12%) Data Engineering
9 15 (25.42%) Conceptual Models
10 14 (23.73%) Mathematics
10 14 (23.73%) OSINT
10 14 (23.73%) Stakeholder Management
11 13 (22.03%) Business Intelligence
11 13 (22.03%) Kanban
11 13 (22.03%) Waterfall
12 12 (20.34%) Logical Data Model
12 12 (20.34%) Physical Data Model
Programming Languages
1 46 (77.97%) Python
2 23 (38.98%) Shell Script
3 21 (35.59%) R
4 17 (28.81%) Scala
5 14 (23.73%) C
6 11 (18.64%) Bash Shell
6 11 (18.64%) Perl
7 4 (6.78%) SQL
8 3 (5.08%) Java
9 2 (3.39%) C#
9 2 (3.39%) ES6
9 2 (3.39%) JavaScript
9 2 (3.39%) Kotlin
9 2 (3.39%) PHP
9 2 (3.39%) TypeScript
10 1 (1.69%) C++
10 1 (1.69%) MATLAB
Qualifications
1 11 (18.64%) Degree
2 3 (5.08%) DV Cleared
2 3 (5.08%) Security Cleared
3 2 (3.39%) CCNA
3 2 (3.39%) Cisco Certification
3 2 (3.39%) CISSP
3 2 (3.39%) CompTIA Security+
3 2 (3.39%) Computer Science Degree
3 2 (3.39%) GIAC
3 2 (3.39%) Linux+ Certification
3 2 (3.39%) MCSE
3 2 (3.39%) Microsoft Certification
3 2 (3.39%) Network+ Certification
3 2 (3.39%) SANS
3 2 (3.39%) SSCP
4 1 (1.69%) PhD
Quality Assurance & Compliance
1 9 (15.25%) Data Quality
2 3 (5.08%) CDISC
2 3 (5.08%) HL7
System Software
1 28 (47.46%) Apache Flume
2 18 (30.51%) HDFS
3 8 (13.56%) Apache ZooKeeper
4 4 (6.78%) Docker
Systems Management
1 42 (71.19%) Oozie
2 8 (13.56%) Hadoop YARN
3 4 (6.78%) Kubernetes
4 3 (5.08%) Kibana
Vendors
1 14 (23.73%) Splunk
2 11 (18.64%) Tableau
3 9 (15.25%) Cloudera
4 6 (10.17%) Apple
5 4 (6.78%) Informatica
6 3 (5.08%) BT
6 3 (5.08%) MicroStrategy
6 3 (5.08%) Talend
7 2 (3.39%) Alteryx
7 2 (3.39%) Google