Period
to 18 September 2020

The following table provides summary statistics for permanent job vacancies advertised in the East of England with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 18 September 2020 with a comparison to the same period in the previous 2 years.

Apache Spark
England > East of England
6 months to
18 Sep 2020
Same period 2019 Same period 2018
Rank 111 214 229
Rank change year-on-year +103 +15 +32
Permanent jobs citing Apache Spark 24 58 124
As % of all permanent jobs advertised in the East of England 1.18% 0.81% 1.11%
As % of the Application Platforms category 8.05% 5.35% 7.37%
Number of salaries quoted 26 54 95
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +25.00%
10th Percentile £57,500 £50,000 £41,100
90th Percentile £88,125 £85,000 £80,000
England median annual salary £75,000 £73,436 £70,000
% change year-on-year +2.13% +4.91% +4.48%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the East of England with a requirement for application platform skills.

All Application Platform Skills
East of England
Permanent vacancies with a requirement for application platform skills 298 1,085 1,683
As % of all permanent IT jobs advertised in the East of England 14.65% 15.21% 15.00%
Number of salaries quoted 245 803 1,285
Median annual salary £45,000 £44,000 £46,000
Median salary % change year-on-year +2.27% -4.35% +2.22%
10th Percentile £26,350 £25,250 £26,000
90th Percentile £70,750 £67,500 £72,500
England median annual salary £55,000 £50,000 £50,000
% change year-on-year +10.00% - +5.26%

Apache Spark
Job Vacancy Trend in the East of England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the East of England.

Job vacancy trend for Apache Spark in the East of England

Apache Spark
Salary Trend in the East of England

3-month moving average salary quoted in jobs citing Apache Spark in the East of England.

Salary trend for Apache Spark in the East of England

Apache Spark
Salary Histogram in the East of England

Salary distribution for jobs citing Apache Spark in the East of England over the 6 months to 18 September 2020.

Salary histogram for Apache Spark in the East of England

Apache Spark
Job Locations in the East of England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the East of England region over the 6 months to 18 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Cambridgeshire +83 16 £70,000 -12.50% 6
Hertfordshire - 7 £75,000 - 1
Suffolk +4 1 £60,000 +20.00%
Apache Spark
England

For the 6 months to 18 September 2020, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the East of England region with a requirement for Apache Spark.

1 20 (83.33%) SQL
2 18 (75.00%) Scala
2 18 (75.00%) NoSQL
2 18 (75.00%) Big Data
3 17 (70.83%) AWS
3 17 (70.83%) Java
4 16 (66.67%) Apache Cassandra
4 16 (66.67%) Amazon Redshift
5 15 (62.50%) Amazon EMR
5 15 (62.50%) Analytics
5 15 (62.50%) Visualisation
6 14 (58.33%) C++
7 13 (54.17%) Python
7 13 (54.17%) PostgreSQL
7 13 (54.17%) Hadoop
7 13 (54.17%) DevOps
8 12 (50.00%) Relational Database
8 12 (50.00%) Data Science
9 11 (45.83%) Data Warehouse
9 11 (45.83%) OO
9 11 (45.83%) Data Visualisation
9 11 (45.83%) Spark Streaming
10 10 (41.67%) Data Centre
10 10 (41.67%) Data Structures
10 10 (41.67%) Performance Metrics
10 10 (41.67%) Actionable Insight
10 10 (41.67%) Process Improvement
10 10 (41.67%) Root Cause Analysis
10 10 (41.67%) Kafka
10 10 (41.67%) Amazon RDS

Apache Spark
Co-occurring IT Skills in the East of England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (41.67%) Apache Airflow
1 10 (41.67%) Luigi
2 7 (29.17%) Apache
3 6 (25.00%) Elasticsearch
4 1 (4.17%) Apache Pig
Cloud Services
1 17 (70.83%) AWS
2 15 (62.50%) Amazon EMR
3 10 (41.67%) Amazon EC2
3 10 (41.67%) Azure
3 10 (41.67%) Logic Apps
4 8 (33.33%) Power Platform
5 5 (20.83%) Amazon S3
5 5 (20.83%) Amazon SQS
6 4 (16.67%) Serverless
7 1 (4.17%) Amazon Cognito
7 1 (4.17%) Amazon Kinesis
7 1 (4.17%) AWS CloudFormation
7 1 (4.17%) AWS Lambda
7 1 (4.17%) SaaS
Communications & Networking
1 1 (4.17%) Skype
Database & Business Intelligence
1 18 (75.00%) Big Data
1 18 (75.00%) NoSQL
2 16 (66.67%) Amazon Redshift
2 16 (66.67%) Apache Cassandra
3 13 (54.17%) Hadoop
3 13 (54.17%) PostgreSQL
4 12 (50.00%) Relational Database
5 11 (45.83%) Data Warehouse
6 10 (41.67%) Amazon RDS
6 10 (41.67%) Azkaban
6 10 (41.67%) SQL Server
6 10 (41.67%) SQL Server Integration Services
6 10 (41.67%) SQL Server Reporting Services
7 8 (33.33%) Power BI
8 6 (25.00%) Apache Ignite
8 6 (25.00%) CouchDB
8 6 (25.00%) Flink
8 6 (25.00%) MongoDB
8 6 (25.00%) Redis
9 5 (20.83%) Apache Hive
Development Applications
1 9 (37.50%) Jenkins
2 6 (25.00%) Atlassian Bamboo
2 6 (25.00%) CircleCI
2 6 (25.00%) GitLab
2 6 (25.00%) TeamCity
2 6 (25.00%) Travis CI
3 3 (12.50%) Git (software)
3 3 (12.50%) Sonatype Nexus
General
1 3 (12.50%) Manufacturing
2 2 (8.33%) Pharmaceutical
Job Titles
1 12 (50.00%) Developer
2 10 (41.67%) Data Engineer
3 7 (29.17%) Senior Data Engineer
4 6 (25.00%) Senior Developer
5 5 (20.83%) Business Developer
5 5 (20.83%) Business Intelligence Developer
5 5 (20.83%) Power BI Developer
5 5 (20.83%) Senior Business Intelligence Developer
6 4 (16.67%) Data Analytics Engineer
7 1 (4.17%) Clojure Developer
7 1 (4.17%) Elixir Developer
7 1 (4.17%) F# Developer
7 1 (4.17%) Haskell Developer
7 1 (4.17%) Programmer
7 1 (4.17%) Scala Developer
7 1 (4.17%) Senior Programmer
7 1 (4.17%) Senior Software Engineer
7 1 (4.17%) Software Engineer
Libraries, Frameworks & Software Standards
1 11 (45.83%) Spark Streaming
2 10 (41.67%) Kafka
3 1 (4.17%) JSON
3 1 (4.17%) Spring
3 1 (4.17%) Web Services
3 1 (4.17%) XML
Miscellaneous
1 10 (41.67%) Data Centre
1 10 (41.67%) Data Structures
1 10 (41.67%) Management Information System
2 6 (25.00%) Self-Motivation
Operating Systems
1 8 (33.33%) Linux
Processes & Methodologies
1 15 (62.50%) Analytics
1 15 (62.50%) Visualisation
2 13 (54.17%) DevOps
3 12 (50.00%) Data Science
4 11 (45.83%) Data Visualisation
4 11 (45.83%) OO
5 10 (41.67%) Actionable Insight
5 10 (41.67%) Computer Science
5 10 (41.67%) Customer Acquisition
5 10 (41.67%) Data Integration
5 10 (41.67%) Data Munging
5 10 (41.67%) Data Transformation
5 10 (41.67%) Informatics
5 10 (41.67%) Performance Metrics
5 10 (41.67%) Process Improvement
5 10 (41.67%) Root Cause Analysis
5 10 (41.67%) Statistics
5 10 (41.67%) Workflow
5 10 (41.67%) Workflow Management
5 10 (41.67%) Workload Management
Programming Languages
1 20 (83.33%) SQL
2 18 (75.00%) Scala
3 17 (70.83%) Java
4 14 (58.33%) C++
5 13 (54.17%) Python
6 8 (33.33%) F#
7 7 (29.17%) Clojure
7 7 (29.17%) Haskell
7 7 (29.17%) Rust
8 4 (16.67%) C#
8 4 (16.67%) Elixir
9 3 (12.50%) Erlang
9 3 (12.50%) Go
9 3 (12.50%) JavaScript
9 3 (12.50%) Kotlin
9 3 (12.50%) OCaml
9 3 (12.50%) R
Qualifications
1 10 (41.67%) Computer Science Degree
1 10 (41.67%) Degree
2 1 (4.17%) AWS Certification
System Software
1 8 (33.33%) Docker
2 1 (4.17%) HDFS
Systems Management
1 7 (29.17%) Kubernetes
2 6 (25.00%) Ansible
2 6 (25.00%) Opscode Chef
2 6 (25.00%) Puppet
3 1 (4.17%) Mesos
Vendors
1 10 (41.67%) Microsoft
2 3 (12.50%) MicroStrategy
3 1 (4.17%) Tableau
3 1 (4.17%) Talend