Period
to 27 July 2021

The following table provides summary statistics for permanent job vacancies advertised in the East of England with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 27 July 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
England > East of England
6 months to
27 Jul 2021
Same period 2020 Same period 2019
Rank 174 145 219
Rank change year-on-year -29 +74 +15
Permanent jobs citing Apache Spark 40 33 65
As % of all permanent jobs advertised in the East of England 0.85% 1.04% 0.87%
As % of the Application Platforms category 5.81% 7.53% 6.01%
Number of salaries quoted 14 30 60
10th Percentile £47,500 £57,500 "
25th Percentile £58,875 £59,063 £50,000
Median annual salary (50th Percentile) £80,000 £72,500 £60,000
Median % change year-on-year +10.34% +20.83% -9.09%
75th Percentile £91,563 £83,438 £71,250
90th Percentile £113,750 £120,000 £85,000
England median annual salary £77,075 £77,500 £75,000
% change year-on-year -0.55% +3.33% +7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the East of England with a requirement for application platform skills.

All Application Platform Skills
East of England
Permanent vacancies with a requirement for application platform skills 688 438 1,081
As % of all permanent IT jobs advertised in the East of England 14.55% 13.78% 14.51%
Number of salaries quoted 393 351 826
10th Percentile £27,500 £27,500 £25,500
25th Percentile £36,250 £36,250 £33,500
Median annual salary (50th Percentile) £47,500 £45,000 £45,000
Median % change year-on-year +5.56% - -4.26%
75th Percentile £64,669 £56,000 £57,500
90th Percentile £81,250 £68,750 £68,750
England median annual salary £55,000 £53,500 £52,000
% change year-on-year +2.80% +2.88% +4.00%

Apache Spark
Job Vacancy Trend in the East of England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the East of England.

Job vacancy trend for Apache Spark in the East of England

Apache Spark
Salary Trend in the East of England

3-month moving average salary quoted in jobs citing Apache Spark in the East of England.

Salary trend for Apache Spark in the East of England

Apache Spark
Salary Histogram in the East of England

Salary distribution for jobs citing Apache Spark in the East of England over the 6 months to 27 July 2021.

Salary histogram for Apache Spark in the East of England

Apache Spark
Job Locations in the East of England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the East of England region over the 6 months to 27 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Cambridgeshire -29 28 £77,500 +14.81% 5
Hertfordshire -16 6 £107,500 +43.33% 1
Suffolk +1 3 £55,000 -
Essex +6 1 £59,500 +40.00%
Apache Spark
England

For the 6 months to 27 July 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the East of England region with a requirement for Apache Spark.

1 36 (90.00%) Python
2 31 (77.50%) AWS
2 31 (77.50%) Data Science
3 24 (60.00%) Analytics
4 20 (50.00%) Artificial Intelligence
4 20 (50.00%) SQL
5 19 (47.50%) Hadoop
6 17 (42.50%) Machine Learning
7 16 (40.00%) Big Data
7 16 (40.00%) Software Engineering
7 16 (40.00%) Java
7 16 (40.00%) Business Intelligence
8 15 (37.50%) Computer Science
9 14 (35.00%) Visualisation
9 14 (35.00%) Data Warehouse
9 14 (35.00%) Kafka
9 14 (35.00%) Amazon Redshift
9 14 (35.00%) Serverless
9 14 (35.00%) Data Engineering
10 13 (32.50%) Natural Language Processing
11 12 (30.00%) R
11 12 (30.00%) Kubernetes
11 12 (30.00%) Data Analysis
12 11 (27.50%) Degree
12 11 (27.50%) Life Science
12 11 (27.50%) Open Source
12 11 (27.50%) Games
12 11 (27.50%) Computer Science Degree
12 11 (27.50%) NoSQL
12 11 (27.50%) DevOps

Apache Spark
Co-occurring IT Skills in the East of England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (17.50%) Apache
2 5 (12.50%) Apache Solr
3 4 (10.00%) Apache Airflow
4 3 (7.50%) Jupyter
5 1 (2.50%) Apache Synapse
5 1 (2.50%) Elasticsearch
Applications
1 2 (5.00%) Gephi
Cloud Services
1 31 (77.50%) AWS
2 14 (35.00%) Serverless
3 8 (20.00%) AWS Lambda
3 8 (20.00%) Power Platform
4 6 (15.00%) GCP
5 5 (12.50%) Amazon EMR
5 5 (12.50%) AWS CloudFormation
5 5 (12.50%) Azure
6 3 (7.50%) Amazon SageMaker
6 3 (7.50%) Snowflake
7 2 (5.00%) Amazon CloudWatch
7 2 (5.00%) Amazon S3
7 2 (5.00%) Amazon SQS
7 2 (5.00%) PowerApps
8 1 (2.50%) Azure Cosmos DB
8 1 (2.50%) Azure Synapse Analytics
8 1 (2.50%) Cloud Computing
Communications & Networking
1 2 (5.00%) DNS
1 2 (5.00%) Ethernet
1 2 (5.00%) Firewall
1 2 (5.00%) HTTP
1 2 (5.00%) Intrusion Detection
1 2 (5.00%) MPLS
1 2 (5.00%) SSL
1 2 (5.00%) VPN
Database & Business Intelligence
1 19 (47.50%) Hadoop
2 16 (40.00%) Big Data
3 14 (35.00%) Amazon Redshift
3 14 (35.00%) Data Warehouse
4 11 (27.50%) NoSQL
5 9 (22.50%) Apache Hive
6 8 (20.00%) Data Lake
6 8 (20.00%) Tableau
7 7 (17.50%) Amazon Aurora
7 7 (17.50%) Star Schema
8 5 (12.50%) Amazon DynamoDB
8 5 (12.50%) Apache Cassandra
8 5 (12.50%) ClickHouse
8 5 (12.50%) Electronic Patient Records
8 5 (12.50%) Oracle ODI
8 5 (12.50%) Power BI
9 4 (10.00%) Looker
9 4 (10.00%) MySQL
10 3 (7.50%) Data Mining
10 3 (7.50%) PostgreSQL
Development Applications
1 10 (25.00%) Jenkins
2 9 (22.50%) Git (software)
3 5 (12.50%) Oracle APEX
4 2 (5.00%) Bitbucket
4 2 (5.00%) Bitbucket Server
4 2 (5.00%) git-flow
4 2 (5.00%) JIRA
4 2 (5.00%) Sonatype Nexus
General
1 11 (27.50%) Games
2 10 (25.00%) Manufacturing
3 9 (22.50%) Social Skills
4 6 (15.00%) Analytical Skills
5 5 (12.50%) Influencing Skills
6 4 (10.00%) Pharmaceutical
7 2 (5.00%) Law
7 2 (5.00%) Legal
7 2 (5.00%) Retail
8 1 (2.50%) Electronics
8 1 (2.50%) Finance
Job Titles
1 12 (30.00%) Data Engineer
2 4 (10.00%) Data Science Leader
2 4 (10.00%) Java Engineer
3 3 (7.50%) Analyst
3 3 (7.50%) Architect
3 3 (7.50%) Data Analyst
3 3 (7.50%) Data Architect
3 3 (7.50%) Data Programmer
3 3 (7.50%) Data Scientist
3 3 (7.50%) Developer
3 3 (7.50%) Enterprise Architect
3 3 (7.50%) Enterprise Data Architect
3 3 (7.50%) Full Stack Developer
3 3 (7.50%) Operations Engineer
3 3 (7.50%) Programmer
3 3 (7.50%) Senior Data Engineer
4 2 (5.00%) AWS Engineer
4 2 (5.00%) Data Science Analyst
4 2 (5.00%) Java Software Engineer
4 2 (5.00%) Software Engineer
Libraries, Frameworks & Software Standards
1 14 (35.00%) Kafka
2 8 (20.00%) Shiny
3 6 (15.00%) TensorFlow
4 5 (12.50%) React
5 4 (10.00%) Elastic Stack
5 4 (10.00%) NumPy
5 4 (10.00%) SciPy
6 3 (7.50%) .NET
6 3 (7.50%) NLTK
6 3 (7.50%) Pandas
7 2 (5.00%) RESTful
8 1 (2.50%) PyTorch
8 1 (2.50%) scikit-learn
Miscellaneous
1 11 (27.50%) Life Science
2 9 (22.50%) Algorithms
3 7 (17.50%) Social Media
4 6 (15.00%) Cloud Native
5 2 (5.00%) Analytical Mindset
5 2 (5.00%) Cyber Kill Chain
5 2 (5.00%) Data Structures
5 2 (5.00%) Management Information System
5 2 (5.00%) Mobile App
6 1 (2.50%) Biotechnology
6 1 (2.50%) Blog
6 1 (2.50%) NHS
6 1 (2.50%) Tandem
Operating Systems
1 2 (5.00%) Android
1 2 (5.00%) Apple iOS
1 2 (5.00%) Linux
Processes & Methodologies
1 31 (77.50%) Data Science
2 24 (60.00%) Analytics
3 20 (50.00%) Artificial Intelligence
4 17 (42.50%) Machine Learning
5 16 (40.00%) Business Intelligence
5 16 (40.00%) Software Engineering
6 15 (37.50%) Computer Science
7 14 (35.00%) Data Engineering
7 14 (35.00%) Visualisation
8 13 (32.50%) Natural Language Processing
9 12 (30.00%) Data Analysis
10 11 (27.50%) DevOps
10 11 (27.50%) Open Source
11 10 (25.00%) Computer Vision
11 10 (25.00%) Continuous Integration
11 10 (25.00%) Scrum
12 9 (22.50%) Agile Software Development
12 9 (22.50%) Predictive Modelling
13 8 (20.00%) Data Modelling
13 8 (20.00%) ETL
Programming Languages
1 36 (90.00%) Python
2 20 (50.00%) SQL
3 16 (40.00%) Java
4 12 (30.00%) R
5 5 (12.50%) JavaScript
6 4 (10.00%) C
7 3 (7.50%) Bash Shell
7 3 (7.50%) Scala
8 2 (5.00%) Groovy
8 2 (5.00%) Java 8
8 2 (5.00%) Perl
9 1 (2.50%) C++
9 1 (2.50%) Go
9 1 (2.50%) Julia
Qualifications
1 11 (27.50%) Computer Science Degree
1 11 (27.50%) Degree
2 8 (20.00%) PhD
3 3 (7.50%) Master's Degree
4 2 (5.00%) CCNA
4 2 (5.00%) CEH
4 2 (5.00%) Cisco Certification
4 2 (5.00%) CISSP
4 2 (5.00%) CompTIA Security+
4 2 (5.00%) DV Cleared
4 2 (5.00%) GIAC
4 2 (5.00%) Linux+ Certification
4 2 (5.00%) MCSE
4 2 (5.00%) Microsoft Certification
4 2 (5.00%) Network+ Certification
4 2 (5.00%) SANS
4 2 (5.00%) Security Cleared
4 2 (5.00%) SSCP
Quality Assurance & Compliance
1 8 (20.00%) Data Quality
2 6 (15.00%) GxP
System Software
1 8 (20.00%) Docker
2 5 (12.50%) Apache ZooKeeper
3 2 (5.00%) Apache Flume
4 1 (2.50%) HDFS
Systems Management
1 12 (30.00%) Kubernetes
2 8 (20.00%) Terraform
3 6 (15.00%) Hadoop YARN
4 5 (12.50%) Mesos
5 4 (10.00%) Ansible
6 3 (7.50%) Kubeflow
7 2 (5.00%) Kibana
7 2 (5.00%) Oozie
Vendors
1 9 (22.50%) Oracle
2 7 (17.50%) Facebook
2 7 (17.50%) Instagram
3 5 (12.50%) MuleSoft
4 4 (10.00%) Microsoft
4 4 (10.00%) Splunk
5 3 (7.50%) Cloudera
5 3 (7.50%) Dataiku
5 3 (7.50%) Google
5 3 (7.50%) Informatica
6 2 (5.00%) Alibaba
6 2 (5.00%) BT
6 2 (5.00%) MicroStrategy
6 2 (5.00%) Talend
7 1 (2.50%) Cognos
7 1 (2.50%) Databricks
7 1 (2.50%) IBM
7 1 (2.50%) Netezza
7 1 (2.50%) NVIDIA
7 1 (2.50%) Teradata