Period
to 29 September 2020

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 29 September 2020 with a comparison to the same period in the previous 2 years.

Apache Spark
Central London > City of London
6 months to
29 Sep 2020
Same period 2019 Same period 2018
Rank 101 157 150
Rank change year-on-year +56 -7 +21
Permanent jobs citing Apache Spark 98 214 230
As % of all permanent jobs advertised in the City of London 2.62% 2.14% 2.09%
As % of the Application Platforms category 18.88% 14.39% 11.78%
Number of salaries quoted 83 214 224
Median annual salary £75,000 £75,000 £80,000
Median salary % change year-on-year - -6.25% +6.67%
10th Percentile £48,850 £55,000 £52,500
90th Percentile £105,000 £113,375 £102,500
Central London median annual salary £75,000 £75,000 £80,000
% change year-on-year - -6.25% +6.67%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for application platform skills.

All Application Platform Skills
City of London
Permanent vacancies with a requirement for application platform skills 519 1,487 1,953
As % of all permanent IT jobs advertised in the City of London 13.89% 14.90% 17.78%
Number of salaries quoted 434 1,321 1,779
Median annual salary £65,000 £65,000 £60,000
Median salary % change year-on-year - +8.33% -
10th Percentile £41,250 £32,500 £36,250
90th Percentile £100,000 £95,000 £90,000
Central London median annual salary £65,000 £62,500 £60,000
% change year-on-year +4.00% +4.17% +4.35%

Apache Spark
Job Vacancy Trend in the City of London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Apache Spark in the City of London

Apache Spark
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Apache Spark in the City of London.

Salary trend for Apache Spark in the City of London

Apache Spark
Salary Histogram in the City of London

Salary distribution for jobs citing Apache Spark in the City of London over the 6 months to 29 September 2020.

Salary histogram for Apache Spark in the City of London

Apache Spark
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the City of London region over the 6 months to 29 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate +2 4 £70,000 +16.67%
Apache Spark
Central London

For the 6 months to 29 September 2020, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Apache Spark.

1 60 (61.22%) Hadoop
2 56 (57.14%) Big Data
2 56 (57.14%) Python
3 48 (48.98%) Java
4 46 (46.94%) Kafka
5 45 (45.92%) AWS
6 38 (38.78%) Scala
7 35 (35.71%) Docker
7 35 (35.71%) Apache
8 33 (33.67%) Data Science
9 32 (32.65%) JavaScript
10 30 (30.61%) Kubernetes
11 29 (29.59%) Azure
12 28 (28.57%) Machine Learning
13 27 (27.55%) Finance
13 27 (27.55%) Agile Software Development
14 26 (26.53%) Analytics
15 25 (25.51%) Artificial Intelligence
16 24 (24.49%) C#
17 22 (22.45%) SQL
17 22 (22.45%) Git (software)
18 21 (21.43%) NoSQL
18 21 (21.43%) R
18 21 (21.43%) AngularJS
18 21 (21.43%) SQL Server
19 20 (20.41%) DevOps
19 20 (20.41%) Analytical Skills
20 19 (19.39%) Apache Hive
20 19 (19.39%) Computer Science
21 17 (17.35%) React

Apache Spark
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 35 (35.71%) Apache
2 6 (6.12%) SAS
3 5 (5.10%) Apache Airflow
3 5 (5.10%) Elasticsearch
4 4 (4.08%) Tomcat
5 3 (3.06%) Confluence
5 3 (3.06%) WebSphere
6 1 (1.02%) Apache Pig
6 1 (1.02%) Apache Synapse
Cloud Services
1 45 (45.92%) AWS
2 29 (29.59%) Azure
3 15 (15.31%) GCP
4 11 (11.22%) Amazon S3
4 11 (11.22%) Power Platform
4 11 (11.22%) SaaS
5 7 (7.14%) Serverless
6 6 (6.12%) Amazon Kinesis
7 5 (5.10%) AWS Lambda
8 4 (4.08%) Amazon EMR
8 4 (4.08%) Amazon SQS
8 4 (4.08%) OpenShift
9 3 (3.06%) Azure Data Factory
10 2 (2.04%) Amazon CloudWatch
10 2 (2.04%) Amazon ECS
10 2 (2.04%) Amazon ElastiCache
10 2 (2.04%) Amazon SageMaker
10 2 (2.04%) Azure Active Directory
10 2 (2.04%) Logic Apps
11 1 (1.02%) Amazon GuardDuty
Communications & Networking
1 5 (5.10%) Kerberos
2 4 (4.08%) HTTP
3 3 (3.06%) AMQP
3 3 (3.06%) TCP/IP
4 1 (1.02%) Firewall
4 1 (1.02%) HTTPS
4 1 (1.02%) Network Security
4 1 (1.02%) SSL
Database & Business Intelligence
1 60 (61.22%) Hadoop
2 56 (57.14%) Big Data
3 21 (21.43%) NoSQL
3 21 (21.43%) SQL Server
4 19 (19.39%) Apache Hive
5 14 (14.29%) Apache Cassandra
6 13 (13.27%) MongoDB
7 11 (11.22%) Power BI
8 10 (10.20%) Amazon Redshift
8 10 (10.20%) PostgreSQL
8 10 (10.20%) Relational Database
9 9 (9.18%) HBase
9 9 (9.18%) MySQL
9 9 (9.18%) Presto
10 8 (8.16%) Data Lake
10 8 (8.16%) Redis
11 7 (7.14%) RDBMS
12 5 (5.10%) Bigtable
12 5 (5.10%) Sqoop
13 4 (4.08%) Data Warehouse
Development Applications
1 22 (22.45%) Git (software)
2 4 (4.08%) Atlassian Bamboo
3 3 (3.06%) Bitbucket
3 3 (3.06%) JIRA
4 1 (1.02%) GoCD
4 1 (1.02%) Jenkins
4 1 (1.02%) Octopus Deploy
4 1 (1.02%) TeamCity
General
1 27 (27.55%) Finance
2 15 (15.31%) Marketing
3 14 (14.29%) Banking
4 9 (9.18%) Front Office
5 6 (6.12%) Advertising
6 2 (2.04%) Financial Institution
6 2 (2.04%) Investment Banking
6 2 (2.04%) Pharmaceutical
6 2 (2.04%) Retail Banking
7 1 (1.02%) Law
7 1 (1.02%) Legal
7 1 (1.02%) Manufacturing
7 1 (1.02%) Public Sector
7 1 (1.02%) Retail
7 1 (1.02%) Telecoms
Job Titles
1 49 (50.00%) Developer
2 28 (28.57%) Java Developer
3 21 (21.43%) Data Engineer
4 18 (18.37%) Full Stack Developer
5 13 (13.27%) Java Engineer
6 11 (11.22%) Big Data Developer
6 11 (11.22%) Big Data Engineer
6 11 (11.22%) C# Developer
7 10 (10.20%) Architect
7 10 (10.20%) Data Architect
7 10 (10.20%) Senior Developer
8 9 (9.18%) Scala Developer
9 8 (8.16%) Big Data Architect
9 8 (8.16%) Data Scientist
9 8 (8.16%) Java Architect
9 8 (8.16%) Senior Data Engineer
10 7 (7.14%) AWS Engineer
10 7 (7.14%) Python Developer
10 7 (7.14%) Python Engineer
10 7 (7.14%) Software Engineer
Libraries, Frameworks & Software Standards
1 46 (46.94%) Kafka
2 21 (21.43%) AngularJS
3 17 (17.35%) React
4 13 (13.27%) Node.js
5 12 (12.24%) HTML
6 11 (11.22%) HTML5
6 11 (11.22%) RESTful
6 11 (11.22%) Spring
7 10 (10.20%) CSS
7 10 (10.20%) PySpark
8 9 (9.18%) Apache Beam
8 9 (9.18%) NumPy
8 9 (9.18%) Pandas
8 9 (9.18%) REST
9 7 (7.14%) JMS
9 7 (7.14%) Keras
9 7 (7.14%) Natural Language Processing
9 7 (7.14%) PyTorch
9 7 (7.14%) scikit-learn
9 7 (7.14%) TensorFlow
Miscellaneous
1 20 (20.41%) Analytical Skills
2 12 (12.24%) Algorithms
3 6 (6.12%) Market Risk
4 5 (5.10%) Cloud Native
4 5 (5.10%) Mobile App
5 4 (4.08%) Greenfield Project
6 3 (3.06%) Hedge funds
7 1 (1.02%) Bitcoin
7 1 (1.02%) Derivative
7 1 (1.02%) Equities
7 1 (1.02%) FMCG
7 1 (1.02%) Reference Data
7 1 (1.02%) Self-Motivation
Operating Systems
1 8 (8.16%) Linux
2 7 (7.14%) Red Hat Enterprise Linux
3 4 (4.08%) Unix
Processes & Methodologies
1 33 (33.67%) Data Science
2 28 (28.57%) Machine Learning
3 27 (27.55%) Agile Software Development
4 26 (26.53%) Analytics
5 25 (25.51%) Artificial Intelligence
6 20 (20.41%) DevOps
7 19 (19.39%) Computer Science
8 17 (17.35%) ETL
9 15 (15.31%) Business Intelligence
9 15 (15.31%) Microservices
9 15 (15.31%) Software Engineering
10 13 (13.27%) TDD
11 12 (12.24%) Digital Marketing
12 11 (11.22%) MapReduce
12 11 (11.22%) Mathematics
12 11 (11.22%) Statistics
13 10 (10.20%) Decision-Making
13 10 (10.20%) Mentoring
13 10 (10.20%) OO
14 9 (9.18%) Open Source
Programming Languages
1 56 (57.14%) Python
2 48 (48.98%) Java
3 38 (38.78%) Scala
4 32 (32.65%) JavaScript
5 24 (24.49%) C#
6 22 (22.45%) SQL
7 21 (21.43%) R
8 10 (10.20%) Ruby
9 9 (9.18%) TypeScript
10 7 (7.14%) Kotlin
10 7 (7.14%) PHP
11 6 (6.12%) ES6
11 6 (6.12%) MATLAB
12 5 (5.10%) Go
12 5 (5.10%) Java 8
13 3 (3.06%) Shell Script
14 2 (2.04%) T-SQL
15 1 (1.02%) Bash Shell
15 1 (1.02%) C++
15 1 (1.02%) Cypher
Qualifications
1 15 (15.31%) Degree
2 13 (13.27%) Computer Science Degree
3 6 (6.12%) Master's Degree
4 3 (3.06%) PhD
5 1 (1.02%) AWS Certification
5 1 (1.02%) SC Cleared
5 1 (1.02%) Security Cleared
Quality Assurance & Compliance
1 4 (4.08%) GDPR
1 4 (4.08%) QA
2 1 (1.02%) Data Quality
System Software
1 35 (35.71%) Docker
2 3 (3.06%) HDFS
3 1 (1.02%) Apache Flume
3 1 (1.02%) Apache ZooKeeper
Systems Management
1 30 (30.61%) Kubernetes
2 8 (8.16%) Terraform
3 7 (7.14%) Ansible
4 1 (1.02%) Ambari
4 1 (1.02%) Hadoop YARN
4 1 (1.02%) Nagios
4 1 (1.02%) Oozie
4 1 (1.02%) Opscode Chef
4 1 (1.02%) Prometheus
4 1 (1.02%) Puppet
4 1 (1.02%) Single Sign-On
Vendors
1 14 (14.29%) Tableau
2 12 (12.24%) Databricks
3 11 (11.22%) Splunk
4 9 (9.18%) Oracle
5 8 (8.16%) Cloudera
6 6 (6.12%) Google
7 4 (4.08%) Red Hat
8 3 (3.06%) Solace
9 2 (2.04%) Hortonworks
9 2 (2.04%) Informatica
9 2 (2.04%) NVIDIA
10 1 (1.02%) Ab Initio
10 1 (1.02%) Foundry
10 1 (1.02%) MapR
10 1 (1.02%) Microsoft
10 1 (1.02%) Palantir
10 1 (1.02%) Talend
10 1 (1.02%) TIBCO