Period
to 20 April 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 20 April 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
Central London > City of London
6 months to
20 Apr 2021
Same period 2020 Same period 2019
Rank 103 134 163
Rank change year-on-year +31 +29 -17
Permanent jobs citing Apache Spark 144 166 187
As % of all permanent jobs advertised in the City of London 2.94% 2.01% 1.83%
As % of the Application Platforms category 22.46% 14.45% 11.84%
Number of salaries quoted 136 153 175
10th Percentile £57,500 £50,000 £49,337
25th Percentile £65,938 £60,000 £56,250
Median annual salary (50th Percentile) £80,000 £72,500 £80,000
Median % change year-on-year +10.34% -9.38% -
75th Percentile £90,000 £93,750 £96,250
90th Percentile £112,500 £112,500 £116,250
Central London median annual salary £80,000 £74,000 £80,000
% change year-on-year +8.11% -7.50% +6.67%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for application platform skills.

All Application Platform Skills
City of London
Permanent vacancies with a requirement for application platform skills 641 1,149 1,580
As % of all permanent IT jobs advertised in the City of London 13.08% 13.94% 15.43%
Number of salaries quoted 583 1,030 1,394
10th Percentile £46,250 £37,500 £31,250
25th Percentile £53,750 £47,500 £45,000
Median annual salary (50th Percentile) £75,000 £65,000 £62,500
Median % change year-on-year +15.38% +4.00% +4.17%
75th Percentile £88,750 £78,750 £81,250
90th Percentile £101,000 £93,750 £95,000
Central London median annual salary £72,500 £65,000 £62,500
% change year-on-year +11.54% +4.00% +8.70%

Apache Spark
Job Vacancy Trend in the City of London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Apache Spark in the City of London

Apache Spark
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Apache Spark in the City of London.

Salary trend for Apache Spark in the City of London

Apache Spark
Salary Histogram in the City of London

Salary distribution for jobs citing Apache Spark in the City of London over the 6 months to 20 April 2021.

Salary histogram for Apache Spark in the City of London

Apache Spark
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the City of London region over the 6 months to 20 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 3 £80,000 -
Apache Spark
Central London

For the 6 months to 20 April 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Apache Spark.

1 94 (65.28%) Big Data
2 91 (63.19%) Hadoop
3 83 (57.64%) Java
4 78 (54.17%) Python
5 66 (45.83%) AWS
6 64 (44.44%) SQL
7 53 (36.81%) Analytics
8 44 (30.56%) Azure
9 42 (29.17%) Scala
10 41 (28.47%) Open Source
10 41 (28.47%) Data Engineering
10 41 (28.47%) Kafka
11 39 (27.08%) DevOps
12 38 (26.39%) NoSQL
12 38 (26.39%) Finance
13 37 (25.69%) Data Science
14 35 (24.31%) Agile Software Development
15 34 (23.61%) Artificial Intelligence
16 33 (22.92%) Docker
16 33 (22.92%) Kubernetes
17 32 (22.22%) Software Engineering
18 30 (20.83%) Microservices
18 30 (20.83%) GCP
19 28 (19.44%) Amazon Redshift
19 28 (19.44%) Apache Hive
20 25 (17.36%) Computer Science
21 24 (16.67%) Banking
21 24 (16.67%) Fintech
22 23 (15.97%) Git (software)
23 22 (15.28%) RESTful

Apache Spark
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 17 (11.81%) Apache
2 14 (9.72%) Apache Airflow
3 4 (2.78%) Elasticsearch
4 1 (0.69%) SAS
Business Applications
1 1 (0.69%) SAP APO
Cloud Services
1 66 (45.83%) AWS
2 44 (30.56%) Azure
3 30 (20.83%) GCP
4 10 (6.94%) Amazon EC2
4 10 (6.94%) Power Platform
5 7 (4.86%) Azure Data Factory
5 7 (4.86%) Cloud Computing
5 7 (4.86%) PowerApps
6 6 (4.17%) Amazon S3
7 5 (3.47%) Matillion
8 4 (2.78%) PaaS
9 3 (2.08%) Amazon EMR
9 3 (2.08%) Azure Cosmos DB
10 2 (1.39%) Amazon Kinesis
10 2 (1.39%) Azure Machine Learning
10 2 (1.39%) SaaS
11 1 (0.69%) AWS Data Pipeline
11 1 (0.69%) Slack
Communications & Networking
1 1 (0.69%) 5G
1 1 (0.69%) Broadband
Database & Business Intelligence
1 94 (65.28%) Big Data
2 91 (63.19%) Hadoop
3 38 (26.39%) NoSQL
4 28 (19.44%) Amazon Redshift
4 28 (19.44%) Apache Hive
5 22 (15.28%) BigQuery
6 21 (14.58%) Data Lake
7 14 (9.72%) Presto
8 13 (9.03%) Data Warehouse
9 10 (6.94%) Power BI
10 7 (4.86%) Amazon RDS
10 7 (4.86%) PowerPivot
10 7 (4.86%) Relational Database
10 7 (4.86%) SQL Server
10 7 (4.86%) SQL Server Reporting Services
11 5 (3.47%) MongoDB
11 5 (3.47%) PostgreSQL
12 3 (2.08%) MySQL
13 2 (1.39%) Apache Cassandra
13 2 (1.39%) Data Mining
Development Applications
1 23 (15.97%) Git (software)
2 7 (4.86%) Visual Studio
3 4 (2.78%) TeamCity
4 3 (2.08%) JIRA
4 3 (2.08%) MLflow
5 2 (1.39%) Gradle
5 2 (1.39%) Jenkins
5 2 (1.39%) Maven
5 2 (1.39%) SonarQube
General
1 38 (26.39%) Finance
2 24 (16.67%) Banking
3 15 (10.42%) Marketing
4 4 (2.78%) Front Office
5 3 (2.08%) Advertising
Job Titles
1 49 (34.03%) Data Engineer
2 36 (25.00%) Developer
3 35 (24.31%) Big Data Engineer
4 27 (18.75%) Java Developer
5 23 (15.97%) Java Engineer
6 21 (14.58%) Software Engineer
7 20 (13.89%) Java Software Engineer
8 19 (13.19%) Big Data Software Engineer
8 19 (13.19%) Data Analytics Engineer
9 15 (10.42%) AWS Engineer
10 12 (8.33%) Senior Data Engineer
11 9 (6.25%) Cloud Engineer
11 9 (6.25%) Hadoop Engineer
12 7 (4.86%) Applications Engineer
12 7 (4.86%) Data Scientist
12 7 (4.86%) Kubernetes Engineer
12 7 (4.86%) Software Manager
13 6 (4.17%) Engineering Manager
13 6 (4.17%) ETL Developer
13 6 (4.17%) Scala Developer
Libraries, Frameworks & Software Standards
1 41 (28.47%) Kafka
2 22 (15.28%) RESTful
3 18 (12.50%) AngularJS
3 18 (12.50%) HTML
4 17 (11.81%) CSS
4 17 (11.81%) HTML5
4 17 (11.81%) React
5 16 (11.11%) Node.js
6 6 (4.17%) PySpark
7 5 (3.47%) Spark Streaming
8 4 (2.78%) Lambda Expressions
8 4 (2.78%) Middleware
8 4 (2.78%) scikit-learn
8 4 (2.78%) Spring
8 4 (2.78%) TensorFlow
9 3 (2.08%) Akka
9 3 (2.08%) GraphQL
9 3 (2.08%) Spring Boot
10 2 (1.39%) Spring Security
10 2 (1.39%) Vue.js
Miscellaneous
1 19 (13.19%) Analytical Skills
2 10 (6.94%) Public Cloud
3 7 (4.86%) Greenfield Project
4 6 (4.17%) Algorithms
4 6 (4.17%) Data Structures
5 3 (2.08%) Cloud Native
5 3 (2.08%) Media Streaming
5 3 (2.08%) Video\Live Streaming
6 2 (1.39%) Data Centre
6 2 (1.39%) Derivative
6 2 (1.39%) Equities
6 2 (1.39%) Fixed Income
7 1 (0.69%) Equity Derivative
7 1 (0.69%) Mainframe
7 1 (0.69%) Management Information System
7 1 (0.69%) Reference Data
7 1 (0.69%) Reinsurance
7 1 (0.69%) Self-Motivation
7 1 (0.69%) Social Media
Operating Systems
1 4 (2.78%) Unix
Processes & Methodologies
1 53 (36.81%) Analytics
2 41 (28.47%) Data Engineering
2 41 (28.47%) Open Source
3 39 (27.08%) DevOps
4 37 (25.69%) Data Science
5 35 (24.31%) Agile Software Development
6 34 (23.61%) Artificial Intelligence
7 32 (22.22%) Software Engineering
8 30 (20.83%) Microservices
9 25 (17.36%) Computer Science
10 24 (16.67%) Fintech
11 20 (13.89%) Data Analytics
11 20 (13.89%) ETL
11 20 (13.89%) OO
12 18 (12.50%) Data Modelling
12 18 (12.50%) Machine Learning
12 18 (12.50%) Project Delivery
13 17 (11.81%) Business Intelligence
14 15 (10.42%) Site Reliability Engineering
15 10 (6.94%) Data Ingestion
Programming Languages
1 83 (57.64%) Java
2 78 (54.17%) Python
3 64 (44.44%) SQL
4 42 (29.17%) Scala
5 18 (12.50%) C#
5 18 (12.50%) JavaScript
5 18 (12.50%) Kotlin
6 17 (11.81%) ES6
6 17 (11.81%) PHP
6 17 (11.81%) TypeScript
7 14 (9.72%) R
8 7 (4.86%) Data Analysis Expressions (DAX)
8 7 (4.86%) T-SQL
9 4 (2.78%) Go
10 2 (1.39%) Java 8
11 1 (0.69%) Julia
Qualifications
1 21 (14.58%) Degree
2 19 (13.19%) Computer Science Degree
3 1 (0.69%) PhD
Quality Assurance & Compliance
1 11 (7.64%) QA
2 5 (3.47%) Data Quality
3 1 (0.69%) GDPR
System Software
1 33 (22.92%) Docker
2 1 (0.69%) Apache Flume
2 1 (0.69%) Apache ZooKeeper
2 1 (0.69%) HDFS
Systems Management
1 33 (22.92%) Kubernetes
2 7 (4.86%) Terraform
3 3 (2.08%) Kubeflow
Vendors
1 12 (8.33%) Databricks
2 9 (6.25%) Talend
3 8 (5.56%) Microsoft
4 4 (2.78%) Alteryx
5 3 (2.08%) Google
5 3 (2.08%) Oracle
6 1 (0.69%) Cloudera
6 1 (0.69%) IBM
6 1 (0.69%) MicroStrategy
6 1 (0.69%) SAP
6 1 (0.69%) Teradata