Period
to 4 December 2021

The following table provides summary statistics for permanent job vacancies advertised in Central London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 4 December 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
London > Central London
6 months to
4 Dec 2021
Same period 2020 Same period 2019
Rank 142 102 146
Rank change year-on-year -40 +44 +33
Permanent jobs citing Apache Spark 150 128 279
As % of all permanent jobs advertised in Central London 2.13% 2.70% 2.21%
As % of the Application Platforms category 16.95% 17.93% 14.53%
Number of salaries quoted 135 105 268
10th Percentile £56,250 £52,500 £55,000
25th Percentile £65,000 £61,250 £62,500
Median annual salary (50th Percentile) £77,500 £80,000 £75,000
Median % change year-on-year -3.13% +6.67% -6.25%
75th Percentile £95,625 £97,500 £95,000
90th Percentile £107,500 £105,000 £112,500
London median annual salary £80,000 £78,750 £80,000
% change year-on-year +1.59% -1.56% +3.23%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Central London with a requirement for application platform skills.

All Application Platform Skills
Central London
Permanent vacancies with a requirement for application platform skills 885 714 1,920
As % of all permanent IT jobs advertised in Central London 12.59% 15.05% 15.24%
Number of salaries quoted 786 621 1,718
10th Percentile £37,505 £45,000 £33,000
25th Percentile £49,438 £52,500 £46,563
Median annual salary (50th Percentile) £67,500 £67,500 £64,375
Median % change year-on-year - +4.85% +7.29%
75th Percentile £84,688 £82,500 £80,000
90th Percentile £101,250 £98,750 £93,750
London median annual salary £65,000 £65,000 £62,500
% change year-on-year - +4.00% +4.17%

Apache Spark
Job Vacancy Trend in Central London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in Central London.

Job vacancy trend for Apache Spark in Central London

Apache Spark
Salary Trend in Central London

3-month moving average salary quoted in jobs citing Apache Spark in Central London.

Salary trend for Apache Spark in Central London

Apache Spark
Salary Histogram in Central London

Salary distribution for jobs citing Apache Spark in Central London over the 6 months to 4 December 2021.

Salary histogram for Apache Spark in Central London

Apache Spark
Job Locations in Central London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the Central London region over the 6 months to 4 December 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London -40 139 £80,000 - 34
Camden - 4 £68,500 -
Lambeth - 1 - -
Kensington and Chelsea - 1 - -
Southwark - 1 - -
Apache Spark
London

For the 6 months to 4 December 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Central London region with a requirement for Apache Spark.

1 93 (62.00%) Java
2 86 (57.33%) Python
2 86 (57.33%) AWS
2 86 (57.33%) Big Data
3 84 (56.00%) Analytics
4 79 (52.67%) Scala
5 71 (47.33%) Data Science
6 64 (42.67%) Kafka
7 63 (42.00%) Hadoop
8 54 (36.00%) Agile Software Development
9 53 (35.33%) SQL
10 49 (32.67%) Azure
11 40 (26.67%) Data Engineering
12 38 (25.33%) Software Engineering
13 37 (24.67%) Machine Learning
13 37 (24.67%) Data Pipeline
14 35 (23.33%) GCP
15 34 (22.67%) NoSQL
16 32 (21.33%) DevOps
16 32 (21.33%) Apache
17 30 (20.00%) Elasticsearch
18 29 (19.33%) Finance
19 28 (18.67%) Data Warehouse
20 26 (17.33%) Data Modelling
21 25 (16.67%) Data Lake
22 24 (16.00%) Microservices
22 24 (16.00%) ETL
22 24 (16.00%) Artificial Intelligence
23 23 (15.33%) Amazon Redshift
23 23 (15.33%) MongoDB

Apache Spark
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 32 (21.33%) Apache
2 30 (20.00%) Elasticsearch
3 14 (9.33%) Apache Airflow
4 4 (2.67%) Tornado
5 1 (0.67%) Apache Pig
Applications
1 1 (0.67%) Microsoft Office
Business Applications
1 1 (0.67%) Oracle Procure-to-Pay
1 1 (0.67%) SAP R/3
Cloud Services
1 86 (57.33%) AWS
2 49 (32.67%) Azure
3 35 (23.33%) GCP
4 19 (12.67%) Snowflake
5 14 (9.33%) Amazon S3
6 12 (8.00%) Amazon EMR
7 8 (5.33%) Power Platform
7 8 (5.33%) Serverless
8 7 (4.67%) Amazon EC2
8 7 (4.67%) Azure Cosmos DB
8 7 (4.67%) Azure Data Factory
9 6 (4.00%) AWS Lambda
10 5 (3.33%) Amazon SQS
10 5 (3.33%) Matillion
11 4 (2.67%) Azure Machine Learning
12 3 (2.00%) Amazon Kinesis
12 3 (2.00%) Azure Synapse Analytics
13 2 (1.33%) Amazon EKS
13 2 (1.33%) AWS Step Functions
13 2 (1.33%) Azure Service Bus
Communications & Networking
1 2 (1.33%) Cisco IPT
1 2 (1.33%) Kerberos
2 1 (0.67%) Internet
Database & Business Intelligence
1 86 (57.33%) Big Data
2 63 (42.00%) Hadoop
3 34 (22.67%) NoSQL
4 28 (18.67%) Data Warehouse
5 25 (16.67%) Data Lake
6 23 (15.33%) Amazon Redshift
6 23 (15.33%) MongoDB
7 19 (12.67%) Apache Cassandra
8 11 (7.33%) Tableau
9 10 (6.67%) BigQuery
10 9 (6.00%) Amazon RDS
11 8 (5.33%) Flink
11 8 (5.33%) Power BI
12 7 (4.67%) Apache Hive
12 7 (4.67%) Electronic Patient Records
12 7 (4.67%) MySQL
12 7 (4.67%) PostgreSQL
12 7 (4.67%) Relational Database
13 5 (3.33%) Amazon Athena
14 4 (2.67%) Presto
Development Applications
1 15 (10.00%) Git (software)
2 6 (4.00%) Gradle
3 4 (2.67%) JIRA
3 4 (2.67%) Maven
4 3 (2.00%) Jenkins
4 3 (2.00%) Subversion
5 2 (1.33%) Artifactory
5 2 (1.33%) Bitbucket
5 2 (1.33%) kappa
5 2 (1.33%) RStudio
5 2 (1.33%) Sonatype Nexus
6 1 (0.67%) Atlassian Bamboo
6 1 (0.67%) Vagrant
General
1 29 (19.33%) Finance
2 19 (12.67%) Publishing
3 11 (7.33%) Retail
4 10 (6.67%) Social Skills
5 9 (6.00%) Analytical Skills
6 7 (4.67%) Advertising
7 5 (3.33%) Banking
8 4 (2.67%) Games
8 4 (2.67%) Marketing
8 4 (2.67%) Presentation Skills
8 4 (2.67%) Telecoms
9 3 (2.00%) Law
9 3 (2.00%) Pharmaceutical
9 3 (2.00%) Retail Banking
10 2 (1.33%) Legal
11 1 (0.67%) Documentation Skills
11 1 (0.67%) Financial Institution
11 1 (0.67%) Inclusion and Diversity
11 1 (0.67%) Manufacturing
Job Titles
1 75 (50.00%) Data Engineer
2 28 (18.67%) Developer
3 22 (14.67%) Senior Data Engineer
4 20 (13.33%) Big Data Engineer
5 15 (10.00%) Java Engineer
6 13 (8.67%) Principal Engineer
6 13 (8.67%) Scala Developer
7 11 (7.33%) Data Scientist
8 10 (6.67%) Apache Spark Developer
8 10 (6.67%) Hadoop Developer
8 10 (6.67%) Software Engineer
9 9 (6.00%) Architect
9 9 (6.00%) AWS Engineer
9 9 (6.00%) Data Architect
9 9 (6.00%) Java Developer
9 9 (6.00%) Scala Engineer
10 8 (5.33%) Senior Developer
11 7 (4.67%) Hadoop Engineer
11 7 (4.67%) Java Software Engineer
11 7 (4.67%) Lead Architect
Libraries, Frameworks & Software Standards
1 64 (42.67%) Kafka
2 12 (8.00%) TensorFlow
3 10 (6.67%) Akka
3 10 (6.67%) RabbitMQ
4 8 (5.33%) Node.js
4 8 (5.33%) Spring
5 7 (4.67%) AngularJS
5 7 (4.67%) PySpark
6 5 (3.33%) React
7 4 (2.67%) Keras
7 4 (2.67%) Pandas
7 4 (2.67%) Redux
7 4 (2.67%) Spring Boot
7 4 (2.67%) Web Services
8 3 (2.00%) .NET
8 3 (2.00%) Apache Beam
8 3 (2.00%) RESTful
9 2 (1.33%) Django
9 2 (1.33%) JSON
9 2 (1.33%) PyTorch
Miscellaneous
1 23 (15.33%) Algorithms
2 14 (9.33%) Greenfield Project
3 10 (6.67%) Data Structures
4 4 (2.67%) Cloud Native
5 3 (2.00%) Equities
5 3 (2.00%) Self-Motivation
6 2 (1.33%) Derivative
6 2 (1.33%) Enterprise Cloud
7 1 (0.67%) Acoustics
7 1 (0.67%) Blog
7 1 (0.67%) CUDA
7 1 (0.67%) Enterprise Software
7 1 (0.67%) Fixed Income
7 1 (0.67%) Grid Computing
7 1 (0.67%) Hedge funds
7 1 (0.67%) Life Science
7 1 (0.67%) Market Risk
7 1 (0.67%) Media Streaming
7 1 (0.67%) Replication
7 1 (0.67%) Virtual Team
Operating Systems
1 9 (6.00%) Linux
2 4 (2.67%) Unix
3 1 (0.67%) DC/OS
Processes & Methodologies
1 84 (56.00%) Analytics
2 71 (47.33%) Data Science
3 54 (36.00%) Agile Software Development
4 40 (26.67%) Data Engineering
5 38 (25.33%) Software Engineering
6 37 (24.67%) Data Pipeline
6 37 (24.67%) Machine Learning
7 32 (21.33%) DevOps
8 26 (17.33%) Data Modelling
9 24 (16.00%) Artificial Intelligence
9 24 (16.00%) ETL
9 24 (16.00%) Microservices
10 21 (14.00%) TDD
11 20 (13.33%) Computer Science
12 17 (11.33%) Scrum
13 15 (10.00%) Data Analytics
13 15 (10.00%) Decision-Making
14 14 (9.33%) Mentoring
14 14 (9.33%) OO
15 13 (8.67%) Informatics
Programming Languages
1 93 (62.00%) Java
2 86 (57.33%) Python
3 79 (52.67%) Scala
4 53 (35.33%) SQL
5 11 (7.33%) Bash Shell
5 11 (7.33%) C#
6 10 (6.67%) R
7 7 (4.67%) Clojure
8 5 (3.33%) ES6
8 5 (3.33%) JavaScript
9 4 (2.67%) Go
9 4 (2.67%) Kotlin
10 3 (2.00%) Java 8
11 2 (1.33%) C
11 2 (1.33%) C++
11 2 (1.33%) PowerShell
12 1 (0.67%) Haskell
12 1 (0.67%) PHP
12 1 (0.67%) PL/SQL
12 1 (0.67%) T-SQL
Qualifications
1 13 (8.67%) Degree
2 4 (2.67%) Computer Science Degree
3 3 (2.00%) PhD
4 2 (1.33%) (ISC)2 CCSP
4 2 (1.33%) AWS Certification
4 2 (1.33%) CCSP
4 2 (1.33%) Cisco Certification
4 2 (1.33%) CISSP
4 2 (1.33%) Master's Degree
Quality Assurance & Compliance
1 10 (6.67%) Data Quality
2 5 (3.33%) QA
3 3 (2.00%) GDPR
System Software
1 17 (11.33%) Docker
2 2 (1.33%) HDFS
2 2 (1.33%) Samba
3 1 (0.67%) VirtualBox
Systems Management
1 14 (9.33%) Kubernetes
2 10 (6.67%) Terraform
3 3 (2.00%) Ansible
3 3 (2.00%) Prometheus
4 2 (1.33%) Ambari
4 2 (1.33%) Hadoop YARN
4 2 (1.33%) Opscode Chef
4 2 (1.33%) vRealize Orchestrator
5 1 (0.67%) Apache Brooklyn
5 1 (0.67%) Docker Swarm
5 1 (0.67%) Marathon
5 1 (0.67%) Mesos
Vendors
1 13 (8.67%) Cloudera
2 12 (8.00%) Databricks
3 10 (6.67%) Talend
4 8 (5.33%) Oracle
5 5 (3.33%) Google
6 4 (2.67%) Hortonworks
7 3 (2.00%) Microsoft
8 2 (1.33%) Alteryx
8 2 (1.33%) Informatica
8 2 (1.33%) ServiceNow
8 2 (1.33%) VMware
9 1 (0.67%) Greenplum
9 1 (0.67%) IBM
9 1 (0.67%) MapR
9 1 (0.67%) PeopleSoft
9 1 (0.67%) Salesforce.com
9 1 (0.67%) SAP
9 1 (0.67%) UiPath