Period
to

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 12 August 2022 with a comparison to the same period in the previous 2 years.

Apache Spark
Central London > City of London
6 months to
12 Aug 2022
Same period 2021 Same period 2020
Rank 221 107 127
Rank change year-on-year -114 +20 +21
Permanent jobs citing Apache Spark 79 153 107
As % of all permanent jobs advertised in the City of London 1.00% 2.75% 2.17%
As % of the Application Platforms category 8.07% 21.28% 17.98%
Number of salaries quoted 68 143 87
10th Percentile £54,325 £56,250 £46,050
25th Percentile £64,000 £62,500 £61,875
Median annual salary (50th Percentile) £82,500 £80,000 £75,000
Median % change year-on-year +3.13% +6.67% -6.25%
75th Percentile £95,000 £87,500 £92,500
90th Percentile £110,000 £95,000 £109,000
Central London median annual salary £82,500 £77,500 £74,500
% change year-on-year +6.45% +4.03% -6.88%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for application platform skills.

All Application Platform Skills
City of London
Permanent vacancies with a requirement for application platform skills 979 719 595
As % of all permanent IT jobs advertised in the City of London 12.42% 12.90% 12.09%
Number of salaries quoted 725 642 522
10th Percentile £41,250 £45,000 £42,011
25th Percentile £56,250 £52,500 £50,000
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £95,000 £85,000 £78,750
90th Percentile £105,000 £99,750 £92,375
Central London median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% +4.00%

Apache Spark
Job Vacancy Trend in the City of London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Apache Spark in the City of London

Apache Spark
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Apache Spark in the City of London.

Salary trend for Apache Spark in the City of London

Apache Spark
Salary Histogram in the City of London

Salary distribution for jobs citing Apache Spark in the City of London over the 6 months to 12 August 2022.

Salary histogram for Apache Spark in the City of London

For the 6 months to 12 August 2022, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Apache Spark.

1 51 (64.56%) Python
2 46 (58.23%) Big Data
3 39 (49.37%) SQL
4 37 (46.84%) AWS
5 32 (40.51%) Hadoop
5 32 (40.51%) Kafka
6 31 (39.24%) Analytics
7 30 (37.97%) Java
8 28 (35.44%) Azure
9 27 (34.18%) Scala
10 25 (31.65%) Data Modelling
10 25 (31.65%) Finance
10 25 (31.65%) Agile
11 24 (30.38%) Data Lake
12 22 (27.85%) Data Warehouse
13 21 (26.58%) ETL
14 20 (25.32%) Data Pipeline
15 19 (24.05%) Business Intelligence
16 18 (22.78%) Snowflake
17 17 (21.52%) CI/CD
17 17 (21.52%) DevOps
18 16 (20.25%) Apache Hive
19 15 (18.99%) TDD
19 15 (18.99%) Databricks
19 15 (18.99%) Data Science
20 14 (17.72%) Azure Data Factory
20 14 (17.72%) Data Engineering
20 14 (17.72%) Data Integration
20 14 (17.72%) OO
20 14 (17.72%) Unix

Apache Spark
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 11 (13.92%) Apache
2 6 (7.59%) Apache Airflow
3 4 (5.06%) Apache Pig
4 3 (3.80%) Confluence
4 3 (3.80%) Tomcat
5 2 (2.53%) SAS
Business Applications
1 1 (1.27%) ION MarketView
Cloud Services
1 37 (46.84%) AWS
2 28 (35.44%) Azure
3 18 (22.78%) Snowflake
4 14 (17.72%) Azure Data Factory
5 10 (12.66%) GCP
6 9 (11.39%) Power Platform
7 7 (8.86%) Azure Synapse Analytics
7 7 (8.86%) Cloud Computing
7 7 (8.86%) Serverless
8 6 (7.59%) Azure Cosmos DB
9 5 (6.33%) Amazon S3
10 4 (5.06%) AWS Lambda
10 4 (5.06%) AWS Step Functions
10 4 (5.06%) Azure DevOps
10 4 (5.06%) Cloud Composer
11 3 (3.80%) Amazon EMR
11 3 (3.80%) Datadog
12 2 (2.53%) Amazon CloudWatch
12 2 (2.53%) Google App Engine
12 2 (2.53%) Google Compute Engine
Communications & Networking
1 1 (1.27%) DNS
Database & Business Intelligence
1 46 (58.23%) Big Data
2 32 (40.51%) Hadoop
3 24 (30.38%) Data Lake
4 22 (27.85%) Data Warehouse
5 16 (20.25%) Apache Hive
6 13 (16.46%) Relational Database
7 12 (15.19%) NoSQL
7 12 (15.19%) SQL Server
8 11 (13.92%) MongoDB
9 10 (12.66%) Amazon Redshift
9 10 (12.66%) Elasticsearch
10 9 (11.39%) Power BI
11 7 (8.86%) Apache Cassandra
11 7 (8.86%) Enterprise Data Warehouse
11 7 (8.86%) Spark SQL
11 7 (8.86%) Tableau
12 6 (7.59%) KDB
12 6 (7.59%) Metadata
13 5 (6.33%) Presto
13 5 (6.33%) SQL Server Integration Services
Development Applications
1 8 (10.13%) JIRA
2 5 (6.33%) Jenkins
3 4 (5.06%) ER Studio
3 4 (5.06%) ERwin
3 4 (5.06%) PowerDesigner
4 3 (3.80%) Git (software)
5 2 (2.53%) Atlassian Bamboo
5 2 (2.53%) JUnit
5 2 (2.53%) Spock
5 2 (2.53%) Vagrant
6 1 (1.27%) Bitbucket
6 1 (1.27%) CircleCI
6 1 (1.27%) Gradle
General
1 25 (31.65%) Finance
2 12 (15.19%) Advertising
3 11 (13.92%) Social Skills
4 6 (7.59%) Analytical Skills
4 6 (7.59%) Retail
5 3 (3.80%) French Language
5 3 (3.80%) German Language
5 3 (3.80%) Portuguese Language
5 3 (3.80%) Russian Language
5 3 (3.80%) Spanish Language
6 2 (2.53%) Electronics
6 2 (2.53%) Law
6 2 (2.53%) Manufacturing
6 2 (2.53%) Marketing
6 2 (2.53%) Music Industry
6 2 (2.53%) Public Sector
6 2 (2.53%) Telecoms
7 1 (1.27%) Banking
7 1 (1.27%) Investment Banking
7 1 (1.27%) Pharmaceutical
Job Titles
1 32 (40.51%) Data Engineer
2 14 (17.72%) Developer
3 10 (12.66%) Analyst
4 8 (10.13%) Senior Developer
5 7 (8.86%) Java Developer
5 7 (8.86%) Senior Java Developer
5 7 (8.86%) Senior Support Engineer
5 7 (8.86%) Support Engineer
6 6 (7.59%) Architect
6 6 (7.59%) Business Information Analyst
6 6 (7.59%) Data Architect
6 6 (7.59%) Information Analyst
6 6 (7.59%) Information Security Analyst
6 6 (7.59%) Scala Engineer
6 6 (7.59%) Security Analyst
7 5 (6.33%) Scala Developer
7 5 (6.33%) Software Engineer
8 4 (5.06%) AWS Data Engineer
8 4 (5.06%) AWS Engineer
8 4 (5.06%) Cloud Engineer
Libraries, Frameworks & Software Standards
1 32 (40.51%) Kafka
2 11 (13.92%) PySpark
3 9 (11.39%) Spark Streaming
3 9 (11.39%) Spring
4 4 (5.06%) Apache Beam
4 4 (5.06%) Apache NiFi
4 4 (5.06%) XML
5 3 (3.80%) Akka
5 3 (3.80%) Apache Camel
5 3 (3.80%) GraphQL
6 2 (2.53%) ActiveMQ
6 2 (2.53%) Django
6 2 (2.53%) MLlib
6 2 (2.53%) MXNet
6 2 (2.53%) Node.js
6 2 (2.53%) Pandas
6 2 (2.53%) pytest
6 2 (2.53%) REST
6 2 (2.53%) RESTful
6 2 (2.53%) TensorFlow
Miscellaneous
1 11 (13.92%) Algorithms
2 10 (12.66%) Data Structures
3 8 (10.13%) Greenfield Project
4 7 (8.86%) Virtual Team
5 6 (7.59%) Grid Computing
5 6 (7.59%) IoT
5 6 (7.59%) Management Information System
5 6 (7.59%) PKI
6 5 (6.33%) Derivative
7 4 (5.06%) User Experience
8 3 (3.80%) Blockchain
8 3 (3.80%) SWIFT
9 2 (2.53%) Analytical Mindset
9 2 (2.53%) Blog
9 2 (2.53%) Hybrid Cloud
9 2 (2.53%) Public Cloud
10 1 (1.27%) Cloud Native
10 1 (1.27%) Equities
Operating Systems
1 14 (17.72%) Linux
1 14 (17.72%) Unix
Processes & Methodologies
1 31 (39.24%) Analytics
2 25 (31.65%) Agile
2 25 (31.65%) Data Modelling
3 21 (26.58%) ETL
4 20 (25.32%) Data Pipeline
5 19 (24.05%) Business Intelligence
6 17 (21.52%) CI/CD
6 17 (21.52%) DevOps
7 15 (18.99%) Data Science
7 15 (18.99%) TDD
8 14 (17.72%) Data Engineering
8 14 (17.72%) Data Integration
8 14 (17.72%) OO
9 13 (16.46%) Vulnerability Management
10 12 (15.19%) Continuous Integration
10 12 (15.19%) Data Analytics
11 11 (13.92%) Data Ingestion
11 11 (13.92%) Mentoring
12 10 (12.66%) Data Architecture
12 10 (12.66%) Test Automation
Programming Languages
1 51 (64.56%) Python
2 39 (49.37%) SQL
3 30 (37.97%) Java
4 27 (34.18%) Scala
5 9 (11.39%) JavaScript
6 7 (8.86%) Perl
6 7 (8.86%) Shell Script
7 3 (3.80%) C++
8 2 (2.53%) R
8 2 (2.53%) TypeScript
9 1 (1.27%) C#
9 1 (1.27%) MATLAB
9 1 (1.27%) T-SQL
Qualifications
1 6 (7.59%) CISSP
1 6 (7.59%) CRISC
2 5 (6.33%) Degree
2 5 (6.33%) Master's Degree
3 3 (3.80%) ITIL Certification
4 2 (2.53%) PhD
5 1 (1.27%) Computer Science Degree
Quality Assurance & Compliance
1 10 (12.66%) Data Quality
2 7 (8.86%) SLA
3 3 (3.80%) ISO 15022
3 3 (3.80%) ISO 20022
3 3 (3.80%) QA
System Software
1 10 (12.66%) Docker
2 4 (5.06%) Apache Flume
3 2 (2.53%) VirtualBox
Systems Management
1 11 (13.92%) Kubernetes
2 7 (8.86%) Terraform
3 3 (3.80%) Ansible
4 2 (2.53%) Docker Swarm
5 1 (1.27%) Grafana
5 1 (1.27%) Prometheus
5 1 (1.27%) Puppet
Vendors
1 15 (18.99%) Databricks
2 11 (13.92%) Informatica
3 10 (12.66%) Talend
4 7 (8.86%) Microsoft
5 6 (7.59%) Oracle
6 4 (5.06%) Cloudera
6 4 (5.06%) Google
7 3 (3.80%) Alteryx
7 3 (3.80%) AppDynamics
7 3 (3.80%) Atlassian
7 3 (3.80%) IBM
7 3 (3.80%) MuleSoft
7 3 (3.80%) Sybase
8 2 (2.53%) Hortonworks
8 2 (2.53%) New Relic
8 2 (2.53%) SAP
9 1 (1.27%) Ab Initio
9 1 (1.27%) ION Trading
9 1 (1.27%) Splunk
9 1 (1.27%) Spotify