Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 4 July 2022 with a comparison to the same period in the previous 2 years.

Apache Spark
England > London
6 months to
4 Jul 2022		 Same period 2021 Same period 2020
Rank 184 146 166
Rank change year-on-year -38 +20 -28
Permanent jobs citing Apache Spark 1,795 1,026 702
As % of all permanent jobs advertised in London 2.32% 2.46% 2.13%
As % of the Application Platforms category 17.03% 18.88% 16.06%
Number of salaries quoted 557 706 522
10th Percentile £51,500 £47,500 £52,625
25th Percentile £66,000 £57,500 £63,750
Median annual salary (50th Percentile) £80,000 £77,500 £80,000
Median % change year-on-year +3.23% -3.13% -
75th Percentile £97,500 £92,500 £95,000
90th Percentile £115,000 £117,500 £118,625
England median annual salary £80,000 £75,000 £75,000
% change year-on-year +6.67% - -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for application platform skills.

All Application Platform Skills
London
Permanent vacancies with a requirement for application platform skills 10,543 5,435 4,370
As % of all permanent IT jobs advertised in London 13.60% 13.01% 13.28%
Number of salaries quoted 4,606 3,777 3,487
10th Percentile £38,350 £41,250 £39,000
25th Percentile £50,000 £49,000 £47,750
Median annual salary (50th Percentile) £66,786 £65,000 £65,000
Median % change year-on-year +2.75% - +8.33%
75th Percentile £87,500 £84,500 £82,500
90th Percentile £103,750 £98,750 £97,500
England median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Apache Spark
Job Vacancy Trend in London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in London.

Job vacancy trend for Apache Spark in London

Apache Spark
Salary Trend in London

3-month moving average salary quoted in jobs citing Apache Spark in London.

Salary trend for Apache Spark in London

Apache Spark
Salary Histogram in London

Salary distribution for jobs citing Apache Spark in London over the 6 months to 4 July 2022.

Salary histogram for Apache Spark in London

Apache Spark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the London region over the 6 months to 4 July 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Jobs
Central London -94 108 £83,750 +4.69% 20
West London - 68 - - 9
South London +3 56 £48,500 -19.17%
East London -26 23 £95,000 +22.58% 5
North London - 9 - -
Apache Spark
England

For the 6 months to 4 July 2022, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Apache Spark.

1 1,367 (76.16%) Python
2 1,122 (62.51%) AWS
3 938 (52.26%) SQL
4 892 (49.69%) Java
5 870 (48.47%) Big Data
6 851 (47.41%) Agile
7 812 (45.24%) Analytics
8 806 (44.90%) Data Science
9 729 (40.61%) Hadoop
10 723 (40.28%) Kafka
11 709 (39.50%) Azure
12 695 (38.72%) GCP
13 674 (37.55%) Data Engineering
14 642 (35.77%) Machine Learning
15 632 (35.21%) Scala
16 615 (34.26%) Finance
17 575 (32.03%) Kubernetes
18 549 (30.58%) NoSQL
19 537 (29.92%) CI/CD
20 525 (29.25%) Docker
21 474 (26.41%) Data Pipeline
22 462 (25.74%) Social Skills
23 451 (25.13%) Software Engineering
24 439 (24.46%) ETL
25 430 (23.96%) DevOps
26 421 (23.45%) Google
27 412 (22.95%) Algorithms
28 378 (21.06%) Data Warehouse
29 372 (20.72%) Apache Airflow
30 367 (20.45%) Computer Science

Apache Spark
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 372 (20.72%) Apache Airflow
2 308 (17.16%) Apache
3 71 (3.96%) Apache Pulsar
4 41 (2.28%) Apache Pig
5 32 (1.78%) Oracle Workflow
6 28 (1.56%) SAS
7 26 (1.45%) Luigi
8 22 (1.23%) Jupyter
9 17 (0.95%) Confluence
10 12 (0.67%) Apache Synapse
11 8 (0.45%) Apache Solr
12 6 (0.33%) Tomcat
13 5 (0.28%) Oracle SOA Suite
14 4 (0.22%) Pachyderm
14 4 (0.22%) SharePoint
15 1 (0.056%) Cloud Foundry
15 1 (0.056%) CMS
Applications
1 1 (0.056%) Chatbot
1 1 (0.056%) SPSS
Business Applications
1 19 (1.06%) Oracle Payables
2 5 (0.28%) SAP Oil and Gas
3 1 (0.056%) ION MarketView
Cloud Services
1 1,122 (62.51%) AWS
2 709 (39.50%) Azure
3 695 (38.72%) GCP
4 287 (15.99%) Serverless
5 239 (13.31%) Snowflake
6 232 (12.92%) AWS Lambda
7 204 (11.36%) Amazon S3
8 172 (9.58%) Power Platform
9 142 (7.91%) Amazon Kinesis
10 141 (7.86%) Amazon EMR
11 135 (7.52%) OpenShift
12 129 (7.19%) Cloud Functions
13 115 (6.41%) Cloud Computing
14 96 (5.35%) Azure Synapse Analytics
15 93 (5.18%) GitHub
16 90 (5.01%) AWS CloudFormation
17 82 (4.57%) Azure Data Factory
18 81 (4.51%) dbt
19 79 (4.40%) Amazon ECS
20 65 (3.62%) Amazon EC2
Communications & Networking
1 160 (8.91%) Internet
2 35 (1.95%) HTTP
3 12 (0.67%) VPN
4 11 (0.61%) Wireless
5 5 (0.28%) DNS
6 4 (0.22%) Firewall
7 3 (0.17%) Broadband
8 2 (0.11%) Kerberos
9 1 (0.056%) Reverse Proxy
Database & Business Intelligence
1 870 (48.47%) Big Data
2 729 (40.61%) Hadoop
3 549 (30.58%) NoSQL
4 378 (21.06%) Data Warehouse
5 358 (19.94%) Flink
6 319 (17.77%) Data Lake
7 318 (17.72%) Apache Cassandra
8 285 (15.88%) MongoDB
9 256 (14.26%) Apache Hive
10 243 (13.54%) Amazon Redshift
11 236 (13.15%) BigQuery
12 220 (12.26%) SQL Server
13 219 (12.20%) PostgreSQL
14 212 (11.81%) Elasticsearch
15 205 (11.42%) MySQL
16 191 (10.64%) Tableau
17 172 (9.58%) Power BI
18 161 (8.97%) HBase
19 155 (8.64%) Relational Database
20 140 (7.80%) Amazon Athena
Development Applications
1 302 (16.82%) Git (software)
2 183 (10.19%) Gradle
3 172 (9.58%) JIRA
4 155 (8.64%) Maven
5 136 (7.58%) Jenkins
6 126 (7.02%) Ant
6 126 (7.02%) Subversion
7 54 (3.01%) CircleCI
8 42 (2.34%) JUnit
8 42 (2.34%) webpack
9 32 (1.78%) MLflow
10 29 (1.62%) Atlassian Bamboo
11 25 (1.39%) SonarQube
12 20 (1.11%) Cucumber
13 19 (1.06%) GitLab
14 18 (1.00%) Spock
15 17 (0.95%) ERwin
16 15 (0.84%) IBM UrbanCode
17 14 (0.78%) Bitbucket
18 11 (0.61%) RStudio
General
1 615 (34.26%) Finance
2 462 (25.74%) Social Skills
3 347 (19.33%) Analytical Skills
4 195 (10.86%) Inclusion and Diversity
5 186 (10.36%) Games
6 163 (9.08%) Banking
7 148 (8.25%) Marketing
8 141 (7.86%) Manufacturing
9 93 (5.18%) Retail
10 66 (3.68%) Advertising
11 49 (2.73%) Telecoms
12 48 (2.67%) Public Sector
13 46 (2.56%) Front Office
13 46 (2.56%) Presentation Skills
14 39 (2.17%) Aerospace
15 27 (1.50%) Law
16 25 (1.39%) Pharmaceutical
17 18 (1.00%) Influencing Skills
17 18 (1.00%) Investment Banking
17 18 (1.00%) Italian Language
Job Titles
1 776 (43.23%) Data Engineer
2 264 (14.71%) Senior Data Engineer
3 184 (10.25%) Software Engineer
4 169 (9.42%) Java Engineer
5 144 (8.02%) Architect
6 139 (7.74%) Senior Java Engineer
7 101 (5.63%) Big Data Engineer
8 99 (5.52%) Data Scientist
9 97 (5.40%) Developer
10 89 (4.96%) Data Architect
11 74 (4.12%) Senior Data Scientist
12 66 (3.68%) AWS Engineer
13 63 (3.51%) Python Engineer
13 63 (3.51%) Scala Engineer
14 62 (3.45%) Analyst
15 56 (3.12%) AWS Data Engineer
16 48 (2.67%) Senior Software Engineer
17 47 (2.62%) Engineering Manager
18 46 (2.56%) Consultant
18 46 (2.56%) Senior Analyst
Libraries, Frameworks & Software Standards
1 723 (40.28%) Kafka
2 193 (10.75%) PySpark
3 167 (9.30%) .NET
4 165 (9.19%) TensorFlow
5 162 (9.03%) RESTful
6 160 (8.91%) Apache Beam
7 149 (8.30%) CSS
8 144 (8.02%) HTML
9 130 (7.24%) JDBC
9 130 (7.24%) Pandas
10 129 (7.19%) ASP.NET
11 119 (6.63%) REST
12 118 (6.57%) scikit-learn
13 113 (6.30%) Spark Streaming
14 100 (5.57%) React
15 88 (4.90%) Keras
16 85 (4.74%) Apache NiFi
17 83 (4.62%) Web Services
18 80 (4.46%) Akka
19 68 (3.79%) D3.js
Miscellaneous
1 412 (22.95%) Algorithms
2 290 (16.16%) Data Structures
3 148 (8.25%) Linux Command Line
4 133 (7.41%) Life Science
5 112 (6.24%) Cloud Native
5 112 (6.24%) Hackathon
6 86 (4.79%) Blog
7 78 (4.35%) Public Cloud
8 60 (3.34%) Greenfield Project
9 50 (2.79%) Digital Media
10 47 (2.62%) IoT
11 45 (2.51%) User Experience
12 38 (2.12%) Blockchain
12 38 (2.12%) Virtual Team
13 36 (2.01%) Hybrid Cloud
13 36 (2.01%) Management Information System
14 30 (1.67%) Educational Technology
15 26 (1.45%) Sports Betting
16 24 (1.34%) Mobile App
17 23 (1.28%) Legacy Systems
Operating Systems
1 188 (10.47%) Unix
2 185 (10.31%) Linux
3 39 (2.17%) Windows
4 13 (0.72%) VMS
5 8 (0.45%) Red Hat Enterprise Linux
6 4 (0.22%) Alpine Linux
6 4 (0.22%) Amazon Linux
6 4 (0.22%) Ubuntu
7 3 (0.17%) Kali Linux
8 2 (0.11%) Android
8 2 (0.11%) Mac OS X
9 1 (0.056%) Apple iOS
9 1 (0.056%) MVS
Processes & Methodologies
1 851 (47.41%) Agile
2 812 (45.24%) Analytics
3 806 (44.90%) Data Science
4 674 (37.55%) Data Engineering
5 642 (35.77%) Machine Learning
6 537 (29.92%) CI/CD
7 474 (26.41%) Data Pipeline
8 451 (25.13%) Software Engineering
9 439 (24.46%) ETL
10 430 (23.96%) DevOps
11 367 (20.45%) Computer Science
12 360 (20.06%) Data Modelling
13 358 (19.94%) Visualisation
14 313 (17.44%) Microservices
15 309 (17.21%) Artificial Intelligence
16 295 (16.43%) Test Automation
17 267 (14.87%) Mentoring
18 243 (13.54%) Data Management
19 241 (13.43%) TDD
20 239 (13.31%) Data Architecture
Programming Languages
1 1,367 (76.16%) Python
2 938 (52.26%) SQL
3 892 (49.69%) Java
4 632 (35.21%) Scala
5 257 (14.32%) JavaScript
6 175 (9.75%) Ruby
7 172 (9.58%) Shell Script
8 157 (8.75%) Perl
9 145 (8.08%) PHP
10 144 (8.02%) PowerShell
11 123 (6.85%) R
12 94 (5.24%) Go
12 94 (5.24%) TypeScript
13 87 (4.85%) C#
14 75 (4.18%) C++
15 60 (3.34%) Bash
16 54 (3.01%) Kotlin
17 28 (1.56%) MATLAB
18 25 (1.39%) Clojure
19 23 (1.28%) C
Qualifications
1 305 (16.99%) Degree
2 141 (7.86%) Computer Science Degree
3 101 (5.63%) Master's Degree
4 76 (4.23%) PhD
5 24 (1.34%) Security Cleared
6 23 (1.28%) AWS Certification
7 12 (0.67%) SC Cleared
8 9 (0.50%) CISSP
8 9 (0.50%) CRISC
9 6 (0.33%) BPSS Clearance
10 5 (0.28%) DV Cleared
11 3 (0.17%) CEH
11 3 (0.17%) CISA
11 3 (0.17%) CISM
11 3 (0.17%) ISO 27001 Lead Auditor
11 3 (0.17%) ISO 27001 Lead Implementer
12 2 (0.11%) ITIL Certification
13 1 (0.056%) Microsoft Certification
Quality Assurance & Compliance
1 170 (9.47%) Data Quality
2 62 (3.45%) QA
3 30 (1.67%) GDPR
4 10 (0.56%) SLA
5 8 (0.45%) ISO/IEC 27001
6 5 (0.28%) NIST
7 4 (0.22%) PCI DSS
8 2 (0.11%) Actionable Recommendations
8 2 (0.11%) GxP
8 2 (0.11%) ISO 15022
8 2 (0.11%) ISO 20022
System Software
1 525 (29.25%) Docker
2 107 (5.96%) Apache Flume
3 24 (1.34%) HDFS
4 9 (0.50%) Apache ZooKeeper
5 4 (0.22%) VirtualBox
6 1 (0.056%) Ceph
6 1 (0.056%) NFS
6 1 (0.056%) Virtual Machines
Systems Management
1 575 (32.03%) Kubernetes
2 325 (18.11%) Terraform
3 95 (5.29%) Oozie
4 72 (4.01%) Ansible
5 66 (3.68%) Prometheus
6 33 (1.84%) Grafana
6 33 (1.84%) Opscode Chef
7 32 (1.78%) Puppet
8 14 (0.78%) Consul
8 14 (0.78%) Kibana
9 11 (0.61%) Hadoop YARN
10 10 (0.56%) Kubeflow
11 8 (0.45%) Docker Swarm
11 8 (0.45%) Istio
12 6 (0.33%) Control-M
13 4 (0.22%) logstash
13 4 (0.22%) Nagios
13 4 (0.22%) Single Sign-On
14 2 (0.11%) Mesos
15 1 (0.056%) Ambari
Vendors
1 421 (23.45%) Google
2 356 (19.83%) Databricks
3 218 (12.14%) Microsoft
4 122 (6.80%) Oracle
5 121 (6.74%) Cloudera
6 72 (4.01%) Teradata
7 70 (3.90%) Splunk
8 44 (2.45%) Foundry
8 44 (2.45%) Palantir
9 34 (1.89%) AppDynamics
10 32 (1.78%) BT
11 30 (1.67%) Funding Circle
12 28 (1.56%) CA Agile Central
13 26 (1.45%) Salesforce.com
14 24 (1.34%) Informatica
15 23 (1.28%) CA
15 23 (1.28%) CrowdStrike
16 21 (1.17%) IBM
17 20 (1.11%) Apple
17 20 (1.11%) Talend