Period
to 24 February 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 24 February 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
England > London
6 months to
24 Feb 2021
Same period 2020 Same period 2019
Rank 155 163 157
Rank change year-on-year +8 -6 -20
Permanent jobs citing Apache Spark 606 1,133 1,385
As % of all permanent jobs advertised in London 2.20% 2.24% 2.24%
As % of the Application Platforms category 15.49% 15.25% 13.27%
Number of salaries quoted 580 951 1,184
Median annual salary £75,000 £77,500 £80,000
Median salary % change year-on-year -3.23% -3.13% +6.67%
10th Percentile £47,500 £53,750 £53,750
90th Percentile £112,500 £112,500 £107,500
England median annual salary £70,000 £72,500 £75,000
% change year-on-year -3.45% -3.33% +7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for application platform skills.

All Application Platform Skills
London
Permanent vacancies with a requirement for application platform skills 3,911 7,431 10,438
As % of all permanent IT jobs advertised in London 14.20% 14.69% 16.87%
Number of salaries quoted 3,184 6,164 8,531
Median annual salary £65,000 £61,250 £60,000
Median salary % change year-on-year +6.12% +2.08% -
10th Percentile £41,250 £33,750 £32,500
90th Percentile £100,000 £95,000 £95,000
England median annual salary £55,000 £51,000 £50,000
% change year-on-year +7.84% +2.00% -

Apache Spark
Job Vacancy Trend in London

Job postings citing Apache Spark as a proportion of all IT jobs advertised in London.

Job vacancy trend for Apache Spark in London

Apache Spark
Salary Trend in London

3-month moving average salary quoted in jobs citing Apache Spark in London.

Salary trend for Apache Spark in London

Apache Spark
Salary Histogram in London

Salary distribution for jobs citing Apache Spark in London over the 6 months to 24 February 2021.

Salary histogram for Apache Spark in London

Apache Spark
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the London region over the 6 months to 24 February 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +32 139 £80,000 +6.67% 39
North London - 8 £62,500 -
East London +11 7 £65,000 -23.53% 6
West London +53 3 £77,500 +10.71% 29
South London +1 1 £67,500 -15.63% 1
Apache Spark
England

For the 6 months to 24 February 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Apache Spark.

1 409 (67.49%) Python
2 328 (54.13%) AWS
3 297 (49.01%) Hadoop
4 296 (48.84%) Big Data
5 275 (45.38%) Kafka
6 259 (42.74%) Java
7 255 (42.08%) SQL
8 199 (32.84%) Azure
9 190 (31.35%) Docker
9 190 (31.35%) Data Science
10 189 (31.19%) Scala
11 184 (30.36%) Agile Software Development
12 181 (29.87%) Finance
13 175 (28.88%) Machine Learning
14 168 (27.72%) GCP
14 168 (27.72%) Kubernetes
15 164 (27.06%) ETL
16 158 (26.07%) NoSQL
17 157 (25.91%) Analytics
18 138 (22.77%) Microservices
19 133 (21.95%) Software Engineering
20 118 (19.47%) Data Engineering
21 112 (18.48%) Apache
22 107 (17.66%) DevOps
23 103 (17.00%) Artificial Intelligence
24 94 (15.51%) Data Lake
25 87 (14.36%) Data Warehouse
25 87 (14.36%) JavaScript
26 84 (13.86%) C#
27 83 (13.70%) Degree

Apache Spark
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 112 (18.48%) Apache
2 69 (11.39%) Apache Airflow
3 54 (8.91%) Elasticsearch
4 26 (4.29%) Luigi
5 21 (3.47%) Apache Pig
6 16 (2.64%) SAS
7 13 (2.15%) Tornado
8 7 (1.16%) CMS
9 5 (0.83%) Jupyter
9 5 (0.83%) Oracle Workflow
10 3 (0.50%) Tomcat
11 1 (0.17%) Apache Synapse
11 1 (0.17%) Confluence
11 1 (0.17%) GlassFish
Applications
1 16 (2.64%) Microsoft Excel
2 11 (1.82%) SPSS
3 3 (0.50%) SPSS Modeler
4 2 (0.33%) Gephi
Business Applications
1 2 (0.33%) Distributed Ledger
1 2 (0.33%) Oracle Cash Management
2 1 (0.17%) SAP APO
Cloud Services
1 328 (54.13%) AWS
2 199 (32.84%) Azure
3 168 (27.72%) GCP
4 55 (9.08%) Serverless
5 47 (7.76%) Amazon S3
6 40 (6.60%) Amazon EMR
7 39 (6.44%) Amazon Kinesis
8 35 (5.78%) AWS Lambda
9 31 (5.12%) GitHub
10 30 (4.95%) Power Platform
11 22 (3.63%) Azure Data Factory
12 21 (3.47%) Amazon ECS
13 19 (3.14%) Amazon EC2
14 15 (2.48%) IBM Cloud
14 15 (2.48%) PaaS
15 14 (2.31%) Cloud Computing
15 14 (2.31%) Cloud Functions
16 11 (1.82%) SaaS
17 9 (1.49%) Amazon SQS
17 9 (1.49%) OpenShift
Communications & Networking
1 25 (4.13%) Firewall
2 21 (3.47%) HTTP
3 16 (2.64%) TCP/IP
4 6 (0.99%) DNS
4 6 (0.99%) Kerberos
5 5 (0.83%) Parlay
5 5 (0.83%) VPN
6 4 (0.66%) 802.11
6 4 (0.66%) Fibre Channel
6 4 (0.66%) FTP
6 4 (0.66%) Internet
6 4 (0.66%) LAN
6 4 (0.66%) SAN
6 4 (0.66%) SNMP
6 4 (0.66%) SSH
6 4 (0.66%) WAN
6 4 (0.66%) Wireless
7 3 (0.50%) DMZ
7 3 (0.50%) Software-Defined Networking
7 3 (0.50%) SSL
Database & Business Intelligence
1 297 (49.01%) Hadoop
2 296 (48.84%) Big Data
3 158 (26.07%) NoSQL
4 94 (15.51%) Data Lake
5 87 (14.36%) Data Warehouse
6 74 (12.21%) Amazon Redshift
7 71 (11.72%) Apache Hive
8 66 (10.89%) PostgreSQL
9 65 (10.73%) MongoDB
10 59 (9.74%) Apache Cassandra
11 47 (7.76%) BigQuery
12 45 (7.43%) Relational Database
13 41 (6.77%) Tableau
14 36 (5.94%) Amazon Athena
14 36 (5.94%) SQL Server
15 30 (4.95%) Power BI
16 29 (4.79%) Presto
17 28 (4.62%) Flink
18 26 (4.29%) MySQL
19 24 (3.96%) HBase
Development Applications
1 65 (10.73%) Git (software)
1 65 (10.73%) Jenkins
2 27 (4.46%) JIRA
3 18 (2.97%) Maven
4 16 (2.64%) TeamCity
5 15 (2.48%) Atlassian Bamboo
5 15 (2.48%) Vagrant
6 13 (2.15%) Sonatype Nexus
7 8 (1.32%) Visual Studio
8 6 (0.99%) Selenium
9 5 (0.83%) Bitbucket
9 5 (0.83%) Cucumber
10 4 (0.66%) GitLab
11 3 (0.50%) SonarQube
12 2 (0.33%) Bitbucket Server
12 2 (0.33%) CA Release Automation
12 2 (0.33%) CircleCI
12 2 (0.33%) ER Studio
12 2 (0.33%) git-flow
12 2 (0.33%) Octopus Deploy
General
1 181 (29.87%) Finance
2 73 (12.05%) Banking
3 50 (8.25%) Front Office
4 43 (7.10%) Retail
5 31 (5.12%) Marketing
6 25 (4.13%) Games
7 21 (3.47%) Telecoms
8 19 (3.14%) Law
9 11 (1.82%) Investment Banking
10 10 (1.65%) Manufacturing
11 7 (1.16%) Advertising
12 4 (0.66%) Financial Institution
12 4 (0.66%) Publishing
13 3 (0.50%) Electronics
13 3 (0.50%) Public Sector
14 2 (0.33%) Legal
14 2 (0.33%) Pharmaceutical
15 1 (0.17%) Billing
15 1 (0.17%) Czech Language
Job Titles
1 229 (37.79%) Data Engineer
2 140 (23.10%) Developer
3 75 (12.38%) Software Engineer
4 60 (9.90%) Big Data Engineer
5 58 (9.57%) Senior Data Engineer
6 53 (8.75%) Architect
7 50 (8.25%) Data Scientist
8 45 (7.43%) Java Developer
9 43 (7.10%) Developer/Software Engineer
10 42 (6.93%) Python Engineer
11 41 (6.77%) AWS Engineer
12 38 (6.27%) Java Engineer
13 37 (6.11%) .NET Developer
14 35 (5.78%) .NET Software Developer
14 35 (5.78%) .NET Software Engineer
15 33 (5.45%) Data Architect
16 26 (4.29%) DevOps Engineer
17 23 (3.80%) Java Software Engineer
17 23 (3.80%) Platform Engineer
17 23 (3.80%) Python Developer
Libraries, Frameworks & Software Standards
1 275 (45.38%) Kafka
2 63 (10.40%) React
3 52 (8.58%) Node.js
4 44 (7.26%) TensorFlow
5 43 (7.10%) .NET
6 41 (6.77%) RESTful
7 37 (6.11%) .NET Core
7 37 (6.11%) Spring
8 35 (5.78%) PySpark
9 33 (5.45%) Spring Boot
10 32 (5.28%) Spark Streaming
11 31 (5.12%) Pandas
11 31 (5.12%) Web Services
12 30 (4.95%) Natural Language Processing
13 29 (4.79%) Apache NiFi
14 26 (4.29%) NumPy
15 25 (4.13%) scikit-learn
16 22 (3.63%) HTML
17 21 (3.47%) CSS
18 19 (3.14%) JSON
Miscellaneous
1 64 (10.56%) Algorithms
2 60 (9.90%) Analytical Skills
3 29 (4.79%) Hedge funds
4 28 (4.62%) Equities
5 26 (4.29%) Greenfield Project
6 19 (3.14%) Data Structures
7 17 (2.81%) Cloud Native
7 17 (2.81%) Public Cloud
8 16 (2.64%) Hybrid Cloud
9 11 (1.82%) Market Risk
9 11 (1.82%) Self-Motivation
10 10 (1.65%) Credit Risk
10 10 (1.65%) FMCG
11 8 (1.32%) User Experience
11 8 (1.32%) Video\Live Streaming
12 7 (1.16%) Foreign Exchange (FX)
13 6 (0.99%) Acoustics
13 6 (0.99%) Blog
13 6 (0.99%) Mobile App
14 5 (0.83%) Virtual Team
Operating Systems
1 56 (9.24%) Linux
2 16 (2.64%) Ubuntu
3 12 (1.98%) Unix
4 7 (1.16%) Windows
5 4 (0.66%) CentOS
5 4 (0.66%) Red Hat Enterprise Linux
6 3 (0.50%) Oracle Linux
7 1 (0.17%) Android
7 1 (0.17%) Apple iOS
Processes & Methodologies
1 190 (31.35%) Data Science
2 184 (30.36%) Agile Software Development
3 175 (28.88%) Machine Learning
4 164 (27.06%) ETL
5 157 (25.91%) Analytics
6 138 (22.77%) Microservices
7 133 (21.95%) Software Engineering
8 118 (19.47%) Data Engineering
9 107 (17.66%) DevOps
10 103 (17.00%) Artificial Intelligence
11 72 (11.88%) Business Intelligence
12 71 (11.72%) Computer Science
13 69 (11.39%) Fintech
14 62 (10.23%) Visualisation
15 59 (9.74%) Mathematics
16 56 (9.24%) Open Source
17 55 (9.08%) Data Modelling
18 48 (7.92%) Problem-Solving
19 45 (7.43%) Continuous Integration
20 43 (7.10%) Data Analytics
Programming Languages
1 409 (67.49%) Python
2 259 (42.74%) Java
3 255 (42.08%) SQL
4 189 (31.19%) Scala
5 87 (14.36%) JavaScript
6 84 (13.86%) C#
7 49 (8.09%) R
8 31 (5.12%) Bash Shell
9 25 (4.13%) Go
10 22 (3.63%) C
10 22 (3.63%) TypeScript
11 21 (3.47%) PHP
12 20 (3.30%) Kotlin
13 16 (2.64%) C++
14 14 (2.31%) ES6
15 11 (1.82%) Perl
16 9 (1.49%) PowerShell
17 8 (1.32%) F#
17 8 (1.32%) T-SQL
18 7 (1.16%) Data Analysis Expressions (DAX)
Qualifications
1 83 (13.70%) Degree
2 32 (5.28%) Computer Science Degree
3 13 (2.15%) PhD
4 12 (1.98%) Numerate Degree
5 9 (1.49%) Postgraduate
6 7 (1.16%) Sun Certification
7 5 (0.83%) TOGAF Certification
8 4 (0.66%) AWS Certification
8 4 (0.66%) Security Cleared
9 3 (0.50%) Master's Degree
10 2 (0.33%) CCNA
10 2 (0.33%) CEH
10 2 (0.33%) CompTIA Security+
10 2 (0.33%) DV Cleared
10 2 (0.33%) GIAC
10 2 (0.33%) Linux+ Certification
10 2 (0.33%) Network+ Certification
10 2 (0.33%) SANS
10 2 (0.33%) SC Cleared
10 2 (0.33%) SSCP
Quality Assurance & Compliance
1 49 (8.09%) QA
2 11 (1.82%) Data Quality
3 8 (1.32%) GDPR
4 2 (0.33%) ISO 20022
4 2 (0.33%) PSD2
4 2 (0.33%) TARGET2
5 1 (0.17%) ISO 9001
5 1 (0.17%) ISO/IEC 27001
5 1 (0.17%) MiFID
5 1 (0.17%) PMO
System Software
1 190 (31.35%) Docker
2 15 (2.48%) VirtualBox
3 9 (1.49%) HDFS
4 6 (0.99%) Apache Flume
5 4 (0.66%) VMware Infrastructure
6 2 (0.33%) Apache ZooKeeper
6 2 (0.33%) Virtual Machines
7 1 (0.17%) Active Directory
7 1 (0.17%) NFS
7 1 (0.17%) oVirt
Systems Management
1 168 (27.72%) Kubernetes
2 79 (13.04%) Terraform
3 57 (9.41%) Ansible
4 23 (3.80%) Puppet
5 15 (2.48%) Docker Swarm
6 14 (2.31%) Oozie
7 10 (1.65%) Opscode Chef
8 4 (0.66%) Kibana
8 4 (0.66%) Nagios
9 2 (0.33%) Grafana
9 2 (0.33%) Hadoop YARN
9 2 (0.33%) Mesos
9 2 (0.33%) Prometheus
9 2 (0.33%) SELinux
10 1 (0.17%) Ambari
10 1 (0.17%) ITRS Geneos
10 1 (0.17%) Kubeflow
10 1 (0.17%) Single Sign-On
Vendors
1 77 (12.71%) Google
2 74 (12.21%) Databricks
3 41 (6.77%) Talend
4 38 (6.27%) Microsoft
5 36 (5.94%) Oracle
6 35 (5.78%) Cloudera
7 19 (3.14%) Red Hat
8 18 (2.97%) Hortonworks
9 17 (2.81%) Informatica
10 16 (2.64%) IBM
11 10 (1.65%) StreamSets
12 7 (1.16%) Splunk
13 6 (0.99%) SAP
14 5 (0.83%) Alteryx
15 4 (0.66%) Guidewire
15 4 (0.66%) MuleSoft
15 4 (0.66%) VMware
16 3 (0.50%) Salesforce.com
16 3 (0.50%) Teradata
17 2 (0.33%) BT