Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to

The following table provides summary statistics for permanent job vacancies with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 23 May 2022 with a comparison to the same period in the previous 2 years.

Apache Spark
UK
6 months to
23 May 2022		 Same period 2021 Same period 2020
Rank 237 243 247
Rank change year-on-year +6 +4 -8
Permanent jobs citing Apache Spark 2,683 1,252 1,254
As % of all permanent jobs advertised in the UK 1.65% 1.36% 1.35%
As % of the Application Platforms category 11.36% 10.00% 9.37%
Number of salaries quoted 887 913 924
10th Percentile £50,000 £46,250 £47,500
25th Percentile £58,750 £55,000 £56,250
Median annual salary (50th Percentile) £77,500 £75,000 £75,000
Median % change year-on-year +3.33% - -
75th Percentile £92,500 £90,000 £90,000
90th Percentile £108,750 £110,750 £110,000
UK excluding London median annual salary £62,500 £62,500 £62,500
% change year-on-year - - +4.17%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for application platform skills.

All Application Platform Skills
UK
Permanent vacancies with a requirement for application platform skills 23,615 12,515 13,377
As % of all permanent IT jobs advertised in the UK 14.49% 13.62% 14.39%
Number of salaries quoted 10,919 9,122 10,673
10th Percentile £31,250 £31,250 £30,000
25th Percentile £41,250 £40,000 £38,250
Median annual salary (50th Percentile) £55,000 £52,500 £52,500
Median % change year-on-year +4.76% - +5.00%
75th Percentile £76,250 £72,500 £71,250
90th Percentile £95,000 £87,500 £87,500
UK excluding London median annual salary £48,000 £47,500 £45,000
% change year-on-year +1.05% +5.56% +4.65%

Apache Spark
Job Vacancy Trend

Job postings citing Apache Spark as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Salary Trend

3-month moving average salary quoted in jobs citing Apache Spark.

Salary trend for Apache Spark in the UK

Apache Spark
Salary Histogram

Salary distribution for jobs citing Apache Spark over the 6 months to 23 May 2022.

Salary histogram for Apache Spark in the UK

Apache Spark
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the UK over the 6 months to 23 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Jobs
England +10 2,290 £80,000 +6.67% 121
London -34 1,625 £80,000 +5.26% 79
Work from Home -17 867 £80,000 +3.23% 45
UK excluding London -8 646 £62,500 - 47
South East -18 223 £63,750 -8.93% 7
East of England +11 136 £55,000 -15.38% 10
North of England -39 125 £66,250 +15.22% 11
North West -33 78 £65,000 - 8
Scotland -40 71 £60,000 -10.45% 4
Midlands -24 65 £62,500 -10.71% 7
East Midlands +14 45 £62,500 -1.96% 3
Yorkshire -45 43 £66,250 +20.45% 3
West Midlands -42 20 £65,000 -13.33% 4
South West -72 15 £70,000 -3.45% 5
Wales -36 12 £50,000 -
North East -14 4 £85,000 +49.35%
Northern Ireland -18 3 £69,500 +11.20% 3

For the 6 months to 23 May 2022, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Apache Spark.

1 2,109 (78.61%) Python
2 1,581 (58.93%) AWS
3 1,402 (52.25%) SQL
4 1,300 (48.45%) Big Data
5 1,218 (45.40%) Java
6 1,190 (44.35%) Agile
7 1,161 (43.27%) Analytics
8 1,119 (41.71%) Hadoop
9 1,100 (41.00%) Azure
10 1,066 (39.73%) Data Science
11 978 (36.45%) Kafka
12 921 (34.33%) GCP
13 916 (34.14%) Data Engineering
14 868 (32.35%) Scala
15 845 (31.49%) Machine Learning
16 816 (30.41%) Finance
17 811 (30.23%) NoSQL
18 807 (30.08%) Kubernetes
19 780 (29.07%) Docker
20 747 (27.84%) Data Pipeline
21 725 (27.02%) CI/CD
22 716 (26.69%) Social Skills
23 710 (26.46%) ETL
24 657 (24.49%) Apache
25 639 (23.82%) Google
26 592 (22.06%) Software Engineering
27 578 (21.54%) Data Warehouse
28 575 (21.43%) DevOps
29 563 (20.98%) Data Modelling
30 547 (20.39%) Algorithms

Apache Spark
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 657 (24.49%) Apache
2 511 (19.05%) Apache Airflow
3 243 (9.06%) Elasticsearch
4 58 (2.16%) Apache Pulsar
5 52 (1.94%) Luigi
6 51 (1.90%) Apache Pig
7 47 (1.75%) Oracle Workflow
8 40 (1.49%) Jupyter
9 39 (1.45%) SAS
10 24 (0.89%) Confluence
11 15 (0.56%) Cloud Foundry
12 14 (0.52%) Tomcat
13 13 (0.48%) Apache Solr
14 12 (0.45%) Apache Synapse
15 9 (0.34%) GemFire
16 8 (0.30%) SharePoint
17 4 (0.15%) BizTalk Server
18 3 (0.11%) JBoss
19 2 (0.075%) MQSeries
19 2 (0.075%) WebLogic
Applications
1 11 (0.41%) Microsoft Excel
1 11 (0.41%) Microsoft Office
1 11 (0.41%) Microsoft PowerPoint
2 10 (0.37%) MS Visio
3 6 (0.22%) Campfire
4 4 (0.15%) SPSS
5 1 (0.037%) Chatbot
5 1 (0.037%) Gephi
Business Applications
1 17 (0.63%) Oracle Payables
2 4 (0.15%) Sentinel
3 1 (0.037%) ION MarketView
Cloud Services
1 1,581 (58.93%) AWS
2 1,100 (41.00%) Azure
3 921 (34.33%) GCP
4 454 (16.92%) Serverless
5 377 (14.05%) AWS Lambda
6 317 (11.82%) Amazon S3
7 291 (10.85%) Snowflake
8 236 (8.80%) OpenShift
9 225 (8.39%) Amazon EMR
10 202 (7.53%) Cloud Functions
11 201 (7.49%) Amazon Kinesis
11 201 (7.49%) Power Platform
12 164 (6.11%) Cloud Computing
13 123 (4.58%) Amazon EC2
13 123 (4.58%) GitHub
14 115 (4.29%) Azure Data Factory
15 110 (4.10%) Azure Synapse Analytics
16 99 (3.69%) AWS CloudFormation
17 96 (3.58%) SaaS
18 82 (3.06%) Azure Cosmos DB
Communications & Networking
1 247 (9.21%) Internet
2 43 (1.60%) HTTP
3 18 (0.67%) Wireless
4 13 (0.48%) Firewall
5 12 (0.45%) VPN
6 10 (0.37%) Broadband
7 6 (0.22%) Network Security
8 5 (0.19%) SSH
9 4 (0.15%) DNS
9 4 (0.15%) Kerberos
10 3 (0.11%) Reverse Proxy
10 3 (0.11%) Wi-Fi
11 2 (0.075%) SNA
12 1 (0.037%) 3GPP
12 1 (0.037%) SAN
Database & Business Intelligence
1 1,300 (48.45%) Big Data
2 1,119 (41.71%) Hadoop
3 811 (30.23%) NoSQL
4 578 (21.54%) Data Warehouse
5 499 (18.60%) Flink
6 484 (18.04%) Data Lake
7 432 (16.10%) MongoDB
8 423 (15.77%) PostgreSQL
9 405 (15.10%) Apache Cassandra
10 401 (14.95%) Apache Hive
11 352 (13.12%) MySQL
12 346 (12.90%) SQL Server
13 287 (10.70%) Amazon Redshift
14 273 (10.18%) BigQuery
15 238 (8.87%) Relational Database
16 219 (8.16%) HBase
17 201 (7.49%) Power BI
17 201 (7.49%) Tableau
18 187 (6.97%) Metadata
19 175 (6.52%) Amazon Athena
Development Applications
1 460 (17.14%) Git (software)
2 282 (10.51%) JIRA
3 235 (8.76%) Jenkins
4 223 (8.31%) Gradle
5 216 (8.05%) Maven
6 201 (7.49%) Subversion
7 195 (7.27%) Ant
8 71 (2.65%) CircleCI
9 50 (1.86%) JUnit
10 32 (1.19%) Atlassian Bamboo
11 25 (0.93%) MLflow
12 24 (0.89%) Bitbucket
12 24 (0.89%) ERwin
13 23 (0.86%) GitLab
14 20 (0.75%) Sonatype Nexus
15 19 (0.71%) SonarQube
16 18 (0.67%) Cucumber
16 18 (0.67%) Storybook
17 16 (0.60%) RStudio
18 14 (0.52%) Spock
General
1 816 (30.41%) Finance
2 716 (26.69%) Social Skills
3 365 (13.60%) Analytical Skills
4 229 (8.54%) Inclusion and Diversity
5 224 (8.35%) Banking
6 217 (8.09%) Manufacturing
7 204 (7.60%) Marketing
8 189 (7.04%) Games
9 148 (5.52%) Retail
10 107 (3.99%) Advertising
11 96 (3.58%) Law
12 61 (2.27%) Telecoms
13 59 (2.20%) Presentation Skills
14 58 (2.16%) Legal
15 53 (1.98%) Pharmaceutical
16 49 (1.83%) Public Sector
17 42 (1.57%) Front Office
18 29 (1.08%) Financial Institution
18 29 (1.08%) Investment Banking
19 20 (0.75%) Influencing Skills
Job Titles
1 1,183 (44.09%) Data Engineer
2 332 (12.37%) Senior Data Engineer
3 275 (10.25%) Java Engineer
4 244 (9.09%) Software Engineer
5 211 (7.86%) Senior Java Engineer
6 197 (7.34%) Architect
7 143 (5.33%) Data Scientist
7 143 (5.33%) Developer
8 112 (4.17%) Data Architect
9 108 (4.03%) Big Data Engineer
10 97 (3.62%) Data Manager
11 91 (3.39%) AWS Engineer
12 90 (3.35%) Cloud Engineer
13 85 (3.17%) Senior Data Scientist
14 74 (2.76%) Analyst
15 71 (2.65%) Senior Software Engineer
16 70 (2.61%) Python Engineer
17 64 (2.39%) Consultant
18 60 (2.24%) Data Consultant
19 57 (2.12%) Scala Engineer
Libraries, Frameworks & Software Standards
1 978 (36.45%) Kafka
2 265 (9.88%) RESTful
3 255 (9.50%) PySpark
4 247 (9.21%) .NET
5 235 (8.76%) CSS
6 234 (8.72%) TensorFlow
7 221 (8.24%) HTML
8 199 (7.42%) JDBC
9 196 (7.31%) ASP.NET
10 191 (7.12%) Apache Beam
11 158 (5.89%) Spark Streaming
12 125 (4.66%) scikit-learn
13 122 (4.55%) Pandas
14 120 (4.47%) REST
15 116 (4.32%) Spring
16 111 (4.14%) Apache NiFi
16 111 (4.14%) Keras
17 108 (4.03%) Web Services
18 104 (3.88%) RabbitMQ
19 99 (3.69%) React
Miscellaneous
1 547 (20.39%) Algorithms
2 321 (11.96%) Data Structures
3 230 (8.57%) Life Science
4 224 (8.35%) Linux Command Line
5 171 (6.37%) Cloud Native
6 111 (4.14%) Blog
7 102 (3.80%) Public Cloud
8 86 (3.21%) Management Information System
9 84 (3.13%) IoT
10 65 (2.42%) Greenfield Project
11 56 (2.09%) Virtual Team
12 54 (2.01%) Blockchain
13 48 (1.79%) Hybrid Cloud
14 44 (1.64%) Digital Media
15 41 (1.53%) User Experience
16 33 (1.23%) Self-Motivation
17 31 (1.16%) Sports Betting
18 27 (1.01%) Enterprise Software
19 26 (0.97%) Mobile App
20 24 (0.89%) Educational Technology
Operating Systems
1 301 (11.22%) Linux
2 300 (11.18%) Unix
3 66 (2.46%) Windows
4 22 (0.82%) CentOS
4 22 (0.82%) Ubuntu
5 12 (0.45%) Alpine Linux
5 12 (0.45%) Kali Linux
5 12 (0.45%) VMS
6 9 (0.34%) Debian
7 4 (0.15%) Red Hat Enterprise Linux
8 3 (0.11%) Amazon Linux
8 3 (0.11%) Android
9 2 (0.075%) Apple iOS
10 1 (0.037%) Windows Server
Processes & Methodologies
1 1,190 (44.35%) Agile
2 1,161 (43.27%) Analytics
3 1,066 (39.73%) Data Science
4 916 (34.14%) Data Engineering
5 845 (31.49%) Machine Learning
6 747 (27.84%) Data Pipeline
7 725 (27.02%) CI/CD
8 710 (26.46%) ETL
9 592 (22.06%) Software Engineering
10 575 (21.43%) DevOps
11 563 (20.98%) Data Modelling
12 533 (19.87%) Computer Science
13 472 (17.59%) Microservices
14 443 (16.51%) Artificial Intelligence
15 434 (16.18%) Mentoring
16 426 (15.88%) Test Automation
17 423 (15.77%) Visualisation
18 420 (15.65%) Data Management
19 386 (14.39%) Problem-Solving
20 364 (13.57%) Data Architecture
Programming Languages
1 2,109 (78.61%) Python
2 1,402 (52.25%) SQL
3 1,218 (45.40%) Java
4 868 (32.35%) Scala
5 334 (12.45%) JavaScript
6 264 (9.84%) R
7 254 (9.47%) Ruby
8 250 (9.32%) Shell Script
9 233 (8.68%) Perl
10 228 (8.50%) PowerShell
11 210 (7.83%) PHP
12 127 (4.73%) C#
13 100 (3.73%) C++
14 99 (3.69%) Go
15 94 (3.50%) Bash
16 89 (3.32%) TypeScript
17 63 (2.35%) MATLAB
18 43 (1.60%) Kotlin
19 33 (1.23%) T-SQL
20 30 (1.12%) Julia
Qualifications
1 462 (17.22%) Degree
2 234 (8.72%) Computer Science Degree
3 104 (3.88%) Master's Degree
4 81 (3.02%) PhD
5 66 (2.46%) Security Cleared
6 37 (1.38%) SC Cleared
7 32 (1.19%) AWS Certification
8 16 (0.60%) Numerate Degree
9 12 (0.45%) RHCE
10 9 (0.34%) CISSP
10 9 (0.34%) CRISC
10 9 (0.34%) OCP
10 9 (0.34%) Oracle Certification
11 7 (0.26%) DV Cleared
11 7 (0.26%) PMI Certification
12 4 (0.15%) BPSS Clearance
12 4 (0.15%) CEH
12 4 (0.15%) CISA
12 4 (0.15%) CISM
12 4 (0.15%) ISO 27001 Lead Auditor
Quality Assurance & Compliance
1 216 (8.05%) Data Quality
2 92 (3.43%) QA
3 41 (1.53%) GDPR
4 14 (0.52%) PCI DSS
5 10 (0.37%) GxP
5 10 (0.37%) ISO/IEC 27001
5 10 (0.37%) SLA
6 7 (0.26%) NIST
7 4 (0.15%) Cyber Essentials
7 4 (0.15%) Cyber Essentials PLUS
8 3 (0.11%) CRD IV
8 3 (0.11%) IFRS
8 3 (0.11%) IFRS 9
9 2 (0.075%) HL7
10 1 (0.037%) Accessibility
10 1 (0.037%) Dodd-Frank
10 1 (0.037%) EMIR
10 1 (0.037%) FATCA
10 1 (0.037%) GLBA
10 1 (0.037%) MiFID
System Software
1 780 (29.07%) Docker
2 97 (3.62%) Apache Flume
3 66 (2.46%) HDFS
4 32 (1.19%) Apache ZooKeeper
5 26 (0.97%) LXC
5 26 (0.97%) VMware Infrastructure
6 12 (0.45%) Active Directory
6 12 (0.45%) GlusterFS
6 12 (0.45%) vSphere
7 5 (0.19%) Ceph
7 5 (0.19%) NFS
7 5 (0.19%) VirtualBox
8 1 (0.037%) Virtual Machines
Systems Management
1 807 (30.08%) Kubernetes
2 380 (14.16%) Terraform
3 132 (4.92%) Ansible
4 114 (4.25%) Oozie
5 73 (2.72%) Opscode Chef
6 72 (2.68%) Prometheus
7 70 (2.61%) Puppet
8 40 (1.49%) Hadoop YARN
9 33 (1.23%) Grafana
10 32 (1.19%) Consul
11 26 (0.97%) Cisco IPCC
12 17 (0.63%) Kibana
13 11 (0.41%) Istio
14 9 (0.34%) Matomo
15 8 (0.30%) Control-M
16 7 (0.26%) Mesos
17 6 (0.22%) Argo
17 6 (0.22%) Nagios
18 5 (0.19%) Docker Swarm
18 5 (0.19%) Kubeflow
Vendors
1 639 (23.82%) Google
2 500 (18.64%) Databricks
3 392 (14.61%) Microsoft
4 157 (5.85%) Oracle
5 131 (4.88%) Cloudera
6 107 (3.99%) Informatica
7 91 (3.39%) Talend
8 72 (2.68%) Splunk
9 66 (2.46%) Teradata
10 36 (1.34%) Salesforce.com
11 33 (1.23%) Hortonworks
12 31 (1.16%) VMware
13 27 (1.01%) Marin
14 26 (0.97%) AppDynamics
14 26 (0.97%) BT
15 25 (0.93%) Spotify
16 24 (0.89%) Apple
16 24 (0.89%) BEA
16 24 (0.89%) CrowdStrike
16 24 (0.89%) IBM
152 Apache Spark job vacancies Nationwide