Period
to

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 15 August 2022 with a comparison to the same period in the previous 2 years.

Apache Spark
UK > England
6 months to
15 Aug 2022
Same period 2021 Same period 2020
Rank 247 228 254
Rank change year-on-year -19 +26 -29
Permanent jobs citing Apache Spark 2,240 1,630 772
As % of all permanent jobs advertised in England 1.59% 1.60% 1.35%
As % of the Application Platforms category 12.48% 12.70% 10.41%
Number of salaries quoted 842 902 536
10th Percentile £50,000 £47,500 £47,500
25th Percentile £62,500 £57,500 £60,000
Median annual salary (50th Percentile) £80,000 £77,500 £75,000
Median % change year-on-year +3.23% +3.33% -
75th Percentile £95,000 £92,500 £95,000
90th Percentile £109,689 £107,500 £120,000
UK median annual salary £75,000 £75,000 £75,000

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for application platform skills.

All Application Platform Skills
England
Permanent vacancies with a requirement for application platform skills 17,949 12,831 7,418
As % of all permanent IT jobs advertised in England 12.74% 12.61% 12.95%
Number of salaries quoted 9,280 8,643 5,918
10th Percentile £31,250 £30,500 £31,250
25th Percentile £41,713 £39,250 £40,000
Median annual salary (50th Percentile) £55,575 £52,500 £52,500
Median % change year-on-year +5.86% - +5.00%
75th Percentile £77,500 £73,750 £72,500
90th Percentile £95,000 £90,000 £87,500
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Apache Spark
Job Vacancy Trend in England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in England.

Job vacancy trend for Apache Spark in England

Apache Spark
Salary Trend in England

3-month moving average salary quoted in jobs citing Apache Spark in England.

Salary trend for Apache Spark in England

Apache Spark
Salary Histogram in England

Salary distribution for jobs citing Apache Spark in England over the 6 months to 15 August 2022.

Salary histogram for Apache Spark in England

Apache Spark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the England region over the 6 months to 15 August 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London -25 1,655 £82,500 +6.45% 97
South East -129 205 £63,750 -25.00% 10
East of England +23 125 £55,000 -31.25% 2
North of England -39 96 £68,750 +17.02% 16
North West -38 56 £70,000 +11.55% 9
Midlands -29 48 £63,750 +6.25% 7
Yorkshire -23 35 £55,000 -2.22% 6
West Midlands -42 27 £70,000 +12.00% 4
East Midlands -11 21 £62,500 +25.00% 3
South West -55 15 £70,000 +16.67% 5
North East -10 5 £77,500 +36.17% 1
Apache Spark
UK

For the 6 months to 15 August 2022, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Apache Spark.

1 1,688 (75.36%) Python
2 1,369 (61.12%) AWS
3 1,200 (53.57%) SQL
4 1,075 (47.99%) Big Data
5 1,063 (47.46%) Agile
6 1,021 (45.58%) Java
7 953 (42.54%) Analytics
8 943 (42.10%) Azure
9 910 (40.63%) Hadoop
10 890 (39.73%) Data Science
11 816 (36.43%) Kafka
12 808 (36.07%) Data Engineering
13 761 (33.97%) GCP
14 750 (33.48%) Finance
15 736 (32.86%) Machine Learning
16 721 (32.19%) Scala
17 651 (29.06%) NoSQL
18 646 (28.84%) CI/CD
19 621 (27.72%) Kubernetes
20 599 (26.74%) Docker
21 591 (26.38%) ETL
22 567 (25.31%) Data Pipeline
23 553 (24.69%) Social Skills
24 538 (24.02%) Software Engineering
25 507 (22.63%) Google
26 496 (22.14%) Data Modelling
27 474 (21.16%) Algorithms
28 460 (20.54%) Flink
29 456 (20.36%) Data Warehouse
30 446 (19.91%) DevOps

Apache Spark
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 382 (17.05%) Apache
2 365 (16.29%) Apache Airflow
3 86 (3.84%) Apache Pulsar
4 43 (1.92%) Oracle Workflow
5 39 (1.74%) Apache Pig
6 28 (1.25%) SAS
7 20 (0.89%) Jupyter
8 18 (0.80%) Cloud Foundry
9 16 (0.71%) Luigi
10 14 (0.63%) Confluence
11 12 (0.54%) Apache Synapse
12 7 (0.31%) Tomcat
13 6 (0.27%) Pachyderm
14 5 (0.22%) Oracle SOA Suite
15 4 (0.18%) Apache Solr
15 4 (0.18%) SharePoint
16 3 (0.13%) GemFire
17 2 (0.089%) MQSeries
18 1 (0.045%) Apache ServiceMix
18 1 (0.045%) Tornado
Applications
1 7 (0.31%) Campfire
2 1 (0.045%) Chatbot
2 1 (0.045%) Microsoft Excel
2 1 (0.045%) Microsoft Office
2 1 (0.045%) SPSS
Business Applications
1 19 (0.85%) Oracle Payables
2 5 (0.22%) SAP Oil and Gas
3 2 (0.089%) Sparx Enterprise Architect
4 1 (0.045%) ION MarketView
Cloud Services
1 1,369 (61.12%) AWS
2 943 (42.10%) Azure
3 761 (33.97%) GCP
4 365 (16.29%) Serverless
5 318 (14.20%) AWS Lambda
6 238 (10.63%) Snowflake
7 221 (9.87%) Amazon S3
8 215 (9.60%) OpenShift
9 203 (9.06%) Power Platform
10 198 (8.84%) Cloud Functions
11 174 (7.77%) Amazon Kinesis
12 145 (6.47%) Amazon EMR
13 143 (6.38%) GitHub
14 129 (5.76%) Cloud Computing
15 125 (5.58%) Azure Data Factory
15 125 (5.58%) Azure Synapse Analytics
16 100 (4.46%) AWS CloudFormation
17 84 (3.75%) Amazon ECS
18 82 (3.66%) Amazon EC2
19 78 (3.48%) Azure DevOps
Communications & Networking
1 217 (9.69%) Internet
2 27 (1.21%) HTTP
3 12 (0.54%) VPN
4 7 (0.31%) Broadband
5 6 (0.27%) DNS
6 4 (0.18%) AMQP
6 4 (0.18%) Firewall
6 4 (0.18%) Wireless
7 3 (0.13%) Kerberos
8 1 (0.045%) 3GPP
8 1 (0.045%) Reverse Proxy
8 1 (0.045%) SAN
Database & Business Intelligence
1 1,075 (47.99%) Big Data
2 910 (40.63%) Hadoop
3 651 (29.06%) NoSQL
4 460 (20.54%) Flink
5 456 (20.36%) Data Warehouse
6 394 (17.59%) Data Lake
7 389 (17.37%) Apache Cassandra
8 361 (16.12%) MongoDB
9 337 (15.04%) Apache Hive
10 321 (14.33%) SQL Server
11 313 (13.97%) PostgreSQL
12 275 (12.28%) MySQL
13 255 (11.38%) Amazon Redshift
14 238 (10.63%) Tableau
15 229 (10.22%) BigQuery
16 221 (9.87%) Elasticsearch
17 203 (9.06%) Power BI
18 201 (8.97%) HBase
19 199 (8.88%) Relational Database
20 159 (7.10%) Amazon Athena
Development Applications
1 390 (17.41%) Git (software)
2 271 (12.10%) JIRA
3 256 (11.43%) Gradle
4 231 (10.31%) Maven
5 215 (9.60%) Jenkins
6 207 (9.24%) Subversion
7 195 (8.71%) Ant
8 61 (2.72%) CircleCI
9 52 (2.32%) JUnit
10 45 (2.01%) webpack
11 40 (1.79%) Cucumber
12 37 (1.65%) MLflow
13 35 (1.56%) GitLab
14 29 (1.29%) Atlassian Bamboo
15 28 (1.25%) Selenium
16 27 (1.21%) SonarQube
17 25 (1.12%) Postman
17 25 (1.12%) SoapUI
18 21 (0.94%) ERwin
19 19 (0.85%) IBM UrbanCode
General
1 750 (33.48%) Finance
2 553 (24.69%) Social Skills
3 376 (16.79%) Analytical Skills
4 222 (9.91%) Manufacturing
5 202 (9.02%) Inclusion and Diversity
6 172 (7.68%) Games
7 170 (7.59%) Banking
8 142 (6.34%) Marketing
9 107 (4.78%) Retail
10 68 (3.04%) Public Sector
11 65 (2.90%) Law
12 54 (2.41%) Advertising
13 47 (2.10%) Presentation Skills
14 42 (1.88%) Aerospace
15 41 (1.83%) Front Office
16 36 (1.61%) Telecoms
17 28 (1.25%) Influencing Skills
18 27 (1.21%) Billing
19 19 (0.85%) Electronics
20 18 (0.80%) Italian Language
Job Titles
1 940 (41.96%) Data Engineer
2 298 (13.30%) Senior Data Engineer
3 234 (10.45%) Java Engineer
4 214 (9.55%) Senior Java Engineer
5 195 (8.71%) Software Engineer
6 160 (7.14%) Architect
7 121 (5.40%) Developer
8 119 (5.31%) Data Scientist
9 118 (5.27%) Analyst
9 118 (5.27%) Big Data Engineer
10 87 (3.88%) AWS Engineer
11 85 (3.79%) Data Architect
12 74 (3.30%) Senior Data Scientist
13 72 (3.21%) Senior Analyst
14 71 (3.17%) Data Manager
14 71 (3.17%) Python Engineer
15 64 (2.86%) AWS Data Engineer
16 62 (2.77%) Scala Engineer
17 59 (2.63%) Cloud Engineer
17 59 (2.63%) Engineering Manager
Libraries, Frameworks & Software Standards
1 816 (36.43%) Kafka
2 243 (10.85%) .NET
3 238 (10.63%) PySpark
4 231 (10.31%) RESTful
5 217 (9.69%) CSS
6 210 (9.38%) HTML
7 199 (8.88%) ASP.NET
7 199 (8.88%) JDBC
8 193 (8.62%) TensorFlow
9 149 (6.65%) Apache Beam
10 139 (6.21%) Pandas
11 132 (5.89%) REST
11 132 (5.89%) scikit-learn
11 132 (5.89%) Spark Streaming
12 115 (5.13%) Web Services
13 100 (4.46%) React
14 95 (4.24%) Apache NiFi
15 94 (4.20%) Spring
16 86 (3.84%) Keras
17 75 (3.35%) Akka
Miscellaneous
1 474 (21.16%) Algorithms
2 408 (18.21%) Data Structures
3 230 (10.27%) Life Science
4 222 (9.91%) Linux Command Line
5 125 (5.58%) Cloud Native
6 120 (5.36%) Hackathon
7 119 (5.31%) Blog
8 73 (3.26%) Public Cloud
9 62 (2.77%) Greenfield Project
10 53 (2.37%) IoT
11 48 (2.14%) Management Information System
12 46 (2.05%) Digital Media
13 44 (1.96%) User Experience
14 40 (1.79%) Virtual Team
15 33 (1.47%) Self-Motivation
16 27 (1.21%) Educational Technology
17 23 (1.03%) Blockchain
17 23 (1.03%) Mobile App
17 23 (1.03%) Renewable Energy
17 23 (1.03%) Sports Betting
Operating Systems
1 293 (13.08%) Unix
2 255 (11.38%) Linux
3 35 (1.56%) Windows
4 15 (0.67%) VMS
5 9 (0.40%) Red Hat Enterprise Linux
6 4 (0.18%) Alpine Linux
6 4 (0.18%) Amazon Linux
6 4 (0.18%) Kali Linux
6 4 (0.18%) Ubuntu
7 2 (0.089%) Mac OS X
8 1 (0.045%) Android
8 1 (0.045%) MVS
8 1 (0.045%) Windows Server
Processes & Methodologies
1 1,063 (47.46%) Agile
2 953 (42.54%) Analytics
3 890 (39.73%) Data Science
4 808 (36.07%) Data Engineering
5 736 (32.86%) Machine Learning
6 646 (28.84%) CI/CD
7 591 (26.38%) ETL
8 567 (25.31%) Data Pipeline
9 538 (24.02%) Software Engineering
10 496 (22.14%) Data Modelling
11 446 (19.91%) DevOps
12 427 (19.06%) Test Automation
13 413 (18.44%) Computer Science
14 403 (17.99%) Microservices
15 388 (17.32%) Visualisation
16 373 (16.65%) Mentoring
17 340 (15.18%) TDD
18 321 (14.33%) Artificial Intelligence
19 306 (13.66%) Coaching
20 291 (12.99%) Data Analysis
Programming Languages
1 1,688 (75.36%) Python
2 1,200 (53.57%) SQL
3 1,021 (45.58%) Java
4 721 (32.19%) Scala
5 335 (14.96%) JavaScript
6 263 (11.74%) Shell Script
7 236 (10.54%) Ruby
8 219 (9.78%) Perl
9 217 (9.69%) PowerShell
10 206 (9.20%) PHP
11 178 (7.95%) R
12 120 (5.36%) C#
13 100 (4.46%) TypeScript
14 97 (4.33%) Go
15 88 (3.93%) Bash
16 73 (3.26%) C++
17 42 (1.88%) Kotlin
18 31 (1.38%) Clojure
18 31 (1.38%) MATLAB
19 26 (1.16%) T-SQL
Qualifications
1 363 (16.21%) Degree
2 135 (6.03%) Computer Science Degree
3 105 (4.69%) Master's Degree
4 82 (3.66%) PhD
5 33 (1.47%) Security Cleared
6 22 (0.98%) SC Cleared
7 21 (0.94%) AWS Certification
8 9 (0.40%) CISSP
8 9 (0.40%) CRISC
9 8 (0.36%) Numerate Degree
10 6 (0.27%) BPSS Clearance
11 5 (0.22%) DV Cleared
11 5 (0.22%) Microsoft Certification
12 3 (0.13%) CEH
12 3 (0.13%) CISA
12 3 (0.13%) CISM
12 3 (0.13%) ISO 27001 Lead Auditor
12 3 (0.13%) ITIL Certification
12 3 (0.13%) OCP
12 3 (0.13%) Oracle Certification
Quality Assurance & Compliance
1 178 (7.95%) Data Quality
2 79 (3.53%) QA
3 26 (1.16%) GDPR
4 12 (0.54%) ISO/IEC 27001
5 9 (0.40%) NIST
5 9 (0.40%) SLA
6 5 (0.22%) PCI DSS
7 4 (0.18%) Cyber Essentials
7 4 (0.18%) Cyber Essentials PLUS
8 3 (0.13%) ISO 15022
8 3 (0.13%) ISO 20022
9 2 (0.089%) Actionable Recommendations
10 1 (0.045%) MiFID
System Software
1 599 (26.74%) Docker
2 122 (5.45%) Apache Flume
3 33 (1.47%) HDFS
4 9 (0.40%) LXC
5 5 (0.22%) Apache ZooKeeper
6 3 (0.13%) VirtualBox
7 1 (0.045%) Virtual Machines
Systems Management
1 621 (27.72%) Kubernetes
2 347 (15.49%) Terraform
3 104 (4.64%) Oozie
4 93 (4.15%) Ansible
5 59 (2.63%) Prometheus
6 27 (1.21%) Grafana
7 24 (1.07%) Control-M
8 23 (1.03%) Puppet
9 18 (0.80%) Opscode Chef
10 16 (0.71%) Kibana
11 12 (0.54%) Kubeflow
12 9 (0.40%) Cisco IPCC
12 9 (0.40%) Consul
12 9 (0.40%) Hadoop YARN
13 8 (0.36%) Istio
14 7 (0.31%) Docker Swarm
15 4 (0.18%) logstash
15 4 (0.18%) Nagios
15 4 (0.18%) Single Sign-On
16 1 (0.045%) Mesos
Vendors
1 507 (22.63%) Google
2 434 (19.38%) Databricks
3 319 (14.24%) Microsoft
4 162 (7.23%) Oracle
5 135 (6.03%) Cloudera
6 91 (4.06%) Informatica
7 86 (3.84%) Talend
8 81 (3.62%) Splunk
9 73 (3.26%) Teradata
10 48 (2.14%) Foundry
10 48 (2.14%) Palantir
11 43 (1.92%) FIS
12 41 (1.83%) CA Agile Central
13 34 (1.52%) AppDynamics
14 33 (1.47%) BT
15 30 (1.34%) Salesforce.com
16 28 (1.25%) Funding Circle
17 23 (1.03%) CA
18 22 (0.98%) Hitachi
19 21 (0.94%) SAP