Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 18 January 2022

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 18 January 2022 with a comparison to the same period in the previous 2 years.

Apache Spark
UK > England
6 months to
18 Jan 2022		 Same period 2021 Same period 2020
Rank 258 257 238
Rank change year-on-year -1 -19 +3
Permanent jobs citing Apache Spark 1,513 719 1,675
As % of all permanent jobs advertised in England 1.37% 1.28% 1.44%
As % of the Application Platforms category 10.53% 9.16% 9.93%
Number of salaries quoted 771 594 1,382
10th Percentile £52,500 £45,225 £48,750
25th Percentile £60,938 £52,500 £57,500
Median annual salary (50th Percentile) £80,000 £70,000 £72,500
Median % change year-on-year +14.29% -3.45% -
75th Percentile £96,500 £90,000 £87,500
90th Percentile £115,000 £105,000 £106,000
UK median annual salary £77,500 £67,500 £72,500
% change year-on-year +14.81% -6.90% -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for application platform skills.

All Application Platform Skills
England
Permanent vacancies with a requirement for application platform skills 14,373 7,853 16,868
As % of all permanent IT jobs advertised in England 13.02% 14.03% 14.54%
Number of salaries quoted 9,416 6,452 13,711
10th Percentile £30,000 £31,250 £27,500
25th Percentile £40,000 £40,000 £36,250
Median annual salary (50th Percentile) £55,000 £55,000 £50,000
Median % change year-on-year - +10.00% -
75th Percentile £75,000 £72,500 £70,000
90th Percentile £92,500 £87,500 £85,000
UK median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% -

Apache Spark
Job Vacancy Trend in England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in England.

Job vacancy trend for Apache Spark in England

Apache Spark
Salary Trend in England

3-month moving average salary quoted in jobs citing Apache Spark in England.

Salary trend for Apache Spark in England

Apache Spark
Salary Histogram in England

Salary distribution for jobs citing Apache Spark in England over the 6 months to 18 January 2022.

Salary histogram for Apache Spark in England

Apache Spark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the England region over the 6 months to 18 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -47 976 £80,000 +3.23% 103
South East +18 214 £72,500 +45.00% 20
North of England -87 98 £61,250 +11.36% 22
East of England -33 72 £47,500 -26.92% 8
Midlands -42 72 £65,000 - 10
North West -56 64 £70,000 +27.27% 9
East Midlands -24 44 £60,000 -9.43% 4
Yorkshire -74 31 £52,500 -4.55% 11
West Midlands -43 28 £92,500 +68.18% 6
South West -61 22 £72,500 +34.88% 4
North East - 3 £55,000 - 2
Apache Spark
UK

For the 6 months to 18 January 2022, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Apache Spark.

1 1,098 (72.57%) Python
2 779 (51.49%) AWS
3 751 (49.64%) Java
4 742 (49.04%) Big Data
5 719 (47.52%) Kafka
6 693 (45.80%) Analytics
7 685 (45.27%) SQL
8 681 (45.01%) Hadoop
9 619 (40.91%) Agile Software Development
10 600 (39.66%) Data Science
11 518 (34.24%) Azure
12 493 (32.58%) Scala
12 493 (32.58%) GCP
13 481 (31.79%) DevOps
14 441 (29.15%) Machine Learning
15 426 (28.16%) Software Engineering
16 421 (27.83%) Finance
17 408 (26.97%) NoSQL
18 395 (26.11%) Data Pipeline
19 385 (25.45%) Kubernetes
20 361 (23.86%) Data Engineering
21 357 (23.60%) Social Skills
22 343 (22.67%) Apache
23 339 (22.41%) Computer Science
24 335 (22.14%) Docker
25 327 (21.61%) Degree
25 327 (21.61%) ETL
26 320 (21.15%) Microservices
27 309 (20.42%) Data Warehouse
28 299 (19.76%) Artificial Intelligence

Apache Spark
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 343 (22.67%) Apache
2 206 (13.62%) Apache Airflow
3 132 (8.72%) Elasticsearch
4 60 (3.97%) GemFire
5 39 (2.58%) Confluence
6 34 (2.25%) Apache Pig
6 34 (2.25%) Luigi
7 28 (1.85%) Jupyter
8 23 (1.52%) Apache Solr
9 20 (1.32%) Cloud Foundry
10 17 (1.12%) SAS
11 12 (0.79%) Apache Pulsar
12 8 (0.53%) Oracle Workflow
13 7 (0.46%) Oracle SOA Suite
14 6 (0.40%) Apache Synapse
15 5 (0.33%) nginx
15 5 (0.33%) Tornado
16 4 (0.26%) Tomcat
17 1 (0.066%) CMS
17 1 (0.066%) JBoss
Applications
1 4 (0.26%) Microsoft Excel
1 4 (0.26%) Microsoft PowerPoint
2 3 (0.20%) Spreadsheet
3 2 (0.13%) Photoshop
4 1 (0.066%) Adobe Illustrator
4 1 (0.066%) Chatbot
4 1 (0.066%) Fireworks
4 1 (0.066%) Microsoft Office
4 1 (0.066%) SPSS
Business Applications
1 2 (0.13%) SAP S/4HANA
2 1 (0.066%) Oracle Procure-to-Pay
2 1 (0.066%) SAP Oil and Gas
2 1 (0.066%) SAP R/3
Cloud Services
1 779 (51.49%) AWS
2 518 (34.24%) Azure
3 493 (32.58%) GCP
4 207 (13.68%) Amazon S3
5 180 (11.90%) Amazon Kinesis
6 163 (10.77%) Serverless
7 159 (10.51%) Amazon EMR
8 132 (8.72%) GitHub
9 112 (7.40%) Snowflake
10 109 (7.20%) Power Platform
11 91 (6.01%) Amazon EC2
12 90 (5.95%) AWS Lambda
13 67 (4.43%) Azure Synapse Analytics
14 62 (4.10%) Azure Data Factory
15 58 (3.83%) AWS CloudFormation
16 52 (3.44%) Azure Cosmos DB
17 47 (3.11%) Azure Functions
17 47 (3.11%) SaaS
18 43 (2.84%) Amazon CloudWatch
19 40 (2.64%) OpenShift
Communications & Networking
1 27 (1.78%) Wireless
2 24 (1.59%) HTTP
3 22 (1.45%) Internet
4 14 (0.93%) Cisco IPT
5 11 (0.73%) SSH
6 7 (0.46%) DNS
7 6 (0.40%) DHCP
7 6 (0.40%) HTTPS
7 6 (0.40%) IPv4
7 6 (0.40%) IPv6
7 6 (0.40%) SMTP
7 6 (0.40%) SNMP
7 6 (0.40%) TCP/IP
8 4 (0.26%) Broadband
8 4 (0.26%) Kerberos
9 3 (0.20%) Reverse Proxy
9 3 (0.20%) SMS
10 1 (0.066%) Cisco ASA
10 1 (0.066%) Network Security
10 1 (0.066%) WAN
Database & Business Intelligence
1 742 (49.04%) Big Data
2 681 (45.01%) Hadoop
3 408 (26.97%) NoSQL
4 309 (20.42%) Data Warehouse
5 280 (18.51%) Data Lake
6 247 (16.33%) Apache Hive
7 203 (13.42%) HBase
8 185 (12.23%) PostgreSQL
9 171 (11.30%) Relational Database
10 164 (10.84%) Amazon Redshift
10 164 (10.84%) MongoDB
11 155 (10.24%) Apache Cassandra
12 144 (9.52%) BigQuery
13 136 (8.99%) MySQL
14 135 (8.92%) Flink
15 119 (7.87%) Amazon DynamoDB
16 106 (7.01%) Power BI
17 100 (6.61%) Tableau
18 96 (6.35%) Redis
19 81 (5.35%) MariaDB
Development Applications
1 246 (16.26%) Jenkins
2 218 (14.41%) Git (software)
3 73 (4.82%) JUnit
4 71 (4.69%) Sonatype Nexus
5 68 (4.49%) Gradle
6 64 (4.23%) Eclipse
7 63 (4.16%) IntelliJ
8 61 (4.03%) JIRA
9 60 (3.97%) Cucumber
9 60 (3.97%) Cypress.io
10 58 (3.83%) Mockito
10 58 (3.83%) Protractor
10 58 (3.83%) Storybook
11 48 (3.17%) Artifactory
12 39 (2.58%) SonarQube
13 38 (2.51%) CircleCI
14 26 (1.72%) Atlassian Bamboo
14 26 (1.72%) Bitbucket
15 24 (1.59%) GitLab
16 18 (1.19%) kappa
General
1 421 (27.83%) Finance
2 357 (23.60%) Social Skills
3 185 (12.23%) Banking
4 178 (11.76%) Inclusion and Diversity
5 143 (9.45%) Analytical Skills
6 123 (8.13%) Retail
7 117 (7.73%) Law
8 106 (7.01%) Marketing
9 79 (5.22%) Games
10 57 (3.77%) Presentation Skills
11 49 (3.24%) Pharmaceutical
12 42 (2.78%) Manufacturing
13 41 (2.71%) Telecoms
14 33 (2.18%) Legal
15 32 (2.12%) Advertising
16 29 (1.92%) Front Office
17 28 (1.85%) Publishing
18 26 (1.72%) Public Sector
19 25 (1.65%) Investment Banking
20 16 (1.06%) Financial Institution
Job Titles
1 580 (38.33%) Data Engineer
2 182 (12.03%) Software Engineer
3 155 (10.24%) Developer
4 141 (9.32%) Senior Data Engineer
5 120 (7.93%) Architect
6 118 (7.80%) Data Scientist
7 96 (6.35%) Data Architect
8 73 (4.82%) Python Engineer
9 72 (4.76%) Principal Engineer
10 71 (4.69%) Big Data Engineer
11 67 (4.43%) Senior Software Engineer
12 64 (4.23%) Cloud Engineer
13 62 (4.10%) Java Developer
14 57 (3.77%) AWS Engineer
15 53 (3.50%) Java Engineer
16 48 (3.17%) Data Manager
17 47 (3.11%) Senior Developer
18 39 (2.58%) Senior Data Scientist
19 38 (2.51%) Software Developer
20 36 (2.38%) Lead Developer
Libraries, Frameworks & Software Standards
1 719 (47.52%) Kafka
2 163 (10.77%) Spring
3 136 (8.99%) React
4 122 (8.06%) Node.js
5 113 (7.47%) RabbitMQ
6 108 (7.14%) Apache Beam
7 96 (6.35%) AngularJS
8 93 (6.15%) PySpark
9 92 (6.08%) Spark Streaming
10 88 (5.82%) JSON
10 88 (5.82%) REST
11 87 (5.75%) TensorFlow
12 82 (5.42%) CSS
12 82 (5.42%) RESTful
13 78 (5.16%) Spring Boot
14 77 (5.09%) Play Framework
15 65 (4.30%) Redux
16 58 (3.83%) Express
16 58 (3.83%) Tailwind CSS
16 58 (3.83%) Twitter Bootstrap
Miscellaneous
1 168 (11.10%) Algorithms
2 76 (5.02%) User Experience
3 72 (4.76%) Virtual Team
4 69 (4.56%) Linux Command Line
4 69 (4.56%) Self-Motivation
5 67 (4.43%) Cloud Native
5 67 (4.43%) Data Structures
6 43 (2.84%) Life Science
7 40 (2.64%) Greenfield Project
8 39 (2.58%) Hybrid Cloud
9 33 (2.18%) Management Information System
9 33 (2.18%) Public Cloud
10 27 (1.78%) Blog
10 27 (1.78%) Enterprise Software
11 26 (1.72%) Social Media
12 25 (1.65%) Data Centre
13 22 (1.45%) Equities
14 14 (0.93%) Internet of Things
15 13 (0.86%) Hedge funds
16 11 (0.73%) Derivative
Operating Systems
1 183 (12.10%) Linux
2 155 (10.24%) Unix
3 19 (1.26%) Windows
4 11 (0.73%) Red Hat Enterprise Linux
5 8 (0.53%) Kali Linux
6 4 (0.26%) DC/OS
7 2 (0.13%) Android
7 2 (0.13%) Apple iOS
7 2 (0.13%) Windows Server
8 1 (0.066%) Windows Server 2012
Processes & Methodologies
1 693 (45.80%) Analytics
2 619 (40.91%) Agile Software Development
3 600 (39.66%) Data Science
4 481 (31.79%) DevOps
5 441 (29.15%) Machine Learning
6 426 (28.16%) Software Engineering
7 395 (26.11%) Data Pipeline
8 361 (23.86%) Data Engineering
9 339 (22.41%) Computer Science
10 327 (21.61%) ETL
11 320 (21.15%) Microservices
12 299 (19.76%) Artificial Intelligence
13 297 (19.63%) Data Modelling
14 264 (17.45%) Data Management
15 216 (14.28%) Business Intelligence
16 205 (13.55%) Visualisation
17 196 (12.95%) Data Analytics
18 179 (11.83%) Scrum
19 177 (11.70%) OO
20 174 (11.50%) Continuous Integration
Programming Languages
1 1,098 (72.57%) Python
2 751 (49.64%) Java
3 685 (45.27%) SQL
4 493 (32.58%) Scala
5 166 (10.97%) R
6 108 (7.14%) JavaScript
7 100 (6.61%) Shell Script
8 93 (6.15%) C#
9 79 (5.22%) Go
10 70 (4.63%) Groovy
11 68 (4.49%) Bash
11 68 (4.49%) C++
12 58 (3.83%) PowerShell
13 46 (3.04%) TypeScript
14 40 (2.64%) C
15 31 (2.05%) MATLAB
16 25 (1.65%) Java 8
17 20 (1.32%) Kotlin
18 19 (1.26%) T-SQL
19 16 (1.06%) Julia
Qualifications
1 327 (21.61%) Degree
2 131 (8.66%) Computer Science Degree
3 55 (3.64%) OCP
3 55 (3.64%) Oracle Certification
4 45 (2.97%) PhD
5 38 (2.51%) Master's Degree
6 27 (1.78%) AWS Certification
7 22 (1.45%) Security Cleared
8 15 (0.99%) CISSP
9 14 (0.93%) (ISC)2 CCSP
9 14 (0.93%) CCSP
9 14 (0.93%) Cisco Certification
10 13 (0.86%) SC Cleared
11 8 (0.53%) Numerate Degree
12 4 (0.26%) DV Cleared
12 4 (0.26%) Microsoft Certification
12 4 (0.26%) TOGAF Certification
13 3 (0.20%) MCSA
14 2 (0.13%) CCA
15 1 (0.066%) PMP
Quality Assurance & Compliance
1 100 (6.61%) Data Quality
2 51 (3.37%) QA
3 27 (1.78%) GDPR
3 27 (1.78%) GxP
4 8 (0.53%) PCI DSS
5 4 (0.26%) PMO
6 3 (0.20%) IFRS
6 3 (0.20%) IFRS 9
6 3 (0.20%) Sarbanes-Oxley
7 2 (0.13%) CRD IV
7 2 (0.13%) ISO 8583
8 1 (0.066%) Dodd-Frank
8 1 (0.066%) EMIR
8 1 (0.066%) FATCA
8 1 (0.066%) ISO/IEC 27001
8 1 (0.066%) MiFID
8 1 (0.066%) SLA
System Software
1 335 (22.14%) Docker
2 101 (6.68%) HDFS
3 48 (3.17%) VMware Infrastructure
4 22 (1.45%) Apache Flume
5 16 (1.06%) Apache ZooKeeper
6 11 (0.73%) VirtualBox
7 9 (0.59%) LXC
8 4 (0.26%) Active Directory
8 4 (0.26%) Ceph
8 4 (0.26%) NFS
9 2 (0.13%) Samba
10 1 (0.066%) etcd
Systems Management
1 385 (25.45%) Kubernetes
2 191 (12.62%) Ansible
3 165 (10.91%) Terraform
4 47 (3.11%) Opscode Chef
5 43 (2.84%) Oozie
6 36 (2.38%) Puppet
7 25 (1.65%) Prometheus
8 19 (1.26%) Grafana
9 18 (1.19%) Istio
10 15 (0.99%) Mesos
11 14 (0.93%) Hadoop YARN
12 11 (0.73%) Docker Swarm
13 10 (0.66%) Control-M
14 9 (0.59%) Cisco IPCC
15 7 (0.46%) Kibana
16 6 (0.40%) Consul
17 5 (0.33%) Kubeflow
18 4 (0.26%) Apache Brooklyn
18 4 (0.26%) Marathon
18 4 (0.26%) Rundeck
Vendors
1 219 (14.47%) Google
2 217 (14.34%) Databricks
3 130 (8.59%) Microsoft
4 100 (6.61%) Oracle
5 78 (5.16%) Cloudera
6 60 (3.97%) VMware
7 58 (3.83%) Okta
8 55 (3.64%) Hortonworks
9 44 (2.91%) Informatica
10 40 (2.64%) Talend
11 27 (1.78%) Apple
12 26 (1.72%) Facebook
13 22 (1.45%) Splunk
14 21 (1.39%) SAP
15 20 (1.32%) BEA
15 20 (1.32%) CrowdStrike
15 20 (1.32%) Spotify
16 19 (1.26%) IBM
17 18 (1.19%) StreamSets
17 18 (1.19%) Teradata