Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 15 June 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 15 June 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
UK > England
6 months to
15 Jun 2021		 Same period 2020 Same period 2019
Rank 232 248 228
Rank change year-on-year +16 -20 +11
Permanent jobs citing Apache Spark 1,330 1,070 2,044
As % of all permanent jobs advertised in England 1.48% 1.39% 1.54%
As % of the Application Platforms category 10.94% 9.74% 10.15%
Number of salaries quoted 897 786 1,659
10th Percentile £46,250 £48,750 £47,500
25th Percentile £56,250 £57,500 £56,370
Median annual salary (50th Percentile) £75,000 £75,000 £75,000
75th Percentile £92,500 £91,250 £95,000
90th Percentile £112,500 £115,000 £110,000
UK median annual salary £75,000 £75,000 £75,000

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for application platform skills.

All Application Platform Skills
England
Permanent vacancies with a requirement for application platform skills 12,154 10,981 20,130
As % of all permanent IT jobs advertised in England 13.55% 14.23% 15.14%
Number of salaries quoted 8,618 8,790 16,000
10th Percentile £31,250 £30,500 £28,375
25th Percentile £40,750 £39,000 £36,250
Median annual salary (50th Percentile) £55,000 £52,500 £50,500
Median % change year-on-year +4.76% +3.96% +1.00%
75th Percentile £73,750 £72,500 £70,000
90th Percentile £87,500 £87,500 £85,000
UK median annual salary £53,000 £52,500 £50,000
% change year-on-year +0.95% +5.00% -

Apache Spark
Job Vacancy Trend in England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in England.

Job vacancy trend for Apache Spark in England

Apache Spark
Salary Trend in England

3-month moving average salary quoted in jobs citing Apache Spark in England.

Salary trend for Apache Spark in England

Apache Spark
Salary Histogram in England

Salary distribution for jobs citing Apache Spark in England over the 6 months to 15 June 2021.

Salary histogram for Apache Spark in England

Apache Spark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the England region over the 6 months to 15 June 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London +18 931 £77,500 -3.13% 126
South East +42 192 £70,000 +3.70% 11
North of England +1 79 £60,000 +9.09% 14
South West -38 51 £68,608 +37.22% 1
Yorkshire -12 44 £57,500 +23.66% 6
East of England -7 35 £80,000 +6.67% 9
North West -12 33 £75,000 +25.00% 7
Midlands -73 26 £57,500 -23.33% 8
West Midlands -34 21 £60,000 +9.09% 5
East Midlands -64 5 £53,750 -28.33% 3
North East -13 2 £56,914 -1.02% 1
Apache Spark
UK

For the 6 months to 15 June 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Apache Spark.

1 879 (66.09%) Python
2 710 (53.38%) Big Data
3 697 (52.41%) AWS
4 678 (50.98%) Hadoop
5 641 (48.20%) SQL
6 630 (47.37%) Kafka
7 614 (46.17%) Java
8 530 (39.85%) Agile Software Development
9 487 (36.62%) Software Engineering
10 486 (36.54%) Analytics
11 449 (33.76%) Kubernetes
12 435 (32.71%) Azure
13 421 (31.65%) Data Pipeline
14 420 (31.58%) Docker
15 404 (30.38%) Finance
16 402 (30.23%) GCP
17 396 (29.77%) NoSQL
18 367 (27.59%) Data Science
19 341 (25.64%) DevOps
20 330 (24.81%) ETL
21 329 (24.74%) Scala
22 323 (24.29%) Microservices
23 322 (24.21%) Data Engineering
24 319 (23.98%) Apache
25 290 (21.80%) Jenkins
26 276 (20.75%) Machine Learning
27 270 (20.30%) Degree
28 253 (19.02%) Ansible
29 241 (18.12%) Computer Science
30 235 (17.67%) Artificial Intelligence

Apache Spark
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 319 (23.98%) Apache
2 147 (11.05%) Apache Airflow
3 103 (7.74%) Elasticsearch
4 95 (7.14%) GemFire
5 45 (3.38%) Luigi
6 38 (2.86%) Apache Pig
7 25 (1.88%) Cloud Foundry
8 21 (1.58%) SAS
9 20 (1.50%) Oracle Application Server
10 17 (1.28%) Oracle Workflow
11 16 (1.20%) Jupyter
12 8 (0.60%) Confluence
13 7 (0.53%) Apache Synapse
13 7 (0.53%) Tomcat
14 3 (0.23%) Apache Solr
14 3 (0.23%) DataSynapse
14 3 (0.23%) JBoss
14 3 (0.23%) Mule
15 2 (0.15%) WebSphere
16 1 (0.075%) WebLogic
Applications
1 8 (0.60%) SPSS
2 6 (0.45%) Gephi
3 5 (0.38%) Microsoft Excel
4 2 (0.15%) Microsoft Office
4 2 (0.15%) Microsoft PowerPoint
4 2 (0.15%) Spreadsheet
5 1 (0.075%) Microsoft Project
5 1 (0.075%) MS Visio
Business Applications
1 1 (0.075%) Dynamics CRM
1 1 (0.075%) Oracle Procure-to-Pay
1 1 (0.075%) SAP R/3
Cloud Services
1 697 (52.41%) AWS
2 435 (32.71%) Azure
3 402 (30.23%) GCP
4 141 (10.60%) Amazon Kinesis
5 130 (9.77%) Amazon EMR
6 125 (9.40%) Serverless
7 124 (9.32%) GitHub
8 118 (8.87%) Snowflake
9 72 (5.41%) IBM Cloud
10 65 (4.89%) Amazon EC2
11 63 (4.74%) Amazon S3
12 61 (4.59%) Power Platform
13 59 (4.44%) AWS Lambda
14 50 (3.76%) Amazon SageMaker
14 50 (3.76%) OpenShift
15 46 (3.46%) Azure Data Factory
16 45 (3.38%) Cloud Functions
17 31 (2.33%) Google Compute Engine
18 30 (2.26%) Google App Engine
18 30 (2.26%) Google Container Engine
Communications & Networking
1 21 (1.58%) Internet
2 15 (1.13%) Wireless
3 12 (0.90%) HTTP
4 11 (0.83%) Firewall
5 8 (0.60%) DNS
6 7 (0.53%) SSL
7 6 (0.45%) Ethernet
7 6 (0.45%) IMAP
7 6 (0.45%) Intrusion Detection
7 6 (0.45%) MPLS
7 6 (0.45%) SMTP
7 6 (0.45%) VPN
8 5 (0.38%) SMS
9 4 (0.30%) Broadband
10 3 (0.23%) 5G
11 2 (0.15%) Cisco IPT
11 2 (0.15%) DSL
11 2 (0.15%) TCP/IP
12 1 (0.075%) HTTPS
12 1 (0.075%) Network Security
Database & Business Intelligence
1 710 (53.38%) Big Data
2 678 (50.98%) Hadoop
3 396 (29.77%) NoSQL
4 227 (17.07%) Amazon Redshift
4 227 (17.07%) Data Warehouse
5 220 (16.54%) PostgreSQL
6 200 (15.04%) Apache Hive
7 191 (14.36%) Relational Database
8 182 (13.68%) HBase
9 172 (12.93%) Data Lake
10 121 (9.10%) MariaDB
11 120 (9.02%) Redis
12 114 (8.57%) Amazon Athena
13 110 (8.27%) MongoDB
14 95 (7.14%) Neo4j
15 83 (6.24%) BigQuery
16 79 (5.94%) Apache Cassandra
17 76 (5.71%) Electronic Patient Records
17 76 (5.71%) Flink
18 69 (5.19%) SQL Server
Development Applications
1 290 (21.80%) Jenkins
2 222 (16.69%) Git (software)
3 122 (9.17%) Gradle
4 110 (8.27%) Sonatype Nexus
5 104 (7.82%) Cypress.io
6 100 (7.52%) Cucumber
6 100 (7.52%) IntelliJ
7 98 (7.37%) Eclipse
8 97 (7.29%) JUnit
9 94 (7.07%) Mockito
10 93 (6.99%) Protractor
10 93 (6.99%) Storybook
11 76 (5.71%) Atlassian Bamboo
11 76 (5.71%) Vagrant
12 53 (3.98%) Artifactory
13 50 (3.76%) JIRA
14 41 (3.08%) SonarQube
15 30 (2.26%) Oracle APEX
16 26 (1.95%) Maven
17 20 (1.50%) GitLab
General
1 404 (30.38%) Finance
2 203 (15.26%) Banking
3 177 (13.31%) Social Skills
4 149 (11.20%) Analytical Skills
5 144 (10.83%) Law
6 78 (5.86%) Front Office
7 62 (4.66%) Retail
8 53 (3.98%) Marketing
9 47 (3.53%) Presentation Skills
10 34 (2.56%) Telecoms
11 29 (2.18%) Games
12 17 (1.28%) Influencing Skills
13 16 (1.20%) Advertising
14 15 (1.13%) Investment Banking
15 14 (1.05%) Retail Banking
16 12 (0.90%) Public Sector
17 9 (0.68%) Legal
17 9 (0.68%) Manufacturing
18 8 (0.60%) Publishing
19 6 (0.45%) Pharmaceutical
Job Titles
1 461 (34.66%) Data Engineer
2 271 (20.38%) Developer
3 237 (17.82%) Software Engineer
4 139 (10.45%) Architect
5 120 (9.02%) Big Data Engineer
5 120 (9.02%) Senior Data Engineer
6 100 (7.52%) Data Architect
7 95 (7.14%) AWS Engineer
8 94 (7.07%) Java Developer
9 86 (6.47%) Data Scientist
10 69 (5.19%) Platform Engineer
11 67 (5.04%) Principal Engineer
12 66 (4.96%) Python Engineer
13 64 (4.81%) Python Developer
14 60 (4.51%) Java Engineer
15 58 (4.36%) Principal Software Engineer
16 50 (3.76%) Cloud Engineer
17 44 (3.31%) Full Stack Developer
18 41 (3.08%) Java Software Engineer
19 39 (2.93%) JavaScript Developer
Libraries, Frameworks & Software Standards
1 630 (47.37%) Kafka
2 223 (16.77%) React
3 208 (15.64%) Spark Streaming
4 207 (15.56%) Spring
5 202 (15.19%) Node.js
6 197 (14.81%) AngularJS
7 137 (10.30%) RESTful
8 134 (10.08%) CSS
9 121 (9.10%) JSON
10 109 (8.20%) RabbitMQ
11 101 (7.59%) Spring Boot
12 100 (7.52%) Redux
13 94 (7.07%) Twitter Bootstrap
14 93 (6.99%) Express
14 93 (6.99%) Tailwind CSS
15 90 (6.77%) WireMock
16 87 (6.54%) REST
17 84 (6.32%) Web Services
18 82 (6.17%) Play Framework
19 64 (4.81%) .NET
Miscellaneous
1 114 (8.57%) Algorithms
2 96 (7.22%) Linux Command Line
2 96 (7.22%) User Experience
3 63 (4.74%) Data Structures
4 58 (4.36%) Hedge funds
5 55 (4.14%) Equities
5 55 (4.14%) Self-Motivation
6 43 (3.23%) Hybrid Cloud
7 33 (2.48%) Greenfield Project
8 21 (1.58%) Derivative
8 21 (1.58%) Foreign Exchange (FX)
9 19 (1.43%) Public Cloud
10 18 (1.35%) Virtual Team
11 15 (1.13%) NHS
12 14 (1.05%) Cloud Native
13 13 (0.98%) Social Network
14 10 (0.75%) Social Media
14 10 (0.75%) Video\Live Streaming
15 9 (0.68%) Data Centre
15 9 (0.68%) Management Information System
Operating Systems
1 185 (13.91%) Linux
2 159 (11.95%) Unix
3 8 (0.60%) Apple iOS
3 8 (0.60%) Windows
4 4 (0.30%) Red Hat Enterprise Linux
5 2 (0.15%) Android
5 2 (0.15%) Ubuntu
Processes & Methodologies
1 530 (39.85%) Agile Software Development
2 487 (36.62%) Software Engineering
3 486 (36.54%) Analytics
4 421 (31.65%) Data Pipeline
5 367 (27.59%) Data Science
6 341 (25.64%) DevOps
7 330 (24.81%) ETL
8 323 (24.29%) Microservices
9 322 (24.21%) Data Engineering
10 276 (20.75%) Machine Learning
11 241 (18.12%) Computer Science
12 235 (17.67%) Artificial Intelligence
13 201 (15.11%) Continuous Integration
14 171 (12.86%) Fintech
15 165 (12.41%) Data Modelling
15 165 (12.41%) Open Source
16 163 (12.26%) Business Intelligence
17 151 (11.35%) Visualisation
18 145 (10.90%) OO
19 123 (9.25%) Data Analytics
Programming Languages
1 879 (66.09%) Python
2 641 (48.20%) SQL
3 614 (46.17%) Java
4 329 (24.74%) Scala
5 181 (13.61%) JavaScript
6 148 (11.13%) C#
7 101 (7.59%) Shell Script
8 93 (6.99%) Groovy
9 83 (6.24%) R
10 46 (3.46%) C++
11 43 (3.23%) TypeScript
12 40 (3.01%) Go
13 38 (2.86%) C
14 37 (2.78%) PL/SQL
15 31 (2.33%) Bash Shell
16 27 (2.03%) Kotlin
17 26 (1.95%) Java 8
18 22 (1.65%) F#
19 21 (1.58%) T-SQL
20 20 (1.50%) ES6
Qualifications
1 270 (20.30%) Degree
2 90 (6.77%) OCP
2 90 (6.77%) Oracle Certification
3 82 (6.17%) Computer Science Degree
4 31 (2.33%) Security Cleared
5 22 (1.65%) PhD
6 14 (1.05%) SC Cleared
7 9 (0.68%) AWS Certification
7 9 (0.68%) DV Cleared
8 8 (0.60%) Cisco Certification
8 8 (0.60%) CISSP
8 8 (0.60%) Master's Degree
8 8 (0.60%) TOGAF Certification
9 6 (0.45%) CCNA
9 6 (0.45%) CEH
9 6 (0.45%) Linux+ Certification
9 6 (0.45%) MCSE
9 6 (0.45%) Microsoft Certification
9 6 (0.45%) Network+ Certification
9 6 (0.45%) SSCP
Quality Assurance & Compliance
1 68 (5.11%) Data Quality
2 57 (4.29%) QA
3 17 (1.28%) GDPR
4 3 (0.23%) PCI DSS
5 2 (0.15%) COBIT
5 2 (0.15%) ISO/IEC 27001
5 2 (0.15%) MiFID
5 2 (0.15%) NIST
System Software
1 420 (31.58%) Docker
2 121 (9.10%) HDFS
3 76 (5.71%) VirtualBox
4 66 (4.96%) VMware Infrastructure
5 18 (1.35%) Apache Flume
6 14 (1.05%) Apache ZooKeeper
7 4 (0.30%) Virtual Servers
8 1 (0.075%) Platform Symphony
Systems Management
1 449 (33.76%) Kubernetes
2 253 (19.02%) Ansible
3 213 (16.02%) Terraform
4 76 (5.71%) Docker Swarm
5 32 (2.41%) Opscode Chef
6 26 (1.95%) Hadoop YARN
7 22 (1.65%) Istio
8 19 (1.43%) Prometheus
9 18 (1.35%) Oozie
10 16 (1.20%) Puppet
11 11 (0.83%) Kibana
12 7 (0.53%) Ambari
13 6 (0.45%) Kubeflow
14 3 (0.23%) Grafana
14 3 (0.23%) logstash
15 2 (0.15%) Graphite
15 2 (0.15%) Nagios
15 2 (0.15%) Opsview
16 1 (0.075%) Mesos
16 1 (0.075%) Tivoli
Vendors
1 212 (15.94%) Google
2 145 (10.90%) Databricks
3 122 (9.17%) Cloudera
4 111 (8.35%) Talend
5 99 (7.44%) Hortonworks
6 97 (7.29%) Oracle
7 95 (7.14%) VMware
8 93 (6.99%) Okta
9 81 (6.09%) IBM
9 81 (6.09%) Informatica
10 64 (4.81%) Microsoft
11 19 (1.43%) Splunk
11 19 (1.43%) Teradata
12 12 (0.90%) Greenplum
12 12 (0.90%) Qubit
13 10 (0.75%) Alteryx
14 9 (0.68%) Cisco
14 9 (0.68%) SAP
15 8 (0.60%) Sybase
16 7 (0.53%) ESRI