Period
to 11 April 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 11 April 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
UK > England
6 months to
11 Apr 2021
Same period 2020 Same period 2019
Rank 246 243 229
Rank change year-on-year -3 -14 +3
Permanent jobs citing Apache Spark 971 1,451 2,106
As % of all permanent jobs advertised in England 1.32% 1.38% 1.53%
As % of the Application Platforms category 9.68% 9.71% 9.86%
Number of salaries quoted 769 1,116 1,718
10th Percentile £46,250 £47,500 £47,500
25th Percentile £55,000 £57,500 £57,500
Median annual salary (50th Percentile) £75,000 £72,500 £75,000
Median % change year-on-year +3.45% -3.33% +7.14%
75th Percentile £92,500 £87,500 £93,438
90th Percentile £111,250 £105,000 £107,500
UK median annual salary £75,000 £72,500 £75,000
% change year-on-year +3.45% -3.33% +7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for application platform skills.

All Application Platform Skills
England
Permanent vacancies with a requirement for application platform skills 10,032 14,943 21,350
As % of all permanent IT jobs advertised in England 13.59% 14.26% 15.48%
Number of salaries quoted 7,866 12,002 17,169
10th Percentile £31,250 £29,000 £28,375
25th Percentile £40,000 £37,500 £36,250
Median annual salary (50th Percentile) £55,000 £52,500 £50,000
Median % change year-on-year +4.76% +5.00% -
75th Percentile £72,500 £70,000 £70,000
90th Percentile £87,500 £85,000 £85,450
UK median annual salary £55,000 £50,000 £50,000
% change year-on-year +10.00% - +1.01%

Apache Spark
Job Vacancy Trend in England

Job postings citing Apache Spark as a proportion of all IT jobs advertised in England.

Job vacancy trend for Apache Spark in England

Apache Spark
Salary Trend in England

3-month moving average salary quoted in jobs citing Apache Spark in England.

Salary trend for Apache Spark in England

Apache Spark
Salary Histogram in England

Salary distribution for jobs citing Apache Spark in England over the 6 months to 11 April 2021.

Salary histogram for Apache Spark in England

Apache Spark
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the England region over the 6 months to 11 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +17 694 £77,500 +3.33% 117
North of England +40 85 £55,000 - 18
South East +13 74 £58,497 -10.00% 8
Yorkshire +29 47 £55,000 - 9
South West +18 47 £63,608 +21.16% 5
North West +37 38 £60,000 +20.00% 8
East of England +37 28 £65,000 -13.33% 6
Midlands -56 23 £67,500 -6.90% 9
West Midlands +14 15 £75,000 +36.36% 7
East Midlands -52 8 £65,000 -13.33% 2
Apache Spark
UK

For the 6 months to 11 April 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Apache Spark.

1 667 (68.69%) Python
2 512 (52.73%) Hadoop
3 505 (52.01%) Big Data
4 478 (49.23%) AWS
5 464 (47.79%) SQL
6 445 (45.83%) Kafka
7 382 (39.34%) Java
8 358 (36.87%) Azure
9 331 (34.09%) Docker
9 331 (34.09%) Kubernetes
10 326 (33.57%) Agile Software Development
11 298 (30.69%) Analytics
12 288 (29.66%) NoSQL
13 281 (28.94%) Data Science
14 266 (27.39%) GCP
15 264 (27.19%) Software Engineering
16 250 (25.75%) Scala
17 244 (25.13%) Finance
17 244 (25.13%) ETL
18 239 (24.61%) Machine Learning
19 235 (24.20%) Data Engineering
20 211 (21.73%) DevOps
21 191 (19.67%) Microservices
22 190 (19.57%) Apache
23 168 (17.30%) Data Warehouse
24 163 (16.79%) Artificial Intelligence
25 161 (16.58%) Terraform
25 161 (16.58%) Data Lake
26 155 (15.96%) Apache Hive
27 154 (15.86%) JavaScript

Apache Spark
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 190 (19.57%) Apache
2 95 (9.78%) Apache Airflow
3 69 (7.11%) Elasticsearch
4 45 (4.63%) Luigi
5 32 (3.30%) Apache Pig
6 21 (2.16%) SAS
7 16 (1.65%) Apache Synapse
8 14 (1.44%) GemFire
9 12 (1.24%) Oracle Workflow
10 10 (1.03%) Jupyter
11 8 (0.82%) Tornado
12 6 (0.62%) CMS
13 5 (0.51%) Tomcat
14 4 (0.41%) Confluence
15 2 (0.21%) BizTalk Server
15 2 (0.21%) DataSynapse
15 2 (0.21%) Oracle SOA Suite
16 1 (0.10%) ArcGIS
16 1 (0.10%) JBoss
16 1 (0.10%) WebSphere
Applications
1 16 (1.65%) Microsoft Excel
2 10 (1.03%) SPSS
3 6 (0.62%) Gephi
4 2 (0.21%) SPSS Modeler
5 1 (0.10%) Microsoft Office
5 1 (0.10%) Microsoft PowerPoint
Business Applications
1 2 (0.21%) Dynamics CRM
2 1 (0.10%) SAP APO
Cloud Services
1 478 (49.23%) AWS
2 358 (36.87%) Azure
3 266 (27.39%) GCP
4 86 (8.86%) Amazon EMR
5 78 (8.03%) Serverless
6 70 (7.21%) Amazon Kinesis
7 63 (6.49%) Power Platform
8 56 (5.77%) Amazon S3
9 47 (4.84%) GitHub
10 46 (4.74%) Azure Data Factory
11 43 (4.43%) IBM Cloud
12 39 (4.02%) AWS Lambda
13 27 (2.78%) Amazon EC2
14 26 (2.68%) Cloud Functions
15 25 (2.57%) Cloud Computing
16 23 (2.37%) PaaS
17 21 (2.16%) Amazon ECS
17 21 (2.16%) AWS CloudFormation
18 20 (2.06%) SaaS
19 16 (1.65%) Google Compute Engine
Communications & Networking
1 26 (2.68%) Firewall
2 23 (2.37%) HTTP
3 19 (1.96%) Internet
4 15 (1.54%) TCP/IP
5 14 (1.44%) DNS
6 9 (0.93%) VPN
7 8 (0.82%) Wireless
8 6 (0.62%) Ethernet
8 6 (0.62%) IMAP
8 6 (0.62%) Intrusion Detection
8 6 (0.62%) MPLS
8 6 (0.62%) SMTP
8 6 (0.62%) SSL
9 4 (0.41%) 802.11
9 4 (0.41%) Fibre Channel
9 4 (0.41%) FTP
9 4 (0.41%) LAN
9 4 (0.41%) SAN
9 4 (0.41%) SNMP
9 4 (0.41%) WAN
Database & Business Intelligence
1 512 (52.73%) Hadoop
2 505 (52.01%) Big Data
3 288 (29.66%) NoSQL
4 168 (17.30%) Data Warehouse
5 161 (16.58%) Data Lake
6 155 (15.96%) Apache Hive
7 144 (14.83%) Amazon Redshift
8 109 (11.23%) PostgreSQL
9 100 (10.30%) MongoDB
10 82 (8.44%) Amazon Athena
10 82 (8.44%) Apache Cassandra
11 76 (7.83%) Relational Database
12 72 (7.42%) SQL Server
13 70 (7.21%) HBase
14 68 (7.00%) BigQuery
15 62 (6.39%) Tableau
16 61 (6.28%) Power BI
17 55 (5.66%) Neo4j
18 48 (4.94%) Flink
19 47 (4.84%) Electronic Patient Records
Development Applications
1 138 (14.21%) Jenkins
2 111 (11.43%) Git (software)
3 44 (4.53%) Atlassian Bamboo
3 44 (4.53%) Vagrant
4 40 (4.12%) JIRA
5 30 (3.09%) Maven
5 30 (3.09%) Sonatype Nexus
6 22 (2.27%) Cucumber
6 22 (2.27%) Gradle
7 17 (1.75%) IntelliJ
8 15 (1.54%) Bitbucket
8 15 (1.54%) Cypress.io
8 15 (1.54%) Eclipse
9 13 (1.34%) JUnit
9 13 (1.34%) Mockito
9 13 (1.34%) Protractor
9 13 (1.34%) SonarQube
9 13 (1.34%) Storybook
10 12 (1.24%) TeamCity
11 10 (1.03%) GitLab
General
1 244 (25.13%) Finance
2 102 (10.50%) Banking
3 57 (5.87%) Retail
4 51 (5.25%) Front Office
5 39 (4.02%) Marketing
6 37 (3.81%) Telecoms
7 36 (3.71%) Law
8 31 (3.19%) Games
9 16 (1.65%) Advertising
10 14 (1.44%) Public Sector
11 10 (1.03%) Manufacturing
12 9 (0.93%) Investment Banking
13 8 (0.82%) Retail Banking
14 6 (0.62%) Electronics
14 6 (0.62%) Legal
15 4 (0.41%) Financial Institution
15 4 (0.41%) Publishing
16 2 (0.21%) Back Office
16 2 (0.21%) Billing
16 2 (0.21%) Czech Language
Job Titles
1 369 (38.00%) Data Engineer
2 230 (23.69%) Developer
3 109 (11.23%) Software Engineer
4 91 (9.37%) Architect
5 86 (8.86%) Big Data Engineer
6 79 (8.14%) Senior Data Engineer
7 73 (7.52%) AWS Engineer
8 72 (7.42%) Data Scientist
9 69 (7.11%) Java Developer
10 62 (6.39%) Python Developer
11 60 (6.18%) Data Architect
12 59 (6.08%) Java Engineer
13 58 (5.97%) Python Engineer
14 49 (5.05%) Full Stack Developer
15 44 (4.53%) Developer/Software Engineer
15 44 (4.53%) Platform Engineer
16 40 (4.12%) .NET Developer
17 39 (4.02%) Cloud Engineer
17 39 (4.02%) JavaScript Developer
18 37 (3.81%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 445 (45.83%) Kafka
2 124 (12.77%) React
3 106 (10.92%) Node.js
4 89 (9.17%) Spark Streaming
5 84 (8.65%) AngularJS
6 69 (7.11%) Spring
7 59 (6.08%) Spring Boot
8 56 (5.77%) REST
9 55 (5.66%) .NET
10 53 (5.46%) Web Services
11 52 (5.36%) PySpark
12 51 (5.25%) RESTful
13 45 (4.63%) Pandas
14 42 (4.33%) NumPy
14 42 (4.33%) TensorFlow
15 41 (4.22%) Vue.js
16 40 (4.12%) Natural Language Processing
17 39 (4.02%) KnockoutJS
18 38 (3.91%) CSS
19 37 (3.81%) .NET Core
Miscellaneous
1 92 (9.47%) Analytical Skills
2 81 (8.34%) Algorithms
3 37 (3.81%) Equities
4 35 (3.60%) Greenfield Project
4 35 (3.60%) Hedge funds
5 32 (3.30%) Data Structures
6 25 (2.57%) Hybrid Cloud
7 16 (1.65%) Cloud Native
7 16 (1.65%) Self-Motivation
7 16 (1.65%) User Experience
8 14 (1.44%) Linux Command Line
8 14 (1.44%) Market Risk
8 14 (1.44%) Video on Demand
9 13 (1.34%) Public Cloud
10 11 (1.13%) Internet of Things
11 10 (1.03%) Credit Risk
12 9 (0.93%) Foreign Exchange (FX)
12 9 (0.93%) Video\Live Streaming
13 8 (0.82%) Blog
14 7 (0.72%) NHS
Operating Systems
1 78 (8.03%) Linux
2 36 (3.71%) Unix
3 15 (1.54%) Ubuntu
4 8 (0.82%) Red Hat Enterprise Linux
4 8 (0.82%) Windows
5 4 (0.41%) CentOS
6 3 (0.31%) Oracle Linux
Processes & Methodologies
1 326 (33.57%) Agile Software Development
2 298 (30.69%) Analytics
3 281 (28.94%) Data Science
4 264 (27.19%) Software Engineering
5 244 (25.13%) ETL
6 239 (24.61%) Machine Learning
7 235 (24.20%) Data Engineering
8 211 (21.73%) DevOps
9 191 (19.67%) Microservices
10 163 (16.79%) Artificial Intelligence
11 138 (14.21%) Business Intelligence
12 130 (13.39%) Fintech
13 123 (12.67%) Continuous Integration
14 117 (12.05%) Data Modelling
15 113 (11.64%) Visualisation
16 107 (11.02%) Computer Science
17 93 (9.58%) Open Source
18 89 (9.17%) Data Analytics
19 81 (8.34%) Mathematics
20 79 (8.14%) Data Integration
Programming Languages
1 667 (68.69%) Python
2 464 (47.79%) SQL
3 382 (39.34%) Java
4 250 (25.75%) Scala
5 154 (15.86%) JavaScript
6 134 (13.80%) C#
7 85 (8.75%) R
8 39 (4.02%) C++
9 35 (3.60%) C
10 34 (3.50%) Go
11 33 (3.40%) Bash Shell
12 27 (2.78%) TypeScript
13 21 (2.16%) T-SQL
14 20 (2.06%) PHP
15 19 (1.96%) Kotlin
16 18 (1.85%) Shell Script
17 17 (1.75%) ES6
18 15 (1.54%) Perl
19 13 (1.34%) Groovy
20 12 (1.24%) Data Analysis Expressions (DAX)
Qualifications
1 131 (13.49%) Degree
2 48 (4.94%) Computer Science Degree
3 26 (2.68%) Security Cleared
4 17 (1.75%) PhD
5 13 (1.34%) OCP
5 13 (1.34%) Oracle Certification
6 9 (0.93%) DV Cleared
6 9 (0.93%) SC Cleared
7 7 (0.72%) Numerate Degree
7 7 (0.72%) TOGAF Certification
8 6 (0.62%) CCNA
8 6 (0.62%) Cisco Certification
8 6 (0.62%) CISSP
8 6 (0.62%) CompTIA Security+
8 6 (0.62%) MCSE
8 6 (0.62%) Microsoft Certification
8 6 (0.62%) Postgraduate
8 6 (0.62%) SANS
8 6 (0.62%) SSCP
8 6 (0.62%) Sun Certification
Quality Assurance & Compliance
1 57 (5.87%) QA
2 35 (3.60%) Data Quality
3 7 (0.72%) GDPR
4 1 (0.10%) ISO 9001
4 1 (0.10%) ISO/IEC 27001
System Software
1 331 (34.09%) Docker
2 44 (4.53%) HDFS
2 44 (4.53%) VirtualBox
3 15 (1.54%) Apache Flume
4 14 (1.44%) VMware Infrastructure
5 5 (0.51%) Apache ZooKeeper
6 3 (0.31%) Virtual Servers
7 1 (0.10%) NFS
7 1 (0.10%) oVirt
7 1 (0.10%) Platform Symphony
7 1 (0.10%) Virtual Machines
Systems Management
1 331 (34.09%) Kubernetes
2 161 (16.58%) Terraform
3 121 (12.46%) Ansible
4 44 (4.53%) Docker Swarm
5 29 (2.99%) Puppet
6 21 (2.16%) Oozie
7 18 (1.85%) Opscode Chef
8 15 (1.54%) Hadoop YARN
9 12 (1.24%) Prometheus
10 11 (1.13%) Nagios
11 8 (0.82%) Kibana
12 7 (0.72%) Graphite
12 7 (0.72%) Opsview
13 6 (0.62%) Kubeflow
14 4 (0.41%) Ambari
14 4 (0.41%) Istio
15 2 (0.21%) Grafana
16 1 (0.10%) ITRS Geneos
16 1 (0.10%) Mesos
16 1 (0.10%) SELinux
Vendors
1 139 (14.32%) Google
2 121 (12.46%) Databricks
3 96 (9.89%) Microsoft
4 84 (8.65%) Cloudera
5 74 (7.62%) Talend
6 59 (6.08%) Hortonworks
7 57 (5.87%) Oracle
8 49 (5.05%) IBM
8 49 (5.05%) Informatica
9 17 (1.75%) VMware
10 16 (1.65%) Teradata
11 15 (1.54%) Red Hat
12 14 (1.44%) SAP
13 13 (1.34%) Okta
13 13 (1.34%) Splunk
14 7 (0.72%) StreamSets
15 6 (0.62%) Alteryx
15 6 (0.62%) BT
15 6 (0.62%) ESRI
15 6 (0.62%) MuleSoft