Period
to 13 April 2021

The following table provides summary statistics for permanent job vacancies advertised in Yorkshire with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 13 April 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
England > Yorkshire
6 months to
13 Apr 2021
Same period 2020 Same period 2019
Rank 176 192 249
Rank change year-on-year +16 +57 +21
Permanent jobs citing Apache Spark 47 36 43
As % of all permanent jobs advertised in Yorkshire 0.98% 0.63% 0.58%
As % of the Application Platforms category 8.88% 4.86% 4.11%
Number of salaries quoted 34 27 34
10th Percentile £46,250 £44,750 £42,500
25th Percentile £50,000 £50,000 £43,750
Median annual salary (50th Percentile) £55,000 £55,000 £49,337
Median % change year-on-year - +11.48% -10.30%
75th Percentile £61,250 £70,625 £63,354
90th Percentile £71,250 £75,000 £89,995
England median annual salary £75,000 £72,500 £75,000
% change year-on-year +3.45% -3.33% +7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Yorkshire with a requirement for application platform skills.

All Application Platform Skills
Yorkshire
Permanent vacancies with a requirement for application platform skills 529 741 1,045
As % of all permanent IT jobs advertised in Yorkshire 11.01% 13.06% 14.01%
Number of salaries quoted 420 620 819
10th Percentile £26,250 £27,500 £25,000
25th Percentile £32,500 £32,500 £31,250
Median annual salary (50th Percentile) £42,500 £45,000 £39,000
Median % change year-on-year -5.56% +15.38% -2.50%
75th Percentile £60,000 £57,500 £50,000
90th Percentile £72,500 £69,000 £57,500
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% -

Apache Spark
Job Vacancy Trend in Yorkshire

Job postings citing Apache Spark as a proportion of all IT jobs advertised in Yorkshire.

Job vacancy trend for Apache Spark in Yorkshire

Apache Spark
Salary Trend in Yorkshire

3-month moving average salary quoted in jobs citing Apache Spark in Yorkshire.

Salary trend for Apache Spark in Yorkshire

Apache Spark
Salary Histogram in Yorkshire

Salary distribution for jobs citing Apache Spark in Yorkshire over the 6 months to 13 April 2021.

Salary histogram for Apache Spark in Yorkshire

Apache Spark
Job Locations in Yorkshire

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the Yorkshire region over the 6 months to 13 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
West Yorkshire +40 47 £55,000 - 8
Apache Spark
England

For the 6 months to 13 April 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Yorkshire region with a requirement for Apache Spark.

1 39 (82.98%) Big Data
2 38 (80.85%) Python
3 33 (70.21%) SQL
4 30 (63.83%) AWS
4 30 (63.83%) Data Engineering
5 27 (57.45%) Azure
6 24 (51.06%) Kafka
7 23 (48.94%) Hadoop
8 22 (46.81%) Databricks
9 19 (40.43%) Agile Software Development
10 18 (38.30%) Kubernetes
10 18 (38.30%) Data Lake
11 17 (36.17%) Docker
11 17 (36.17%) ETL
12 16 (34.04%) Data Warehouse
12 16 (34.04%) DevOps
13 14 (29.79%) Business Intelligence
14 13 (27.66%) Apache
14 13 (27.66%) SQL Server Integration Services
14 13 (27.66%) GCP
15 12 (25.53%) Jenkins
15 12 (25.53%) Azure SQL Database
15 12 (25.53%) SQL Server Analysis Services
15 12 (25.53%) Scala
15 12 (25.53%) Terraform
16 11 (23.40%) Power BI
16 11 (23.40%) Serverless
16 11 (23.40%) Power Platform
16 11 (23.40%) Data Modelling
16 11 (23.40%) TDD

Apache Spark
Co-occurring IT Skills in Yorkshire by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 13 (27.66%) Apache
2 7 (14.89%) Apache Synapse
3 3 (6.38%) Apache Airflow
4 2 (4.26%) Luigi
5 1 (2.13%) Elasticsearch
5 1 (2.13%) Jupyter
Cloud Services
1 30 (63.83%) AWS
2 27 (57.45%) Azure
3 13 (27.66%) GCP
4 11 (23.40%) Power Platform
4 11 (23.40%) Serverless
5 8 (17.02%) Azure Data Factory
6 5 (10.64%) AWS CloudFormation
6 5 (10.64%) Azure Functions
6 5 (10.64%) SaaS
7 3 (6.38%) AWS Lambda
8 2 (4.26%) Amazon Kinesis
9 1 (2.13%) Amazon EC2
9 1 (2.13%) Amazon EMR
9 1 (2.13%) Amazon S3
9 1 (2.13%) Azure Machine Learning
Database & Business Intelligence
1 39 (82.98%) Big Data
2 23 (48.94%) Hadoop
3 18 (38.30%) Data Lake
4 16 (34.04%) Data Warehouse
5 13 (27.66%) SQL Server Integration Services
6 12 (25.53%) Azure SQL Database
6 12 (25.53%) SQL Server Analysis Services
7 11 (23.40%) Apache Hive
7 11 (23.40%) HBase
7 11 (23.40%) Power BI
8 10 (21.28%) PostgreSQL
9 9 (19.15%) NoSQL
10 7 (14.89%) Azure SQL Data Warehouse
10 7 (14.89%) Relational Database
10 7 (14.89%) SQL Server
10 7 (14.89%) SQL Server Reporting Services
10 7 (14.89%) Sqoop
11 6 (12.77%) Spark SQL
12 5 (10.64%) BigQuery
12 5 (10.64%) Enterprise Data Warehouse
Development Applications
1 12 (25.53%) Jenkins
2 8 (17.02%) Git (software)
3 7 (14.89%) Maven
4 5 (10.64%) Cucumber
4 5 (10.64%) Gradle
4 5 (10.64%) SonarQube
5 1 (2.13%) RStudio
General
1 8 (17.02%) Finance
2 5 (10.64%) Banking
2 5 (10.64%) Games
3 3 (6.38%) Retail
4 2 (4.26%) Public Sector
5 1 (2.13%) Billing
Job Titles
1 24 (51.06%) Data Engineer
2 7 (14.89%) DevOps Engineer
3 5 (10.64%) Architect
3 5 (10.64%) Azure Architect
3 5 (10.64%) Azure Engineer
3 5 (10.64%) Cloud Engineer
3 5 (10.64%) Java Engineer
3 5 (10.64%) Java Software Engineer
3 5 (10.64%) Software Engineer
4 4 (8.51%) AWS Engineer
5 3 (6.38%) Python Engineer
5 3 (6.38%) Senior DevOps
5 3 (6.38%) Senior DevOps Engineer
6 2 (4.26%) Big Data Engineer
6 2 (4.26%) Data Scientist
6 2 (4.26%) Scala Engineer
7 1 (2.13%) Business Intelligence Analyst
7 1 (2.13%) Hadoop Engineer
7 1 (2.13%) Senior Data Engineer
7 1 (2.13%) Tableau Analyst
Libraries, Frameworks & Software Standards
1 24 (51.06%) Kafka
2 7 (14.89%) Web Services
3 6 (12.77%) PySpark
4 5 (10.64%) EDI
4 5 (10.64%) JSON
4 5 (10.64%) Spring
4 5 (10.64%) Spring Boot
4 5 (10.64%) Swagger
4 5 (10.64%) XML
5 4 (8.51%) Pandas
6 2 (4.26%) Natural Language Processing
6 2 (4.26%) Spark Streaming
7 1 (2.13%) Matplotlib
7 1 (2.13%) NLTK
7 1 (2.13%) scikit-learn
7 1 (2.13%) Seaborn
7 1 (2.13%) SpaCy
Miscellaneous
1 4 (8.51%) Analytical Skills
2 1 (2.13%) Data Structures
Operating Systems
1 7 (14.89%) Linux
1 7 (14.89%) Red Hat Enterprise Linux
Processes & Methodologies
1 30 (63.83%) Data Engineering
2 19 (40.43%) Agile Software Development
3 17 (36.17%) ETL
4 16 (34.04%) DevOps
5 14 (29.79%) Business Intelligence
6 11 (23.40%) Data Modelling
6 11 (23.40%) TDD
7 10 (21.28%) Analytics
8 9 (19.15%) Software Engineering
9 7 (14.89%) Configuration Management
9 7 (14.89%) Data Governance
9 7 (14.89%) Data Integration
9 7 (14.89%) SDLC
9 7 (14.89%) Software Delivery
9 7 (14.89%) Visualisation
10 6 (12.77%) Data Migration
10 6 (12.77%) Event-Driven Architecture
10 6 (12.77%) Migration
11 5 (10.64%) Data Architecture
11 5 (10.64%) Data Munging
Programming Languages
1 38 (80.85%) Python
2 33 (70.21%) SQL
3 12 (25.53%) Scala
4 11 (23.40%) T-SQL
5 8 (17.02%) Java
6 7 (14.89%) Bash Shell
6 7 (14.89%) R
7 6 (12.77%) C#
8 5 (10.64%) Data Analysis Expressions (DAX)
8 5 (10.64%) JavaScript
8 5 (10.64%) PL/SQL
9 2 (4.26%) C++
Qualifications
1 1 (2.13%) Degree
1 1 (2.13%) Postgraduate
Quality Assurance & Compliance
1 5 (10.64%) Data Quality
System Software
1 17 (36.17%) Docker
2 10 (21.28%) HDFS
Systems Management
1 18 (38.30%) Kubernetes
2 12 (25.53%) Terraform
3 8 (17.02%) Hadoop YARN
4 7 (14.89%) Ansible
4 7 (14.89%) Graphite
4 7 (14.89%) Nagios
4 7 (14.89%) Opscode Chef
4 7 (14.89%) Opsview
4 7 (14.89%) Puppet
5 2 (4.26%) Oozie
Vendors
1 22 (46.81%) Databricks
2 7 (14.89%) Microsoft
3 1 (2.13%) Google