Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 20 October 2021

The following table provides summary statistics for permanent job vacancies advertised in the Midlands with a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 20 October 2021 with a comparison to the same period in the previous 2 years.

Apache Spark
England > Midlands
6 months to
20 Oct 2021		 Same period 2020 Same period 2019
Rank 276 189 249
Rank change year-on-year -87 +60 +20
Permanent jobs citing Apache Spark 53 15 83
As % of all permanent jobs advertised in the Midlands 0.50% 0.38% 0.74%
As % of the Application Platforms category 4.37% 3.32% 5.68%
Number of salaries quoted 37 11 74
10th Percentile £37,500 £45,000 £53,250
25th Percentile £48,750 £68,125 £56,250
Median annual salary (50th Percentile) £60,000 £75,000 £63,750
Median % change year-on-year -20.00% +17.65% -12.07%
75th Percentile £85,000 £105,000 £73,750
90th Percentile £102,500 " £75,875
England median annual salary £80,000 £72,500 £75,000
% change year-on-year +10.34% -3.33% +7.14%

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the Midlands with a requirement for application platform skills.

All Application Platform Skills
Midlands
Permanent vacancies with a requirement for application platform skills 1,214 452 1,460
As % of all permanent IT jobs advertised in the Midlands 11.46% 11.31% 13.05%
Number of salaries quoted 924 343 1,215
10th Percentile £26,250 £25,000 £25,500
25th Percentile £32,500 £31,250 £30,875
Median annual salary (50th Percentile) £44,719 £42,500 £40,000
Median % change year-on-year +5.22% +6.25% -
75th Percentile £56,375 £57,500 £53,750
90th Percentile £68,750 £66,150 £65,000
England median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% -

Apache Spark
Job Vacancy Trend in the Midlands

Job postings citing Apache Spark as a proportion of all IT jobs advertised in the Midlands.

Job vacancy trend for Apache Spark in the Midlands

Apache Spark
Salary Trend in the Midlands

3-month moving average salary quoted in jobs citing Apache Spark in the Midlands.

Salary trend for Apache Spark in the Midlands

Apache Spark
Salary Histogram in the Midlands

Salary distribution for jobs citing Apache Spark in the Midlands over the 6 months to 20 October 2021.

Salary histogram for Apache Spark in the Midlands

Apache Spark
Job Locations in the Midlands

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Spark within the Midlands region over the 6 months to 20 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
West Midlands -72 36 £70,000 +40.00% 3
East Midlands -68 17 £52,500 -40.00% 9
Apache Spark
England

For the 6 months to 20 October 2021, IT jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Midlands region with a requirement for Apache Spark.

1 32 (60.38%) Analytics
2 31 (58.49%) Kafka
2 31 (58.49%) Hadoop
3 30 (56.60%) Java
4 28 (52.83%) SQL
4 28 (52.83%) Python
5 23 (43.40%) Big Data
6 20 (37.74%) DevOps
6 20 (37.74%) Apache
7 19 (35.85%) NoSQL
7 19 (35.85%) Agile Software Development
8 18 (33.96%) Finance
9 17 (32.08%) AWS
10 14 (26.42%) Computer Science
11 13 (24.53%) Degree
12 12 (22.64%) Continuous Integration
12 12 (22.64%) Apache Hive
12 12 (22.64%) GCP
12 12 (22.64%) Terraform
13 11 (20.75%) Microservices
13 11 (20.75%) OO
13 11 (20.75%) RabbitMQ
13 11 (20.75%) Social Skills
13 11 (20.75%) Data Pipeline
14 10 (18.87%) Scala
14 10 (18.87%) Spring
14 10 (18.87%) Data Warehouse
14 10 (18.87%) Data Modelling
14 10 (18.87%) Scrum
14 10 (18.87%) Data Analytics

Apache Spark
Co-occurring IT Skills in the Midlands by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 20 (37.74%) Apache
2 7 (13.21%) SAS
3 5 (9.43%) Apache Airflow
4 4 (7.55%) Luigi
5 3 (5.66%) Elasticsearch
5 3 (5.66%) SharePoint
6 1 (1.89%) Apache Solr
6 1 (1.89%) Apache Synapse
Cloud Services
1 17 (32.08%) AWS
2 12 (22.64%) GCP
3 7 (13.21%) Azure
4 6 (11.32%) Amazon S3
5 5 (9.43%) Amazon CloudWatch
5 5 (9.43%) Amazon EC2
5 5 (9.43%) AWS CloudFormation
5 5 (9.43%) Serverless
6 4 (7.55%) Amazon ECS
6 4 (7.55%) Amazon ELB
6 4 (7.55%) Virtual Private Cloud
7 3 (5.66%) Azure Synapse Analytics
7 3 (5.66%) Power Platform
8 2 (3.77%) Amazon EMR
8 2 (3.77%) Amazon Kinesis
8 2 (3.77%) Azure Data Factory
8 2 (3.77%) Azure Data Lake Analytics
8 2 (3.77%) SaaS
9 1 (1.89%) Amazon SQS
9 1 (1.89%) PaaS
Communications & Networking
1 1 (1.89%) Cisco IPT
Database & Business Intelligence
1 31 (58.49%) Hadoop
2 23 (43.40%) Big Data
3 19 (35.85%) NoSQL
4 12 (22.64%) Apache Hive
5 10 (18.87%) Data Warehouse
6 7 (13.21%) Amazon Redshift
6 7 (13.21%) BigQuery
6 7 (13.21%) Impala
6 7 (13.21%) SQL Server Integration Services
7 6 (11.32%) Apache Cassandra
7 6 (11.32%) Data Lake
7 6 (11.32%) Metadata
7 6 (11.32%) Tableau
8 5 (9.43%) Amazon Athena
8 5 (9.43%) MongoDB
8 5 (9.43%) SQL Server
9 4 (7.55%) Amazon RDS
9 4 (7.55%) MySQL
9 4 (7.55%) Neo4j
10 3 (5.66%) PostgreSQL
Development Applications
1 8 (15.09%) Jenkins
2 2 (3.77%) SQL Server Management Studio (SSMS)
3 1 (1.89%) kappa
General
1 18 (33.96%) Finance
2 11 (20.75%) Social Skills
3 6 (11.32%) Analytical Skills
4 4 (7.55%) Banking
4 4 (7.55%) Retail
5 3 (5.66%) German Language
6 2 (3.77%) Inclusion and Diversity
6 2 (3.77%) Law
7 1 (1.89%) Financial Institution
7 1 (1.89%) Influencing Skills
7 1 (1.89%) Marketing
7 1 (1.89%) Presentation Skills
Job Titles
1 24 (45.28%) Data Engineer
2 17 (32.08%) Developer
3 12 (22.64%) Java Developer
4 9 (16.98%) Big Data Engineer
5 8 (15.09%) Lead Developer
5 8 (15.09%) Lead Java Developer
6 7 (13.21%) Senior Data Engineer
7 4 (7.55%) Senior Developer
7 4 (7.55%) Senior Java Developer
8 3 (5.66%) Architect
8 3 (5.66%) Java Engineer
8 3 (5.66%) Python Engineer
9 2 (3.77%) AWS Developer
9 2 (3.77%) Business Intelligence Manager
9 2 (3.77%) Data Architect
9 2 (3.77%) Data Manager
9 2 (3.77%) Senior Manager
9 2 (3.77%) Software Engineer
10 1 (1.89%) Security Engineer
10 1 (1.89%) SQL Database Developer
Libraries, Frameworks & Software Standards
1 31 (58.49%) Kafka
2 11 (20.75%) RabbitMQ
3 10 (18.87%) Spring
4 9 (16.98%) Spring Boot
5 8 (15.09%) Apache Beam
6 5 (9.43%) Dask
7 4 (7.55%) Apache NiFi
8 2 (3.77%) NLTK
8 2 (3.77%) NumPy
8 2 (3.77%) Pandas
8 2 (3.77%) SciPy
8 2 (3.77%) SpaCy
9 1 (1.89%) Akka
9 1 (1.89%) OAuth
9 1 (1.89%) OAuth2
9 1 (1.89%) Spring Batch
9 1 (1.89%) Web Services
9 1 (1.89%) ZeroMQ
Miscellaneous
1 8 (15.09%) Data Structures
2 7 (13.21%) Algorithms
3 4 (7.55%) Clustering
3 4 (7.55%) Credit Risk
4 3 (5.66%) Foreign Exchange (FX)
4 3 (5.66%) Management Information System
5 2 (3.77%) Virtual Team
6 1 (1.89%) Data Centre
6 1 (1.89%) Derivative
6 1 (1.89%) Equities
6 1 (1.89%) Interest Rate Derivative
6 1 (1.89%) Public Cloud
Operating Systems
1 5 (9.43%) Linux
2 1 (1.89%) Unix
Processes & Methodologies
1 32 (60.38%) Analytics
2 20 (37.74%) DevOps
3 19 (35.85%) Agile Software Development
4 14 (26.42%) Computer Science
5 12 (22.64%) Continuous Integration
6 11 (20.75%) Data Pipeline
6 11 (20.75%) Microservices
6 11 (20.75%) OO
7 10 (18.87%) Data Analytics
7 10 (18.87%) Data Modelling
7 10 (18.87%) Scrum
8 9 (16.98%) Data Science
8 9 (16.98%) ETL
8 9 (16.98%) Fintech
8 9 (16.98%) People Management
8 9 (16.98%) Scaled Agile Framework
9 6 (11.32%) Mathematics
9 6 (11.32%) OOD
9 6 (11.32%) Problem-Solving
9 6 (11.32%) SDLC
Programming Languages
1 30 (56.60%) Java
2 28 (52.83%) Python
2 28 (52.83%) SQL
3 10 (18.87%) Scala
4 8 (15.09%) C++
5 5 (9.43%) C
6 4 (7.55%) U-SQL
7 1 (1.89%) Bash Shell
7 1 (1.89%) C#
7 1 (1.89%) Java 11
7 1 (1.89%) Java 8
7 1 (1.89%) JavaScript
7 1 (1.89%) PL/SQL
7 1 (1.89%) PowerShell
7 1 (1.89%) R
7 1 (1.89%) TypeScript
Qualifications
1 13 (24.53%) Degree
2 8 (15.09%) Computer Science Degree
3 5 (9.43%) Master's Degree
3 5 (9.43%) SC Cleared
3 5 (9.43%) Security Cleared
4 1 (1.89%) (ISC)2 CCSP
4 1 (1.89%) AWS Certification
4 1 (1.89%) CCSP
4 1 (1.89%) Cisco Certification
4 1 (1.89%) CISSP
4 1 (1.89%) DV Cleared
Quality Assurance & Compliance
1 3 (5.66%) Data Quality
1 3 (5.66%) GDPR
1 3 (5.66%) PCI DSS
1 3 (5.66%) QA
1 3 (5.66%) Sarbanes-Oxley
2 1 (1.89%) IFRS
2 1 (1.89%) IFRS 9
System Software
1 1 (1.89%) Apache ZooKeeper
1 1 (1.89%) Docker
1 1 (1.89%) HDFS
Systems Management
1 12 (22.64%) Terraform
2 9 (16.98%) Ansible
3 4 (7.55%) Kubernetes
3 4 (7.55%) Opscode Chef
4 2 (3.77%) Puppet
5 1 (1.89%) Hadoop YARN
5 1 (1.89%) Salt
Vendors
1 9 (16.98%) Databricks
2 4 (7.55%) Ab Initio
2 4 (7.55%) Microsoft
2 4 (7.55%) Oracle
2 4 (7.55%) Teradata
3 3 (5.66%) Google
3 3 (5.66%) SAP
3 3 (5.66%) Talend
4 2 (3.77%) Cloudera
5 1 (1.89%) ServiceNow