Period
to 20 October 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Spark Streaming skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Spark Streaming over the 6 months to 20 October 2021 with a comparison to the same period in the previous 2 years.

Apache Spark Streaming
UK > England
6 months to
20 Oct 2021
Same period 2020 Same period 2019
Rank 734 654 1008
Rank change year-on-year -80 +354 +23
Permanent jobs citing Spark Streaming 247 21 67
As % of all permanent jobs advertised in England 0.22% 0.047% 0.053%
As % of the Libraries, Frameworks & Software Standards category 0.55% 0.11% 0.14%
Number of salaries quoted 56 17 41
10th Percentile £42,500 " £50,000
25th Percentile £46,250 £57,500 £62,500
Median annual salary (50th Percentile) £80,000 £70,000 £85,000
Median % change year-on-year +14.29% -17.65% +6.25%
75th Percentile £95,625 £72,500 £93,750
90th Percentile £97,500 £115,750 £100,000
UK median annual salary £76,250 £70,000 £85,000
% change year-on-year +8.93% -17.65% +6.25%

Spark Streaming is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
England
Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 45,012 19,769 47,036
As % of all permanent IT jobs advertised in England 40.70% 44.02% 37.39%
Number of salaries quoted 28,892 17,131 39,441
10th Percentile £36,250 £35,000 £32,500
25th Percentile £45,000 £43,750 £40,000
Median annual salary (50th Percentile) £60,000 £57,500 £55,000
Median % change year-on-year +4.35% +4.55% +4.76%
75th Percentile £80,000 £75,000 £73,750
90th Percentile £96,250 £95,000 £88,750
UK median annual salary £60,000 £57,500 £55,000
% change year-on-year +4.35% +4.55% +7.84%

Spark Streaming
Job Vacancy Trend in England

Job postings citing Spark Streaming as a proportion of all IT jobs advertised in England.

Job vacancy trend for Spark Streaming in England

Spark Streaming
Salary Trend in England

3-month moving average salary quoted in jobs citing Spark Streaming in England.

Salary trend for Spark Streaming in England

Spark Streaming
Salary Histogram in England

Salary distribution for jobs citing Spark Streaming in England over the 6 months to 20 October 2021.

Salary histogram for Spark Streaming in England

Spark Streaming
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Spark Streaming within the England region over the 6 months to 20 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East - 181 £82,500 - 1
London -216 50 £80,000 -7.25% 9
North of England -125 12 £35,000 -
Yorkshire - 11 £35,000 -
East of England -107 3 £50,000 -28.57%
North West -103 1 £115,000 -
Spark Streaming
UK

For the 6 months to 20 October 2021, IT jobs citing Spark Streaming also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Spark Streaming.

1 244 (98.79%) Apache Spark
2 220 (89.07%) Agile Software Development
3 218 (88.26%) Software Engineering
3 218 (88.26%) Jenkins
4 213 (86.23%) Ansible
5 207 (83.81%) Kafka
5 207 (83.81%) Java
6 194 (78.54%) Computer Science
7 193 (78.14%) NoSQL
8 192 (77.73%) Degree
9 191 (77.33%) PostgreSQL
10 188 (76.11%) Linux
11 187 (75.71%) JSON
11 187 (75.71%) HDFS
12 186 (75.30%) DevOps
12 186 (75.30%) Finance
13 185 (74.90%) Shell Script
13 185 (74.90%) Unix
13 185 (74.90%) Spring
13 185 (74.90%) HBase
13 185 (74.90%) Linux Command Line
14 184 (74.49%) Inclusion and Diversity
14 184 (74.49%) Git (software)
15 183 (74.09%) Validation
16 182 (73.68%) CSS
16 182 (73.68%) Apache
16 182 (73.68%) AngularJS
16 182 (73.68%) React
16 182 (73.68%) Twitter Bootstrap
16 182 (73.68%) Microservices

Spark Streaming
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 244 (98.79%) Apache Spark
2 182 (73.68%) Apache
3 181 (73.28%) GemFire
4 11 (4.45%) Apache Airflow
4 11 (4.45%) Luigi
5 7 (2.83%) Cloud Foundry
6 6 (2.43%) Tomcat
7 4 (1.62%) Elasticsearch
8 2 (0.81%) Oracle Workflow
Cloud Services
1 181 (73.28%) GitHub
2 172 (69.64%) AWS
3 137 (55.47%) Azure
4 133 (53.85%) GCP
5 125 (50.61%) Amazon Kinesis
6 40 (16.19%) OpenShift
7 37 (14.98%) Amazon EMR
8 25 (10.12%) IBM Cloud
9 18 (7.29%) Snowflake
10 15 (6.07%) Serverless
11 12 (4.86%) Cloud Functions
11 12 (4.86%) Google App Engine
11 12 (4.86%) Google Compute Engine
11 12 (4.86%) Google Container Engine
12 11 (4.45%) Amazon EC2
13 8 (3.24%) PaaS
14 7 (2.83%) Azure Data Factory
15 6 (2.43%) Amazon SageMaker
16 3 (1.21%) AWS Lambda
17 2 (0.81%) AWS CloudFormation
Communications & Networking
1 5 (2.02%) Cisco ASA
2 4 (1.62%) Internet
2 4 (1.62%) Sourcefire
3 2 (0.81%) Firewall
Database & Business Intelligence
1 193 (78.14%) NoSQL
2 191 (77.33%) PostgreSQL
3 185 (74.90%) HBase
4 174 (70.45%) MariaDB
4 174 (70.45%) Redis
5 168 (68.02%) Big Data
6 153 (61.94%) Relational Database
7 60 (24.29%) Hadoop
8 38 (15.38%) Amazon Redshift
9 32 (12.96%) Neo4j
10 26 (10.53%) Amazon Athena
11 24 (9.72%) Electronic Patient Records
12 14 (5.67%) Apache Hive
13 13 (5.26%) Apache Cassandra
14 11 (4.45%) Amazon RDS
14 11 (4.45%) Azkaban
14 11 (4.45%) Flink
14 11 (4.45%) Metadata
15 10 (4.05%) Data Lake
16 7 (2.83%) MySQL
Development Applications
1 218 (88.26%) Jenkins
2 184 (74.49%) Git (software)
3 181 (73.28%) Cucumber
3 181 (73.28%) Cypress.io
3 181 (73.28%) Eclipse
3 181 (73.28%) Gradle
3 181 (73.28%) IntelliJ
3 181 (73.28%) JUnit
3 181 (73.28%) Protractor
3 181 (73.28%) Sonatype Nexus
3 181 (73.28%) Storybook
4 174 (70.45%) Mockito
5 123 (49.80%) Artifactory
6 83 (33.60%) SonarQube
7 31 (12.55%) Atlassian Bamboo
7 31 (12.55%) Vagrant
8 7 (2.83%) Appium
9 6 (2.43%) JIRA
10 5 (2.02%) Visual Studio
11 2 (0.81%) Oracle APEX
General
1 186 (75.30%) Finance
2 184 (74.49%) Inclusion and Diversity
3 180 (72.87%) Banking
4 179 (72.47%) Law
5 16 (6.48%) Social Skills
6 7 (2.83%) Analytical Skills
7 6 (2.43%) Retail
8 5 (2.02%) Advertising
8 5 (2.02%) Games
9 2 (0.81%) Marketing
10 1 (0.40%) Manufacturing
10 1 (0.40%) Presentation Skills
Job Titles
1 151 (61.13%) Software Engineer
2 76 (30.77%) Principal Engineer
2 76 (30.77%) Principal Software Engineer
3 57 (23.08%) Lead Software Engineer
4 38 (15.38%) Developer
5 35 (14.17%) Lead Developer
5 35 (14.17%) Lead Software Developer
5 35 (14.17%) Software Developer
6 22 (8.91%) Data Engineer
7 20 (8.10%) Architect
8 16 (6.48%) Data Architect
8 16 (6.48%) Platform Architect
8 16 (6.48%) Senior Software Engineer
9 13 (5.26%) Platform Engineer
10 10 (4.05%) DevOps Engineer
11 7 (2.83%) AWS Architect
12 6 (2.43%) Analyst
12 6 (2.43%) Cloud Engineer
12 6 (2.43%) Data Analyst
12 6 (2.43%) Data Scientist
Libraries, Frameworks & Software Standards
1 207 (83.81%) Kafka
2 187 (75.71%) JSON
3 185 (74.90%) Spring
4 182 (73.68%) AngularJS
4 182 (73.68%) CSS
4 182 (73.68%) React
4 182 (73.68%) Twitter Bootstrap
5 181 (73.28%) Express
5 181 (73.28%) Node.js
5 181 (73.28%) Redux
5 181 (73.28%) RESTful
5 181 (73.28%) Tailwind CSS
6 175 (70.85%) Play Framework
7 174 (70.45%) WireMock
8 133 (53.85%) LAMP
8 133 (53.85%) LAPP Stack
9 130 (52.63%) RabbitMQ
10 21 (8.50%) Java EE
11 20 (8.10%) Web Services
12 7 (2.83%) Spring Boot
Miscellaneous
1 185 (74.90%) Linux Command Line
2 85 (34.41%) User Experience
3 57 (23.08%) Self-Motivation
4 12 (4.86%) Data Structures
5 8 (3.24%) Management Information System
6 7 (2.83%) Virtual Team
7 5 (2.02%) Algorithms
8 4 (1.62%) Cloud Native
8 4 (1.62%) Cyber Defence
8 4 (1.62%) Internet of Things
9 2 (0.81%) Social Media
10 1 (0.40%) Acoustics
10 1 (0.40%) Blog
10 1 (0.40%) Enterprise Software
10 1 (0.40%) Greenfield Project
10 1 (0.40%) Housing Association
Operating Systems
1 188 (76.11%) Linux
2 185 (74.90%) Unix
3 4 (1.62%) Windows
Processes & Methodologies
1 220 (89.07%) Agile Software Development
2 218 (88.26%) Software Engineering
3 194 (78.54%) Computer Science
4 186 (75.30%) DevOps
5 183 (74.09%) Validation
6 182 (73.68%) Microservices
7 181 (73.28%) Cross-Browser Testing
8 179 (72.47%) Digital Banking
9 146 (59.11%) Business Continuity
10 135 (54.66%) Full Stack Development
11 132 (53.44%) OO
12 124 (50.20%) High Availability
13 123 (49.80%) Clean Code
13 123 (49.80%) Performance Monitoring
13 123 (49.80%) Software Testing
14 118 (47.77%) Open Source
15 116 (46.96%) Scaled Agile Framework
16 115 (46.56%) BDD
16 115 (46.56%) TDD
17 112 (45.34%) Multithreading
Programming Languages
1 207 (83.81%) Java
2 185 (74.90%) Shell Script
3 181 (73.28%) Groovy
3 181 (73.28%) Python
4 51 (20.65%) SQL
5 16 (6.48%) Scala
6 10 (4.05%) JavaScript
7 7 (2.83%) R
8 6 (2.43%) C++
9 4 (1.62%) Perl
9 4 (1.62%) PowerShell
10 3 (1.21%) Clojure
10 3 (1.21%) Erlang
10 3 (1.21%) Rust
10 3 (1.21%) TypeScript
11 2 (0.81%) PL/SQL
12 1 (0.40%) C#
12 1 (0.40%) Java 8
Qualifications
1 192 (77.73%) Degree
2 174 (70.45%) OCP
2 174 (70.45%) Oracle Certification
3 13 (5.26%) Computer Science Degree
4 4 (1.62%) Security Cleared
5 1 (0.40%) AWS Certification
5 1 (0.40%) TOGAF Certification
Quality Assurance & Compliance
1 2 (0.81%) QA
System Software
1 187 (75.71%) HDFS
2 125 (50.61%) VMware Infrastructure
3 33 (13.36%) Docker
4 31 (12.55%) VirtualBox
5 7 (2.83%) Apache ZooKeeper
6 2 (0.81%) Active Directory
7 1 (0.40%) Virtual Servers
Systems Management
1 213 (86.23%) Ansible
2 46 (18.62%) Opscode Chef
3 38 (15.38%) Terraform
4 37 (14.98%) Kubernetes
5 31 (12.55%) Docker Swarm
6 4 (1.62%) Puppet
7 3 (1.21%) FortiGate
8 2 (0.81%) Active Directory Federation Services
Vendors
1 181 (73.28%) Okta
1 181 (73.28%) VMware
2 42 (17.00%) Google
3 32 (12.96%) Cloudera
3 32 (12.96%) Hortonworks
4 25 (10.12%) IBM
5 24 (9.72%) Informatica
5 24 (9.72%) Talend
6 13 (5.26%) Databricks
7 12 (4.86%) Microsoft
8 9 (3.64%) Cisco
9 6 (2.43%) Dataiku
10 5 (2.02%) Apple
10 5 (2.02%) CheckPoint
11 4 (1.62%) Splunk
12 3 (1.21%) CA
13 2 (0.81%) Oracle