Period
to 1 December 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Spark Streaming skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Spark Streaming over the 6 months to 1 December 2021 with a comparison to the same period in the previous 2 years.

Apache Spark Streaming
UK
6 months to
1 Dec 2021
Same period 2020 Same period 2019
Rank 847 699 996
Rank change year-on-year -148 +297 +40
Permanent jobs citing Spark Streaming 208 26 62
As % of all permanent jobs advertised in the UK 0.16% 0.047% 0.046%
As % of the Libraries, Frameworks & Software Standards category 0.41% 0.11% 0.12%
Number of salaries quoted 54 22 42
10th Percentile £41,500 £57,500 £47,625
25th Percentile £55,000 £62,500 £50,938
Median annual salary (50th Percentile) £80,000 £70,000 £82,500
Median % change year-on-year +14.29% -15.15% +3.13%
75th Percentile £97,500 £90,938 £93,750
90th Percentile £112,500 £109,625 £104,500
UK excluding London median annual salary £55,000 £67,500 -
% change year-on-year -18.52% - -

Spark Streaming is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
UK
Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 50,528 24,220 51,101
As % of all permanent IT jobs advertised in the UK 39.13% 43.85% 38.29%
Number of salaries quoted 32,496 20,954 42,571
10th Percentile £36,750 £35,000 £32,500
25th Percentile £45,000 £42,500 £40,000
Median annual salary (50th Percentile) £60,000 £57,500 £55,000
Median % change year-on-year +4.35% +4.55% +4.76%
75th Percentile £80,000 £75,000 £72,500
90th Percentile £97,500 £91,250 £88,750
UK excluding London median annual salary £52,500 £50,000 £45,000
% change year-on-year +5.00% +11.11% -

Spark Streaming
Job Vacancy Trend

Job postings citing Spark Streaming as a proportion of all IT jobs advertised.

Job vacancy trend for Spark Streaming in the UK

Spark Streaming
Salary Trend

3-month moving average salary quoted in jobs citing Spark Streaming.

Salary trend for Spark Streaming in the UK

Spark Streaming
Salary Histogram

Salary distribution for jobs citing Spark Streaming over the 6 months to 1 December 2021.

Salary histogram for Spark Streaming in the UK

Spark Streaming
Top 13 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Spark Streaming within the UK over the 6 months to 1 December 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -135 199 £80,000 +14.29% 8
UK excluding London -64 163 £55,000 -18.52% 6
South East - 142 £82,500 -
London -225 37 £80,000 -4.48% 2
Work from Home -234 31 £80,000 -4.48% 3
North of England - 13 £35,000 - 5
Yorkshire - 11 £35,000 - 5
East of England -113 4 £50,000 -25.93% 1
Scotland - 2 £70,000 -
North West - 2 £97,500 -
Midlands - 1 £80,000 -
South West - 1 £80,000 -
West Midlands - 1 £80,000 -

For the 6 months to 1 December 2021, IT jobs citing Spark Streaming also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Spark Streaming.

1 204 (98.08%) Apache Spark
2 178 (85.58%) Jenkins
3 175 (84.13%) Kafka
3 175 (84.13%) Software Engineering
4 172 (82.69%) Ansible
5 171 (82.21%) Java
6 164 (78.85%) Agile Software Development
7 162 (77.88%) NoSQL
8 158 (75.96%) PostgreSQL
9 156 (75.00%) Git (software)
10 154 (74.04%) Python
11 153 (73.56%) Linux
11 153 (73.56%) Degree
11 153 (73.56%) Computer Science
12 152 (73.08%) DevOps
13 148 (71.15%) Finance
14 147 (70.67%) CSS
14 147 (70.67%) React
14 147 (70.67%) AngularJS
14 147 (70.67%) Twitter Bootstrap
14 147 (70.67%) HBase
14 147 (70.67%) Linux Command Line
15 146 (70.19%) Inclusion and Diversity
15 146 (70.19%) HDFS
15 146 (70.19%) Unix
15 146 (70.19%) Shell Script
15 146 (70.19%) JSON
15 146 (70.19%) Spring
16 145 (69.71%) AWS
17 144 (69.23%) Validation

Spark Streaming
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 204 (98.08%) Apache Spark
2 142 (68.27%) Apache
2 142 (68.27%) GemFire
3 9 (4.33%) Apache Airflow
4 8 (3.85%) Luigi
5 6 (2.88%) Tomcat
6 5 (2.40%) Cloud Foundry
7 4 (1.92%) Elasticsearch
Cloud Services
1 145 (69.71%) AWS
2 142 (68.27%) GitHub
3 121 (58.17%) Azure
4 116 (55.77%) GCP
5 113 (54.33%) Amazon Kinesis
6 28 (13.46%) OpenShift
7 25 (12.02%) Amazon EMR
8 13 (6.25%) Amazon SageMaker
9 12 (5.77%) Azure Data Factory
10 11 (5.29%) IBM Cloud
11 10 (4.81%) Serverless
12 9 (4.33%) Snowflake
13 8 (3.85%) Amazon EC2
14 7 (3.37%) Cloud Functions
14 7 (3.37%) Google App Engine
14 7 (3.37%) Google Compute Engine
14 7 (3.37%) Google Container Engine
15 6 (2.88%) AWS CloudFormation
15 6 (2.88%) Google Data Studio
15 6 (2.88%) Power Platform
Communications & Networking
1 5 (2.40%) Cisco ASA
2 4 (1.92%) Internet
2 4 (1.92%) Sourcefire
3 2 (0.96%) Firewall
Database & Business Intelligence
1 162 (77.88%) NoSQL
2 158 (75.96%) PostgreSQL
3 147 (70.67%) HBase
4 137 (65.87%) MariaDB
4 137 (65.87%) Redis
5 131 (62.98%) Big Data
6 126 (60.58%) Relational Database
7 52 (25.00%) Hadoop
8 30 (14.42%) Neo4j
9 26 (12.50%) Amazon Redshift
10 18 (8.65%) Amazon Athena
11 15 (7.21%) Apache Hive
12 14 (6.73%) Data Lake
12 14 (6.73%) Electronic Patient Records
13 12 (5.77%) Apache Cassandra
13 12 (5.77%) Data Warehouse
14 10 (4.81%) Flink
15 8 (3.85%) Amazon RDS
15 8 (3.85%) Azkaban
15 8 (3.85%) Metadata
Development Applications
1 178 (85.58%) Jenkins
2 156 (75.00%) Git (software)
3 142 (68.27%) Cucumber
3 142 (68.27%) Cypress.io
3 142 (68.27%) Eclipse
3 142 (68.27%) Gradle
3 142 (68.27%) IntelliJ
3 142 (68.27%) JUnit
3 142 (68.27%) Protractor
3 142 (68.27%) Sonatype Nexus
3 142 (68.27%) Storybook
4 137 (65.87%) Mockito
5 106 (50.96%) Artifactory
6 71 (34.13%) SonarQube
7 24 (11.54%) Atlassian Bamboo
7 24 (11.54%) Vagrant
8 9 (4.33%) Visual Studio
9 6 (2.88%) JIRA
9 6 (2.88%) Spinnaker
10 5 (2.40%) Appium
General
1 148 (71.15%) Finance
2 146 (70.19%) Inclusion and Diversity
3 142 (68.27%) Banking
4 140 (67.31%) Law
5 33 (15.87%) Social Skills
6 11 (5.29%) Retail
7 6 (2.88%) Analytical Skills
7 6 (2.88%) Manufacturing
8 5 (2.40%) Advertising
8 5 (2.40%) Games
9 4 (1.92%) Presentation Skills
Job Titles
1 122 (58.65%) Software Engineer
2 59 (28.37%) Principal Engineer
2 59 (28.37%) Principal Software Engineer
3 45 (21.63%) Lead Software Engineer
4 29 (13.94%) Developer
5 28 (13.46%) Lead Developer
5 28 (13.46%) Lead Software Developer
5 28 (13.46%) Software Developer
6 19 (9.13%) Data Engineer
7 15 (7.21%) Senior Software Engineer
8 13 (6.25%) Architect
8 13 (6.25%) Data Scientist
9 12 (5.77%) Consultant
10 9 (4.33%) Data Architect
11 8 (3.85%) DevOps Engineer
11 8 (3.85%) Senior Data Scientist
12 7 (3.37%) Data Consultant
13 6 (2.88%) Analyst
13 6 (2.88%) Data Analyst
13 6 (2.88%) Platform Engineer
Libraries, Frameworks & Software Standards
1 175 (84.13%) Kafka
2 147 (70.67%) AngularJS
2 147 (70.67%) CSS
2 147 (70.67%) React
2 147 (70.67%) Twitter Bootstrap
3 146 (70.19%) JSON
3 146 (70.19%) Spring
4 142 (68.27%) Express
4 142 (68.27%) Node.js
4 142 (68.27%) Redux
4 142 (68.27%) RESTful
4 142 (68.27%) Tailwind CSS
5 140 (67.31%) Play Framework
6 137 (65.87%) AssertJ
6 137 (65.87%) WireMock
7 111 (53.37%) RabbitMQ
8 110 (52.88%) LAMP
8 110 (52.88%) LAPP Stack
9 16 (7.69%) Web Services
10 14 (6.73%) TensorFlow
Miscellaneous
1 147 (70.67%) Linux Command Line
2 70 (33.65%) User Experience
3 36 (17.31%) Self-Motivation
4 14 (6.73%) Data Structures
5 7 (3.37%) Algorithms
6 6 (2.88%) Management Information System
7 5 (2.40%) Virtual Team
8 4 (1.92%) Cloud Native
8 4 (1.92%) Cyber Defence
8 4 (1.92%) Internet of Things
9 2 (0.96%) Greenfield Project
10 1 (0.48%) Acoustics
10 1 (0.48%) Blog
Operating Systems
1 153 (73.56%) Linux
2 146 (70.19%) Unix
3 4 (1.92%) Windows
Processes & Methodologies
1 175 (84.13%) Software Engineering
2 164 (78.85%) Agile Software Development
3 153 (73.56%) Computer Science
4 152 (73.08%) DevOps
5 144 (69.23%) Validation
6 142 (68.27%) Cross-Browser Testing
6 142 (68.27%) Microservices
7 140 (67.31%) Digital Banking
8 118 (56.73%) Business Continuity
9 112 (53.85%) OO
10 111 (53.37%) High Availability
11 108 (51.92%) Full Stack Development
12 106 (50.96%) Clean Code
12 106 (50.96%) Performance Monitoring
12 106 (50.96%) Software Testing
13 102 (49.04%) Open Source
14 96 (46.15%) Multithreaded Programming
14 96 (46.15%) Multithreading
15 95 (45.67%) Scaled Agile Framework
16 93 (44.71%) BDD
Programming Languages
1 171 (82.21%) Java
2 154 (74.04%) Python
3 146 (70.19%) Shell Script
4 143 (68.75%) Groovy
5 50 (24.04%) SQL
6 22 (10.58%) Scala
7 18 (8.65%) R
8 17 (8.17%) JavaScript
9 6 (2.88%) C#
10 5 (2.40%) PowerShell
11 4 (1.92%) C++
11 4 (1.92%) Erlang
11 4 (1.92%) Perl
11 4 (1.92%) Rust
11 4 (1.92%) TypeScript
12 2 (0.96%) Clojure
13 1 (0.48%) Bash Shell
Qualifications
1 153 (73.56%) Degree
2 137 (65.87%) OCP
2 137 (65.87%) Oracle Certification
3 10 (4.81%) Computer Science Degree
4 3 (1.44%) Security Cleared
5 1 (0.48%) PMI Certification
5 1 (0.48%) PMP
Quality Assurance & Compliance
1 2 (0.96%) QA
2 1 (0.48%) Data Quality
System Software
1 146 (70.19%) HDFS
2 99 (47.60%) VMware Infrastructure
3 30 (14.42%) Docker
4 24 (11.54%) VirtualBox
5 5 (2.40%) Apache ZooKeeper
6 2 (0.96%) Active Directory
7 1 (0.48%) Apache Flume
Systems Management
1 172 (82.69%) Ansible
2 36 (17.31%) Terraform
3 34 (16.35%) Kubernetes
3 34 (16.35%) Opscode Chef
4 24 (11.54%) Docker Swarm
5 4 (1.92%) Puppet
6 3 (1.44%) FortiGate
7 2 (0.96%) Active Directory Federation Services
8 1 (0.48%) Oozie
Vendors
1 142 (68.27%) Okta
1 142 (68.27%) VMware
2 36 (17.31%) Google
3 31 (14.90%) Cloudera
4 30 (14.42%) Hortonworks
5 25 (12.02%) Databricks
6 17 (8.17%) Microsoft
7 13 (6.25%) Dataiku
8 11 (5.29%) IBM
9 10 (4.81%) Informatica
9 10 (4.81%) Talend
10 9 (4.33%) Cisco
11 5 (2.40%) Apple
11 5 (2.40%) CheckPoint
12 4 (1.92%) Splunk
13 3 (1.44%) CA
14 1 (0.48%) Oracle
14 1 (0.48%) Salesforce.com
14 1 (0.48%) SAP
14 1 (0.48%) StreamSets