Period
to 24 June 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Spark Streaming skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Spark Streaming over the 6 months to 24 June 2021 with a comparison to the same period in the previous 2 years.

Apache Spark Streaming
Central London > City of London
6 months to
24 Jun 2021
Same period 2020 Same period 2019
Rank 236 245 336
Rank change year-on-year +9 +91 +11
Permanent jobs citing Spark Streaming 5 5 5
As % of all permanent jobs advertised in the City of London 0.095% 0.082% 0.049%
As % of the Libraries, Frameworks & Software Standards category 0.23% 0.21% 0.12%
Number of salaries quoted 4 0 4
Median annual salary (50th Percentile) £95,000 - £49,337
Central London median annual salary £95,000 £52,500 £49,337
% change year-on-year +80.95% +6.41% -48.07%

Spark Streaming is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
City of London
Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 2,166 2,388 4,097
As % of all permanent IT jobs advertised in the City of London 40.95% 39.06% 40.53%
Number of salaries quoted 1,989 2,123 3,700
10th Percentile £46,250 £46,250 £42,500
25th Percentile £56,500 £55,000 £52,500
Median annual salary (50th Percentile) £75,000 £70,000 £70,000
Median % change year-on-year +7.14% - +7.69%
75th Percentile £90,000 £85,000 £83,750
90th Percentile £107,500 £97,500 £95,000
Central London median annual salary £75,000 £70,000 £67,500
% change year-on-year +7.14% +3.70% +5.06%

Spark Streaming
Job Vacancy Trend in the City of London

Job postings citing Spark Streaming as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Spark Streaming in the City of London

Spark Streaming
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Spark Streaming in the City of London.

Salary trend for Spark Streaming in the City of London

For the 6 months to 24 June 2021, IT jobs citing Spark Streaming also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Spark Streaming.

1 5 (100.00%) Python
1 5 (100.00%) Apache Spark
2 4 (80.00%) Kafka
2 4 (80.00%) Scala
2 4 (80.00%) Java
2 4 (80.00%) AWS
3 3 (60.00%) Media Streaming
3 3 (60.00%) Video\Live Streaming
3 3 (60.00%) Test Automation
3 3 (60.00%) RESTful
3 3 (60.00%) Cloud Native
3 3 (60.00%) Auto-Scaling
3 3 (60.00%) Data Engineering
4 2 (40.00%) Finance
4 2 (40.00%) Big Data
4 2 (40.00%) Hadoop
4 2 (40.00%) Analytics
4 2 (40.00%) SQL
4 2 (40.00%) Data Warehouse
4 2 (40.00%) Statistics
5 1 (20.00%) Degree
5 1 (20.00%) Refactoring
5 1 (20.00%) Informatics
5 1 (20.00%) Computer Science
5 1 (20.00%) QA
5 1 (20.00%) User Acceptance Testing
5 1 (20.00%) Data Architecture
5 1 (20.00%) Apache Cassandra
5 1 (20.00%) NoSQL
5 1 (20.00%) Process Improvement

Spark Streaming
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 5 (100.00%) Apache Spark
Cloud Services
1 4 (80.00%) AWS
2 1 (20.00%) Amazon EC2
2 1 (20.00%) Amazon EMR
2 1 (20.00%) AWS Data Pipeline
2 1 (20.00%) Matillion
Database & Business Intelligence
1 2 (40.00%) Big Data
1 2 (40.00%) Data Warehouse
1 2 (40.00%) Hadoop
2 1 (20.00%) Amazon RDS
2 1 (20.00%) Amazon Redshift
2 1 (20.00%) Apache Cassandra
2 1 (20.00%) Flink
2 1 (20.00%) HBase
2 1 (20.00%) Impala
2 1 (20.00%) NoSQL
2 1 (20.00%) PostgreSQL
2 1 (20.00%) Presto
2 1 (20.00%) Relational Database
2 1 (20.00%) Sqoop
General
1 2 (40.00%) Finance
Job Titles
1 4 (80.00%) Data Engineer
2 1 (20.00%) Architect
2 1 (20.00%) Big Data Engineer
2 1 (20.00%) Data Architect
2 1 (20.00%) ETL Architect
2 1 (20.00%) Senior Architect
2 1 (20.00%) Senior Data Architect
2 1 (20.00%) Strategy Architect
Libraries, Frameworks & Software Standards
1 4 (80.00%) Kafka
2 3 (60.00%) RESTful
3 1 (20.00%) GraphX
Miscellaneous
1 3 (60.00%) Cloud Native
1 3 (60.00%) Media Streaming
1 3 (60.00%) Video\Live Streaming
2 1 (20.00%) Data Centre
2 1 (20.00%) Data Structures
2 1 (20.00%) Derivative
2 1 (20.00%) Equities
2 1 (20.00%) Equity Derivative
2 1 (20.00%) Fixed Income
2 1 (20.00%) Management Information System
Processes & Methodologies
1 3 (60.00%) Auto-Scaling
1 3 (60.00%) Data Engineering
1 3 (60.00%) Test Automation
2 2 (40.00%) Analytics
2 2 (40.00%) Statistics
3 1 (20.00%) Agile Software Development
3 1 (20.00%) Business Intelligence
3 1 (20.00%) Change Management
3 1 (20.00%) Computer Science
3 1 (20.00%) Data Architecture
3 1 (20.00%) Data Modelling
3 1 (20.00%) Data Munging
3 1 (20.00%) ETL
3 1 (20.00%) Informatics
3 1 (20.00%) OO
3 1 (20.00%) Refactoring
3 1 (20.00%) Risk Management
3 1 (20.00%) User Acceptance Testing
3 1 (20.00%) Workflow
3 1 (20.00%) Workflow Management
Programming Languages
1 5 (100.00%) Python
2 4 (80.00%) Java
2 4 (80.00%) Scala
3 2 (40.00%) SQL
Qualifications
1 1 (20.00%) Computer Science Degree
1 1 (20.00%) Degree
Quality Assurance & Compliance
1 1 (20.00%) QA
System Software
1 1 (20.00%) Apache Flume
1 1 (20.00%) Apache ZooKeeper