Apache Spark Streaming
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Spark Streaming skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Spark Streaming over the 6 months to 2 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
2 May 2024
Same period 2023 Same period 2022
Rank 867 950 1062
Rank change year-on-year +83 +112 -269
Permanent jobs citing Spark Streaming 10 28 163
As % of all permanent jobs advertised in the UK 0.010% 0.027% 0.10%
As % of the Libraries, Frameworks & Software Standards category 0.047% 0.090% 0.26%
Number of salaries quoted 1 8 43
10th Percentile - - £55,500
25th Percentile £80,000 £70,000 £70,000
Median annual salary (50th Percentile) £85,000 £78,750 £90,000
Median % change year-on-year +7.94% -12.50% +38.46%
75th Percentile £90,000 £90,000 £103,000
90th Percentile - - £112,500
UK excluding London median annual salary - £77,500 £72,500
% change year-on-year - +6.90% +26.09%

All Software Libraries and Frameworks
UK

Spark Streaming is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for technical specification, industry standards, software libraries and framework skills.

Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 21,058 31,283 63,194
As % of all permanent jobs advertised in the UK 21.37% 30.13% 40.47%
Number of salaries quoted 15,741 19,277 30,292
10th Percentile £36,250 £41,117 £37,500
25th Percentile £45,000 £50,000 £47,500
Median annual salary (50th Percentile) £60,000 £67,500 £62,500
Median % change year-on-year -11.11% +8.00% +13.64%
75th Percentile £79,600 £87,500 £82,500
90th Percentile £100,000 £106,250 £100,000
UK excluding London median annual salary £55,000 £57,500 £55,000
% change year-on-year -4.35% +4.55% +10.00%

Spark Streaming
Job Vacancy Trend

Job postings citing Spark Streaming as a proportion of all IT jobs advertised.

Job vacancy trend for Spark Streaming in the UK

Spark Streaming
Salary Trend

3-month moving average salary quoted in jobs citing Spark Streaming.

Salary trend for Spark Streaming in the UK

Spark Streaming
Top 3 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Spark Streaming within the UK over the 6 months to 2 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +69 10 £85,000 +7.94% 6
London +126 9 £85,000 -5.56% 3
Work from Home +78 2 £85,000 -5.56% 1

Spark Streaming
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (100.00%) Apache Spark
2 8 (80.00%) Apache
2 8 (80.00%) Apache Airflow
Cloud Services
1 10 (100.00%) AWS
1 10 (100.00%) GCP
2 9 (90.00%) Azure
3 8 (80.00%) GitHub
3 8 (80.00%) GitHub Actions
4 2 (20.00%) Amazon EMR
4 2 (20.00%) Amazon Kinesis
5 1 (10.00%) Snowflake
Database & Business Intelligence
1 10 (100.00%) Big Data
2 9 (90.00%) Data Warehouse
2 9 (90.00%) NoSQL
3 8 (80.00%) Apache Hive
3 8 (80.00%) Data Lake
3 8 (80.00%) Flink
3 8 (80.00%) Hadoop
3 8 (80.00%) Parquet
4 2 (20.00%) Amazon Athena
4 2 (20.00%) Amazon Redshift
5 1 (10.00%) BigQuery
5 1 (10.00%) DynamoDB
5 1 (10.00%) Electronic Patient Records
5 1 (10.00%) Looker
5 1 (10.00%) Neo4j
Development Applications
1 10 (100.00%) Git
1 10 (100.00%) Jenkins
2 8 (80.00%) CircleCI
3 2 (20.00%) Spinnaker
General
1 8 (80.00%) Banking
1 8 (80.00%) Finance
1 8 (80.00%) Inclusion and Diversity
1 8 (80.00%) Retail Banking
2 1 (10.00%) Social Skills
Job Titles
1 10 (100.00%) Data Engineer
2 8 (80.00%) Senior
2 8 (80.00%) Senior Data Engineer
3 2 (20.00%) AWS Data Engineer
3 2 (20.00%) AWS Engineer
Libraries, Frameworks & Software Standards
1 10 (100.00%) Kafka
2 8 (80.00%) Apache Avro
2 8 (80.00%) Apache Beam
2 8 (80.00%) PySpark
Miscellaneous
1 8 (80.00%) Distributed Applications
1 8 (80.00%) Distributed Systems
1 8 (80.00%) Greenfield Project
Processes & Methodologies
1 10 (100.00%) CI/CD
1 10 (100.00%) Data Engineering
1 10 (100.00%) Data Pipeline
1 10 (100.00%) ETL
2 9 (90.00%) Agile
2 9 (90.00%) Data Transformation
2 9 (90.00%) Digital Engineering
2 9 (90.00%) Machine Learning
3 8 (80.00%) Analytics
3 8 (80.00%) Asset Management
3 8 (80.00%) Containerisation
3 8 (80.00%) Continuous Delivery
3 8 (80.00%) Continuous Improvement
3 8 (80.00%) Data Analytics
3 8 (80.00%) Data Modelling
3 8 (80.00%) DevOps
3 8 (80.00%) Event-Driven
3 8 (80.00%) MLOps
3 8 (80.00%) SDLC
3 8 (80.00%) Software Engineering
Programming Languages
1 10 (100.00%) Java
1 10 (100.00%) Python
1 10 (100.00%) Scala
2 9 (90.00%) SQL
Qualifications
1 1 (10.00%) SC Cleared
1 1 (10.00%) Security Cleared
Quality Assurance & Compliance
1 1 (10.00%) Data Quality
1 1 (10.00%) QA
System Software
1 8 (80.00%) HDFS
Systems Management
1 2 (20.00%) Ansible
2 1 (10.00%) Terraform
Vendors
1 10 (100.00%) Cloudera
2 9 (90.00%) Databricks
3 2 (20.00%) Google
3 2 (20.00%) Hortonworks