Period
to

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Spark Streaming skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Spark Streaming over the 6 months to 28 June 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark Streaming
England > London
6 months to
28 Jun 2022
Same period 2021 Same period 2020
Rank 546 469 375
Rank change year-on-year -77 -94 +178
Contract jobs citing Spark Streaming 53 30 29
As % of all contract jobs advertised in London 0.14% 0.11% 0.17%
As % of the Libraries, Frameworks & Software Standards category 0.44% 0.31% 0.44%
Number of daily rates quoted 38 23 21
10th Percentile £437 £463 £513
25th Percentile £516 £481 £525
Median daily rate (50th Percentile) £575 £575 £600
Median % change year-on-year - -4.17% -6.98%
75th Percentile £650 £631 £663
90th Percentile £713 £645 £688
England median daily rate £575 £550 £600
% change year-on-year +4.55% -8.33% +4.35%

Spark Streaming is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
London
Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 12,172 9,742 6,653
As % of all contract IT jobs advertised in London 31.11% 36.30% 38.33%
Number of daily rates quoted 9,402 7,240 4,938
10th Percentile £425 £393 £375
25th Percentile £505 £461 £450
Median daily rate (50th Percentile) £600 £545 £525
Median % change year-on-year +10.09% +3.81% -
75th Percentile £719 £638 £625
90th Percentile £800 £713 £711
England median daily rate £575 £510 £500
% change year-on-year +12.75% +2.00% -
Number of hourly rates quoted 58 41 35
10th Percentile £29.75 £25.25 £22.50
25th Percentile £35.00 £35.25 £31.03
Median hourly rate £46.75 £45.00 £47.83
Median % change year-on-year +3.89% -5.92% -2.65%
75th Percentile £67.07 £60.97 £63.00
90th Percentile £75.39 £68.36 £67.91
England median hourly rate £52.50 £45.00 £46.00
% change year-on-year +16.67% -2.17% +2.22%

Spark Streaming
Job Vacancy Trend in London

Job postings citing Spark Streaming as a proportion of all IT jobs advertised in London.

Job vacancy trend for Spark Streaming in London

Spark Streaming
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Spark Streaming in London.

Daily rate trend for Spark Streaming in London

Spark Streaming
Daily Rate Histogram in London

Daily rate distribution for jobs citing Spark Streaming in London over the 6 months to 28 June 2022.

Daily rate histogram for Spark Streaming in London

Spark Streaming
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Spark Streaming within the London region over the 6 months to 28 June 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London - 7 £425 - 1
Spark Streaming
England

For the 6 months to 28 June 2022, IT contractor jobs citing Spark Streaming also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Spark Streaming.

1 53 (100.00%) Apache Spark
2 50 (94.34%) Kafka
3 37 (69.81%) Java
4 29 (54.72%) Python
5 25 (47.17%) Git (software)
6 23 (43.40%) Agile
6 23 (43.40%) Finance
7 22 (41.51%) Big Data
8 21 (39.62%) DevOps
8 21 (39.62%) Analytics
9 20 (37.74%) Data Engineering
9 20 (37.74%) Data Pipeline
10 18 (33.96%) CI/CD
10 18 (33.96%) Flink
10 18 (33.96%) SQL
11 17 (32.08%) Scala
11 17 (32.08%) Azure
12 16 (30.19%) GCP
12 16 (30.19%) ETL
13 15 (28.30%) Scrum
14 14 (26.42%) AWS
15 13 (24.53%) Hadoop
15 13 (24.53%) Jenkins
15 13 (24.53%) TDD
15 13 (24.53%) Maven
15 13 (24.53%) Unit Testing
15 13 (24.53%) Databricks
16 12 (22.64%) Kanban
16 12 (22.64%) BDD
17 11 (20.75%) Amazon EMR

Spark Streaming
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (100.00%) Apache Spark
2 8 (15.09%) Apache
3 6 (11.32%) Apache Airflow
4 1 (1.89%) Apache Pig
4 1 (1.89%) Confluence
Cloud Services
1 17 (32.08%) Azure
2 16 (30.19%) GCP
3 14 (26.42%) AWS
4 11 (20.75%) Amazon EMR
5 10 (18.87%) Amazon S3
5 10 (18.87%) Azure Data Factory
5 10 (18.87%) Azure DevOps
5 10 (18.87%) Azure Functions
5 10 (18.87%) Azure Monitor
5 10 (18.87%) Azure Synapse Analytics
5 10 (18.87%) Power Platform
5 10 (18.87%) Serverless
6 7 (13.21%) Amazon EC2
7 6 (11.32%) Amazon EKS
7 6 (11.32%) AWS Fargate
8 4 (7.55%) Amazon Kinesis
9 3 (5.66%) Snowflake
10 2 (3.77%) GitHub
Database & Business Intelligence
1 22 (41.51%) Big Data
2 18 (33.96%) Flink
3 13 (24.53%) Hadoop
4 10 (18.87%) Data Lake
4 10 (18.87%) Data Warehouse
4 10 (18.87%) Power BI
5 8 (15.09%) Apache Hive
5 8 (15.09%) Spark SQL
6 7 (13.21%) HBase
6 7 (13.21%) NoSQL
7 6 (11.32%) MongoDB
8 5 (9.43%) Apache Cassandra
8 5 (9.43%) Metadata
9 4 (7.55%) Amazon Redshift
10 3 (5.66%) BigQuery
10 3 (5.66%) SQL Server
11 2 (3.77%) Elasticsearch
11 2 (3.77%) Impala
11 2 (3.77%) Relational Database
11 2 (3.77%) Sqoop
Development Applications
1 25 (47.17%) Git (software)
2 13 (24.53%) Jenkins
2 13 (24.53%) Maven
3 4 (7.55%) JIRA
4 3 (5.66%) Artifactory
4 3 (5.66%) Bitbucket
4 3 (5.66%) GitLab
4 3 (5.66%) MLflow
5 1 (1.89%) git-flow
5 1 (1.89%) HP UFT
5 1 (1.89%) Rational Robot
5 1 (1.89%) RIATest
5 1 (1.89%) SilkTest
5 1 (1.89%) TeamCity
5 1 (1.89%) WinRunner
General
1 23 (43.40%) Finance
2 10 (18.87%) Banking
3 8 (15.09%) Publishing
4 6 (11.32%) Financial Institution
4 6 (11.32%) Legal
5 3 (5.66%) Games
5 3 (5.66%) Social Skills
6 1 (1.89%) Public Sector
Job Titles
1 29 (54.72%) Data Engineer
2 11 (20.75%) Cloud Engineer
3 9 (16.98%) Developer
4 8 (15.09%) Architect
5 7 (13.21%) DevOps Engineer
5 7 (13.21%) Java Engineer
6 6 (11.32%) Data Architect
6 6 (11.32%) Scala Engineer
7 5 (9.43%) Big Data Developer
7 5 (9.43%) Senior Data Engineer
8 4 (7.55%) GCP Data Engineer
8 4 (7.55%) GCP Engineer
9 3 (5.66%) Apache Spark Developer
9 3 (5.66%) Azure Engineer
9 3 (5.66%) Big Data Engineer
9 3 (5.66%) Data Warehouse Developer
9 3 (5.66%) Python Developer
9 3 (5.66%) QA Engineer
9 3 (5.66%) Senior Cloud Engineer
10 2 (3.77%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 50 (94.34%) Kafka
2 10 (18.87%) PySpark
3 3 (5.66%) Anaconda
3 3 (5.66%) MLlib
3 3 (5.66%) SparkR
4 2 (3.77%) Elastic Stack
4 2 (3.77%) RESTful
5 1 (1.89%) H2O
5 1 (1.89%) RabbitMQ
Miscellaneous
1 10 (18.87%) Linux Command Line
2 6 (11.32%) Hedge funds
2 6 (11.32%) Self-Motivation
3 5 (9.43%) Data Structures
4 3 (5.66%) Algorithms
5 2 (3.77%) iPad
Operating Systems
1 5 (9.43%) Linux
2 2 (3.77%) Unix
Processes & Methodologies
1 23 (43.40%) Agile
2 21 (39.62%) Analytics
2 21 (39.62%) DevOps
3 20 (37.74%) Data Engineering
3 20 (37.74%) Data Pipeline
4 18 (33.96%) CI/CD
5 16 (30.19%) ETL
6 15 (28.30%) Scrum
7 13 (24.53%) TDD
7 13 (24.53%) Unit Testing
8 12 (22.64%) BDD
8 12 (22.64%) Kanban
9 10 (18.87%) Data Cleansing
9 10 (18.87%) Data Security
9 10 (18.87%) Log Analytics
10 9 (16.98%) Cybersecurity
10 9 (16.98%) Stakeholder Management
11 8 (15.09%) Complex Event Processing
11 8 (15.09%) Data Transformation
11 8 (15.09%) OWASP
Programming Languages
1 37 (69.81%) Java
2 29 (54.72%) Python
3 18 (33.96%) SQL
4 17 (32.08%) Scala
5 10 (18.87%) Bash
5 10 (18.87%) PowerShell
6 9 (16.98%) C#
Qualifications
1 8 (15.09%) FFIEC
2 7 (13.21%) PMP
3 5 (9.43%) PMI Certification
Quality Assurance & Compliance
1 10 (18.87%) Data Quality
2 8 (15.09%) GLBA
2 8 (15.09%) NIST
2 8 (15.09%) PCI DSS
3 6 (11.32%) GDPR
4 4 (7.55%) QA
System Software
1 4 (7.55%) HDFS
2 3 (5.66%) Docker
3 1 (1.89%) Apache Flume
Systems Management
1 6 (11.32%) Ansible
1 6 (11.32%) Terraform
2 3 (5.66%) Kubernetes
3 2 (3.77%) Hadoop YARN
3 2 (3.77%) Kibana
3 2 (3.77%) logstash
Vendors
1 13 (24.53%) Databricks
2 10 (18.87%) Google
3 3 (5.66%) Ab Initio
3 3 (5.66%) MapR
4 1 (1.89%) Green Hat
4 1 (1.89%) HP