Period
to 1 August 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Spark SQL skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Spark SQL over the 6 months to 1 August 2021 with a comparison to the same period in the previous 2 years.

Apache Spark SQL
Central London > City of London
6 months to
1 Aug 2021
Same period 2020 Same period 2019
Rank 245 - -
Rank change year-on-year - - +351
Permanent jobs citing Spark SQL 7 0 0
As % of all permanent jobs advertised in the City of London 0.13% - -
As % of the Database & Business Intelligence category 0.44% - -
Number of salaries quoted 7 0 0
Median annual salary (50th Percentile) £82,500 - -
Central London median annual salary £82,500 - -

Spark SQL is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,605 1,259 3,263
As % of all permanent IT jobs advertised in the City of London 28.73% 24.00% 31.95%
Number of salaries quoted 1,428 1,084 2,943
10th Percentile £45,000 £42,500 £42,500
25th Percentile £53,750 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £92,500 £85,000 £85,000
90th Percentile £108,750 £96,250 £98,750
Central London median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Spark SQL
Job Vacancy Trend in the City of London

Job postings citing Spark SQL as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Spark SQL in the City of London

Spark SQL
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Spark SQL in the City of London.

Salary trend for Spark SQL in the City of London

For the 6 months to 1 August 2021, IT jobs citing Spark SQL also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Spark SQL.

1 7 (100.00%) Data Warehouse
1 7 (100.00%) SQL
1 7 (100.00%) Hadoop
1 7 (100.00%) AWS
1 7 (100.00%) Big Data
1 7 (100.00%) Amazon Redshift
1 7 (100.00%) Apache Spark
1 7 (100.00%) Data Lake
1 7 (100.00%) Data Pipeline
2 5 (71.43%) Apache
2 5 (71.43%) Insurtech
2 5 (71.43%) AWS Data Pipeline
2 5 (71.43%) Talend
2 5 (71.43%) NoSQL
2 5 (71.43%) Amazon RDS
2 5 (71.43%) Data Transformation
2 5 (71.43%) Relational Database
2 5 (71.43%) Amazon EC2
3 2 (28.57%) Azure
3 2 (28.57%) Apache Hive
3 2 (28.57%) Visualisation
3 2 (28.57%) Oracle
3 2 (28.57%) SQL Server
3 2 (28.57%) Tableau
3 2 (28.57%) Apache Flume
3 2 (28.57%) Analytics
3 2 (28.57%) Apache Pig
3 2 (28.57%) Sqoop
3 2 (28.57%) Data Modelling
3 2 (28.57%) ETL

Spark SQL
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (100.00%) Apache Spark
2 5 (71.43%) Apache
3 2 (28.57%) Apache Airflow
3 2 (28.57%) Apache Pig
Cloud Services
1 7 (100.00%) AWS
2 5 (71.43%) Amazon EC2
2 5 (71.43%) AWS Data Pipeline
3 2 (28.57%) AWS Step Functions
3 2 (28.57%) Azure
3 2 (28.57%) Azure Data Factory
3 2 (28.57%) Azure Synapse Analytics
3 2 (28.57%) GCP
3 2 (28.57%) Power Platform
3 2 (28.57%) Snowflake
Database & Business Intelligence
1 7 (100.00%) Amazon Redshift
1 7 (100.00%) Big Data
1 7 (100.00%) Data Lake
1 7 (100.00%) Data Warehouse
1 7 (100.00%) Hadoop
2 5 (71.43%) Amazon RDS
2 5 (71.43%) NoSQL
2 5 (71.43%) Relational Database
3 2 (28.57%) Apache Hive
3 2 (28.57%) Azure SQL Data Warehouse
3 2 (28.57%) HDInsight
3 2 (28.57%) OLTP
3 2 (28.57%) Power BI
3 2 (28.57%) SQL Server
3 2 (28.57%) SQL Server Integration Services
3 2 (28.57%) SQL Server Reporting Services
3 2 (28.57%) Sqoop
3 2 (28.57%) Tableau
Development Applications
1 2 (28.57%) ER Studio
1 2 (28.57%) ERwin
1 2 (28.57%) JIRA
1 2 (28.57%) PowerDesigner
General
1 2 (28.57%) Advertising
Job Titles
1 7 (100.00%) Data Engineer
2 5 (71.43%) AWS Engineer
Libraries, Frameworks & Software Standards
1 2 (28.57%) PySpark
Miscellaneous
1 2 (28.57%) Derivative
Processes & Methodologies
1 7 (100.00%) Data Pipeline
2 5 (71.43%) Data Transformation
2 5 (71.43%) Insurtech
3 2 (28.57%) Agile Software Development
3 2 (28.57%) Analytics
3 2 (28.57%) Business Intelligence
3 2 (28.57%) Coaching
3 2 (28.57%) Data Analysis
3 2 (28.57%) Data Architecture
3 2 (28.57%) Data Integration
3 2 (28.57%) Data Modelling
3 2 (28.57%) DevOps
3 2 (28.57%) ETL
3 2 (28.57%) Logical Data Model
3 2 (28.57%) Mentoring
3 2 (28.57%) Model Validation
3 2 (28.57%) Physical Data Model
3 2 (28.57%) Scrum
3 2 (28.57%) SDLC
3 2 (28.57%) Unit Testing
Programming Languages
1 7 (100.00%) SQL
System Software
1 2 (28.57%) Apache Flume
Vendors
1 5 (71.43%) Talend
2 2 (28.57%) Databricks
2 2 (28.57%) Microsoft
2 2 (28.57%) Oracle