Period
to 21 September 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for HDInsight skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited HDInsight over the 6 months to 21 September 2021 with a comparison to the same period in the previous 2 years.

Microsoft Azure HDInsight
Central London > City of London
6 months to
21 Sep 2021
Same period 2020 Same period 2019
Rank 247 190 315
Rank change year-on-year -57 +125 +33
Permanent jobs citing HDInsight 4 7 9
As % of all permanent jobs advertised in the City of London 0.068% 0.18% 0.090%
As % of the Database & Business Intelligence category 0.23% 0.67% 0.29%
Number of salaries quoted 4 7 9
10th Percentile £67,375 £67,500 £50,000
25th Percentile £69,063 £70,000 £57,500
Median annual salary (50th Percentile) £75,750 £105,000 £70,000
Median % change year-on-year -27.86% +50.00% -29.11%
75th Percentile £79,813 £117,500 £77,500
90th Percentile £79,925 £120,500 £78,500
Central London median annual salary £75,750 £105,000 £70,000
% change year-on-year -27.86% +50.00% -29.11%

HDInsight is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,754 1,045 3,149
As % of all permanent IT jobs advertised in the City of London 29.68% 27.07% 31.39%
Number of salaries quoted 1,550 870 2,844
10th Percentile £46,250 £42,500 £43,400
25th Percentile £56,250 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £95,000 £85,000 £85,000
90th Percentile £110,000 £100,000 £100,000
Central London median annual salary £72,500 £70,000 £65,000
% change year-on-year +3.57% +7.69% +3.17%

HDInsight
Job Vacancy Trend in the City of London

Job postings citing HDInsight as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for HDInsight in the City of London

HDInsight
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing HDInsight in the City of London.

Salary trend for HDInsight in the City of London

For the 6 months to 21 September 2021, IT jobs citing HDInsight also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for HDInsight.

1 4 (100.00%) SQL
1 4 (100.00%) Agile Software Development
1 4 (100.00%) Microsoft
1 4 (100.00%) Business Intelligence
1 4 (100.00%) Data Architecture
1 4 (100.00%) Azure
1 4 (100.00%) DevOps
1 4 (100.00%) Power BI
1 4 (100.00%) Data Lake
1 4 (100.00%) Power Platform
2 3 (75.00%) Apache Airflow
2 3 (75.00%) Databricks
2 3 (75.00%) Apache Spark
2 3 (75.00%) Hadoop
2 3 (75.00%) Apache Hive
3 2 (50.00%) NoSQL
3 2 (50.00%) Tableau
3 2 (50.00%) Big Data
3 2 (50.00%) Visualisation
3 2 (50.00%) AWS
3 2 (50.00%) Test Automation
3 2 (50.00%) OLTP
3 2 (50.00%) PowerDesigner
3 2 (50.00%) ERwin
3 2 (50.00%) Advertising
3 2 (50.00%) Scrum
3 2 (50.00%) Information Security
3 2 (50.00%) TDD
3 2 (50.00%) SQL Server Reporting Services
3 2 (50.00%) Data Analysis

HDInsight
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 3 (75.00%) Apache Airflow
1 3 (75.00%) Apache Spark
2 2 (50.00%) Apache Pig
3 1 (25.00%) Apache
Cloud Services
1 4 (100.00%) Azure
1 4 (100.00%) Power Platform
2 2 (50.00%) AWS
2 2 (50.00%) AWS Step Functions
2 2 (50.00%) Azure Data Factory
2 2 (50.00%) Azure Synapse Analytics
2 2 (50.00%) GCP
2 2 (50.00%) PaaS
2 2 (50.00%) SaaS
2 2 (50.00%) Snowflake
Database & Business Intelligence
1 4 (100.00%) Data Lake
1 4 (100.00%) Power BI
2 3 (75.00%) Apache Hive
2 3 (75.00%) Hadoop
3 2 (50.00%) Amazon Redshift
3 2 (50.00%) Azure SQL Data Warehouse
3 2 (50.00%) Big Data
3 2 (50.00%) Data Warehouse
3 2 (50.00%) NoSQL
3 2 (50.00%) OLTP
3 2 (50.00%) Qlik Sense
3 2 (50.00%) Spark SQL
3 2 (50.00%) SQL Server
3 2 (50.00%) SQL Server Integration Services
3 2 (50.00%) SQL Server Reporting Services
3 2 (50.00%) Sqoop
3 2 (50.00%) Tableau
Development Applications
1 2 (50.00%) ER Studio
1 2 (50.00%) ERwin
1 2 (50.00%) JIRA
1 2 (50.00%) PowerDesigner
2 1 (25.00%) GitLab
General
1 2 (50.00%) Advertising
Job Titles
1 2 (50.00%) Data Engineer
1 2 (50.00%) Technical Leader
Libraries, Frameworks & Software Standards
1 2 (50.00%) AngularJS
1 2 (50.00%) HTML
1 2 (50.00%) PySpark
Miscellaneous
1 2 (50.00%) Derivative
Processes & Methodologies
1 4 (100.00%) Agile Software Development
1 4 (100.00%) Business Intelligence
1 4 (100.00%) Data Architecture
1 4 (100.00%) DevOps
2 2 (50.00%) Analytics
2 2 (50.00%) Coaching
2 2 (50.00%) Continuous Deployment
2 2 (50.00%) Data Engineering
2 2 (50.00%) Data Pipeline
2 2 (50.00%) Data Strategy
2 2 (50.00%) Logical Data Model
2 2 (50.00%) Mentoring
2 2 (50.00%) Model Validation
2 2 (50.00%) Physical Data Model
2 2 (50.00%) SDLC
2 2 (50.00%) TDD
2 2 (50.00%) Technical Leadership
2 2 (50.00%) Technology Roadmap
2 2 (50.00%) Test Automation
2 2 (50.00%) Visualisation
Programming Languages
1 4 (100.00%) SQL
2 2 (50.00%) Java
2 2 (50.00%) JavaScript
Quality Assurance & Compliance
1 2 (50.00%) GDPR
1 2 (50.00%) QA
System Software
1 2 (50.00%) Apache Flume
2 1 (25.00%) HDFS
Vendors
1 4 (100.00%) Microsoft
2 3 (75.00%) Databricks
3 2 (50.00%) Oracle
4 1 (25.00%) Cloudera