Period
to 26 September 2020

The following table provides summary statistics for contract job vacancies with a requirement for HDInsight skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited HDInsight over the 6 months to 26 September 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Microsoft Azure HDInsight
UK
6 months to
26 Sep 2020
Same period 2019 Same period 2018
Rank 473 762 805
Rank change year-on-year +289 +43 +67
Contract jobs citing HDInsight 30 73 104
As % of all contract jobs advertised in the UK 0.10% 0.083% 0.10%
As % of the Database & Business Intelligence category 0.45% 0.38% 0.45%
Number of daily rates quoted 25 48 71
Median daily rate £525 £550 £500
Median daily rate % change year-on-year -4.55% +10.00% -
10th Percentile £474 £404 £363
90th Percentile £600 £700 £645
UK excluding London median daily rate £545 £550 £475
% change year-on-year -0.91% +15.79% +15.15%
Number of hourly rates quoted 0 0 1
Median hourly rate - - £75.00
UK excluding London median hourly rate - - -

HDInsight is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 6,605 19,054 23,363
As % of all contract IT jobs advertised in the UK 22.42% 21.66% 22.73%
Number of daily rates quoted 4,279 12,940 16,380
Median daily rate £500 £475 £475
Median daily rate % change year-on-year +5.26% - +5.56%
10th Percentile £313 £325 £313
90th Percentile £675 £650 £638
UK excluding London median daily rate £450 £433 £425
% change year-on-year +4.05% +1.76% +6.25%
Number of hourly rates quoted 144 262 236
Median hourly rate £35.00 £35.00 £27.62
Median hourly rate % change year-on-year - +26.74% -6.58%
10th Percentile £14.00 £12.64 £13.38
90th Percentile £48.53 £60.00 £56.00
Median hourly rate £26.00 £35.00 £26.00
% change year-on-year -25.71% +34.62% -16.13%

HDInsight
Job Vacancy Trend

Job postings citing HDInsight as a proportion of all IT jobs advertised.

Job vacancy trend for HDInsight in the UK

HDInsight
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing HDInsight.

Daily rate trend for HDInsight in the UK

HDInsight
Daily Rate Histogram

Daily rate distribution for jobs citing HDInsight over the 6 months to 26 September 2020.

Daily rate histogram for HDInsight in the UK

HDInsight
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing HDInsight.

Hourly rate trend for HDInsight in the UK

HDInsight
Top 7 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing HDInsight within the UK over the 6 months to 26 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +275 30 £525 -4.55% 8
UK excluding London +267 26 £545 -0.91% 6
South East +167 14 £520 -5.45% 1
North of England +139 9 £600 - 5
North West - 9 £600 - 5
London +202 4 £525 - 2
East of England - 3 £630 -

For the 6 months to 26 September 2020, IT contractor jobs citing HDInsight also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for HDInsight.

1 30 (100.00%) Azure
1 30 (100.00%) Data Lake
2 28 (93.33%) Business Intelligence
3 27 (90.00%) Microsoft
3 27 (90.00%) Analytics
4 22 (73.33%) PaaS
5 20 (66.67%) SQL
6 16 (53.33%) DevOps
6 16 (53.33%) Power BI
6 16 (53.33%) Power Platform
7 15 (50.00%) Data Management
8 13 (43.33%) IaaS
8 13 (43.33%) SQL Server Integration Services
8 13 (43.33%) Agile Software Development
8 13 (43.33%) Visual Studio
8 13 (43.33%) Windows
8 13 (43.33%) Databricks
8 13 (43.33%) Virtual Machines
9 12 (40.00%) Hadoop
9 12 (40.00%) Big Data
9 12 (40.00%) Data Transformation
10 11 (36.67%) Linux
10 11 (36.67%) Informatica
10 11 (36.67%) Test Automation
10 11 (36.67%) Security Testing
10 11 (36.67%) Data-Driven Testing
11 10 (33.33%) Continuous Integration
11 10 (33.33%) Continuous Delivery
11 10 (33.33%) Hortonworks
12 9 (30.00%) Machine Learning

HDInsight
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 2 (6.67%) Apache Spark
Cloud Services
1 30 (100.00%) Azure
2 22 (73.33%) PaaS
3 16 (53.33%) Power Platform
4 13 (43.33%) IaaS
5 8 (26.67%) Azure Data Factory
6 1 (3.33%) Azure Functions
6 1 (3.33%) Serverless
Database & Business Intelligence
1 30 (100.00%) Data Lake
2 16 (53.33%) Power BI
3 13 (43.33%) SQL Server Integration Services
4 12 (40.00%) Big Data
4 12 (40.00%) Hadoop
5 3 (10.00%) Azure SQL Database
5 3 (10.00%) Semantic Layer
6 1 (3.33%) PolyBase
Development Applications
1 13 (43.33%) Visual Studio
General
1 1 (3.33%) Law
1 1 (3.33%) Pharmaceutical
Job Titles
1 14 (46.67%) DevOps Engineer
2 10 (33.33%) Azure Engineer
3 9 (30.00%) Architect
3 9 (30.00%) Data Architect
3 9 (30.00%) Enterprise Architect
3 9 (30.00%) Enterprise Data Architect
4 7 (23.33%) Data Engineer
5 5 (16.67%) Azure DevOps Engineer
6 4 (13.33%) Hadoop Engineer
6 4 (13.33%) Linux DevOps Engineer
6 4 (13.33%) Linux Engineer
6 4 (13.33%) Linux/Unix DevOps
6 4 (13.33%) Technical Engineer
7 3 (10.00%) Big Data Engineer
7 3 (10.00%) Python Engineer
8 2 (6.67%) Azure DevOps
9 1 (3.33%) Azure Specialist
9 1 (3.33%) Kubernetes Engineer
9 1 (3.33%) Linux Scripter
Libraries, Frameworks & Software Standards
1 3 (10.00%) PySpark
Miscellaneous
1 4 (13.33%) FMCG
2 3 (10.00%) Data Structures
2 3 (10.00%) Management Information System
2 3 (10.00%) Replication
Operating Systems
1 13 (43.33%) Windows
2 11 (36.67%) Linux
Processes & Methodologies
1 28 (93.33%) Business Intelligence
2 27 (90.00%) Analytics
3 16 (53.33%) DevOps
4 15 (50.00%) Data Management
5 13 (43.33%) Agile Software Development
6 12 (40.00%) Data Transformation
7 11 (36.67%) Data-Driven Testing
7 11 (36.67%) Security Testing
7 11 (36.67%) Test Automation
8 10 (33.33%) Continuous Delivery
8 10 (33.33%) Continuous Integration
9 9 (30.00%) Enterprise Architecture
9 9 (30.00%) Machine Learning
9 9 (30.00%) Scrum
9 9 (30.00%) Task Automation
9 9 (30.00%) TOGAF
10 7 (23.33%) Project Delivery
11 6 (20.00%) Data Modelling
12 4 (13.33%) Data Engineering
12 4 (13.33%) Data Science
Programming Languages
1 20 (66.67%) SQL
2 9 (30.00%) Shell Script
3 3 (10.00%) PowerShell
3 3 (10.00%) Python
4 1 (3.33%) C#
4 1 (3.33%) Java
4 1 (3.33%) Scala
Qualifications
1 9 (30.00%) Microsoft Certification
1 9 (30.00%) TOGAF Certification
2 1 (3.33%) BPSS Clearance
Quality Assurance & Compliance
1 3 (10.00%) Data Quality
System Software
1 13 (43.33%) Virtual Machines
2 3 (10.00%) Docker
Systems Management
1 3 (10.00%) Kubernetes
Vendors
1 27 (90.00%) Microsoft
2 13 (43.33%) Databricks
3 11 (36.67%) Informatica
4 10 (33.33%) Hortonworks
5 3 (10.00%) Tableau
5 3 (10.00%) Talend