Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 19 September 2020

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 19 September 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
19 Sep 2020		 Same period 2019 Same period 2018
Rank 231 309 474
Rank change year-on-year +78 +165 +223
Contract jobs citing Data Lake 325 770 501
As % of all contract jobs advertised in the UK 1.10% 0.87% 0.49%
As % of the Database & Business Intelligence category 4.93% 4.01% 2.14%
Number of daily rates quoted 254 573 335
Median daily rate £528 £525 £515
Median daily rate % change year-on-year +0.48% +1.94% -6.36%
10th Percentile £407 £406 £383
90th Percentile £688 £688 £716
UK excluding London median daily rate £550 £500 £500
% change year-on-year +10.00% - -4.76%
Number of hourly rates quoted 2 6 3
Median hourly rate £51.25 £72.50 £50.00
Median hourly rate % change year-on-year -29.31% +45.00% +11.11%
10th Percentile £37.88 £53.13 £43.80
90th Percentile £67.63 £73.75 £56.00
UK excluding London median hourly rate £67.50 £72.50 £50.00
% change year-on-year -6.90% +45.00% +11.11%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 6,586 19,193 23,434
As % of all contract IT jobs advertised in the UK 22.29% 21.60% 22.73%
Number of daily rates quoted 4,276 13,052 16,431
Median daily rate £500 £475 £475
Median daily rate % change year-on-year +5.26% - +5.56%
10th Percentile £315 £325 £313
90th Percentile £675 £650 £638
UK excluding London median daily rate £450 £438 £425
% change year-on-year +2.86% +2.94% +6.25%
Number of hourly rates quoted 139 254 238
Median hourly rate £35.00 £35.00 £29.75
Median hourly rate % change year-on-year - +17.65% +0.85%
10th Percentile £14.00 £12.66 £13.43
90th Percentile £50.66 £60.00 £56.01
Median hourly rate £32.94 £35.00 £29.50
% change year-on-year -5.89% +18.64% -1.67%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 19 September 2020.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 19 September 2020.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 19 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +65 285 £550 +4.76% 92
London +42 163 £550 - 41
UK excluding London +115 125 £550 +10.00% 62
Work from Home -9 62 £550 -8.33% 3
South East +80 55 £520 +4.00% 11
North of England +113 26 £550 +10.00% 26
North West +87 24 £550 +10.00% 14
East of England +78 13 £653 +12.26%
Scotland +65 12 £425 -15.00% 11
South West +83 9 £481 -31.25% 3
Midlands +85 8 £650 +52.94% 9
West Midlands +63 5 £650 +64.56% 2
East Midlands +63 3 - - 6
Yorkshire +81 2 £550 +10.00% 10
Wales +34 2 £513 -24.07%
North East +40 1 £550 +18.92% 2

For the 6 months to 19 September 2020, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 249 (76.62%) Azure
2 160 (49.23%) SQL
3 152 (46.77%) Business Intelligence
4 150 (46.15%) Data Warehouse
5 137 (42.15%) Analytics
6 133 (40.92%) Microsoft
7 120 (36.92%) Azure Data Factory
8 119 (36.62%) Databricks
8 119 (36.62%) Agile Software Development
9 113 (34.77%) DevOps
10 108 (33.23%) Data Modelling
11 98 (30.15%) Power Platform
12 97 (29.85%) Power BI
13 80 (24.62%) Python
13 80 (24.62%) Big Data
14 71 (21.85%) ETL
15 70 (21.54%) Azure SQL Database
16 64 (19.69%) AWS
17 56 (17.23%) Finance
18 51 (15.69%) Scrum
19 50 (15.38%) Data Architecture
20 49 (15.08%) SQL Server
20 49 (15.08%) Azure SQL Data Warehouse
21 43 (13.23%) Data Engineering
22 42 (12.92%) SQL Server Integration Services
23 40 (12.31%) C#
24 39 (12.00%) Test Automation
25 38 (11.69%) Apache Spark
25 38 (11.69%) Data Management
26 36 (11.08%) Cosmos DB

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 38 (11.69%) Apache Spark
2 9 (2.77%) Confluence
3 8 (2.46%) Elasticsearch
4 7 (2.15%) Apache
5 4 (1.23%) Apache Pig
6 3 (0.92%) SharePoint
7 1 (0.31%) SAS
Applications
1 3 (0.92%) Microsoft Excel
1 3 (0.92%) Microsoft Office
1 3 (0.92%) Microsoft PowerPoint
2 1 (0.31%) Spreadsheet
2 1 (0.31%) SPSS
Business Applications
1 5 (1.54%) SAP S/4HANA
2 4 (1.23%) SAP Oil and Gas
3 3 (0.92%) SAP MDG
4 2 (0.62%) Dynamics AX
4 2 (0.62%) SAP APO
4 2 (0.62%) Sparx Enterprise Architect
5 1 (0.31%) Bloomberg AIM
5 1 (0.31%) FINCAD Analytics
5 1 (0.31%) Markit EDM
5 1 (0.31%) SAP ERP
5 1 (0.31%) SAP FI-CA
5 1 (0.31%) SAP MM
5 1 (0.31%) SimCorp Dimension
5 1 (0.31%) thinkFolio
Cloud Services
1 249 (76.62%) Azure
2 120 (36.92%) Azure Data Factory
3 98 (30.15%) Power Platform
4 64 (19.69%) AWS
5 32 (9.85%) Serverless
6 31 (9.54%) PaaS
7 26 (8.00%) Amazon S3
8 25 (7.69%) Logic Apps
9 23 (7.08%) Azure Functions
10 20 (6.15%) AWS Lambda
11 17 (5.23%) Amazon EMR
12 14 (4.31%) IaaS
13 13 (4.00%) GCP
14 11 (3.38%) Amazon Kinesis
14 11 (3.38%) Azure Active Directory
15 9 (2.77%) Amazon SQS
16 8 (2.46%) Amazon SageMaker
17 7 (2.15%) Amazon EC2
17 7 (2.15%) Dynamics 365
18 6 (1.85%) PowerApps
Communications & Networking
1 2 (0.62%) Extranet
1 2 (0.62%) Internet
1 2 (0.62%) Skype
1 2 (0.62%) WAN
2 1 (0.31%) LAN
2 1 (0.31%) TCP/IP
2 1 (0.31%) VLAN
2 1 (0.31%) VPN
2 1 (0.31%) Wi-Fi
Database & Business Intelligence
1 150 (46.15%) Data Warehouse
2 97 (29.85%) Power BI
3 80 (24.62%) Big Data
4 70 (21.54%) Azure SQL Database
5 49 (15.08%) Azure SQL Data Warehouse
5 49 (15.08%) SQL Server
6 42 (12.92%) SQL Server Integration Services
7 36 (11.08%) Cosmos DB
8 34 (10.46%) Hadoop
9 30 (9.23%) HDInsight
10 24 (7.38%) MySQL
10 24 (7.38%) Relational Database
11 23 (7.08%) Apache Hive
12 21 (6.46%) NoSQL
13 20 (6.15%) Amazon Redshift
14 16 (4.92%) Amazon DynamoDB
14 16 (4.92%) Microsoft Analysis Services
15 15 (4.62%) SQL Server Analysis Services
16 14 (4.31%) Amazon Athena
17 12 (3.69%) Amazon RDS
Development Applications
1 31 (9.54%) Git (software)
2 23 (7.08%) Visual Studio Team System
3 16 (4.92%) Visual Studio
4 15 (4.62%) GitLab
4 15 (4.62%) Jenkins
5 10 (3.08%) JIRA
6 8 (2.46%) Artifactory
7 5 (1.54%) CircleCI
7 5 (1.54%) kappa
7 5 (1.54%) Selenium
7 5 (1.54%) Subversion
7 5 (1.54%) Team Foundation Server
8 4 (1.23%) JUnit
8 4 (1.23%) SonarQube
9 3 (0.92%) ER Studio
9 3 (0.92%) ERwin
9 3 (0.92%) SpecFlow
10 2 (0.62%) Octopus Deploy
10 2 (0.62%) TeamCity
11 1 (0.31%) Sonatype Nexus
General
1 56 (17.23%) Finance
2 18 (5.54%) Marketing
3 12 (3.69%) Public Sector
4 7 (2.15%) Banking
4 7 (2.15%) Pharmaceutical
5 5 (1.54%) Advertising
6 4 (1.23%) Front Office
6 4 (1.23%) Law
6 4 (1.23%) Legal
6 4 (1.23%) Manufacturing
7 3 (0.92%) Retail
8 2 (0.62%) Games
8 2 (0.62%) German Language
9 1 (0.31%) Back Office
9 1 (0.31%) Billing
9 1 (0.31%) Electronics
9 1 (0.31%) Police
9 1 (0.31%) Polish Language
9 1 (0.31%) Publishing
9 1 (0.31%) Telecoms
Job Titles
1 91 (28.00%) Architect
2 76 (23.38%) Data Architect
3 73 (22.46%) Data Engineer
4 68 (20.92%) Developer
5 50 (15.38%) Azure Engineer
6 34 (10.46%) Azure Developer
7 28 (8.62%) DevOps Engineer
8 25 (7.69%) Azure Architect
9 19 (5.85%) Analyst
10 17 (5.23%) Business Intelligence Developer
11 16 (4.92%) Azure DevOps
11 16 (4.92%) Azure DevOps Engineer
12 14 (4.31%) Business Analyst
12 14 (4.31%) Lead DevOps
13 13 (4.00%) Enterprise Data Architect
14 12 (3.69%) AWS Engineer
14 12 (3.69%) Data Business Analyst
14 12 (3.69%) Python Engineer
15 11 (3.38%) Business Intelligence Analyst
15 11 (3.38%) Enterprise Architect
Libraries, Frameworks & Software Standards
1 29 (8.92%) Kafka
2 25 (7.69%) PySpark
3 20 (6.15%) .NET
4 9 (2.77%) JSON
5 7 (2.15%) XML
6 6 (1.85%) React
6 6 (1.85%) Web Services
7 5 (1.54%) Akka
7 5 (1.54%) Apache NiFi
7 5 (1.54%) Spark Streaming
8 4 (1.23%) .NET Core
8 4 (1.23%) ADO
9 3 (0.92%) .NET Framework
9 3 (0.92%) MDX
9 3 (0.92%) Middleware
9 3 (0.92%) Node.js
9 3 (0.92%) NumPy
9 3 (0.92%) RESTful
9 3 (0.92%) scikit-learn
9 3 (0.92%) SciPy
Miscellaneous
1 28 (8.62%) Analytical Skills
2 22 (6.77%) Management Information System
3 21 (6.46%) Data Structures
4 20 (6.15%) Greenfield Project
5 10 (3.08%) FMCG
6 6 (1.85%) Data Centre
6 6 (1.85%) Reference Data
6 6 (1.85%) User Experience
7 5 (1.54%) Taxonomies
7 5 (1.54%) Virtual Team
8 4 (1.23%) Cloud Native
8 4 (1.23%) Enterprise Software
8 4 (1.23%) PMI
9 3 (0.92%) Replication
10 2 (0.62%) Algorithms
10 2 (0.62%) Blog
10 2 (0.62%) Client/Server
10 2 (0.62%) Credit Risk
10 2 (0.62%) Derivative
10 2 (0.62%) Fixed Income
Operating Systems
1 24 (7.38%) Linux
2 22 (6.77%) Windows
3 8 (2.46%) VMS
4 4 (1.23%) Debian
4 4 (1.23%) Red Hat Enterprise Linux
4 4 (1.23%) Ubuntu
5 3 (0.92%) Unix
Processes & Methodologies
1 152 (46.77%) Business Intelligence
2 137 (42.15%) Analytics
3 119 (36.62%) Agile Software Development
4 113 (34.77%) DevOps
5 108 (33.23%) Data Modelling
6 71 (21.85%) ETL
7 51 (15.69%) Scrum
8 50 (15.38%) Data Architecture
9 43 (13.23%) Data Engineering
10 39 (12.00%) Test Automation
11 38 (11.69%) Data Management
12 34 (10.46%) Data Governance
13 33 (10.15%) Machine Learning
14 32 (9.85%) Migration
15 31 (9.54%) Data Ingestion
15 31 (9.54%) Data Integration
16 29 (8.92%) Data Analysis
16 29 (8.92%) Visualisation
17 27 (8.31%) Continuous Integration
18 26 (8.00%) Problem-Solving
Programming Languages
1 160 (49.23%) SQL
2 80 (24.62%) Python
3 40 (12.31%) C#
4 34 (10.46%) Java
5 30 (9.23%) PowerShell
6 29 (8.92%) T-SQL
7 16 (4.92%) JavaScript
8 11 (3.38%) Scala
9 10 (3.08%) Shell Script
10 8 (2.46%) R
11 7 (2.15%) C
12 6 (1.85%) PHP
13 5 (1.54%) Data Analysis Expressions (DAX)
14 4 (1.23%) Perl
15 2 (0.62%) Bash Shell
15 2 (0.62%) C++
15 2 (0.62%) TypeScript
15 2 (0.62%) VBA
16 1 (0.31%) PROC SQL
16 1 (0.31%) U-SQL
Qualifications
1 14 (4.31%) Microsoft Certification
2 13 (4.00%) Security Cleared
3 10 (3.08%) TOGAF Certification
4 9 (2.77%) SC Cleared
5 5 (1.54%) AWS Certification
5 5 (1.54%) Degree
6 4 (1.23%) CTC Cleared
6 4 (1.23%) PMI Certification
7 1 (0.31%) BPSS Clearance
7 1 (0.31%) Computer Science Degree
7 1 (0.31%) ISTQB
7 1 (0.31%) ITIL Certification
7 1 (0.31%) MCSA
7 1 (0.31%) MCSE
7 1 (0.31%) MCTS
Quality Assurance & Compliance
1 35 (10.77%) Data Quality
2 22 (6.77%) QA
3 5 (1.54%) GDPR
4 2 (0.62%) GxP
4 2 (0.62%) Sarbanes-Oxley
System Software
1 17 (5.23%) Docker
2 15 (4.62%) Virtual Machines
3 11 (3.38%) Active Directory
4 6 (1.85%) Apache Flume
5 3 (0.92%) Apache ZooKeeper
5 3 (0.92%) HDFS
Systems Management
1 17 (5.23%) Kubernetes
2 10 (3.08%) Terraform
3 4 (1.23%) Nagios
4 3 (0.92%) Ansible
5 2 (0.62%) Hadoop YARN
5 2 (0.62%) Puppet
6 1 (0.31%) HP Quality Center
6 1 (0.31%) MIIS
6 1 (0.31%) Oozie
6 1 (0.31%) Opscode Chef
Vendors
1 133 (40.92%) Microsoft
2 119 (36.62%) Databricks
3 21 (6.46%) SAP
4 19 (5.85%) Informatica
4 19 (5.85%) Tableau
5 17 (5.23%) Oracle
6 16 (4.92%) Talend
7 10 (3.08%) Hortonworks
8 7 (2.15%) Cloudera
8 7 (2.15%) Google
9 6 (1.85%) MuleSoft
10 5 (1.54%) Salesforce.com
10 5 (1.54%) Teradata
11 4 (1.23%) New Relic
11 4 (1.23%) Red Hat
11 4 (1.23%) Sparx
11 4 (1.23%) StreamSets
12 3 (0.92%) IBM
13 2 (0.62%) Ab Initio
13 2 (0.62%) Bloomberg