Period
to 25 November 2020

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 25 November 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
25 Nov 2020
Same period 2019 Same period 2018
Rank 231 282 424
Rank change year-on-year +51 +142 +223
Contract jobs citing Data Lake 388 756 587
As % of all contract jobs advertised in the UK 1.06% 0.92% 0.57%
As % of the Database & Business Intelligence category 4.74% 4.27% 2.53%
Number of daily rates quoted 323 544 402
Median daily rate £525 £550 £525
Median daily rate % change year-on-year -4.55% +4.76% -4.55%
10th Percentile £363 £406 £380
90th Percentile £688 £713 £700
UK excluding London median daily rate £500 £500 £500
Number of hourly rates quoted 3 6 2
Median hourly rate £35.00 £72.50 £49.75
Median hourly rate % change year-on-year -51.72% +45.73% +10.56%
UK excluding London median hourly rate - £72.50 £49.75
% change year-on-year - +45.73% +10.56%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 8,189 17,690 23,184
As % of all contract IT jobs advertised in the UK 22.41% 21.55% 22.64%
Number of daily rates quoted 5,192 11,924 16,154
Median daily rate £480 £475 £475
Median daily rate % change year-on-year +1.13% - +5.56%
10th Percentile £313 £319 £313
90th Percentile £668 £656 £638
UK excluding London median daily rate £431 £438 £425
% change year-on-year -1.49% +2.94% +6.25%
Number of hourly rates quoted 178 264 244
Median hourly rate £35.00 £31.00 £30.00
Median hourly rate % change year-on-year +12.90% +3.33% -3.94%
10th Percentile £14.09 £13.40 £13.78
90th Percentile £55.00 £69.38 £57.45
Median hourly rate £29.00 £30.00 £33.25
% change year-on-year -3.33% -9.77% -5.00%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 25 November 2020.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 25 November 2020.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 25 November 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +44 321 £525 -4.55% 89
London +12 200 £550 - 40
UK excluding London +72 118 £500 - 51
Work from Home -36 118 £513 +10.81% 12
North of England +105 35 £550 +10.00% 23
South East +43 32 £463 -7.50% 14
North West +80 25 £550 +10.00% 17
Midlands +64 22 £475 -9.52% 6
East Midlands +49 12 £472 -16.09% 3
Scotland +61 11 £375 -23.08% 3
West Midlands +53 10 £488 -1.76% 3
South West +76 9 £500 -28.57% 1
Yorkshire +59 9 £550 -4.35% 2
East of England +48 5 £475 -24.00% 4
Wales +37 3 £513 -24.07%
North East +34 2 £475 +2.70% 4
Northern Ireland - 1 £450 -

For the 6 months to 25 November 2020, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 270 (69.59%) Azure
2 182 (46.91%) SQL
3 176 (45.36%) Data Warehouse
4 161 (41.49%) Business Intelligence
5 147 (37.89%) Databricks
6 145 (37.37%) Data Modelling
7 137 (35.31%) Azure Data Factory
8 129 (33.25%) Microsoft
9 114 (29.38%) Python
10 112 (28.87%) Analytics
11 110 (28.35%) Agile Software Development
12 103 (26.55%) Power Platform
13 102 (26.29%) Power BI
14 100 (25.77%) DevOps
15 96 (24.74%) Azure SQL Database
16 92 (23.71%) ETL
17 89 (22.94%) Big Data
18 82 (21.13%) AWS
19 66 (17.01%) Finance
20 62 (15.98%) Data Architecture
21 58 (14.95%) Azure SQL Data Warehouse
22 48 (12.37%) Serverless
23 47 (12.11%) SQL Server
24 46 (11.86%) Data Quality
24 46 (11.86%) Data Engineering
25 43 (11.08%) Data Governance
26 40 (10.31%) Data Management
27 38 (9.79%) Data Analysis
28 37 (9.54%) Git (software)
29 36 (9.28%) Migration

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 35 (9.02%) Apache Spark
2 13 (3.35%) Confluence
3 11 (2.84%) Apache
4 8 (2.06%) Elasticsearch
5 6 (1.55%) ArcGIS
5 6 (1.55%) SAS
6 4 (1.03%) Apache Pig
7 2 (0.52%) Apache Synapse
7 2 (0.52%) CMS
7 2 (0.52%) SharePoint
8 1 (0.26%) Adobe Experience Manager
Applications
1 4 (1.03%) Microsoft Excel
1 4 (1.03%) Microsoft Office
1 4 (1.03%) Microsoft PowerPoint
1 4 (1.03%) MS Visio
2 1 (0.26%) SPSS
Business Applications
1 6 (1.55%) SAP S/4HANA
2 4 (1.03%) SAP Oil and Gas
3 3 (0.77%) Dynamics CRM
3 3 (0.77%) SAP CRM
3 3 (0.77%) SAP IS-U
3 3 (0.77%) SAP MDG
4 2 (0.52%) Aligne
4 2 (0.52%) SAP APO
4 2 (0.52%) SAP ERP
5 1 (0.26%) Bloomberg AIM
5 1 (0.26%) Dynamics AX
5 1 (0.26%) Markit EDM
5 1 (0.26%) Oracle EBS
5 1 (0.26%) SAP FI-CA
5 1 (0.26%) SAP MM
5 1 (0.26%) SimCorp Dimension
5 1 (0.26%) thinkFolio
Cloud Services
1 270 (69.59%) Azure
2 137 (35.31%) Azure Data Factory
3 103 (26.55%) Power Platform
4 82 (21.13%) AWS
5 48 (12.37%) Serverless
6 33 (8.51%) Azure Functions
7 28 (7.22%) AWS Lambda
8 27 (6.96%) Amazon S3
9 23 (5.93%) Logic Apps
10 19 (4.90%) GCP
11 18 (4.64%) PaaS
12 14 (3.61%) Amazon EMR
13 13 (3.35%) Dynamics 365
14 11 (2.84%) Amazon Kinesis
14 11 (2.84%) Azure Active Directory
15 10 (2.58%) Amazon SageMaker
16 9 (2.32%) AWS Fargate
17 8 (2.06%) AWS CloudFormation
18 7 (1.80%) Amazon EC2
19 6 (1.55%) SaaS
Communications & Networking
1 3 (0.77%) WAN
2 2 (0.52%) Extranet
2 2 (0.52%) Internet
2 2 (0.52%) LAN
2 2 (0.52%) Skype
2 2 (0.52%) TCP/IP
2 2 (0.52%) Wi-Fi
2 2 (0.52%) X.21
3 1 (0.26%) Firewall
3 1 (0.26%) VLAN
3 1 (0.26%) VPN
Database & Business Intelligence
1 176 (45.36%) Data Warehouse
2 102 (26.29%) Power BI
3 96 (24.74%) Azure SQL Database
4 89 (22.94%) Big Data
5 58 (14.95%) Azure SQL Data Warehouse
6 47 (12.11%) SQL Server
7 35 (9.02%) Cosmos DB
8 29 (7.47%) Hadoop
9 28 (7.22%) SQL Server Integration Services
10 26 (6.70%) NoSQL
10 26 (6.70%) Relational Database
11 24 (6.19%) Amazon Athena
12 22 (5.67%) Amazon Redshift
13 20 (5.15%) HDInsight
14 19 (4.90%) Tableau
15 18 (4.64%) Apache Hive
15 18 (4.64%) SQL Server Analysis Services
16 17 (4.38%) Microsoft Analysis Services
17 16 (4.12%) Amazon DynamoDB
18 15 (3.87%) MySQL
Development Applications
1 37 (9.54%) Git (software)
2 24 (6.19%) Jenkins
3 23 (5.93%) JIRA
4 17 (4.38%) Visual Studio Team System
5 14 (3.61%) GitLab
6 9 (2.32%) kappa
7 7 (1.80%) ERwin
8 5 (1.29%) Atlassian Bamboo
8 5 (1.29%) CircleCI
9 4 (1.03%) PowerDesigner
9 4 (1.03%) Selenium
9 4 (1.03%) Subversion
9 4 (1.03%) Team Foundation Server
9 4 (1.03%) Terragrunt
10 3 (0.77%) Artifactory
10 3 (0.77%) ER Studio
10 3 (0.77%) JUnit
10 3 (0.77%) SonarQube
10 3 (0.77%) Visual Studio
11 2 (0.52%) TeamCity
General
1 66 (17.01%) Finance
2 23 (5.93%) Marketing
3 19 (4.90%) Public Sector
4 12 (3.09%) Banking
5 8 (2.06%) Advertising
5 8 (2.06%) Manufacturing
5 8 (2.06%) Retail
6 5 (1.29%) Pharmaceutical
6 5 (1.29%) Publishing
7 4 (1.03%) Back Office
7 4 (1.03%) Legal
8 3 (0.77%) Law
9 2 (0.52%) Electronics
9 2 (0.52%) German Language
9 2 (0.52%) Telecoms
10 1 (0.26%) Financial Institution
10 1 (0.26%) Games
10 1 (0.26%) General Ledger
10 1 (0.26%) Investment Banking
10 1 (0.26%) Polish Language
Job Titles
1 124 (31.96%) Architect
2 109 (28.09%) Data Engineer
3 88 (22.68%) Data Architect
4 72 (18.56%) Developer
5 55 (14.18%) Azure Engineer
6 37 (9.54%) Azure Developer
7 36 (9.28%) Analyst
8 34 (8.76%) Azure Architect
9 28 (7.22%) AWS Engineer
10 19 (4.90%) Python Engineer
11 18 (4.64%) Solutions Architect
12 17 (4.38%) Business Analyst
12 17 (4.38%) Business Intelligence Developer
13 14 (3.61%) Enterprise Data Architect
14 13 (3.35%) Consultant
14 13 (3.35%) Data Business Analyst
14 13 (3.35%) Enterprise Architect
15 11 (2.84%) Cloud Architect
15 11 (2.84%) Technical Analyst
15 11 (2.84%) Technical Business Analyst
Libraries, Frameworks & Software Standards
1 35 (9.02%) PySpark
2 29 (7.47%) Kafka
3 23 (5.93%) .NET
4 12 (3.09%) JSON
5 11 (2.84%) REST
6 9 (2.32%) XML
7 6 (1.55%) GraphQL
8 5 (1.29%) Akka
8 5 (1.29%) Spark Streaming
8 5 (1.29%) Web Services
9 4 (1.03%) React
10 3 (0.77%) .NET Core
10 3 (0.77%) .NET Framework
10 3 (0.77%) Apache NiFi
10 3 (0.77%) MDX
10 3 (0.77%) Middleware
10 3 (0.77%) MLlib
10 3 (0.77%) scikit-learn
11 2 (0.52%) YAML
12 1 (0.26%) OAuth
Miscellaneous
1 32 (8.25%) Analytical Skills
2 27 (6.96%) Data Structures
3 26 (6.70%) Greenfield Project
4 21 (5.41%) Management Information System
5 8 (2.06%) Cloud Native
5 8 (2.06%) FMCG
6 6 (1.55%) Public Cloud
6 6 (1.55%) Reference Data
6 6 (1.55%) User Experience
6 6 (1.55%) Virtual Team
7 5 (1.29%) Data Centre
7 5 (1.29%) Replication
8 4 (1.03%) Algorithms
8 4 (1.03%) Enterprise Software
8 4 (1.03%) NHS
9 3 (0.77%) Market Risk
9 3 (0.77%) SCADA
10 2 (0.52%) Client/Server
10 2 (0.52%) Credit Risk
10 2 (0.52%) Taxonomies
Operating Systems
1 14 (3.61%) Linux
2 12 (3.09%) Windows
3 6 (1.55%) Android
3 6 (1.55%) Apple iOS
4 4 (1.03%) Debian
4 4 (1.03%) Red Hat Enterprise Linux
4 4 (1.03%) Ubuntu
5 3 (0.77%) Unix
6 2 (0.52%) VMS
6 2 (0.52%) Windows 10
Processes & Methodologies
1 161 (41.49%) Business Intelligence
2 145 (37.37%) Data Modelling
3 112 (28.87%) Analytics
4 110 (28.35%) Agile Software Development
5 100 (25.77%) DevOps
6 92 (23.71%) ETL
7 62 (15.98%) Data Architecture
8 46 (11.86%) Data Engineering
9 43 (11.08%) Data Governance
10 40 (10.31%) Data Management
11 38 (9.79%) Data Analysis
12 36 (9.28%) Migration
13 35 (9.02%) Machine Learning
13 35 (9.02%) Scrum
14 32 (8.25%) Problem-Solving
15 31 (7.99%) Microservices
16 29 (7.47%) Visualisation
17 28 (7.22%) Kimball Methodology
17 28 (7.22%) Master Data Management
17 28 (7.22%) TOGAF
Programming Languages
1 182 (46.91%) SQL
2 114 (29.38%) Python
3 28 (7.22%) C#
4 27 (6.96%) T-SQL
5 22 (5.67%) PowerShell
6 15 (3.87%) Java
7 13 (3.35%) JavaScript
8 11 (2.84%) R
9 10 (2.58%) Bash Shell
10 8 (2.06%) Scala
11 7 (1.80%) C
12 6 (1.55%) Perl
12 6 (1.55%) PHP
13 5 (1.29%) Data Analysis Expressions (DAX)
14 3 (0.77%) TypeScript
14 3 (0.77%) U-SQL
15 2 (0.52%) Shell Script
16 1 (0.26%) PROC SQL
16 1 (0.26%) SAS Macro
16 1 (0.26%) VB
Qualifications
1 16 (4.12%) TOGAF Certification
2 15 (3.87%) Security Cleared
3 12 (3.09%) SC Cleared
4 10 (2.58%) Microsoft Certification
5 8 (2.06%) AWS Certification
6 7 (1.80%) Degree
7 4 (1.03%) Computer Science Degree
7 4 (1.03%) CTC Cleared
8 1 (0.26%) ISTQB
8 1 (0.26%) ITIL Certification
8 1 (0.26%) MCSA
8 1 (0.26%) MCSE
8 1 (0.26%) MCTS
Quality Assurance & Compliance
1 46 (11.86%) Data Quality
2 31 (7.99%) QA
3 3 (0.77%) GDPR
4 2 (0.52%) Sarbanes-Oxley
5 1 (0.26%) IFRS
5 1 (0.26%) PMO
5 1 (0.26%) SLA
System Software
1 25 (6.44%) Docker
2 11 (2.84%) Active Directory
3 8 (2.06%) HDFS
4 6 (1.55%) Apache Flume
5 3 (0.77%) Apache ZooKeeper
5 3 (0.77%) Virtual Machines
6 1 (0.26%) VMware ESXi
6 1 (0.26%) VMware Infrastructure
Systems Management
1 27 (6.96%) Kubernetes
2 20 (5.15%) Terraform
3 8 (2.06%) Grafana
4 7 (1.80%) Hadoop YARN
4 7 (1.80%) Opscode Chef
5 6 (1.55%) Prometheus
6 4 (1.03%) Ansible
7 3 (0.77%) Nagios
8 2 (0.52%) Puppet
9 1 (0.26%) HP Quality Center
9 1 (0.26%) MIIS
9 1 (0.26%) Oozie
Vendors
1 147 (37.89%) Databricks
2 129 (33.25%) Microsoft
3 34 (8.76%) SAP
4 16 (4.12%) Salesforce.com
5 14 (3.61%) Oracle
6 9 (2.32%) MuleSoft
7 8 (2.06%) Cloudera
7 8 (2.06%) Informatica
7 8 (2.06%) Talend
8 7 (1.80%) BiZZdesign
8 7 (1.80%) Google
9 6 (1.55%) ESRI
10 5 (1.29%) Atlassian
11 4 (1.03%) Alteryx
11 4 (1.03%) Red Hat
11 4 (1.03%) Sage
11 4 (1.03%) Sparx
11 4 (1.03%) Teradata
11 4 (1.03%) VMware
12 3 (0.77%) New Relic