Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 24 July 2021

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 24 July 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
24 Jul 2021		 Same period 2020 Same period 2019
Rank 182 250 334
Rank change year-on-year +68 +84 +134
Contract jobs citing Data Lake 1,051 384 735
As % of all contract jobs advertised in the UK 1.48% 1.02% 0.80%
As % of the Database & Business Intelligence category 6.94% 4.64% 3.53%
Number of daily rates quoted 699 277 554
10th Percentile £396 £406 £406
25th Percentile £440 £463 £451
Median daily rate (50th Percentile) £525 £525 £525
75th Percentile £613 £644 £613
90th Percentile £713 £700 £688
UK excluding London median daily rate £493 £521 £500
% change year-on-year -5.52% +4.25% +2.56%
Number of hourly rates quoted 7 2 3
10th Percentile £28.70 £57.68 "
25th Percentile £34.38 £58.69 £71.25
Median hourly rate £50.00 £63.25 £72.50
Median % change year-on-year -20.95% -12.76% +53.44%
75th Percentile £53.38 £68.69 £73.75
90th Percentile £63.14 £70.23 "
UK excluding London median hourly rate - £67.50 £72.50
% change year-on-year - -6.90% +45.00%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 15,153 8,280 20,824
As % of all contract IT jobs advertised in the UK 21.29% 22.07% 22.65%
Number of daily rates quoted 10,409 5,733 14,398
10th Percentile £338 £325 £325
25th Percentile £413 £406 £400
Median daily rate (50th Percentile) £500 £500 £475
Median % change year-on-year - +5.26% +2.70%
75th Percentile £611 £600 £575
90th Percentile £700 £688 £650
UK excluding London median daily rate £450 £450 £433
% change year-on-year - +4.05% +4.85%
Number of hourly rates quoted 219 114 257
10th Percentile £11.79 £12.63 £13.45
25th Percentile £19.00 £17.77 £17.63
Median hourly rate £27.00 £22.50 £30.00
Median % change year-on-year +20.00% -25.00% -6.25%
75th Percentile £44.72 £43.12 £50.00
90th Percentile £62.00 £63.79 £60.00
UK excluding London median hourly rate £26.00 £21.57 £30.00
% change year-on-year +20.54% -28.10% -2.44%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 24 July 2021.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 24 July 2021.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 24 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +63 835 £525 - 256
London +48 498 £550 - 117
Work from Home -36 345 £515 -8.85% 42
UK excluding London +12 297 £493 -5.52% 148
South East -44 91 £511 -2.34% 39
North of England +26 79 £450 -5.26% 35
Midlands +9 50 £475 -22.45% 37
Yorkshire +26 48 £428 -14.50% 12
North West -2 29 £475 - 21
East Midlands +6 25 £438 -2.78% 14
South West -1 25 £575 +7.78% 10
West Midlands -18 25 £483 -25.77% 23
Scotland -46 19 £550 +22.22% 8
Wales +6 18 £440 -14.15% 2
East of England -28 15 £450 -12.20% 17
North East - 2 £625 - 2

For the 6 months to 24 July 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 727 (69.17%) Azure
2 524 (49.86%) SQL
3 405 (38.53%) Databricks
4 389 (37.01%) Data Warehouse
5 382 (36.35%) Azure Data Factory
6 345 (32.83%) DevOps
7 343 (32.64%) Analytics
8 332 (31.59%) Data Modelling
9 331 (31.49%) Business Intelligence
10 326 (31.02%) Agile Software Development
11 321 (30.54%) Python
12 315 (29.97%) Microsoft
13 278 (26.45%) Power Platform
14 271 (25.78%) ETL
15 259 (24.64%) Power BI
16 229 (21.79%) Azure SQL Database
17 212 (20.17%) Azure Synapse Analytics
18 204 (19.41%) Big Data
19 203 (19.31%) AWS
20 182 (17.32%) Finance
21 172 (16.37%) Data Pipeline
22 169 (16.08%) Social Skills
23 168 (15.98%) SQL Server
24 163 (15.51%) Data Engineering
25 154 (14.65%) Migration
26 153 (14.56%) Scrum
27 145 (13.80%) Apache Spark
28 136 (12.94%) Serverless
29 126 (11.99%) Hadoop
30 120 (11.42%) Data Architecture

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 145 (13.80%) Apache Spark
2 49 (4.66%) Apache
3 37 (3.52%) Apache Airflow
3 37 (3.52%) SharePoint
4 11 (1.05%) Apache Pig
4 11 (1.05%) SAS
5 10 (0.95%) Confluence
6 8 (0.76%) Jupyter
7 7 (0.67%) Elasticsearch
8 6 (0.57%) Oracle Workflow
8 6 (0.57%) WebLogic
9 4 (0.38%) MQSeries
9 4 (0.38%) Oracle Coherence
10 3 (0.29%) ArcGIS
10 3 (0.29%) JBoss
11 2 (0.19%) Camunda
11 2 (0.19%) Cloud Foundry
11 2 (0.19%) Luigi
11 2 (0.19%) MS Exchange
12 1 (0.095%) Apache Synapse
Applications
1 12 (1.14%) Microsoft Excel
2 8 (0.76%) Microsoft Office
3 5 (0.48%) SPSS
4 3 (0.29%) Microsoft PowerPoint
5 2 (0.19%) Oracle Smart View
6 1 (0.095%) MS Visio
Business Applications
1 20 (1.90%) Dynamics CRM
2 5 (0.48%) Maximo
3 3 (0.29%) NetSuite
3 3 (0.29%) Unit4 Business World
4 2 (0.19%) Eloqua
4 2 (0.19%) SAP Oil and Gas
4 2 (0.19%) SAP S/4HANA
4 2 (0.19%) Temenos T24
5 1 (0.095%) Adobe Campaign
5 1 (0.095%) Aligne
5 1 (0.095%) Dynamics AX
5 1 (0.095%) Oracle EBS
5 1 (0.095%) SAP APO
5 1 (0.095%) SAP CRM
5 1 (0.095%) SAP ERP
5 1 (0.095%) SAP IBP
5 1 (0.095%) Sparx Enterprise Architect
5 1 (0.095%) Traffica
Cloud Services
1 727 (69.17%) Azure
2 382 (36.35%) Azure Data Factory
3 278 (26.45%) Power Platform
4 212 (20.17%) Azure Synapse Analytics
5 203 (19.31%) AWS
6 136 (12.94%) Serverless
7 108 (10.28%) Azure Cosmos DB
8 76 (7.23%) PaaS
9 72 (6.85%) Azure Functions
10 69 (6.57%) Azure Storage
11 64 (6.09%) GCP
12 60 (5.71%) Amazon S3
13 55 (5.23%) AWS Lambda
14 44 (4.19%) Azure Key Vault
15 40 (3.81%) IaaS
16 39 (3.71%) Dynamics 365
16 39 (3.71%) Snowflake
17 38 (3.62%) Azure Active Directory
18 36 (3.43%) Microsoft 365
19 34 (3.24%) Azure Stack
Communications & Networking
1 18 (1.71%) Firewall
2 9 (0.86%) FTP
3 6 (0.57%) Cisco ASA
4 5 (0.48%) HTTP
5 3 (0.29%) MQTT
5 3 (0.29%) NAS
6 2 (0.19%) Unified Communications
7 1 (0.095%) Cisco IPT
7 1 (0.095%) DNS
7 1 (0.095%) Extranet
7 1 (0.095%) Internet
7 1 (0.095%) LAN
7 1 (0.095%) MPLS
7 1 (0.095%) SSL
7 1 (0.095%) WAN
7 1 (0.095%) Wi-Fi
Database & Business Intelligence
1 389 (37.01%) Data Warehouse
2 259 (24.64%) Power BI
3 229 (21.79%) Azure SQL Database
4 204 (19.41%) Big Data
5 168 (15.98%) SQL Server
6 126 (11.99%) Hadoop
7 96 (9.13%) SQL Server Integration Services
8 94 (8.94%) Azure SQL Data Warehouse
9 88 (8.37%) SQL Server Analysis Services
10 83 (7.90%) Metadata
11 79 (7.52%) SQL Server Reporting Services
12 65 (6.18%) Relational Database
13 62 (5.90%) NoSQL
14 60 (5.71%) Apache Hive
15 43 (4.09%) Microsoft Analysis Services
16 41 (3.90%) Tableau
17 37 (3.52%) Enterprise Data Warehouse
17 37 (3.52%) MongoDB
18 31 (2.95%) PostgreSQL
19 29 (2.76%) Amazon Redshift
Development Applications
1 80 (7.61%) Git (software)
2 51 (4.85%) JIRA
3 47 (4.47%) Jenkins
4 44 (4.19%) Visual Studio
5 28 (2.66%) kappa
6 27 (2.57%) PowerDesigner
7 24 (2.28%) GitLab
8 11 (1.05%) ER Studio
9 10 (0.95%) ERwin
10 9 (0.86%) Visual Studio Team System
11 8 (0.76%) Maven
11 8 (0.76%) Subversion
12 7 (0.67%) Octopus Deploy
12 7 (0.67%) Sonatype Nexus
12 7 (0.67%) SpecFlow
13 6 (0.57%) MLflow
14 5 (0.48%) Cucumber
15 4 (0.38%) Bitbucket
15 4 (0.38%) SQL Server Management Studio (SSMS)
16 3 (0.29%) TeamCity
General
1 182 (17.32%) Finance
2 169 (16.08%) Social Skills
3 84 (7.99%) Analytical Skills
4 58 (5.52%) Banking
5 37 (3.52%) Public Sector
5 37 (3.52%) Retail
6 24 (2.28%) Marketing
7 22 (2.09%) Presentation Skills
8 21 (2.00%) Legal
9 15 (1.43%) Influencing Skills
10 11 (1.05%) Front Office
11 10 (0.95%) Documentation Skills
11 10 (0.95%) Games
12 9 (0.86%) Law
12 9 (0.86%) Manufacturing
13 7 (0.67%) Publishing
13 7 (0.67%) Retail Banking
13 7 (0.67%) Telecoms
14 4 (0.38%) General Ledger
14 4 (0.38%) Investment Banking
Job Titles
1 333 (31.68%) Data Engineer
2 232 (22.07%) Architect
3 204 (19.41%) Azure Engineer
4 143 (13.61%) Data Architect
5 118 (11.23%) Developer
6 85 (8.09%) Azure Architect
7 76 (7.23%) Analyst
7 76 (7.23%) Solutions Architect
8 53 (5.04%) DevOps Engineer
9 47 (4.47%) Project Manager
10 46 (4.38%) Consultant
11 44 (4.19%) AWS Engineer
12 34 (3.24%) Azure Developer
13 32 (3.04%) Senior Data Engineer
14 31 (2.95%) Cloud Architect
14 31 (2.95%) Data Analyst
15 30 (2.85%) Azure DevOps Engineer
16 26 (2.47%) Business Intelligence Developer
17 25 (2.38%) Business Analyst
18 24 (2.28%) Senior Architect
Libraries, Frameworks & Software Standards
1 91 (8.66%) Kafka
2 75 (7.14%) .NET
3 58 (5.52%) PySpark
4 34 (3.24%) JSON
5 32 (3.04%) RESTful
6 28 (2.66%) .NET Framework
7 27 (2.57%) Web Services
7 27 (2.57%) XML
8 25 (2.38%) Spark Streaming
9 21 (2.00%) ASP.NET
10 20 (1.90%) REST
11 18 (1.71%) Pandas
12 17 (1.62%) .NET Core
13 16 (1.52%) AngularJS
14 15 (1.43%) SAML
15 14 (1.33%) HTML
15 14 (1.33%) pytest
15 14 (1.33%) YAML
16 11 (1.05%) ASP.NET MVC
16 11 (1.05%) SOAP
Miscellaneous
1 55 (5.23%) Data Structures
2 38 (3.62%) Greenfield Project
3 31 (2.95%) Cloud Native
4 26 (2.47%) Algorithms
4 26 (2.47%) Virtual Team
5 21 (2.00%) Data Protection Act
6 20 (1.90%) Enterprise Software
7 18 (1.71%) Self-Motivation
8 15 (1.43%) Reference Data
9 14 (1.33%) Public Cloud
10 12 (1.14%) Management Information System
10 12 (1.14%) NHS
10 12 (1.14%) User Experience
11 10 (0.95%) Cyber Defence
12 9 (0.86%) Hybrid Cloud
12 9 (0.86%) Legacy Applications
12 9 (0.86%) Legacy Systems
13 7 (0.67%) SCADA
14 6 (0.57%) Derivative
15 5 (0.48%) Taxonomies
Operating Systems
1 38 (3.62%) Linux
2 16 (1.52%) Unix
3 15 (1.43%) Windows
4 13 (1.24%) Red Hat Enterprise Linux
5 8 (0.76%) CentOS
5 8 (0.76%) SUSE Linux Enterprise Server
6 5 (0.48%) Ubuntu
6 5 (0.48%) VMS
7 4 (0.38%) Debian
7 4 (0.38%) Windows Server
8 1 (0.095%) Mac OS X
Processes & Methodologies
1 345 (32.83%) DevOps
2 343 (32.64%) Analytics
3 332 (31.59%) Data Modelling
4 331 (31.49%) Business Intelligence
5 326 (31.02%) Agile Software Development
6 271 (25.78%) ETL
7 172 (16.37%) Data Pipeline
8 163 (15.51%) Data Engineering
9 154 (14.65%) Migration
10 153 (14.56%) Scrum
11 120 (11.42%) Data Architecture
12 111 (10.56%) Data Management
13 97 (9.23%) Data Analysis
14 94 (8.94%) Data Integration
15 86 (8.18%) Visualisation
16 85 (8.09%) Data Analytics
16 85 (8.09%) Data Science
17 80 (7.61%) Data Ingestion
18 78 (7.42%) Machine Learning
19 72 (6.85%) Data Migration
Programming Languages
1 524 (49.86%) SQL
2 321 (30.54%) Python
3 98 (9.32%) Java
4 89 (8.47%) Scala
5 84 (7.99%) C#
6 70 (6.66%) T-SQL
7 62 (5.90%) PowerShell
8 45 (4.28%) JavaScript
9 33 (3.14%) R
10 19 (1.81%) Data Analysis Expressions (DAX)
10 19 (1.81%) PL/SQL
11 9 (0.86%) Bash Shell
12 8 (0.76%) C
12 8 (0.76%) PHP
12 8 (0.76%) Shell Script
12 8 (0.76%) TypeScript
12 8 (0.76%) U-SQL
13 7 (0.67%) C++
13 7 (0.67%) Java 8
13 7 (0.67%) Perl
Qualifications
1 64 (6.09%) Security Cleared
2 55 (5.23%) SC Cleared
3 47 (4.47%) Degree
4 11 (1.05%) Computer Science Degree
4 11 (1.05%) Microsoft Certification
5 10 (0.95%) DV Cleared
6 6 (0.57%) AWS Certification
6 6 (0.57%) BPSS Clearance
6 6 (0.57%) CISSP
7 4 (0.38%) CISM
7 4 (0.38%) Master's Degree
8 3 (0.29%) Cisco Certification
8 3 (0.29%) DBS Check
9 2 (0.19%) (ISC)2 CCSP
9 2 (0.19%) CISA
9 2 (0.19%) CompTIA Security+
9 2 (0.19%) ISEB
9 2 (0.19%) OSCP
9 2 (0.19%) PMI Certification
9 2 (0.19%) SSCP
Quality Assurance & Compliance
1 98 (9.32%) Data Quality
2 27 (2.57%) QA
3 17 (1.62%) GDPR
4 10 (0.95%) Sarbanes-Oxley
5 5 (0.48%) IFRS
5 5 (0.48%) PMO
6 4 (0.38%) NIST
7 3 (0.29%) COBIT
7 3 (0.29%) PCI DSS
7 3 (0.29%) SLA
8 2 (0.19%) Cyber Essentials
8 2 (0.19%) HL7
8 2 (0.19%) ISO/IEC 27001
8 2 (0.19%) NCSC
8 2 (0.19%) PSD2
9 1 (0.095%) Basel II
9 1 (0.095%) Disclosure Scotland
9 1 (0.095%) GxP
System Software
1 40 (3.81%) Active Directory
2 37 (3.52%) Docker
3 20 (1.90%) HDFS
4 8 (0.76%) iptables
5 4 (0.38%) Hyper-V
5 4 (0.38%) ISA Server
5 4 (0.38%) VMware Infrastructure
6 2 (0.19%) Apache ZooKeeper
6 2 (0.19%) Virtual Machines
Systems Management
1 62 (5.90%) Kubernetes
2 47 (4.47%) Terraform
3 25 (2.38%) Opscode Chef
4 21 (2.00%) Ansible
5 16 (1.52%) Puppet
6 14 (1.33%) Oozie
7 11 (1.05%) Hadoop YARN
8 6 (0.57%) Active Directory Federation Services
8 6 (0.57%) FortiGate
9 5 (0.48%) Kubeflow
10 4 (0.38%) Single Sign-On
11 2 (0.19%) Kibana
11 2 (0.19%) logstash
11 2 (0.19%) Salt
12 1 (0.095%) Computer Emergency Response Teams
12 1 (0.095%) Control-M
12 1 (0.095%) Oracle EDQ
12 1 (0.095%) Oracle RMAN
Vendors
1 405 (38.53%) Databricks
2 315 (29.97%) Microsoft
3 57 (5.42%) Oracle
4 45 (4.28%) Google
5 42 (4.00%) SAP
6 36 (3.43%) Salesforce.com
7 32 (3.04%) Informatica
8 27 (2.57%) BiZZdesign
9 23 (2.19%) MuleSoft
10 21 (2.00%) Cloudera
11 17 (1.62%) Alteryx
12 16 (1.52%) Atlassian
13 15 (1.43%) Cisco
13 15 (1.43%) Red Hat
14 10 (0.95%) Talend
15 8 (0.76%) Ab Initio
15 8 (0.76%) Dell
15 8 (0.76%) Remedy
15 8 (0.76%) SaltStack
15 8 (0.76%) Teradata
288 Data Lake job vacancies Nationwide