Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 25 January 2022

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 25 January 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
25 Jan 2022		 Same period 2021 Same period 2020
Rank 184 222 250
Rank change year-on-year +38 +28 +152
Contract jobs citing Data Lake 1,359 487 761
As % of all contract jobs advertised in the UK 1.55% 1.16% 1.06%
As % of the Database & Business Intelligence category 7.30% 5.34% 4.95%
Number of daily rates quoted 867 333 552
10th Percentile £413 £364 £400
25th Percentile £475 £425 £450
Median daily rate (50th Percentile) £550 £500 £525
Median % change year-on-year +10.00% -4.76% -
75th Percentile £650 £600 £638
90th Percentile £725 £663 £713
UK excluding London median daily rate £525 £498 £500
% change year-on-year +5.53% -0.50% -4.76%
Number of hourly rates quoted 1 2 3
10th Percentile - £47.15 £28.85
25th Percentile - £50.38 £44.75
Median hourly rate £24.00 £55.75 £72.50
Median % change year-on-year -56.95% -23.10% +195.92%
75th Percentile - £61.13 £73.75
90th Percentile - £64.35 -
UK excluding London median hourly rate £24.00 - £72.50

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 18,624 9,121 15,365
As % of all contract IT jobs advertised in the UK 21.22% 21.81% 21.45%
Number of daily rates quoted 13,268 6,283 10,473
10th Percentile £363 £313 £315
25th Percentile £435 £390 £400
Median daily rate (50th Percentile) £525 £488 £475
Median % change year-on-year +7.69% +2.63% -
75th Percentile £638 £588 £575
90th Percentile £725 £663 £663
UK excluding London median daily rate £475 £425 £440
% change year-on-year +11.76% -3.41% +3.53%
Number of hourly rates quoted 205 181 212
10th Percentile £16.94 £13.99 £12.78
25th Percentile £24.50 £19.63 £17.83
Median hourly rate £43.95 £26.50 £26.00
Median % change year-on-year +65.85% +1.92% -2.44%
75th Percentile £62.15 £48.75 £42.63
90th Percentile £72.30 £62.00 £54.88
UK excluding London median hourly rate £43.34 £23.62 £22.77
% change year-on-year +83.45% +3.73% -12.41%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 25 January 2022.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 25 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Jobs
England +27 987 £575 +9.52% 241
London +28 664 £575 +4.55% 116
Work from Home +32 522 £550 +10.00% 53
UK excluding London -14 288 £525 +5.53% 143
North of England -20 98 £550 - 32
South East -31 75 £575 +27.78% 36
Yorkshire -5 54 £550 -0.90% 13
Midlands -48 42 £525 +12.66% 31
Scotland -23 36 £450 +12.50% 19
North West -55 35 £534 -2.95% 16
West Midlands -41 26 £495 +4.21% 25
East of England -23 20 £500 +5.26% 13
East Midlands -29 15 £588 +27.72% 6
South West -56 11 £550 +4.27% 11
North East +3 9 £700 +47.37% 3
Wales -24 5 £475 +14.46% 1
Northern Ireland 0 1 £550 +22.22%

For the 6 months to 25 January 2022, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 863 (63.50%) Azure
2 602 (44.30%) SQL
3 561 (41.28%) Data Warehouse
4 511 (37.60%) Databricks
5 505 (37.16%) Agile Software Development
6 486 (35.76%) Python
7 468 (34.44%) Azure Data Factory
8 465 (34.22%) Analytics
9 438 (32.23%) Business Intelligence
10 418 (30.76%) Data Modelling
11 387 (28.48%) DevOps
12 365 (26.86%) ETL
13 362 (26.64%) Power Platform
14 353 (25.97%) AWS
15 341 (25.09%) Power BI
16 331 (24.36%) Big Data
17 316 (23.25%) CI/CD
18 281 (20.68%) Microsoft
19 279 (20.53%) Social Skills
20 249 (18.32%) Finance
21 223 (16.41%) Data Engineering
22 222 (16.34%) SQL Server
23 214 (15.75%) Azure Synapse Analytics
24 210 (15.45%) Azure SQL Database
25 208 (15.31%) Apache Spark
25 208 (15.31%) Data Pipeline
26 177 (13.02%) Data Integration
27 175 (12.88%) Scrum
28 163 (11.99%) Kafka
29 156 (11.48%) Hadoop

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 208 (15.31%) Apache Spark
2 64 (4.71%) Apache
3 56 (4.12%) Apache Airflow
4 35 (2.58%) Confluence
5 17 (1.25%) SharePoint
6 16 (1.18%) Elasticsearch
7 12 (0.88%) nginx
8 10 (0.74%) SAS
9 9 (0.66%) Adobe Experience Manager
9 9 (0.66%) Anypoint
10 8 (0.59%) Apache Pig
11 6 (0.44%) BizTalk Server
11 6 (0.44%) WebLogic
12 5 (0.37%) Luigi
13 4 (0.29%) Jupyter
14 3 (0.22%) Mule
15 2 (0.15%) Apache Synapse
16 1 (0.074%) Camunda
16 1 (0.074%) JBoss
16 1 (0.074%) Oracle SOA Suite
Applications
1 32 (2.35%) Microsoft Excel
2 7 (0.52%) Microsoft PowerPoint
3 5 (0.37%) Spreadsheet
4 3 (0.22%) SPSS
5 2 (0.15%) Chatbot
5 2 (0.15%) Microsoft Office
5 2 (0.15%) MS Visio
Business Applications
1 17 (1.25%) Dynamics CRM
2 16 (1.18%) Sparx Enterprise Architect
3 5 (0.37%) Adobe Campaign
3 5 (0.37%) Workday HCM
4 3 (0.22%) Oracle Financials
4 3 (0.22%) SAP CO
4 3 (0.22%) SAP FI
4 3 (0.22%) SAP FI/CO
4 3 (0.22%) SAP Oil and Gas
4 3 (0.22%) SAP S/4HANA
5 2 (0.15%) Dynamics AX
5 2 (0.15%) NetSuite
5 2 (0.15%) Oracle EBS
5 2 (0.15%) SAP ERP
5 2 (0.15%) SAP SD
6 1 (0.074%) JDE EnterpriseOne
6 1 (0.074%) Primavera
6 1 (0.074%) Unit4 Business World
Cloud Services
1 863 (63.50%) Azure
2 468 (34.44%) Azure Data Factory
3 362 (26.64%) Power Platform
4 353 (25.97%) AWS
5 214 (15.75%) Azure Synapse Analytics
6 137 (10.08%) Serverless
7 114 (8.39%) Amazon S3
8 103 (7.58%) Azure Cosmos DB
9 74 (5.45%) Snowflake
10 66 (4.86%) Azure Functions
11 64 (4.71%) GCP
11 64 (4.71%) PaaS
12 61 (4.49%) Azure Logic Apps
13 60 (4.42%) AWS Lambda
14 58 (4.27%) Azure Storage
15 56 (4.12%) Amazon EMR
16 53 (3.90%) Azure Monitor
17 44 (3.24%) PowerApps
18 41 (3.02%) Amazon Kinesis
18 41 (3.02%) AWS CloudFormation
Communications & Networking
1 16 (1.18%) FTP
2 7 (0.52%) DNS
2 7 (0.52%) Internet
3 6 (0.44%) Cisco IPT
3 6 (0.44%) Network Security
4 5 (0.37%) Firewall
4 5 (0.37%) IPFS
5 4 (0.29%) Kerberos
6 3 (0.22%) AMQP
6 3 (0.22%) Extranet
6 3 (0.22%) VPN
7 1 (0.074%) 2G
7 1 (0.074%) 3G
7 1 (0.074%) 4G
7 1 (0.074%) 5G
7 1 (0.074%) DKIM
7 1 (0.074%) HTTP
7 1 (0.074%) Intrusion Detection
7 1 (0.074%) SAN
Database & Business Intelligence
1 561 (41.28%) Data Warehouse
2 341 (25.09%) Power BI
3 331 (24.36%) Big Data
4 222 (16.34%) SQL Server
5 210 (15.45%) Azure SQL Database
6 156 (11.48%) Hadoop
7 118 (8.68%) Metadata
8 108 (7.95%) NoSQL
9 103 (7.58%) Relational Database
10 102 (7.51%) SQL Server Integration Services
11 94 (6.92%) Amazon Redshift
12 90 (6.62%) Tableau
13 87 (6.40%) Azure SQL Data Warehouse
14 69 (5.08%) Amazon Athena
15 61 (4.49%) SQL Server Analysis Services
16 55 (4.05%) PostgreSQL
17 50 (3.68%) SQL Server Reporting Services
18 47 (3.46%) RDBMS
19 46 (3.38%) Microsoft Analysis Services
20 45 (3.31%) MongoDB
Development Applications
1 96 (7.06%) Git (software)
2 83 (6.11%) JIRA
3 73 (5.37%) Jenkins
4 37 (2.72%) PowerDesigner
5 33 (2.43%) ERwin
6 29 (2.13%) kappa
7 26 (1.91%) Visual Studio
8 25 (1.84%) ER Studio
9 17 (1.25%) GitLab
10 14 (1.03%) Subversion
10 14 (1.03%) Visual Studio Team System
11 8 (0.59%) TeamCity
12 7 (0.52%) Maven
13 6 (0.44%) CircleCI
13 6 (0.44%) SQL Server Management Studio (SSMS)
14 5 (0.37%) Atlassian Bamboo
14 5 (0.37%) Bitbucket
14 5 (0.37%) Selenium
15 4 (0.29%) SonarQube
16 3 (0.22%) Team Foundation Server
General
1 279 (20.53%) Social Skills
2 249 (18.32%) Finance
3 124 (9.12%) Analytical Skills
4 69 (5.08%) Banking
5 59 (4.34%) Public Sector
6 53 (3.90%) Marketing
7 50 (3.68%) Presentation Skills
8 28 (2.06%) Legal
9 24 (1.77%) Financial Institution
10 23 (1.69%) Retail
11 22 (1.62%) Investment Banking
12 21 (1.55%) Publishing
13 20 (1.47%) Telecoms
14 19 (1.40%) Law
15 18 (1.32%) Influencing Skills
16 17 (1.25%) Pharmaceutical
17 15 (1.10%) Manufacturing
18 14 (1.03%) Documentation Skills
18 14 (1.03%) Front Office
19 10 (0.74%) Electronics
Job Titles
1 485 (35.69%) Data Engineer
2 284 (20.90%) Architect
3 221 (16.26%) Azure Engineer
4 182 (13.39%) Data Architect
5 164 (12.07%) Developer
6 99 (7.28%) Analyst
7 90 (6.62%) Solutions Architect
8 69 (5.08%) Azure Architect
9 62 (4.56%) Project Manager
10 59 (4.34%) AWS Engineer
11 52 (3.83%) Senior Data Engineer
12 50 (3.68%) Azure Developer
12 50 (3.68%) Cloud Engineer
13 49 (3.61%) Data Analyst
14 46 (3.38%) Data Modeller
14 46 (3.38%) Python Engineer
15 44 (3.24%) Business Intelligence Developer
16 36 (2.65%) Business Analyst
17 34 (2.50%) DevOps Engineer
18 32 (2.35%) Power BI Developer
Libraries, Frameworks & Software Standards
1 163 (11.99%) Kafka
2 112 (8.24%) PySpark
3 76 (5.59%) JSON
4 71 (5.22%) .NET
5 47 (3.46%) XML
6 37 (2.72%) REST
7 33 (2.43%) Spark Streaming
8 27 (1.99%) RESTful
9 26 (1.91%) ARM Templates
10 25 (1.84%) Web Services
11 19 (1.40%) React
12 16 (1.18%) Pandas
13 15 (1.10%) RabbitMQ
14 13 (0.96%) .NET Framework
15 12 (0.88%) ASP.NET
15 12 (0.88%) Node.js
15 12 (0.88%) SOAP
16 11 (0.81%) ASP.NET Web API
16 11 (0.81%) Middleware
16 11 (0.81%) NumPy
Miscellaneous
1 58 (4.27%) Data Structures
2 39 (2.87%) Self-Motivation
3 37 (2.72%) Cloud Native
4 36 (2.65%) Data Protection Act
5 33 (2.43%) User Experience
6 32 (2.35%) Legacy Systems
7 29 (2.13%) Virtual Team
8 28 (2.06%) Greenfield Project
9 27 (1.99%) Management Information System
10 25 (1.84%) Enterprise Software
10 25 (1.84%) Reference Data
11 22 (1.62%) Hedge funds
12 20 (1.47%) Data Centre
12 20 (1.47%) FMCG
13 19 (1.40%) Public Cloud
14 17 (1.25%) Algorithms
15 11 (0.81%) Clustering
16 10 (0.74%) Enterprise Cloud
16 10 (0.74%) NVMe
17 9 (0.66%) Hybrid Cloud
Operating Systems
1 85 (6.25%) Linux
2 37 (2.72%) Windows
3 32 (2.35%) Unix
4 14 (1.03%) Red Hat Enterprise Linux
5 9 (0.66%) Windows Server
6 6 (0.44%) CentOS
7 4 (0.29%) VMS
8 3 (0.22%) Debian
8 3 (0.22%) Ubuntu
9 2 (0.15%) Windows Server 2012
9 2 (0.15%) Windows Server 2016
9 2 (0.15%) Windows Server 2019
Processes & Methodologies
1 505 (37.16%) Agile Software Development
2 465 (34.22%) Analytics
3 438 (32.23%) Business Intelligence
4 418 (30.76%) Data Modelling
5 387 (28.48%) DevOps
6 365 (26.86%) ETL
7 316 (23.25%) CI/CD
8 223 (16.41%) Data Engineering
9 208 (15.31%) Data Pipeline
10 177 (13.02%) Data Integration
11 175 (12.88%) Scrum
12 143 (10.52%) Data Analysis
13 140 (10.30%) Data Architecture
14 132 (9.71%) Visualisation
15 130 (9.57%) Data Science
16 129 (9.49%) Migration
17 121 (8.90%) Problem-Solving
18 115 (8.46%) Data Analytics
19 107 (7.87%) Data Management
20 104 (7.65%) Microservices
Programming Languages
1 602 (44.30%) SQL
2 486 (35.76%) Python
3 138 (10.15%) Java
4 130 (9.57%) C#
5 124 (9.12%) PowerShell
6 73 (5.37%) Scala
7 65 (4.78%) T-SQL
8 64 (4.71%) Bash
9 48 (3.53%) Data Analysis Expressions (DAX)
10 39 (2.87%) R
11 38 (2.80%) JavaScript
12 16 (1.18%) Shell Script
13 14 (1.03%) PL/SQL
14 11 (0.81%) C
15 6 (0.44%) C++
15 6 (0.44%) COBOL
15 6 (0.44%) Perl
15 6 (0.44%) PHP
16 5 (0.37%) Kotlin
17 4 (0.29%) U-SQL
Qualifications
1 78 (5.74%) Degree
2 74 (5.45%) Security Cleared
3 55 (4.05%) SC Cleared
4 34 (2.50%) AWS Certification
5 25 (1.84%) Computer Science Degree
6 21 (1.55%) Master's Degree
7 18 (1.32%) BPSS Clearance
8 15 (1.10%) Microsoft Certification
9 9 (0.66%) TOGAF Certification
10 8 (0.59%) DV Cleared
11 7 (0.52%) PMI Certification
12 6 (0.44%) (ISC)2 CCSP
12 6 (0.44%) Cisco Certification
12 6 (0.44%) CISSP
12 6 (0.44%) PhD
12 6 (0.44%) PMP
13 5 (0.37%) MCSA
13 5 (0.37%) MCSE
14 4 (0.29%) FFIEC
15 3 (0.22%) CTC Cleared
Quality Assurance & Compliance
1 135 (9.93%) Data Quality
2 42 (3.09%) QA
3 40 (2.94%) GDPR
4 15 (1.10%) Accessibility
5 13 (0.96%) SLA
6 10 (0.74%) GxP
7 8 (0.59%) Sarbanes-Oxley
8 6 (0.44%) ISO/IEC 27001
9 5 (0.37%) NIST
10 4 (0.29%) GLBA
10 4 (0.29%) GMP
10 4 (0.29%) ISO 13485
10 4 (0.29%) ISO/IEC 17025
10 4 (0.29%) PCI DSS
11 3 (0.22%) NCSC
11 3 (0.22%) NIST 800
12 2 (0.15%) IFRS
12 2 (0.15%) PMO
13 1 (0.074%) Disclosure Scotland
13 1 (0.074%) Solvency II
System Software
1 61 (4.49%) Docker
2 52 (3.83%) Active Directory
3 30 (2.21%) Virtual Machines
4 16 (1.18%) HDFS
5 6 (0.44%) Oracle RAC
5 6 (0.44%) Virtual Desktop
6 5 (0.37%) VMware Infrastructure
7 4 (0.29%) Apache Flume
8 2 (0.15%) Apache ZooKeeper
8 2 (0.15%) Squid
9 1 (0.074%) Snort
Systems Management
1 111 (8.17%) Terraform
2 80 (5.89%) Kubernetes
3 35 (2.58%) Ansible
4 11 (0.81%) Grafana
4 11 (0.81%) Opscode Chef
4 11 (0.81%) Prometheus
5 9 (0.66%) Hadoop YARN
6 7 (0.52%) Active Directory Federation Services
7 5 (0.37%) Microsoft Clustering
8 4 (0.29%) Demisto
8 4 (0.29%) Oozie
8 4 (0.29%) Single Sign-On
9 2 (0.15%) Control-M
9 2 (0.15%) Data Guard
9 2 (0.15%) Kibana
9 2 (0.15%) logstash
9 2 (0.15%) Puppet
10 1 (0.074%) Host Intrusion Detection System
10 1 (0.074%) Kubeflow
Vendors
1 511 (37.60%) Databricks
2 281 (20.68%) Microsoft
3 101 (7.43%) Oracle
4 76 (5.59%) SAP
5 49 (3.61%) Google
6 46 (3.38%) Talend
7 44 (3.24%) Salesforce.com
8 39 (2.87%) Cloudera
9 38 (2.80%) Teradata
10 37 (2.72%) Informatica
11 32 (2.35%) BiZZdesign
12 26 (1.91%) MuleSoft
13 19 (1.40%) Adobe
14 16 (1.18%) Red Hat
14 16 (1.18%) Sparx
14 16 (1.18%) Workday
15 14 (1.03%) Alteryx
15 14 (1.03%) Hortonworks
16 12 (0.88%) JD Edwards
16 12 (0.88%) StreamSets
280 Data Lake job vacancies Nationwide