Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 27 February 2021

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 27 February 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
27 Feb 2021		 Same period 2020 Same period 2019
Rank 226 235 360
Rank change year-on-year +9 +125 +167
Contract jobs citing Data Lake 542 746 704
As % of all contract jobs advertised in the UK 1.14% 1.10% 0.71%
As % of the Database & Business Intelligence category 5.40% 5.13% 3.14%
Number of daily rates quoted 506 567 505
Median daily rate £500 £525 £525
Median daily rate % change year-on-year -4.76% - +5.00%
10th Percentile £396 £396 £413
90th Percentile £675 £693 £713
UK excluding London median daily rate £495 £500 £500
% change year-on-year -1.00% - +2.56%
Number of hourly rates quoted 3 3 1
Median hourly rate £45.00 £59.00 £24.50
Median hourly rate % change year-on-year -23.73% +140.82% +2.08%
UK excluding London median hourly rate - £45.50 -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 10,031 14,537 22,390
As % of all contract IT jobs advertised in the UK 21.17% 21.45% 22.60%
Number of daily rates quoted 6,858 9,886 15,607
Median daily rate £488 £475 £475
Median daily rate % change year-on-year +2.63% - +2.70%
10th Percentile £313 £319 £320
90th Percentile £650 £663 £650
UK excluding London median daily rate £425 £438 £425
% change year-on-year -2.86% +2.94% +6.25%
Number of hourly rates quoted 175 203 236
Median hourly rate £25.14 £25.00 £28.00
Median hourly rate % change year-on-year +0.56% -10.71% -13.18%
10th Percentile £13.55 £13.30 £12.79
90th Percentile £58.75 £59.20 £55.00
Median hourly rate £23.43 £22.50 £30.00
% change year-on-year +4.13% -25.00% -20.00%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 27 February 2021.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 27 February 2021.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 27 February 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -3 435 £513 -2.38% 139
London -7 255 £534 -2.95% 71
Work from Home -58 189 £500 -12.09% 30
UK excluding London +3 147 £495 -1.00% 72
North of England +104 61 £550 - 31
North West +73 38 £550 +10.00% 17
South East -36 34 £450 -5.26% 13
Yorkshire +54 22 £550 - 10
Midlands +42 22 £472 -4.16% 13
West Midlands +32 12 £475 -20.83% 9
South West +48 11 £508 -21.92% 3
Scotland +27 10 £375 -16.67% 5
East Midlands +25 10 £466 +3.56% 4
East of England +26 6 £450 -10.00% 5
North East +27 2 £475 -28.30% 4
Wales +12 2 £415 -19.02% 1
Northern Ireland - 1 £450 - 1

For the 6 months to 27 February 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 331 (61.07%) Azure
2 240 (44.28%) SQL
3 213 (39.30%) Data Warehouse
4 180 (33.21%) Azure Data Factory
5 178 (32.84%) Agile Software Development
6 177 (32.66%) Business Intelligence
7 167 (30.81%) Analytics
8 166 (30.63%) Databricks
9 164 (30.26%) Python
10 162 (29.89%) Data Modelling
11 158 (29.15%) DevOps
12 143 (26.38%) Microsoft
13 140 (25.83%) Big Data
14 139 (25.65%) Power Platform
15 137 (25.28%) Power BI
16 136 (25.09%) ETL
17 117 (21.59%) AWS
18 108 (19.93%) Azure SQL Database
19 93 (17.16%) Finance
19 93 (17.16%) Apache Spark
20 82 (15.13%) Serverless
21 72 (13.28%) Data Engineering
22 71 (13.10%) SQL Server
22 71 (13.10%) Data Analysis
23 70 (12.92%) Data Architecture
24 66 (12.18%) Hadoop
25 62 (11.44%) Data Management
26 59 (10.89%) Data Integration
27 58 (10.70%) Machine Learning
28 55 (10.15%) Data Quality

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 93 (17.16%) Apache Spark
2 48 (8.86%) Apache
3 33 (6.09%) Apache Airflow
4 21 (3.87%) Confluence
5 18 (3.32%) SharePoint
6 10 (1.85%) Apache Synapse
7 8 (1.48%) SAS
8 7 (1.29%) ArcGIS
9 6 (1.11%) Elasticsearch
10 4 (0.74%) Oracle Workflow
10 4 (0.74%) WebLogic
11 2 (0.37%) Apache Pulsar
11 2 (0.37%) CMS
12 1 (0.18%) Adobe Experience Manager
12 1 (0.18%) Apache Pig
12 1 (0.18%) Apache Solr
12 1 (0.18%) Camunda
12 1 (0.18%) MQSeries
12 1 (0.18%) MS Exchange
12 1 (0.18%) Oracle Coherence
Applications
1 9 (1.66%) Microsoft Office
2 6 (1.11%) Microsoft Excel
3 4 (0.74%) Microsoft PowerPoint
3 4 (0.74%) MS Visio
4 2 (0.37%) Microsoft Project
Business Applications
1 4 (0.74%) SAP CRM
1 4 (0.74%) SAP ERP
1 4 (0.74%) Temenos T24
2 3 (0.55%) Dynamics CRM
2 3 (0.55%) SAP IS-U
3 2 (0.37%) Aligne
3 2 (0.37%) SAP S/4HANA
4 1 (0.18%) Dynamics AX
4 1 (0.18%) NetSuite
4 1 (0.18%) Oracle EBS
4 1 (0.18%) SAP APO
4 1 (0.18%) SAP FI-CA
4 1 (0.18%) SAP MM
4 1 (0.18%) SAP SD
4 1 (0.18%) Traffica
4 1 (0.18%) Workfront
Cloud Services
1 331 (61.07%) Azure
2 180 (33.21%) Azure Data Factory
3 139 (25.65%) Power Platform
4 117 (21.59%) AWS
5 82 (15.13%) Serverless
6 38 (7.01%) Azure Functions
7 36 (6.64%) AWS Lambda
8 35 (6.46%) Amazon S3
9 30 (5.54%) GCP
10 29 (5.35%) PaaS
11 24 (4.43%) Logic Apps
12 15 (2.77%) Amazon EMR
13 14 (2.58%) Amazon Kinesis
14 13 (2.40%) Amazon EC2
14 13 (2.40%) SaaS
15 11 (2.03%) Dynamics 365
16 10 (1.85%) PowerApps
17 9 (1.66%) Amazon SageMaker
17 9 (1.66%) iPaaS
18 7 (1.29%) Boomi
Communications & Networking
1 9 (1.66%) HTTP
2 3 (0.55%) Wi-Fi
3 2 (0.37%) LAN
3 2 (0.37%) NAS
3 2 (0.37%) TCP/IP
3 2 (0.37%) WAN
3 2 (0.37%) X.21
4 1 (0.18%) DNS
4 1 (0.18%) Extranet
4 1 (0.18%) Firewall
4 1 (0.18%) Internet
4 1 (0.18%) Skype
4 1 (0.18%) VLAN
Database & Business Intelligence
1 213 (39.30%) Data Warehouse
2 140 (25.83%) Big Data
3 137 (25.28%) Power BI
4 108 (19.93%) Azure SQL Database
5 71 (13.10%) SQL Server
6 66 (12.18%) Hadoop
7 48 (8.86%) SQL Server Integration Services
8 42 (7.75%) Cosmos DB
8 42 (7.75%) SQL Server Analysis Services
9 40 (7.38%) Apache Hive
10 39 (7.20%) NoSQL
11 38 (7.01%) Azure SQL Data Warehouse
12 33 (6.09%) Amazon Redshift
13 31 (5.72%) Amazon Athena
14 28 (5.17%) SQL Server Reporting Services
14 28 (5.17%) Tableau
15 27 (4.98%) Relational Database
16 20 (3.69%) Microsoft Analysis Services
17 19 (3.51%) Spark SQL
18 18 (3.32%) Parquet
Development Applications
1 47 (8.67%) JIRA
2 45 (8.30%) Jenkins
3 43 (7.93%) Git (software)
4 21 (3.87%) kappa
5 20 (3.69%) PowerDesigner
6 11 (2.03%) GitLab
7 10 (1.85%) ERwin
7 10 (1.85%) Visual Studio
8 9 (1.66%) Maven
8 9 (1.66%) Visual Studio Team System
9 6 (1.11%) Atlassian Bamboo
9 6 (1.11%) Gradle
9 6 (1.11%) IBM UrbanCode
9 6 (1.11%) Sonatype Nexus
10 4 (0.74%) ER Studio
10 4 (0.74%) Terragrunt
11 2 (0.37%) Cucumber
11 2 (0.37%) Octopus Deploy
11 2 (0.37%) TeamCity
12 1 (0.18%) SQL Server Management Studio (SSMS)
General
1 93 (17.16%) Finance
2 26 (4.80%) Public Sector
3 21 (3.87%) Retail
4 17 (3.14%) Banking
5 11 (2.03%) Manufacturing
5 11 (2.03%) Marketing
6 7 (1.29%) Advertising
7 5 (0.92%) Publishing
8 3 (0.55%) Back Office
8 3 (0.55%) Front Office
9 2 (0.37%) Legal
9 2 (0.37%) Private Banking
9 2 (0.37%) Telecoms
10 1 (0.18%) Aerospace
10 1 (0.18%) Automotive
10 1 (0.18%) Billing
10 1 (0.18%) Electronics
10 1 (0.18%) German Language
10 1 (0.18%) Law
10 1 (0.18%) Retail Banking
Job Titles
1 181 (33.39%) Data Engineer
2 139 (25.65%) Architect
3 93 (17.16%) Data Architect
4 86 (15.87%) Developer
5 73 (13.47%) Azure Engineer
6 46 (8.49%) Analyst
6 46 (8.49%) Azure Architect
7 44 (8.12%) AWS Engineer
8 31 (5.72%) Solutions Architect
9 25 (4.61%) Consultant
10 24 (4.43%) Big Data Engineer
11 23 (4.24%) Azure Developer
12 22 (4.06%) Python Engineer
13 20 (3.69%) Business Intelligence Developer
13 20 (3.69%) Data Analyst
14 16 (2.95%) DevOps Engineer
15 15 (2.77%) Azure DevOps
15 15 (2.77%) Cloud Architect
16 14 (2.58%) Data Consultant
16 14 (2.58%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 54 (9.96%) Kafka
2 41 (7.56%) PySpark
3 24 (4.43%) XML
4 20 (3.69%) Web Services
5 18 (3.32%) .NET
6 14 (2.58%) JSON
7 13 (2.40%) HTML
8 12 (2.21%) REST
9 9 (1.66%) PostGIS
10 8 (1.48%) Flask
11 7 (1.29%) GraphQL
11 7 (1.29%) Pandas
11 7 (1.29%) RESTful
11 7 (1.29%) Spring
12 6 (1.11%) MDX
13 5 (0.92%) Django
13 5 (0.92%) React
13 5 (0.92%) Velocity
14 4 (0.74%) .NET Framework
14 4 (0.74%) pytest
Miscellaneous
1 52 (9.59%) Analytical Skills
2 28 (5.17%) Data Structures
3 24 (4.43%) Algorithms
4 21 (3.87%) Greenfield Project
5 15 (2.77%) Self-Motivation
6 14 (2.58%) Cloud Native
7 11 (2.03%) Virtual Team
8 10 (1.85%) Management Information System
9 8 (1.48%) NHS
10 7 (1.29%) Reference Data
10 7 (1.29%) Taxonomies
10 7 (1.29%) User Experience
11 6 (1.11%) Linux Command Line
12 5 (0.92%) FMCG
12 5 (0.92%) Public Cloud
13 4 (0.74%) Enterprise Cloud
13 4 (0.74%) Enterprise Software
13 4 (0.74%) Reinsurance
13 4 (0.74%) SCADA
14 3 (0.55%) Market Risk
Operating Systems
1 18 (3.32%) Linux
2 10 (1.85%) Windows
3 7 (1.29%) Android
3 7 (1.29%) Apple iOS
4 3 (0.55%) Red Hat Enterprise Linux
4 3 (0.55%) Unix
4 3 (0.55%) Windows Server
5 2 (0.37%) VMS
5 2 (0.37%) Windows 10
6 1 (0.18%) Mac OS X
Processes & Methodologies
1 178 (32.84%) Agile Software Development
2 177 (32.66%) Business Intelligence
3 167 (30.81%) Analytics
4 162 (29.89%) Data Modelling
5 158 (29.15%) DevOps
6 136 (25.09%) ETL
7 72 (13.28%) Data Engineering
8 71 (13.10%) Data Analysis
9 70 (12.92%) Data Architecture
10 62 (11.44%) Data Management
11 59 (10.89%) Data Integration
12 58 (10.70%) Machine Learning
13 55 (10.15%) Migration
14 49 (9.04%) Scrum
15 45 (8.30%) Artificial Intelligence
16 44 (8.12%) TOGAF
17 43 (7.93%) Data Science
17 43 (7.93%) Kimball Methodology
18 41 (7.56%) Visualisation
19 38 (7.01%) Data Analytics
Programming Languages
1 240 (44.28%) SQL
2 164 (30.26%) Python
3 34 (6.27%) PowerShell
3 34 (6.27%) Scala
4 31 (5.72%) Java
5 30 (5.54%) C#
6 27 (4.98%) T-SQL
7 15 (2.77%) Bash Shell
7 15 (2.77%) R
8 8 (1.48%) Data Analysis Expressions (DAX)
8 8 (1.48%) JavaScript
8 8 (1.48%) Shell Script
9 6 (1.11%) Elm
9 6 (1.11%) Haskell
10 5 (0.92%) C
10 5 (0.92%) PL/SQL
10 5 (0.92%) U-SQL
11 4 (0.74%) Java 8
11 4 (0.74%) TypeScript
12 3 (0.55%) SAS Macro
Qualifications
1 30 (5.54%) Security Cleared
2 27 (4.98%) SC Cleared
3 14 (2.58%) Degree
4 11 (2.03%) TOGAF Certification
5 9 (1.66%) AWS Certification
6 7 (1.29%) Microsoft Certification
7 6 (1.11%) Computer Science Degree
8 4 (0.74%) PMP
9 3 (0.55%) PMI Certification
10 2 (0.37%) BPSS Clearance
11 1 (0.18%) ISEB
11 1 (0.18%) ISTQB
11 1 (0.18%) MBCS
11 1 (0.18%) Numerate Degree
11 1 (0.18%) Tableau Certification
Quality Assurance & Compliance
1 55 (10.15%) Data Quality
2 41 (7.56%) QA
3 5 (0.92%) IFRS
4 4 (0.74%) GDPR
5 2 (0.37%) SLA
6 1 (0.18%) Basel II
6 1 (0.18%) PCI DSS
6 1 (0.18%) PMO
6 1 (0.18%) WCAG
System Software
1 22 (4.06%) Docker
2 18 (3.32%) HDFS
3 4 (0.74%) Active Directory
4 3 (0.55%) Virtual Machines
4 3 (0.55%) VMware Infrastructure
5 2 (0.37%) Apache Flume
5 2 (0.37%) Hyper-V
6 1 (0.18%) Apache ZooKeeper
6 1 (0.18%) ISA Server
6 1 (0.18%) VMware ESXi
Systems Management
1 38 (7.01%) Terraform
2 25 (4.61%) Kubernetes
3 13 (2.40%) Ansible
4 10 (1.85%) Oozie
5 9 (1.66%) Grafana
6 8 (1.48%) Opscode Chef
7 7 (1.29%) Hadoop YARN
7 7 (1.29%) Prometheus
8 2 (0.37%) Puppet
9 1 (0.18%) Control-M
9 1 (0.18%) Single Sign-On
Vendors
1 166 (30.63%) Databricks
2 143 (26.38%) Microsoft
3 26 (4.80%) SAP
4 23 (4.24%) BiZZdesign
5 18 (3.32%) Salesforce.com
6 17 (3.14%) Oracle
7 16 (2.95%) MuleSoft
7 16 (2.95%) Talend
8 10 (1.85%) Atlassian
8 10 (1.85%) Cloudera
9 9 (1.66%) CA Agile Central
10 8 (1.48%) Google
10 8 (1.48%) Informatica
10 8 (1.48%) Teradata
11 7 (1.29%) ESRI
12 6 (1.11%) Dell
12 6 (1.11%) VMware
13 5 (0.92%) Alteryx
14 4 (0.74%) Hortonworks
14 4 (0.74%) Splunk
158 Data Lake job vacancies Nationwide