Period
to 21 April 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 21 April 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
21 Apr 2021
Same period 2020 Same period 2019
Rank 207 214 325
Rank change year-on-year +7 +111 +145
Contract jobs citing Data Lake 527 606 719
As % of all contract jobs advertised in England 1.24% 1.19% 0.82%
As % of the Database & Business Intelligence category 5.91% 5.56% 3.66%
Number of daily rates quoted 354 445 538
10th Percentile £400 £396 £411
25th Percentile £445 £444 £463
Median daily rate (50th Percentile) £525 £525 £525
75th Percentile £613 £613 £613
90th Percentile £675 £684 £688
UK median daily rate £513 £525 £525
% change year-on-year -2.38% - +5.00%
Number of hourly rates quoted 3 3 1
10th Percentile £26.35 £26.00 "
25th Percentile £30.25 £37.63 £24.25
Median hourly rate £44.50 £59.00 £24.50
Median % change year-on-year -24.58% +140.82% -33.78%
75th Percentile £59.38 £66.13 £24.75
90th Percentile £63.65 £69.20 "
UK median hourly rate £44.50 £59.00 £24.50
% change year-on-year -24.58% +140.82% -33.78%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 8,921 10,897 19,658
As % of all contract IT jobs advertised in England 21.04% 21.43% 22.49%
Number of daily rates quoted 6,194 7,525 13,798
10th Percentile £315 £325 £325
25th Percentile £406 £400 £400
Median daily rate (50th Percentile) £500 £488 £488
Median % change year-on-year +2.56% - +2.63%
75th Percentile £600 £588 £575
90th Percentile £685 £675 £650
UK median daily rate £500 £475 £475
% change year-on-year +5.26% - +2.15%
Number of hourly rates quoted 158 157 210
10th Percentile £13.10 £14.30 £14.07
25th Percentile £19.00 £18.25 £18.59
Median hourly rate £24.57 £24.70 £33.75
Median % change year-on-year -0.53% -26.81% +12.50%
75th Percentile £48.75 £46.00 £47.50
90th Percentile £61.40 £62.55 £57.50
UK median hourly rate £26.00 £24.70 £30.00
% change year-on-year +5.26% -17.67% -0.83%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Lake in England.

Daily rate trend for Data Lake in England

Data Lake
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Lake in England over the 6 months to 21 April 2021.

Daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Lake in England.

Hourly rate trend for Data Lake in England

Data Lake
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Lake in England over the 6 months to 21 April 2021.

Hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 21 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +6 312 £550 - 75
North of England +75 60 £525 -4.55% 29
South East -60 41 £480 -4.00% 38
North West +41 32 £525 +5.00% 16
Yorkshire +52 28 £514 -6.50% 10
Midlands +33 21 £438 -6.67% 26
South West +38 20 £555 -9.39% 6
West Midlands +20 12 £500 -25.23% 20
East Midlands +19 9 £419 -1.47% 6
East of England +6 9 £450 - 20
Data Lake
UK

For the 6 months to 21 April 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 318 (60.34%) Azure
2 228 (43.26%) SQL
3 197 (37.38%) Data Warehouse
4 171 (32.45%) Analytics
5 165 (31.31%) Agile Software Development
6 164 (31.12%) Databricks
7 163 (30.93%) Data Modelling
8 157 (29.79%) Azure Data Factory
9 154 (29.22%) Python
10 142 (26.94%) Big Data
11 134 (25.43%) ETL
12 132 (25.05%) Business Intelligence
13 131 (24.86%) DevOps
14 123 (23.34%) Microsoft
15 116 (22.01%) AWS
16 109 (20.68%) Power Platform
17 105 (19.92%) Power BI
18 99 (18.79%) Apache Spark
19 96 (18.22%) Finance
20 91 (17.27%) Azure Synapse Analytics
21 78 (14.80%) Serverless
21 78 (14.80%) Azure SQL Database
22 77 (14.61%) SQL Server
23 72 (13.66%) Hadoop
24 71 (13.47%) Data Engineering
25 65 (12.33%) Data Quality
26 63 (11.95%) Data Architecture
27 62 (11.76%) Data Analysis
28 61 (11.57%) Migration
29 59 (11.20%) Data Management

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 99 (18.79%) Apache Spark
2 46 (8.73%) Apache
3 31 (5.88%) Apache Airflow
4 22 (4.17%) Confluence
5 17 (3.23%) SharePoint
6 7 (1.33%) Elasticsearch
7 5 (0.95%) Oracle Workflow
7 5 (0.95%) SAS
7 5 (0.95%) WebLogic
8 4 (0.76%) ArcGIS
9 2 (0.38%) Apache Pig
9 2 (0.38%) Apache Solr
9 2 (0.38%) Camunda
10 1 (0.19%) Adobe Experience Manager
10 1 (0.19%) MQSeries
10 1 (0.19%) Oracle Coherence
Applications
1 7 (1.33%) Microsoft Office
2 5 (0.95%) Microsoft Excel
3 3 (0.57%) MS Visio
4 2 (0.38%) Microsoft PowerPoint
4 2 (0.38%) Microsoft Project
5 1 (0.19%) SPSS
Business Applications
1 3 (0.57%) Aligne
1 3 (0.57%) Dynamics CRM
1 3 (0.57%) SAP CRM
1 3 (0.57%) SAP ERP
2 2 (0.38%) Oracle EBS
2 2 (0.38%) Temenos T24
3 1 (0.19%) Dynamics AX
3 1 (0.19%) SAP APO
3 1 (0.19%) SAP IBP
3 1 (0.19%) SAP IS-U
3 1 (0.19%) SAP S/4HANA
3 1 (0.19%) Traffica
3 1 (0.19%) Workfront
Cloud Services
1 318 (60.34%) Azure
2 157 (29.79%) Azure Data Factory
3 116 (22.01%) AWS
4 109 (20.68%) Power Platform
5 91 (17.27%) Azure Synapse Analytics
6 78 (14.80%) Serverless
7 43 (8.16%) Azure Cosmos DB
8 37 (7.02%) GCP
9 34 (6.45%) Azure Functions
10 32 (6.07%) Amazon S3
11 31 (5.88%) AWS Lambda
11 31 (5.88%) PaaS
12 19 (3.61%) Azure Storage
13 14 (2.66%) Amazon EMR
13 14 (2.66%) Azure Logic Apps
14 12 (2.28%) Amazon Kinesis
14 12 (2.28%) Azure Key Vault
14 12 (2.28%) SaaS
15 11 (2.09%) Dynamics 365
15 11 (2.09%) iPaaS
Communications & Networking
1 10 (1.90%) HTTP
2 8 (1.52%) Firewall
3 2 (0.38%) NAS
4 1 (0.19%) DNS
4 1 (0.19%) FTP
4 1 (0.19%) Wi-Fi
4 1 (0.19%) X.21
Database & Business Intelligence
1 197 (37.38%) Data Warehouse
2 142 (26.94%) Big Data
3 105 (19.92%) Power BI
4 78 (14.80%) Azure SQL Database
5 77 (14.61%) SQL Server
6 72 (13.66%) Hadoop
7 48 (9.11%) Apache Hive
8 44 (8.35%) Azure SQL Data Warehouse
9 42 (7.97%) SQL Server Integration Services
10 41 (7.78%) SQL Server Analysis Services
11 35 (6.64%) NoSQL
12 31 (5.88%) SQL Server Reporting Services
13 27 (5.12%) Relational Database
14 25 (4.74%) Amazon Redshift
15 24 (4.55%) Enterprise Data Warehouse
16 22 (4.17%) Tableau
17 21 (3.98%) HBase
18 20 (3.80%) Amazon Athena
18 20 (3.80%) Data Mining
19 19 (3.61%) Snowflake Schema
Development Applications
1 45 (8.54%) JIRA
2 40 (7.59%) Git (software)
3 27 (5.12%) Jenkins
4 25 (4.74%) kappa
5 23 (4.36%) GitLab
6 22 (4.17%) PowerDesigner
7 13 (2.47%) Visual Studio
8 12 (2.28%) Maven
9 10 (1.90%) Sonatype Nexus
10 9 (1.71%) Visual Studio Team System
11 7 (1.33%) IBM UrbanCode
12 6 (1.14%) ERwin
12 6 (1.14%) Gradle
13 5 (0.95%) Atlassian Bamboo
13 5 (0.95%) ER Studio
14 3 (0.57%) Bitbucket
14 3 (0.57%) Subversion
14 3 (0.57%) Terragrunt
15 2 (0.38%) Cucumber
15 2 (0.38%) SQL Server Management Studio (SSMS)
General
1 96 (18.22%) Finance
2 23 (4.36%) Public Sector
3 22 (4.17%) Banking
3 22 (4.17%) Retail
4 13 (2.47%) Legal
5 11 (2.09%) Marketing
6 8 (1.52%) Manufacturing
7 7 (1.33%) Front Office
7 7 (1.33%) Games
8 6 (1.14%) Publishing
9 3 (0.57%) Advertising
9 3 (0.57%) Automotive
9 3 (0.57%) Investment Banking
9 3 (0.57%) Telecoms
10 2 (0.38%) Back Office
10 2 (0.38%) Private Banking
10 2 (0.38%) Retail Banking
11 1 (0.19%) Aerospace
11 1 (0.19%) Electronics
11 1 (0.19%) Military
Job Titles
1 186 (35.29%) Data Engineer
2 126 (23.91%) Architect
3 98 (18.60%) Data Architect
4 75 (14.23%) Developer
5 71 (13.47%) Azure Engineer
6 47 (8.92%) Azure Architect
7 46 (8.73%) AWS Engineer
8 43 (8.16%) Analyst
9 31 (5.88%) Solutions Architect
10 27 (5.12%) Big Data Engineer
11 23 (4.36%) Data Analyst
11 23 (4.36%) Python Engineer
12 21 (3.98%) Project Manager
13 19 (3.61%) Consultant
13 19 (3.61%) DevOps Engineer
14 18 (3.42%) Senior Data Engineer
15 17 (3.23%) Azure DevOps
16 16 (3.04%) Azure Developer
17 15 (2.85%) Azure DevOps Engineer
17 15 (2.85%) Senior Architect
Libraries, Frameworks & Software Standards
1 56 (10.63%) Kafka
2 46 (8.73%) PySpark
3 22 (4.17%) XML
4 19 (3.61%) Web Services
5 14 (2.66%) .NET
6 13 (2.47%) HTML
7 11 (2.09%) RESTful
8 10 (1.90%) PostGIS
8 10 (1.90%) YAML
9 9 (1.71%) Pandas
9 9 (1.71%) Spring
9 9 (1.71%) Velocity
10 8 (1.52%) JSON
10 8 (1.52%) REST
11 7 (1.33%) .NET Framework
11 7 (1.33%) Flask
12 6 (1.14%) pytest
13 5 (0.95%) NumPy
14 4 (0.76%) Django
14 4 (0.76%) MDX
Miscellaneous
1 48 (9.11%) Analytical Skills
2 28 (5.31%) Algorithms
3 27 (5.12%) Data Structures
4 21 (3.98%) Greenfield Project
4 21 (3.98%) Virtual Team
5 16 (3.04%) Cloud Native
6 14 (2.66%) Self-Motivation
7 9 (1.71%) NHS
7 9 (1.71%) Taxonomies
8 8 (1.52%) Linux Command Line
9 7 (1.33%) Cyber Defence
9 7 (1.33%) Reference Data
10 5 (0.95%) Management Information System
10 5 (0.95%) Reinsurance
11 4 (0.76%) BYOD
11 4 (0.76%) Market Risk
11 4 (0.76%) SCADA
11 4 (0.76%) User Experience
12 3 (0.57%) Mobile App
12 3 (0.57%) Public Cloud
Operating Systems
1 26 (4.93%) Linux
2 12 (2.28%) Red Hat Enterprise Linux
3 9 (1.71%) Windows
4 8 (1.52%) CentOS
4 8 (1.52%) SUSE Linux Enterprise Server
5 4 (0.76%) Unix
6 2 (0.38%) Windows Server
7 1 (0.19%) Android
7 1 (0.19%) Apple iOS
7 1 (0.19%) Debian
7 1 (0.19%) Ubuntu
Processes & Methodologies
1 171 (32.45%) Analytics
2 165 (31.31%) Agile Software Development
3 163 (30.93%) Data Modelling
4 134 (25.43%) ETL
5 132 (25.05%) Business Intelligence
6 131 (24.86%) DevOps
7 71 (13.47%) Data Engineering
8 63 (11.95%) Data Architecture
9 62 (11.76%) Data Analysis
10 61 (11.57%) Migration
11 59 (11.20%) Data Management
12 56 (10.63%) Data Integration
13 55 (10.44%) Scrum
14 54 (10.25%) Machine Learning
15 49 (9.30%) Data Science
16 42 (7.97%) Kimball Methodology
17 40 (7.59%) Data Analytics
18 39 (7.40%) Master Data Management
19 37 (7.02%) Visualisation
20 36 (6.83%) TOGAF
Programming Languages
1 228 (43.26%) SQL
2 154 (29.22%) Python
3 47 (8.92%) Scala
4 41 (7.78%) Java
5 30 (5.69%) C#
6 22 (4.17%) PowerShell
7 21 (3.98%) T-SQL
8 15 (2.85%) JavaScript
9 11 (2.09%) R
10 10 (1.90%) PL/SQL
11 9 (1.71%) Data Analysis Expressions (DAX)
12 7 (1.33%) Shell Script
13 6 (1.14%) Elm
13 6 (1.14%) Haskell
14 5 (0.95%) Java 8
15 4 (0.76%) TypeScript
16 3 (0.57%) Bash Shell
17 2 (0.38%) C
17 2 (0.38%) C++
17 2 (0.38%) Perl
Qualifications
1 32 (6.07%) Security Cleared
2 27 (5.12%) SC Cleared
3 18 (3.42%) Degree
4 6 (1.14%) Computer Science Degree
4 6 (1.14%) DV Cleared
5 4 (0.76%) AWS Certification
5 4 (0.76%) PMP
6 3 (0.57%) Master's Degree
6 3 (0.57%) PMI Certification
7 2 (0.38%) CISSP
7 2 (0.38%) GIAC
7 2 (0.38%) OSCP
7 2 (0.38%) TOGAF Certification
8 1 (0.19%) ISEB
8 1 (0.19%) ISTQB
8 1 (0.19%) MBCS
8 1 (0.19%) Microsoft Certification
8 1 (0.19%) Numerate Degree
8 1 (0.19%) Tableau Certification
Quality Assurance & Compliance
1 65 (12.33%) Data Quality
2 25 (4.74%) QA
3 6 (1.14%) GDPR
4 5 (0.95%) IFRS
5 2 (0.38%) NIST
5 2 (0.38%) SLA
6 1 (0.19%) PCI DSS
6 1 (0.19%) WCAG
System Software
1 22 (4.17%) HDFS
2 14 (2.66%) Docker
3 8 (1.52%) iptables
4 4 (0.76%) Active Directory
4 4 (0.76%) ISA Server
5 2 (0.38%) Hyper-V
5 2 (0.38%) VMware Infrastructure
6 1 (0.19%) Apache Flume
Systems Management
1 26 (4.93%) Kubernetes
2 25 (4.74%) Terraform
3 23 (4.36%) Ansible
4 12 (2.28%) Oozie
5 9 (1.71%) Opscode Chef
6 8 (1.52%) Puppet
7 7 (1.33%) Hadoop YARN
8 2 (0.38%) Grafana
9 1 (0.19%) Computer Emergency Response Teams
9 1 (0.19%) Oracle EDQ
9 1 (0.19%) Prometheus
9 1 (0.19%) Single Sign-On
Vendors
1 164 (31.12%) Databricks
2 123 (23.34%) Microsoft
3 34 (6.45%) Oracle
4 23 (4.36%) BiZZdesign
5 21 (3.98%) SAP
6 20 (3.80%) MuleSoft
7 16 (3.04%) Google
7 16 (3.04%) Salesforce.com
8 14 (2.66%) Talend
9 11 (2.09%) Red Hat
10 10 (1.90%) Atlassian
11 8 (1.52%) Alteryx
11 8 (1.52%) CA Agile Central
11 8 (1.52%) Cisco
11 8 (1.52%) Remedy
11 8 (1.52%) SaltStack
12 6 (1.14%) Cloudera
12 6 (1.14%) Teradata
13 5 (0.95%) GoldenSource
13 5 (0.95%) Serena