Period
to 26 July 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 26 July 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
26 Jul 2021
Same period 2020 Same period 2019
Rank 178 239 321
Rank change year-on-year +61 +82 +155
Contract jobs citing Data Lake 840 354 716
As % of all contract jobs advertised in England 1.49% 1.06% 0.85%
As % of the Database & Business Intelligence category 6.92% 4.73% 3.72%
Number of daily rates quoted 568 260 545
10th Percentile £400 £406 £406
25th Percentile £450 £463 £455
Median daily rate (50th Percentile) £525 £525 £525
75th Percentile £613 £644 £613
90th Percentile £714 £689 £688
UK median daily rate £525 £525 £525
Number of hourly rates quoted 3 2 3
10th Percentile £26.35 £57.68 "
25th Percentile £30.25 £58.69 £71.25
Median hourly rate £44.50 £63.25 £72.50
Median % change year-on-year -29.64% -12.76% +53.44%
75th Percentile £65.02 £68.69 £73.75
90th Percentile £72.68 £70.23 "
UK median hourly rate £50.00 £63.25 £72.50
% change year-on-year -20.95% -12.76% +53.44%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 12,144 7,480 19,246
As % of all contract IT jobs advertised in England 21.49% 22.40% 22.85%
Number of daily rates quoted 8,469 5,264 13,475
10th Percentile £335 £329 £325
25th Percentile £413 £413 £400
Median daily rate (50th Percentile) £513 £500 £480
Median % change year-on-year +2.50% +4.17% +1.05%
75th Percentile £623 £600 £575
90th Percentile £706 £700 £650
UK median daily rate £500 £500 £475
% change year-on-year - +5.26% +2.70%
Number of hourly rates quoted 178 101 230
10th Percentile £11.50 £12.63 £13.86
25th Percentile £18.51 £17.75 £17.66
Median hourly rate £26.00 £24.70 £30.00
Median % change year-on-year +5.26% -17.67% -
75th Percentile £47.50 £43.25 £52.22
90th Percentile £63.98 £66.00 £60.00
UK median hourly rate £26.99 £22.50 £30.00
% change year-on-year +19.96% -25.00% -

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Lake in England.

Daily rate trend for Data Lake in England

Data Lake
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Lake in England over the 6 months to 26 July 2021.

Daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Lake in England.

Hourly rate trend for Data Lake in England

Data Lake
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Lake in England over the 6 months to 26 July 2021.

Hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 26 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +42 501 £550 - 115
South East -44 92 £515 -1.76% 45
North of England +30 81 £450 -5.26% 36
Midlands +5 51 £475 -22.45% 33
Yorkshire +25 48 £428 -14.50% 12
North West -4 31 £500 +5.26% 22
West Midlands -18 26 £485 -25.38% 20
East Midlands +10 25 £438 -2.78% 13
South West +8 25 £575 +7.78% 9
East of England -24 15 £450 -12.20% 16
North East - 2 £625 - 2
Data Lake
UK

For the 6 months to 26 July 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 576 (68.57%) Azure
2 400 (47.62%) SQL
3 319 (37.98%) Databricks
4 306 (36.43%) Data Warehouse
5 293 (34.88%) Azure Data Factory
6 289 (34.40%) Analytics
7 274 (32.62%) DevOps
8 267 (31.79%) Agile Software Development
9 265 (31.55%) Business Intelligence
10 258 (30.71%) Data Modelling
11 253 (30.12%) Microsoft
12 250 (29.76%) Python
13 212 (25.24%) Power Platform
14 208 (24.76%) ETL
15 200 (23.81%) Power BI
16 179 (21.31%) Big Data
17 173 (20.60%) Azure SQL Database
18 167 (19.88%) Azure Synapse Analytics
19 166 (19.76%) AWS
20 146 (17.38%) Finance
20 146 (17.38%) Social Skills
21 143 (17.02%) Data Pipeline
22 130 (15.48%) SQL Server
23 129 (15.36%) Migration
24 123 (14.64%) Scrum
25 120 (14.29%) Data Engineering
26 118 (14.05%) Apache Spark
27 107 (12.74%) Serverless
28 97 (11.55%) Data Architecture
29 91 (10.83%) Hadoop

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (14.05%) Apache Spark
2 42 (5.00%) Apache
3 31 (3.69%) Apache Airflow
4 21 (2.50%) SharePoint
5 13 (1.55%) Apache Pig
6 7 (0.83%) Confluence
6 7 (0.83%) Elasticsearch
6 7 (0.83%) Jupyter
7 6 (0.71%) SAS
8 5 (0.60%) Oracle Workflow
8 5 (0.60%) WebLogic
9 4 (0.48%) MQSeries
9 4 (0.48%) Oracle Coherence
10 3 (0.36%) JBoss
11 2 (0.24%) ArcGIS
11 2 (0.24%) Camunda
11 2 (0.24%) Cloud Foundry
12 1 (0.12%) Apache Solr
12 1 (0.12%) Apache Synapse
Applications
1 9 (1.07%) Microsoft Excel
2 5 (0.60%) Microsoft Office
3 3 (0.36%) Microsoft PowerPoint
4 2 (0.24%) Oracle Smart View
4 2 (0.24%) SPSS
5 1 (0.12%) MS Visio
Business Applications
1 14 (1.67%) Dynamics CRM
2 4 (0.48%) Maximo
3 3 (0.36%) Unit4 Business World
4 2 (0.24%) Eloqua
4 2 (0.24%) SAP Oil and Gas
4 2 (0.24%) SAP S/4HANA
5 1 (0.12%) Aligne
5 1 (0.12%) Oracle EBS
5 1 (0.12%) SAP APO
5 1 (0.12%) SAP CRM
5 1 (0.12%) SAP ERP
5 1 (0.12%) SAP IBP
5 1 (0.12%) Sparx Enterprise Architect
5 1 (0.12%) Temenos T24
5 1 (0.12%) Traffica
Cloud Services
1 576 (68.57%) Azure
2 293 (34.88%) Azure Data Factory
3 212 (25.24%) Power Platform
4 167 (19.88%) Azure Synapse Analytics
5 166 (19.76%) AWS
6 107 (12.74%) Serverless
7 85 (10.12%) Azure Cosmos DB
8 61 (7.26%) PaaS
9 56 (6.67%) GCP
10 54 (6.43%) Azure Storage
11 52 (6.19%) AWS Lambda
12 48 (5.71%) Azure Functions
13 45 (5.36%) Amazon S3
14 35 (4.17%) Azure Key Vault
15 34 (4.05%) Snowflake
16 33 (3.93%) Azure Active Directory
17 32 (3.81%) IaaS
18 28 (3.33%) Dynamics 365
19 25 (2.98%) Azure Stack
20 24 (2.86%) Microsoft 365
Communications & Networking
1 15 (1.79%) Firewall
2 9 (1.07%) FTP
3 5 (0.60%) Cisco ASA
3 5 (0.60%) HTTP
4 3 (0.36%) MQTT
4 3 (0.36%) NAS
5 1 (0.12%) DNS
5 1 (0.12%) Extranet
5 1 (0.12%) Internet
5 1 (0.12%) LAN
5 1 (0.12%) MPLS
5 1 (0.12%) SSL
5 1 (0.12%) Unified Communications
5 1 (0.12%) WAN
5 1 (0.12%) Wi-Fi
Database & Business Intelligence
1 306 (36.43%) Data Warehouse
2 200 (23.81%) Power BI
3 179 (21.31%) Big Data
4 173 (20.60%) Azure SQL Database
5 130 (15.48%) SQL Server
6 91 (10.83%) Hadoop
7 82 (9.76%) SQL Server Integration Services
8 71 (8.45%) Metadata
9 70 (8.33%) Azure SQL Data Warehouse
9 70 (8.33%) SQL Server Analysis Services
10 65 (7.74%) SQL Server Reporting Services
11 55 (6.55%) Relational Database
12 54 (6.43%) Apache Hive
13 52 (6.19%) NoSQL
14 37 (4.40%) Tableau
15 36 (4.29%) Microsoft Analysis Services
16 34 (4.05%) Enterprise Data Warehouse
17 33 (3.93%) MongoDB
18 26 (3.10%) Data Mining
19 25 (2.98%) Delta Lake
Development Applications
1 61 (7.26%) Git (software)
2 43 (5.12%) Jenkins
3 37 (4.40%) JIRA
4 33 (3.93%) Visual Studio
5 28 (3.33%) kappa
5 28 (3.33%) PowerDesigner
6 19 (2.26%) GitLab
7 9 (1.07%) ER Studio
7 9 (1.07%) Visual Studio Team System
8 8 (0.95%) ERwin
8 8 (0.95%) Maven
8 8 (0.95%) SpecFlow
8 8 (0.95%) Subversion
9 7 (0.83%) Sonatype Nexus
10 6 (0.71%) Cucumber
10 6 (0.71%) MLflow
11 5 (0.60%) Octopus Deploy
12 3 (0.36%) Bitbucket
13 2 (0.24%) IBM UrbanCode
13 2 (0.24%) SQL Server Management Studio (SSMS)
General
1 146 (17.38%) Finance
1 146 (17.38%) Social Skills
2 71 (8.45%) Analytical Skills
3 51 (6.07%) Banking
4 30 (3.57%) Retail
5 25 (2.98%) Public Sector
6 21 (2.50%) Marketing
6 21 (2.50%) Presentation Skills
7 18 (2.14%) Legal
8 15 (1.79%) Influencing Skills
9 11 (1.31%) Front Office
10 10 (1.19%) Games
11 9 (1.07%) Documentation Skills
11 9 (1.07%) Manufacturing
12 8 (0.95%) Law
13 7 (0.83%) Telecoms
14 6 (0.71%) Publishing
14 6 (0.71%) Retail Banking
15 4 (0.48%) Automotive
15 4 (0.48%) Investment Banking
Job Titles
1 259 (30.83%) Data Engineer
2 190 (22.62%) Architect
3 149 (17.74%) Azure Engineer
4 116 (13.81%) Data Architect
5 95 (11.31%) Developer
6 72 (8.57%) Azure Architect
7 69 (8.21%) Solutions Architect
8 61 (7.26%) Analyst
9 48 (5.71%) DevOps Engineer
10 40 (4.76%) Project Manager
11 36 (4.29%) AWS Engineer
12 32 (3.81%) Consultant
13 29 (3.45%) Data Analyst
14 27 (3.21%) Azure Developer
15 26 (3.10%) Azure DevOps Engineer
16 25 (2.98%) Senior Data Engineer
17 23 (2.74%) Azure DevOps
17 23 (2.74%) Cloud Architect
17 23 (2.74%) Senior Architect
18 22 (2.62%) Python Engineer
Libraries, Frameworks & Software Standards
1 70 (8.33%) Kafka
2 65 (7.74%) .NET
3 44 (5.24%) PySpark
4 31 (3.69%) JSON
5 27 (3.21%) .NET Framework
6 26 (3.10%) RESTful
6 26 (3.10%) Web Services
7 23 (2.74%) XML
8 21 (2.50%) REST
9 20 (2.38%) ASP.NET
10 16 (1.90%) .NET Core
10 16 (1.90%) Pandas
11 15 (1.79%) Spark Streaming
12 14 (1.67%) AngularJS
13 13 (1.55%) HTML
13 13 (1.55%) SAML
14 12 (1.43%) ASP.NET MVC
14 12 (1.43%) YAML
15 10 (1.19%) SOAP
15 10 (1.19%) Velocity
Miscellaneous
1 43 (5.12%) Data Structures
2 32 (3.81%) Cloud Native
3 26 (3.10%) Virtual Team
4 23 (2.74%) Algorithms
4 23 (2.74%) Data Protection Act
5 21 (2.50%) Greenfield Project
6 15 (1.79%) Self-Motivation
7 13 (1.55%) Enterprise Software
8 12 (1.43%) Management Information System
9 11 (1.31%) Public Cloud
10 10 (1.19%) NHS
10 10 (1.19%) Reference Data
11 9 (1.07%) Legacy Applications
12 8 (0.95%) Cyber Defence
12 8 (0.95%) User Experience
13 6 (0.71%) Derivative
13 6 (0.71%) Hybrid Cloud
13 6 (0.71%) SCADA
14 5 (0.60%) Foreign Exchange (FX)
14 5 (0.60%) Video Conferencing
Operating Systems
1 35 (4.17%) Linux
2 14 (1.67%) Unix
3 13 (1.55%) Red Hat Enterprise Linux
3 13 (1.55%) Windows
4 8 (0.95%) CentOS
4 8 (0.95%) SUSE Linux Enterprise Server
5 5 (0.60%) VMS
6 4 (0.48%) Debian
6 4 (0.48%) Ubuntu
6 4 (0.48%) Windows Server
Processes & Methodologies
1 289 (34.40%) Analytics
2 274 (32.62%) DevOps
3 267 (31.79%) Agile Software Development
4 265 (31.55%) Business Intelligence
5 258 (30.71%) Data Modelling
6 208 (24.76%) ETL
7 143 (17.02%) Data Pipeline
8 129 (15.36%) Migration
9 123 (14.64%) Scrum
10 120 (14.29%) Data Engineering
11 97 (11.55%) Data Architecture
12 89 (10.60%) Data Analysis
12 89 (10.60%) Data Management
13 83 (9.88%) Data Integration
14 74 (8.81%) Data Science
15 69 (8.21%) Data Ingestion
15 69 (8.21%) Machine Learning
16 68 (8.10%) Visualisation
17 63 (7.50%) Data Analytics
18 62 (7.38%) Stakeholder Management
Programming Languages
1 400 (47.62%) SQL
2 250 (29.76%) Python
3 81 (9.64%) Java
4 75 (8.93%) Scala
5 72 (8.57%) C#
6 57 (6.79%) PowerShell
7 53 (6.31%) T-SQL
8 37 (4.40%) JavaScript
9 22 (2.62%) R
10 16 (1.90%) PL/SQL
11 15 (1.79%) Data Analysis Expressions (DAX)
12 12 (1.43%) Bash Shell
13 7 (0.83%) Shell Script
13 7 (0.83%) TypeScript
14 6 (0.71%) C
14 6 (0.71%) C++
14 6 (0.71%) COBOL
14 6 (0.71%) Java 8
14 6 (0.71%) Perl
14 6 (0.71%) PHP
Qualifications
1 43 (5.12%) Security Cleared
2 39 (4.64%) Degree
3 35 (4.17%) SC Cleared
4 11 (1.31%) Computer Science Degree
5 7 (0.83%) Microsoft Certification
6 6 (0.71%) AWS Certification
6 6 (0.71%) DV Cleared
7 5 (0.60%) CISSP
8 4 (0.48%) Master's Degree
9 3 (0.36%) BC Cleared
9 3 (0.36%) CISM
10 2 (0.24%) (ISC)2 CCSP
10 2 (0.24%) Cisco Certification
10 2 (0.24%) GIAC
10 2 (0.24%) ISEB
10 2 (0.24%) OSCP
11 1 (0.12%) BPSS Clearance
11 1 (0.12%) CompTIA Security+
11 1 (0.12%) Numerate Degree
11 1 (0.12%) TOGAF Certification
Quality Assurance & Compliance
1 87 (10.36%) Data Quality
2 25 (2.98%) QA
3 15 (1.79%) GDPR
4 11 (1.31%) Sarbanes-Oxley
5 5 (0.60%) IFRS
5 5 (0.60%) PMO
6 4 (0.48%) NIST
7 3 (0.36%) COBIT
7 3 (0.36%) PCI DSS
7 3 (0.36%) SLA
8 2 (0.24%) HL7
8 2 (0.24%) ISO/IEC 27001
8 2 (0.24%) PSD2
9 1 (0.12%) Cyber Essentials
9 1 (0.12%) NCSC
System Software
1 37 (4.40%) Active Directory
2 34 (4.05%) Docker
3 20 (2.38%) HDFS
4 8 (0.95%) iptables
5 4 (0.48%) Hyper-V
5 4 (0.48%) ISA Server
5 4 (0.48%) VMware Infrastructure
6 2 (0.24%) Apache ZooKeeper
Systems Management
1 63 (7.50%) Kubernetes
2 47 (5.60%) Terraform
3 21 (2.50%) Opscode Chef
4 20 (2.38%) Ansible
5 14 (1.67%) Oozie
5 14 (1.67%) Puppet
6 10 (1.19%) Hadoop YARN
7 5 (0.60%) Active Directory Federation Services
7 5 (0.60%) FortiGate
7 5 (0.60%) Kubeflow
8 3 (0.36%) Single Sign-On
9 2 (0.24%) Kibana
9 2 (0.24%) logstash
10 1 (0.12%) Computer Emergency Response Teams
10 1 (0.12%) Oracle EDQ
10 1 (0.12%) Salt
Vendors
1 319 (37.98%) Databricks
2 253 (30.12%) Microsoft
3 50 (5.95%) Oracle
4 38 (4.52%) SAP
5 37 (4.40%) Google
6 33 (3.93%) Salesforce.com
7 28 (3.33%) BiZZdesign
8 22 (2.62%) MuleSoft
9 20 (2.38%) Informatica
10 16 (1.90%) Cloudera
11 15 (1.79%) Red Hat
12 14 (1.67%) Alteryx
13 13 (1.55%) Cisco
14 9 (1.07%) Atlassian
15 8 (0.95%) Ab Initio
15 8 (0.95%) Remedy
15 8 (0.95%) SaltStack
16 7 (0.83%) Dell
16 7 (0.83%) Talend
17 6 (0.71%) IBM