Period
to 30 July 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 30 July 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
30 Jul 2021
Same period 2020 Same period 2019
Rank 171 224 243
Rank change year-on-year +53 +19 +132
Contract jobs citing Data Lake 509 177 449
As % of all contract jobs advertised in London 1.68% 1.12% 1.11%
As % of the Database & Business Intelligence category 6.96% 4.43% 4.38%
Number of daily rates quoted 321 119 353
10th Percentile £425 £418 £413
25th Percentile £475 £480 £475
Median daily rate (50th Percentile) £550 £550 £538
Median % change year-on-year - +2.33% +2.38%
75th Percentile £638 £650 £625
90th Percentile £738 £728 £698
England median daily rate £525 £528 £525
% change year-on-year -0.47% +0.48% +0.96%
Number of hourly rates quoted 1 1 0
Median hourly rate £44.50 £59.00 -
Median % change year-on-year -24.58% - -
England median hourly rate £44.50 £63.25 £72.50
% change year-on-year -29.64% -12.76% +53.44%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 7,316 3,993 10,246
As % of all contract IT jobs advertised in London 24.16% 25.25% 25.43%
Number of daily rates quoted 5,174 2,872 7,514
10th Percentile £388 £363 £363
25th Percentile £463 £438 £425
Median daily rate (50th Percentile) £550 £525 £525
Median % change year-on-year +4.76% - +0.72%
75th Percentile £650 £636 £608
90th Percentile £725 £725 £688
England median daily rate £518 £500 £480
% change year-on-year +3.50% +4.17% +1.05%
Number of hourly rates quoted 36 29 56
10th Percentile £11.00 £15.99 £15.55
25th Percentile £19.06 £20.50 £20.00
Median hourly rate £28.31 £27.50 £24.58
Median % change year-on-year +2.95% +11.88% -18.07%
75th Percentile £44.78 £39.25 £43.75
90th Percentile £57.72 £49.20 £51.63
England median hourly rate £26.50 £25.00 £30.00
% change year-on-year +6.00% -16.67% -

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Lake in London.

Daily rate trend for Data Lake in London

Data Lake
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Lake in London over the 6 months to 30 July 2021.

Daily rate histogram for Data Lake in London

Data Lake
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Lake in London.

Hourly rate trend for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 30 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -14 54 £538 +2.38% 21
West London +2 6 £555 +6.73% 8
South London +22 2 £750 +42.86% 5
Data Lake
England

For the 6 months to 30 July 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 344 (67.58%) Azure
2 220 (43.22%) SQL
3 201 (39.49%) Databricks
4 181 (35.56%) Data Warehouse
5 180 (35.36%) Azure Data Factory
6 172 (33.79%) Analytics
7 170 (33.40%) Agile Software Development
8 164 (32.22%) Business Intelligence
9 162 (31.83%) Data Modelling
9 162 (31.83%) DevOps
10 152 (29.86%) Python
11 132 (25.93%) Microsoft
12 124 (24.36%) Power BI
12 124 (24.36%) Power Platform
13 117 (22.99%) Big Data
14 107 (21.02%) Finance
15 102 (20.04%) ETL
16 101 (19.84%) AWS
17 99 (19.45%) Azure SQL Database
18 92 (18.07%) Azure Synapse Analytics
19 87 (17.09%) Social Skills
19 87 (17.09%) Data Engineering
20 80 (15.72%) SQL Server
21 79 (15.52%) Serverless
22 78 (15.32%) Apache Spark
23 77 (15.13%) Data Pipeline
24 75 (14.73%) Scrum
25 73 (14.34%) Migration
26 70 (13.75%) Data Architecture
27 60 (11.79%) Data Management

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 78 (15.32%) Apache Spark
2 30 (5.89%) Apache
3 25 (4.91%) Apache Airflow
4 12 (2.36%) Apache Pig
5 4 (0.79%) MQSeries
5 4 (0.79%) Oracle Coherence
5 4 (0.79%) SharePoint
6 3 (0.59%) Confluence
6 3 (0.59%) SAS
7 2 (0.39%) Camunda
7 2 (0.39%) Cloud Foundry
7 2 (0.39%) Elasticsearch
8 1 (0.20%) JBoss
Applications
1 4 (0.79%) Microsoft Excel
2 3 (0.59%) Microsoft Office
2 3 (0.59%) Microsoft PowerPoint
3 2 (0.39%) Oracle Smart View
3 2 (0.39%) SPSS
Business Applications
1 9 (1.77%) Dynamics CRM
2 2 (0.39%) Eloqua
2 2 (0.39%) Maximo
2 2 (0.39%) SAP Oil and Gas
2 2 (0.39%) SAP S/4HANA
3 1 (0.20%) Aligne
3 1 (0.20%) Oracle EBS
3 1 (0.20%) SAP ERP
3 1 (0.20%) Sparx Enterprise Architect
Cloud Services
1 344 (67.58%) Azure
2 180 (35.36%) Azure Data Factory
3 124 (24.36%) Power Platform
4 101 (19.84%) AWS
5 92 (18.07%) Azure Synapse Analytics
6 79 (15.52%) Serverless
7 46 (9.04%) Azure Cosmos DB
8 41 (8.06%) AWS Lambda
9 39 (7.66%) PaaS
10 36 (7.07%) Amazon S3
11 33 (6.48%) Azure Functions
12 32 (6.29%) GCP
13 24 (4.72%) Azure Storage
13 24 (4.72%) IaaS
14 21 (4.13%) Azure Active Directory
15 17 (3.34%) Snowflake
16 15 (2.95%) Azure Key Vault
17 14 (2.75%) Dynamics 365
18 13 (2.55%) Azure Data Lake Analytics
19 12 (2.36%) Azure Machine Learning
Communications & Networking
1 10 (1.96%) Firewall
2 9 (1.77%) FTP
3 4 (0.79%) HTTP
4 1 (0.20%) Cisco ASA
4 1 (0.20%) Internet
4 1 (0.20%) SSL
4 1 (0.20%) Unified Communications
4 1 (0.20%) Wi-Fi
Database & Business Intelligence
1 181 (35.56%) Data Warehouse
2 124 (24.36%) Power BI
3 117 (22.99%) Big Data
4 99 (19.45%) Azure SQL Database
5 80 (15.72%) SQL Server
6 55 (10.81%) Hadoop
7 50 (9.82%) Metadata
8 40 (7.86%) SQL Server Integration Services
9 38 (7.47%) Azure SQL Data Warehouse
10 35 (6.88%) Relational Database
11 34 (6.68%) SQL Server Analysis Services
12 33 (6.48%) NoSQL
13 31 (6.09%) SQL Server Reporting Services
14 26 (5.11%) Apache Hive
15 24 (4.72%) Tableau
16 23 (4.52%) Enterprise Data Warehouse
17 21 (4.13%) Microsoft Analysis Services
18 18 (3.54%) MongoDB
18 18 (3.54%) RDBMS
19 17 (3.34%) BigQuery
Development Applications
1 37 (7.27%) Git (software)
2 28 (5.50%) PowerDesigner
3 23 (4.52%) kappa
4 16 (3.14%) Jenkins
4 16 (3.14%) Visual Studio
5 14 (2.75%) JIRA
6 12 (2.36%) GitLab
7 9 (1.77%) Visual Studio Team System
8 8 (1.57%) ER Studio
8 8 (1.57%) Subversion
9 7 (1.38%) ERwin
10 6 (1.18%) Octopus Deploy
11 5 (0.98%) Cucumber
11 5 (0.98%) SpecFlow
12 4 (0.79%) Maven
12 4 (0.79%) MLflow
13 3 (0.59%) Sonatype Nexus
14 2 (0.39%) NUnit
14 2 (0.39%) TeamCity
15 1 (0.20%) Team Foundation Server
General
1 107 (21.02%) Finance
2 87 (17.09%) Social Skills
3 49 (9.63%) Analytical Skills
4 32 (6.29%) Banking
5 19 (3.73%) Retail
6 15 (2.95%) Marketing
6 15 (2.95%) Presentation Skills
7 14 (2.75%) Influencing Skills
8 11 (2.16%) Front Office
8 11 (2.16%) Legal
8 11 (2.16%) Public Sector
9 10 (1.96%) Games
10 6 (1.18%) Documentation Skills
10 6 (1.18%) Retail Banking
11 5 (0.98%) Manufacturing
12 4 (0.79%) Investment Banking
12 4 (0.79%) Law
13 3 (0.59%) Financial Institution
14 2 (0.39%) General Ledger
14 2 (0.39%) Pharmaceutical
Job Titles
1 160 (31.43%) Data Engineer
2 119 (23.38%) Architect
3 86 (16.90%) Azure Engineer
4 72 (14.15%) Data Architect
5 60 (11.79%) Developer
6 49 (9.63%) Azure Architect
7 46 (9.04%) Solutions Architect
8 38 (7.47%) Analyst
9 25 (4.91%) Project Manager
10 23 (4.52%) AWS Engineer
10 23 (4.52%) DevOps Engineer
11 21 (4.13%) Azure Developer
12 20 (3.93%) Senior Data Engineer
13 19 (3.73%) Data Analyst
14 15 (2.95%) Consultant
14 15 (2.95%) Senior Architect
15 13 (2.55%) Azure DevOps
15 13 (2.55%) Business Analyst
16 12 (2.36%) Azure DevOps Engineer
17 11 (2.16%) Python Engineer
Libraries, Frameworks & Software Standards
1 44 (8.64%) Kafka
2 40 (7.86%) .NET
3 21 (4.13%) PySpark
4 20 (3.93%) RESTful
5 17 (3.34%) JSON
6 15 (2.95%) .NET Framework
6 15 (2.95%) REST
7 13 (2.55%) XML
8 12 (2.36%) Web Services
9 11 (2.16%) AngularJS
9 11 (2.16%) HTML
10 10 (1.96%) YAML
11 9 (1.77%) Velocity
12 8 (1.57%) ASP.NET
12 8 (1.57%) Entity Framework
12 8 (1.57%) Pandas
13 6 (1.18%) Matplotlib
13 6 (1.18%) NumPy
13 6 (1.18%) pytest
14 5 (0.98%) Node.js
Miscellaneous
1 27 (5.30%) Data Structures
2 23 (4.52%) Cloud Native
3 18 (3.54%) Virtual Team
4 16 (3.14%) Algorithms
4 16 (3.14%) Greenfield Project
5 12 (2.36%) Self-Motivation
6 8 (1.57%) Legacy Applications
6 8 (1.57%) Management Information System
6 8 (1.57%) Reference Data
7 7 (1.38%) Enterprise Software
8 5 (0.98%) Derivative
8 5 (0.98%) Foreign Exchange (FX)
8 5 (0.98%) Public Cloud
8 5 (0.98%) User Experience
9 4 (0.79%) Data Protection Act
9 4 (0.79%) Hybrid Cloud
9 4 (0.79%) Market Risk
9 4 (0.79%) Replication
9 4 (0.79%) Taxonomies
10 3 (0.59%) NHS
Operating Systems
1 20 (3.93%) Linux
2 12 (2.36%) Red Hat Enterprise Linux
3 8 (1.57%) CentOS
3 8 (1.57%) SUSE Linux Enterprise Server
3 8 (1.57%) Unix
4 6 (1.18%) Windows
5 4 (0.79%) Debian
5 4 (0.79%) Ubuntu
6 1 (0.20%) VMS
Processes & Methodologies
1 172 (33.79%) Analytics
2 170 (33.40%) Agile Software Development
3 164 (32.22%) Business Intelligence
4 162 (31.83%) Data Modelling
4 162 (31.83%) DevOps
5 102 (20.04%) ETL
6 87 (17.09%) Data Engineering
7 77 (15.13%) Data Pipeline
8 75 (14.73%) Scrum
9 73 (14.34%) Migration
10 70 (13.75%) Data Architecture
11 60 (11.79%) Data Management
12 57 (11.20%) Data Analysis
12 57 (11.20%) Data Integration
13 55 (10.81%) Data Science
14 43 (8.45%) Stakeholder Management
15 42 (8.25%) Visualisation
16 39 (7.66%) Data Ingestion
16 39 (7.66%) Logical Data Model
17 38 (7.47%) Problem-Solving
Programming Languages
1 220 (43.22%) SQL
2 152 (29.86%) Python
3 50 (9.82%) Java
4 40 (7.86%) C#
5 34 (6.68%) Scala
6 32 (6.29%) PowerShell
7 28 (5.50%) T-SQL
8 24 (4.72%) JavaScript
9 9 (1.77%) R
10 7 (1.38%) Data Analysis Expressions (DAX)
10 7 (1.38%) PL/SQL
11 6 (1.18%) C
11 6 (1.18%) COBOL
12 5 (0.98%) Bash Shell
12 5 (0.98%) C++
12 5 (0.98%) Perl
12 5 (0.98%) PHP
12 5 (0.98%) TypeScript
13 4 (0.79%) U-SQL
14 3 (0.59%) Shell Script
Qualifications
1 36 (7.07%) Degree
2 11 (2.16%) Computer Science Degree
2 11 (2.16%) Security Cleared
3 10 (1.96%) SC Cleared
4 4 (0.79%) AWS Certification
4 4 (0.79%) Master's Degree
5 3 (0.59%) CISSP
5 3 (0.59%) Microsoft Certification
6 2 (0.39%) DV Cleared
6 2 (0.39%) GIAC
6 2 (0.39%) OSCP
7 1 (0.20%) CBAP
7 1 (0.20%) CCA
7 1 (0.20%) CISA
7 1 (0.20%) CISM
7 1 (0.20%) CompTIA Security+
7 1 (0.20%) Numerate Degree
7 1 (0.20%) PMI Certification
7 1 (0.20%) SSCP
7 1 (0.20%) Tableau Certification
Quality Assurance & Compliance
1 47 (9.23%) Data Quality
2 18 (3.54%) QA
3 12 (2.36%) GDPR
4 9 (1.77%) Sarbanes-Oxley
5 5 (0.98%) IFRS
5 5 (0.98%) PMO
6 4 (0.79%) NIST
7 3 (0.59%) COBIT
7 3 (0.59%) PCI DSS
8 2 (0.39%) ISO/IEC 27001
8 2 (0.39%) PSD2
8 2 (0.39%) SLA
9 1 (0.20%) Cyber Essentials
9 1 (0.20%) NCSC
System Software
1 20 (3.93%) Docker
2 17 (3.34%) Active Directory
3 8 (1.57%) HDFS
3 8 (1.57%) iptables
4 4 (0.79%) ISA Server
5 2 (0.39%) Virtual Machines
Systems Management
1 38 (7.47%) Kubernetes
2 25 (4.91%) Terraform
3 14 (2.75%) Ansible
4 6 (1.18%) Oozie
5 5 (0.98%) Hadoop YARN
5 5 (0.98%) Puppet
6 3 (0.59%) Opscode Chef
6 3 (0.59%) Single Sign-On
7 2 (0.39%) Active Directory Federation Services
7 2 (0.39%) Kibana
7 2 (0.39%) Kubeflow
7 2 (0.39%) logstash
8 1 (0.20%) Computer Emergency Response Teams
8 1 (0.20%) FortiGate
8 1 (0.20%) Salt
Vendors
1 201 (39.49%) Databricks
2 132 (25.93%) Microsoft
3 28 (5.50%) BiZZdesign
4 23 (4.52%) SAP
5 22 (4.32%) Oracle
6 19 (3.73%) MuleSoft
7 18 (3.54%) Google
7 18 (3.54%) Salesforce.com
8 13 (2.55%) Red Hat
9 12 (2.36%) Alteryx
10 9 (1.77%) Cisco
10 9 (1.77%) Cloudera
11 8 (1.57%) Remedy
11 8 (1.57%) SaltStack
12 7 (1.38%) Informatica
13 5 (0.98%) IBM
13 5 (0.98%) Talend
14 4 (0.79%) Hortonworks
14 4 (0.79%) Solace
15 3 (0.59%) AppDynamics