Period
to 7 May 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 7 May 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
7 May 2021
Same period 2020 Same period 2019
Rank 185 205 260
Rank change year-on-year +20 +55 +116
Contract jobs citing Data Lake 340 267 426
As % of all contract jobs advertised in London 1.45% 1.24% 1.04%
As % of the Database & Business Intelligence category 6.18% 5.12% 4.18%
Number of daily rates quoted 219 189 333
10th Percentile £413 £418 £425
25th Percentile £471 £475 £481
Median daily rate (50th Percentile) £550 £550 £525
Median % change year-on-year - +4.76% -
75th Percentile £625 £631 £625
90th Percentile £690 £688 £725
England median daily rate £519 £525 £525
% change year-on-year -1.18% - -
Number of hourly rates quoted 2 1 1
10th Percentile £39.73 " "
25th Percentile £44.19 £57.00 £24.25
Median hourly rate £55.50 £59.00 £24.50
Median % change year-on-year -5.93% +140.82% +2.08%
75th Percentile £62.94 £61.00 £24.75
90th Percentile £65.08 " "
England median hourly rate £44.50 £59.00 £24.50
% change year-on-year -24.58% +140.82% -33.78%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 5,498 5,212 10,197
As % of all contract IT jobs advertised in London 23.38% 24.19% 24.94%
Number of daily rates quoted 3,891 3,790 7,508
10th Percentile £368 £363 £363
25th Percentile £442 £425 £425
Median daily rate (50th Percentile) £525 £525 £525
75th Percentile £638 £625 £610
90th Percentile £713 £700 £675
England median daily rate £500 £495 £488
% change year-on-year +1.01% +1.54% +2.63%
Number of hourly rates quoted 30 31 46
10th Percentile £13.40 £15.94 £18.53
25th Percentile £20.31 £20.24 £20.63
Median hourly rate £36.44 £26.50 £24.50
Median % change year-on-year +37.51% +8.16% -18.33%
75th Percentile £61.19 £39.00 £43.75
90th Percentile £66.65 £61.00 £54.25
England median hourly rate £24.82 £24.70 £35.00
% change year-on-year +0.49% -29.43% +9.38%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Lake in London.

Daily rate trend for Data Lake in London

Data Lake
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Lake in London over the 6 months to 7 May 2021.

Daily rate histogram for Data Lake in London

Data Lake
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Lake in London.

Hourly rate trend for Data Lake in London

Data Lake
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Data Lake in London over the 6 months to 7 May 2021.

Hourly rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 7 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +19 42 £600 +14.29% 18
West London +22 5 £628 +0.40% 5
South London +37 4 £625 +19.05% 3
Data Lake
England

For the 6 months to 7 May 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 195 (57.35%) Azure
2 138 (40.59%) Data Warehouse
3 130 (38.24%) SQL
4 124 (36.47%) Data Modelling
5 122 (35.88%) Agile Software Development
6 120 (35.29%) Analytics
7 114 (33.53%) Databricks
8 95 (27.94%) Python
9 92 (27.06%) Azure Data Factory
10 90 (26.47%) Business Intelligence
11 88 (25.88%) Big Data
12 84 (24.71%) Finance
13 82 (24.12%) ETL
14 80 (23.53%) DevOps
15 70 (20.59%) Microsoft
16 69 (20.29%) AWS
17 65 (19.12%) Social Skills
18 63 (18.53%) Data Pipeline
19 62 (18.24%) Azure Synapse Analytics
20 61 (17.94%) Power Platform
20 61 (17.94%) Serverless
20 61 (17.94%) Power BI
21 60 (17.65%) Apache Spark
22 59 (17.35%) Data Architecture
23 49 (14.41%) Data Analysis
24 48 (14.12%) Data Management
25 45 (13.24%) Data Quality
26 44 (12.94%) SQL Server
26 44 (12.94%) Data Science
27 42 (12.35%) Migration

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 60 (17.65%) Apache Spark
2 33 (9.71%) Apache
3 24 (7.06%) Apache Airflow
4 10 (2.94%) Confluence
5 8 (2.35%) SharePoint
6 3 (0.88%) MQSeries
6 3 (0.88%) Oracle Coherence
7 2 (0.59%) Apache Pig
7 2 (0.59%) Camunda
7 2 (0.59%) SAS
8 1 (0.29%) Apache Solr
Applications
1 6 (1.76%) Microsoft Excel
2 4 (1.18%) Microsoft Office
3 3 (0.88%) Microsoft PowerPoint
4 1 (0.29%) MS Visio
4 1 (0.29%) SPSS
Business Applications
1 3 (0.88%) Aligne
2 1 (0.29%) Dynamics CRM
2 1 (0.29%) Maximo
2 1 (0.29%) Oracle EBS
2 1 (0.29%) Workfront
Cloud Services
1 195 (57.35%) Azure
2 92 (27.06%) Azure Data Factory
3 69 (20.29%) AWS
4 62 (18.24%) Azure Synapse Analytics
5 61 (17.94%) Power Platform
5 61 (17.94%) Serverless
6 25 (7.35%) Azure Cosmos DB
6 25 (7.35%) Azure Functions
7 22 (6.47%) AWS Lambda
8 21 (6.18%) PaaS
9 18 (5.29%) Amazon S3
9 18 (5.29%) GCP
10 11 (3.24%) iPaaS
11 10 (2.94%) Amazon EC2
11 10 (2.94%) Amazon Kinesis
12 9 (2.65%) Azure Storage
13 8 (2.35%) Azure Logic Apps
14 7 (2.06%) Azure Active Directory
14 7 (2.06%) Azure Data Lake Analytics
14 7 (2.06%) SaaS
Communications & Networking
1 10 (2.94%) HTTP
2 8 (2.35%) Firewall
3 1 (0.29%) FTP
3 1 (0.29%) Internet
3 1 (0.29%) Unified Communications
3 1 (0.29%) Wi-Fi
3 1 (0.29%) X.21
Database & Business Intelligence
1 138 (40.59%) Data Warehouse
2 88 (25.88%) Big Data
3 61 (17.94%) Power BI
4 44 (12.94%) SQL Server
5 41 (12.06%) Azure SQL Database
6 39 (11.47%) Hadoop
7 27 (7.94%) Azure SQL Data Warehouse
8 26 (7.65%) NoSQL
9 25 (7.35%) Relational Database
10 18 (5.29%) Apache Hive
10 18 (5.29%) Enterprise Data Warehouse
11 17 (5.00%) SQL Server Integration Services
11 17 (5.00%) Tableau
12 16 (4.71%) Amazon Redshift
12 16 (4.71%) SQL Server Analysis Services
13 14 (4.12%) Parquet
14 13 (3.82%) SQL Server Reporting Services
15 12 (3.53%) Snowflake Schema
16 11 (3.24%) PostgreSQL
17 10 (2.94%) OLAP
Development Applications
1 25 (7.35%) JIRA
2 24 (7.06%) kappa
3 22 (6.47%) PowerDesigner
4 21 (6.18%) Git (software)
5 13 (3.82%) Jenkins
6 9 (2.65%) GitLab
6 9 (2.65%) Visual Studio Team System
7 7 (2.06%) Visual Studio
8 6 (1.76%) ER Studio
8 6 (1.76%) Maven
9 5 (1.47%) ERwin
10 3 (0.88%) Subversion
11 2 (0.59%) Cucumber
12 1 (0.29%) CircleCI
12 1 (0.29%) GoCD
12 1 (0.29%) MLflow
12 1 (0.29%) Octopus Deploy
12 1 (0.29%) Sonatype Nexus
12 1 (0.29%) SQL Server Management Studio (SSMS)
12 1 (0.29%) TeamCity
General
1 84 (24.71%) Finance
2 65 (19.12%) Social Skills
3 33 (9.71%) Analytical Skills
4 21 (6.18%) Banking
5 14 (4.12%) Presentation Skills
6 13 (3.82%) Retail
7 10 (2.94%) Influencing Skills
7 10 (2.94%) Public Sector
8 9 (2.65%) Front Office
8 9 (2.65%) Games
9 8 (2.35%) Marketing
10 6 (1.76%) Legal
11 4 (1.18%) Manufacturing
12 3 (0.88%) Investment Banking
12 3 (0.88%) Organisational Skills
13 2 (0.59%) Advertising
13 2 (0.59%) Retail Banking
14 1 (0.29%) Back Office
14 1 (0.29%) General Ledger
14 1 (0.29%) Publishing
Job Titles
1 115 (33.82%) Data Engineer
2 78 (22.94%) Architect
3 62 (18.24%) Data Architect
4 45 (13.24%) Developer
5 36 (10.59%) Azure Engineer
6 33 (9.71%) AWS Engineer
7 32 (9.41%) Analyst
8 31 (9.12%) Azure Architect
9 23 (6.76%) Solutions Architect
10 20 (5.88%) Data Analyst
11 15 (4.41%) Python Engineer
11 15 (4.41%) Senior Data Engineer
12 14 (4.12%) Project Manager
13 12 (3.53%) Azure Developer
14 11 (3.24%) Big Data Engineer
15 9 (2.65%) .NET Developer
16 8 (2.35%) Administrator
16 8 (2.35%) Business Analyst
16 8 (2.35%) Consultant
16 8 (2.35%) Data Modeller
Libraries, Frameworks & Software Standards
1 41 (12.06%) Kafka
2 18 (5.29%) PySpark
3 14 (4.12%) HTML
3 14 (4.12%) Web Services
4 13 (3.82%) XML
5 12 (3.53%) .NET
6 10 (2.94%) Pandas
6 10 (2.94%) PostGIS
7 9 (2.65%) Velocity
7 9 (2.65%) YAML
8 7 (2.06%) .NET Framework
8 7 (2.06%) Flask
9 6 (1.76%) JSON
9 6 (1.76%) NumPy
9 6 (1.76%) RESTful
10 5 (1.47%) pytest
10 5 (1.47%) Spring
11 3 (0.88%) MLlib
11 3 (0.88%) Rendezvous
11 3 (0.88%) scikit-learn
Miscellaneous
1 23 (6.76%) Algorithms
2 22 (6.47%) Data Structures
3 15 (4.41%) Greenfield Project
3 15 (4.41%) Self-Motivation
4 14 (4.12%) Virtual Team
5 11 (3.24%) Cloud Native
6 9 (2.65%) Taxonomies
7 7 (2.06%) Reference Data
8 4 (1.18%) Foreign Exchange (FX)
9 3 (0.88%) Market Risk
9 3 (0.88%) Reinsurance
10 2 (0.59%) BYOD
10 2 (0.59%) Cyber Defence
10 2 (0.59%) Derivative
10 2 (0.59%) Management Information System
10 2 (0.59%) NHS
10 2 (0.59%) User Experience
11 1 (0.29%) IVR
11 1 (0.29%) Replication
11 1 (0.29%) Video\Live Streaming
Operating Systems
1 11 (3.24%) Linux
2 9 (2.65%) Red Hat Enterprise Linux
3 8 (2.35%) CentOS
3 8 (2.35%) SUSE Linux Enterprise Server
4 4 (1.18%) Windows
5 2 (0.59%) Unix
6 1 (0.29%) Debian
6 1 (0.29%) Ubuntu
6 1 (0.29%) Windows Server
Processes & Methodologies
1 124 (36.47%) Data Modelling
2 122 (35.88%) Agile Software Development
3 120 (35.29%) Analytics
4 90 (26.47%) Business Intelligence
5 82 (24.12%) ETL
6 80 (23.53%) DevOps
7 63 (18.53%) Data Pipeline
8 59 (17.35%) Data Architecture
9 49 (14.41%) Data Analysis
10 48 (14.12%) Data Management
11 44 (12.94%) Data Science
12 42 (12.35%) Data Integration
12 42 (12.35%) Migration
13 41 (12.06%) Data Engineering
14 39 (11.47%) Kimball Methodology
15 36 (10.59%) Machine Learning
16 33 (9.71%) Logical Data Model
17 32 (9.41%) Scrum
18 31 (9.12%) Master Data Management
19 29 (8.53%) Problem-Solving
Programming Languages
1 130 (38.24%) SQL
2 95 (27.94%) Python
3 28 (8.24%) Java
4 23 (6.76%) Scala
5 18 (5.29%) C#
5 18 (5.29%) PowerShell
6 9 (2.65%) JavaScript
7 8 (2.35%) T-SQL
8 5 (1.47%) C++
9 4 (1.18%) R
10 3 (0.88%) Data Analysis Expressions (DAX)
10 3 (0.88%) PL/SQL
11 2 (0.59%) Bash Shell
11 2 (0.59%) C
11 2 (0.59%) TypeScript
12 1 (0.29%) COBOL
12 1 (0.29%) Groovy
12 1 (0.29%) Perl
12 1 (0.29%) Shell Script
12 1 (0.29%) VBA
Qualifications
1 17 (5.00%) Degree
2 5 (1.47%) Computer Science Degree
3 4 (1.18%) SC Cleared
3 4 (1.18%) Security Cleared
4 3 (0.88%) AWS Certification
4 3 (0.88%) CISSP
4 3 (0.88%) Master's Degree
5 2 (0.59%) DV Cleared
5 2 (0.59%) GIAC
5 2 (0.59%) OSCP
5 2 (0.59%) PMP
6 1 (0.29%) CISA
6 1 (0.29%) CISM
6 1 (0.29%) CompTIA Security+
6 1 (0.29%) ISTQB
6 1 (0.29%) Numerate Degree
6 1 (0.29%) PMI Certification
6 1 (0.29%) SSCP
6 1 (0.29%) Tableau Certification
6 1 (0.29%) TOGAF Certification
Quality Assurance & Compliance
1 45 (13.24%) Data Quality
2 18 (5.29%) QA
3 9 (2.65%) GDPR
4 5 (1.47%) IFRS
5 3 (0.88%) PCI DSS
6 2 (0.59%) NIST
6 2 (0.59%) PMO
6 2 (0.59%) SLA
7 1 (0.29%) Cyber Essentials
7 1 (0.29%) NCSC
7 1 (0.29%) PSD2
7 1 (0.29%) Sarbanes-Oxley
System Software
1 12 (3.53%) Docker
2 8 (2.35%) iptables
3 5 (1.47%) Active Directory
3 5 (1.47%) HDFS
4 4 (1.18%) ISA Server
5 1 (0.29%) Apache Flume
Systems Management
1 16 (4.71%) Terraform
2 12 (3.53%) Ansible
2 12 (3.53%) Kubernetes
3 4 (1.18%) Oozie
3 4 (1.18%) Puppet
4 3 (0.88%) Single Sign-On
5 2 (0.59%) Hadoop YARN
5 2 (0.59%) Opscode Chef
6 1 (0.29%) Computer Emergency Response Teams
6 1 (0.29%) Kubeflow
Vendors
1 114 (33.53%) Databricks
2 70 (20.59%) Microsoft
3 22 (6.47%) BiZZdesign
4 16 (4.71%) MuleSoft
5 14 (4.12%) Oracle
6 12 (3.53%) Talend
7 9 (2.65%) Red Hat
7 9 (2.65%) SAP
8 8 (2.35%) Alteryx
8 8 (2.35%) CA Agile Central
8 8 (2.35%) Cisco
8 8 (2.35%) Remedy
8 8 (2.35%) Salesforce.com
8 8 (2.35%) SaltStack
9 6 (1.76%) Google
10 4 (1.18%) GoldenSource
11 3 (0.88%) IBM
11 3 (0.88%) Solace
11 3 (0.88%) TIBCO
12 2 (0.59%) Cadence