Period
to 24 January 2022

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 24 January 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
Central London > City of London
6 months to
24 Jan 2022
Same period 2021 Same period 2020
Rank 137 94 141
Rank change year-on-year -43 +47 +66
Contract jobs citing Data Lake 52 31 60
As % of all contract jobs advertised in the City of London 1.31% 1.50% 1.22%
As % of the Database & Business Intelligence category 5.51% 6.64% 5.28%
Number of daily rates quoted 39 27 53
10th Percentile £375 - £413
25th Percentile £513 £463 £444
Median daily rate (50th Percentile) £575 £600 £525
Median % change year-on-year -4.17% +14.29% -4.55%
75th Percentile £700 £638 £575
90th Percentile £788 £659 £600
Central London median daily rate £575 £600 £525
% change year-on-year -4.17% +14.29% -2.33%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 943 467 1,136
As % of all contract IT jobs advertised in the City of London 23.71% 22.59% 23.04%
Number of daily rates quoted 750 347 888
10th Percentile £370 £325 £374
25th Percentile £488 £415 £425
Median daily rate (50th Percentile) £570 £525 £520
Median % change year-on-year +8.57% +0.96% -0.95%
75th Percentile £675 £638 £600
90th Percentile £763 £688 £675
Central London median daily rate £570 £525 £510
% change year-on-year +8.57% +2.94% -2.86%
Number of hourly rates quoted 6 1 4
10th Percentile £34.75 - £22.17
25th Percentile £39.00 - £23.67
Median hourly rate £53.25 £22.00 £25.00
Median % change year-on-year +142.05% -12.00% -32.60%
75th Percentile £61.56 - £33.00
90th Percentile £69.63 - £46.50
Central London median hourly rate £53.25 £42.25 £25.00
% change year-on-year +26.04% +69.00% -32.60%

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Data Lake in the City of London.

Daily rate trend for Data Lake in the City of London

Data Lake
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Data Lake in the City of London over the 6 months to 24 January 2022.

Daily rate histogram for Data Lake in the City of London

For the 6 months to 24 January 2022, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Data Lake.

1 29 (55.77%) Azure
2 21 (40.38%) SQL
3 20 (38.46%) Business Intelligence
4 19 (36.54%) Data Warehouse
4 19 (36.54%) Agile Software Development
4 19 (36.54%) Analytics
5 18 (34.62%) AWS
5 18 (34.62%) Finance
6 17 (32.69%) Python
7 16 (30.77%) Microsoft
7 16 (30.77%) DevOps
7 16 (30.77%) Databricks
8 13 (25.00%) CI/CD
8 13 (25.00%) Data Modelling
9 12 (23.08%) Big Data
9 12 (23.08%) Power Platform
10 11 (21.15%) Social Skills
10 11 (21.15%) Amazon Redshift
10 11 (21.15%) Apache Spark
10 11 (21.15%) ETL
11 10 (19.23%) Power BI
11 10 (19.23%) Tableau
11 10 (19.23%) Azure Synapse Analytics
11 10 (19.23%) Azure Data Factory
12 8 (15.38%) SQL Server
12 8 (15.38%) PowerShell
13 7 (13.46%) Data Analysis
13 7 (13.46%) Migration
13 7 (13.46%) Data Engineering
13 7 (13.46%) NoSQL

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 11 (21.15%) Apache Spark
2 4 (7.69%) Apache
3 2 (3.85%) Apache Airflow
4 1 (1.92%) Jupyter
Cloud Services
1 29 (55.77%) Azure
2 18 (34.62%) AWS
3 12 (23.08%) Power Platform
4 10 (19.23%) Azure Data Factory
4 10 (19.23%) Azure Synapse Analytics
5 6 (11.54%) Amazon S3
5 6 (11.54%) Serverless
6 5 (9.62%) Amazon EMR
6 5 (9.62%) AWS CloudFormation
6 5 (9.62%) AWS Lambda
6 5 (9.62%) Azure Cosmos DB
7 4 (7.69%) IaaS
7 4 (7.69%) PaaS
7 4 (7.69%) Power Automate
8 3 (5.77%) Azure Logic Apps
8 3 (5.77%) GCP
8 3 (5.77%) PowerApps
9 2 (3.85%) Dynamics 365
9 2 (3.85%) Google Data Studio
9 2 (3.85%) Snowflake
Communications & Networking
1 1 (1.92%) Cisco IPT
Database & Business Intelligence
1 19 (36.54%) Data Warehouse
2 12 (23.08%) Big Data
3 11 (21.15%) Amazon Redshift
4 10 (19.23%) Power BI
4 10 (19.23%) Tableau
5 8 (15.38%) SQL Server
6 7 (13.46%) NoSQL
7 4 (7.69%) Hadoop
7 4 (7.69%) MongoDB
8 3 (5.77%) Amazon Athena
8 3 (5.77%) Azure SQL Data Warehouse
8 3 (5.77%) Azure SQL Database
8 3 (5.77%) Parquet
8 3 (5.77%) PostgreSQL
8 3 (5.77%) RDBMS
8 3 (5.77%) Relational Database
8 3 (5.77%) SQL Server Analysis Services
9 2 (3.85%) BigQuery
9 2 (3.85%) Enterprise Data Warehouse
9 2 (3.85%) Presto
Development Applications
1 6 (11.54%) Git (software)
1 6 (11.54%) Jenkins
1 6 (11.54%) JIRA
2 5 (9.62%) Atlassian Bamboo
3 4 (7.69%) Visual Studio
4 2 (3.85%) Subversion
4 2 (3.85%) Visual Studio Team System
5 1 (1.92%) Cucumber
5 1 (1.92%) GitLab
5 1 (1.92%) kappa
5 1 (1.92%) Maven
5 1 (1.92%) MSBuild
5 1 (1.92%) Selenium
5 1 (1.92%) SpecFlow
5 1 (1.92%) SQL Server Management Studio (SSMS)
5 1 (1.92%) TeamCity
5 1 (1.92%) webpack
General
1 18 (34.62%) Finance
2 11 (21.15%) Social Skills
3 6 (11.54%) Analytical Skills
3 6 (11.54%) Financial Institution
4 5 (9.62%) Legal
5 2 (3.85%) Banking
5 2 (3.85%) Law
5 2 (3.85%) Presentation Skills
6 1 (1.92%) Influencing Skills
6 1 (1.92%) Investment Banking
6 1 (1.92%) Marketing
6 1 (1.92%) Public Sector
Job Titles
1 16 (30.77%) Data Engineer
2 9 (17.31%) Azure Engineer
3 8 (15.38%) Architect
3 8 (15.38%) Developer
4 6 (11.54%) Analyst
5 5 (9.62%) Azure DevOps Engineer
5 5 (9.62%) DevOps Engineer
5 5 (9.62%) Project Manager
6 4 (7.69%) Business Intelligence Developer
6 4 (7.69%) Power BI Developer
7 3 (5.77%) AWS Engineer
7 3 (5.77%) Security Engineer
7 3 (5.77%) Senior Architect
7 3 (5.77%) Solutions Architect
8 2 (3.85%) Business Architect
8 2 (3.85%) Business Intelligence Analyst
8 2 (3.85%) Business Intelligence Architect
8 2 (3.85%) Cybersecurity Engineer
8 2 (3.85%) Data Architect
8 2 (3.85%) Python Engineer
Libraries, Frameworks & Software Standards
1 7 (13.46%) Kafka
2 3 (5.77%) .NET
2 3 (5.77%) JSON
3 2 (3.85%) Elastic Stack
3 2 (3.85%) RESTful
3 2 (3.85%) SOAP
3 2 (3.85%) Web Services
4 1 (1.92%) .NET Framework
4 1 (1.92%) Apache NiFi
4 1 (1.92%) ARM Templates
4 1 (1.92%) Gherkin
4 1 (1.92%) JMS
4 1 (1.92%) Middleware
4 1 (1.92%) PySpark
4 1 (1.92%) REST
4 1 (1.92%) Spring
4 1 (1.92%) XML
Miscellaneous
1 5 (9.62%) Hedge funds
2 3 (5.77%) Market Risk
3 2 (3.85%) Legacy Systems
3 2 (3.85%) User Experience
4 1 (1.92%) Analytical Mindset
4 1 (1.92%) Credit Risk
4 1 (1.92%) Enterprise Software
4 1 (1.92%) Fixed Income
4 1 (1.92%) Management Information System
4 1 (1.92%) Public Cloud
4 1 (1.92%) Self-Motivation
Operating Systems
1 1 (1.92%) Linux
Processes & Methodologies
1 20 (38.46%) Business Intelligence
2 19 (36.54%) Agile Software Development
2 19 (36.54%) Analytics
3 16 (30.77%) DevOps
4 13 (25.00%) CI/CD
4 13 (25.00%) Data Modelling
5 11 (21.15%) ETL
6 7 (13.46%) Data Analysis
6 7 (13.46%) Data Engineering
6 7 (13.46%) Data Pipeline
6 7 (13.46%) Migration
7 6 (11.54%) Architectural Design
7 6 (11.54%) Data Ingestion
7 6 (11.54%) Data Protection
7 6 (11.54%) Data Strategy
7 6 (11.54%) Scrum
7 6 (11.54%) SDLC
8 5 (9.62%) Data Architecture
8 5 (9.62%) Data Integration
8 5 (9.62%) Data Migration
Programming Languages
1 21 (40.38%) SQL
2 17 (32.69%) Python
3 8 (15.38%) PowerShell
4 6 (11.54%) Java
5 3 (5.77%) C#
5 3 (5.77%) Scala
6 2 (3.85%) Data Analysis Expressions (DAX)
7 1 (1.92%) Bash
7 1 (1.92%) R
7 1 (1.92%) Shell Script
7 1 (1.92%) T-SQL
Qualifications
1 3 (5.77%) Degree
2 2 (3.85%) Computer Science Degree
3 1 (1.92%) (ISC)2 CCSP
3 1 (1.92%) Cisco Certification
3 1 (1.92%) CISSP
3 1 (1.92%) Master's Degree
Quality Assurance & Compliance
1 6 (11.54%) Data Quality
2 5 (9.62%) GDPR
3 3 (5.77%) QA
4 2 (3.85%) SLA
5 1 (1.92%) IFRS
5 1 (1.92%) Sarbanes-Oxley
5 1 (1.92%) Solvency II
System Software
1 7 (13.46%) Docker
Systems Management
1 5 (9.62%) Ansible
1 5 (9.62%) Kubernetes
1 5 (9.62%) Terraform
2 1 (1.92%) Control-M
Vendors
1 16 (30.77%) Databricks
1 16 (30.77%) Microsoft
2 4 (7.69%) Oracle
3 2 (3.85%) AppDynamics
3 2 (3.85%) Google
3 2 (3.85%) MuleSoft
3 2 (3.85%) Splunk
3 2 (3.85%) Talend
4 1 (1.92%) Alteryx
4 1 (1.92%) Informatica