Period
to 25 September 2021

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 25 September 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
Central London > City of London
6 months to
25 Sep 2021
Same period 2020 Same period 2019
Rank 122 92 140
Rank change year-on-year -30 +48 +71
Contract jobs citing Data Lake 55 23 101
As % of all contract jobs advertised in the City of London 1.51% 1.30% 1.62%
As % of the Database & Business Intelligence category 6.89% 4.83% 6.22%
Number of daily rates quoted 45 20 78
10th Percentile £481 £459 £421
25th Percentile £500 £463 £513
Median daily rate (50th Percentile) £550 £475 £525
Median % change year-on-year +15.79% -9.52% -4.55%
75th Percentile £638 £500 £600
90th Percentile £775 £589 £704
Central London median daily rate £550 £475 £525
% change year-on-year +15.79% -9.52% -4.55%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 798 476 1,623
As % of all contract IT jobs advertised in the City of London 21.85% 26.83% 25.99%
Number of daily rates quoted 585 358 1,299
10th Percentile £376 £380 £388
25th Percentile £475 £427 £461
Median daily rate (50th Percentile) £550 £525 £525
Median % change year-on-year +4.76% - -
75th Percentile £650 £603 £619
90th Percentile £738 £688 £688
Central London median daily rate £550 £525 £525
% change year-on-year +4.76% - -
Number of hourly rates quoted 8 6 8
10th Percentile " £18.50 £17.89
25th Percentile £8.00 £20.50 £21.23
Median hourly rate £15.25 £29.75 £28.75
Median % change year-on-year -48.74% +3.48% +27.78%
75th Percentile £33.69 £39.00 £47.42
90th Percentile £43.33 £43.50 £51.04
Central London median hourly rate £17.00 £29.75 £28.75
% change year-on-year -42.86% +3.48% +27.78%

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Data Lake in the City of London.

Daily rate trend for Data Lake in the City of London

Data Lake
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Data Lake in the City of London over the 6 months to 25 September 2021.

Daily rate histogram for Data Lake in the City of London

For the 6 months to 25 September 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Data Lake.

1 32 (58.18%) Azure
2 27 (49.09%) Agile Software Development
3 26 (47.27%) Business Intelligence
4 22 (40.00%) Python
5 19 (34.55%) SQL
5 19 (34.55%) Analytics
5 19 (34.55%) Data Ingestion
5 19 (34.55%) Databricks
6 17 (30.91%) Microsoft
7 15 (27.27%) Data Modelling
7 15 (27.27%) Finance
7 15 (27.27%) AWS
7 15 (27.27%) DevOps
8 14 (25.45%) Power BI
8 14 (25.45%) Data Engineering
8 14 (25.45%) Power Platform
8 14 (25.45%) Data Warehouse
9 13 (23.64%) ETL
10 12 (21.82%) Stakeholder Management
10 12 (21.82%) Apache Spark
11 11 (20.00%) Analytical Skills
11 11 (20.00%) Azure Data Factory
11 11 (20.00%) Dashboard Development
11 11 (20.00%) Data Pipeline
12 10 (18.18%) Azure Synapse Analytics
12 10 (18.18%) Problem-Solving
12 10 (18.18%) SQL Server
13 9 (16.36%) Java
13 9 (16.36%) Insurtech
13 9 (16.36%) Data Science

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 12 (21.82%) Apache Spark
2 5 (9.09%) Apache
3 4 (7.27%) Apache Airflow
Business Applications
1 2 (3.64%) Maximo
Cloud Services
1 32 (58.18%) Azure
2 15 (27.27%) AWS
3 14 (25.45%) Power Platform
4 11 (20.00%) Azure Data Factory
5 10 (18.18%) Azure Synapse Analytics
6 5 (9.09%) Azure Cosmos DB
6 5 (9.09%) Serverless
7 4 (7.27%) Amazon SQS
7 4 (7.27%) AWS CloudFormation
7 4 (7.27%) AWS Lambda
8 3 (5.45%) GitHub
9 2 (3.64%) Amazon EKS
9 2 (3.64%) Amazon EMR
9 2 (3.64%) Amazon S3
9 2 (3.64%) Azure Data Lake Analytics
9 2 (3.64%) GCP
9 2 (3.64%) PaaS
10 1 (1.82%) AWS Step Functions
10 1 (1.82%) Dynamics 365
10 1 (1.82%) Google Data Studio
Database & Business Intelligence
1 14 (25.45%) Data Warehouse
1 14 (25.45%) Power BI
2 10 (18.18%) SQL Server
3 8 (14.55%) Azure SQL Database
3 8 (14.55%) Hadoop
3 8 (14.55%) SQL Server Integration Services
4 7 (12.73%) SQL Server Analysis Services
5 6 (10.91%) Big Data
5 6 (10.91%) SQL Server Reporting Services
6 5 (9.09%) Tableau
7 4 (7.27%) Apache Hive
7 4 (7.27%) Impala
7 4 (7.27%) NoSQL
7 4 (7.27%) Presto
8 3 (5.45%) Amazon Athena
8 3 (5.45%) BusinessObjects
8 3 (5.45%) Delta Lake
8 3 (5.45%) MongoDB
8 3 (5.45%) PostgreSQL
8 3 (5.45%) QlikView
Development Applications
1 6 (10.91%) Git (software)
2 5 (9.09%) JIRA
3 4 (7.27%) Visual Studio
4 3 (5.45%) Atlassian Bamboo
4 3 (5.45%) Jenkins
5 1 (1.82%) Cucumber
5 1 (1.82%) Selenium
5 1 (1.82%) SpecFlow
5 1 (1.82%) Subversion
5 1 (1.82%) Visual Studio Team System
General
1 15 (27.27%) Finance
2 11 (20.00%) Analytical Skills
3 4 (7.27%) Social Skills
4 3 (5.45%) Influencing Skills
5 2 (3.64%) Banking
5 2 (3.64%) Documentation Skills
5 2 (3.64%) Financial Institution
5 2 (3.64%) General Ledger
5 2 (3.64%) Marketing
6 1 (1.82%) Legal
6 1 (1.82%) Presentation Skills
6 1 (1.82%) Public Sector
Job Titles
1 15 (27.27%) Data Engineer
2 14 (25.45%) Project Manager
3 8 (14.55%) Azure Engineer
4 6 (10.91%) Analyst
5 4 (7.27%) Architect
5 4 (7.27%) Azure DevOps Engineer
5 4 (7.27%) Developer
5 4 (7.27%) DevOps Engineer
5 4 (7.27%) Senior Data Engineer
6 2 (3.64%) AWS Engineer
6 2 (3.64%) Business Intelligence Developer
6 2 (3.64%) Data Analyst
6 2 (3.64%) Designer
6 2 (3.64%) Power BI Developer
6 2 (3.64%) Report Analyst
7 1 (1.82%) Business Intelligence Architect
7 1 (1.82%) Data Governance Manager
7 1 (1.82%) Java Engineer
7 1 (1.82%) Senior Architect
7 1 (1.82%) Test Leader
Libraries, Frameworks & Software Standards
1 4 (7.27%) Kafka
2 3 (5.45%) JSON
2 3 (5.45%) RESTful
3 2 (3.64%) PySpark
3 2 (3.64%) SOAP
4 1 (1.82%) .NET
4 1 (1.82%) ARM Templates
4 1 (1.82%) Gherkin
4 1 (1.82%) MDX
4 1 (1.82%) RabbitMQ
4 1 (1.82%) React
4 1 (1.82%) Spring
4 1 (1.82%) XML
Miscellaneous
1 4 (7.27%) Algorithms
1 4 (7.27%) Management Information System
2 3 (5.45%) Cloud Native
3 2 (3.64%) Self-Motivation
4 1 (1.82%) Analytical Mindset
4 1 (1.82%) BYOD
4 1 (1.82%) Hedge funds
4 1 (1.82%) Market Risk
4 1 (1.82%) Replication
4 1 (1.82%) Social Media
Operating Systems
1 1 (1.82%) Linux
1 1 (1.82%) Unix
Processes & Methodologies
1 27 (49.09%) Agile Software Development
2 26 (47.27%) Business Intelligence
3 19 (34.55%) Analytics
3 19 (34.55%) Data Ingestion
4 15 (27.27%) Data Modelling
4 15 (27.27%) DevOps
5 14 (25.45%) Data Engineering
6 13 (23.64%) ETL
7 12 (21.82%) Stakeholder Management
8 11 (20.00%) Dashboard Development
8 11 (20.00%) Data Pipeline
9 10 (18.18%) Problem-Solving
10 9 (16.36%) Data Science
10 9 (16.36%) Insurtech
11 8 (14.55%) Data Management
11 8 (14.55%) Scrum
12 7 (12.73%) Infrastructure as Code
12 7 (12.73%) Release Management
13 6 (10.91%) Computer Science
14 5 (9.09%) Kanban
Programming Languages
1 22 (40.00%) Python
2 19 (34.55%) SQL
3 9 (16.36%) Java
4 7 (12.73%) Scala
5 6 (10.91%) T-SQL
6 5 (9.09%) PowerShell
7 4 (7.27%) C++
8 3 (5.45%) R
9 1 (1.82%) C#
9 1 (1.82%) Data Analysis Expressions (DAX)
9 1 (1.82%) JavaScript
Qualifications
1 3 (5.45%) Degree
2 1 (1.82%) Computer Science Degree
2 1 (1.82%) Master's Degree
Quality Assurance & Compliance
1 3 (5.45%) QA
2 1 (1.82%) Data Quality
2 1 (1.82%) GDPR
2 1 (1.82%) IFRS
2 1 (1.82%) Sarbanes-Oxley
2 1 (1.82%) Solvency II
System Software
1 3 (5.45%) Docker
Systems Management
1 4 (7.27%) Terraform
2 3 (5.45%) Ansible
2 3 (5.45%) Kubernetes
Vendors
1 19 (34.55%) Databricks
2 17 (30.91%) Microsoft
3 3 (5.45%) SAP
4 2 (3.64%) Alteryx
4 2 (3.64%) Google
4 2 (3.64%) MuleSoft
5 1 (1.82%) AppDynamics
5 1 (1.82%) Informatica
5 1 (1.82%) Oracle
5 1 (1.82%) Splunk