Period
to 18 April 2021

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 18 April 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
Central London > City of London
6 months to
18 Apr 2021
Same period 2020 Same period 2019
Rank 109 130 165
Rank change year-on-year +21 +35 +59
Contract jobs citing Data Lake 32 41 81
As % of all contract jobs advertised in the City of London 1.30% 1.05% 1.20%
As % of the Database & Business Intelligence category 6.24% 4.36% 4.56%
Number of daily rates quoted 29 34 59
10th Percentile £463 £425 £463
25th Percentile £550 £475 £497
Median daily rate (50th Percentile) £600 £525 £525
Median % change year-on-year +14.29% - -2.33%
75th Percentile £638 £575 £594
90th Percentile £640 £596 £678
Central London median daily rate £600 £525 £525
% change year-on-year +14.29% - +5.00%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 513 940 1,776
As % of all contract IT jobs advertised in the City of London 20.85% 24.03% 26.26%
Number of daily rates quoted 361 714 1,410
10th Percentile £363 £363 £406
25th Percentile £425 £425 £456
Median daily rate (50th Percentile) £550 £500 £538
Median % change year-on-year +10.00% -6.98% +3.37%
75th Percentile £638 £600 £600
90th Percentile £700 £675 £675
Central London median daily rate £525 £500 £525
% change year-on-year +5.00% -4.76% +2.44%
Number of hourly rates quoted 1 4 9
10th Percentile " " £19.85
25th Percentile £21.73 £24.50 £32.50
Median hourly rate £23.45 £31.75 £35.00
Median % change year-on-year -26.14% -9.29% +59.09%
75th Percentile £25.18 £41.38 £37.50
90th Percentile " £45.20 £56.50
Central London median hourly rate £21.73 £31.75 £35.00
% change year-on-year -31.57% -9.29% +55.56%

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Data Lake in the City of London.

Daily rate trend for Data Lake in the City of London

Data Lake
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Data Lake in the City of London over the 6 months to 18 April 2021.

Daily rate histogram for Data Lake in the City of London

Data Lake
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the City of London region over the 6 months to 18 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +4 6 £600 +23.08%
Data Lake
Central London

For the 6 months to 18 April 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Data Lake.

1 23 (71.88%) AWS
2 22 (68.75%) Apache Spark
3 20 (62.50%) Python
4 19 (59.38%) Data Warehouse
4 19 (59.38%) SQL
4 19 (59.38%) Big Data
5 15 (46.88%) Hadoop
6 14 (43.75%) Analytical Skills
6 14 (43.75%) Finance
7 13 (40.63%) Kafka
7 13 (40.63%) Machine Learning
7 13 (40.63%) Apache Airflow
8 12 (37.50%) Java
9 11 (34.38%) Apache
9 11 (34.38%) Azure
10 10 (31.25%) Amazon Redshift
10 10 (31.25%) Algorithms
10 10 (31.25%) Agile Software Development
10 10 (31.25%) XML
11 9 (28.13%) Continuous Deployment
11 9 (28.13%) Data Transformation
11 9 (28.13%) NoSQL
12 8 (25.00%) MapReduce
12 8 (25.00%) PostGIS
12 8 (25.00%) Analytics
12 8 (25.00%) Forensic Analysis
12 8 (25.00%) SQL Optimisation
12 8 (25.00%) XML Parsing
12 8 (25.00%) Amazon Kinesis
12 8 (25.00%) Data Structures

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 22 (68.75%) Apache Spark
2 13 (40.63%) Apache Airflow
3 11 (34.38%) Apache
Cloud Services
1 23 (71.88%) AWS
2 11 (34.38%) Azure
3 8 (25.00%) Amazon Kinesis
4 7 (21.88%) Amazon EC2
5 5 (15.63%) Azure Data Factory
5 5 (15.63%) Power Platform
6 1 (3.13%) Amazon EMR
6 1 (3.13%) Amazon SageMaker
6 1 (3.13%) Data Lake Analytics
6 1 (3.13%) Logic Apps
6 1 (3.13%) PaaS
Communications & Networking
1 8 (25.00%) HTTP
Database & Business Intelligence
1 19 (59.38%) Big Data
1 19 (59.38%) Data Warehouse
2 15 (46.88%) Hadoop
3 10 (31.25%) Amazon Redshift
4 9 (28.13%) NoSQL
5 8 (25.00%) Parquet
5 8 (25.00%) Snowflake Schema
6 7 (21.88%) Amazon RDS
6 7 (21.88%) Relational Database
7 5 (15.63%) Power BI
8 3 (9.38%) Apache Hive
8 3 (9.38%) Spark SQL
8 3 (9.38%) SQL Server
9 2 (6.25%) Impala
9 2 (6.25%) PostgreSQL
9 2 (6.25%) Presto
9 2 (6.25%) SQL Server Analysis Services
10 1 (3.13%) Azure SQL Database
10 1 (3.13%) SQL Server 2014
10 1 (3.13%) Tableau
Development Applications
1 4 (12.50%) JIRA
2 2 (6.25%) Git (software)
2 2 (6.25%) Visual Studio Team System
3 1 (3.13%) Visual Studio
General
1 14 (43.75%) Finance
2 1 (3.13%) Banking
2 1 (3.13%) Financial Institution
Job Titles
1 25 (78.13%) Data Engineer
2 10 (31.25%) AWS Engineer
3 6 (18.75%) Developer
4 5 (15.63%) Big Data Engineer
4 5 (15.63%) Python Engineer
5 3 (9.38%) Senior Data Engineer
6 2 (6.25%) Architect
6 2 (6.25%) Azure Engineer
6 2 (6.25%) ETL Developer
6 2 (6.25%) Hadoop Engineer
6 2 (6.25%) Python Developer
7 1 (3.13%) Analyst
7 1 (3.13%) C# Developer
7 1 (3.13%) Data Architect
7 1 (3.13%) Data Warehouse Developer
7 1 (3.13%) Programme Manager
7 1 (3.13%) Report Analyst
7 1 (3.13%) Senior Analyst
7 1 (3.13%) Senior Reporting Analyst
7 1 (3.13%) Technical Architect
Libraries, Frameworks & Software Standards
1 13 (40.63%) Kafka
2 10 (31.25%) XML
3 8 (25.00%) HTML
3 8 (25.00%) PostGIS
3 8 (25.00%) Web Services
4 2 (6.25%) JSON
4 2 (6.25%) PySpark
4 2 (6.25%) Spring
5 1 (3.13%) MDX
5 1 (3.13%) React
Miscellaneous
1 14 (43.75%) Analytical Skills
2 10 (31.25%) Algorithms
3 8 (25.00%) Data Structures
3 8 (25.00%) Self-Motivation
4 2 (6.25%) Cloud Native
Processes & Methodologies
1 13 (40.63%) Machine Learning
2 10 (31.25%) Agile Software Development
3 9 (28.13%) Continuous Deployment
3 9 (28.13%) Data Transformation
4 8 (25.00%) Analytics
4 8 (25.00%) Change Management
4 8 (25.00%) Data Analysis
4 8 (25.00%) Data Science
4 8 (25.00%) Forensic Analysis
4 8 (25.00%) Load Testing
4 8 (25.00%) MapReduce
4 8 (25.00%) SQL Optimisation
4 8 (25.00%) Use Case
4 8 (25.00%) XML Parsing
5 6 (18.75%) Business Intelligence
6 5 (15.63%) Data Engineering
6 5 (15.63%) Data Modelling
6 5 (15.63%) Insurtech
7 4 (12.50%) DevOps
7 4 (12.50%) Fintech
Programming Languages
1 20 (62.50%) Python
2 19 (59.38%) SQL
3 12 (37.50%) Java
4 5 (15.63%) PowerShell
5 3 (9.38%) C#
5 3 (9.38%) Scala
6 2 (6.25%) Bash Shell
6 2 (6.25%) C++
7 1 (3.13%) Data Analysis Expressions (DAX)
7 1 (3.13%) JavaScript
7 1 (3.13%) T-SQL
Qualifications
1 1 (3.13%) Degree
Quality Assurance & Compliance
1 4 (12.50%) QA
Vendors
1 7 (21.88%) Talend
2 5 (15.63%) Databricks
3 3 (9.38%) Microsoft
4 2 (6.25%) Oracle
5 1 (3.13%) Salesforce.com
5 1 (3.13%) SAP