Period
to 10 December 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 10 December 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
Central London > City of London
6 months to
10 Dec 2019
Same period 2018 Same period 2017
Rank 140 216 231
Rank change year-on-year +76 +15 -16
Contract jobs citing Data Lake 75 50 16
As % of all contract IT jobs advertised in the City of London 1.33% 0.70% 0.22%
As % of the Database & Business Intelligence category 5.45% 2.81% 0.91%
Number of daily rates quoted 61 39 16
City of London median daily rate £538 £550 £525
Median daily rate % change year-on-year -2.27% +4.76% -16.00%
10th Percentile £413 £454 £416
90th Percentile £700 £680 £784
Central London median daily rate £548 £550 £525
% change year-on-year -0.45% +4.76% -16.00%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,376 1,777 1,756
As % of all contract IT jobs advertised in the City of London 24.41% 24.89% 24.59%
Number of daily rates quoted 1,084 1,425 1,439
City of London median daily rate £525 £525 £525
10th Percentile £388 £375 £369
90th Percentile £675 £675 £697
Central London median daily rate £520 £525 £525
% change year-on-year -0.95% - +10.53%
Number of hourly rates quoted 4 11 9
City of London median hourly rate £37.17 £35.00 £27.50
Median hourly rate % change year-on-year +6.19% +27.27% -38.89%
10th Percentile £21.19 £19.50 £20.75
90th Percentile £91.90 £42.19 £33.25
Central London median hourly rate £35.00 £35.00 £27.50
% change year-on-year - +27.27% -38.89%

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in the City of London.

Contractor daily rate trend for Data Lake in the City of London

Data Lake
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Data Lake in the City of London over the 6 months to 10 December 2019.

Contractor daily rate histogram for Data Lake in the City of London

Data Lake
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the City of London region over the 6 months to 10 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +47 12 £525 -
Data Lake
Central London

For the 6 months to 10 December 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Data Lake.

1 54 (72.00%) Azure
2 40 (53.33%) SQL
3 32 (42.67%) Azure Data Factory
4 31 (41.33%) Serverless
5 30 (40.00%) Microsoft
6 29 (38.67%) C#
7 27 (36.00%) Azure SQL Database
8 26 (34.67%) Agile Software Development
9 23 (30.67%) Business Intelligence
10 22 (29.33%) Analytics
11 21 (28.00%) .NET
12 20 (26.67%) Data Warehouse
13 19 (25.33%) Python
13 19 (25.33%) Power Platform
13 19 (25.33%) Power BI
14 18 (24.00%) Databricks
15 17 (22.67%) Finance
16 16 (21.33%) Data Modelling
16 16 (21.33%) Azure Functions
16 16 (21.33%) Big Data
17 15 (20.00%) Migration
18 13 (17.33%) AWS
18 13 (17.33%) Amazon S3
19 12 (16.00%) SQL Server Analysis Services
19 12 (16.00%) Mentoring
19 12 (16.00%) Azure SQL Data Warehouse
19 12 (16.00%) Data Lake Analytics
20 11 (14.67%) Data Science
20 11 (14.67%) DevOps
20 11 (14.67%) Kubernetes

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 7 (9.33%) Apache Spark
2 3 (4.00%) Jupyter
3 2 (2.67%) Confluence
3 2 (2.67%) Elasticsearch
3 2 (2.67%) SharePoint
4 1 (1.33%) SAS
Business Applications
1 2 (2.67%) Dynamics CRM
2 1 (1.33%) Dynamics AX
2 1 (1.33%) Dynamics NAV
2 1 (1.33%) SAP Oil and Gas
Cloud Services
1 54 (72.00%) Azure
2 32 (42.67%) Azure Data Factory
3 31 (41.33%) Serverless
4 19 (25.33%) Power Platform
5 16 (21.33%) Azure Functions
6 13 (17.33%) Amazon S3
6 13 (17.33%) AWS
7 12 (16.00%) Data Lake Analytics
8 7 (9.33%) Amazon EMR
8 7 (9.33%) AWS Lambda
9 5 (6.67%) Azure Active Directory
10 3 (4.00%) GCP
11 2 (2.67%) Amazon CloudWatch
11 2 (2.67%) Amazon Kinesis
11 2 (2.67%) AWS CloudFormation
11 2 (2.67%) AWS CloudTrail
11 2 (2.67%) Dynamics 365
11 2 (2.67%) IaaS
11 2 (2.67%) Office 365
11 2 (2.67%) SaaS
Database & Business Intelligence
1 27 (36.00%) Azure SQL Database
2 20 (26.67%) Data Warehouse
3 19 (25.33%) Power BI
4 16 (21.33%) Big Data
5 12 (16.00%) Azure SQL Data Warehouse
5 12 (16.00%) SQL Server Analysis Services
6 11 (14.67%) SQL Server Integration Services
7 10 (13.33%) Hadoop
8 8 (10.67%) Cosmos DB
8 8 (10.67%) SQL Server
9 6 (8.00%) Microsoft Analysis Services
9 6 (8.00%) NoSQL
9 6 (8.00%) Redis
9 6 (8.00%) SQL Server Reporting Services
10 5 (6.67%) Amazon Redshift
10 5 (6.67%) Apache Hive
11 4 (5.33%) Data Mart
12 3 (4.00%) Impala
12 3 (4.00%) MongoDB
12 3 (4.00%) SQL Server 2014
Development Applications
1 6 (8.00%) Git (software)
2 5 (6.67%) JIRA
2 5 (6.67%) Visual Studio Team System
3 3 (4.00%) Atlassian Bamboo
3 3 (4.00%) Jenkins
3 3 (4.00%) Visual Studio
4 2 (2.67%) Cucumber
4 2 (2.67%) Team Foundation Server
5 1 (1.33%) Maven
5 1 (1.33%) Mocha
5 1 (1.33%) NUnit
5 1 (1.33%) PowerDesigner
5 1 (1.33%) Selenium
5 1 (1.33%) Spock
5 1 (1.33%) TeamCity
General
1 17 (22.67%) Finance
2 6 (8.00%) Advertising
3 3 (4.00%) Marketing
4 2 (2.67%) Banking
Job Titles
1 23 (30.67%) Developer
2 19 (25.33%) Architect
3 18 (24.00%) Data Architect
4 12 (16.00%) Azure Developer
5 10 (13.33%) Azure Engineer
5 10 (13.33%) Data Engineer
6 9 (12.00%) C# Developer
7 5 (6.67%) Azure Architect
7 5 (6.67%) Senior Architect
7 5 (6.67%) Senior Data Architect
8 4 (5.33%) Senior Developer
9 3 (4.00%) .NET Developer
9 3 (4.00%) Applications Developer
9 3 (4.00%) C# Application Developer
9 3 (4.00%) Data Warehouse Architect
9 3 (4.00%) Python Developer
9 3 (4.00%) Senior C# Developer
9 3 (4.00%) SQL Developer
9 3 (4.00%) SSIS Developer
9 3 (4.00%) SSRS Developer
Libraries, Frameworks & Software Standards
1 21 (28.00%) .NET
2 6 (8.00%) .NET Core
3 4 (5.33%) MDX
3 4 (5.33%) Web Services
4 3 (4.00%) AngularJS
4 3 (4.00%) JSON
4 3 (4.00%) Kafka
4 3 (4.00%) XML
5 2 (2.67%) .NET Framework
5 2 (2.67%) Flask
5 2 (2.67%) GraphQL
5 2 (2.67%) Node.js
5 2 (2.67%) Vue.js
6 1 (1.33%) Gherkin
6 1 (1.33%) REST
6 1 (1.33%) Spring
Miscellaneous
1 7 (9.33%) Greenfield Project
2 4 (5.33%) Analytical Skills
3 3 (4.00%) Algorithms
4 2 (2.67%) Cloud Native
5 1 (1.33%) Data Centre
5 1 (1.33%) Enterprise Cloud
5 1 (1.33%) Linux Command Line
5 1 (1.33%) Public Cloud
5 1 (1.33%) User Experience
Operating Systems
1 2 (2.67%) Unix
2 1 (1.33%) Linux
Processes & Methodologies
1 26 (34.67%) Agile Software Development
2 23 (30.67%) Business Intelligence
3 22 (29.33%) Analytics
4 16 (21.33%) Data Modelling
5 15 (20.00%) Migration
6 12 (16.00%) Mentoring
7 11 (14.67%) Continuous Integration
7 11 (14.67%) Data Architecture
7 11 (14.67%) Data Science
7 11 (14.67%) DevOps
7 11 (14.67%) ETL
8 10 (13.33%) Microservices
8 10 (13.33%) Test Automation
9 9 (12.00%) Data Management
10 8 (10.67%) Data Integration
11 7 (9.33%) Dimensional Modelling
11 7 (9.33%) Stakeholder Management
11 7 (9.33%) TDD
12 6 (8.00%) Machine Learning
13 5 (6.67%) Continuous Improvement
Programming Languages
1 40 (53.33%) SQL
2 29 (38.67%) C#
3 19 (25.33%) Python
4 7 (9.33%) Scala
5 6 (8.00%) PowerShell
6 4 (5.33%) Data Analysis Expressions (DAX)
6 4 (5.33%) Java
7 3 (4.00%) T-SQL
8 1 (1.33%) Bash Shell
8 1 (1.33%) Java 8
8 1 (1.33%) U-SQL
Quality Assurance & Compliance
1 5 (6.67%) Data Quality
2 2 (2.67%) GDPR
System Software
1 10 (13.33%) Docker
2 6 (8.00%) Virtual Machines
3 5 (6.67%) Active Directory
3 5 (6.67%) HDFS
4 2 (2.67%) NFS
Systems Management
1 11 (14.67%) Kubernetes
2 2 (2.67%) Hadoop YARN
3 1 (1.33%) Ansible
3 1 (1.33%) Kubeflow
3 1 (1.33%) Terraform
Vendors
1 30 (40.00%) Microsoft
2 18 (24.00%) Databricks
3 5 (6.67%) Tableau
4 3 (4.00%) Cloudera
4 3 (4.00%) Google
5 2 (2.67%) NetApp
5 2 (2.67%) SAP
6 1 (1.33%) Atlassian
6 1 (1.33%) MuleSoft