Period
to 23 September 2019

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 23 September 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
London > Central London
6 months to
23 Sep 2019
Same period 2018 Same period 2017
Rank 138 245 255
Rank change year-on-year +107 +10 +12
Contract jobs citing Data Lake 138 45 16
As % of all contract IT jobs advertised in Central London 1.74% 0.50% 0.20%
As % of the Database & Business Intelligence category 6.69% 1.98% 0.80%
Number of daily rates quoted 113 41 11
Central London median daily rate £525 £550 £525
Median daily rate % change year-on-year -4.55% +4.76% -15.15%
10th Percentile £415 £425 £413
90th Percentile £674 £700 £819
London median daily rate £550 £525 £550
% change year-on-year +4.76% -4.55% -8.33%
Number of hourly rates quoted 0 0 0
Central London median hourly rate - - -
London median hourly rate - - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 2,064 2,278 2,002
As % of all contract IT jobs advertised in Central London 26.01% 25.45% 25.18%
Number of daily rates quoted 1,638 1,806 1,552
Central London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +11.11%
10th Percentile £375 £363 £363
90th Percentile £675 £675 £675
London median daily rate £525 £525 £500
% change year-on-year - +5.00% +5.26%
Number of hourly rates quoted 9 14 10
Central London median hourly rate £44.57 £22.25 £25.99
Median hourly rate % change year-on-year +100.29% -14.40% +45.41%
10th Percentile £21.23 £19.50 £20.75
90th Percentile £70.10 £37.09 £33.56
London median hourly rate £35.00 £27.50 £27.33
% change year-on-year +27.27% +0.62% -14.59%

Data Lake
Job Vacancy Trend in Central London

Job postings citing Data Lake as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Data Lake in Central London

Data Lake
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in Central London.

Contractor daily rate trend for Data Lake in Central London

Data Lake
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Data Lake in Central London over the 6 months to 23 September 2019.

Contractor daily rate histogram for Data Lake in Central London

Data Lake
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the Central London region over the 6 months to 23 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London +86 101 £525 -4.55% 23
Southwark - 10 £550 -
City of Westminster - 2 £600 -
Data Lake
London

For the 6 months to 23 September 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Data Lake.

1 79 (57.25%) Azure
2 67 (48.55%) SQL
3 60 (43.48%) Data Warehouse
4 54 (39.13%) Big Data
5 49 (35.51%) Python
6 44 (31.88%) C#
7 42 (30.43%) Finance
8 39 (28.26%) Data Modelling
8 39 (28.26%) Hadoop
9 37 (26.81%) .NET
10 36 (26.09%) Serverless
11 35 (25.36%) Apache Spark
12 34 (24.64%) Agile Software Development
13 33 (23.91%) Business Intelligence
13 33 (23.91%) Microservices
14 32 (23.19%) Azure SQL Database
15 30 (21.74%) Microsoft
16 29 (21.01%) Azure Data Factory
17 27 (19.57%) Kafka
17 27 (19.57%) AWS
18 26 (18.84%) Analytics
18 26 (18.84%) Apache Hive
18 26 (18.84%) ETL
19 25 (18.12%) Power Platform
19 25 (18.12%) Cosmos DB
19 25 (18.12%) Docker
19 25 (18.12%) Power BI
20 24 (17.39%) Cloudera
21 23 (16.67%) Kubernetes
22 22 (15.94%) Redis

Data Lake
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 35 (25.36%) Apache Spark
2 7 (5.07%) SharePoint
3 3 (2.17%) Confluence
3 3 (2.17%) Elasticsearch
3 3 (2.17%) Jupyter
4 2 (1.45%) Apache
5 1 (0.72%) Anypoint
5 1 (0.72%) SAS
Applications
1 2 (1.45%) Microsoft Office
2 1 (0.72%) Microsoft Excel
Business Applications
1 4 (2.90%) Dynamics AX
1 4 (2.90%) Dynamics CRM
1 4 (2.90%) Dynamics NAV
2 1 (0.72%) Markit EDM
2 1 (0.72%) SAP ERP
2 1 (0.72%) SAP Oil and Gas
2 1 (0.72%) SAP S/4HANA
Cloud Services
1 79 (57.25%) Azure
2 36 (26.09%) Serverless
3 29 (21.01%) Azure Data Factory
4 27 (19.57%) AWS
5 25 (18.12%) Power Platform
6 17 (12.32%) Amazon S3
7 10 (7.25%) Amazon EMR
8 9 (6.52%) Azure Functions
8 9 (6.52%) Data Lake Analytics
9 7 (5.07%) AWS Lambda
9 7 (5.07%) Office 365
10 6 (4.35%) GCP
11 5 (3.62%) Amazon Kinesis
11 5 (3.62%) Dynamics 365
12 3 (2.17%) Apigee
12 3 (2.17%) Azure Active Directory
12 3 (2.17%) Cloud Computing
12 3 (2.17%) IaaS
12 3 (2.17%) PaaS
13 2 (1.45%) GitHub
Communications & Networking
1 2 (1.45%) Kerberos
Database & Business Intelligence
1 60 (43.48%) Data Warehouse
2 54 (39.13%) Big Data
3 39 (28.26%) Hadoop
4 32 (23.19%) Azure SQL Database
5 26 (18.84%) Apache Hive
6 25 (18.12%) Cosmos DB
6 25 (18.12%) Power BI
7 22 (15.94%) Redis
8 18 (13.04%) Azure SQL Data Warehouse
8 18 (13.04%) SQL Server
9 16 (11.59%) SQL Server Integration Services
10 11 (7.97%) NoSQL
11 10 (7.25%) SQL Server Analysis Services
12 8 (5.80%) Amazon Redshift
12 8 (5.80%) MySQL
12 8 (5.80%) SQL Server Reporting Services
13 7 (5.07%) MongoDB
13 7 (5.07%) PostgreSQL
14 6 (4.35%) Impala
15 5 (3.62%) Microsoft Analysis Services
Development Applications
1 10 (7.25%) Git (software)
2 7 (5.07%) Visual Studio Team System
3 5 (3.62%) JIRA
4 4 (2.90%) Cucumber
4 4 (2.90%) Jenkins
5 3 (2.17%) Atlassian Bamboo
5 3 (2.17%) SpecFlow
5 3 (2.17%) TeamCity
5 3 (2.17%) Visual Studio
6 2 (1.45%) Hudson
6 2 (1.45%) Octopus Deploy
6 2 (1.45%) Team Foundation Server
6 2 (1.45%) tSQLt
7 1 (0.72%) Concordion
7 1 (0.72%) EasyMock
7 1 (0.72%) Maven
7 1 (0.72%) Mocha
7 1 (0.72%) Mockito
7 1 (0.72%) Selenium
7 1 (0.72%) Spock
General
1 42 (30.43%) Finance
2 7 (5.07%) Advertising
3 6 (4.35%) Retail
4 3 (2.17%) Banking
4 3 (2.17%) Marketing
5 1 (0.72%) Environmental Health
5 1 (0.72%) Front Office
5 1 (0.72%) Public Sector
Job Titles
1 43 (31.16%) Data Engineer
2 25 (18.12%) Architect
3 21 (15.22%) Big Data Engineer
4 20 (14.49%) Developer
5 19 (13.77%) Data Architect
6 14 (10.14%) Azure Engineer
7 13 (9.42%) Azure Architect
8 8 (5.80%) Senior Developer
9 6 (4.35%) Administrator
9 6 (4.35%) Azure Developer
10 5 (3.62%) AWS Engineer
10 5 (3.62%) Data Warehouse Architect
10 5 (3.62%) Senior Architect
10 5 (3.62%) Senior Data Architect
11 4 (2.90%) Azure DevOps
11 4 (2.90%) Big Data Architect
11 4 (2.90%) C# Developer
11 4 (2.90%) CRM Developer
11 4 (2.90%) Dynamics CRM Developer
11 4 (2.90%) Python Developer
Libraries, Frameworks & Software Standards
1 37 (26.81%) .NET
2 27 (19.57%) Kafka
3 20 (14.49%) .NET Core
4 16 (11.59%) AngularJS
5 9 (6.52%) JSON
6 8 (5.80%) XML
7 7 (5.07%) Web Services
8 4 (2.90%) REST
9 3 (2.17%) .NET Framework
9 3 (2.17%) LAMP
9 3 (2.17%) Velocity
10 2 (1.45%) Angular 2
10 2 (1.45%) Flask
10 2 (1.45%) Gherkin
10 2 (1.45%) LDAP
10 2 (1.45%) MDX
10 2 (1.45%) Spark Streaming
10 2 (1.45%) Spring
11 1 (0.72%) React
11 1 (0.72%) Spring Boot
Miscellaneous
1 21 (15.22%) Greenfield Project
2 15 (10.87%) Analytical Skills
3 4 (2.90%) Data Structures
3 4 (2.90%) User Experience
4 3 (2.17%) Algorithms
4 3 (2.17%) Cloud Native
5 2 (1.45%) Linux Command Line
5 2 (1.45%) Self-Motivation
6 1 (0.72%) Data Centre
6 1 (0.72%) Hybrid Cloud
6 1 (0.72%) Public Cloud
6 1 (0.72%) Reference Data
6 1 (0.72%) SCADA
Operating Systems
1 6 (4.35%) Linux
2 3 (2.17%) Unix
2 3 (2.17%) VMS
3 2 (1.45%) CentOS
3 2 (1.45%) Windows
Processes & Methodologies
1 39 (28.26%) Data Modelling
2 34 (24.64%) Agile Software Development
3 33 (23.91%) Business Intelligence
3 33 (23.91%) Microservices
4 26 (18.84%) Analytics
4 26 (18.84%) ETL
5 22 (15.94%) TDD
6 20 (14.49%) Single Customer View
7 19 (13.77%) Migration
8 16 (11.59%) DevOps
8 16 (11.59%) Problem-Solving
9 14 (10.14%) Data Architecture
9 14 (10.14%) Fintech
10 13 (9.42%) Data Science
11 12 (8.70%) Scrum
12 11 (7.97%) Data Integration
12 11 (7.97%) Dimensional Modelling
13 10 (7.25%) Test Automation
14 9 (6.52%) Continuous Integration
14 9 (6.52%) Data Migration
Programming Languages
1 67 (48.55%) SQL
2 49 (35.51%) Python
3 44 (31.88%) C#
4 17 (12.32%) Java
5 6 (4.35%) PowerShell
5 6 (4.35%) T-SQL
6 5 (3.62%) JavaScript
6 5 (3.62%) Scala
6 5 (3.62%) Shell Script
7 4 (2.90%) U-SQL
8 3 (2.17%) Bash Shell
8 3 (2.17%) Perl
9 2 (1.45%) Clojure
9 2 (1.45%) Data Analysis Expressions (DAX)
9 2 (1.45%) Go
10 1 (0.72%) C
10 1 (0.72%) Java 8
10 1 (0.72%) PL/SQL
Qualifications
1 2 (1.45%) Degree
1 2 (1.45%) PRINCE2 Certification
1 2 (1.45%) SC Cleared
1 2 (1.45%) Security Cleared
2 1 (0.72%) Master's Degree
Quality Assurance & Compliance
1 7 (5.07%) Data Quality
2 4 (2.90%) GDPR
3 3 (2.17%) QA
System Software
1 25 (18.12%) Docker
2 20 (14.49%) Apache Flume
3 8 (5.80%) HDFS
4 3 (2.17%) Active Directory
4 3 (2.17%) Virtual Machines
5 2 (1.45%) NFS
5 2 (1.45%) Samba
5 2 (1.45%) VMware ESXi
5 2 (1.45%) VMware Infrastructure
Systems Management
1 23 (16.67%) Kubernetes
2 7 (5.07%) Hadoop YARN
3 2 (1.45%) Ambari
3 2 (1.45%) Ansible
3 2 (1.45%) Terraform
4 1 (0.72%) Microsoft Intune
4 1 (0.72%) Puppet
4 1 (0.72%) SCCM
Vendors
1 30 (21.74%) Microsoft
2 24 (17.39%) Cloudera
3 21 (15.22%) Talend
4 12 (8.70%) Databricks
5 7 (5.07%) Tableau
6 5 (3.62%) Google
6 5 (3.62%) MuleSoft
6 5 (3.62%) Oracle
7 4 (2.90%) Informatica
8 3 (2.17%) Teradata
9 2 (1.45%) Alteryx
9 2 (1.45%) Hortonworks
9 2 (1.45%) IBM
9 2 (1.45%) NetApp
9 2 (1.45%) Red Hat
9 2 (1.45%) VMware
10 1 (0.72%) Ab Initio
10 1 (0.72%) Atlassian
10 1 (0.72%) SAP
10 1 (0.72%) Siebel