Period
to 18 January 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 18 January 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
18 Jan 2019
Same period 2018 Same period 2017
Rank 292 457 494
Rank change year-on-year +165 +37 +79
Contract jobs citing Data Lake 390 182 110
As % of all contract IT jobs advertised in London 0.88% 0.39% 0.26%
As % of the Database & Business Intelligence category 3.63% 1.65% 1.09%
Number of daily rates quoted 276 138 76
London median daily rate £525 £513 £600
Median daily rate % change year-on-year +2.44% -14.58% +20.00%
10th Percentile £425 £372 £441
90th Percentile £713 £658 £688
England median daily rate £525 £513 £550
% change year-on-year +2.44% -6.82% -
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate - £45.00 -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 10,732 11,021 10,062
As % of all contract IT jobs advertised in London 24.13% 23.70% 23.95%
Number of daily rates quoted 7,949 8,292 7,142
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £363 £350 £325
90th Percentile £675 £650 £638
England median daily rate £484 £470 £428
% change year-on-year +2.98% +9.81% +0.71%
Number of hourly rates quoted 48 61 46
London median hourly rate £28.50 £26.78 £33.25
Median hourly rate % change year-on-year +6.44% -19.47% -2.21%
10th Percentile £19.15 £17.30 £15.25
90th Percentile £47.50 £58.75 £65.00
England median hourly rate £35.00 £31.31 £28.00
% change year-on-year +11.79% +11.82% -6.67%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in London.

Contractor daily rate trend for Data Lake in London

Data Lake
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Lake in London over the 6 months to 18 January 2019.

Contractor daily rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 18 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +43 74 £538 +4.88% 14
West London +23 13 £525 +48.73% 8
South London +6 10 £475 -
East London -22 7 £575 +4.55% 3
North London - 2 £594 -
Data Lake
England

For the 6 months to 18 January 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 214 (54.87%) Microsoft Azure
2 155 (39.74%) SQL
3 145 (37.18%) Analytics
4 143 (36.67%) Agile Software Development
5 136 (34.87%) Data Warehouse
6 129 (33.08%) Business Intelligence
7 127 (32.56%) Big Data
8 109 (27.95%) Hadoop
9 106 (27.18%) Python
10 105 (26.92%) SQL Server
11 101 (25.90%) Azure Data Factory
12 98 (25.13%) Data Modelling
13 97 (24.87%) Microsoft
14 93 (23.85%) ETL
15 92 (23.59%) Apache Spark
16 90 (23.08%) Finance
17 88 (22.56%) SQL Server Integration Services
18 86 (22.05%) Scrum
19 78 (20.00%) Power BI
20 75 (19.23%) .NET
21 70 (17.95%) Kafka
22 69 (17.69%) Apache Hive
22 69 (17.69%) Azure SQL Database
23 64 (16.41%) Amazon AWS
24 59 (15.13%) C#
25 57 (14.62%) Serverless
26 56 (14.36%) Data Science
27 54 (13.85%) DevOps
28 51 (13.08%) SQL Server Analysis Services
28 51 (13.08%) Cosmos DB

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 92 (23.59%) Apache Spark
2 18 (4.62%) Apache
3 15 (3.85%) SAS
4 9 (2.31%) Elasticsearch
5 8 (2.05%) SharePoint
6 5 (1.28%) Confluence
7 4 (1.03%) Apache Pig
7 4 (1.03%) Apache Solr
8 3 (0.77%) Apache Airflow
9 2 (0.51%) Jupyter
9 2 (0.51%) K2 blackpearl
9 2 (0.51%) Luigi
9 2 (0.51%) nginx
9 2 (0.51%) Oracle SOA Suite
9 2 (0.51%) PowerExchange
9 2 (0.51%) SharePoint 2013
10 1 (0.26%) Alfresco
10 1 (0.26%) Content Management Server
Applications
1 14 (3.59%) Microsoft Excel
2 2 (0.51%) Spreadsheet
2 2 (0.51%) SPSS
Business Applications
1 9 (2.31%) SAP Oil and Gas
2 7 (1.79%) Dynamics CRM
3 2 (0.51%) Markit EDM
3 2 (0.51%) PolarLake
4 1 (0.26%) Dynamics AX
4 1 (0.26%) Dynamics NAV
4 1 (0.26%) SAP PLM
4 1 (0.26%) Summit
Cloud Services
1 214 (54.87%) Microsoft Azure
2 101 (25.90%) Azure Data Factory
3 64 (16.41%) Amazon AWS
4 57 (14.62%) Serverless
5 38 (9.74%) Data Lake Analytics
6 33 (8.46%) PaaS
7 32 (8.21%) Google Cloud Platform
8 30 (7.69%) Azure Functions
9 19 (4.87%) Amazon S3
10 14 (3.59%) Azure Active Directory
11 12 (3.08%) IaaS
12 11 (2.82%) Amazon EMR
13 10 (2.56%) Amazon Kinesis
14 8 (2.05%) GitHub
15 7 (1.79%) Azure Machine Learning
15 7 (1.79%) SaaS
16 6 (1.54%) Amazon EC2
16 6 (1.54%) Office 365
17 4 (1.03%) AWS Lambda
18 3 (0.77%) Cortana Intelligence Suite
Communications & Networking
1 6 (1.54%) Firewall
2 4 (1.03%) VPN
3 3 (0.77%) DNS
3 3 (0.77%) Kerberos
3 3 (0.77%) Network Security
4 2 (0.51%) SSL
4 2 (0.51%) Wi-Fi
5 1 (0.26%) Internet
Database & Business Intelligence
1 136 (34.87%) Data Warehouse
2 127 (32.56%) Big Data
3 109 (27.95%) Hadoop
4 105 (26.92%) SQL Server
5 88 (22.56%) SQL Server Integration Services
6 78 (20.00%) Power BI
7 69 (17.69%) Apache Hive
7 69 (17.69%) Azure SQL Database
8 51 (13.08%) Cosmos DB
8 51 (13.08%) SQL Server Analysis Services
9 44 (11.28%) SQL Server Reporting Services
10 39 (10.00%) HDInsight
11 38 (9.74%) Azure SQL Data Warehouse
12 37 (9.49%) Relational Database
13 36 (9.23%) HBase
14 33 (8.46%) NoSQL
15 31 (7.95%) Redis
16 20 (5.13%) Microsoft Analysis Services
17 18 (4.62%) Impala
17 18 (4.62%) MongoDB
Development Applications
1 31 (7.95%) Visual Studio Team System
2 29 (7.44%) Git (software)
3 23 (5.90%) Jenkins
4 16 (4.10%) Team Foundation Server
5 12 (3.08%) NUnit
6 11 (2.82%) JIRA
6 11 (2.82%) Moq
6 11 (2.82%) Visual Studio
7 5 (1.28%) JUnit
8 4 (1.03%) Ant
8 4 (1.03%) CruiseControl
8 4 (1.03%) IBM UrbanCode
8 4 (1.03%) Maven
8 4 (1.03%) Sonatype Nexus
9 3 (0.77%) Selenium
10 2 (0.51%) FishEye
10 2 (0.51%) Octopus Deploy
10 2 (0.51%) RStudio
10 2 (0.51%) SoapUI
10 2 (0.51%) TeamCity
General
1 90 (23.08%) Finance
2 46 (11.79%) Banking
3 42 (10.77%) Retail
4 17 (4.36%) Marketing
5 8 (2.05%) Front Office
6 7 (1.79%) Investment Banking
7 6 (1.54%) Back Office
7 6 (1.54%) Publishing
8 5 (1.28%) Telecoms
9 4 (1.03%) Games
9 4 (1.03%) Legal
10 3 (0.77%) Pharmaceutical
11 1 (0.26%) Advertising
11 1 (0.26%) Dutch Language
11 1 (0.26%) French Language
11 1 (0.26%) Retail Banking
Job Titles
1 130 (33.33%) Developer
2 83 (21.28%) Data Engineer
3 82 (21.03%) Architect
4 55 (14.10%) Azure Developer
5 44 (11.28%) Data Architect
6 32 (8.21%) Business Intelligence Developer
7 30 (7.69%) .NET Developer
8 28 (7.18%) Azure Architect
8 28 (7.18%) Big Data Engineer
9 23 (5.90%) C# Developer
10 21 (5.38%) Technical Architect
11 15 (3.85%) Consultant
12 14 (3.59%) Azure Engineer
12 14 (3.59%) Python Engineer
13 13 (3.33%) Analyst
13 13 (3.33%) C# .NET Developer
13 13 (3.33%) Senior Data Engineer
13 13 (3.33%) Senior Developer
14 12 (3.08%) AWS Engineer
15 11 (2.82%) Solutions Architect
Libraries, Frameworks & Software Standards
1 75 (19.23%) .NET
2 70 (17.95%) Kafka
3 34 (8.72%) ASP.NET Web API
4 29 (7.44%) .NET Core
5 27 (6.92%) AngularJS
6 26 (6.67%) REST
7 24 (6.15%) JSON
8 17 (4.36%) React
9 16 (4.10%) .NET Framework
10 15 (3.85%) ASP.NET
10 15 (3.85%) HTML
11 12 (3.08%) Angular 2
12 11 (2.82%) CSS
12 11 (2.82%) Node.js
13 9 (2.31%) Middleware
13 9 (2.31%) Twitter Bootstrap
14 8 (2.05%) Entity Framework
14 8 (2.05%) MDX
14 8 (2.05%) Pandas
14 8 (2.05%) XML
Miscellaneous
1 45 (11.54%) Greenfield Project
2 28 (7.18%) Analytical Skills
3 16 (4.10%) Algorithms
3 16 (4.10%) Data Structures
4 15 (3.85%) Fintech
5 10 (2.56%) Virtual Team
6 6 (1.54%) Management Information System
7 5 (1.28%) Digital Media
8 4 (1.03%) Fixed Income
8 4 (1.03%) Public Cloud
8 4 (1.03%) Reference Data
9 3 (0.77%) Foreign Exchange (FX)
9 3 (0.77%) Hybrid Cloud
9 3 (0.77%) Self-Motivation
10 2 (0.51%) Derivative
10 2 (0.51%) e-Health
10 2 (0.51%) Equities
10 2 (0.51%) LIMS
10 2 (0.51%) PACS
10 2 (0.51%) PMI
Operating Systems
1 15 (3.85%) Linux
2 8 (2.05%) Unix
3 6 (1.54%) Windows
4 2 (0.51%) VMS
5 1 (0.26%) Oracle Linux
5 1 (0.26%) Ubuntu
5 1 (0.26%) Windows Server
Processes & Methodologies
1 145 (37.18%) Analytics
2 143 (36.67%) Agile Software Development
3 129 (33.08%) Business Intelligence
4 98 (25.13%) Data Modelling
5 93 (23.85%) ETL
6 86 (22.05%) Scrum
7 56 (14.36%) Data Science
8 54 (13.85%) DevOps
9 43 (11.03%) TDD
10 42 (10.77%) Data Analytics
11 38 (9.74%) Data Management
11 38 (9.74%) Microservices
12 36 (9.23%) Continuous Integration
13 33 (8.46%) Data Integration
14 32 (8.21%) Data Engineering
15 31 (7.95%) Visualisation
16 29 (7.44%) Data Analysis
17 28 (7.18%) Migration
18 26 (6.67%) Kimball Methodology
18 26 (6.67%) Test Automation
Programming Languages
1 155 (39.74%) SQL
2 106 (27.18%) Python
3 59 (15.13%) C#
4 49 (12.56%) Java
5 37 (9.49%) PowerShell
6 34 (8.72%) R
7 31 (7.95%) Scala
8 29 (7.44%) T-SQL
9 24 (6.15%) JavaScript
10 17 (4.36%) U-SQL
11 14 (3.59%) Data Analysis Expressions (DAX)
12 8 (2.05%) Bash Shell
13 6 (1.54%) C
13 6 (1.54%) VB
14 4 (1.03%) Perl
14 4 (1.03%) Ruby
15 3 (0.77%) Shell Script
16 2 (0.51%) C++
16 2 (0.51%) PHP
16 2 (0.51%) VBA
Qualifications
1 15 (3.85%) Degree
2 11 (2.82%) Computer Science Degree
3 4 (1.03%) BPSS Clearance
3 4 (1.03%) CEH
3 4 (1.03%) Microsoft Certification
4 3 (0.77%) ITIL Certification
4 3 (0.77%) Postgraduate
5 2 (0.51%) CISM
5 2 (0.51%) CISSP
5 2 (0.51%) Numerate Degree
5 2 (0.51%) PMI Certification
5 2 (0.51%) SC Cleared
5 2 (0.51%) Security Cleared
6 1 (0.26%) DV Cleared
6 1 (0.26%) TOGAF Certification
Quality Assurance & Compliance
1 19 (4.87%) QA
2 9 (2.31%) Data Quality
3 4 (1.03%) GDPR
4 2 (0.51%) HL7
4 2 (0.51%) Solvency II
5 1 (0.26%) Disclosure Scotland
5 1 (0.26%) PMO
System Software
1 30 (7.69%) Apache Flume
2 18 (4.62%) Docker
3 15 (3.85%) HDFS
4 12 (3.08%) Active Directory
5 10 (2.56%) Virtual Machines
6 5 (1.28%) Apache ZooKeeper
Systems Management
1 18 (4.62%) Kubernetes
2 13 (3.33%) Oozie
3 12 (3.08%) Ansible
3 12 (3.08%) Hadoop YARN
3 12 (3.08%) Terraform
4 7 (1.79%) Control-M
5 6 (1.54%) ITRS Geneos
5 6 (1.54%) Puppet
6 2 (0.51%) Kibana
6 2 (0.51%) logstash
6 2 (0.51%) Opscode Chef
6 2 (0.51%) Salt
6 2 (0.51%) Single Sign-On
7 1 (0.26%) Ambari
Vendors
1 97 (24.87%) Microsoft
2 38 (9.74%) Oracle
3 36 (9.23%) Cloudera
3 36 (9.23%) Tableau
4 29 (7.44%) Talend
5 25 (6.41%) Google
6 22 (5.64%) Informatica
7 18 (4.62%) SAP
8 17 (4.36%) Databricks
9 16 (4.10%) Alteryx
10 15 (3.85%) Hortonworks
11 12 (3.08%) Splunk
12 6 (1.54%) MapR
13 5 (1.28%) ATG
13 5 (1.28%) Atlassian
13 5 (1.28%) Teradata
14 4 (1.03%) Cisco
14 4 (1.03%) Salesforce.com
14 4 (1.03%) Sybase
15 3 (0.77%) MicroStrategy