Period
to 14 November 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 14 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
14 Nov 2018
Same period 2017 Same period 2016
Rank 319 500 538
Rank change year-on-year +181 +38 +65
Contract jobs citing Data Lake 359 130 99
As % of all contract IT jobs advertised in London 0.77% 0.28% 0.22%
As % of the Database & Business Intelligence category 3.16% 1.17% 0.94%
Number of daily rates quoted 254 92 70
London median daily rate £525 £550 £625
Median daily rate % change year-on-year -4.55% -12.00% -21.88%
10th Percentile £414 £363 £473
90th Percentile £705 £723 £753
England median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate £49.75 £45.00 -
% change year-on-year +10.56% - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,359 11,140 10,489
As % of all contract IT jobs advertised in London 24.43% 23.72% 23.30%
Number of daily rates quoted 8,479 8,255 7,436
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £363 £350 £319
90th Percentile £675 £656 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +3.03%
Number of hourly rates quoted 50 61 36
London median hourly rate £27.62 £26.61 £33.50
Median hourly rate % change year-on-year +3.80% -20.58% +48.89%
10th Percentile £16.15 £18.25 £15.25
90th Percentile £48.73 £58.75 £99.50
England median hourly rate £33.50 £31.31 £28.00
% change year-on-year +6.99% +11.82% +0.79%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in London.

Contractor daily rate trend for Data Lake in London

Data Lake
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Lake in London over the 6 months to 14 November 2018.

Contractor daily rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 14 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +3 45 £550 +4.76% 18
West London +12 22 £488 +50.23% 9
East London -14 10 £494 -10.23% 4
South London - 10 £475 - 2
North London - 2 £594 - 2
Data Lake
England

For the 6 months to 14 November 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 202 (56.27%) Microsoft Azure
2 158 (44.01%) Business Intelligence
3 150 (41.78%) SQL
4 144 (40.11%) Analytics
5 143 (39.83%) Agile Software Development
6 136 (37.88%) Data Warehouse
7 124 (34.54%) Big Data
8 111 (30.92%) SQL Server
9 109 (30.36%) Microsoft
10 101 (28.13%) ETL
11 98 (27.30%) SQL Server Integration Services
12 97 (27.02%) Hadoop
13 95 (26.46%) Python
14 91 (25.35%) Azure Data Factory
15 88 (24.51%) Finance
16 84 (23.40%) Power BI
17 82 (22.84%) Apache Spark
18 75 (20.89%) Scrum
19 72 (20.06%) Amazon AWS
20 71 (19.78%) Data Modelling
20 71 (19.78%) .NET
21 61 (16.99%) SQL Server Analysis Services
22 58 (16.16%) C#
23 56 (15.60%) Java
24 53 (14.76%) Data Science
25 52 (14.48%) Kafka
26 51 (14.21%) Azure SQL Database
27 49 (13.65%) Apache Hive
28 48 (13.37%) SQL Server Reporting Services
29 47 (13.09%) Serverless

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 82 (22.84%) Apache Spark
2 19 (5.29%) Apache
3 18 (5.01%) SAS
4 6 (1.67%) Elasticsearch
5 5 (1.39%) Apache Pig
5 5 (1.39%) Confluence
5 5 (1.39%) SharePoint
6 4 (1.11%) Apache Solr
7 2 (0.56%) K2 blackpearl
7 2 (0.56%) Oracle SOA Suite
7 2 (0.56%) SharePoint 2013
8 1 (0.28%) Alfresco
8 1 (0.28%) Apache Airflow
8 1 (0.28%) Appian
8 1 (0.28%) BizTalk Server
8 1 (0.28%) Content Management Server
8 1 (0.28%) Documentum
Applications
1 15 (4.18%) Microsoft Excel
2 2 (0.56%) Spreadsheet
2 2 (0.56%) SPSS
3 1 (0.28%) Microsoft Office
3 1 (0.28%) Microsoft PowerPoint
3 1 (0.28%) MS Visio
3 1 (0.28%) Shockwave
Business Applications
1 9 (2.51%) SAP Oil and Gas
2 2 (0.56%) Dynamics CRM
2 2 (0.56%) Markit EDM
2 2 (0.56%) PolarLake
3 1 (0.28%) Dynamics AX
3 1 (0.28%) Dynamics NAV
3 1 (0.28%) SAP ERP
3 1 (0.28%) SAP S/4HANA
3 1 (0.28%) Summit
Cloud Services
1 202 (56.27%) Microsoft Azure
2 91 (25.35%) Azure Data Factory
3 72 (20.06%) Amazon AWS
4 47 (13.09%) Serverless
5 37 (10.31%) Data Lake Analytics
6 31 (8.64%) PaaS
7 24 (6.69%) Azure Functions
8 22 (6.13%) Google Cloud Platform
9 21 (5.85%) Amazon S3
10 15 (4.18%) Amazon Kinesis
11 13 (3.62%) Amazon EMR
12 12 (3.34%) Azure Machine Learning
12 12 (3.34%) IaaS
13 9 (2.51%) AWS Lambda
13 9 (2.51%) SaaS
14 8 (2.23%) Azure Active Directory
15 7 (1.95%) GitHub
16 6 (1.67%) Amazon EC2
16 6 (1.67%) Cortana Intelligence Suite
17 5 (1.39%) Office 365
Communications & Networking
1 6 (1.67%) Firewall
2 4 (1.11%) VPN
3 3 (0.84%) DNS
3 3 (0.84%) Kerberos
3 3 (0.84%) Network Security
4 2 (0.56%) SSL
4 2 (0.56%) Wi-Fi
5 1 (0.28%) Internet
5 1 (0.28%) Intranet
Database & Business Intelligence
1 136 (37.88%) Data Warehouse
2 124 (34.54%) Big Data
3 111 (30.92%) SQL Server
4 98 (27.30%) SQL Server Integration Services
5 97 (27.02%) Hadoop
6 84 (23.40%) Power BI
7 61 (16.99%) SQL Server Analysis Services
8 51 (14.21%) Azure SQL Database
9 49 (13.65%) Apache Hive
10 48 (13.37%) SQL Server Reporting Services
11 46 (12.81%) HDInsight
12 40 (11.14%) Cosmos DB
13 37 (10.31%) Azure SQL Data Warehouse
13 37 (10.31%) HBase
13 37 (10.31%) Relational Database
14 35 (9.75%) NoSQL
15 26 (7.24%) Microsoft Analysis Services
16 24 (6.69%) Impala
17 23 (6.41%) MongoDB
18 22 (6.13%) Redis
Development Applications
1 36 (10.03%) Git (software)
1 36 (10.03%) Visual Studio Team System
2 23 (6.41%) Team Foundation Server
3 20 (5.57%) Jenkins
4 12 (3.34%) Visual Studio
5 11 (3.06%) JIRA
6 10 (2.79%) NUnit
7 9 (2.51%) Moq
8 5 (1.39%) JUnit
9 4 (1.11%) Ant
9 4 (1.11%) CruiseControl
9 4 (1.11%) IBM UrbanCode
9 4 (1.11%) Maven
9 4 (1.11%) Sonatype Nexus
10 3 (0.84%) RStudio
10 3 (0.84%) TeamCity
11 2 (0.56%) ERwin
11 2 (0.56%) FishEye
11 2 (0.56%) Octopus Deploy
11 2 (0.56%) SoapUI
General
1 88 (24.51%) Finance
2 37 (10.31%) Banking
3 33 (9.19%) Retail
4 8 (2.23%) Front Office
5 6 (1.67%) Back Office
5 6 (1.67%) Pharmaceutical
6 5 (1.39%) Legal
6 5 (1.39%) Publishing
7 4 (1.11%) Games
7 4 (1.11%) Investment Banking
8 3 (0.84%) Marketing
8 3 (0.84%) Telecoms
9 2 (0.56%) Advertising
10 1 (0.28%) Dutch Language
10 1 (0.28%) Financial Institution
10 1 (0.28%) French Language
10 1 (0.28%) Spanish Language
Job Titles
1 122 (33.98%) Developer
2 73 (20.33%) Architect
3 60 (16.71%) Data Engineer
4 43 (11.98%) Azure Developer
5 40 (11.14%) Data Architect
6 35 (9.75%) Business Intelligence Developer
7 28 (7.80%) Big Data Engineer
8 22 (6.13%) Consultant
9 21 (5.85%) .NET Developer
10 20 (5.57%) Azure Architect
11 16 (4.46%) C# Developer
12 15 (4.18%) Analyst
13 14 (3.90%) AWS Engineer
13 14 (3.90%) Big Data Architect
13 14 (3.90%) Solutions Architect
14 13 (3.62%) Azure Engineer
15 12 (3.34%) Business Analyst
16 11 (3.06%) Project Manager
16 11 (3.06%) Python Developer
16 11 (3.06%) Technical Architect
Libraries, Frameworks & Software Standards
1 71 (19.78%) .NET
2 52 (14.48%) Kafka
3 28 (7.80%) ASP.NET Web API
4 22 (6.13%) REST
5 21 (5.85%) .NET Core
6 18 (5.01%) JSON
7 16 (4.46%) AngularJS
8 13 (3.62%) ASP.NET
9 11 (3.06%) HTML
10 10 (2.79%) .NET Framework
10 10 (2.79%) React
11 9 (2.51%) Node.js
12 8 (2.23%) Entity Framework
12 8 (2.23%) MDX
13 7 (1.95%) CSS
13 7 (1.95%) RESTful
13 7 (1.95%) Twitter Bootstrap
14 6 (1.67%) Middleware
14 6 (1.67%) RabbitMQ
14 6 (1.67%) Spark Streaming
Miscellaneous
1 41 (11.42%) Analytical Skills
2 35 (9.75%) Greenfield Project
3 18 (5.01%) Algorithms
3 18 (5.01%) Computer Science
4 12 (3.34%) Data Structures
4 12 (3.34%) Fintech
5 6 (1.67%) Virtual Team
6 4 (1.11%) Fixed Income
6 4 (1.11%) Reference Data
7 3 (0.84%) Digital Media
7 3 (0.84%) Mobile App
8 2 (0.56%) Credit Risk
8 2 (0.56%) Derivative
8 2 (0.56%) e-Health
8 2 (0.56%) Equities
8 2 (0.56%) LIMS
8 2 (0.56%) Management Information System
8 2 (0.56%) PACS
8 2 (0.56%) PKI
8 2 (0.56%) PMI
Operating Systems
1 15 (4.18%) Linux
2 8 (2.23%) Unix
3 5 (1.39%) Windows
4 1 (0.28%) Oracle Linux
4 1 (0.28%) Ubuntu
4 1 (0.28%) Windows Server
Processes & Methodologies
1 158 (44.01%) Business Intelligence
2 144 (40.11%) Analytics
3 143 (39.83%) Agile Software Development
4 101 (28.13%) ETL
5 75 (20.89%) Scrum
6 71 (19.78%) Data Modelling
7 53 (14.76%) Data Science
8 42 (11.70%) DevOps
8 42 (11.70%) TDD
9 37 (10.31%) Visualisation
10 33 (9.19%) Data Integration
11 31 (8.64%) Data Analytics
11 31 (8.64%) Problem-Solving
12 28 (7.80%) Continuous Integration
12 28 (7.80%) Machine Learning
12 28 (7.80%) Migration
13 27 (7.52%) Test Automation
14 26 (7.24%) BDD
15 24 (6.69%) Data Engineering
15 24 (6.69%) Microservices
Programming Languages
1 150 (41.78%) SQL
2 95 (26.46%) Python
3 58 (16.16%) C#
4 56 (15.60%) Java
5 37 (10.31%) R
5 37 (10.31%) Scala
6 33 (9.19%) PowerShell
7 32 (8.91%) T-SQL
8 22 (6.13%) U-SQL
9 21 (5.85%) JavaScript
10 15 (4.18%) Data Analysis Expressions (DAX)
11 12 (3.34%) VB
12 7 (1.95%) C
12 7 (1.95%) MATLAB
13 6 (1.67%) Bash Shell
14 4 (1.11%) Perl
14 4 (1.11%) Ruby
15 3 (0.84%) Shell Script
16 2 (0.56%) PHP
16 2 (0.56%) VBA
Qualifications
1 20 (5.57%) Degree
2 14 (3.90%) Computer Science Degree
3 4 (1.11%) CEH
3 4 (1.11%) CISSP
4 3 (0.84%) BPSS Clearance
4 3 (0.84%) Microsoft Certification
4 3 (0.84%) Numerate Degree
5 2 (0.56%) CISM
5 2 (0.56%) PMI Certification
5 2 (0.56%) SC Cleared
5 2 (0.56%) Security Cleared
6 1 (0.28%) (ISC)2 CCSP
6 1 (0.28%) Cisco Certification
6 1 (0.28%) DV Cleared
6 1 (0.28%) ITIL Certification
6 1 (0.28%) Master's Degree
6 1 (0.28%) PhD
6 1 (0.28%) Postgraduate
Quality Assurance & Compliance
1 22 (6.13%) QA
2 9 (2.51%) Data Quality
3 8 (2.23%) GDPR
4 2 (0.56%) HL7
4 2 (0.56%) Solvency II
5 1 (0.28%) Disclosure Scotland
5 1 (0.28%) PMO
System Software
1 20 (5.57%) HDFS
2 19 (5.29%) Apache Flume
3 18 (5.01%) Docker
4 8 (2.23%) Active Directory
5 6 (1.67%) Virtual Machines
6 5 (1.39%) Apache ZooKeeper
Systems Management
1 15 (4.18%) Kubernetes
2 13 (3.62%) Oozie
3 12 (3.34%) Ansible
4 9 (2.51%) Terraform
5 8 (2.23%) Hadoop YARN
6 7 (1.95%) Control-M
7 6 (1.67%) ITRS Geneos
8 5 (1.39%) Puppet
9 2 (0.56%) Kibana
9 2 (0.56%) logstash
9 2 (0.56%) Opscode Chef
9 2 (0.56%) Salt
9 2 (0.56%) Single Sign-On
10 1 (0.28%) Ambari
10 1 (0.28%) Consul
10 1 (0.28%) Packer
Vendors
1 109 (30.36%) Microsoft
2 39 (10.86%) Tableau
3 35 (9.75%) Oracle
4 26 (7.24%) Cloudera
5 25 (6.96%) Informatica
6 22 (6.13%) Alteryx
7 20 (5.57%) Google
7 20 (5.57%) Talend
8 19 (5.29%) SAP
9 15 (4.18%) Databricks
10 14 (3.90%) Hortonworks
11 11 (3.06%) Splunk
12 7 (1.95%) Teradata
13 6 (1.67%) MapR
14 4 (1.11%) Ab Initio
14 4 (1.11%) IBM
15 3 (0.84%) Atlassian
15 3 (0.84%) Bloomberg
15 3 (0.84%) MicroStrategy
15 3 (0.84%) Netezza