Period
to 26 September 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 26 September 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
26 Sep 2018
Same period 2017 Same period 2016
Rank 337 503 544
Rank change year-on-year +166 +41 +67
Contract jobs citing Data Lake 311 116 71
As % of all contract IT jobs advertised in London 0.68% 0.26% 0.16%
As % of the Database & Business Intelligence category 2.72% 1.09% 0.69%
Number of daily rates quoted 217 78 52
London median daily rate £525 £550 £613
Median daily rate % change year-on-year -4.55% -10.20% -23.44%
10th Percentile £390 £393 £464
90th Percentile £718 £741 £773
England median daily rate £520 £550 £600
% change year-on-year -5.45% -8.33% -25.00%
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate £49.75 £45.00 -
% change year-on-year +10.56% - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,433 10,628 10,238
As % of all contract IT jobs advertised in London 24.92% 23.87% 22.99%
Number of daily rates quoted 8,538 7,769 7,396
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £363 £348 £313
90th Percentile £675 £650 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 57 60 40
London median hourly rate £27.50 £27.16 £35.00
Median hourly rate % change year-on-year +1.25% -22.40% +40.00%
10th Percentile £19.25 £18.63 £16.89
90th Percentile £47.60 £58.75 £108.75
England median hourly rate £27.73 £30.00 £30.00
% change year-on-year -7.57% - +7.57%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in London.

Contractor daily rate trend for Data Lake in London

Data Lake
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Lake in London over the 6 months to 26 September 2018.

Contractor daily rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 26 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +6 44 £563 +7.14% 18
West London 0 21 £475 +40.12% 7
East London - 12 £413 - 1
South London -33 4 £475 -
North London - 1 £700 -
Data Lake
England

For the 6 months to 26 September 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 162 (52.09%) Microsoft Azure
2 158 (50.80%) Business Intelligence
3 136 (43.73%) Analytics
4 133 (42.77%) SQL
5 129 (41.48%) Data Warehouse
5 129 (41.48%) Big Data
6 126 (40.51%) Agile Software Development
7 105 (33.76%) ETL
8 100 (32.15%) Microsoft
9 95 (30.55%) SQL Server
10 92 (29.58%) Hadoop
11 91 (29.26%) Python
12 87 (27.97%) Apache Spark
13 77 (24.76%) Power BI
14 71 (22.83%) Finance
15 70 (22.51%) SQL Server Integration Services
15 70 (22.51%) Amazon AWS
16 62 (19.94%) Scrum
17 61 (19.61%) Data Modelling
18 54 (17.36%) Azure Data Factory
19 51 (16.40%) Java
20 50 (16.08%) C#
20 50 (16.08%) .NET
20 50 (16.08%) SQL Server Analysis Services
20 50 (16.08%) Data Science
21 49 (15.76%) Analytical Skills
21 49 (15.76%) Kafka
22 48 (15.43%) HDInsight
23 47 (15.11%) Apache Hive
24 44 (14.15%) HBase

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 87 (27.97%) Apache Spark
2 17 (5.47%) Apache
3 13 (4.18%) SAS
4 10 (3.22%) Apache Pig
5 7 (2.25%) Confluence
5 7 (2.25%) Elasticsearch
6 5 (1.61%) Apache Solr
7 2 (0.64%) SharePoint
8 1 (0.32%) Alfresco
8 1 (0.32%) Apache Airflow
8 1 (0.32%) Appian
8 1 (0.32%) BizTalk Server
8 1 (0.32%) Content Management Server
8 1 (0.32%) Documentum
8 1 (0.32%) JBoss
8 1 (0.32%) Tomcat
8 1 (0.32%) WebSphere
Applications
1 6 (1.93%) Microsoft Excel
2 1 (0.32%) Microsoft Office
2 1 (0.32%) Microsoft PowerPoint
2 1 (0.32%) MS Visio
2 1 (0.32%) Shockwave
Business Applications
1 13 (4.18%) SAP Oil and Gas
2 5 (1.61%) Markit EDM
3 2 (0.64%) PolarLake
4 1 (0.32%) Cognos TM1
4 1 (0.32%) Dynamics CRM
4 1 (0.32%) SAP ERP
4 1 (0.32%) SAP S/4HANA
Cloud Services
1 162 (52.09%) Microsoft Azure
2 70 (22.51%) Amazon AWS
3 54 (17.36%) Azure Data Factory
4 25 (8.04%) Data Lake Analytics
4 25 (8.04%) Serverless
5 24 (7.72%) PaaS
6 21 (6.75%) Amazon S3
7 13 (4.18%) Amazon EMR
8 12 (3.86%) Amazon Kinesis
8 12 (3.86%) Google Cloud Platform
9 11 (3.54%) IaaS
10 10 (3.22%) Azure Machine Learning
11 9 (2.89%) Azure Functions
11 9 (2.89%) SaaS
12 7 (2.25%) AWS Lambda
12 7 (2.25%) Azure Active Directory
12 7 (2.25%) GitHub
13 5 (1.61%) Amazon EC2
13 5 (1.61%) Cortana Intelligence Suite
13 5 (1.61%) iPaaS
Communications & Networking
1 6 (1.93%) VPN
2 5 (1.61%) Kerberos
2 5 (1.61%) SSL
3 2 (0.64%) DNS
4 1 (0.32%) Firewall
4 1 (0.32%) Internet
4 1 (0.32%) Intranet
4 1 (0.32%) Network Security
Database & Business Intelligence
1 129 (41.48%) Big Data
1 129 (41.48%) Data Warehouse
2 95 (30.55%) SQL Server
3 92 (29.58%) Hadoop
4 77 (24.76%) Power BI
5 70 (22.51%) SQL Server Integration Services
6 50 (16.08%) SQL Server Analysis Services
7 48 (15.43%) HDInsight
8 47 (15.11%) Apache Hive
9 44 (14.15%) HBase
10 43 (13.83%) Cosmos DB
11 40 (12.86%) SQL Server Reporting Services
12 37 (11.90%) NoSQL
13 32 (10.29%) Relational Database
14 29 (9.32%) Azure SQL Data Warehouse
14 29 (9.32%) Azure SQL Database
15 26 (8.36%) MongoDB
16 24 (7.72%) MySQL
17 23 (7.40%) Redis
18 21 (6.75%) Apache Cassandra
Development Applications
1 39 (12.54%) Git (software)
2 26 (8.36%) Visual Studio Team System
3 25 (8.04%) Team Foundation Server
4 21 (6.75%) Jenkins
5 14 (4.50%) JIRA
6 13 (4.18%) Visual Studio
7 7 (2.25%) NUnit
8 6 (1.93%) JUnit
8 6 (1.93%) Sonatype Nexus
9 5 (1.61%) FishEye
9 5 (1.61%) Maven
9 5 (1.61%) Moq
10 4 (1.29%) Ant
10 4 (1.29%) CruiseControl
10 4 (1.29%) Cucumber
10 4 (1.29%) IBM UrbanCode
10 4 (1.29%) TeamCity
11 3 (0.96%) RStudio
11 3 (0.96%) Selenium
11 3 (0.96%) SpecFlow
General
1 71 (22.83%) Finance
2 29 (9.32%) Retail
3 17 (5.47%) Banking
4 16 (5.14%) Games
5 6 (1.93%) Back Office
5 6 (1.93%) Front Office
5 6 (1.93%) Pharmaceutical
6 5 (1.61%) Marketing
7 3 (0.96%) Investment Banking
7 3 (0.96%) Legal
7 3 (0.96%) Publishing
8 2 (0.64%) Digital Economy
8 2 (0.64%) Telecoms
9 1 (0.32%) Advertising
9 1 (0.32%) Financial Institution
9 1 (0.32%) Spanish Language
Job Titles
1 90 (28.94%) Developer
2 63 (20.26%) Architect
3 56 (18.01%) Data Engineer
4 42 (13.50%) Data Architect
5 27 (8.68%) Big Data Engineer
6 24 (7.72%) Azure Developer
7 21 (6.75%) Business Intelligence Developer
8 19 (6.11%) Consultant
9 17 (5.47%) Big Data Architect
10 15 (4.82%) Analyst
10 15 (4.82%) Azure Engineer
10 15 (4.82%) Big Data Developer
11 13 (4.18%) .NET Developer
11 13 (4.18%) AWS Engineer
11 13 (4.18%) Azure Architect
11 13 (4.18%) Business Analyst
12 12 (3.86%) Solutions Architect
13 11 (3.54%) Data Business Analyst
13 11 (3.54%) Python Engineer
14 10 (3.22%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 50 (16.08%) .NET
2 49 (15.76%) Kafka
3 17 (5.47%) ASP.NET Web API
4 16 (5.14%) .NET Core
5 14 (4.50%) REST
6 11 (3.54%) RESTful
7 10 (3.22%) AngularJS
8 9 (2.89%) .NET Framework
8 9 (2.89%) JSON
8 9 (2.89%) RabbitMQ
8 9 (2.89%) Spark Streaming
9 8 (2.57%) Entity Framework
9 8 (2.57%) Natural Language Processing
9 8 (2.57%) React
10 7 (2.25%) HTML
10 7 (2.25%) HTML5
10 7 (2.25%) MDX
10 7 (2.25%) XML
11 6 (1.93%) Angular 2
11 6 (1.93%) ASP.NET
Miscellaneous
1 49 (15.76%) Analytical Skills
2 22 (7.07%) Greenfield Project
3 18 (5.79%) Algorithms
4 13 (4.18%) Computer Science
4 13 (4.18%) Fintech
5 9 (2.89%) Data Structures
6 4 (1.29%) Fixed Income
6 4 (1.29%) Reference Data
6 4 (1.29%) Virtual Team
7 3 (0.96%) Mobile App
8 2 (0.64%) Credit Risk
8 2 (0.64%) Data Centre
8 2 (0.64%) Derivative
8 2 (0.64%) e-Health
8 2 (0.64%) Equities
8 2 (0.64%) Foreign Exchange (FX)
8 2 (0.64%) LIMS
8 2 (0.64%) Online Games
8 2 (0.64%) PACS
8 2 (0.64%) User Experience
Operating Systems
1 10 (3.22%) Linux
1 10 (3.22%) Unix
2 1 (0.32%) Oracle Linux
2 1 (0.32%) Ubuntu
2 1 (0.32%) Windows
Processes & Methodologies
1 158 (50.80%) Business Intelligence
2 136 (43.73%) Analytics
3 126 (40.51%) Agile Software Development
4 105 (33.76%) ETL
5 62 (19.94%) Scrum
6 61 (19.61%) Data Modelling
7 50 (16.08%) Data Science
8 42 (13.50%) Problem-Solving
9 40 (12.86%) Visualisation
10 37 (11.90%) DevOps
11 36 (11.58%) Data Integration
11 36 (11.58%) TDD
12 28 (9.00%) Machine Learning
13 26 (8.36%) Stakeholder Management
14 23 (7.40%) Data Analytics
14 23 (7.40%) Test Automation
15 21 (6.75%) Continuous Integration
15 21 (6.75%) Migration
16 20 (6.43%) BDD
17 19 (6.11%) Data Architecture
Programming Languages
1 133 (42.77%) SQL
2 91 (29.26%) Python
3 51 (16.40%) Java
4 50 (16.08%) C#
5 40 (12.86%) Scala
6 32 (10.29%) R
7 26 (8.36%) T-SQL
8 22 (7.07%) JavaScript
9 16 (5.14%) U-SQL
10 15 (4.82%) PowerShell
10 15 (4.82%) VB
11 7 (2.25%) Bash Shell
11 7 (2.25%) Data Analysis Expressions (DAX)
11 7 (2.25%) MATLAB
11 7 (2.25%) Perl
12 6 (1.93%) C
13 3 (0.96%) Ruby
13 3 (0.96%) Shell Script
14 2 (0.64%) VBA
15 1 (0.32%) IronPython
Qualifications
1 15 (4.82%) Degree
2 11 (3.54%) Computer Science Degree
3 4 (1.29%) Numerate Degree
4 3 (0.96%) CISSP
4 3 (0.96%) Microsoft Certification
5 1 (0.32%) (ISC)2 CCSP
5 1 (0.32%) BPSS Clearance
5 1 (0.32%) CEH
5 1 (0.32%) Cisco Certification
5 1 (0.32%) CISM
5 1 (0.32%) ITIL Certification
5 1 (0.32%) Master's Degree
5 1 (0.32%) PhD
5 1 (0.32%) Postgraduate
5 1 (0.32%) SC Cleared
5 1 (0.32%) Security Cleared
Quality Assurance & Compliance
1 16 (5.14%) QA
2 14 (4.50%) Data Quality
3 7 (2.25%) GDPR
4 2 (0.64%) HL7
4 2 (0.64%) Solvency II
5 1 (0.32%) Disclosure Scotland
5 1 (0.32%) PMO
System Software
1 26 (8.36%) HDFS
2 16 (5.14%) Apache Flume
3 11 (3.54%) Docker
4 8 (2.57%) Apache ZooKeeper
5 7 (2.25%) Active Directory
6 6 (1.93%) Virtual Machines
Systems Management
1 14 (4.50%) Oozie
2 11 (3.54%) Ansible
3 9 (2.89%) Hadoop YARN
4 8 (2.57%) Kubernetes
4 8 (2.57%) Terraform
5 2 (0.64%) Kibana
5 2 (0.64%) logstash
6 1 (0.32%) Ambari
6 1 (0.32%) Consul
6 1 (0.32%) Control-M
6 1 (0.32%) Packer
6 1 (0.32%) Puppet
Vendors
1 100 (32.15%) Microsoft
2 37 (11.90%) Tableau
3 27 (8.68%) Oracle
4 23 (7.40%) Cloudera
4 23 (7.40%) Informatica
5 22 (7.07%) SAP
6 19 (6.11%) Hortonworks
6 19 (6.11%) Talend
7 18 (5.79%) Alteryx
8 12 (3.86%) Databricks
8 12 (3.86%) Google
9 8 (2.57%) MapR
10 7 (2.25%) IBM
10 7 (2.25%) Teradata
11 6 (1.93%) Atlassian
11 6 (1.93%) Netezza
11 6 (1.93%) Splunk
12 5 (1.61%) Cognos
13 4 (1.29%) Ab Initio
13 4 (1.29%) MicroStrategy