Period
to 18 December 2017

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 18 December 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
18 Dec 2017
Same period 2016 Same period 2015
Rank 488 498 606
Rank change year-on-year +10 +108 +23
Contract jobs citing Data Lake 159 107 13
As % of all contract IT jobs advertised in London 0.33% 0.24% 0.028%
As % of the Database & Business Intelligence category 1.42% 1.03% 0.12%
Number of daily rates quoted 118 78 4
London median daily rate £550 £600 £650
Median daily rate % change year-on-year -8.33% -7.69% -
10th Percentile £393 £442 £364
90th Percentile £691 £750 £800
England median daily rate £550 £575 £550
% change year-on-year -4.35% +4.55% -
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate £45.00 - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11230 10412 11092
As % of all contract IT jobs advertised in London 23.62% 23.58% 24.09%
Number of daily rates quoted 8391 7349 7898
London median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +5.88%
10th Percentile £350 £325 £310
90th Percentile £663 £638 £631
England median daily rate £463 £425 £420
% change year-on-year +8.82% +1.19% +5.00%
Number of hourly rates quoted 64 42 66
London median hourly rate £26.97 £32.25 £22.50
Median hourly rate % change year-on-year -16.38% +43.33% -18.18%
10th Percentile £18.08 £15.25 £15.19
90th Percentile £58.75 £65.00 £100.00
England median hourly rate £32.75 £28.00 £27.12
% change year-on-year +16.96% +3.24% -1.38%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in London.

Contractor daily rate trend for Data Lake in London

Data Lake
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Lake in London over the 6 months to 18 December 2017.

Contractor daily rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 18 December 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -11 23 £525 -16.00% 12
West London -11 6 £325 -47.02% 2
East London - 1 £550 - 1
Data Lake
England

For the 6 months to 18 December 2017, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the London region with a requirement for Data Lake.

1 74 (46.54%) SQL
2 70 (44.03%) Big Data
3 64 (40.25%) Microsoft Azure
4 63 (39.62%) Business Intelligence
5 61 (38.36%) Hadoop
6 59 (37.11%) Data Warehouse
7 54 (33.96%) Analytics
8 47 (29.56%) ETL
9 45 (28.30%) Finance
10 36 (22.64%) Microsoft
11 34 (21.38%) Agile Software Development
12 33 (20.75%) Data Modelling
13 32 (20.13%) SQL Server
14 31 (19.50%) Python
15 28 (17.61%) Apache Spark
16 23 (14.47%) Power BI
17 22 (13.84%) Tableau
17 22 (13.84%) Java
17 22 (13.84%) SQL Server Integration Services
18 21 (13.21%) Machine Learning
19 20 (12.58%) Cloudera
19 20 (12.58%) Data Analytics
19 20 (12.58%) .NET
19 20 (12.58%) C#
20 18 (11.32%) Scrum
21 17 (10.69%) R
21 17 (10.69%) NoSQL
22 16 (10.06%) HDInsight
23 15 (9.43%) Apache Hive
23 15 (9.43%) MongoDB

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 28 (17.61%) Apache Spark
2 15 (9.43%) Apache
3 4 (2.52%) SAS
4 2 (1.26%) nginx
4 2 (1.26%) SharePoint
5 1 (0.63%) Apache Pig
5 1 (0.63%) BizTalk Server
5 1 (0.63%) Elasticsearch
5 1 (0.63%) IPython
5 1 (0.63%) Jetty
5 1 (0.63%) Jupyter
5 1 (0.63%) Skype for Business
Applications
1 5 (3.14%) SPSS
2 4 (2.52%) Microsoft Excel
3 1 (0.63%) Microsoft Project
Business Applications
1 3 (1.89%) SAP Oil and Gas
Cloud Services
1 64 (40.25%) Microsoft Azure
2 12 (7.55%) Amazon AWS
2 12 (7.55%) Azure Data Factory
3 10 (6.29%) Data Lake Analytics
4 9 (5.66%) Google Cloud Platform
5 8 (5.03%) Serverless
6 7 (4.40%) Azure Machine Learning
7 4 (2.52%) Amazon S3
8 3 (1.89%) Amazon Kinesis
8 3 (1.89%) Cloud Computing
8 3 (1.89%) GitHub
9 2 (1.26%) Amazon EC2
9 2 (1.26%) Amazon EMR
9 2 (1.26%) AWS Lambda
9 2 (1.26%) IaaS
9 2 (1.26%) PaaS
9 2 (1.26%) SaaS
9 2 (1.26%) Virtual Private Cloud
10 1 (0.63%) AWS CloudTrail
10 1 (0.63%) Azure Active Directory
Communications & Networking
1 1 (0.63%) Skype
Database & Business Intelligence
1 70 (44.03%) Big Data
2 61 (38.36%) Hadoop
3 59 (37.11%) Data Warehouse
4 32 (20.13%) SQL Server
5 23 (14.47%) Power BI
6 22 (13.84%) SQL Server Integration Services
7 17 (10.69%) NoSQL
8 16 (10.06%) HDInsight
9 15 (9.43%) Apache Hive
9 15 (9.43%) MongoDB
10 12 (7.55%) Azure SQL Database
10 12 (7.55%) SQL Server Analysis Services
10 12 (7.55%) SQL Server Reporting Services
11 9 (5.66%) Azure SQL Data Warehouse
11 9 (5.66%) HBase
11 9 (5.66%) Spotfire
12 8 (5.03%) BigQuery
12 8 (5.03%) DataStage
13 7 (4.40%) Apache Cassandra
14 5 (3.14%) Lumira
Development Applications
1 6 (3.77%) JIRA
2 5 (3.14%) Visual Studio
3 3 (1.89%) Jenkins
4 2 (1.26%) Git (software)
5 1 (0.63%) Apache Continuum
5 1 (0.63%) Babel
5 1 (0.63%) Bower
5 1 (0.63%) GoCD
5 1 (0.63%) Gradle
5 1 (0.63%) Grunt
5 1 (0.63%) Subversion
5 1 (0.63%) Talend Open Studio
5 1 (0.63%) Team Foundation Server
5 1 (0.63%) Travis CI
5 1 (0.63%) Vagrant
General
1 45 (28.30%) Finance
2 13 (8.18%) Banking
3 6 (3.77%) Investment Banking
4 5 (3.14%) Marketing
5 4 (2.52%) Front Office
5 4 (2.52%) Legal
6 3 (1.89%) Pharmaceutical
6 3 (1.89%) Retail
6 3 (1.89%) Telecoms
7 2 (1.26%) Dutch Language
7 2 (1.26%) Games
7 2 (1.26%) Law
8 1 (0.63%) Advertising
8 1 (0.63%) Financial Institution
8 1 (0.63%) French Language
8 1 (0.63%) Private Banking
8 1 (0.63%) Publishing
Job Titles
1 40 (25.16%) Developer
2 34 (21.38%) Architect
3 21 (13.21%) Analyst
3 21 (13.21%) Data Architect
4 19 (11.95%) Data Engineer
5 15 (9.43%) Consultant
6 11 (6.92%) Business Analyst
6 11 (6.92%) Solutions Architect
6 11 (6.92%) SQL Developer
7 10 (6.29%) Business Intelligence Developer
7 10 (6.29%) Data Analyst
8 8 (5.03%) Azure Architect
8 8 (5.03%) Business Intelligence Consultant
8 8 (5.03%) Project Manager
8 8 (5.03%) Tableau Consultant
9 7 (4.40%) Big Data Engineer
9 7 (4.40%) Data Consultant
10 6 (3.77%) Data Manager
10 6 (3.77%) Senior Developer
10 6 (3.77%) Technical Business Analyst
Libraries, Frameworks & Software Standards
1 20 (12.58%) .NET
2 6 (3.77%) Kafka
3 5 (3.14%) ASP.NET
4 4 (2.52%) AngularJS
4 4 (2.52%) ASP.NET Web API
4 4 (2.52%) Node.js
5 3 (1.89%) ASP.NET MVC
5 3 (1.89%) jQuery
5 3 (1.89%) MDX
5 3 (1.89%) Middleware
5 3 (1.89%) PySpark
5 3 (1.89%) Spring
6 2 (1.26%) .NET Core
6 2 (1.26%) Apache Avro
6 2 (1.26%) HTML
6 2 (1.26%) RabbitMQ
6 2 (1.26%) RESTful
6 2 (1.26%) Web Services
6 2 (1.26%) WinForms
7 1 (0.63%) HTML5
Miscellaneous
1 9 (5.66%) User Experience
2 8 (5.03%) Analytical Skills
2 8 (5.03%) Computer Science
3 6 (3.77%) Fintech
4 5 (3.14%) Greenfield Project
5 3 (1.89%) Equities
5 3 (1.89%) FMCG
5 3 (1.89%) Foreign Exchange (FX)
6 2 (1.26%) Derivative
6 2 (1.26%) Fixed Income
6 2 (1.26%) Management Information System
7 1 (0.63%) Hybrid Cloud
7 1 (0.63%) Market Risk
7 1 (0.63%) NHS
7 1 (0.63%) N-Tier
7 1 (0.63%) Private Cloud
7 1 (0.63%) Reference Data
7 1 (0.63%) RIA
7 1 (0.63%) Social Network
7 1 (0.63%) Virtual Team
Operating Systems
1 5 (3.14%) Linux
2 4 (2.52%) Unix
3 3 (1.89%) Red Hat Enterprise Linux
3 3 (1.89%) VMS
4 2 (1.26%) Windows
Processes & Methodologies
1 63 (39.62%) Business Intelligence
2 54 (33.96%) Analytics
3 47 (29.56%) ETL
4 34 (21.38%) Agile Software Development
5 33 (20.75%) Data Modelling
6 21 (13.21%) Machine Learning
7 20 (12.58%) Data Analytics
8 18 (11.32%) Scrum
9 15 (9.43%) Data Management
10 14 (8.81%) Migration
11 13 (8.18%) DevOps
12 12 (7.55%) Data Strategy
12 12 (7.55%) Visualisation
13 11 (6.92%) Business Analytics
13 11 (6.92%) Data Engineering
14 10 (6.29%) Test Automation
15 9 (5.66%) Change Management
15 9 (5.66%) Data Integration
15 9 (5.66%) Mentoring
16 8 (5.03%) Microservices
Programming Languages
1 74 (46.54%) SQL
2 31 (19.50%) Python
3 22 (13.84%) Java
4 20 (12.58%) C#
5 17 (10.69%) R
6 14 (8.81%) JavaScript
6 14 (8.81%) Scala
7 12 (7.55%) T-SQL
8 9 (5.66%) PowerShell
9 4 (2.52%) Shell Script
10 3 (1.89%) Data Analysis Expressions (DAX)
10 3 (1.89%) MATLAB
10 3 (1.89%) U-SQL
11 2 (1.26%) C
11 2 (1.26%) VB.NET
11 2 (1.26%) VBA
12 1 (0.63%) Bash Shell
12 1 (0.63%) C++
12 1 (0.63%) PL/SQL
12 1 (0.63%) TypeScript
Qualifications
1 9 (5.66%) Degree
2 6 (3.77%) Master's Degree
3 3 (1.89%) Computer Science Degree
4 1 (0.63%) Microsoft Certification
4 1 (0.63%) Numerate Degree
Quality Assurance & Compliance
1 5 (3.14%) QA
2 4 (2.52%) PMO
3 3 (1.89%) GDPR
4 2 (1.26%) MiFID
5 1 (0.63%) Data Quality
5 1 (0.63%) IFRS
5 1 (0.63%) IFRS 9
System Software
1 7 (4.40%) Apache Flume
2 5 (3.14%) Docker
2 5 (3.14%) HDFS
3 2 (1.26%) Virtual Machines
Systems Management
1 7 (4.40%) Ansible
1 7 (4.40%) Terraform
2 6 (3.77%) Kubernetes
3 4 (2.52%) Opscode Chef
3 4 (2.52%) Puppet
4 3 (1.89%) Hadoop YARN
5 1 (0.63%) Ambari
5 1 (0.63%) HP Quality Center
5 1 (0.63%) Nagios
5 1 (0.63%) Oozie
Vendors
1 36 (22.64%) Microsoft
2 22 (13.84%) Tableau
3 20 (12.58%) Cloudera
4 11 (6.92%) Google
5 9 (5.66%) Informatica
6 8 (5.03%) Hortonworks
7 5 (3.14%) SAP
8 3 (1.89%) Apigee
8 3 (1.89%) IBM
8 3 (1.89%) Oracle
8 3 (1.89%) Red Hat
9 2 (1.26%) Alteryx
9 2 (1.26%) Netezza
9 2 (1.26%) Salesforce.com
9 2 (1.26%) Teradata
10 1 (0.63%) Capita
10 1 (0.63%) Cognos
10 1 (0.63%) HP
10 1 (0.63%) MicroStrategy
10 1 (0.63%) TIBCO