Period
to 23 June 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 23 June 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
23 Jun 2018
Same period 2017 Same period 2016
Rank 364 466 560
Rank change year-on-year +102 +94 +33
Contract jobs citing Data Lake 289 110 40
As % of all contract IT jobs advertised in London 0.64% 0.27% 0.091%
As % of the Database & Business Intelligence category 2.55% 1.13% 0.39%
Number of daily rates quoted 197 75 25
London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% -
10th Percentile £404 £403 £385
90th Percentile £693 £675 £795
England median daily rate £500 £525 £550
% change year-on-year -4.76% -4.55% -
Number of hourly rates quoted 1 0 0
London median hourly rate £24.00 - -
England median hourly rate £47.25 - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,340 9,745 10,298
As % of all contract IT jobs advertised in London 25.15% 24.35% 23.53%
Number of daily rates quoted 8,490 7,067 7,493
London median daily rate £513 £500 £475
Median daily rate % change year-on-year +2.50% +5.26% +5.56%
10th Percentile £356 £325 £313
90th Percentile £675 £650 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 71 46 59
London median hourly rate £30.00 £30.50 £27.50
Median hourly rate % change year-on-year -1.64% +10.91% +0.68%
10th Percentile £20.25 £18.97 £17.45
90th Percentile £47.50 £47.25 £99.20
England median hourly rate £34.00 £30.00 £30.25
% change year-on-year +13.33% -0.83% +21.00%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in London.

Contractor daily rate trend for Data Lake in London

Data Lake
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Lake in London over the 6 months to 23 June 2018.

Contractor daily rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 23 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -2 53 £500 -9.09% 6
East London -4 12 - - 2
West London - 7 £513 - 6
South London -45 2 - - 1
Data Lake
England

For the 6 months to 23 June 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 152 (52.60%) Business Intelligence
2 146 (50.52%) SQL
3 145 (50.17%) Microsoft Azure
3 145 (50.17%) Big Data
4 139 (48.10%) Data Warehouse
5 122 (42.21%) Analytics
6 120 (41.52%) Agile Software Development
7 112 (38.75%) Hadoop
8 108 (37.37%) SQL Server
9 107 (37.02%) ETL
10 101 (34.95%) Microsoft
11 93 (32.18%) Apache Spark
12 88 (30.45%) Python
13 76 (26.30%) Finance
14 74 (25.61%) Data Modelling
15 70 (24.22%) Amazon AWS
16 69 (23.88%) Power BI
17 63 (21.80%) Scrum
18 59 (20.42%) SQL Server Integration Services
19 56 (19.38%) HDInsight
20 52 (17.99%) C#
21 51 (17.65%) Analytical Skills
21 51 (17.65%) Problem-Solving
22 49 (16.96%) Apache Hive
23 46 (15.92%) SQL Server Reporting Services
23 46 (15.92%) Cosmos DB
24 43 (14.88%) Azure Data Factory
24 43 (14.88%) HBase
25 42 (14.53%) T-SQL
26 41 (14.19%) Data Integration

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 93 (32.18%) Apache Spark
2 18 (6.23%) Apache
3 11 (3.81%) Apache Pig
4 9 (3.11%) Elasticsearch
4 9 (3.11%) SAS
5 8 (2.77%) Apache Solr
6 7 (2.42%) Confluence
7 3 (1.04%) SharePoint
8 2 (0.69%) Oracle SOA Suite
8 2 (0.69%) WebSphere
9 1 (0.35%) CMS
9 1 (0.35%) IBM Domino
9 1 (0.35%) IPython
9 1 (0.35%) JBoss
9 1 (0.35%) Jupyter
9 1 (0.35%) Tomcat
Applications
1 7 (2.42%) Microsoft Excel
2 3 (1.04%) SPSS
3 2 (0.69%) Microsoft Office
3 2 (0.69%) Microsoft PowerPoint
3 2 (0.69%) MS Visio
4 1 (0.35%) Shockwave
Business Applications
1 14 (4.84%) SAP Oil and Gas
2 4 (1.38%) Markit EDM
3 1 (0.35%) Cognos TM1
3 1 (0.35%) Dynamics CRM
3 1 (0.35%) PolarLake
3 1 (0.35%) SAP ERP
3 1 (0.35%) SAP S/4HANA
Cloud Services
1 145 (50.17%) Microsoft Azure
2 70 (24.22%) Amazon AWS
3 43 (14.88%) Azure Data Factory
4 23 (7.96%) Serverless
5 22 (7.61%) Data Lake Analytics
6 17 (5.88%) Amazon Kinesis
6 17 (5.88%) Amazon S3
7 16 (5.54%) PaaS
8 11 (3.81%) AWS Lambda
9 9 (3.11%) Amazon EMR
10 6 (2.08%) IaaS
10 6 (2.08%) SaaS
11 5 (1.73%) Google Cloud Platform
11 5 (1.73%) iPaaS
12 3 (1.04%) Azure Machine Learning
13 2 (0.69%) Amazon EC2
13 2 (0.69%) Azure Active Directory
13 2 (0.69%) Cortana Intelligence Suite
13 2 (0.69%) Dynamics 365
13 2 (0.69%) Google Analytics
Communications & Networking
1 7 (2.42%) Kerberos
2 6 (2.08%) SSL
2 6 (2.08%) VPN
Database & Business Intelligence
1 145 (50.17%) Big Data
2 139 (48.10%) Data Warehouse
3 112 (38.75%) Hadoop
4 108 (37.37%) SQL Server
5 69 (23.88%) Power BI
6 59 (20.42%) SQL Server Integration Services
7 56 (19.38%) HDInsight
8 49 (16.96%) Apache Hive
9 46 (15.92%) Cosmos DB
9 46 (15.92%) SQL Server Reporting Services
10 43 (14.88%) HBase
11 38 (13.15%) SQL Server Analysis Services
12 37 (12.80%) NoSQL
13 36 (12.46%) MongoDB
14 31 (10.73%) PostgreSQL
15 30 (10.38%) MySQL
16 28 (9.69%) Azure SQL Data Warehouse
17 27 (9.34%) Redis
18 24 (8.30%) SAP HANA
18 24 (8.30%) Spotfire
Development Applications
1 40 (13.84%) Git (software)
2 20 (6.92%) Team Foundation Server
3 18 (6.23%) Jenkins
4 11 (3.81%) SpecFlow
5 10 (3.46%) JIRA
5 10 (3.46%) Visual Studio
6 7 (2.42%) TeamCity
6 7 (2.42%) tSQLt
6 7 (2.42%) Visual Studio Team System
7 6 (2.08%) FishEye
8 5 (1.73%) Octopus Deploy
9 4 (1.38%) Cucumber
10 3 (1.04%) Maven
10 3 (1.04%) Selenium
11 2 (0.69%) Ant
11 2 (0.69%) ClearCase
11 2 (0.69%) ERwin
11 2 (0.69%) Sonatype Nexus
11 2 (0.69%) Subversion
12 1 (0.35%) GoCD
General
1 76 (26.30%) Finance
2 27 (9.34%) Games
2 27 (9.34%) Retail
3 20 (6.92%) Banking
4 10 (3.46%) Legal
5 7 (2.42%) Investment Banking
6 6 (2.08%) Marketing
7 5 (1.73%) Digital Economy
8 4 (1.38%) Back Office
9 3 (1.04%) Financial Institution
10 1 (0.35%) Advertising
10 1 (0.35%) Front Office
Job Titles
1 76 (26.30%) Developer
2 54 (18.69%) Architect
3 50 (17.30%) Data Engineer
4 40 (13.84%) Data Architect
5 28 (9.69%) Analyst
6 24 (8.30%) Consultant
7 21 (7.27%) Big Data Developer
8 17 (5.88%) Big Data Architect
8 17 (5.88%) Business Analyst
8 17 (5.88%) Business Intelligence Developer
9 16 (5.54%) Azure Developer
9 16 (5.54%) Big Data Engineer
10 15 (5.19%) Azure Engineer
11 14 (4.84%) Data Modeller
11 14 (4.84%) SQL Developer
12 13 (4.50%) Azure Architect
12 13 (4.50%) Azure Consultant
12 13 (4.50%) Business Intelligence Analyst
12 13 (4.50%) Data Business Analyst
13 12 (4.15%) Business Intelligence Business Analyst
Libraries, Frameworks & Software Standards
1 37 (12.80%) .NET
2 31 (10.73%) Kafka
3 21 (7.27%) RESTful
4 9 (3.11%) MDX
4 9 (3.11%) Web Services
4 9 (3.11%) XML
5 8 (2.77%) ASP.NET
6 7 (2.42%) ASP.NET Web API
6 7 (2.42%) Spark Streaming
6 7 (2.42%) Velocity
7 6 (2.08%) HTML
7 6 (2.08%) HTML5
7 6 (2.08%) Natural Language Processing
7 6 (2.08%) Play Framework
7 6 (2.08%) RabbitMQ
7 6 (2.08%) React
8 5 (1.73%) .NET Core
8 5 (1.73%) AngularJS
9 4 (1.38%) JSON
9 4 (1.38%) REST
Miscellaneous
1 51 (17.65%) Analytical Skills
2 22 (7.61%) Computer Science
3 12 (4.15%) Algorithms
4 10 (3.46%) Fintech
4 10 (3.46%) Greenfield Project
5 6 (2.08%) Market Risk
5 6 (2.08%) Self-Motivation
6 5 (1.73%) Management Information System
7 4 (1.38%) Virtual Team
8 3 (1.04%) NHS
9 2 (0.69%) Clustering
9 2 (0.69%) Data Centre
9 2 (0.69%) Data Structures
9 2 (0.69%) Enterprise Software
9 2 (0.69%) Hybrid Cloud
9 2 (0.69%) Online Games
9 2 (0.69%) Private Cloud
9 2 (0.69%) RIA
9 2 (0.69%) Robotics
10 1 (0.35%) User Experience
Operating Systems
1 9 (3.11%) Linux
1 9 (3.11%) Unix
2 3 (1.04%) Windows
3 2 (0.69%) Ubuntu
3 2 (0.69%) Windows Server
4 1 (0.35%) CentOS
Processes & Methodologies
1 152 (52.60%) Business Intelligence
2 122 (42.21%) Analytics
3 120 (41.52%) Agile Software Development
4 107 (37.02%) ETL
5 74 (25.61%) Data Modelling
6 63 (21.80%) Scrum
7 51 (17.65%) Problem-Solving
8 41 (14.19%) Data Integration
9 39 (13.49%) Visualisation
10 38 (13.15%) Data Science
11 35 (12.11%) Data Architecture
12 34 (11.76%) DevOps
12 34 (11.76%) Test Automation
13 33 (11.42%) Stakeholder Management
14 26 (9.00%) Data Engineering
15 22 (7.61%) E-Commerce
15 22 (7.61%) Machine Learning
16 21 (7.27%) Continuous Improvement
16 21 (7.27%) Data Management
17 20 (6.92%) ERP
Programming Languages
1 146 (50.52%) SQL
2 88 (30.45%) Python
3 52 (17.99%) C#
4 42 (14.53%) T-SQL
5 38 (13.15%) JavaScript
5 38 (13.15%) Scala
6 36 (12.46%) Java
7 27 (9.34%) R
8 13 (4.50%) VB
9 12 (4.15%) PowerShell
9 12 (4.15%) U-SQL
10 10 (3.46%) Bash Shell
11 8 (2.77%) Perl
12 6 (2.08%) Data Analysis Expressions (DAX)
13 4 (1.38%) C
14 3 (1.04%) Shell Script
15 2 (0.69%) VB.NET
16 1 (0.35%) MATLAB
16 1 (0.35%) PL/SQL
16 1 (0.35%) VBA
Qualifications
1 25 (8.65%) Degree
2 8 (2.77%) Computer Science Degree
2 8 (2.77%) Master's Degree
3 5 (1.73%) Numerate Degree
4 3 (1.04%) SC Cleared
4 3 (1.04%) Security Cleared
5 2 (0.69%) DV Cleared
5 2 (0.69%) Microsoft Certification
6 1 (0.35%) AWS Certification
6 1 (0.35%) Postgraduate
Quality Assurance & Compliance
1 17 (5.88%) Data Quality
2 16 (5.54%) QA
3 5 (1.73%) GDPR
4 1 (0.35%) HL7
4 1 (0.35%) SLA
System Software
1 22 (7.61%) HDFS
2 14 (4.84%) Apache Flume
3 8 (2.77%) Apache ZooKeeper
4 6 (2.08%) Docker
5 3 (1.04%) VMware Infrastructure
6 2 (0.69%) Active Directory
6 2 (0.69%) VMware ESXi
7 1 (0.35%) Samba
7 1 (0.35%) Virtual Machines
7 1 (0.35%) Virtual Servers
Systems Management
1 15 (5.19%) Oozie
2 10 (3.46%) Ansible
3 7 (2.42%) Hadoop YARN
3 7 (2.42%) Terraform
4 2 (0.69%) Packer
5 1 (0.35%) Ambari
5 1 (0.35%) Consul
5 1 (0.35%) Failover Clustering
5 1 (0.35%) Kubernetes
5 1 (0.35%) Opscode Chef
5 1 (0.35%) Puppet
Vendors
1 101 (34.95%) Microsoft
2 29 (10.03%) SAP
3 26 (9.00%) Oracle
4 23 (7.96%) Cloudera
4 23 (7.96%) Hortonworks
4 23 (7.96%) Tableau
5 19 (6.57%) Informatica
6 18 (6.23%) Alteryx
7 15 (5.19%) Talend
8 13 (4.50%) IBM
9 10 (3.46%) Netezza
10 7 (2.42%) Google
11 6 (2.08%) Atlassian
11 6 (2.08%) Cognos
11 6 (2.08%) Teradata
12 5 (1.73%) MapR
13 4 (1.38%) Salesforce.com
14 3 (1.04%) Capita
14 3 (1.04%) MicroStrategy
14 3 (1.04%) VMware