Period
to 21 August 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 21 August 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
21 Aug 2018
Same period 2017 Same period 2016
Rank 375 724 867
Rank change year-on-year +349 +143 +47
Permanent jobs citing Data Lake 558 114 34
As % of all permanent IT jobs advertised in London 0.81% 0.15% 0.042%
As % of the Database & Business Intelligence category 2.58% 0.52% 0.14%
Number of salaries quoted 373 90 21
London median annual salary £70,000 £68,250 £95,000
Median salary % change year-on-year +2.56% -28.16% +24.59%
10th Percentile £51,250 £47,500 £70,000
90th Percentile £100,000 £105,750 £120,000
England median annual salary £65,000 £60,000 £75,000
% change year-on-year +8.33% -20.00% +66.67%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,662 21,819 24,163
As % of all permanent IT jobs advertised in London 31.36% 29.54% 29.94%
Number of salaries quoted 17,085 17,785 21,102
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £92,500 £90,000 £86,250
England median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 21 August 2018.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 21 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +99 160 £65,000 -7.14% 11
West London +40 17 £45,000 +28.57% 8
South London 0 4 £47,500 -47.22%
East London - 2 £120,000 - 4
North London - 1 £60,000 -
Data Lake
England

For the 6 months to 21 August 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 377 (67.56%) SQL
2 348 (62.37%) Analytics
3 327 (58.60%) Big Data
4 287 (51.43%) Business Intelligence
5 279 (50.00%) Microsoft Azure
6 233 (41.76%) Microsoft
7 225 (40.32%) SQL Server
8 211 (37.81%) Power BI
9 209 (37.46%) Data Warehouse
10 201 (36.02%) Finance
11 186 (33.33%) SQL Server Integration Services
12 179 (32.08%) Python
13 160 (28.67%) Java
13 160 (28.67%) Hadoop
14 159 (28.49%) Agile Software Development
15 156 (27.96%) Machine Learning
16 144 (25.81%) Azure Data Factory
17 140 (25.09%) SQL Server Analysis Services
18 138 (24.73%) Apache Spark
19 133 (23.84%) Data Modelling
20 132 (23.66%) Azure SQL Database
20 132 (23.66%) Data Science
21 126 (22.58%) ETL
22 125 (22.40%) SQL Server Reporting Services
23 121 (21.68%) Data Analytics
24 115 (20.61%) C#
25 102 (18.28%) Visualisation
26 100 (17.92%) NoSQL
27 98 (17.56%) Degree
28 97 (17.38%) Tableau

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 138 (24.73%) Apache Spark
2 40 (7.17%) Apache
3 23 (4.12%) Apache Pig
4 18 (3.23%) Apache Solr
5 6 (1.08%) Elasticsearch
5 6 (1.08%) Tomcat
6 3 (0.54%) Confluence
7 2 (0.36%) Apache Airflow
7 2 (0.36%) Drupal
7 2 (0.36%) SharePoint
8 1 (0.18%) IIS
8 1 (0.18%) Luigi
8 1 (0.18%) SAS
8 1 (0.18%) Tornado
Applications
1 12 (2.15%) MS Visio
2 9 (1.61%) Microsoft Excel
3 2 (0.36%) Microsoft Office
Business Applications
1 4 (0.72%) Markit EDM
2 2 (0.36%) Dynamics AX
2 2 (0.36%) Dynamics CRM
Cloud Services
1 279 (50.00%) Microsoft Azure
2 144 (25.81%) Azure Data Factory
3 80 (14.34%) Amazon AWS
4 63 (11.29%) PaaS
5 59 (10.57%) Serverless
6 53 (9.50%) Cortana Intelligence Suite
7 40 (7.17%) Azure Machine Learning
8 39 (6.99%) IaaS
9 32 (5.73%) Data Lake Analytics
10 16 (2.87%) Google Cloud Platform
11 14 (2.51%) AWS Lambda
12 10 (1.79%) SaaS
13 9 (1.61%) Azure Functions
14 7 (1.25%) Amazon EMR
15 5 (0.90%) Amazon Kinesis
16 4 (0.72%) Cloud Computing
17 3 (0.54%) Amazon S3
17 3 (0.54%) Datadog
17 3 (0.54%) GitHub
17 3 (0.54%) Office 365
Communications & Networking
1 3 (0.54%) DNS
1 3 (0.54%) Firewall
1 3 (0.54%) HTTP
1 3 (0.54%) SMTP
1 3 (0.54%) TCP/IP
1 3 (0.54%) VPN
2 1 (0.18%) Internet
Database & Business Intelligence
1 327 (58.60%) Big Data
2 225 (40.32%) SQL Server
3 211 (37.81%) Power BI
4 209 (37.46%) Data Warehouse
5 186 (33.33%) SQL Server Integration Services
6 160 (28.67%) Hadoop
7 140 (25.09%) SQL Server Analysis Services
8 132 (23.66%) Azure SQL Database
9 125 (22.40%) SQL Server Reporting Services
10 100 (17.92%) NoSQL
11 76 (13.62%) Azure SQL Data Warehouse
12 75 (13.44%) Apache Hive
13 71 (12.72%) Cosmos DB
14 52 (9.32%) HBase
15 40 (7.17%) Sqoop
16 37 (6.63%) Oracle ODI
17 36 (6.45%) Relational Database
18 28 (5.02%) Apache Cassandra
19 27 (4.84%) HDInsight
19 27 (4.84%) Microsoft Analysis Services
Development Applications
1 53 (9.50%) Visual Studio
2 47 (8.42%) Git (software)
3 14 (2.51%) Visual Studio Team System
4 12 (2.15%) Jenkins
5 8 (1.43%) GitLab
5 8 (1.43%) RStudio
6 7 (1.25%) JIRA
7 6 (1.08%) Team Foundation Server
8 5 (0.90%) ERwin
9 4 (0.72%) Cucumber
9 4 (0.72%) Octopus Deploy
10 3 (0.54%) Artifactory
10 3 (0.54%) GoCD
10 3 (0.54%) Sonatype Nexus
10 3 (0.54%) SpecFlow
10 3 (0.54%) SQL Server Management Studio (SSMS)
10 3 (0.54%) Subversion
10 3 (0.54%) TeamCity
11 2 (0.36%) Maven
11 2 (0.36%) TestNG
General
1 201 (36.02%) Finance
2 92 (16.49%) Banking
3 53 (9.50%) Advertising
4 51 (9.14%) Investment Banking
5 41 (7.35%) Games
6 39 (6.99%) Financial Institution
7 36 (6.45%) Marketing
8 27 (4.84%) Retail
9 11 (1.97%) Publishing
10 9 (1.61%) Corporate Banking
11 5 (0.90%) Billing
12 4 (0.72%) Front Office
13 1 (0.18%) Automotive
13 1 (0.18%) Law
Job Titles
1 200 (35.84%) Developer
2 100 (17.92%) Consultant
3 87 (15.59%) Architect
4 85 (15.23%) Business Intelligence Developer
5 79 (14.16%) Data Engineer
6 62 (11.11%) Data Architect
7 57 (10.22%) Azure Consultant
8 50 (8.96%) SQL Developer
9 47 (8.42%) Business Intelligence Consultant
10 45 (8.06%) Big Data Developer
11 44 (7.89%) Data Consultant
12 39 (6.99%) SSIS Developer
13 37 (6.63%) SQL BI Developer
14 35 (6.27%) SSAS Developer
15 34 (6.09%) Power BI Consultant
15 34 (6.09%) Senior Developer
16 33 (5.91%) Microsoft BI Consultant
17 31 (5.56%) SSRS Developer
18 29 (5.20%) T-SQL Developer
19 27 (4.84%) Data Warehouse Developer
Libraries, Frameworks & Software Standards
1 74 (13.26%) Kafka
2 65 (11.65%) .NET
3 34 (6.09%) AngularJS
4 32 (5.73%) Velocity
5 28 (5.02%) RabbitMQ
6 27 (4.84%) Natural Language Processing
7 24 (4.30%) jQuery
8 23 (4.12%) Web Services
9 21 (3.76%) HornetQ
9 21 (3.76%) JMS
9 21 (3.76%) MDX
10 18 (3.23%) JSON
11 17 (3.05%) ASP.NET
11 17 (3.05%) RESTful
12 15 (2.69%) REST
13 14 (2.51%) HTML
14 12 (2.15%) ASP.NET MVC
15 11 (1.97%) .NET Core
15 11 (1.97%) ASP.NET Web API
16 10 (1.79%) Vert.x
Miscellaneous
1 49 (8.78%) Computer Science
2 39 (6.99%) Cyberthreat
3 36 (6.45%) Analytical Skills
4 31 (5.56%) Fintech
5 27 (4.84%) Self-Motivation
6 17 (3.05%) Algorithms
6 17 (3.05%) Hedge funds
7 13 (2.33%) Data Structures
7 13 (2.33%) Fixed Income
7 13 (2.33%) Public Cloud
8 12 (2.15%) Derivative
8 12 (2.15%) Equities
8 12 (2.15%) Greenfield Project
8 12 (2.15%) Management Information System
9 11 (1.97%) Reference Data
9 11 (1.97%) Virtual Team
10 9 (1.61%) Credit Risk
11 7 (1.25%) Enterprise Software
11 7 (1.25%) Foreign Exchange (FX)
12 6 (1.08%) Linux Command Line
Operating Systems
1 20 (3.58%) Unix
2 18 (3.23%) Linux
Processes & Methodologies
1 348 (62.37%) Analytics
2 287 (51.43%) Business Intelligence
3 159 (28.49%) Agile Software Development
4 156 (27.96%) Machine Learning
5 133 (23.84%) Data Modelling
6 132 (23.66%) Data Science
7 126 (22.58%) ETL
8 121 (21.68%) Data Analytics
9 102 (18.28%) Visualisation
10 94 (16.85%) Problem-Solving
11 77 (13.80%) OO
12 71 (12.72%) Data Governance
13 68 (12.19%) Mathematics
14 61 (10.93%) Data Engineering
15 59 (10.57%) TDD
16 52 (9.32%) Presales
17 51 (9.14%) Data Visualisation
18 50 (8.96%) Investment Management
19 48 (8.60%) Data Architecture
20 47 (8.42%) OOP
Programming Languages
1 377 (67.56%) SQL
2 179 (32.08%) Python
3 160 (28.67%) Java
4 115 (20.61%) C#
5 87 (15.59%) Scala
6 80 (14.34%) Data Analysis Expressions (DAX)
7 77 (13.80%) T-SQL
8 58 (10.39%) JavaScript
9 50 (8.96%) R
10 47 (8.42%) U-SQL
11 38 (6.81%) Perl
12 32 (5.73%) C++
13 25 (4.48%) Shell Script
14 11 (1.97%) Java 8
15 10 (1.79%) C
16 9 (1.61%) PowerShell
17 7 (1.25%) Go
18 4 (0.72%) Ruby
19 3 (0.54%) MATLAB
19 3 (0.54%) VB.NET
Qualifications
1 98 (17.56%) Degree
2 38 (6.81%) Computer Science Degree
3 30 (5.38%) Master's Degree
4 11 (1.97%) Microsoft Certification
5 8 (1.43%) MBA
5 8 (1.43%) Security Cleared
6 6 (1.08%) GSEC
7 4 (0.72%) SC Cleared
8 2 (0.36%) Numerate Degree
9 1 (0.18%) PhD
Quality Assurance & Compliance
1 15 (2.69%) Data Quality
2 12 (2.15%) QA
3 3 (0.54%) GCP
4 2 (0.36%) GDPR
5 1 (0.18%) Actionable Recommendations
5 1 (0.18%) SLA
System Software
1 49 (8.78%) HDFS
2 30 (5.38%) Docker
2 30 (5.38%) Virtual Machines
3 18 (3.23%) Apache ZooKeeper
4 17 (3.05%) Apache Flume
Systems Management
1 25 (4.48%) Kubernetes
2 17 (3.05%) Oozie
3 12 (2.15%) Ambari
4 9 (1.61%) Terraform
5 7 (1.25%) Opscode Chef
6 5 (0.90%) Kibana
7 4 (0.72%) Ansible
7 4 (0.72%) Hadoop YARN
7 4 (0.72%) Puppet
8 3 (0.54%) Consul
8 3 (0.54%) Salt
9 2 (0.36%) Mesos
10 1 (0.18%) Grafana
Vendors
1 233 (41.76%) Microsoft
2 97 (17.38%) Tableau
3 80 (14.34%) Oracle
4 50 (8.96%) Cloudera
5 48 (8.60%) Talend
6 36 (6.45%) Informatica
7 33 (5.91%) Sybase
7 33 (5.91%) WorldPay
8 25 (4.48%) SnapLogic
9 21 (3.76%) EXASOL
10 20 (3.58%) Hortonworks
11 18 (3.23%) Google
12 17 (3.05%) Alteryx
12 17 (3.05%) Cognizant
12 17 (3.05%) Cognos
12 17 (3.05%) Netezza
13 16 (2.87%) Databricks
14 11 (1.97%) Salesforce.com
15 7 (1.25%) MapR
16 6 (1.08%) SAP