Period
to 19 January 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 19 January 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
19 Jan 2018
Same period 2017 Same period 2016
Rank 557 762 880
Rank change year-on-year +205 +118 +17
Permanent jobs citing Data Lake 258 63 31
As % of all permanent IT jobs advertised in London 0.37% 0.089% 0.036%
As % of the Database & Business Intelligence category 1.22% 0.30% 0.12%
Number of salaries quoted 220 58 14
London median annual salary £70,000 £80,000 £80,000
Median salary % change year-on-year -12.50% - -
10th Percentile £47,500 £50,000 £66,500
90th Percentile £105,000 £105,000 £141,000
England median annual salary £65,000 £75,000 £80,000
% change year-on-year -13.33% -6.25% +25.00%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,177 21,031 26,263
As % of all permanent IT jobs advertised in London 30.12% 29.75% 30.80%
Number of salaries quoted 17,279 18,400 22,434
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £88,750 £87,500 £85,000
England median annual salary £50,000 £47,500 £46,000
% change year-on-year +5.26% +3.26% +2.22%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 19 January 2018.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 19 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +54 68 £70,000 -20.00% 23
West London - 12 £47,500 - 8
East London - 4 £110,000 - 2
South London - 3 £57,500 -
North London - 2 - -
Data Lake
England

For the 6 months to 19 January 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Data Lake.

1 182 (70.54%) Analytics
2 160 (62.02%) Big Data
3 145 (56.20%) SQL
4 141 (54.65%) Microsoft Azure
5 140 (54.26%) Business Intelligence
6 126 (48.84%) Data Warehouse
7 94 (36.43%) SQL Server
8 92 (35.66%) Hadoop
9 87 (33.72%) Power BI
10 85 (32.95%) Microsoft
11 81 (31.40%) Azure Data Factory
12 77 (29.84%) Apache Spark
12 77 (29.84%) Amazon AWS
13 72 (27.91%) Tableau
14 62 (24.03%) SQL Server Integration Services
15 61 (23.64%) SQL Server Analysis Services
15 61 (23.64%) Java
16 58 (22.48%) Azure SQL Database
17 57 (22.09%) Machine Learning
17 57 (22.09%) Finance
17 57 (22.09%) Agile Software Development
18 54 (20.93%) ETL
19 50 (19.38%) Python
20 47 (18.22%) C#
20 47 (18.22%) Migration
20 47 (18.22%) Data Analytics
21 45 (17.44%) Google
22 44 (17.05%) Cortana Intelligence Suite
23 43 (16.67%) Data Modelling
24 42 (16.28%) Oracle

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 77 (29.84%) Apache Spark
2 10 (3.88%) Apache Pig
3 8 (3.10%) SAS
4 4 (1.55%) Apache
4 4 (1.55%) Apache Airflow
5 3 (1.16%) SharePoint
6 2 (0.78%) Elasticsearch
7 1 (0.39%) Apache Solr
7 1 (0.39%) CMS
7 1 (0.39%) IBM Domino
7 1 (0.39%) Jupyter
7 1 (0.39%) Luigi
Applications
1 1 (0.39%) SPSS
Business Applications
1 4 (1.55%) Adobe Campaign
2 1 (0.39%) MetaTrader
2 1 (0.39%) Oracle AML
Cloud Services
1 141 (54.65%) Microsoft Azure
2 81 (31.40%) Azure Data Factory
3 77 (29.84%) Amazon AWS
4 44 (17.05%) Cortana Intelligence Suite
5 23 (8.91%) Google Cloud Platform
6 21 (8.14%) Serverless
7 17 (6.59%) AWS Lambda
8 14 (5.43%) Amazon Kinesis
9 11 (4.26%) Data Lake Analytics
9 11 (4.26%) PaaS
10 10 (3.88%) IaaS
11 8 (3.10%) Cloud Computing
12 6 (2.33%) Amazon S3
12 6 (2.33%) GitHub
12 6 (2.33%) SaaS
13 4 (1.55%) Office 365
14 3 (1.16%) Amazon EC2
14 3 (1.16%) Amazon EMR
14 3 (1.16%) Azure Machine Learning
15 1 (0.39%) OpenShift
Communications & Networking
1 1 (0.39%) DNS
1 1 (0.39%) Firewall
1 1 (0.39%) HTTP
1 1 (0.39%) Internet
1 1 (0.39%) SMTP
1 1 (0.39%) TCP/IP
1 1 (0.39%) VPN
Database & Business Intelligence
1 160 (62.02%) Big Data
2 126 (48.84%) Data Warehouse
3 94 (36.43%) SQL Server
4 92 (35.66%) Hadoop
5 87 (33.72%) Power BI
6 62 (24.03%) SQL Server Integration Services
7 61 (23.64%) SQL Server Analysis Services
8 58 (22.48%) Azure SQL Database
9 41 (15.89%) SQL Server Reporting Services
10 33 (12.79%) HDInsight
11 29 (11.24%) NoSQL
12 27 (10.47%) Azure SQL Data Warehouse
13 25 (9.69%) MySQL
14 21 (8.14%) MongoDB
15 19 (7.36%) Apache Hive
16 16 (6.20%) QlikView
17 15 (5.81%) HBase
18 13 (5.04%) Amazon DynamoDB
18 13 (5.04%) Relational Database
19 12 (4.65%) Cosmos DB
Development Applications
1 25 (9.69%) Visual Studio
2 23 (8.91%) Git (software)
3 8 (3.10%) Jenkins
4 3 (1.16%) Atlassian Bamboo
4 3 (1.16%) SQL Server Management Studio (SSMS)
4 3 (1.16%) Subversion
5 1 (0.39%) Artifactory
5 1 (0.39%) Cucumber
5 1 (0.39%) GoCD
5 1 (0.39%) JUnit
5 1 (0.39%) Maven
5 1 (0.39%) Sonatype Nexus
General
1 57 (22.09%) Finance
2 16 (6.20%) Retail
3 15 (5.81%) Marketing
4 11 (4.26%) Advertising
4 11 (4.26%) Banking
5 10 (3.88%) Games
6 9 (3.49%) Financial Institution
6 9 (3.49%) Manufacturing
6 9 (3.49%) Telecoms
7 7 (2.71%) Publishing
8 4 (1.55%) Law
9 3 (1.16%) Electronics
9 3 (1.16%) Front Office
10 2 (0.78%) Investment Banking
11 1 (0.39%) iGaming
11 1 (0.39%) Legal
11 1 (0.39%) Spanish Language
Job Titles
1 81 (31.40%) Architect
2 52 (20.16%) Data Architect
3 45 (17.44%) Consultant
4 44 (17.05%) Data Engineer
4 44 (17.05%) Developer
5 38 (14.73%) Business Intelligence Consultant
6 29 (11.24%) Azure Architect
7 26 (10.08%) Microsoft BI Consultant
8 24 (9.30%) Azure Consultant
9 23 (8.91%) Lead Architect
9 23 (8.91%) Power BI Consultant
10 15 (5.81%) Business Intelligence Developer
10 15 (5.81%) Java Developer
10 15 (5.81%) Solutions Architect
11 14 (5.43%) Big Data Developer
11 14 (5.43%) SSIS Consultant
11 14 (5.43%) SSRS Consultant
12 13 (5.04%) AWS Engineer
12 13 (5.04%) Big Data Architect
13 12 (4.65%) Business Intelligence Architect
Libraries, Frameworks & Software Standards
1 35 (13.57%) Kafka
2 23 (8.91%) MDX
3 18 (6.98%) .NET
4 11 (4.26%) AngularJS
5 9 (3.49%) jQuery
6 8 (3.10%) Django
6 8 (3.10%) Node.js
6 8 (3.10%) RabbitMQ
7 6 (2.33%) Flask
8 5 (1.94%) .NET Framework
8 5 (1.94%) ASP.NET
8 5 (1.94%) ASP.NET MVC
8 5 (1.94%) Entity Framework
9 4 (1.55%) XML
10 3 (1.16%) JSON
10 3 (1.16%) Web Services
10 3 (1.16%) XSD
11 2 (0.78%) CSS
11 2 (0.78%) J2EE
11 2 (0.78%) Spring
Miscellaneous
1 23 (8.91%) Analytical Skills
2 20 (7.75%) Computer Science
3 12 (4.65%) Enterprise Software
3 12 (4.65%) Greenfield Project
4 7 (2.71%) Fintech
5 6 (2.33%) Algorithms
5 6 (2.33%) Cloud Native
5 6 (2.33%) Social Media
6 5 (1.94%) Data Structures
6 5 (1.94%) Equities
6 5 (1.94%) Taxonomies
7 3 (1.16%) Driving Licence
7 3 (1.16%) Fixed Income
7 3 (1.16%) Foreign Exchange (FX)
7 3 (1.16%) Linux Command Line
7 3 (1.16%) Online Games
7 3 (1.16%) Public Cloud
8 2 (0.78%) Digital Media
8 2 (0.78%) N-Tier
8 2 (0.78%) Virtual Team
Operating Systems
1 20 (7.75%) Linux
2 10 (3.88%) Unix
Processes & Methodologies
1 182 (70.54%) Analytics
2 140 (54.26%) Business Intelligence
3 57 (22.09%) Agile Software Development
3 57 (22.09%) Machine Learning
4 54 (20.93%) ETL
5 47 (18.22%) Data Analytics
5 47 (18.22%) Migration
6 43 (16.67%) Data Modelling
7 39 (15.12%) Presales
8 34 (13.18%) Visualisation
9 33 (12.79%) Business Analytics
9 33 (12.79%) Data Architecture
9 33 (12.79%) Data Migration
9 33 (12.79%) Stakeholder Management
10 31 (12.02%) Data Governance
10 31 (12.02%) Data Management
11 30 (11.63%) Information Management
12 29 (11.24%) Data Integration
12 29 (11.24%) Data Visualisation
13 26 (10.08%) Kimball Methodology
Programming Languages
1 145 (56.20%) SQL
2 61 (23.64%) Java
3 50 (19.38%) Python
4 47 (18.22%) C#
5 40 (15.50%) Scala
6 28 (10.85%) T-SQL
7 17 (6.59%) C++
8 15 (5.81%) R
9 14 (5.43%) Data Analysis Expressions (DAX)
10 13 (5.04%) PowerShell
11 12 (4.65%) U-SQL
12 7 (2.71%) C
12 7 (2.71%) JavaScript
13 2 (0.78%) Ruby
13 2 (0.78%) Shell Script
14 1 (0.39%) Go
14 1 (0.39%) Perl
14 1 (0.39%) PHP
Qualifications
1 33 (12.79%) Degree
2 16 (6.20%) Computer Science Degree
3 12 (4.65%) Master's Degree
4 6 (2.33%) AWS Certification
5 5 (1.94%) PhD
6 4 (1.55%) APMP
7 2 (0.78%) ISTQB
8 1 (0.39%) Numerate Degree
Quality Assurance & Compliance
1 25 (9.69%) Data Quality
2 13 (5.04%) QA
3 11 (4.26%) GDPR
4 5 (1.94%) Actionable Recommendations
5 3 (1.16%) PMO
6 1 (0.39%) COBIT
6 1 (0.39%) GCP
System Software
1 15 (5.81%) HDFS
2 11 (4.26%) Docker
3 10 (3.88%) Virtual Machines
4 3 (1.16%) Apache Flume
Systems Management
1 4 (1.55%) Hadoop YARN
1 4 (1.55%) Kubernetes
2 3 (1.16%) Rundeck
3 2 (0.78%) Ansible
4 1 (0.39%) Consul
4 1 (0.39%) Oozie
4 1 (0.39%) Opscode Chef
4 1 (0.39%) Puppet
4 1 (0.39%) Salt
4 1 (0.39%) Terraform
Vendors
1 85 (32.95%) Microsoft
2 72 (27.91%) Tableau
3 45 (17.44%) Google
4 42 (16.28%) Oracle
5 15 (5.81%) Informatica
6 14 (5.43%) IBM
6 14 (5.43%) Talend
7 9 (3.49%) Twitter
8 6 (2.33%) Ab Initio
9 4 (1.55%) Adobe
9 4 (1.55%) Cloudera
9 4 (1.55%) Netezza
9 4 (1.55%) Sybase
10 3 (1.16%) Capita
10 3 (1.16%) Hortonworks
10 3 (1.16%) Salesforce.com
10 3 (1.16%) SAP
10 3 (1.16%) Vertica
11 2 (0.78%) Thunderhead
11 2 (0.78%) WorldPay