Period
to 10 December 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 10 December 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
10 Dec 2018
Same period 2017 Same period 2016
Rank 421 670 771
Rank change year-on-year +249 +101 +128
Permanent jobs citing Data Lake 413 200 69
As % of all permanent IT jobs advertised in London 0.62% 0.27% 0.093%
As % of the Database & Business Intelligence category 2.07% 0.92% 0.31%
Number of salaries quoted 312 170 62
London median annual salary £70,000 £70,000 £88,750
Median salary % change year-on-year - -21.13% +7.58%
10th Percentile £43,500 £47,500 £50,125
90th Percentile £102,375 £110,000 £113,375
England median annual salary £65,000 £63,750 £77,500
% change year-on-year +1.96% -17.74% +10.71%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 19,925 21,782 21,993
As % of all permanent IT jobs advertised in London 29.91% 29.50% 29.72%
Number of salaries quoted 16,373 17,515 19,152
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £95,000 £88,750 £87,500
England median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% +5.56%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 10 December 2018.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 10 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +42 83 £72,500 -3.33% 23
South London +5 14 £60,000 +4.35% 1
West London +19 12 £55,000 +15.79% 9
East London +4 2 £75,000 -31.82%
North London +11 1 £80,000 - 1
Data Lake
England

For the 6 months to 10 December 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 251 (60.77%) Business Intelligence
1 251 (60.77%) Microsoft Azure
2 250 (60.53%) Analytics
2 250 (60.53%) SQL
3 231 (55.93%) Data Warehouse
4 187 (45.28%) Microsoft
5 184 (44.55%) Big Data
6 175 (42.37%) SQL Server
7 150 (36.32%) Power BI
8 144 (34.87%) SQL Server Integration Services
9 136 (32.93%) Data Modelling
10 134 (32.45%) Agile Software Development
11 130 (31.48%) ETL
12 128 (30.99%) Hadoop
13 124 (30.02%) SQL Server Analysis Services
14 121 (29.30%) Azure Data Factory
15 111 (26.88%) Python
16 108 (26.15%) Finance
17 107 (25.91%) Azure SQL Database
18 101 (24.46%) SQL Server Reporting Services
19 100 (24.21%) Machine Learning
20 89 (21.55%) Visualisation
21 86 (20.82%) Apache Spark
21 86 (20.82%) Azure SQL Data Warehouse
22 85 (20.58%) Data Science
23 75 (18.16%) Amazon AWS
24 74 (17.92%) T-SQL
25 73 (17.68%) Kafka
26 71 (17.19%) Data Lake Analytics
27 69 (16.71%) Cosmos DB

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 86 (20.82%) Apache Spark
2 38 (9.20%) Apache
3 25 (6.05%) Apache Pig
4 23 (5.57%) Apache Solr
5 16 (3.87%) SAS
6 11 (2.66%) SharePoint
7 9 (2.18%) Elasticsearch
8 6 (1.45%) Confluence
9 3 (0.73%) Apache Airflow
9 3 (0.73%) Luigi
10 2 (0.48%) Tornado
11 1 (0.24%) Ethereum
11 1 (0.24%) IIS
11 1 (0.24%) Jupyter
11 1 (0.24%) Tomcat
Applications
1 29 (7.02%) Microsoft Excel
2 3 (0.73%) SPSS
3 2 (0.48%) Microsoft Office
Business Applications
1 2 (0.48%) Markit EDM
2 1 (0.24%) Dynamics AX
2 1 (0.24%) Eagle PACE
Cloud Services
1 251 (60.77%) Microsoft Azure
2 121 (29.30%) Azure Data Factory
3 75 (18.16%) Amazon AWS
4 71 (17.19%) Data Lake Analytics
5 60 (14.53%) PaaS
6 39 (9.44%) Serverless
7 27 (6.54%) Azure Machine Learning
8 25 (6.05%) Google Cloud Platform
9 22 (5.33%) Cortana Intelligence Suite
10 15 (3.63%) Azure Functions
11 12 (2.91%) AWS Lambda
12 11 (2.66%) IaaS
13 10 (2.42%) SaaS
14 9 (2.18%) Amazon S3
14 9 (2.18%) Azure Active Directory
15 6 (1.45%) Amazon Kinesis
15 6 (1.45%) BlazeMeter
16 5 (1.21%) Cloud Computing
17 3 (0.73%) Amazon CloudWatch
17 3 (0.73%) AWS CloudFormation
Communications & Networking
1 3 (0.73%) HTTP
2 1 (0.24%) Firewall
2 1 (0.24%) Internet
Database & Business Intelligence
1 231 (55.93%) Data Warehouse
2 184 (44.55%) Big Data
3 175 (42.37%) SQL Server
4 150 (36.32%) Power BI
5 144 (34.87%) SQL Server Integration Services
6 128 (30.99%) Hadoop
7 124 (30.02%) SQL Server Analysis Services
8 107 (25.91%) Azure SQL Database
9 101 (24.46%) SQL Server Reporting Services
10 86 (20.82%) Azure SQL Data Warehouse
11 69 (16.71%) Cosmos DB
12 59 (14.29%) NoSQL
13 52 (12.59%) Relational Database
14 45 (10.90%) Microsoft Analysis Services
15 44 (10.65%) Apache Hive
16 41 (9.93%) MongoDB
17 38 (9.20%) Apache Cassandra
17 38 (9.20%) MySQL
18 34 (8.23%) HBase
19 25 (6.05%) Impala
Development Applications
1 37 (8.96%) Git (software)
2 34 (8.23%) Visual Studio
3 26 (6.30%) Jenkins
4 24 (5.81%) Visual Studio Team System
5 17 (4.12%) ERwin
6 11 (2.66%) ER Studio
6 11 (2.66%) Team Foundation Server
7 9 (2.18%) TeamCity
8 8 (1.94%) JIRA
8 8 (1.94%) Octopus Deploy
9 7 (1.69%) SpecFlow
9 7 (1.69%) tSQLt
10 6 (1.45%) Atlassian Bamboo
10 6 (1.45%) SQL Server Management Studio (SSMS)
11 4 (0.97%) Hudson
11 4 (0.97%) Maven
12 3 (0.73%) GitLab
12 3 (0.73%) JUnit
12 3 (0.73%) Subversion
13 2 (0.48%) FindBugs
General
1 108 (26.15%) Finance
2 39 (9.44%) Banking
3 37 (8.96%) Retail
4 26 (6.30%) Investment Banking
5 25 (6.05%) Advertising
6 12 (2.91%) Corporate Banking
6 12 (2.91%) Games
7 9 (2.18%) Financial Institution
7 9 (2.18%) Marketing
8 8 (1.94%) Telecoms
9 6 (1.45%) Online Betting
10 3 (0.73%) Front Office
10 3 (0.73%) General Ledger
11 1 (0.24%) Law
Job Titles
1 103 (24.94%) Developer
2 94 (22.76%) Architect
3 79 (19.13%) Data Architect
4 69 (16.71%) Business Intelligence Developer
5 68 (16.46%) Data Engineer
6 51 (12.35%) Consultant
7 41 (9.93%) Analyst
8 33 (7.99%) SQL Developer
9 31 (7.51%) SQL BI Developer
10 30 (7.26%) Data Consultant
11 29 (7.02%) Business Analyst
11 29 (7.02%) SSIS Developer
12 26 (6.30%) Business Intelligence Analyst
13 24 (5.81%) Business Intelligence Business Analyst
13 24 (5.81%) Cloud Architect
13 24 (5.81%) Microsoft Consultant
14 23 (5.57%) Business Intelligence Architect
14 23 (5.57%) SSAS Developer
15 22 (5.33%) Data Business Analyst
16 21 (5.08%) Senior Developer
Libraries, Frameworks & Software Standards
1 73 (17.68%) Kafka
2 48 (11.62%) .NET
3 36 (8.72%) JSON
4 33 (7.99%) MDX
5 19 (4.60%) Velocity
6 13 (3.15%) Web Services
7 11 (2.66%) RESTful
8 10 (2.42%) RabbitMQ
8 10 (2.42%) TensorFlow
9 9 (2.18%) .NET Core
9 9 (2.18%) AngularJS
10 8 (1.94%) HTML
10 8 (1.94%) XML
11 7 (1.69%) ASP.NET Web API
11 7 (1.69%) HTML5
11 7 (1.69%) REST
11 7 (1.69%) SAML
11 7 (1.69%) Spark Streaming
12 6 (1.45%) Akka
12 6 (1.45%) Natural Language Processing
Miscellaneous
1 52 (12.59%) Analytical Skills
2 17 (4.12%) Reference Data
3 13 (3.15%) Credit Risk
4 12 (2.91%) Algorithms
4 12 (2.91%) Equities
4 12 (2.91%) Greenfield Project
5 10 (2.42%) Data Structures
5 10 (2.42%) Enterprise Software
6 9 (2.18%) Cloud Native
6 9 (2.18%) Cyberthreat
6 9 (2.18%) Virtual Team
7 7 (1.69%) Management Information System
7 7 (1.69%) Public Cloud
8 6 (1.45%) Hedge funds
8 6 (1.45%) Mobile App
8 6 (1.45%) Self-Motivation
9 5 (1.21%) NHS
10 4 (0.97%) Data Centre
10 4 (0.97%) Derivative
10 4 (0.97%) Fintech
Operating Systems
1 15 (3.63%) Linux
2 11 (2.66%) Unix
3 10 (2.42%) Windows
Processes & Methodologies
1 251 (60.77%) Business Intelligence
2 250 (60.53%) Analytics
3 136 (32.93%) Data Modelling
4 134 (32.45%) Agile Software Development
5 130 (31.48%) ETL
6 100 (24.21%) Machine Learning
7 89 (21.55%) Visualisation
8 85 (20.58%) Data Science
9 69 (16.71%) Data Architecture
10 68 (16.46%) Data Analytics
11 49 (11.86%) Data Integration
12 46 (11.14%) Data Engineering
13 45 (10.90%) Data Governance
13 45 (10.90%) Problem-Solving
14 44 (10.65%) Data Analysis
15 42 (10.17%) Kimball Methodology
16 39 (9.44%) Data Management
17 38 (9.20%) Dimensional Modelling
18 37 (8.96%) Data Visualisation
19 36 (8.72%) Scrum
Programming Languages
1 250 (60.53%) SQL
2 111 (26.88%) Python
3 74 (17.92%) T-SQL
4 69 (16.71%) Data Analysis Expressions (DAX)
5 68 (16.46%) C#
6 54 (13.08%) Java
7 44 (10.65%) U-SQL
8 41 (9.93%) PowerShell
9 35 (8.47%) Scala
10 34 (8.23%) R
11 27 (6.54%) JavaScript
12 13 (3.15%) Perl
13 10 (2.42%) Shell Script
14 9 (2.18%) C
15 7 (1.69%) C++
16 2 (0.48%) MATLAB
16 2 (0.48%) PHP
16 2 (0.48%) PL/SQL
17 1 (0.24%) Ruby
17 1 (0.24%) VB.NET
Qualifications
1 27 (6.54%) Degree
2 16 (3.87%) Microsoft Certification
3 6 (1.45%) Master's Degree
4 4 (0.97%) MCAD
4 4 (0.97%) MCDBA
4 4 (0.97%) MCSD
4 4 (0.97%) PhD
5 2 (0.48%) Computer Science Degree
5 2 (0.48%) GSEC
5 2 (0.48%) MBA
6 1 (0.24%) CEH
6 1 (0.24%) PMI Certification
6 1 (0.24%) TOGAF Certification
Quality Assurance & Compliance
1 38 (9.20%) Data Quality
2 28 (6.78%) QA
3 9 (2.18%) SLA
4 4 (0.97%) GDPR
5 2 (0.48%) PCI DSS
6 1 (0.24%) Actionable Recommendations
6 1 (0.24%) IFRS
6 1 (0.24%) Solvency II
System Software
1 23 (5.57%) HDFS
2 15 (3.63%) Apache Flume
2 15 (3.63%) Docker
3 13 (3.15%) Apache ZooKeeper
4 9 (2.18%) Active Directory
5 8 (1.94%) Virtual Machines
6 2 (0.48%) Hyper-V
6 2 (0.48%) VMware Infrastructure
Systems Management
1 21 (5.08%) Terraform
2 19 (4.60%) Opscode Chef
2 19 (4.60%) Puppet
3 16 (3.87%) Oozie
4 7 (1.69%) Kubernetes
5 4 (0.97%) Ansible
6 3 (0.73%) Grafana
7 2 (0.48%) ArcSight ESM
8 1 (0.24%) Ambari
8 1 (0.24%) Hadoop YARN
8 1 (0.24%) Kibana
8 1 (0.24%) Salt
Vendors
1 187 (45.28%) Microsoft
2 59 (14.29%) Tableau
3 57 (13.80%) Oracle
4 40 (9.69%) Databricks
5 30 (7.26%) Cloudera
5 30 (7.26%) Talend
6 24 (5.81%) Google
7 15 (3.63%) Informatica
8 13 (3.15%) Hortonworks
9 12 (2.91%) Alteryx
9 12 (2.91%) Cognizant
9 12 (2.91%) MapR
10 11 (2.66%) SAP
11 10 (2.42%) WorldPay
12 9 (2.18%) Salesforce.com
12 9 (2.18%) SnapLogic
13 8 (1.94%) IDERA
14 7 (1.69%) Sybase
15 5 (1.21%) Teradata
16 4 (0.97%) EXASOL