Period
to 18 October 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 October 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
18 Oct 2018
Same period 2017 Same period 2016
Rank 403 697 816
Rank change year-on-year +294 +119 +93
Permanent jobs citing Data Lake 483 149 51
As % of all permanent IT jobs advertised in London 0.71% 0.20% 0.066%
As % of the Database & Business Intelligence category 2.31% 0.68% 0.23%
Number of salaries quoted 331 118 41
London median annual salary £70,000 £70,000 £95,000
Median salary % change year-on-year - -26.32% -6.17%
10th Percentile £46,250 £47,500 £67,500
90th Percentile £101,250 £105,000 £120,000
England median annual salary £65,000 £60,000 £86,250
% change year-on-year +8.33% -30.43% +91.67%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 20,881 22,003 22,646
As % of all permanent IT jobs advertised in London 30.77% 29.61% 29.33%
Number of salaries quoted 16,634 17,607 19,675
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £95,000 £90,000 £87,500
England median annual salary £50,000 £50,000 £47,500
% change year-on-year - +5.26% +5.56%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 18 October 2018.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 18 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +63 121 £65,000 -13.33% 17
South London +13 12 £57,500 -36.11% 1
West London +27 9 £45,000 -5.26% 8
East London - 2 £75,000 - 2
North London +7 1 £60,000 -
Data Lake
England

For the 6 months to 18 October 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 303 (62.73%) SQL
2 298 (61.70%) Analytics
3 274 (56.73%) Business Intelligence
4 267 (55.28%) Microsoft Azure
5 251 (51.97%) Big Data
6 234 (48.45%) Data Warehouse
7 218 (45.13%) Microsoft
8 199 (41.20%) SQL Server
9 178 (36.85%) Power BI
10 165 (34.16%) SQL Server Integration Services
11 164 (33.95%) Finance
12 154 (31.88%) Agile Software Development
13 148 (30.64%) Hadoop
14 145 (30.02%) Python
15 138 (28.57%) Data Modelling
16 129 (26.71%) SQL Server Analysis Services
17 128 (26.50%) Machine Learning
18 126 (26.09%) SQL Server Reporting Services
19 124 (25.67%) Azure Data Factory
20 122 (25.26%) ETL
20 122 (25.26%) Azure SQL Database
21 106 (21.95%) Apache Spark
22 100 (20.70%) Data Science
23 99 (20.50%) Data Analytics
23 99 (20.50%) Java
24 97 (20.08%) Azure SQL Data Warehouse
25 87 (18.01%) C#
25 87 (18.01%) Visualisation
26 79 (16.36%) NoSQL
27 78 (16.15%) Kafka

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 106 (21.95%) Apache Spark
2 47 (9.73%) Apache
3 25 (5.18%) Apache Pig
4 22 (4.55%) Apache Solr
5 12 (2.48%) Elasticsearch
6 11 (2.28%) SAS
6 11 (2.28%) SharePoint
7 6 (1.24%) Confluence
8 5 (1.04%) Tomcat
9 2 (0.41%) Apache Airflow
9 2 (0.41%) Luigi
9 2 (0.41%) Tornado
10 1 (0.21%) Drupal
10 1 (0.21%) Ethereum
10 1 (0.21%) IIS
Applications
1 22 (4.55%) Microsoft Excel
2 3 (0.62%) MS Visio
3 2 (0.41%) Microsoft Office
4 1 (0.21%) SPSS
Business Applications
1 3 (0.62%) Markit EDM
2 2 (0.41%) Dynamics AX
Cloud Services
1 267 (55.28%) Microsoft Azure
2 124 (25.67%) Azure Data Factory
3 74 (15.32%) Amazon AWS
4 64 (13.25%) PaaS
5 62 (12.84%) Data Lake Analytics
6 43 (8.90%) Serverless
7 34 (7.04%) Cortana Intelligence Suite
8 32 (6.63%) Azure Machine Learning
9 22 (4.55%) Google Cloud Platform
10 19 (3.93%) Azure Functions
10 19 (3.93%) IaaS
11 11 (2.28%) SaaS
12 10 (2.07%) AWS Lambda
13 9 (1.86%) Amazon Kinesis
14 8 (1.66%) Azure Active Directory
15 5 (1.04%) Amazon S3
15 5 (1.04%) BlazeMeter
15 5 (1.04%) Cloud Computing
16 4 (0.83%) Amazon EMR
17 3 (0.62%) Office 365
Communications & Networking
1 3 (0.62%) HTTP
2 2 (0.41%) Internet
Database & Business Intelligence
1 251 (51.97%) Big Data
2 234 (48.45%) Data Warehouse
3 199 (41.20%) SQL Server
4 178 (36.85%) Power BI
5 165 (34.16%) SQL Server Integration Services
6 148 (30.64%) Hadoop
7 129 (26.71%) SQL Server Analysis Services
8 126 (26.09%) SQL Server Reporting Services
9 122 (25.26%) Azure SQL Database
10 97 (20.08%) Azure SQL Data Warehouse
11 79 (16.36%) NoSQL
12 71 (14.70%) Cosmos DB
13 50 (10.35%) Apache Hive
14 49 (10.14%) Relational Database
15 39 (8.07%) Microsoft Analysis Services
16 38 (7.87%) MongoDB
17 36 (7.45%) Apache Cassandra
18 35 (7.25%) HBase
19 28 (5.80%) Impala
19 28 (5.80%) MySQL
Development Applications
1 43 (8.90%) Visual Studio
2 41 (8.49%) Git (software)
3 22 (4.55%) Jenkins
4 21 (4.35%) Visual Studio Team System
5 11 (2.28%) ERwin
6 9 (1.86%) TeamCity
7 8 (1.66%) JIRA
7 8 (1.66%) Octopus Deploy
8 7 (1.45%) SpecFlow
8 7 (1.45%) Team Foundation Server
9 6 (1.24%) SQL Server Management Studio (SSMS)
9 6 (1.24%) tSQLt
10 5 (1.04%) Atlassian Bamboo
10 5 (1.04%) ER Studio
11 4 (0.83%) GitLab
11 4 (0.83%) Hudson
12 3 (0.62%) Cucumber
12 3 (0.62%) JUnit
12 3 (0.62%) Maven
12 3 (0.62%) Subversion
General
1 164 (33.95%) Finance
2 75 (15.53%) Banking
3 51 (10.56%) Investment Banking
4 39 (8.07%) Advertising
5 38 (7.87%) Retail
6 34 (7.04%) Financial Institution
7 21 (4.35%) Games
8 17 (3.52%) Marketing
9 12 (2.48%) Corporate Banking
10 6 (1.24%) Online Betting
10 6 (1.24%) Telecoms
11 5 (1.04%) Front Office
12 4 (0.83%) Publishing
13 3 (0.62%) Billing
14 2 (0.41%) General Ledger
15 1 (0.21%) Automotive
15 1 (0.21%) Law
Job Titles
1 153 (31.68%) Developer
2 89 (18.43%) Architect
3 79 (16.36%) Business Intelligence Developer
4 77 (15.94%) Data Engineer
5 75 (15.53%) Consultant
6 70 (14.49%) Data Architect
7 42 (8.70%) Data Consultant
8 41 (8.49%) SQL Developer
9 40 (8.28%) SSIS Developer
10 33 (6.83%) Azure Consultant
11 32 (6.63%) SSAS Developer
12 31 (6.42%) Big Data Developer
13 30 (6.21%) Senior Developer
14 29 (6.00%) Business Intelligence Consultant
14 29 (6.00%) Data Warehouse Developer
14 29 (6.00%) SQL BI Developer
15 26 (5.38%) Analyst
16 23 (4.76%) SSRS Developer
17 22 (4.55%) Senior Business Intelligence Developer
18 21 (4.35%) Cloud Architect
Libraries, Frameworks & Software Standards
1 78 (16.15%) Kafka
2 65 (13.46%) .NET
3 32 (6.63%) JSON
4 30 (6.21%) MDX
5 28 (5.80%) Velocity
6 25 (5.18%) Web Services
7 20 (4.14%) RabbitMQ
8 19 (3.93%) RESTful
9 17 (3.52%) Natural Language Processing
10 13 (2.69%) HornetQ
10 13 (2.69%) HTML
10 13 (2.69%) JMS
10 13 (2.69%) REST
11 12 (2.48%) ASP.NET
12 10 (2.07%) AngularJS
12 10 (2.07%) ASP.NET MVC
12 10 (2.07%) TensorFlow
13 9 (1.86%) SAML
14 8 (1.66%) .NET Core
15 7 (1.45%) Vert.x
Miscellaneous
1 47 (9.73%) Analytical Skills
2 34 (7.04%) Cyberthreat
3 23 (4.76%) Computer Science
4 19 (3.93%) Algorithms
5 16 (3.31%) Reference Data
6 15 (3.11%) Greenfield Project
7 14 (2.90%) Equities
7 14 (2.90%) Hedge funds
7 14 (2.90%) Self-Motivation
8 12 (2.48%) Credit Risk
8 12 (2.48%) Derivative
9 10 (2.07%) Enterprise Software
9 10 (2.07%) Fintech
9 10 (2.07%) Management Information System
10 8 (1.66%) Data Structures
10 8 (1.66%) Fixed Income
11 7 (1.45%) Virtual Team
12 6 (1.24%) Foreign Exchange (FX)
13 5 (1.04%) NHS
13 5 (1.04%) Taxonomies
Operating Systems
1 15 (3.11%) Unix
2 12 (2.48%) Linux
3 8 (1.66%) Windows
Processes & Methodologies
1 298 (61.70%) Analytics
2 274 (56.73%) Business Intelligence
3 154 (31.88%) Agile Software Development
4 138 (28.57%) Data Modelling
5 128 (26.50%) Machine Learning
6 122 (25.26%) ETL
7 100 (20.70%) Data Science
8 99 (20.50%) Data Analytics
9 87 (18.01%) Visualisation
10 69 (14.29%) Data Architecture
11 65 (13.46%) Problem-Solving
12 47 (9.73%) OO
13 46 (9.52%) Data Governance
14 45 (9.32%) Investment Management
15 44 (9.11%) Data Integration
16 43 (8.90%) Continuous Integration
16 43 (8.90%) Data Engineering
16 43 (8.90%) TDD
17 41 (8.49%) Data Strategy
18 40 (8.28%) Low Latency
Programming Languages
1 303 (62.73%) SQL
2 145 (30.02%) Python
3 99 (20.50%) Java
4 87 (18.01%) C#
5 76 (15.73%) T-SQL
6 74 (15.32%) Data Analysis Expressions (DAX)
7 62 (12.84%) Scala
8 54 (11.18%) JavaScript
9 47 (9.73%) U-SQL
10 40 (8.28%) R
11 29 (6.00%) Perl
12 28 (5.80%) PowerShell
13 20 (4.14%) C++
14 19 (3.93%) Shell Script
15 10 (2.07%) C
16 4 (0.83%) Go
17 3 (0.62%) Java 8
18 1 (0.21%) Haskell
18 1 (0.21%) MATLAB
18 1 (0.21%) VB.NET
Qualifications
1 47 (9.73%) Degree
2 13 (2.69%) Microsoft Certification
3 11 (2.28%) Computer Science Degree
4 8 (1.66%) Master's Degree
4 8 (1.66%) MBA
5 6 (1.24%) GSEC
6 1 (0.21%) Numerate Degree
6 1 (0.21%) PhD
Quality Assurance & Compliance
1 25 (5.18%) Data Quality
2 20 (4.14%) QA
3 7 (1.45%) SLA
4 1 (0.21%) Actionable Recommendations
4 1 (0.21%) GDPR
System Software
1 30 (6.21%) HDFS
2 24 (4.97%) Docker
3 17 (3.52%) Virtual Machines
4 14 (2.90%) Apache Flume
5 12 (2.48%) Apache ZooKeeper
6 8 (1.66%) Active Directory
7 2 (0.41%) Hyper-V
7 2 (0.41%) VMware Infrastructure
Systems Management
1 19 (3.93%) Terraform
2 17 (3.52%) Opscode Chef
2 17 (3.52%) Puppet
3 16 (3.31%) Oozie
4 15 (3.11%) Kubernetes
5 5 (1.04%) Kibana
6 3 (0.62%) Ambari
7 2 (0.41%) Ansible
7 2 (0.41%) Grafana
8 1 (0.21%) Hadoop YARN
Vendors
1 218 (45.13%) Microsoft
2 65 (13.46%) Oracle
3 63 (13.04%) Tableau
4 39 (8.07%) Cloudera
5 37 (7.66%) Talend
6 33 (6.83%) Databricks
7 25 (5.18%) Informatica
8 22 (4.55%) Sybase
9 21 (4.35%) Google
10 17 (3.52%) Hortonworks
10 17 (3.52%) SnapLogic
11 13 (2.69%) EXASOL
11 13 (2.69%) WorldPay
12 11 (2.28%) MapR
13 10 (2.07%) Cognizant
13 10 (2.07%) Salesforce.com
13 10 (2.07%) SAP
14 8 (1.66%) Alteryx
15 7 (1.45%) Cognos
16 6 (1.24%) Teradata