Period
to 18 November 2017

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 November 2017 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
18 Nov 2017
Same period 2016 Same period 2015
Rank 678 776 899
Rank change year-on-year +98 +123 +17
Permanent jobs citing Data Lake 166 68 17
As % of all permanent IT jobs advertised in London 0.22% 0.090% 0.019%
As % of the Database & Business Intelligence category 0.75% 0.30% 0.062%
Number of salaries quoted 138 59 6
London median annual salary £70,000 £90,000 £97,500
Median salary % change year-on-year -22.22% -7.69% -
10th Percentile £47,500 £51,000 £67,500
90th Percentile £112,875 £115,000 £143,750
England median annual salary £60,000 £77,500 £60,000
% change year-on-year -22.58% +29.17% -6.25%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22080 22349 27350
As % of all permanent IT jobs advertised in London 29.43% 29.42% 30.64%
Number of salaries quoted 17685 19438 23124
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £88,750 £87,500 £85,000
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 18 November 2017.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 18 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +41 37 £75,000 -16.67% 5
West London - 10 £47,500 -
East London - 4 £110,000 -
South London - 3 £57,500 -
North London - 2 - -
Data Lake
England

For the 6 months to 18 November 2017, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Data Lake.

1 109 (65.66%) Analytics
2 108 (65.06%) Data Warehouse
3 105 (63.25%) Business Intelligence
4 95 (57.23%) SQL
5 91 (54.82%) Big Data
6 87 (52.41%) Microsoft Azure
7 86 (51.81%) SQL Server
8 67 (40.36%) Hadoop
9 63 (37.95%) Power BI
10 59 (35.54%) Microsoft
11 52 (31.33%) SQL Server Integration Services
12 49 (29.52%) Finance
13 46 (27.71%) Tableau
14 44 (26.51%) SQL Server Analysis Services
15 42 (25.30%) Data Modelling
15 42 (25.30%) Apache Spark
15 42 (25.30%) Azure Data Factory
16 41 (24.70%) Oracle
17 40 (24.10%) Amazon AWS
18 39 (23.49%) SQL Server Reporting Services
19 37 (22.29%) Agile Software Development
20 36 (21.69%) ETL
21 35 (21.08%) Visualisation
22 34 (20.48%) Migration
23 32 (19.28%) Stakeholder Management
24 30 (18.07%) C#
25 29 (17.47%) Azure SQL Database
26 28 (16.87%) Data Visualisation
26 28 (16.87%) Business Analytics
27 27 (16.27%) Azure SQL Data Warehouse

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 42 (25.30%) Apache Spark
2 8 (4.82%) Apache Pig
3 7 (4.22%) SAS
4 2 (1.20%) Apache
4 2 (1.20%) Apache Airflow
4 2 (1.20%) Jupyter
5 1 (0.60%) Apache Solr
5 1 (0.60%) CMS
5 1 (0.60%) Elasticsearch
5 1 (0.60%) SharePoint
Applications
1 2 (1.20%) SPSS
2 1 (0.60%) Microsoft Excel
Business Applications
1 1 (0.60%) Markit EDM
Cloud Services
1 87 (52.41%) Microsoft Azure
2 42 (25.30%) Azure Data Factory
3 40 (24.10%) Amazon AWS
4 19 (11.45%) Google Cloud Platform
5 15 (9.04%) Cortana Intelligence Suite
6 13 (7.83%) Amazon Kinesis
7 12 (7.23%) PaaS
8 9 (5.42%) Cloud Computing
9 5 (3.01%) GitHub
9 5 (3.01%) SaaS
10 4 (2.41%) Azure Machine Learning
10 4 (2.41%) Data Lake Analytics
11 3 (1.81%) Amazon EMR
12 2 (1.20%) Amazon EC2
12 2 (1.20%) Amazon S3
13 1 (0.60%) Datadog
13 1 (0.60%) OpenShift
Communications & Networking
1 1 (0.60%) DNS
1 1 (0.60%) Firewall
1 1 (0.60%) HTTP
1 1 (0.60%) LDAP
1 1 (0.60%) SMTP
1 1 (0.60%) TCP/IP
1 1 (0.60%) VPN
Database & Business Intelligence
1 108 (65.06%) Data Warehouse
2 91 (54.82%) Big Data
3 86 (51.81%) SQL Server
4 67 (40.36%) Hadoop
5 63 (37.95%) Power BI
6 52 (31.33%) SQL Server Integration Services
7 44 (26.51%) SQL Server Analysis Services
8 39 (23.49%) SQL Server Reporting Services
9 29 (17.47%) Azure SQL Database
10 27 (16.27%) Azure SQL Data Warehouse
10 27 (16.27%) NoSQL
11 24 (14.46%) HDInsight
12 19 (11.45%) MongoDB
12 19 (11.45%) MySQL
13 15 (9.04%) QlikView
14 13 (7.83%) HBase
15 11 (6.63%) Apache Hive
16 10 (6.02%) Amazon DynamoDB
16 10 (6.02%) BigQuery
16 10 (6.02%) Oracle OLAP
Development Applications
1 13 (7.83%) Talend Open Studio
2 8 (4.82%) Jenkins
3 3 (1.81%) Atlassian Bamboo
3 3 (1.81%) Visual Studio
4 2 (1.20%) Subversion
5 1 (0.60%) Artifactory
5 1 (0.60%) Cucumber
5 1 (0.60%) GoCD
5 1 (0.60%) JUnit
5 1 (0.60%) Sonatype Nexus
5 1 (0.60%) Visual Studio Team System
General
1 49 (29.52%) Finance
2 11 (6.63%) Retail
3 8 (4.82%) Advertising
3 8 (4.82%) Banking
4 7 (4.22%) Financial Institution
4 7 (4.22%) Telecoms
5 5 (3.01%) Manufacturing
6 4 (2.41%) Games
7 3 (1.81%) Marketing
8 1 (0.60%) Automotive
8 1 (0.60%) French Language
8 1 (0.60%) Front Office
8 1 (0.60%) German Language
8 1 (0.60%) iGaming
8 1 (0.60%) Legal
8 1 (0.60%) Local Government
8 1 (0.60%) Publishing
8 1 (0.60%) Spanish Language
Job Titles
1 61 (36.75%) Architect
2 43 (25.90%) Data Architect
3 30 (18.07%) Consultant
4 28 (16.87%) Developer
5 25 (15.06%) Business Intelligence Consultant
6 22 (13.25%) Microsoft BI Consultant
7 21 (12.65%) Business Intelligence Developer
8 20 (12.05%) Azure Architect
9 16 (9.64%) Azure Consultant
10 15 (9.04%) Data Engineer
10 15 (9.04%) Power BI Consultant
11 14 (8.43%) Big Data Architect
12 13 (7.83%) Senior Consultant
12 13 (7.83%) Solutions Architect
13 12 (7.23%) Senior Business Intelligence Consultant
14 11 (6.63%) Cloud Architect
14 11 (6.63%) Lead Architect
14 11 (6.63%) SQL Developer
15 10 (6.02%) SQL BI Developer
15 10 (6.02%) SQL Server Consultant
Libraries, Frameworks & Software Standards
1 22 (13.25%) Kafka
2 21 (12.65%) MDX
3 10 (6.02%) .NET
4 7 (4.22%) Django
4 7 (4.22%) Node.js
5 6 (3.61%) Flask
5 6 (3.61%) RabbitMQ
6 3 (1.81%) ASP.NET
6 3 (1.81%) XML
7 2 (1.20%) CSS
7 2 (1.20%) HTML
7 2 (1.20%) JSON
7 2 (1.20%) Oracle GoldenGate
7 2 (1.20%) XSD
8 1 (0.60%) AngularJS
8 1 (0.60%) Elastic Stack
8 1 (0.60%) Natural Language Processing
8 1 (0.60%) scikit-learn
8 1 (0.60%) Spark Streaming
8 1 (0.60%) TensorFlow
Miscellaneous
1 9 (5.42%) Analytical Skills
1 9 (5.42%) Enterprise Software
2 7 (4.22%) Computer Science
2 7 (4.22%) Greenfield Project
3 6 (3.61%) Cloud Native
3 6 (3.61%) Social Media
3 6 (3.61%) Taxonomies
4 5 (3.01%) Fintech
4 5 (3.01%) Public Cloud
5 4 (2.41%) Algorithms
5 4 (2.41%) Digital Media
6 3 (1.81%) Equities
6 3 (1.81%) Fixed Income
6 3 (1.81%) Foreign Exchange (FX)
7 2 (1.20%) Data Structures
7 2 (1.20%) Management Information System
7 2 (1.20%) N-Tier
7 2 (1.20%) Online Games
8 1 (0.60%) Derivative
8 1 (0.60%) Replication
Operating Systems
1 14 (8.43%) Linux
2 4 (2.41%) Unix
3 2 (1.20%) Windows
4 1 (0.60%) Red Hat Enterprise Linux
4 1 (0.60%) VMS
Processes & Methodologies
1 109 (65.66%) Analytics
2 105 (63.25%) Business Intelligence
3 42 (25.30%) Data Modelling
4 37 (22.29%) Agile Software Development
5 36 (21.69%) ETL
6 35 (21.08%) Visualisation
7 34 (20.48%) Migration
8 32 (19.28%) Stakeholder Management
9 28 (16.87%) Business Analytics
9 28 (16.87%) Data Visualisation
10 24 (14.46%) Data Architecture
10 24 (14.46%) Information Management
11 23 (13.86%) Data Management
11 23 (13.86%) Data Migration
12 22 (13.25%) Machine Learning
13 21 (12.65%) Data Analytics
14 19 (11.45%) Data Integration
15 17 (10.24%) Kimball Methodology
15 17 (10.24%) Presales
16 15 (9.04%) Data Governance
Programming Languages
1 95 (57.23%) SQL
2 30 (18.07%) C#
3 27 (16.27%) Python
3 27 (16.27%) T-SQL
4 23 (13.86%) Java
5 19 (11.45%) Scala
6 13 (7.83%) PowerShell
7 12 (7.23%) R
8 11 (6.63%) C++
8 11 (6.63%) Data Analysis Expressions (DAX)
9 10 (6.02%) JavaScript
10 3 (1.81%) Ruby
10 3 (1.81%) VB.NET
11 2 (1.20%) C
11 2 (1.20%) U-SQL
12 1 (0.60%) Go
12 1 (0.60%) MATLAB
12 1 (0.60%) PHP
Qualifications
1 17 (10.24%) Degree
2 6 (3.61%) AWS Certification
3 3 (1.81%) Computer Science Degree
3 3 (1.81%) PhD
4 2 (1.20%) ISTQB
5 1 (0.60%) Master's Degree
Quality Assurance & Compliance
1 19 (11.45%) Data Quality
2 10 (6.02%) GDPR
3 5 (3.01%) QA
4 1 (0.60%) COBIT
4 1 (0.60%) GCP
4 1 (0.60%) PMO
System Software
1 9 (5.42%) Docker
1 9 (5.42%) HDFS
2 5 (3.01%) Apache Flume
Systems Management
1 3 (1.81%) Ansible
1 3 (1.81%) Hadoop YARN
1 3 (1.81%) Puppet
2 2 (1.20%) Ambari
2 2 (1.20%) Kubernetes
2 2 (1.20%) Opscode Chef
2 2 (1.20%) Rundeck
2 2 (1.20%) Terraform
3 1 (0.60%) Consul
3 1 (0.60%) Salt
Vendors
1 59 (35.54%) Microsoft
2 46 (27.71%) Tableau
3 41 (24.70%) Oracle
4 23 (13.86%) Google
5 14 (8.43%) Informatica
6 13 (7.83%) Talend
7 7 (4.22%) Cloudera
8 5 (3.01%) Hortonworks
8 5 (3.01%) Twitter
9 4 (2.41%) Ab Initio
10 2 (1.20%) Salesforce.com
10 2 (1.20%) Vertica
11 1 (0.60%) Cadence
11 1 (0.60%) IBM
11 1 (0.60%) MapR
11 1 (0.60%) Netezza
11 1 (0.60%) New Relic
11 1 (0.60%) Red Hat
11 1 (0.60%) Teradata