Period
to 21 June 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 21 June 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
21 Jun 2018
Same period 2017 Same period 2016
Rank 369 722 847
Rank change year-on-year +353 +125 +68
Permanent jobs citing Data Lake 582 102 34
As % of all permanent IT jobs advertised in London 0.84% 0.15% 0.041%
As % of the Database & Business Intelligence category 2.67% 0.48% 0.14%
Number of salaries quoted 392 80 11
London median annual salary £70,000 £70,000 £80,000
Median salary % change year-on-year - -12.50% +6.67%
10th Percentile £51,250 £53,000 £63,000
90th Percentile £105,000 £106,000 £130,000
England median annual salary £65,000 £62,000 £74,000
% change year-on-year +4.84% -16.22% -1.33%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,800 21,120 24,928
As % of all permanent IT jobs advertised in London 31.39% 30.14% 30.33%
Number of salaries quoted 17,318 17,972 21,733
London median annual salary £60,000 £60,000 £55,000
Median salary % change year-on-year - +9.09% -
10th Percentile £37,500 £36,250 £35,750
90th Percentile £92,500 £90,000 £85,000
England median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 21 June 2018.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 21 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +109 179 £67,500 -3.57% 9
West London - 18 £57,500 - 6
East London - 2 £120,000 - 3
North London - 1 £60,000 -
Data Lake
England

For the 6 months to 21 June 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 378 (64.95%) Big Data
2 374 (64.26%) Analytics
3 365 (62.71%) SQL
4 272 (46.74%) Business Intelligence
5 270 (46.39%) Microsoft Azure
6 221 (37.97%) Microsoft
7 197 (33.85%) Java
8 195 (33.51%) Finance
9 194 (33.33%) Python
10 187 (32.13%) Power BI
11 184 (31.62%) Agile Software Development
12 183 (31.44%) SQL Server
13 182 (31.27%) Data Warehouse
14 180 (30.93%) Apache Spark
15 173 (29.73%) Hadoop
16 162 (27.84%) Machine Learning
17 155 (26.63%) SQL Server Integration Services
18 144 (24.74%) Azure Data Factory
18 144 (24.74%) Data Science
19 133 (22.85%) ETL
20 129 (22.16%) Azure SQL Database
21 128 (21.99%) Data Modelling
21 128 (21.99%) Degree
22 124 (21.31%) C#
23 123 (21.13%) Data Analytics
24 122 (20.96%) Tableau
25 112 (19.24%) SQL Server Analysis Services
26 104 (17.87%) Amazon AWS
26 104 (17.87%) NoSQL
27 99 (17.01%) SQL Server Reporting Services

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 180 (30.93%) Apache Spark
2 34 (5.84%) Apache
3 21 (3.61%) Apache Solr
4 18 (3.09%) Apache Pig
5 6 (1.03%) Elasticsearch
6 5 (0.86%) Tomcat
7 4 (0.69%) SharePoint
8 2 (0.34%) Apache Airflow
8 2 (0.34%) BizTalk Server
8 2 (0.34%) Drupal
9 1 (0.17%) Confluence
9 1 (0.17%) IBM Domino
9 1 (0.17%) Luigi
9 1 (0.17%) SAS
Applications
1 14 (2.41%) MS Visio
2 5 (0.86%) Microsoft Excel
Business Applications
1 5 (0.86%) Dynamics CRM
2 3 (0.52%) Markit EDM
3 1 (0.17%) Dynamics AX
3 1 (0.17%) MetaTrader
Cloud Services
1 270 (46.39%) Microsoft Azure
2 144 (24.74%) Azure Data Factory
3 104 (17.87%) Amazon AWS
4 73 (12.54%) Cortana Intelligence Suite
5 71 (12.20%) Serverless
6 50 (8.59%) IaaS
7 46 (7.90%) PaaS
8 42 (7.22%) Azure Machine Learning
9 27 (4.64%) AWS Lambda
10 24 (4.12%) Data Lake Analytics
11 17 (2.92%) SaaS
12 15 (2.58%) Google Cloud Platform
13 13 (2.23%) Amazon EMR
13 13 (2.23%) GitHub
14 10 (1.72%) Amazon S3
14 10 (1.72%) OpenShift
15 9 (1.55%) Datadog
16 6 (1.03%) Amazon Kinesis
17 5 (0.86%) Office 365
18 2 (0.34%) Force.com
Communications & Networking
1 9 (1.55%) DNS
1 9 (1.55%) Firewall
1 9 (1.55%) HTTP
1 9 (1.55%) SMTP
1 9 (1.55%) TCP/IP
1 9 (1.55%) VPN
2 1 (0.17%) Internet
Database & Business Intelligence
1 378 (64.95%) Big Data
2 187 (32.13%) Power BI
3 183 (31.44%) SQL Server
4 182 (31.27%) Data Warehouse
5 173 (29.73%) Hadoop
6 155 (26.63%) SQL Server Integration Services
7 129 (22.16%) Azure SQL Database
8 112 (19.24%) SQL Server Analysis Services
9 104 (17.87%) NoSQL
10 99 (17.01%) SQL Server Reporting Services
11 86 (14.78%) Apache Hive
12 59 (10.14%) Cosmos DB
13 55 (9.45%) Azure SQL Data Warehouse
14 53 (9.11%) HBase
15 48 (8.25%) Sqoop
16 43 (7.39%) Oracle ODI
17 37 (6.36%) HDInsight
18 29 (4.98%) Apache Cassandra
19 25 (4.30%) Relational Database
19 25 (4.30%) SQL Server 2008
Development Applications
1 63 (10.82%) Visual Studio
2 58 (9.97%) Git (software)
3 20 (3.44%) Jenkins
3 20 (3.44%) RStudio
4 14 (2.41%) Sonatype Nexus
4 14 (2.41%) Visual Studio Team System
5 11 (1.89%) JIRA
6 10 (1.72%) GitLab
7 9 (1.55%) Artifactory
7 9 (1.55%) GoCD
8 6 (1.03%) ERwin
9 4 (0.69%) SQL Server Management Studio (SSMS)
10 3 (0.52%) Cucumber
10 3 (0.52%) Octopus Deploy
10 3 (0.52%) Team Foundation Server
10 3 (0.52%) TeamCity
11 2 (0.34%) JUnit
11 2 (0.34%) NUnit
11 2 (0.34%) Selenium
11 2 (0.34%) SpecFlow
General
1 195 (33.51%) Finance
2 87 (14.95%) Banking
3 48 (8.25%) Advertising
4 44 (7.56%) Marketing
5 41 (7.04%) Games
6 37 (6.36%) Investment Banking
7 34 (5.84%) Financial Institution
8 26 (4.47%) Retail
9 19 (3.26%) Publishing
10 7 (1.20%) Billing
11 5 (0.86%) Front Office
12 2 (0.34%) Automotive
12 2 (0.34%) Electronics
12 2 (0.34%) Law
12 2 (0.34%) Manufacturing
12 2 (0.34%) Telecoms
13 1 (0.17%) Back Office
13 1 (0.17%) Pharmaceutical
Job Titles
1 207 (35.57%) Developer
2 103 (17.70%) Consultant
3 91 (15.64%) Architect
4 78 (13.40%) Data Engineer
5 67 (11.51%) Business Intelligence Developer
6 66 (11.34%) Business Intelligence Consultant
7 59 (10.14%) Azure Consultant
8 58 (9.97%) Data Architect
9 53 (9.11%) Power BI Consultant
10 52 (8.93%) Big Data Developer
11 46 (7.90%) Microsoft BI Consultant
12 38 (6.53%) SQL Developer
13 32 (5.50%) Data Consultant
14 31 (5.33%) SSIS Developer
15 30 (5.15%) Azure Architect
15 30 (5.15%) Data Scientist
16 28 (4.81%) Java Developer
16 28 (4.81%) SSRS Developer
17 27 (4.64%) Lead Architect
17 27 (4.64%) SQL BI Developer
Libraries, Frameworks & Software Standards
1 86 (14.78%) Kafka
2 78 (13.40%) .NET
3 45 (7.73%) AngularJS
4 38 (6.53%) jQuery
5 34 (5.84%) RabbitMQ
6 32 (5.50%) Velocity
7 29 (4.98%) HornetQ
7 29 (4.98%) JMS
8 28 (4.81%) Natural Language Processing
9 22 (3.78%) ASP.NET
10 18 (3.09%) Web Services
11 16 (2.75%) ASP.NET MVC
11 16 (2.75%) JSON
12 14 (2.41%) HTML
13 13 (2.23%) REST
14 12 (2.06%) RESTful
14 12 (2.06%) XML
15 11 (1.89%) Vert.x
16 9 (1.55%) Elastic Stack
16 9 (1.55%) LDAP
Miscellaneous
1 72 (12.37%) Computer Science
2 38 (6.53%) Self-Motivation
3 37 (6.36%) Analytical Skills
4 35 (6.01%) Fintech
5 32 (5.50%) Cyberthreat
6 18 (3.09%) Data Structures
7 16 (2.75%) Hedge funds
7 16 (2.75%) Public Cloud
8 15 (2.58%) Fixed Income
9 14 (2.41%) Algorithms
9 14 (2.41%) Greenfield Project
9 14 (2.41%) Virtual Team
10 11 (1.89%) Management Information System
11 9 (1.55%) Derivative
11 9 (1.55%) Enterprise Software
11 9 (1.55%) Linux Command Line
12 7 (1.20%) Clustering
12 7 (1.20%) Equities
12 7 (1.20%) Foreign Exchange (FX)
13 5 (0.86%) Private Cloud
Operating Systems
1 27 (4.64%) Linux
2 22 (3.78%) Unix
Processes & Methodologies
1 374 (64.26%) Analytics
2 272 (46.74%) Business Intelligence
3 184 (31.62%) Agile Software Development
4 162 (27.84%) Machine Learning
5 144 (24.74%) Data Science
6 133 (22.85%) ETL
7 128 (21.99%) Data Modelling
8 123 (21.13%) Data Analytics
9 94 (16.15%) Data Governance
10 92 (15.81%) Problem-Solving
11 91 (15.64%) Visualisation
12 86 (14.78%) OO
13 79 (13.57%) Mathematics
14 70 (12.03%) Presales
15 61 (10.48%) OOP
15 61 (10.48%) SOA
16 59 (10.14%) TDD
17 58 (9.97%) Data Engineering
18 52 (8.93%) Mentoring
19 51 (8.76%) Workflow
Programming Languages
1 365 (62.71%) SQL
2 197 (33.85%) Java
3 194 (33.33%) Python
4 124 (21.31%) C#
5 99 (17.01%) Scala
6 63 (10.82%) R
7 60 (10.31%) T-SQL
8 56 (9.62%) JavaScript
9 47 (8.08%) U-SQL
10 45 (7.73%) Data Analysis Expressions (DAX)
11 37 (6.36%) C++
12 35 (6.01%) Perl
13 26 (4.47%) Shell Script
14 22 (3.78%) Java 8
15 13 (2.23%) Go
16 10 (1.72%) Ruby
17 8 (1.37%) C
18 6 (1.03%) PowerShell
19 4 (0.69%) MATLAB
19 4 (0.69%) VB.NET
Qualifications
1 128 (21.99%) Degree
2 63 (10.82%) Computer Science Degree
3 50 (8.59%) Master's Degree
4 8 (1.37%) Security Cleared
5 6 (1.03%) MBA
6 4 (0.69%) GSEC
6 4 (0.69%) Microsoft Certification
6 4 (0.69%) PhD
6 4 (0.69%) SC Cleared
7 3 (0.52%) AWS Certification
8 2 (0.34%) Numerate Degree
Quality Assurance & Compliance
1 27 (4.64%) Data Quality
2 17 (2.92%) QA
3 10 (1.72%) GDPR
4 3 (0.52%) GCP
5 2 (0.34%) Actionable Recommendations
5 2 (0.34%) PMO
6 1 (0.17%) HIPAA
6 1 (0.17%) Sarbanes-Oxley
6 1 (0.17%) SLA
System Software
1 57 (9.79%) HDFS
2 40 (6.87%) Virtual Machines
3 37 (6.36%) Docker
4 17 (2.92%) Apache ZooKeeper
5 10 (1.72%) Apache Flume
6 2 (0.34%) Active Directory
Systems Management
1 35 (6.01%) Kubernetes
2 18 (3.09%) Oozie
3 15 (2.58%) Ambari
3 15 (2.58%) Opscode Chef
4 14 (2.41%) Terraform
5 10 (1.72%) Ansible
6 9 (1.55%) Consul
6 9 (1.55%) Salt
7 6 (1.03%) Hadoop YARN
8 5 (0.86%) Puppet
9 4 (0.69%) Kibana
10 2 (0.34%) Mesos
Vendors
1 221 (37.97%) Microsoft
2 122 (20.96%) Tableau
3 90 (15.46%) Oracle
4 60 (10.31%) Talend
5 54 (9.28%) Cloudera
6 44 (7.56%) Informatica
7 35 (6.01%) WorldPay
8 33 (5.67%) Google
9 30 (5.15%) Sybase
10 29 (4.98%) EXASOL
10 29 (4.98%) SnapLogic
11 23 (3.95%) Alteryx
12 20 (3.44%) Cognos
13 18 (3.09%) Hortonworks
14 16 (2.75%) Cognizant
14 16 (2.75%) Netezza
15 15 (2.58%) IBM
15 15 (2.58%) Salesforce.com
16 9 (1.55%) New Relic
17 6 (1.03%) Databricks