Period
to 22 April 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 22 April 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
22 Apr 2018
Same period 2017 Same period 2016
Rank 393 737 859
Rank change year-on-year +344 +122 +43
Permanent jobs citing Data Lake 522 83 41
As % of all permanent IT jobs advertised in London 0.75% 0.12% 0.049%
As % of the Database & Business Intelligence category 2.42% 0.40% 0.16%
Number of salaries quoted 391 72 16
London median annual salary £70,000 £70,000 £80,000
Median salary % change year-on-year - -12.50% +6.67%
10th Percentile £50,000 £47,500 £61,875
90th Percentile £111,250 £93,750 £135,000
England median annual salary £62,500 £65,000 £80,000
% change year-on-year -3.85% -18.75% +6.67%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,564 20,675 26,232
As % of all permanent IT jobs advertised in London 30.81% 30.14% 31.25%
Number of salaries quoted 17,678 17,975 22,857
London median annual salary £60,000 £60,000 £55,000
Median salary % change year-on-year - +9.09% -
10th Percentile £37,500 £35,000 £36,015
90th Percentile £92,500 £88,750 £85,000
England median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 22 April 2018.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 22 April 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +73 149 £70,000 - 11
West London - 23 £52,500 - 5
East London - 6 £110,000 - 1
South London - 2 £51,250 -
North London - 1 - -
Data Lake
England

For the 6 months to 22 April 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 339 (64.94%) Big Data
1 339 (64.94%) Analytics
2 305 (58.43%) SQL
3 253 (48.47%) Microsoft Azure
4 243 (46.55%) Business Intelligence
5 184 (35.25%) Microsoft
6 172 (32.95%) Apache Spark
7 170 (32.57%) Data Warehouse
8 166 (31.80%) Java
9 164 (31.42%) Python
10 163 (31.23%) Hadoop
11 162 (31.03%) Power BI
12 157 (30.08%) SQL Server
13 151 (28.93%) Agile Software Development
14 143 (27.39%) Finance
15 142 (27.20%) Machine Learning
16 141 (27.01%) Azure Data Factory
17 134 (25.67%) Tableau
18 131 (25.10%) Data Science
19 124 (23.75%) SQL Server Integration Services
20 123 (23.56%) ETL
21 121 (23.18%) Amazon AWS
22 119 (22.80%) Degree
23 108 (20.69%) C#
23 108 (20.69%) Azure SQL Database
24 104 (19.92%) Data Analytics
25 102 (19.54%) SQL Server Analysis Services
26 97 (18.58%) Data Governance
27 92 (17.62%) Data Modelling
28 82 (15.71%) Apache Hive

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 172 (32.95%) Apache Spark
2 15 (2.87%) Apache
2 15 (2.87%) Apache Solr
3 13 (2.49%) Apache Pig
4 5 (0.96%) SAS
4 5 (0.96%) SharePoint
5 4 (0.77%) Apache Airflow
6 2 (0.38%) BizTalk Server
6 2 (0.38%) Elasticsearch
7 1 (0.19%) Drupal
7 1 (0.19%) IBM Domino
7 1 (0.19%) Luigi
7 1 (0.19%) Tomcat
Applications
1 12 (2.30%) MS Visio
2 5 (0.96%) Microsoft Excel
Business Applications
1 5 (0.96%) Dynamics CRM
2 4 (0.77%) Adobe Campaign
3 1 (0.19%) Markit EDM
3 1 (0.19%) MetaTrader
3 1 (0.19%) Oracle AML
Cloud Services
1 253 (48.47%) Microsoft Azure
2 141 (27.01%) Azure Data Factory
3 121 (23.18%) Amazon AWS
4 79 (15.13%) Cortana Intelligence Suite
5 67 (12.84%) Serverless
6 46 (8.81%) IaaS
7 34 (6.51%) AWS Lambda
8 32 (6.13%) PaaS
9 29 (5.56%) Azure Machine Learning
10 20 (3.83%) Google Cloud Platform
11 18 (3.45%) SaaS
12 16 (3.07%) GitHub
13 15 (2.87%) Data Lake Analytics
14 14 (2.68%) Amazon S3
15 11 (2.11%) OpenShift
16 10 (1.92%) Amazon EMR
16 10 (1.92%) Datadog
17 8 (1.53%) Amazon Kinesis
18 7 (1.34%) Office 365
19 4 (0.77%) Amazon EC2
Communications & Networking
1 10 (1.92%) DNS
1 10 (1.92%) Firewall
1 10 (1.92%) HTTP
1 10 (1.92%) SMTP
1 10 (1.92%) TCP/IP
1 10 (1.92%) VPN
2 1 (0.19%) Internet
Database & Business Intelligence
1 339 (64.94%) Big Data
2 170 (32.57%) Data Warehouse
3 163 (31.23%) Hadoop
4 162 (31.03%) Power BI
5 157 (30.08%) SQL Server
6 124 (23.75%) SQL Server Integration Services
7 108 (20.69%) Azure SQL Database
8 102 (19.54%) SQL Server Analysis Services
9 82 (15.71%) Apache Hive
10 76 (14.56%) NoSQL
11 64 (12.26%) SQL Server Reporting Services
12 48 (9.20%) HBase
12 48 (9.20%) HDInsight
13 45 (8.62%) Cosmos DB
14 43 (8.24%) Sqoop
15 35 (6.70%) Azure SQL Data Warehouse
15 35 (6.70%) MySQL
16 29 (5.56%) Oracle ODI
17 23 (4.41%) Apache Cassandra
18 20 (3.83%) QlikView
Development Applications
1 56 (10.73%) Visual Studio
2 55 (10.54%) Git (software)
3 23 (4.41%) Jenkins
4 21 (4.02%) RStudio
5 15 (2.87%) Sonatype Nexus
6 10 (1.92%) Artifactory
6 10 (1.92%) GoCD
7 9 (1.72%) JIRA
7 9 (1.72%) Visual Studio Team System
8 8 (1.53%) GitLab
9 6 (1.15%) ERwin
10 4 (0.77%) SQL Server Management Studio (SSMS)
11 2 (0.38%) JUnit
11 2 (0.38%) Maven
11 2 (0.38%) Subversion
11 2 (0.38%) Team Foundation Server
12 1 (0.19%) Atlassian Bamboo
12 1 (0.19%) FitNesse
12 1 (0.19%) TeamCity
12 1 (0.19%) TestNG
General
1 143 (27.39%) Finance
2 49 (9.39%) Banking
3 44 (8.43%) Marketing
4 37 (7.09%) Advertising
5 32 (6.13%) Games
6 25 (4.79%) Retail
7 18 (3.45%) Publishing
8 9 (1.72%) Financial Institution
8 9 (1.72%) Investment Banking
9 6 (1.15%) Manufacturing
10 5 (0.96%) Billing
10 5 (0.96%) Law
11 4 (0.77%) Telecoms
12 3 (0.57%) Electronics
12 3 (0.57%) Front Office
13 1 (0.19%) Automotive
13 1 (0.19%) Back Office
13 1 (0.19%) Pharmaceutical
Job Titles
1 155 (29.69%) Developer
2 107 (20.50%) Architect
3 87 (16.67%) Consultant
4 76 (14.56%) Data Engineer
5 66 (12.64%) Business Intelligence Consultant
6 64 (12.26%) Data Architect
7 52 (9.96%) Azure Consultant
7 52 (9.96%) Power BI Consultant
8 46 (8.81%) Business Intelligence Developer
9 40 (7.66%) Big Data Developer
9 40 (7.66%) Microsoft BI Consultant
10 38 (7.28%) Azure Architect
11 34 (6.51%) Lead Architect
12 32 (6.13%) Java Developer
13 25 (4.79%) SQL Developer
14 24 (4.60%) Angular Developer
15 23 (4.41%) Scala Developer
15 23 (4.41%) SQL BI Developer
16 22 (4.21%) Data Scientist
17 19 (3.64%) C++ Developer
Libraries, Frameworks & Software Standards
1 73 (13.98%) Kafka
2 53 (10.15%) .NET
3 49 (9.39%) AngularJS
4 41 (7.85%) jQuery
5 20 (3.83%) RabbitMQ
6 17 (3.26%) HornetQ
6 17 (3.26%) JMS
6 17 (3.26%) Velocity
7 15 (2.87%) ASP.NET
7 15 (2.87%) Natural Language Processing
8 14 (2.68%) MDX
9 11 (2.11%) .NET Framework
9 11 (2.11%) Entity Framework
9 11 (2.11%) JSON
9 11 (2.11%) XML
10 10 (1.92%) Elastic Stack
10 10 (1.92%) LDAP
10 10 (1.92%) Sensu
11 9 (1.72%) ASP.NET MVC
12 8 (1.53%) HTML
Miscellaneous
1 72 (13.79%) Computer Science
2 37 (7.09%) Analytical Skills
3 34 (6.51%) Self-Motivation
4 33 (6.32%) Fintech
5 18 (3.45%) Data Structures
6 16 (3.07%) Enterprise Software
6 16 (3.07%) Public Cloud
7 15 (2.87%) Greenfield Project
8 12 (2.30%) Linux Command Line
9 11 (2.11%) Virtual Team
10 10 (1.92%) Fixed Income
11 7 (1.34%) Algorithms
11 7 (1.34%) Clustering
11 7 (1.34%) Cyberthreat
12 6 (1.15%) Equities
12 6 (1.15%) Hedge funds
12 6 (1.15%) Private Cloud
13 5 (0.96%) Foreign Exchange (FX)
13 5 (0.96%) Management Information System
14 3 (0.57%) FMCG
Operating Systems
1 34 (6.51%) Linux
2 20 (3.83%) Unix
Processes & Methodologies
1 339 (64.94%) Analytics
2 243 (46.55%) Business Intelligence
3 151 (28.93%) Agile Software Development
4 142 (27.20%) Machine Learning
5 131 (25.10%) Data Science
6 123 (23.56%) ETL
7 104 (19.92%) Data Analytics
8 97 (18.58%) Data Governance
9 92 (17.62%) Data Modelling
10 80 (15.33%) Visualisation
11 75 (14.37%) Presales
12 61 (11.69%) SOA
13 60 (11.49%) Mathematics
13 60 (11.49%) Migration
14 58 (11.11%) Problem-Solving
15 57 (10.92%) OO
16 50 (9.58%) OOP
17 49 (9.39%) Data Visualisation
17 49 (9.39%) Workflow
18 47 (9.00%) Mentoring
Programming Languages
1 305 (58.43%) SQL
2 166 (31.80%) Java
3 164 (31.42%) Python
4 108 (20.69%) C#
5 82 (15.71%) Scala
6 54 (10.34%) R
7 46 (8.81%) T-SQL
8 40 (7.66%) U-SQL
9 36 (6.90%) Data Analysis Expressions (DAX)
10 32 (6.13%) C++
11 28 (5.36%) Java 8
12 26 (4.98%) JavaScript
13 14 (2.68%) Perl
13 14 (2.68%) Shell Script
14 11 (2.11%) PowerShell
14 11 (2.11%) Ruby
15 10 (1.92%) Go
16 8 (1.53%) C
17 4 (0.77%) MATLAB
17 4 (0.77%) VB.NET
Qualifications
1 119 (22.80%) Degree
2 63 (12.07%) Computer Science Degree
3 55 (10.54%) Master's Degree
4 8 (1.53%) Security Cleared
5 5 (0.96%) PhD
6 4 (0.77%) APMP
6 4 (0.77%) AWS Certification
6 4 (0.77%) SC Cleared
7 2 (0.38%) ISTQB
7 2 (0.38%) Numerate Degree
8 1 (0.19%) Microsoft Certification
Quality Assurance & Compliance
1 32 (6.13%) Data Quality
2 20 (3.83%) QA
3 10 (1.92%) GDPR
4 5 (0.96%) Actionable Recommendations
5 4 (0.77%) PMO
6 2 (0.38%) GCP
7 1 (0.19%) HIPAA
7 1 (0.19%) Sarbanes-Oxley
7 1 (0.19%) SLA
System Software
1 53 (10.15%) HDFS
2 37 (7.09%) Virtual Machines
3 31 (5.94%) Docker
4 13 (2.49%) Apache ZooKeeper
5 6 (1.15%) Apache Flume
6 2 (0.38%) Active Directory
Systems Management
1 28 (5.36%) Kubernetes
2 15 (2.87%) Oozie
3 13 (2.49%) Ambari
4 12 (2.30%) Opscode Chef
5 11 (2.11%) Ansible
5 11 (2.11%) Terraform
6 10 (1.92%) Consul
6 10 (1.92%) Salt
7 8 (1.53%) Hadoop YARN
8 2 (0.38%) Mesos
8 2 (0.38%) Rundeck
9 1 (0.19%) Puppet
Vendors
1 184 (35.25%) Microsoft
2 134 (25.67%) Tableau
3 80 (15.33%) Oracle
4 54 (10.34%) Google
5 51 (9.77%) Talend
6 38 (7.28%) Cloudera
7 36 (6.90%) Informatica
8 31 (5.94%) WorldPay
9 24 (4.60%) Alteryx
10 21 (4.02%) IBM
11 17 (3.26%) EXASOL
11 17 (3.26%) Netezza
11 17 (3.26%) SnapLogic
11 17 (3.26%) Sybase
12 16 (3.07%) Cognizant
12 16 (3.07%) Salesforce.com
13 15 (2.87%) Cognos
14 14 (2.68%) Hortonworks
15 10 (1.92%) New Relic
16 9 (1.72%) Twitter