Period
to 23 October 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 23 October 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
23 Oct 2019
Same period 2018 Same period 2017
Rank 360 411 705
Rank change year-on-year +51 +294 +109
Permanent jobs citing Data Lake 439 486 150
As % of all permanent IT jobs advertised in London 0.81% 0.71% 0.20%
As % of the Database & Business Intelligence category 2.84% 2.32% 0.68%
Number of salaries quoted 381 338 119
London median annual salary £75,000 £67,500 £70,000
Median salary % change year-on-year +11.11% -3.57% -26.32%
10th Percentile £43,750 £46,250 £47,500
90th Percentile £101,250 £101,625 £106,000
England median annual salary £65,000 £65,000 £60,000
% change year-on-year - +8.33% -29.41%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 15,474 20,933 22,108
As % of all permanent IT jobs advertised in London 28.38% 30.76% 29.62%
Number of salaries quoted 12,812 16,684 17,694
London median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% +4.35%
10th Percentile £38,000 £37,500 £36,250
90th Percentile £98,750 £95,000 £89,700
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +5.26%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 23 October 2019.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 23 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +32 126 £77,500 +19.23% 26
West London +20 9 £60,000 +33.33% 5
East London +32 6 £40,000 -46.67% 4
North London +3 4 £75,000 +7.14%
Data Lake
England

For the 6 months to 23 October 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 313 (71.30%) Azure
2 304 (69.25%) SQL
3 281 (64.01%) Data Warehouse
4 261 (59.45%) Analytics
5 252 (57.40%) Business Intelligence
6 194 (44.19%) Microsoft
7 184 (41.91%) SQL Server
7 184 (41.91%) Power BI
7 184 (41.91%) Power Platform
8 168 (38.27%) Big Data
9 154 (35.08%) Azure Data Factory
10 149 (33.94%) Finance
11 146 (33.26%) Python
12 144 (32.80%) Data Modelling
12 144 (32.80%) ETL
13 142 (32.35%) Azure SQL Database
14 138 (31.44%) Agile Software Development
15 136 (30.98%) SQL Server Analysis Services
16 126 (28.70%) Databricks
17 125 (28.47%) SQL Server Integration Services
18 116 (26.42%) Data Science
19 104 (23.69%) DevOps
20 97 (22.10%) SQL Server Reporting Services
21 91 (20.73%) Data Analytics
22 82 (18.68%) AWS
23 81 (18.45%) Machine Learning
24 78 (17.77%) Hadoop
24 78 (17.77%) Data Analysis Expressions (DAX)
24 78 (17.77%) Microsoft Analysis Services
24 78 (17.77%) Azure SQL Data Warehouse

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 55 (12.53%) Apache Spark
2 13 (2.96%) Apache
2 13 (2.96%) IIS
3 9 (2.05%) Apache Airflow
3 9 (2.05%) SAS
4 8 (1.82%) Anypoint
5 7 (1.59%) Apache Pig
5 7 (1.59%) ArcGIS
6 4 (0.91%) Apache Solr
7 3 (0.68%) Elasticsearch
8 2 (0.46%) BizTalk Server
8 2 (0.46%) Jupyter
9 1 (0.23%) SharePoint
Applications
1 10 (2.28%) Microsoft Office
2 6 (1.37%) Microsoft Excel
Business Applications
1 2 (0.46%) Markit EDM
2 1 (0.23%) Dynamics CRM
Cloud Services
1 313 (71.30%) Azure
2 184 (41.91%) Power Platform
3 154 (35.08%) Azure Data Factory
4 82 (18.68%) AWS
5 38 (8.66%) GCP
6 33 (7.52%) Data Lake Analytics
7 32 (7.29%) PaaS
8 30 (6.83%) Serverless
9 23 (5.24%) Azure Active Directory
10 22 (5.01%) Azure Machine Learning
11 20 (4.56%) Azure Functions
12 19 (4.33%) Amazon S3
13 18 (4.10%) Amazon Kinesis
14 16 (3.64%) Amazon EMR
15 13 (2.96%) SaaS
16 11 (2.51%) IaaS
16 11 (2.51%) PowerApps
17 7 (1.59%) GitHub
17 7 (1.59%) Office 365
18 6 (1.37%) Cloud Computing
Communications & Networking
1 1 (0.23%) Broadband
Database & Business Intelligence
1 281 (64.01%) Data Warehouse
2 184 (41.91%) Power BI
2 184 (41.91%) SQL Server
3 168 (38.27%) Big Data
4 142 (32.35%) Azure SQL Database
5 136 (30.98%) SQL Server Analysis Services
6 125 (28.47%) SQL Server Integration Services
7 97 (22.10%) SQL Server Reporting Services
8 78 (17.77%) Azure SQL Data Warehouse
8 78 (17.77%) Hadoop
8 78 (17.77%) Microsoft Analysis Services
9 76 (17.31%) NoSQL
10 45 (10.25%) Cosmos DB
11 44 (10.02%) Amazon Redshift
12 36 (8.20%) Apache Hive
13 28 (6.38%) OLAP
14 22 (5.01%) Relational Database
15 21 (4.78%) MongoDB
15 21 (4.78%) Snowflake Schema
15 21 (4.78%) SQL Server 2016
Development Applications
1 39 (8.88%) Git (software)
2 15 (3.42%) Visual Studio
3 11 (2.51%) Visual Studio Team System
4 10 (2.28%) Subversion
5 9 (2.05%) JIRA
6 8 (1.82%) Jenkins
7 7 (1.59%) ER Studio
7 7 (1.59%) ERwin
7 7 (1.59%) PowerDesigner
8 3 (0.68%) Hudson
8 3 (0.68%) Octopus Deploy
9 2 (0.46%) Cucumber
9 2 (0.46%) GitLab
9 2 (0.46%) Mocha
9 2 (0.46%) NUnit
9 2 (0.46%) Selenium
9 2 (0.46%) Spock
9 2 (0.46%) SQL Server Management Studio (SSMS)
9 2 (0.46%) Team Foundation Server
10 1 (0.23%) Maven
General
1 149 (33.94%) Finance
2 37 (8.43%) Banking
3 21 (4.78%) Retail
4 12 (2.73%) Marketing
5 8 (1.82%) Advertising
6 7 (1.59%) Public Sector
7 6 (1.37%) Games
7 6 (1.37%) Telecoms
8 5 (1.14%) Legal
8 5 (1.14%) Publishing
9 4 (0.91%) Automotive
9 4 (0.91%) Investment Banking
10 3 (0.68%) Front Office
11 2 (0.46%) Financial Institution
12 1 (0.23%) Back Office
12 1 (0.23%) General Ledger
12 1 (0.23%) Law
Job Titles
1 140 (31.89%) Developer
2 97 (22.10%) Architect
3 75 (17.08%) Data Engineer
4 72 (16.40%) Business Intelligence Developer
5 62 (14.12%) SQL Developer
6 51 (11.62%) Data Architect
7 48 (10.93%) Azure Developer
8 43 (9.79%) Senior Developer
9 41 (9.34%) Database Developer
9 41 (9.34%) SQL Database Developer
10 39 (8.88%) SQL BI Developer
11 38 (8.66%) Business Intelligence Lead
12 36 (8.20%) Analyst
12 36 (8.20%) SQL Server Developer
13 30 (6.83%) Cloud Architect
14 27 (6.15%) Azure Engineer
14 27 (6.15%) Power BI Developer
15 26 (5.92%) Lead Developer
16 25 (5.69%) Consultant
17 23 (5.24%) Data Analyst
Libraries, Frameworks & Software Standards
1 68 (15.49%) MDX
2 23 (5.24%) Kafka
3 19 (4.33%) .NET
4 18 (4.10%) Web Services
5 16 (3.64%) JSON
6 14 (3.19%) HTML
7 13 (2.96%) Lambda Expressions
8 12 (2.73%) XML
9 11 (2.51%) Node.js
10 9 (2.05%) Natural Language Processing
11 8 (1.82%) REST
12 7 (1.59%) D3.js
12 7 (1.59%) Leaflet
13 6 (1.37%) AngularJS
13 6 (1.37%) ASP.NET
13 6 (1.37%) Spring
14 5 (1.14%) .NET Core
14 5 (1.14%) Entity Framework
14 5 (1.14%) NumPy
14 5 (1.14%) Pandas
Miscellaneous
1 40 (9.11%) Analytical Skills
2 34 (7.74%) Management Information System
3 26 (5.92%) Algorithms
4 16 (3.64%) Greenfield Project
5 10 (2.28%) Clustering
6 8 (1.82%) User Experience
7 6 (1.37%) Analytical Mindset
7 6 (1.37%) Cloud Native
7 6 (1.37%) Private Cloud
7 6 (1.37%) Public Cloud
8 5 (1.14%) Data Centre
8 5 (1.14%) Online Games
8 5 (1.14%) Self-Motivation
9 4 (0.91%) Data Structures
9 4 (0.91%) Derivative
10 3 (0.68%) Equities
10 3 (0.68%) Fixed Income
10 3 (0.68%) Hybrid Cloud
11 2 (0.46%) Reinsurance
11 2 (0.46%) Replication
Operating Systems
1 26 (5.92%) Windows
2 20 (4.56%) Windows Server
3 13 (2.96%) Unix
4 11 (2.51%) Linux
5 10 (2.28%) Windows 10
6 5 (1.14%) Windows 7
7 4 (0.91%) Red Hat Enterprise Linux
Processes & Methodologies
1 261 (59.45%) Analytics
2 252 (57.40%) Business Intelligence
3 144 (32.80%) Data Modelling
3 144 (32.80%) ETL
4 138 (31.44%) Agile Software Development
5 116 (26.42%) Data Science
6 104 (23.69%) DevOps
7 91 (20.73%) Data Analytics
8 81 (18.45%) Machine Learning
9 74 (16.86%) Problem-Solving
10 56 (12.76%) Kimball Methodology
11 54 (12.30%) Visualisation
12 53 (12.07%) Migration
13 52 (11.85%) Data Architecture
14 50 (11.39%) Computer Science
14 50 (11.39%) Data Engineering
15 47 (10.71%) Scrum
16 40 (9.11%) Data Ingestion
16 40 (9.11%) Data Integration
16 40 (9.11%) Stakeholder Management
Programming Languages
1 304 (69.25%) SQL
2 146 (33.26%) Python
3 78 (17.77%) Data Analysis Expressions (DAX)
4 59 (13.44%) T-SQL
5 53 (12.07%) R
6 36 (8.20%) Java
7 28 (6.38%) C#
8 23 (5.24%) Scala
9 21 (4.78%) JavaScript
10 18 (4.10%) PL/SQL
11 14 (3.19%) PowerShell
12 12 (2.73%) U-SQL
13 6 (1.37%) MATLAB
14 5 (1.14%) Ruby
15 4 (0.91%) Bash Shell
15 4 (0.91%) Go
16 3 (0.68%) C
16 3 (0.68%) C++
16 3 (0.68%) PHP
17 2 (0.46%) VBScript
Qualifications
1 69 (15.72%) Degree
2 31 (7.06%) Computer Science Degree
3 15 (3.42%) Microsoft Certification
4 12 (2.73%) TOGAF Certification
5 7 (1.59%) MCSA
6 6 (1.37%) MBA
7 5 (1.14%) (ISC)2 CCSP
7 5 (1.14%) CCSP
7 5 (1.14%) Cisco Certification
7 5 (1.14%) CISSP
7 5 (1.14%) CompTIA Security+
7 5 (1.14%) MCSE
7 5 (1.14%) PhD
8 3 (0.68%) AWS Certification
9 2 (0.46%) DBS Check
10 1 (0.23%) APMP
10 1 (0.23%) DV Cleared
10 1 (0.23%) Numerate Degree
10 1 (0.23%) SC Cleared
10 1 (0.23%) Security Cleared
Quality Assurance & Compliance
1 18 (4.10%) Data Quality
2 9 (2.05%) QA
3 7 (1.59%) GDPR
4 2 (0.46%) HIPAA
5 1 (0.23%) PCI DSS
System Software
1 22 (5.01%) Docker
2 21 (4.78%) Active Directory
3 19 (4.33%) HDFS
4 10 (2.28%) Hyper-V
5 9 (2.05%) Virtual Machines
6 7 (1.59%) VMware Infrastructure
7 3 (0.68%) Apache Flume
8 2 (0.46%) XenApp
9 1 (0.23%) Apache ZooKeeper
Systems Management
1 20 (4.56%) Kubernetes
2 15 (3.42%) Hadoop YARN
3 5 (1.14%) Microsoft Intune
3 5 (1.14%) Single Sign-On
4 2 (0.46%) Ansible
4 2 (0.46%) Oozie
5 1 (0.23%) Docker Swarm
5 1 (0.23%) Opscode Chef
5 1 (0.23%) Puppet
5 1 (0.23%) Terraform
Vendors
1 194 (44.19%) Microsoft
2 126 (28.70%) Databricks
3 29 (6.61%) Tableau
4 23 (5.24%) Google
5 22 (5.01%) Oracle
6 20 (4.56%) MuleSoft
7 12 (2.73%) Cloudera
8 10 (2.28%) VMware
9 8 (1.82%) Netezza
9 8 (1.82%) Teradata
10 7 (1.59%) Mapbox
10 7 (1.59%) MicroStrategy
11 6 (1.37%) Informatica
11 6 (1.37%) Sybase
12 5 (1.14%) Atlassian
12 5 (1.14%) Salesforce.com
13 4 (0.91%) Red Hat
13 4 (0.91%) Talend
14 3 (0.68%) Hortonworks
14 3 (0.68%) SAP