Period
to 29 May 2020

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 29 May 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
Central London > City of London
6 months to
29 May 2020
Same period 2019 Same period 2018
Rank 181 208 198
Rank change year-on-year +27 -10 +109
Permanent jobs citing Data Lake 79 127 160
As % of all permanent jobs advertised in the City of London 1.16% 1.26% 1.51%
As % of the Database & Business Intelligence category 4.88% 4.08% 4.80%
Number of salaries quoted 67 120 178
Median annual salary £65,000 £70,000 £70,000
Median salary % change year-on-year -7.14% - -
10th Percentile £57,500 £46,250 £53,750
90th Percentile £80,250 £92,525 £90,750
Central London median annual salary £67,500 £72,500 £70,000
% change year-on-year -6.90% +3.57% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,618 3,114 3,334
As % of all permanent IT jobs advertised in the City of London 23.81% 30.91% 31.39%
Number of salaries quoted 1,403 2,820 2,980
Median annual salary £67,500 £67,500 £62,501
Median salary % change year-on-year - +8.00% +4.17%
10th Percentile £42,500 £41,250 £41,250
90th Percentile £100,000 £97,500 £90,000
Central London median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% +4.17%

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Data Lake in the City of London.

Salary trend for Data Lake in the City of London

Data Lake
Salary Histogram in the City of London

Salary distribution for jobs citing Data Lake in the City of London over the 6 months to 29 May 2020.

Salary histogram for Data Lake in the City of London

For the 6 months to 29 May 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Data Lake.

1 64 (81.01%) SQL
2 58 (73.42%) Data Warehouse
3 57 (72.15%) Agile Software Development
4 53 (67.09%) Business Intelligence
5 37 (46.84%) SQL Server
5 37 (46.84%) Power BI
5 37 (46.84%) Power Platform
6 35 (44.30%) Data Modelling
7 30 (37.97%) Microsoft
7 30 (37.97%) SQL Server Reporting Services
7 30 (37.97%) Finance
7 30 (37.97%) SQL Server Integration Services
7 30 (37.97%) Big Data
8 28 (35.44%) Azure
9 27 (34.18%) Visualisation
10 26 (32.91%) Management Information System
11 22 (27.85%) T-SQL
12 21 (26.58%) Insurtech
13 20 (25.32%) Data Visualisation
14 19 (24.05%) Analytics
14 19 (24.05%) ETL
15 18 (22.78%) SQL Server Analysis Services
16 16 (20.25%) Requirements Engineering
16 16 (20.25%) User Stories
16 16 (20.25%) Backlog Management
16 16 (20.25%) Product Backlog
16 16 (20.25%) Requirements Gathering
16 16 (20.25%) Dashboard Development
16 16 (20.25%) Prototyping
16 16 (20.25%) Data Ingestion

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 8 (10.13%) Apache Spark
2 4 (5.06%) Apache Airflow
3 3 (3.80%) Luigi
4 1 (1.27%) Apache
Cloud Services
1 37 (46.84%) Power Platform
2 28 (35.44%) Azure
3 14 (17.72%) Azure Data Factory
4 13 (16.46%) AWS
5 8 (10.13%) IaaS
5 8 (10.13%) PaaS
6 7 (8.86%) GCP
7 5 (6.33%) Amazon EMR
8 3 (3.80%) Amazon S3
8 3 (3.80%) Data Lake Analytics
8 3 (3.80%) Serverless
9 2 (2.53%) Amazon CloudWatch
9 2 (2.53%) Amazon GuardDuty
9 2 (2.53%) AWS CloudTrail
10 1 (1.27%) Amazon Kinesis
10 1 (1.27%) Azure Active Directory
10 1 (1.27%) Azure Functions
10 1 (1.27%) Logic Apps
Database & Business Intelligence
1 58 (73.42%) Data Warehouse
2 37 (46.84%) Power BI
2 37 (46.84%) SQL Server
3 30 (37.97%) Big Data
3 30 (37.97%) SQL Server Integration Services
3 30 (37.97%) SQL Server Reporting Services
4 18 (22.78%) SQL Server Analysis Services
5 15 (18.99%) Azure SQL Database
6 11 (13.92%) Microsoft Analysis Services
7 7 (8.86%) Azure SQL Data Warehouse
7 7 (8.86%) Data Mining
7 7 (8.86%) Relational Database
8 5 (6.33%) MongoDB
8 5 (6.33%) SQL Server 2012
8 5 (6.33%) SQL Server 2016
8 5 (6.33%) SQL Server 2017
9 4 (5.06%) Hadoop
10 3 (3.80%) Amazon DynamoDB
10 3 (3.80%) Apache Hive
10 3 (3.80%) Impala
Development Applications
1 3 (3.80%) Visual Studio
General
1 30 (37.97%) Finance
2 6 (7.59%) Marketing
3 2 (2.53%) Advertising
3 2 (2.53%) Banking
4 1 (1.27%) Investment Banking
4 1 (1.27%) Law
4 1 (1.27%) Legal
4 1 (1.27%) Public Sector
4 1 (1.27%) Retail
Job Titles
1 29 (36.71%) Developer
2 20 (25.32%) SQL Developer
3 17 (21.52%) Analyst
3 17 (21.52%) Data Warehouse Developer
4 16 (20.25%) Business Analyst
4 16 (20.25%) Technical Analyst
4 16 (20.25%) Technical Business Analyst
5 15 (18.99%) Business Intelligence Developer
5 15 (18.99%) SSIS Developer
5 15 (18.99%) SSRS Developer
6 13 (16.46%) SQL BI Developer
7 12 (15.19%) Data Engineer
8 11 (13.92%) Business Intelligence Analyst
9 10 (12.66%) Business Intelligence Business Analyst
9 10 (12.66%) Data Business Analyst
10 8 (10.13%) Administrator
10 8 (10.13%) DBA
10 8 (10.13%) SQL DBA
11 6 (7.59%) Cloud Technical Analyst
11 6 (7.59%) Data Warehouse Analyst
Libraries, Frameworks & Software Standards
1 6 (7.59%) Kafka
2 4 (5.06%) .NET
3 2 (2.53%) MDX
4 1 (1.27%) D3.js
4 1 (1.27%) Matplotlib
4 1 (1.27%) NumPy
4 1 (1.27%) Pandas
4 1 (1.27%) React
4 1 (1.27%) REST
4 1 (1.27%) Web Services
Miscellaneous
1 26 (32.91%) Management Information System
2 6 (7.59%) Greenfield Project
3 2 (2.53%) Analytical Mindset
3 2 (2.53%) Analytical Skills
3 2 (2.53%) Cloud Native
3 2 (2.53%) Reinsurance
4 1 (1.27%) Digital Media
4 1 (1.27%) Marketing Technology
4 1 (1.27%) Reference Data
4 1 (1.27%) Self-Motivation
4 1 (1.27%) Virtual Team
Operating Systems
1 8 (10.13%) Windows
1 8 (10.13%) Windows Server
Processes & Methodologies
1 57 (72.15%) Agile Software Development
2 53 (67.09%) Business Intelligence
3 35 (44.30%) Data Modelling
4 27 (34.18%) Visualisation
5 21 (26.58%) Insurtech
6 20 (25.32%) Data Visualisation
7 19 (24.05%) Analytics
7 19 (24.05%) ETL
8 16 (20.25%) Backlog Management
8 16 (20.25%) Dashboard Development
8 16 (20.25%) Data Ingestion
8 16 (20.25%) Product Backlog
8 16 (20.25%) Prototyping
8 16 (20.25%) Requirements Engineering
8 16 (20.25%) Requirements Gathering
8 16 (20.25%) User Stories
9 12 (15.19%) Continuous Integration
9 12 (15.19%) Data Analytics
9 12 (15.19%) Data Strategy
9 12 (15.19%) Test Automation
Programming Languages
1 64 (81.01%) SQL
2 22 (27.85%) T-SQL
3 10 (12.66%) Python
4 7 (8.86%) Scala
5 4 (5.06%) C#
5 4 (5.06%) Go
6 3 (3.80%) R
7 2 (2.53%) Data Analysis Expressions (DAX)
7 2 (2.53%) PowerShell
8 1 (1.27%) Java
8 1 (1.27%) JavaScript
8 1 (1.27%) Julia
8 1 (1.27%) PHP
Quality Assurance & Compliance
1 5 (6.33%) Data Quality
2 1 (1.27%) GDPR
System Software
1 5 (6.33%) Docker
2 1 (1.27%) Active Directory
2 1 (1.27%) Virtual Machines
Systems Management
1 10 (12.66%) Kubernetes
2 3 (3.80%) Argo
2 3 (3.80%) Oozie
3 1 (1.27%) Grafana
3 1 (1.27%) Kibana
3 1 (1.27%) Prometheus
3 1 (1.27%) Terraform
Vendors
1 30 (37.97%) Microsoft
2 7 (8.86%) Google
3 3 (3.80%) Databricks
3 3 (3.80%) Tableau
4 2 (2.53%) Oracle
5 1 (1.27%) Adobe
5 1 (1.27%) Alteryx
5 1 (1.27%) Salesforce.com
5 1 (1.27%) SAP