Period
to 27 September 2020

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 27 September 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
Central London > City of London
6 months to
27 Sep 2020
Same period 2019 Same period 2018
Rank 133 201 234
Rank change year-on-year +68 +33 +70
Permanent jobs citing Data Lake 64 132 121
As % of all permanent jobs advertised in the City of London 1.73% 1.30% 1.10%
As % of the Database & Business Intelligence category 6.37% 4.24% 3.55%
Number of salaries quoted 57 120 117
Median annual salary £72,500 £77,500 £70,000
Median salary % change year-on-year -6.45% +10.71% +10.24%
10th Percentile £55,000 £43,750 £50,750
90th Percentile £96,500 £105,000 £93,500
Central London median annual salary £72,500 £73,750 £65,000
% change year-on-year -1.69% +13.46% -9.25%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,004 3,115 3,411
As % of all permanent IT jobs advertised in the City of London 27.14% 30.79% 30.95%
Number of salaries quoted 833 2,806 3,091
Median annual salary £70,000 £67,500 £65,000
Median salary % change year-on-year +3.70% +3.85% +8.33%
10th Percentile £42,500 £43,750 £40,000
90th Percentile £100,000 £98,750 £95,000
Central London median annual salary £70,000 £65,000 £65,000
% change year-on-year +7.69% - +8.33%

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Data Lake in the City of London.

Salary trend for Data Lake in the City of London

Data Lake
Salary Histogram in the City of London

Salary distribution for jobs citing Data Lake in the City of London over the 6 months to 27 September 2020.

Salary histogram for Data Lake in the City of London

For the 6 months to 27 September 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Data Lake.

1 46 (71.88%) Business Intelligence
2 43 (67.19%) Data Warehouse
3 40 (62.50%) SQL
4 39 (60.94%) Azure
5 38 (59.38%) Agile Software Development
6 28 (43.75%) Databricks
7 26 (40.63%) SQL Server
8 25 (39.06%) Finance
9 22 (34.38%) Analytics
10 21 (32.81%) Azure Data Factory
11 20 (31.25%) Power Platform
11 20 (31.25%) Big Data
11 20 (31.25%) Data Modelling
12 18 (28.13%) SQL Server Integration Services
12 18 (28.13%) ETL
12 18 (28.13%) DevOps
12 18 (28.13%) Power BI
13 17 (26.56%) Azure SQL Database
14 16 (25.00%) Python
14 16 (25.00%) Microsoft
14 16 (25.00%) SQL Server Reporting Services
14 16 (25.00%) Azure SQL Data Warehouse
15 15 (23.44%) SQL Server Analysis Services
16 13 (20.31%) Visualisation
16 13 (20.31%) Data Analytics
17 12 (18.75%) Data Visualisation
17 12 (18.75%) Data Ingestion
17 12 (18.75%) Insurtech
18 11 (17.19%) Management Information System
19 9 (14.06%) Continuous Integration

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 8 (12.50%) Apache Spark
2 2 (3.13%) Apache
2 2 (3.13%) Apache Airflow
2 2 (3.13%) SharePoint
3 1 (1.56%) Apache Synapse
3 1 (1.56%) Luigi
Cloud Services
1 39 (60.94%) Azure
2 21 (32.81%) Azure Data Factory
3 20 (31.25%) Power Platform
4 9 (14.06%) SaaS
5 6 (9.38%) AWS
6 4 (6.25%) Amazon Kinesis
6 4 (6.25%) Amazon S3
7 3 (4.69%) Amazon EMR
7 3 (4.69%) PaaS
8 2 (3.13%) Amazon ElastiCache
8 2 (3.13%) Amazon SQS
8 2 (3.13%) Azure Active Directory
8 2 (3.13%) Dynamics 365
8 2 (3.13%) Logic Apps
9 1 (1.56%) Amazon CloudWatch
9 1 (1.56%) Amazon GuardDuty
9 1 (1.56%) AWS CloudTrail
9 1 (1.56%) AWS Lambda
9 1 (1.56%) GCP
9 1 (1.56%) Serverless
Database & Business Intelligence
1 43 (67.19%) Data Warehouse
2 26 (40.63%) SQL Server
3 20 (31.25%) Big Data
4 18 (28.13%) Power BI
4 18 (28.13%) SQL Server Integration Services
5 17 (26.56%) Azure SQL Database
6 16 (25.00%) Azure SQL Data Warehouse
6 16 (25.00%) SQL Server Reporting Services
7 15 (23.44%) SQL Server Analysis Services
8 6 (9.38%) Data Mining
8 6 (9.38%) Microsoft Analysis Services
9 5 (7.81%) Apache Hive
9 5 (7.81%) Hadoop
10 4 (6.25%) HBase
10 4 (6.25%) OLAP
10 4 (6.25%) Parquet
10 4 (6.25%) Presto
10 4 (6.25%) Sqoop
11 3 (4.69%) Amazon Redshift
11 3 (4.69%) HDInsight
Development Applications
1 6 (9.38%) Git (software)
2 2 (3.13%) Artifactory
2 2 (3.13%) JUnit
2 2 (3.13%) Selenium
2 2 (3.13%) SonarQube
2 2 (3.13%) Subversion
2 2 (3.13%) Team Foundation Server
2 2 (3.13%) Visual Studio Team System
3 1 (1.56%) Atlassian Bamboo
3 1 (1.56%) Octopus Deploy
3 1 (1.56%) TeamCity
3 1 (1.56%) Visual Studio
General
1 25 (39.06%) Finance
2 5 (7.81%) Front Office
2 5 (7.81%) Retail
3 3 (4.69%) Banking
4 2 (3.13%) Investment Banking
5 1 (1.56%) Marketing
5 1 (1.56%) Pharmaceutical
Job Titles
1 32 (50.00%) Developer
2 20 (31.25%) Business Intelligence Developer
3 18 (28.13%) Azure Developer
4 10 (15.63%) Lead Developer
5 9 (14.06%) Architect
6 8 (12.50%) Azure Engineer
6 8 (12.50%) Business Intelligence Lead
7 7 (10.94%) Analyst
7 7 (10.94%) Business Analyst
7 7 (10.94%) Data Engineer
7 7 (10.94%) SQL Developer
7 7 (10.94%) Technical Analyst
7 7 (10.94%) Technical Business Analyst
8 6 (9.38%) Cloud Technical Analyst
8 6 (9.38%) Data Warehouse Analyst
8 6 (9.38%) Data Warehouse Business Analyst
9 5 (7.81%) Data Warehouse Developer
9 5 (7.81%) SaaS Architect
9 5 (7.81%) Senior Business Intelligence Developer
9 5 (7.81%) Senior Developer
Libraries, Frameworks & Software Standards
1 7 (10.94%) .NET
2 5 (7.81%) MDX
3 4 (6.25%) .NET Core
3 4 (6.25%) .NET Framework
3 4 (6.25%) AngularJS
3 4 (6.25%) ASP.NET Web API
3 4 (6.25%) Entity Framework
3 4 (6.25%) Kafka
3 4 (6.25%) Node.js
4 2 (3.13%) Ajax
4 2 (3.13%) CSS
4 2 (3.13%) HTML
4 2 (3.13%) HTML5
4 2 (3.13%) jQuery
4 2 (3.13%) JSON
4 2 (3.13%) React
4 2 (3.13%) Twitter Bootstrap
4 2 (3.13%) WebRTC
4 2 (3.13%) XML
5 1 (1.56%) NumPy
Miscellaneous
1 11 (17.19%) Management Information System
2 2 (3.13%) Enterprise Software
2 2 (3.13%) Greenfield Project
3 1 (1.56%) Analytical Skills
3 1 (1.56%) Cloud Native
3 1 (1.56%) Data Centre
3 1 (1.56%) Equities
3 1 (1.56%) Private Cloud
3 1 (1.56%) Reference Data
3 1 (1.56%) Virtual Team
Operating Systems
1 2 (3.13%) Linux
1 2 (3.13%) Windows
Processes & Methodologies
1 46 (71.88%) Business Intelligence
2 38 (59.38%) Agile Software Development
3 22 (34.38%) Analytics
4 20 (31.25%) Data Modelling
5 18 (28.13%) DevOps
5 18 (28.13%) ETL
6 13 (20.31%) Data Analytics
6 13 (20.31%) Visualisation
7 12 (18.75%) Data Ingestion
7 12 (18.75%) Data Visualisation
7 12 (18.75%) Insurtech
8 9 (14.06%) Continuous Integration
8 9 (14.06%) Data Science
8 9 (14.06%) SDLC
9 8 (12.50%) Test Automation
10 7 (10.94%) Dashboard Development
10 7 (10.94%) Problem-Solving
10 7 (10.94%) Prototyping
10 7 (10.94%) Requirements Engineering
10 7 (10.94%) User Stories
Programming Languages
1 40 (62.50%) SQL
2 16 (25.00%) Python
3 7 (10.94%) C#
3 7 (10.94%) JavaScript
3 7 (10.94%) T-SQL
4 6 (9.38%) R
5 5 (7.81%) Data Analysis Expressions (DAX)
6 4 (6.25%) Java
7 2 (3.13%) Bash Shell
7 2 (3.13%) PowerShell
7 2 (3.13%) Scala
8 1 (1.56%) Go
8 1 (1.56%) Julia
Qualifications
1 3 (4.69%) Computer Science Degree
1 3 (4.69%) Degree
2 1 (1.56%) AWS Certification
Quality Assurance & Compliance
1 3 (4.69%) Data Quality
System Software
1 6 (9.38%) Docker
Systems Management
1 8 (12.50%) Kubernetes
2 2 (3.13%) Nagios
3 1 (1.56%) Argo
3 1 (1.56%) Oozie
Vendors
1 28 (43.75%) Databricks
2 16 (25.00%) Microsoft
3 6 (9.38%) Tableau
4 3 (4.69%) Ab Initio
5 1 (1.56%) Google
5 1 (1.56%) Sparx
5 1 (1.56%) Talend