Period
to 31 July 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 31 July 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
Central London > City of London
6 months to
31 Jul 2021
Same period 2020 Same period 2019
Rank 140 153 189
Rank change year-on-year +13 +36 +22
Permanent jobs citing Data Lake 108 75 152
As % of all permanent jobs advertised in the City of London 1.92% 1.43% 1.49%
As % of the Database & Business Intelligence category 6.65% 5.96% 4.64%
Number of salaries quoted 103 65 143
10th Percentile £52,500 £57,500 £46,250
25th Percentile £70,500 £61,250 £55,250
Median annual salary (50th Percentile) £82,500 £65,000 £70,000
Median % change year-on-year +26.92% -7.14% +3.70%
75th Percentile £96,250 £78,750 £87,500
90th Percentile £110,000 £82,500 £105,000
Central London median annual salary £82,500 £67,500 £72,500
% change year-on-year +22.22% -6.90% +11.54%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,624 1,259 3,273
As % of all permanent IT jobs advertised in the City of London 28.84% 23.96% 31.99%
Number of salaries quoted 1,438 1,084 2,954
10th Percentile £45,000 £42,500 £42,500
25th Percentile £53,750 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £92,500 £85,000 £85,000
90th Percentile £108,400 £96,250 £99,625
Central London median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Data Lake in the City of London.

Salary trend for Data Lake in the City of London

Data Lake
Salary Histogram in the City of London

Salary distribution for jobs citing Data Lake in the City of London over the 6 months to 31 July 2021.

Salary histogram for Data Lake in the City of London

Data Lake
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the City of London region over the 6 months to 31 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 1 £80,000 -
Data Lake
Central London

For the 6 months to 31 July 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Data Lake.

1 75 (69.44%) Data Warehouse
2 70 (64.81%) Azure
3 64 (59.26%) Analytics
4 50 (46.30%) Business Intelligence
5 49 (45.37%) ETL
5 49 (45.37%) SQL
6 44 (40.74%) Data Modelling
7 42 (38.89%) AWS
8 39 (36.11%) Python
9 38 (35.19%) Data Engineering
9 38 (35.19%) Databricks
10 32 (29.63%) Azure Data Factory
10 32 (29.63%) Big Data
11 30 (27.78%) Apache Spark
11 30 (27.78%) Finance
11 30 (27.78%) Agile Software Development
12 28 (25.93%) Data Pipeline
13 26 (24.07%) Microsoft
14 25 (23.15%) DevOps
15 24 (22.22%) Hadoop
16 23 (21.30%) Amazon Redshift
16 23 (21.30%) Power Platform
17 22 (20.37%) NoSQL
18 21 (19.44%) Power BI
19 20 (18.52%) Java
20 18 (16.67%) Data Architecture
20 18 (16.67%) Data Strategy
21 17 (15.74%) Azure SQL Database
21 17 (15.74%) Relational Database
21 17 (15.74%) SQL Server

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 30 (27.78%) Apache Spark
2 16 (14.81%) Apache
3 6 (5.56%) Apache Airflow
4 3 (2.78%) Confluence
5 2 (1.85%) Apache Pig
5 2 (1.85%) SharePoint
6 1 (0.93%) Oracle SOA Suite
Applications
1 1 (0.93%) Microsoft Excel
1 1 (0.93%) Microsoft PowerPoint
Cloud Services
1 70 (64.81%) Azure
2 42 (38.89%) AWS
3 32 (29.63%) Azure Data Factory
4 23 (21.30%) Power Platform
5 12 (11.11%) Amazon EC2
6 11 (10.19%) GCP
7 9 (8.33%) Amazon S3
7 9 (8.33%) SaaS
8 8 (7.41%) Azure Synapse Analytics
9 7 (6.48%) AWS CloudFormation
9 7 (6.48%) Snowflake
10 6 (5.56%) Serverless
11 5 (4.63%) AWS Data Pipeline
12 4 (3.70%) PaaS
13 3 (2.78%) Azure Cosmos DB
13 3 (2.78%) Azure Event Grid
13 3 (2.78%) Azure Storage
13 3 (2.78%) Dynamics 365
14 2 (1.85%) AWS Step Functions
14 2 (1.85%) Azure Logic Apps
Communications & Networking
1 1 (0.93%) Broadband
Database & Business Intelligence
1 75 (69.44%) Data Warehouse
2 32 (29.63%) Big Data
3 24 (22.22%) Hadoop
4 23 (21.30%) Amazon Redshift
5 22 (20.37%) NoSQL
6 21 (19.44%) Power BI
7 17 (15.74%) Azure SQL Database
7 17 (15.74%) Relational Database
7 17 (15.74%) SQL Server
8 13 (12.04%) Amazon RDS
9 11 (10.19%) Metadata
10 9 (8.33%) Data Mart
11 7 (6.48%) Apache Hive
11 7 (6.48%) Spark SQL
12 6 (5.56%) Azure SQL Data Warehouse
12 6 (5.56%) SQL Server Integration Services
12 6 (5.56%) Tableau
13 4 (3.70%) Delta Lake
13 4 (3.70%) Snowflake Schema
13 4 (3.70%) SQL Server Reporting Services
Development Applications
1 10 (9.26%) JIRA
2 4 (3.70%) Git (software)
3 3 (2.78%) ER Studio
3 3 (2.78%) ERwin
3 3 (2.78%) Jenkins
4 2 (1.85%) PowerDesigner
5 1 (0.93%) Atlassian Bamboo
5 1 (0.93%) GDB
5 1 (0.93%) GitLab
5 1 (0.93%) Octopus Deploy
5 1 (0.93%) Sourcetree
5 1 (0.93%) SQL Server Management Studio (SSMS)
5 1 (0.93%) TeamCity
5 1 (0.93%) Visual Studio
5 1 (0.93%) Visual Studio Code
General
1 30 (27.78%) Finance
2 16 (14.81%) Analytical Skills
3 8 (7.41%) Social Skills
4 7 (6.48%) Front Office
5 4 (3.70%) Banking
6 3 (2.78%) Investment Banking
7 2 (1.85%) Advertising
7 2 (1.85%) Law
7 2 (1.85%) Legal
7 2 (1.85%) Retail
8 1 (0.93%) Marketing
8 1 (0.93%) Presentation Skills
Job Titles
1 61 (56.48%) Data Engineer
2 29 (26.85%) Architect
3 20 (18.52%) AWS Engineer
3 20 (18.52%) Data Architect
4 13 (12.04%) Azure Architect
5 11 (10.19%) Big Data Engineer
5 11 (10.19%) Hadoop Engineer
5 11 (10.19%) Senior Data Engineer
6 10 (9.26%) Azure Engineer
7 7 (6.48%) Java Engineer
7 7 (6.48%) Lead Architect
8 5 (4.63%) Senior Architect
9 4 (3.70%) Analyst
9 4 (3.70%) Developer
9 4 (3.70%) Lead Data Architect
9 4 (3.70%) Principal Engineer
10 3 (2.78%) Data Manager
10 3 (2.78%) Enterprise Architect
10 3 (2.78%) Platform Architect
10 3 (2.78%) SaaS Architect
Libraries, Frameworks & Software Standards
1 14 (12.96%) Kafka
2 12 (11.11%) PySpark
3 5 (4.63%) Middleware
4 3 (2.78%) .NET
4 3 (2.78%) HTML
4 3 (2.78%) React
4 3 (2.78%) Vert.x
4 3 (2.78%) Web Services
4 3 (2.78%) WebRTC
5 2 (1.85%) .NET Framework
5 2 (1.85%) Ajax
5 2 (1.85%) AngularJS
5 2 (1.85%) CSS
5 2 (1.85%) jQuery
5 2 (1.85%) JSON
5 2 (1.85%) MDX
5 2 (1.85%) RabbitMQ
5 2 (1.85%) Twitter Bootstrap
5 2 (1.85%) XML
6 1 (0.93%) EDI
Miscellaneous
1 7 (6.48%) Management Information System
1 7 (6.48%) Reinsurance
2 4 (3.70%) Cloud Native
2 4 (3.70%) Data Centre
3 3 (2.78%) Algorithms
3 3 (2.78%) Enterprise Software
3 3 (2.78%) Private Cloud
4 2 (1.85%) Derivative
4 2 (1.85%) Greenfield Project
5 1 (0.93%) Data Structures
5 1 (0.93%) e-Learning
5 1 (0.93%) Mainframe
5 1 (0.93%) N-Tier
5 1 (0.93%) User Experience
Processes & Methodologies
1 64 (59.26%) Analytics
2 50 (46.30%) Business Intelligence
3 49 (45.37%) ETL
4 44 (40.74%) Data Modelling
5 38 (35.19%) Data Engineering
6 30 (27.78%) Agile Software Development
7 28 (25.93%) Data Pipeline
8 25 (23.15%) DevOps
9 18 (16.67%) Data Architecture
9 18 (16.67%) Data Strategy
10 16 (14.81%) Data Science
11 15 (13.89%) Data Transformation
11 15 (13.89%) Problem-Solving
12 14 (12.96%) Data Analytics
13 13 (12.04%) Data Integration
14 12 (11.11%) Insurtech
14 12 (11.11%) Translating Business Requirements
15 11 (10.19%) Data Management
15 11 (10.19%) Metadata Management
16 10 (9.26%) Release Management
Programming Languages
1 49 (45.37%) SQL
2 39 (36.11%) Python
3 20 (18.52%) Java
4 8 (7.41%) JavaScript
5 4 (3.70%) PowerShell
6 3 (2.78%) PHP
6 3 (2.78%) Scala
7 2 (1.85%) C#
7 2 (1.85%) Data Analysis Expressions (DAX)
8 1 (0.93%) Clojure
8 1 (0.93%) T-SQL
8 1 (0.93%) VB.NET
Qualifications
1 6 (5.56%) Degree
2 2 (1.85%) Computer Science Degree
3 1 (0.93%) PhD
Quality Assurance & Compliance
1 9 (8.33%) QA
2 5 (4.63%) Data Quality
3 2 (1.85%) GDPR
System Software
1 2 (1.85%) Apache Flume
2 1 (0.93%) Docker
2 1 (0.93%) HDFS
Systems Management
1 7 (6.48%) Kubernetes
2 5 (4.63%) Terraform
3 3 (2.78%) Grafana
3 3 (2.78%) Istio
3 3 (2.78%) Prometheus
4 2 (1.85%) Ansible
5 1 (0.93%) Puppet
Vendors
1 38 (35.19%) Databricks
2 26 (24.07%) Microsoft
3 13 (12.04%) Talend
4 4 (3.70%) Cloudera
4 4 (3.70%) Oracle
5 3 (2.78%) IBM
6 2 (1.85%) Alteryx
6 2 (1.85%) Google
6 2 (1.85%) Teradata
7 1 (0.93%) Actuate
7 1 (0.93%) Cognos
7 1 (0.93%) Confluent
7 1 (0.93%) Facebook
7 1 (0.93%) MicroStrategy
7 1 (0.93%) Netezza
7 1 (0.93%) Sage