Period
to 15 October 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 15 October 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
Central London > City of London
6 months to
15 Oct 2021
Same period 2020 Same period 2019
Rank 117 123 219
Rank change year-on-year +6 +96 +28
Permanent jobs citing Data Lake 142 66 125
As % of all permanent jobs advertised in the City of London 2.39% 1.84% 1.24%
As % of the Database & Business Intelligence category 7.97% 6.69% 3.99%
Number of salaries quoted 134 59 112
10th Percentile £52,500 £57,500 £43,750
25th Percentile £70,500 £65,000 £55,000
Median annual salary (50th Percentile) £81,250 £85,000 £77,500
Median % change year-on-year -4.41% +9.68% +19.23%
75th Percentile £106,250 £92,500 £87,500
90th Percentile £114,250 £105,000 £105,000
Central London median annual salary £80,000 £75,000 £75,000
% change year-on-year +6.67% - +15.38%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 1,782 986 3,131
As % of all permanent IT jobs advertised in the City of London 29.96% 27.55% 31.05%
Number of salaries quoted 1,577 825 2,818
10th Percentile £46,250 £42,350 £42,500
25th Percentile £56,250 £52,500 £52,500
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £95,000 £85,000 £85,000
90th Percentile £108,750 £100,000 £100,000
Central London median annual salary £72,500 £70,000 £65,000
% change year-on-year +3.57% +7.69% -

Data Lake
Job Vacancy Trend in the City of London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Lake in the City of London

Data Lake
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Data Lake in the City of London.

Salary trend for Data Lake in the City of London

Data Lake
Salary Histogram in the City of London

Salary distribution for jobs citing Data Lake in the City of London over the 6 months to 15 October 2021.

Salary histogram for Data Lake in the City of London

For the 6 months to 15 October 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Data Lake.

1 98 (69.01%) Data Warehouse
2 90 (63.38%) Azure
3 76 (53.52%) SQL
4 73 (51.41%) Analytics
5 60 (42.25%) AWS
5 60 (42.25%) Python
6 59 (41.55%) ETL
7 56 (39.44%) Business Intelligence
8 48 (33.80%) Data Modelling
9 46 (32.39%) Finance
10 43 (30.28%) Big Data
10 43 (30.28%) Databricks
11 42 (29.58%) Data Engineering
12 37 (26.06%) Azure Data Factory
13 36 (25.35%) Agile Software Development
14 35 (24.65%) Data Pipeline
15 34 (23.94%) Apache Spark
16 29 (20.42%) Power Platform
16 29 (20.42%) Power BI
17 27 (19.01%) DevOps
17 27 (19.01%) Microsoft
18 26 (18.31%) Hadoop
19 24 (16.90%) Java
20 23 (16.20%) Azure SQL Database
21 22 (15.49%) GCP
21 22 (15.49%) Data Science
22 21 (14.79%) Data Architecture
23 20 (14.08%) NoSQL
23 20 (14.08%) Amazon Redshift
23 20 (14.08%) JIRA

Data Lake
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 34 (23.94%) Apache Spark
2 14 (9.86%) Apache
3 13 (9.15%) Confluence
4 8 (5.63%) Apache Airflow
5 6 (4.23%) Elasticsearch
6 2 (1.41%) Apache Pig
7 1 (0.70%) Oracle SOA Suite
Applications
1 2 (1.41%) Microsoft Excel
2 1 (0.70%) Microsoft PowerPoint
Cloud Services
1 90 (63.38%) Azure
2 60 (42.25%) AWS
3 37 (26.06%) Azure Data Factory
4 29 (20.42%) Power Platform
5 22 (15.49%) GCP
6 17 (11.97%) Azure Synapse Analytics
7 12 (8.45%) Amazon EC2
8 8 (5.63%) Amazon S3
8 8 (5.63%) Serverless
9 7 (4.93%) AWS CloudFormation
10 6 (4.23%) SaaS
10 6 (4.23%) Snowflake
11 5 (3.52%) AWS Data Pipeline
11 5 (3.52%) Azure Cosmos DB
12 4 (2.82%) Azure Event Grid
13 3 (2.11%) Azure Storage
13 3 (2.11%) PaaS
14 2 (1.41%) Amazon SQS
14 2 (1.41%) AWS Step Functions
14 2 (1.41%) Azure Logic Apps
Communications & Networking
1 1 (0.70%) Broadband
1 1 (0.70%) Network Security
Database & Business Intelligence
1 98 (69.01%) Data Warehouse
2 43 (30.28%) Big Data
3 29 (20.42%) Power BI
4 26 (18.31%) Hadoop
5 23 (16.20%) Azure SQL Database
6 20 (14.08%) Amazon Redshift
6 20 (14.08%) NoSQL
7 18 (12.68%) Relational Database
8 17 (11.97%) SQL Server
9 15 (10.56%) Metadata
10 12 (8.45%) Amazon RDS
11 9 (6.34%) Data Mart
11 9 (6.34%) Snowflake Schema
11 9 (6.34%) SQL Server Integration Services
11 9 (6.34%) Star Schema
12 7 (4.93%) Apache Cassandra
12 7 (4.93%) Azure SQL Data Warehouse
12 7 (4.93%) Delta Lake
12 7 (4.93%) Spark SQL
12 7 (4.93%) Tableau
Development Applications
1 20 (14.08%) JIRA
2 17 (11.97%) Git (software)
3 10 (7.04%) Team Foundation Server
4 3 (2.11%) ER Studio
4 3 (2.11%) ERwin
4 3 (2.11%) Jenkins
5 2 (1.41%) PowerDesigner
6 1 (0.70%) Atlassian Bamboo
6 1 (0.70%) GDB
6 1 (0.70%) Octopus Deploy
6 1 (0.70%) Sourcetree
6 1 (0.70%) SQL Server Management Studio (SSMS)
6 1 (0.70%) TeamCity
6 1 (0.70%) Visual Studio
6 1 (0.70%) Visual Studio Code
General
1 46 (32.39%) Finance
2 17 (11.97%) Social Skills
3 15 (10.56%) Analytical Skills
4 8 (5.63%) Front Office
5 6 (4.23%) Advertising
6 3 (2.11%) Law
7 2 (1.41%) Banking
7 2 (1.41%) Investment Banking
7 2 (1.41%) Legal
7 2 (1.41%) Marketing
7 2 (1.41%) Presentation Skills
7 2 (1.41%) Retail
8 1 (0.70%) Public Sector
Job Titles
1 71 (50.00%) Data Engineer
2 38 (26.76%) Architect
3 27 (19.01%) Data Architect
4 18 (12.68%) AWS Engineer
5 17 (11.97%) Senior Data Engineer
6 14 (9.86%) Lead Architect
7 11 (7.75%) Azure Engineer
7 11 (7.75%) Big Data Engineer
8 10 (7.04%) Automation Engineer
8 10 (7.04%) Hadoop Engineer
8 10 (7.04%) Lead Data Architect
8 10 (7.04%) QA Automation Engineer
8 10 (7.04%) QA Engineer
9 9 (6.34%) Azure Architect
10 7 (4.93%) Developer
10 7 (4.93%) Java Engineer
11 6 (4.23%) Analyst
12 5 (3.52%) Enterprise Architect
12 5 (3.52%) Enterprise Data Architect
13 4 (2.82%) Principal Engineer
Libraries, Frameworks & Software Standards
1 19 (13.38%) Kafka
1 19 (13.38%) PySpark
2 7 (4.93%) .NET
2 7 (4.93%) Web Services
3 6 (4.23%) Middleware
4 5 (3.52%) React
5 4 (2.82%) MDX
6 3 (2.11%) .NET Core
6 3 (2.11%) ADO.NET
6 3 (2.11%) ASP.NET Core
6 3 (2.11%) Dapper ORM
6 3 (2.11%) Entity Framework
6 3 (2.11%) JSON
6 3 (2.11%) NHibernate
6 3 (2.11%) Vue.js
7 2 (1.41%) RabbitMQ
7 2 (1.41%) Vert.x
7 2 (1.41%) WebRTC
8 1 (0.70%) Apache Avro
8 1 (0.70%) RESTful
Miscellaneous
1 10 (7.04%) Self-Motivation
2 5 (3.52%) Algorithms
3 4 (2.82%) Cloud Native
3 4 (2.82%) Enterprise Software
3 4 (2.82%) Management Information System
3 4 (2.82%) User Experience
4 3 (2.11%) Data Centre
4 3 (2.11%) Reinsurance
5 2 (1.41%) Data Structures
5 2 (1.41%) Derivative
5 2 (1.41%) Greenfield Project
5 2 (1.41%) Private Cloud
6 1 (0.70%) e-Learning
6 1 (0.70%) Hybrid Cloud
6 1 (0.70%) Marketing Technology
6 1 (0.70%) NHS
6 1 (0.70%) N-Tier
Operating Systems
1 1 (0.70%) Linux
1 1 (0.70%) Unix
Processes & Methodologies
1 73 (51.41%) Analytics
2 59 (41.55%) ETL
3 56 (39.44%) Business Intelligence
4 48 (33.80%) Data Modelling
5 42 (29.58%) Data Engineering
6 36 (25.35%) Agile Software Development
7 35 (24.65%) Data Pipeline
8 27 (19.01%) DevOps
9 22 (15.49%) Data Science
10 21 (14.79%) Data Architecture
11 17 (11.97%) Data Strategy
12 16 (11.27%) Data Integration
13 15 (10.56%) Data Transformation
13 15 (10.56%) DataOps
13 15 (10.56%) Release Management
14 14 (9.86%) Data Analytics
14 14 (9.86%) Visualisation
15 13 (9.15%) Data Management
15 13 (9.15%) Test Automation
16 12 (8.45%) Problem-Solving
Programming Languages
1 76 (53.52%) SQL
2 60 (42.25%) Python
3 24 (16.90%) Java
4 16 (11.27%) C#
5 8 (5.63%) JavaScript
5 8 (5.63%) PowerShell
5 8 (5.63%) Scala
6 7 (4.93%) Data Analysis Expressions (DAX)
6 7 (4.93%) T-SQL
7 4 (2.82%) PHP
8 2 (1.41%) R
9 1 (0.70%) VB.NET
9 1 (0.70%) VBA
Qualifications
1 10 (7.04%) Degree
2 2 (1.41%) Computer Science Degree
2 2 (1.41%) PhD
3 1 (0.70%) IBM Certification
3 1 (0.70%) Master's Degree
Quality Assurance & Compliance
1 17 (11.97%) QA
2 4 (2.82%) Data Quality
System Software
1 2 (1.41%) Apache Flume
2 1 (0.70%) Active Directory
2 1 (0.70%) Docker
2 1 (0.70%) Virtual Desktop
Systems Management
1 8 (5.63%) Kubernetes
2 5 (3.52%) Terraform
3 4 (2.82%) Grafana
3 4 (2.82%) Istio
3 4 (2.82%) Prometheus
4 2 (1.41%) Ansible
5 1 (0.70%) Puppet
Vendors
1 43 (30.28%) Databricks
2 27 (19.01%) Microsoft
3 13 (9.15%) Talend
4 5 (3.52%) IBM
5 3 (2.11%) Cloudera
5 3 (2.11%) Google
5 3 (2.11%) Oracle
6 1 (0.70%) Actuate
6 1 (0.70%) Alteryx
6 1 (0.70%) Cognos
6 1 (0.70%) Facebook
6 1 (0.70%) Netezza
6 1 (0.70%) Palantir
6 1 (0.70%) Teradata