Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 13 May 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 13 May 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
13 May 2021		 Same period 2020 Same period 2019
Rank 289 237 405
Rank change year-on-year -52 +168 -30
Permanent jobs citing Data Lake 374 604 411
As % of all permanent jobs advertised in London 1.12% 1.49% 0.70%
As % of the Database & Business Intelligence category 3.86% 5.34% 2.41%
Number of salaries quoted 303 362 341
10th Percentile £52,500 £55,000 £47,500
25th Percentile £64,375 £61,563 £57,500
Median annual salary (50th Percentile) £80,000 £72,500 £70,257
Median % change year-on-year +10.34% +3.19% +0.37%
75th Percentile £101,250 £85,000 £87,500
90th Percentile £109,750 £91,250 £100,000
England median annual salary £70,000 £70,000 £66,000
% change year-on-year - +6.06% +1.54%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 9,677 11,303 17,023
As % of all permanent IT jobs advertised in London 29.07% 27.82% 29.11%
Number of salaries quoted 7,160 9,319 14,265
10th Percentile £43,750 £40,000 £38,750
25th Percentile £52,500 £50,000 £47,500
Median annual salary (50th Percentile) £70,000 £65,000 £65,000
Median % change year-on-year +7.69% - +8.33%
75th Percentile £87,500 £85,000 £82,500
90th Percentile £102,500 £105,000 £95,000
England median annual salary £55,000 £55,000 £52,500
% change year-on-year - +4.76% +5.00%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

Salary distribution for jobs citing Data Lake in London over the 6 months to 13 May 2021.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 13 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
Central London +72 106 £82,500 +22.22% 25
West London +2 9 £77,500 +19.23% 8
South London -36 1 £60,000 -5.88% 3
Data Lake
England

For the 6 months to 13 May 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 231 (61.76%) Azure
2 200 (53.48%) SQL
3 195 (52.14%) Data Warehouse
4 157 (41.98%) Business Intelligence
5 150 (40.11%) ETL
6 142 (37.97%) Analytics
7 129 (34.49%) Power Platform
8 127 (33.96%) AWS
9 123 (32.89%) Python
10 118 (31.55%) Databricks
11 109 (29.14%) Data Modelling
12 108 (28.88%) Power BI
13 107 (28.61%) SQL Server
14 103 (27.54%) Azure Data Factory
15 96 (25.67%) Microsoft
16 94 (25.13%) Agile Software Development
17 92 (24.60%) Big Data
17 92 (24.60%) DevOps
17 92 (24.60%) Apache Spark
18 90 (24.06%) Finance
19 86 (22.99%) Data Pipeline
20 76 (20.32%) Data Science
21 73 (19.52%) Azure SQL Database
22 72 (19.25%) Data Engineering
23 70 (18.72%) Hadoop
24 66 (17.65%) Java
25 65 (17.38%) NoSQL
26 60 (16.04%) Microservices
27 59 (15.78%) Machine Learning
27 59 (15.78%) Social Skills

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 92 (24.60%) Apache Spark
2 26 (6.95%) Apache
3 24 (6.42%) SharePoint
4 20 (5.35%) Apache Airflow
5 9 (2.41%) Confluence
6 6 (1.60%) Oracle Workflow
7 3 (0.80%) Jupyter
8 2 (0.53%) Apache Pig
8 2 (0.53%) JBoss
8 2 (0.53%) Luigi
8 2 (0.53%) Mule
8 2 (0.53%) Mule ESB
8 2 (0.53%) Tomcat
8 2 (0.53%) WebSphere
9 1 (0.27%) Apache Synapse
9 1 (0.27%) Elasticsearch
9 1 (0.27%) IIS
9 1 (0.27%) OpenStack
9 1 (0.27%) SAS
Applications
1 11 (2.94%) Microsoft Excel
2 3 (0.80%) Microsoft Office
3 2 (0.53%) Microsoft Project
4 1 (0.27%) Microsoft PowerPoint
4 1 (0.27%) SPSS
4 1 (0.27%) SPSS Modeler
Business Applications
1 5 (1.34%) Magento
1 5 (1.34%) NetSuite
2 4 (1.07%) Dynamics AX
3 2 (0.53%) Sparx Enterprise Architect
Cloud Services
1 231 (61.76%) Azure
2 129 (34.49%) Power Platform
3 127 (33.96%) AWS
4 103 (27.54%) Azure Data Factory
5 48 (12.83%) GCP
6 44 (11.76%) PaaS
7 34 (9.09%) Azure Synapse Analytics
8 32 (8.56%) Dynamics 365
9 27 (7.22%) SaaS
10 22 (5.88%) Amazon S3
11 18 (4.81%) Serverless
12 14 (3.74%) Azure Cosmos DB
13 13 (3.48%) Amazon Kinesis
13 13 (3.48%) AWS Lambda
13 13 (3.48%) Azure Storage
14 10 (2.67%) Amazon EC2
15 9 (2.41%) Azure Logic Apps
15 9 (2.41%) Cloud Computing
16 8 (2.14%) Amazon EMR
17 7 (1.87%) Azure Data Lake Analytics
Communications & Networking
1 10 (2.67%) Wireless
2 4 (1.07%) FTP
2 4 (1.07%) Internet
3 2 (0.53%) Broadband
3 2 (0.53%) HTTP
3 2 (0.53%) Kerberos
4 1 (0.27%) Extranet
4 1 (0.27%) Firewall
Database & Business Intelligence
1 195 (52.14%) Data Warehouse
2 108 (28.88%) Power BI
3 107 (28.61%) SQL Server
4 92 (24.60%) Big Data
5 73 (19.52%) Azure SQL Database
6 70 (18.72%) Hadoop
7 65 (17.38%) NoSQL
8 42 (11.23%) Tableau
9 40 (10.70%) SQL Server Integration Services
10 38 (10.16%) Apache Hive
11 34 (9.09%) Amazon Redshift
12 33 (8.82%) SQL Server Analysis Services
13 29 (7.75%) Snowflake Schema
14 28 (7.49%) Azure SQL Data Warehouse
15 25 (6.68%) Data Mart
16 24 (6.42%) Relational Database
17 21 (5.61%) SQL Server Reporting Services
18 17 (4.55%) HBase
18 17 (4.55%) Microsoft Analysis Services
19 16 (4.28%) Amazon RDS
Development Applications
1 16 (4.28%) JIRA
2 11 (2.94%) Git (software)
2 11 (2.94%) Jenkins
3 7 (1.87%) ER Studio
3 7 (1.87%) ERwin
4 6 (1.60%) Bitbucket
5 5 (1.34%) Sonatype Nexus
6 4 (1.07%) Subversion
6 4 (1.07%) Visual Studio
7 3 (0.80%) SQL Server Management Studio (SSMS)
8 2 (0.53%) CircleCI
8 2 (0.53%) GitLab
8 2 (0.53%) Octopus Deploy
8 2 (0.53%) PowerDesigner
9 1 (0.27%) Maven
9 1 (0.27%) Postman
9 1 (0.27%) Team Foundation Server
9 1 (0.27%) TeamCity
9 1 (0.27%) Visual Studio Team System
General
1 90 (24.06%) Finance
2 59 (15.78%) Social Skills
3 45 (12.03%) Analytical Skills
4 24 (6.42%) Retail
5 22 (5.88%) Banking
6 13 (3.48%) Telecoms
7 12 (3.21%) Marketing
8 11 (2.94%) Front Office
8 11 (2.94%) Games
9 9 (2.41%) Law
10 6 (1.60%) Investment Banking
11 4 (1.07%) Advertising
12 3 (0.80%) iGaming
13 2 (0.53%) Influencing Skills
13 2 (0.53%) Presentation Skills
13 2 (0.53%) Publishing
14 1 (0.27%) Automotive
14 1 (0.27%) Back Office
14 1 (0.27%) Manufacturing
14 1 (0.27%) Public Sector
Job Titles
1 116 (31.02%) Data Engineer
2 100 (26.74%) Architect
3 71 (18.98%) Data Architect
4 45 (12.03%) Developer
5 41 (10.96%) Azure Architect
6 27 (7.22%) Analyst
7 25 (6.68%) Senior Data Engineer
8 24 (6.42%) Big Data Engineer
9 23 (6.15%) Azure Engineer
10 21 (5.61%) Enterprise Architect
11 20 (5.35%) Applications Architect
12 19 (5.08%) AWS Engineer
13 17 (4.55%) Consultant
13 17 (4.55%) Technical Manager
14 16 (4.28%) Enterprise Applications Architect
15 15 (4.01%) Business Intelligence Developer
16 14 (3.74%) Product Manager
16 14 (3.74%) Technical Product Manager
17 13 (3.48%) Python Engineer
18 12 (3.21%) Data Analyst
Libraries, Frameworks & Software Standards
1 53 (14.17%) Kafka
2 31 (8.29%) .NET
3 29 (7.75%) XML
4 24 (6.42%) CSS
5 21 (5.61%) jQuery
5 21 (5.61%) Twitter Bootstrap
6 20 (5.35%) Ajax
7 18 (4.81%) PySpark
8 10 (2.67%) Web Services
9 9 (2.41%) HTML
10 8 (2.14%) Apache NiFi
11 6 (1.60%) EDI
11 6 (1.60%) JSON
11 6 (1.60%) React
11 6 (1.60%) Spring Boot
12 5 (1.34%) .NET Framework
12 5 (1.34%) Node.js
13 4 (1.07%) AngularJS
13 4 (1.07%) NumPy
13 4 (1.07%) Spring
Miscellaneous
1 23 (6.15%) Algorithms
2 21 (5.61%) Enterprise Software
3 18 (4.81%) Greenfield Project
4 16 (4.28%) Data Structures
5 15 (4.01%) Reinsurance
6 14 (3.74%) Management Information System
7 11 (2.94%) Cloud Native
8 10 (2.67%) Virtual Team
9 6 (1.60%) Data Centre
9 6 (1.60%) Self-Motivation
9 6 (1.60%) User Experience
10 5 (1.34%) BBC
11 4 (1.07%) Blog
11 4 (1.07%) Market Risk
12 3 (0.80%) Credit Risk
12 3 (0.80%) Internet of Things
12 3 (0.80%) Online Games
12 3 (0.80%) Robotics
13 2 (0.53%) Data Protection Act
13 2 (0.53%) Derivative
Operating Systems
1 10 (2.67%) Unix
2 6 (1.60%) Linux
2 6 (1.60%) Windows
3 2 (0.53%) Windows Server
Processes & Methodologies
1 157 (41.98%) Business Intelligence
2 150 (40.11%) ETL
3 142 (37.97%) Analytics
4 109 (29.14%) Data Modelling
5 94 (25.13%) Agile Software Development
6 92 (24.60%) DevOps
7 86 (22.99%) Data Pipeline
8 76 (20.32%) Data Science
9 72 (19.25%) Data Engineering
10 60 (16.04%) Microservices
11 59 (15.78%) Machine Learning
12 58 (15.51%) Data Architecture
13 55 (14.71%) Visualisation
14 48 (12.83%) Test Automation
15 45 (12.03%) Continuous Integration
16 41 (10.96%) Data Strategy
16 41 (10.96%) Migration
16 41 (10.96%) Stakeholder Management
17 39 (10.43%) Data Management
18 38 (10.16%) Data Visualisation
Programming Languages
1 200 (53.48%) SQL
2 123 (32.89%) Python
3 66 (17.65%) Java
4 36 (9.63%) Scala
5 19 (5.08%) C#
6 14 (3.74%) Data Analysis Expressions (DAX)
7 12 (3.21%) JavaScript
7 12 (3.21%) R
8 9 (2.41%) C
9 8 (2.14%) T-SQL
10 7 (1.87%) U-SQL
11 6 (1.60%) Bash Shell
12 4 (1.07%) Kotlin
12 4 (1.07%) PowerShell
12 4 (1.07%) VBA
13 3 (0.80%) Cython
13 3 (0.80%) Go
13 3 (0.80%) Google Apps Script
13 3 (0.80%) Java 8
14 2 (0.53%) TypeScript
Qualifications
1 37 (9.89%) Degree
2 18 (4.81%) Computer Science Degree
3 5 (1.34%) Microsoft Certification
4 4 (1.07%) AWS Certification
4 4 (1.07%) ITIL Certification
5 3 (0.80%) AAT
5 3 (0.80%) ACCA
5 3 (0.80%) CIMA
5 3 (0.80%) DBS Check
5 3 (0.80%) PhD
5 3 (0.80%) SC Cleared
5 3 (0.80%) Security Cleared
6 1 (0.27%) PMI Certification
6 1 (0.27%) PMP
6 1 (0.27%) TOGAF Certification
Quality Assurance & Compliance
1 34 (9.09%) Data Quality
2 11 (2.94%) QA
3 7 (1.87%) GDPR
4 2 (0.53%) SLA
5 1 (0.27%) NIST
System Software
1 10 (2.67%) Docker
2 8 (2.14%) HDFS
3 2 (0.53%) Active Directory
3 2 (0.53%) Apache Flume
4 1 (0.27%) Hyper-V
4 1 (0.27%) VMware Infrastructure
Systems Management
1 24 (6.42%) Kubernetes
2 18 (4.81%) Terraform
3 14 (3.74%) Puppet
4 11 (2.94%) Ansible
5 5 (1.34%) Opscode Chef
6 4 (1.07%) Oozie
7 3 (0.80%) Grafana
7 3 (0.80%) Packer
8 1 (0.27%) Failover Clustering
8 1 (0.27%) SCCM
8 1 (0.27%) Single Sign-On
8 1 (0.27%) vCenter Server
Vendors
1 118 (31.55%) Databricks
2 96 (25.67%) Microsoft
3 20 (5.35%) Google
4 17 (4.55%) Salesforce.com
5 15 (4.01%) Oracle
6 14 (3.74%) Talend
7 9 (2.41%) Alteryx
8 6 (1.60%) SAP
9 5 (1.34%) Cloudera
9 5 (1.34%) JD Edwards
10 4 (1.07%) Informatica
11 3 (0.80%) Instagram
11 3 (0.80%) StreamSets
11 3 (0.80%) Teradata
11 3 (0.80%) TIBCO
12 2 (0.53%) IBM
12 2 (0.53%) Sparx
12 2 (0.53%) VMware
13 1 (0.27%) Calypso
13 1 (0.27%) Cisco