Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 24 July 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 24 July 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
24 Jul 2021		 Same period 2020 Same period 2019
Rank 280 197 363
Rank change year-on-year -83 +166 +6
Permanent jobs citing Data Lake 553 544 470
As % of all permanent jobs advertised in London 1.23% 1.85% 0.82%
As % of the Database & Business Intelligence category 3.85% 6.54% 2.81%
Number of salaries quoted 426 294 406
10th Percentile £52,500 £56,625 £43,750
25th Percentile £60,000 £61,563 £56,250
Median annual salary (50th Percentile) £80,000 £72,500 £70,000
Median % change year-on-year +10.34% +3.57% -
75th Percentile £95,000 £87,500 £87,500
90th Percentile £108,750 £95,000 £105,000
England median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 14,374 8,318 16,700
As % of all permanent IT jobs advertised in London 31.91% 28.27% 29.00%
Number of salaries quoted 8,721 6,764 14,090
10th Percentile £44,000 £41,250 £38,500
25th Percentile £52,500 £51,250 £48,000
Median annual salary (50th Percentile) £70,000 £67,500 £65,000
Median % change year-on-year +3.70% +3.85% +4.00%
75th Percentile £88,750 £85,000 £82,500
90th Percentile £105,000 £101,250 £95,000
England median annual salary £57,000 £55,000 £52,500
% change year-on-year +3.64% +4.76% +5.00%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

Salary distribution for jobs citing Data Lake in London over the 6 months to 24 July 2021.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 24 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
Central London +30 125 £80,000 +18.52% 24
West London -66 9 £70,000 +7.69% 8
South London -52 6 £60,000 -9.43% 3
Data Lake
England

For the 6 months to 24 July 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 318 (57.50%) Azure
2 297 (53.71%) Data Warehouse
3 288 (52.08%) SQL
4 248 (44.85%) Analytics
5 243 (43.94%) Business Intelligence
6 214 (38.70%) AWS
7 208 (37.61%) ETL
8 203 (36.71%) Python
9 180 (32.55%) Data Modelling
10 165 (29.84%) Agile Software Development
11 158 (28.57%) Databricks
12 152 (27.49%) Azure Data Factory
13 150 (27.12%) Power Platform
14 145 (26.22%) Power BI
15 143 (25.86%) Big Data
15 143 (25.86%) Data Pipeline
16 139 (25.14%) Apache Spark
17 134 (24.23%) Data Engineering
18 130 (23.51%) DevOps
19 129 (23.33%) Microsoft
20 121 (21.88%) Finance
21 114 (20.61%) SQL Server
22 103 (18.63%) Hadoop
23 98 (17.72%) Data Science
24 92 (16.64%) Social Skills
25 89 (16.09%) NoSQL
26 87 (15.73%) Data Architecture
27 86 (15.55%) Azure SQL Database
27 86 (15.55%) Java
27 86 (15.55%) GCP

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 139 (25.14%) Apache Spark
2 47 (8.50%) Apache
3 37 (6.69%) Apache Airflow
4 19 (3.44%) Confluence
5 16 (2.89%) SharePoint
6 7 (1.27%) Oracle Workflow
7 6 (1.08%) Apache Pig
8 5 (0.90%) Luigi
8 5 (0.90%) Oracle SOA Suite
9 3 (0.54%) JBoss
9 3 (0.54%) Jupyter
10 2 (0.36%) Mule
10 2 (0.36%) Mule ESB
10 2 (0.36%) Tomcat
10 2 (0.36%) WebSphere
11 1 (0.18%) Apache Synapse
11 1 (0.18%) Elasticsearch
11 1 (0.18%) IIS
Applications
1 12 (2.17%) Microsoft Excel
2 9 (1.63%) Microsoft Office
3 5 (0.90%) Microsoft Project
4 3 (0.54%) Microsoft PowerPoint
4 3 (0.54%) MS Visio
Business Applications
1 7 (1.27%) Magento
2 4 (0.72%) Dynamics AX
2 4 (0.72%) Dynamics CRM
2 4 (0.72%) NetSuite
3 2 (0.36%) Sparx Enterprise Architect
Cloud Services
1 318 (57.50%) Azure
2 214 (38.70%) AWS
3 152 (27.49%) Azure Data Factory
4 150 (27.12%) Power Platform
5 86 (15.55%) GCP
6 56 (10.13%) Snowflake
7 51 (9.22%) Azure Synapse Analytics
8 45 (8.14%) Amazon S3
9 44 (7.96%) PaaS
10 36 (6.51%) Serverless
11 25 (4.52%) AWS Lambda
12 24 (4.34%) SaaS
13 23 (4.16%) Azure Storage
14 21 (3.80%) Amazon Kinesis
15 20 (3.62%) Amazon EC2
16 18 (3.25%) Azure Cosmos DB
17 17 (3.07%) Amazon SQS
18 16 (2.89%) GitHub
19 14 (2.53%) Amazon EMR
19 14 (2.53%) IaaS
Communications & Networking
1 19 (3.44%) Wireless
2 12 (2.17%) 4G
2 12 (2.17%) 5G
3 5 (0.90%) FTP
4 4 (0.72%) Broadband
4 4 (0.72%) HTTP
5 2 (0.36%) Cisco IPT
5 2 (0.36%) DNS
5 2 (0.36%) VPN
6 1 (0.18%) ATM
6 1 (0.18%) Extranet
6 1 (0.18%) Internet
Database & Business Intelligence
1 297 (53.71%) Data Warehouse
2 145 (26.22%) Power BI
3 143 (25.86%) Big Data
4 114 (20.61%) SQL Server
5 103 (18.63%) Hadoop
6 89 (16.09%) NoSQL
7 86 (15.55%) Azure SQL Database
8 65 (11.75%) Relational Database
9 57 (10.31%) SQL Server Integration Services
10 55 (9.95%) Amazon Redshift
11 45 (8.14%) Apache Hive
11 45 (8.14%) SQL Server Analysis Services
12 44 (7.96%) Tableau
13 42 (7.59%) PostgreSQL
14 41 (7.41%) Azure SQL Data Warehouse
15 38 (6.87%) Amazon RDS
16 37 (6.69%) Metadata
17 31 (5.61%) BigQuery
18 29 (5.24%) SQL Server Reporting Services
19 25 (4.52%) Microsoft Analysis Services
Development Applications
1 37 (6.69%) JIRA
2 32 (5.79%) Git (software)
3 19 (3.44%) Visual Studio
4 18 (3.25%) Jenkins
5 17 (3.07%) CircleCI
6 13 (2.35%) ER Studio
7 12 (2.17%) ERwin
8 11 (1.99%) Bitbucket
9 6 (1.08%) TeamCity
10 5 (0.90%) Postman
10 5 (0.90%) PowerDesigner
10 5 (0.90%) Sonatype Nexus
10 5 (0.90%) SQL Server Management Studio (SSMS)
11 4 (0.72%) GDB
11 4 (0.72%) Subversion
11 4 (0.72%) Visual Studio Code
12 3 (0.54%) kappa
12 3 (0.54%) NUnit
12 3 (0.54%) Selenium
12 3 (0.54%) SpecFlow
General
1 121 (21.88%) Finance
2 92 (16.64%) Social Skills
3 55 (9.95%) Analytical Skills
4 40 (7.23%) Retail
5 38 (6.87%) Telecoms
6 25 (4.52%) Banking
7 12 (2.17%) Law
7 12 (2.17%) Presentation Skills
8 9 (1.63%) Games
9 8 (1.45%) Front Office
9 8 (1.45%) Manufacturing
9 8 (1.45%) Marketing
10 7 (1.27%) Advertising
11 6 (1.08%) Investment Banking
12 4 (0.72%) Czech Language
12 4 (0.72%) Financial Institution
12 4 (0.72%) Legal
12 4 (0.72%) Publishing
13 3 (0.54%) Influencing Skills
13 3 (0.54%) Organisational Skills
Job Titles
1 193 (34.90%) Data Engineer
2 145 (26.22%) Architect
3 113 (20.43%) Data Architect
4 60 (10.85%) Developer
5 44 (7.96%) Azure Engineer
6 39 (7.05%) Solutions Architect
7 35 (6.33%) AWS Engineer
7 35 (6.33%) Senior Data Engineer
8 33 (5.97%) Azure Architect
9 25 (4.52%) Analyst
10 24 (4.34%) Big Data Architect
10 24 (4.34%) Big Data Engineer
10 24 (4.34%) Software Engineer
11 21 (3.80%) Consultant
12 20 (3.62%) Python Engineer
13 17 (3.07%) Business Intelligence Developer
14 15 (2.71%) ETL Developer
14 15 (2.71%) Technical Manager
15 14 (2.53%) Data Manager
15 14 (2.53%) Java Engineer
Libraries, Frameworks & Software Standards
1 78 (14.10%) Kafka
2 47 (8.50%) PySpark
3 25 (4.52%) Web Services
4 21 (3.80%) HTML
5 18 (3.25%) .NET
6 17 (3.07%) React
7 16 (2.89%) CSS
8 13 (2.35%) XML
9 12 (2.17%) Django
9 12 (2.17%) JSON
10 10 (1.81%) jQuery
10 10 (1.81%) REST
11 9 (1.63%) .NET Framework
11 9 (1.63%) AngularJS
12 8 (1.45%) Apache NiFi
13 7 (1.27%) GraphQL
13 7 (1.27%) gRPC
13 7 (1.27%) Middleware
14 6 (1.08%) ASP.NET
14 6 (1.08%) COM
Miscellaneous
1 31 (5.61%) Greenfield Project
2 24 (4.34%) Cloud Native
3 23 (4.16%) Algorithms
4 21 (3.80%) Data Structures
5 20 (3.62%) Virtual Team
6 15 (2.71%) Public Cloud
7 14 (2.53%) Management Information System
8 13 (2.35%) Reinsurance
9 10 (1.81%) Self-Motivation
10 9 (1.63%) Enterprise Software
10 9 (1.63%) Renewable Energy
11 8 (1.45%) User Experience
12 7 (1.27%) BBC
12 7 (1.27%) Derivative
12 7 (1.27%) Foreign Exchange (FX)
13 5 (0.90%) Data Protection Act
13 5 (0.90%) Equities
13 5 (0.90%) Fixed Income
14 4 (0.72%) Digital Currency
14 4 (0.72%) Linux Command Line
Operating Systems
1 10 (1.81%) Unix
2 9 (1.63%) Linux
2 9 (1.63%) Windows
3 3 (0.54%) Windows Server
Processes & Methodologies
1 248 (44.85%) Analytics
2 243 (43.94%) Business Intelligence
3 208 (37.61%) ETL
4 180 (32.55%) Data Modelling
5 165 (29.84%) Agile Software Development
6 143 (25.86%) Data Pipeline
7 134 (24.23%) Data Engineering
8 130 (23.51%) DevOps
9 98 (17.72%) Data Science
10 87 (15.73%) Data Architecture
11 82 (14.83%) Microservices
12 81 (14.65%) Visualisation
13 70 (12.66%) Data Management
14 61 (11.03%) Machine Learning
15 59 (10.67%) Mentoring
16 58 (10.49%) Problem-Solving
17 57 (10.31%) Artificial Intelligence
17 57 (10.31%) Software Engineering
18 56 (10.13%) Data Visualisation
19 55 (9.95%) Stakeholder Management
Programming Languages
1 288 (52.08%) SQL
2 203 (36.71%) Python
3 86 (15.55%) Java
4 34 (6.15%) Scala
5 27 (4.88%) C#
6 23 (4.16%) JavaScript
7 20 (3.62%) T-SQL
8 18 (3.25%) Data Analysis Expressions (DAX)
9 17 (3.07%) PowerShell
9 17 (3.07%) R
10 13 (2.35%) Bash Shell
10 13 (2.35%) Kotlin
11 12 (2.17%) C
12 11 (1.99%) U-SQL
13 9 (1.63%) Go
14 7 (1.27%) Shell Script
15 5 (0.90%) PL/SQL
16 4 (0.72%) Clojure
16 4 (0.72%) PHP
17 3 (0.54%) Google Apps Script
Qualifications
1 52 (9.40%) Degree
2 10 (1.81%) Computer Science Degree
3 9 (1.63%) Microsoft Certification
4 6 (1.08%) AWS Certification
5 4 (0.72%) SC Cleared
5 4 (0.72%) Security Cleared
6 3 (0.54%) DBS Check
6 3 (0.54%) ISEB
6 3 (0.54%) ISTQB
6 3 (0.54%) Master's Degree
6 3 (0.54%) PhD
7 2 (0.36%) (ISC)2 CCSP
7 2 (0.36%) AAT
7 2 (0.36%) ACCA
7 2 (0.36%) CIMA
7 2 (0.36%) Cisco Certification
7 2 (0.36%) CISSP
8 1 (0.18%) PMI Certification
8 1 (0.18%) PMP
8 1 (0.18%) TOGAF Certification
Quality Assurance & Compliance
1 49 (8.86%) Data Quality
2 19 (3.44%) QA
3 10 (1.81%) GDPR
4 3 (0.54%) ISO/IEC 27001
5 1 (0.18%) Accessibility
5 1 (0.18%) NIST
5 1 (0.18%) PCI DSS
5 1 (0.18%) SOC 2
System Software
1 44 (7.96%) Docker
2 7 (1.27%) Active Directory
2 7 (1.27%) HDFS
3 3 (0.54%) Virtual Machines
4 2 (0.36%) Apache Flume
5 1 (0.18%) Hyper-V
Systems Management
1 53 (9.58%) Kubernetes
2 17 (3.07%) Terraform
3 8 (1.45%) Ansible
4 7 (1.27%) Puppet
5 5 (0.90%) Grafana
5 5 (0.90%) Istio
5 5 (0.90%) Prometheus
6 4 (0.72%) Oozie
7 3 (0.54%) HP ALM
7 3 (0.54%) HP Quality Center
8 1 (0.18%) Opscode Chef
8 1 (0.18%) Single Sign-On
Vendors
1 158 (28.57%) Databricks
2 129 (23.33%) Microsoft
3 41 (7.41%) Google
4 29 (5.24%) Salesforce.com
5 27 (4.88%) Oracle
6 23 (4.16%) Talend
7 15 (2.71%) Alteryx
8 12 (2.17%) Cloudera
9 10 (1.81%) IBM
10 9 (1.63%) Teradata
11 7 (1.27%) ServiceNow
12 6 (1.08%) Hortonworks
12 6 (1.08%) Okta
12 6 (1.08%) SAP
13 5 (0.90%) MuleSoft
14 4 (0.72%) Informatica
14 4 (0.72%) JD Edwards
14 4 (0.72%) Netezza
15 3 (0.54%) HP
15 3 (0.54%) TIBCO