Period
to 5 March 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 5 March 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
5 Mar 2021
Same period 2020 Same period 2019
Rank 239 293 431
Rank change year-on-year +54 +138 +48
Permanent jobs citing Data Lake 371 556 396
As % of all permanent jobs advertised in London 1.30% 1.09% 0.63%
As % of the Database & Business Intelligence category 4.52% 3.90% 2.12%
Number of salaries quoted 332 386 340
Median annual salary £80,000 £72,500 £67,500
Median salary % change year-on-year +10.34% +7.41% -3.57%
10th Percentile £52,500 £52,500 £44,875
90th Percentile £107,500 £95,000 £102,500
England median annual salary £67,500 £70,000 £65,000
% change year-on-year -3.57% +7.69% +6.56%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 8,206 14,245 18,692
As % of all permanent IT jobs advertised in London 28.81% 28.00% 29.79%
Number of salaries quoted 6,693 11,758 15,688
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £42,500 £38,750 £37,750
90th Percentile £100,000 £105,000 £95,000
England median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

Salary distribution for jobs citing Data Lake in London over the 6 months to 5 March 2021.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 5 March 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +128 113 £87,500 +25.00% 18
West London +53 7 £77,500 +19.23% 2
South London +19 7 £65,000 - 2
East London +14 5 £65,000 -18.75% 4
Data Lake
England

For the 6 months to 5 March 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 240 (64.69%) Azure
2 195 (52.56%) SQL
3 187 (50.40%) Data Warehouse
4 156 (42.05%) Business Intelligence
5 145 (39.08%) Analytics
6 144 (38.81%) Databricks
7 139 (37.47%) Power Platform
7 139 (37.47%) Python
8 136 (36.66%) ETL
9 134 (36.12%) AWS
10 127 (34.23%) SQL Server
11 117 (31.54%) Microsoft
12 104 (28.03%) Azure Data Factory
13 103 (27.76%) Big Data
13 103 (27.76%) DevOps
14 102 (27.49%) Power BI
15 96 (25.88%) Finance
16 94 (25.34%) Apache Spark
17 88 (23.72%) Azure SQL Database
18 82 (22.10%) Agile Software Development
19 79 (21.29%) Data Modelling
20 70 (18.87%) Hadoop
21 68 (18.33%) Microservices
22 67 (18.06%) Data Science
23 61 (16.44%) Data Analytics
24 59 (15.90%) NoSQL
25 54 (14.56%) GCP
26 51 (13.75%) PaaS
26 51 (13.75%) Data Engineering
27 49 (13.21%) .NET

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 94 (25.34%) Apache Spark
2 39 (10.51%) Apache
3 38 (10.24%) SharePoint
4 18 (4.85%) Apache Airflow
5 10 (2.70%) Elasticsearch
6 8 (2.16%) Luigi
7 6 (1.62%) Oracle Workflow
8 4 (1.08%) Jupyter
9 3 (0.81%) SAS
10 2 (0.54%) Confluence
10 2 (0.54%) Mule
10 2 (0.54%) Mule ESB
11 1 (0.27%) Apache Pig
11 1 (0.27%) Apache Synapse
11 1 (0.27%) IIS
11 1 (0.27%) OpenStack
Applications
1 12 (3.23%) Microsoft Excel
2 3 (0.81%) SPSS
2 3 (0.81%) SPSS Modeler
3 2 (0.54%) Microsoft Office
4 1 (0.27%) Microsoft PowerPoint
Business Applications
1 5 (1.35%) NetSuite
2 2 (0.54%) Dynamics AX
3 1 (0.27%) Magento
3 1 (0.27%) Sparx Enterprise Architect
Cloud Services
1 240 (64.69%) Azure
2 139 (37.47%) Power Platform
3 134 (36.12%) AWS
4 104 (28.03%) Azure Data Factory
5 54 (14.56%) GCP
6 51 (13.75%) PaaS
7 45 (12.13%) Dynamics 365
7 45 (12.13%) SaaS
8 32 (8.63%) Amazon S3
9 27 (7.28%) Serverless
10 22 (5.93%) Amazon EMR
11 18 (4.85%) Amazon Kinesis
11 18 (4.85%) AWS Lambda
12 10 (2.70%) Azure Functions
12 10 (2.70%) Logic Apps
13 9 (2.43%) Amazon EC2
13 9 (2.43%) Data Lake Analytics
14 7 (1.89%) GitHub
15 6 (1.62%) Cloud Computing
15 6 (1.62%) IaaS
Communications & Networking
1 4 (1.08%) Internet
2 3 (0.81%) Firewall
2 3 (0.81%) Wireless
3 2 (0.54%) FTP
3 2 (0.54%) Kerberos
4 1 (0.27%) Broadband
4 1 (0.27%) Extranet
Database & Business Intelligence
1 187 (50.40%) Data Warehouse
2 127 (34.23%) SQL Server
3 103 (27.76%) Big Data
4 102 (27.49%) Power BI
5 88 (23.72%) Azure SQL Database
6 70 (18.87%) Hadoop
7 59 (15.90%) NoSQL
8 46 (12.40%) Tableau
9 41 (11.05%) Amazon Redshift
10 37 (9.97%) SQL Server Analysis Services
11 33 (8.89%) SQL Server Integration Services
12 31 (8.36%) Snowflake Schema
13 30 (8.09%) Azure SQL Data Warehouse
14 29 (7.82%) Amazon Athena
14 29 (7.82%) Cosmos DB
15 28 (7.55%) Apache Hive
16 26 (7.01%) Amazon RDS
17 22 (5.93%) Looker
17 22 (5.93%) Relational Database
18 21 (5.66%) Data Mart
Development Applications
1 12 (3.23%) Git (software)
2 8 (2.16%) Jenkins
2 8 (2.16%) JIRA
3 6 (1.62%) Visual Studio
4 5 (1.35%) ER Studio
4 5 (1.35%) ERwin
5 4 (1.08%) Postman
6 3 (0.81%) CircleCI
6 3 (0.81%) SQL Server Management Studio (SSMS)
6 3 (0.81%) Team Foundation Server
7 2 (0.54%) NUnit
7 2 (0.54%) Subversion
7 2 (0.54%) Visual Studio Team System
7 2 (0.54%) xUnit.net
8 1 (0.27%) GoCD
8 1 (0.27%) Maven
8 1 (0.27%) Octopus Deploy
General
1 96 (25.88%) Finance
2 27 (7.28%) Banking
3 17 (4.58%) Front Office
3 17 (4.58%) Marketing
4 9 (2.43%) Games
4 9 (2.43%) Retail
5 8 (2.16%) Advertising
6 6 (1.62%) Law
7 5 (1.35%) iGaming
7 5 (1.35%) Telecoms
8 4 (1.08%) Housing Association
8 4 (1.08%) Investment Banking
9 3 (0.81%) Publishing
10 2 (0.54%) Back Office
10 2 (0.54%) Manufacturing
11 1 (0.27%) Automotive
11 1 (0.27%) Billing
11 1 (0.27%) General Ledger
11 1 (0.27%) Legal
11 1 (0.27%) Pharmaceutical
Job Titles
1 113 (30.46%) Data Engineer
2 94 (25.34%) Architect
3 58 (15.63%) Developer
4 50 (13.48%) Data Architect
5 44 (11.86%) Azure Architect
6 38 (10.24%) Analyst
7 33 (8.89%) Applications Architect
8 32 (8.63%) Enterprise Architect
9 28 (7.55%) Enterprise Applications Architect
10 27 (7.28%) Business Intelligence Developer
11 24 (6.47%) Senior Data Engineer
12 23 (6.20%) SaaS Architect
13 22 (5.93%) Big Data Engineer
14 20 (5.39%) Azure Developer
14 20 (5.39%) Consultant
14 20 (5.39%) Data Analyst
15 19 (5.12%) Azure Engineer
16 15 (4.04%) Python Engineer
17 13 (3.50%) AWS Engineer
17 13 (3.50%) Senior Consultant
Libraries, Frameworks & Software Standards
1 49 (13.21%) .NET
2 47 (12.67%) Kafka
3 44 (11.86%) XML
4 38 (10.24%) CSS
5 37 (9.97%) jQuery
5 37 (9.97%) Twitter Bootstrap
6 33 (8.89%) Ajax
7 24 (6.47%) PySpark
8 22 (5.93%) Web Services
9 13 (3.50%) Apache NiFi
10 12 (3.23%) Spring Boot
11 10 (2.70%) .NET Core
11 10 (2.70%) Spring
12 9 (2.43%) ADO
13 8 (2.16%) Pandas
13 8 (2.16%) SOAP
14 7 (1.89%) JSON
14 7 (1.89%) MDX
15 6 (1.62%) Node.js
15 6 (1.62%) REST
Miscellaneous
1 44 (11.86%) Analytical Skills
2 35 (9.43%) Enterprise Software
3 20 (5.39%) Management Information System
4 19 (5.12%) Greenfield Project
5 17 (4.58%) Data Structures
6 13 (3.50%) Algorithms
7 11 (2.96%) Market Risk
7 11 (2.96%) Reinsurance
8 10 (2.70%) Credit Risk
8 10 (2.70%) Fixed Income
9 9 (2.43%) Equities
9 9 (2.43%) Hedge funds
10 8 (2.16%) Blog
10 8 (2.16%) Foreign Exchange (FX)
11 7 (1.89%) Reference Data
12 6 (1.62%) Public Cloud
13 5 (1.35%) Data Centre
13 5 (1.35%) Online Games
13 5 (1.35%) PlayStation
13 5 (1.35%) Virtual Team
Operating Systems
1 7 (1.89%) Unix
2 6 (1.62%) Linux
2 6 (1.62%) Windows
3 1 (0.27%) Windows Server
Processes & Methodologies
1 156 (42.05%) Business Intelligence
2 145 (39.08%) Analytics
3 136 (36.66%) ETL
4 103 (27.76%) DevOps
5 82 (22.10%) Agile Software Development
6 79 (21.29%) Data Modelling
7 68 (18.33%) Microservices
8 67 (18.06%) Data Science
9 61 (16.44%) Data Analytics
10 51 (13.75%) Data Engineering
11 48 (12.94%) Continuous Integration
11 48 (12.94%) Visualisation
12 44 (11.86%) Test Automation
13 43 (11.59%) Data Architecture
14 41 (11.05%) Machine Learning
15 38 (10.24%) Deployment Automation
16 37 (9.97%) Computer Science
16 37 (9.97%) Migration
17 36 (9.70%) Fintech
18 33 (8.89%) Stakeholder Management
Programming Languages
1 195 (52.56%) SQL
2 139 (37.47%) Python
3 48 (12.94%) Java
4 38 (10.24%) Scala
5 26 (7.01%) C#
6 21 (5.66%) Data Analysis Expressions (DAX)
7 18 (4.85%) R
8 13 (3.50%) PowerShell
9 12 (3.23%) JavaScript
9 12 (3.23%) T-SQL
10 7 (1.89%) U-SQL
11 4 (1.08%) Go
11 4 (1.08%) VBA
12 3 (0.81%) Cython
12 3 (0.81%) Google Apps Script
12 3 (0.81%) Java 8
13 2 (0.54%) C++
14 1 (0.27%) C
14 1 (0.27%) PL/SQL
14 1 (0.27%) TypeScript
Qualifications
1 43 (11.59%) Degree
2 27 (7.28%) Computer Science Degree
3 10 (2.70%) ITIL Certification
4 7 (1.89%) Microsoft Certification
5 4 (1.08%) AWS Certification
6 3 (0.81%) AAT
6 3 (0.81%) ACCA
6 3 (0.81%) CIMA
6 3 (0.81%) DBS Check
6 3 (0.81%) PhD
7 2 (0.54%) Numerate Degree
8 1 (0.27%) Master's Degree
8 1 (0.27%) SC Cleared
8 1 (0.27%) Security Cleared
Quality Assurance & Compliance
1 18 (4.85%) Data Quality
2 15 (4.04%) QA
3 8 (2.16%) GDPR
4 2 (0.54%) SLA
5 1 (0.27%) Dodd-Frank
5 1 (0.27%) EMIR
5 1 (0.27%) ISO/IEC 20000
5 1 (0.27%) MiFID
System Software
1 12 (3.23%) Docker
2 5 (1.35%) HDFS
3 3 (0.81%) Active Directory
4 1 (0.27%) Apache Flume
4 1 (0.27%) Hyper-V
4 1 (0.27%) VMware Infrastructure
Systems Management
1 24 (6.47%) Kubernetes
1 24 (6.47%) Terraform
2 14 (3.77%) Puppet
3 9 (2.43%) Grafana
3 9 (2.43%) Packer
4 7 (1.89%) Oozie
5 5 (1.35%) Ansible
5 5 (1.35%) Opscode Chef
6 1 (0.27%) Failover Clustering
6 1 (0.27%) SCCM
6 1 (0.27%) vCenter Server
Vendors
1 144 (38.81%) Databricks
2 117 (31.54%) Microsoft
3 19 (5.12%) Google
4 17 (4.58%) Oracle
5 16 (4.31%) Talend
6 11 (2.96%) Salesforce.com
7 9 (2.43%) Informatica
8 7 (1.89%) Alteryx
9 6 (1.62%) StreamSets
10 5 (1.35%) Blue Prism
10 5 (1.35%) JD Edwards
10 5 (1.35%) SAP
11 4 (1.08%) Guidewire
11 4 (1.08%) MuleSoft
12 3 (0.81%) Ab Initio
12 3 (0.81%) Instagram
12 3 (0.81%) Twitter
13 2 (0.54%) Teradata
13 2 (0.54%) TIBCO
13 2 (0.54%) VMware