Period
to 29 September 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 29 September 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
29 Sep 2020
Same period 2019 Same period 2018
Rank 226 364 396
Rank change year-on-year +138 +32 +346
Permanent jobs citing Data Lake 283 444 505
As % of all permanent jobs advertised in London 1.43% 0.81% 0.74%
As % of the Database & Business Intelligence category 4.99% 2.85% 2.39%
Number of salaries quoted 211 401 384
Median annual salary £75,000 £70,000 £70,000
Median salary % change year-on-year +7.14% - -
10th Percentile £56,250 £43,750 £47,500
90th Percentile £97,000 £101,250 £100,000
England median annual salary £65,000 £65,000 £65,000

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 5,668 15,601 21,130
As % of all permanent IT jobs advertised in London 28.54% 28.41% 31.06%
Number of salaries quoted 4,732 12,909 16,805
Median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £42,500 £38,200 £37,500
90th Percentile £105,000 £97,500 £93,750
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% -

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

Salary distribution for jobs citing Data Lake in London over the 6 months to 29 September 2020.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 29 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +79 69 £72,500 -1.69% 15
South London +72 17 £67,500 +8.00% 2
West London +73 4 - - 2
East London +29 4 £65,000 +62.50% 3
Data Lake
England

For the 6 months to 29 September 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 169 (59.72%) SQL
2 163 (57.60%) Azure
3 159 (56.18%) Data Warehouse
4 151 (53.36%) Business Intelligence
5 130 (45.94%) Finance
6 128 (45.23%) Agile Software Development
7 111 (39.22%) Analytics
8 108 (38.16%) Databricks
9 106 (37.46%) Power Platform
10 100 (35.34%) Power BI
11 93 (32.86%) AWS
12 90 (31.80%) Python
12 90 (31.80%) Azure Data Factory
13 86 (30.39%) ETL
14 85 (30.04%) Microsoft
15 81 (28.62%) SQL Server
16 77 (27.21%) DevOps
17 75 (26.50%) Big Data
18 72 (25.44%) Apache Spark
19 71 (25.09%) Data Modelling
20 70 (24.73%) Kafka
21 65 (22.97%) Azure SQL Database
22 58 (20.49%) Data Engineering
23 54 (19.08%) SDLC
24 50 (17.67%) Azure SQL Data Warehouse
25 47 (16.61%) NoSQL
26 44 (15.55%) SQL Server Integration Services
26 44 (15.55%) SQL Server Analysis Services
26 44 (15.55%) Scala
26 44 (15.55%) Data Analytics

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 72 (25.44%) Apache Spark
2 21 (7.42%) Apache
3 9 (3.18%) Cloud Foundry
4 7 (2.47%) Apache Airflow
5 6 (2.12%) SharePoint
6 5 (1.77%) Luigi
7 4 (1.41%) Confluence
8 3 (1.06%) Apache Synapse
8 3 (1.06%) Jupyter
9 2 (0.71%) Apache Pig
9 2 (0.71%) Apache Solr
9 2 (0.71%) Oracle SOA Suite
10 1 (0.35%) CMS
10 1 (0.35%) Elasticsearch
Applications
1 3 (1.06%) Microsoft Excel
Business Applications
1 1 (0.35%) Dynamics CRM
Cloud Services
1 163 (57.60%) Azure
2 106 (37.46%) Power Platform
3 93 (32.86%) AWS
4 90 (31.80%) Azure Data Factory
5 36 (12.72%) GCP
6 33 (11.66%) Serverless
7 32 (11.31%) SaaS
8 28 (9.89%) Amazon S3
9 23 (8.13%) PaaS
10 19 (6.71%) Amazon CloudWatch
10 19 (6.71%) Amazon GuardDuty
10 19 (6.71%) AWS CloudTrail
11 17 (6.01%) PowerApps
12 14 (4.95%) IaaS
13 11 (3.89%) Amazon Kinesis
14 10 (3.53%) Amazon EMR
14 10 (3.53%) Data Lake Analytics
15 8 (2.83%) AWS Lambda
16 6 (2.12%) Amazon ElastiCache
16 6 (2.12%) Dynamics 365
Communications & Networking
1 1 (0.35%) Kerberos
Database & Business Intelligence
1 159 (56.18%) Data Warehouse
2 100 (35.34%) Power BI
3 81 (28.62%) SQL Server
4 75 (26.50%) Big Data
5 65 (22.97%) Azure SQL Database
6 50 (17.67%) Azure SQL Data Warehouse
7 47 (16.61%) NoSQL
8 44 (15.55%) SQL Server Analysis Services
8 44 (15.55%) SQL Server Integration Services
9 41 (14.49%) Snowflake Schema
10 40 (14.13%) Amazon Redshift
11 34 (12.01%) Hadoop
11 34 (12.01%) SQL Server Reporting Services
12 33 (11.66%) BigQuery
13 29 (10.25%) Cosmos DB
14 23 (8.13%) Amazon Athena
14 23 (8.13%) Microsoft Analysis Services
15 22 (7.77%) RDBMS
15 22 (7.77%) Relational Database
16 19 (6.71%) Looker
Development Applications
1 20 (7.07%) Git (software)
2 14 (4.95%) Visual Studio
3 7 (2.47%) GitLab
3 7 (2.47%) TeamCity
4 6 (2.12%) Atlassian Bamboo
4 6 (2.12%) Octopus Deploy
5 5 (1.77%) Artifactory
5 5 (1.77%) Jenkins
5 5 (1.77%) Team Foundation Server
6 4 (1.41%) JIRA
7 3 (1.06%) ER Studio
7 3 (1.06%) ERwin
7 3 (1.06%) Visual Studio Team System
8 2 (0.71%) GDB
8 2 (0.71%) JUnit
8 2 (0.71%) Selenium
8 2 (0.71%) SonarQube
8 2 (0.71%) Sourcetree
8 2 (0.71%) Subversion
8 2 (0.71%) tSQLt
General
1 130 (45.94%) Finance
2 34 (12.01%) Banking
3 16 (5.65%) Marketing
4 9 (3.18%) Retail
5 7 (2.47%) Front Office
6 5 (1.77%) Advertising
7 2 (0.71%) Back Office
7 2 (0.71%) Investment Banking
7 2 (0.71%) Pharmaceutical
8 1 (0.35%) Games
8 1 (0.35%) Legal
8 1 (0.35%) Manufacturing
8 1 (0.35%) Publishing
Job Titles
1 99 (34.98%) Data Engineer
2 66 (23.32%) Developer
3 50 (17.67%) Azure Engineer
4 46 (16.25%) Architect
5 35 (12.37%) Business Intelligence Developer
6 29 (10.25%) Azure Developer
7 22 (7.77%) Data Architect
8 20 (7.07%) AWS Engineer
9 19 (6.71%) SQL Developer
10 15 (5.30%) Analyst
11 14 (4.95%) Consultant
11 14 (4.95%) Senior Architect
12 13 (4.59%) Business Intelligence Manager
12 13 (4.59%) Lead Developer
12 13 (4.59%) Senior Developer
13 11 (3.89%) Business Analyst
13 11 (3.89%) Business Intelligence Lead
13 11 (3.89%) Senior Business Intelligence Developer
13 11 (3.89%) Solutions Architect
14 10 (3.53%) Python Engineer
Libraries, Frameworks & Software Standards
1 70 (24.73%) Kafka
2 35 (12.37%) .NET
3 23 (8.13%) PySpark
4 11 (3.89%) MDX
5 8 (2.83%) XML
6 7 (2.47%) J2EE
7 6 (2.12%) .NET Core
7 6 (2.12%) CSS
7 6 (2.12%) Web Services
8 5 (1.77%) jQuery
8 5 (1.77%) JSON
8 5 (1.77%) REST
8 5 (1.77%) Twitter Bootstrap
9 4 (1.41%) .NET Framework
9 4 (1.41%) ADO
9 4 (1.41%) ASP.NET Web API
9 4 (1.41%) Entity Framework
9 4 (1.41%) Node.js
9 4 (1.41%) Pandas
9 4 (1.41%) SOAP
Miscellaneous
1 30 (10.60%) Greenfield Project
2 25 (8.83%) Data Structures
3 22 (7.77%) Cloud Native
4 19 (6.71%) Enterprise Software
5 18 (6.36%) Analytical Skills
6 13 (4.59%) Management Information System
7 4 (1.41%) Equities
7 4 (1.41%) Reference Data
8 3 (1.06%) Foreign Exchange (FX)
8 3 (1.06%) PMI
9 2 (0.71%) Algorithms
9 2 (0.71%) Blog
9 2 (0.71%) Data Centre
9 2 (0.71%) Fixed Income
9 2 (0.71%) Hedge funds
9 2 (0.71%) N-Tier
9 2 (0.71%) Public Cloud
9 2 (0.71%) Virtual Team
10 1 (0.35%) Exotic Derivative
10 1 (0.35%) Replication
Operating Systems
1 6 (2.12%) Linux
2 3 (1.06%) Windows
3 1 (0.35%) Unix
Processes & Methodologies
1 151 (53.36%) Business Intelligence
2 128 (45.23%) Agile Software Development
3 111 (39.22%) Analytics
4 86 (30.39%) ETL
5 77 (27.21%) DevOps
6 71 (25.09%) Data Modelling
7 58 (20.49%) Data Engineering
8 54 (19.08%) SDLC
9 44 (15.55%) Data Analytics
10 34 (12.01%) Asset Management
10 34 (12.01%) Visualisation
11 31 (10.95%) Data Science
11 31 (10.95%) Data Visualisation
11 31 (10.95%) Fintech
12 28 (9.89%) Microservices
13 25 (8.83%) Data Integration
14 22 (7.77%) Computer Science
15 21 (7.42%) Cybersecurity
16 20 (7.07%) Security Architecture
16 20 (7.07%) Test Automation
Programming Languages
1 169 (59.72%) SQL
2 90 (31.80%) Python
3 44 (15.55%) Scala
4 26 (9.19%) C#
5 21 (7.42%) Java
5 21 (7.42%) T-SQL
6 20 (7.07%) Data Analysis Expressions (DAX)
7 16 (5.65%) PowerShell
8 15 (5.30%) JavaScript
9 13 (4.59%) R
10 9 (3.18%) C
11 8 (2.83%) U-SQL
12 6 (2.12%) VB.NET
13 3 (1.06%) VBA
14 2 (0.71%) Bash Shell
15 1 (0.35%) C++
15 1 (0.35%) Go
15 1 (0.35%) Julia
15 1 (0.35%) VB
Qualifications
1 22 (7.77%) Degree
2 9 (3.18%) AWS Certification
3 4 (1.41%) Computer Science Degree
3 4 (1.41%) Microsoft Certification
4 3 (1.06%) PMI Certification
5 2 (0.71%) Master's Degree
6 1 (0.35%) ITIL Certification
6 1 (0.35%) MBA
6 1 (0.35%) MCSA
6 1 (0.35%) PhD
6 1 (0.35%) Security Cleared
6 1 (0.35%) Sun Certification
Quality Assurance & Compliance
1 27 (9.54%) Data Quality
2 3 (1.06%) QA
3 1 (0.35%) Dodd-Frank
3 1 (0.35%) EMIR
3 1 (0.35%) GDPR
3 1 (0.35%) MiFID
System Software
1 11 (3.89%) Docker
2 8 (2.83%) HDFS
3 3 (1.06%) Active Directory
4 2 (0.71%) Virtual Machines
5 1 (0.35%) Apache Flume
5 1 (0.35%) Apache ZooKeeper
Systems Management
1 38 (13.43%) Kubernetes
2 14 (4.95%) Terraform
3 8 (2.83%) Hadoop YARN
4 4 (1.41%) Oozie
5 2 (0.71%) Nagios
5 2 (0.71%) Puppet
6 1 (0.35%) Argo
6 1 (0.35%) Grafana
6 1 (0.35%) Packer
Vendors
1 108 (38.16%) Databricks
2 85 (30.04%) Microsoft
3 29 (10.25%) Tableau
4 13 (4.59%) Oracle
5 11 (3.89%) Talend
6 7 (2.47%) StreamSets
7 5 (1.77%) Google
8 4 (1.41%) Hortonworks
8 4 (1.41%) Informatica
8 4 (1.41%) Sybase
9 3 (1.06%) Ab Initio
9 3 (1.06%) Guidewire
9 3 (1.06%) IBM
9 3 (1.06%) MuleSoft
9 3 (1.06%) Netezza
9 3 (1.06%) Teradata
10 2 (0.71%) Actuate
10 2 (0.71%) Cognos
10 2 (0.71%) Facebook
10 2 (0.71%) Salesforce.com