Period
to 31 May 2020

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 31 May 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
31 May 2020
Same period 2019 Same period 2018
Rank 215 404 365
Rank change year-on-year +189 -39 +365
Permanent jobs citing Data Lake 593 422 603
As % of all permanent jobs advertised in London 1.59% 0.72% 0.87%
As % of the Database & Business Intelligence category 5.70% 2.51% 2.77%
Number of salaries quoted 344 373 475
Median annual salary £72,500 £70,000 £70,000
Median salary % change year-on-year +3.57% - -
10th Percentile £55,000 £47,750 £50,000
90th Percentile £91,250 £102,250 £103,250
England median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% +0.81%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 10,399 16,797 21,806
As % of all permanent IT jobs advertised in London 27.81% 28.81% 31.40%
Number of salaries quoted 8,455 13,947 17,314
Median annual salary £67,500 £65,000 £60,000
Median salary % change year-on-year +3.85% +8.33% -
10th Percentile £40,000 £38,750 £37,500
90th Percentile £105,000 £95,000 £92,500
England median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

Salary distribution for jobs citing Data Lake in London over the 6 months to 31 May 2020.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 31 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +23 94 £67,500 -6.90% 6
West London +74 50 £65,000 -7.14% 2
South London +63 49 £62,500 - 1
North London +27 43 £82,500 -4.35%
East London +29 20 - -
Data Lake
England

For the 6 months to 31 May 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 462 (77.91%) SQL
2 423 (71.33%) Business Intelligence
3 380 (64.08%) Analytics
4 329 (55.48%) ETL
5 326 (54.97%) SQL Server
6 288 (48.57%) Data Warehouse
7 260 (43.84%) Azure
8 248 (41.82%) Python
9 238 (40.13%) Tableau
10 230 (38.79%) Data Analytics
11 227 (38.28%) Power Platform
12 218 (36.76%) Power BI
13 207 (34.91%) Analytical Skills
14 205 (34.57%) Agile Software Development
15 200 (33.73%) Oracle
16 185 (31.20%) Data Analysis
17 175 (29.51%) Proactive Monitoring
18 171 (28.84%) Degree
19 167 (28.16%) Microsoft
20 164 (27.66%) Teradata
21 162 (27.32%) Alteryx
22 160 (26.98%) Data Extraction
23 158 (26.64%) Visualisation
23 158 (26.64%) Blue Prism
23 158 (26.64%) Cadence
23 158 (26.64%) UiPath
23 158 (26.64%) Automation Anywhere
24 139 (23.44%) Data Modelling
25 138 (23.27%) Azure Data Factory
26 131 (22.09%) Finance

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 81 (13.66%) Apache Spark
2 18 (3.04%) Apache Airflow
3 10 (1.69%) Apache
4 8 (1.35%) Confluence
5 7 (1.18%) Elasticsearch
5 7 (1.18%) Oracle Workflow
6 4 (0.67%) IIS
6 4 (0.67%) SharePoint
7 3 (0.51%) Luigi
7 3 (0.51%) Oracle SOA Suite
8 2 (0.34%) Anypoint
8 2 (0.34%) Apache Solr
8 2 (0.34%) SAS
9 1 (0.17%) Apache Pig
9 1 (0.17%) Apache Synapse
9 1 (0.17%) CMS
Applications
1 15 (2.53%) Microsoft Office
2 6 (1.01%) Microsoft Excel
Business Applications
1 1 (0.17%) NetSuite
1 1 (0.17%) SimCorp Dimension
Cloud Services
1 260 (43.84%) Azure
2 227 (38.28%) Power Platform
3 138 (23.27%) Azure Data Factory
4 119 (20.07%) AWS
5 57 (9.61%) GCP
6 37 (6.24%) SaaS
7 36 (6.07%) PaaS
8 31 (5.23%) Amazon S3
8 31 (5.23%) Serverless
9 28 (4.72%) Data Lake Analytics
10 25 (4.22%) IaaS
11 15 (2.53%) Amazon EMR
11 15 (2.53%) Logic Apps
12 14 (2.36%) Azure Active Directory
12 14 (2.36%) PowerApps
13 13 (2.19%) Azure Machine Learning
13 13 (2.19%) Office 365
14 12 (2.02%) Amazon CloudWatch
15 10 (1.69%) Amazon GuardDuty
15 10 (1.69%) AWS CloudTrail
Communications & Networking
1 2 (0.34%) Skype
2 1 (0.17%) Internet
Database & Business Intelligence
1 326 (54.97%) SQL Server
2 288 (48.57%) Data Warehouse
3 218 (36.76%) Power BI
4 122 (20.57%) Big Data
5 103 (17.37%) Azure SQL Database
6 87 (14.67%) SQL Server Analysis Services
7 85 (14.33%) SQL Server Integration Services
8 83 (14.00%) Oracle Reports
9 79 (13.32%) Azure SQL Data Warehouse
10 56 (9.44%) SQL Server Reporting Services
11 54 (9.11%) Snowflake Schema
12 49 (8.26%) Microsoft Analysis Services
13 44 (7.42%) Amazon Redshift
13 44 (7.42%) Hadoop
14 43 (7.25%) NoSQL
15 37 (6.24%) Cosmos DB
16 31 (5.23%) BigQuery
17 26 (4.38%) Relational Database
18 25 (4.22%) Looker
19 20 (3.37%) PolyBase
Development Applications
1 32 (5.40%) Git (software)
2 21 (3.54%) Visual Studio
3 11 (1.85%) TeamCity
4 8 (1.35%) GitLab
4 8 (1.35%) Jenkins
5 7 (1.18%) JIRA
5 7 (1.18%) Visual Studio Team System
6 6 (1.01%) ERwin
7 5 (0.84%) Atlassian Bamboo
7 5 (0.84%) ER Studio
7 5 (0.84%) GDB
7 5 (0.84%) Octopus Deploy
7 5 (0.84%) Sourcetree
8 4 (0.67%) Artifactory
8 4 (0.67%) SQL Server Management Studio (SSMS)
8 4 (0.67%) Visual Studio Code
9 3 (0.51%) CircleCI
9 3 (0.51%) GoCD
10 2 (0.34%) Travis CI
10 2 (0.34%) tSQLt
General
1 131 (22.09%) Finance
2 91 (15.35%) Legal
3 34 (5.73%) Marketing
4 19 (3.20%) Banking
5 9 (1.52%) Advertising
6 7 (1.18%) Publishing
7 6 (1.01%) Retail
8 4 (0.67%) Investment Banking
8 4 (0.67%) Public Sector
9 2 (0.34%) Financial Institution
9 2 (0.34%) Front Office
9 2 (0.34%) Police
10 1 (0.17%) Automotive
10 1 (0.17%) Back Office
10 1 (0.17%) Law
Job Titles
1 191 (32.21%) Data Engineer
2 153 (25.80%) Analyst
3 131 (22.09%) Data Analyst
4 86 (14.50%) Developer
5 79 (13.32%) Architect
5 79 (13.32%) Azure Engineer
6 55 (9.27%) Senior Analyst
7 54 (9.11%) Senior Data Analyst
8 53 (8.94%) Senior Data Engineer
9 49 (8.26%) Data Manager
10 47 (7.93%) SQL Developer
11 45 (7.59%) Data Architect
12 36 (6.07%) Business Intelligence Developer
13 26 (4.38%) Data Warehouse Developer
13 26 (4.38%) SQL BI Developer
14 25 (4.22%) Consultant
15 24 (4.05%) SSIS Developer
16 21 (3.54%) AWS Engineer
17 20 (3.37%) Data Consultant
17 20 (3.37%) SSRS Developer
Libraries, Frameworks & Software Standards
1 56 (9.44%) .NET
2 53 (8.94%) Kafka
3 25 (4.22%) MDX
4 23 (3.88%) PySpark
5 16 (2.70%) HTML
5 16 (2.70%) Web Services
6 9 (1.52%) HTML5
6 9 (1.52%) JSON
7 6 (1.01%) ASP.NET
8 5 (0.84%) Spark Streaming
8 5 (0.84%) XML
9 4 (0.67%) ADO
9 4 (0.67%) Apache NiFi
9 4 (0.67%) Lambda Expressions
9 4 (0.67%) REST
10 3 (0.51%) Apache Avro
10 3 (0.51%) CSS
10 3 (0.51%) Natural Language Processing
10 3 (0.51%) React
10 3 (0.51%) scikit-learn
Miscellaneous
1 207 (34.91%) Analytical Skills
2 55 (9.27%) Greenfield Project
3 29 (4.89%) Management Information System
4 23 (3.88%) Enterprise Software
5 21 (3.54%) Data Structures
6 18 (3.04%) Cloud Native
7 14 (2.36%) Self-Motivation
8 9 (1.52%) Cyberthreat
9 6 (1.01%) Virtual Team
10 5 (0.84%) Algorithms
10 5 (0.84%) N-Tier
10 5 (0.84%) Reference Data
11 4 (0.67%) PMI
12 3 (0.51%) Digital Media
12 3 (0.51%) Market Risk
13 2 (0.34%) Analytical Mindset
13 2 (0.34%) Fixed Income
13 2 (0.34%) Marketing Technology
13 2 (0.34%) Taxonomies
13 2 (0.34%) User Experience
Operating Systems
1 23 (3.88%) Windows
2 21 (3.54%) Windows Server
3 11 (1.85%) Windows 10
4 6 (1.01%) Linux
5 2 (0.34%) Unix
5 2 (0.34%) Windows 7
Processes & Methodologies
1 423 (71.33%) Business Intelligence
2 380 (64.08%) Analytics
3 329 (55.48%) ETL
4 230 (38.79%) Data Analytics
5 205 (34.57%) Agile Software Development
6 185 (31.20%) Data Analysis
7 175 (29.51%) Proactive Monitoring
8 160 (26.98%) Data Extraction
9 158 (26.64%) Visualisation
10 139 (23.44%) Data Modelling
11 93 (15.68%) User Acceptance Testing
12 87 (14.67%) Data Engineering
13 84 (14.17%) Project Management
14 81 (13.66%) System Integration Testing
15 77 (12.98%) Change Control
16 67 (11.30%) Data Science
17 60 (10.12%) Data Visualisation
18 59 (9.95%) Fintech
19 55 (9.27%) Data Architecture
20 48 (8.09%) DevOps
Programming Languages
1 462 (77.91%) SQL
2 248 (41.82%) Python
3 63 (10.62%) Scala
4 61 (10.29%) T-SQL
5 55 (9.27%) C#
6 47 (7.93%) R
7 39 (6.58%) PowerShell
8 35 (5.90%) Java
9 28 (4.72%) Data Analysis Expressions (DAX)
10 25 (4.22%) U-SQL
11 19 (3.20%) JavaScript
12 14 (2.36%) VB.NET
13 8 (1.35%) C
14 7 (1.18%) PL/SQL
14 7 (1.18%) VBA
15 4 (0.67%) Go
15 4 (0.67%) PHP
16 3 (0.51%) VB
17 2 (0.34%) ES6
17 2 (0.34%) Ruby
Qualifications
1 171 (28.84%) Degree
2 12 (2.02%) Microsoft Certification
3 9 (1.52%) (ISC)2 CCSP
3 9 (1.52%) CCSP
3 9 (1.52%) Cisco Certification
3 9 (1.52%) CISSP
3 9 (1.52%) CompTIA Security+
4 5 (0.84%) Computer Science Degree
4 5 (0.84%) PMI Certification
5 4 (0.67%) AWS Certification
6 3 (0.51%) Security Cleared
7 2 (0.34%) SC Cleared
8 1 (0.17%) MCSA
8 1 (0.17%) PMP
8 1 (0.17%) PRINCE2 Certification
Quality Assurance & Compliance
1 81 (13.66%) GAAP
2 44 (7.42%) Data Quality
3 13 (2.19%) GDPR
4 10 (1.69%) QA
5 2 (0.34%) EMIR
5 2 (0.34%) IFRS
5 2 (0.34%) MiFID
System Software
1 18 (3.04%) Docker
2 12 (2.02%) Active Directory
3 9 (1.52%) Virtual Machines
4 7 (1.18%) Apache ZooKeeper
5 5 (0.84%) HDFS
6 2 (0.34%) Apache Flume
6 2 (0.34%) Hyper-V
6 2 (0.34%) VMware Infrastructure
Systems Management
1 31 (5.23%) Kubernetes
2 14 (2.36%) Terraform
3 11 (1.85%) Oozie
4 9 (1.52%) Microsoft Intune
4 9 (1.52%) Single Sign-On
5 8 (1.35%) Hadoop YARN
6 6 (1.01%) Puppet
7 4 (0.67%) Ansible
8 3 (0.51%) Argo
8 3 (0.51%) Opscode Chef
9 2 (0.34%) Kibana
10 1 (0.17%) Grafana
10 1 (0.17%) Prometheus
Vendors
1 238 (40.13%) Tableau
2 200 (33.73%) Oracle
3 167 (28.16%) Microsoft
4 164 (27.66%) Teradata
5 162 (27.32%) Alteryx
6 158 (26.64%) Automation Anywhere
6 158 (26.64%) Blue Prism
6 158 (26.64%) Cadence
6 158 (26.64%) UiPath
7 116 (19.56%) Databricks
8 24 (4.05%) Google
9 12 (2.02%) Informatica
9 12 (2.02%) Salesforce.com
10 9 (1.52%) Hortonworks
10 9 (1.52%) Netezza
11 8 (1.35%) IBM
12 7 (1.18%) StreamSets
12 7 (1.18%) Workday
13 5 (0.84%) Adobe
13 5 (0.84%) Talend