Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 16 October 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 16 October 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
16 Oct 2021		 Same period 2020 Same period 2019
Rank 249 218 363
Rank change year-on-year -31 +145 +41
Permanent jobs citing Data Lake 744 293 445
As % of all permanent jobs advertised in London 1.49% 1.51% 0.81%
As % of the Database & Business Intelligence category 4.66% 5.26% 2.79%
Number of salaries quoted 585 230 384
10th Percentile £55,000 £57,500 £43,750
25th Percentile £63,750 £62,500 £56,250
Median annual salary (50th Percentile) £80,000 £75,000 £72,500
Median % change year-on-year +6.67% +3.45% +3.57%
75th Percentile £95,000 £92,500 £87,500
90th Percentile £110,000 £102,750 £101,250
England median annual salary £70,000 £66,750 £65,000
% change year-on-year +4.87% +2.69% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 15,966 5,573 15,926
As % of all permanent IT jobs advertised in London 31.89% 28.76% 29.06%
Number of salaries quoted 9,447 4,731 13,288
10th Percentile £45,000 £42,500 £37,500
25th Percentile £54,250 £52,500 £48,750
Median annual salary (50th Percentile) £70,000 £70,000 £65,000
Median % change year-on-year - +7.69% +4.00%
75th Percentile £90,000 £86,250 £82,500
90th Percentile £107,500 £105,000 £98,750
England median annual salary £58,500 £55,000 £52,500
% change year-on-year +6.36% +4.76% +5.00%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

Salary distribution for jobs citing Data Lake in London over the 6 months to 16 October 2021.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 16 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
Central London +18 163 £80,000 - 31
East London -13 10 £95,000 +46.15% 10
South London -32 10 £60,000 -7.69% 6
West London -73 10 £55,000 - 8
Data Lake
England

For the 6 months to 16 October 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 428 (57.53%) SQL
2 425 (57.12%) Azure
3 408 (54.84%) Data Warehouse
4 339 (45.56%) Analytics
5 319 (42.88%) Python
6 306 (41.13%) Business Intelligence
7 284 (38.17%) AWS
8 265 (35.62%) ETL
9 249 (33.47%) Agile Software Development
10 244 (32.80%) Data Modelling
11 222 (29.84%) Databricks
12 197 (26.48%) Data Engineering
12 197 (26.48%) Big Data
13 193 (25.94%) Azure Data Factory
14 180 (24.19%) Apache Spark
15 179 (24.06%) DevOps
16 178 (23.92%) Data Pipeline
17 176 (23.66%) Finance
18 175 (23.52%) Microsoft
19 167 (22.45%) Power Platform
20 165 (22.18%) Power BI
21 143 (19.22%) Social Skills
22 137 (18.41%) GCP
23 134 (18.01%) Data Science
24 132 (17.74%) SQL Server
25 119 (15.99%) Hadoop
26 112 (15.05%) Azure SQL Database
27 109 (14.65%) Data Architecture
27 109 (14.65%) Java
28 106 (14.25%) NoSQL

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 180 (24.19%) Apache Spark
2 58 (7.80%) Apache
3 55 (7.39%) Apache Airflow
4 33 (4.44%) Confluence
5 13 (1.75%) SharePoint
6 8 (1.08%) Luigi
7 7 (0.94%) Elasticsearch
7 7 (0.94%) Oracle SOA Suite
8 6 (0.81%) Apache Pig
9 3 (0.40%) Jupyter
9 3 (0.40%) Oracle Workflow
9 3 (0.40%) SAS
10 1 (0.13%) CMS
10 1 (0.13%) IIS
10 1 (0.13%) JBoss
Applications
1 12 (1.61%) Microsoft Office
2 11 (1.48%) Microsoft Excel
3 8 (1.08%) Microsoft Project
3 8 (1.08%) MS Visio
4 2 (0.27%) Microsoft PowerPoint
5 1 (0.13%) SPSS
Business Applications
1 7 (0.94%) Dynamics CRM
2 2 (0.27%) Magento
2 2 (0.27%) Sparx Enterprise Architect
3 1 (0.13%) SAP Oil and Gas
Cloud Services
1 425 (57.12%) Azure
2 284 (38.17%) AWS
3 193 (25.94%) Azure Data Factory
4 167 (22.45%) Power Platform
5 137 (18.41%) GCP
6 76 (10.22%) Azure Synapse Analytics
7 75 (10.08%) Snowflake
8 60 (8.06%) Amazon S3
9 53 (7.12%) Serverless
10 43 (5.78%) PaaS
11 41 (5.51%) Amazon Kinesis
12 38 (5.11%) Azure Cosmos DB
13 34 (4.57%) AWS Lambda
14 28 (3.76%) SaaS
15 27 (3.63%) GitHub
16 26 (3.49%) Amazon SQS
17 25 (3.36%) Azure Storage
18 21 (2.82%) Amazon EC2
19 20 (2.69%) Amazon ECS
20 19 (2.55%) Azure Service Bus
Communications & Networking
1 25 (3.36%) Wireless
2 12 (1.61%) 4G
2 12 (1.61%) 5G
3 4 (0.54%) Cisco IPT
3 4 (0.54%) HTTP
3 4 (0.54%) VPN
4 3 (0.40%) Broadband
5 2 (0.27%) DNS
5 2 (0.27%) FTP
6 1 (0.13%) ATM
6 1 (0.13%) Network Security
Database & Business Intelligence
1 408 (54.84%) Data Warehouse
2 197 (26.48%) Big Data
3 165 (22.18%) Power BI
4 132 (17.74%) SQL Server
5 119 (15.99%) Hadoop
6 112 (15.05%) Azure SQL Database
7 106 (14.25%) NoSQL
8 88 (11.83%) Relational Database
9 77 (10.35%) PostgreSQL
9 77 (10.35%) SQL Server Integration Services
10 67 (9.01%) Amazon Redshift
11 61 (8.20%) SQL Server Analysis Services
12 54 (7.26%) Tableau
13 53 (7.12%) Apache Hive
14 49 (6.59%) BigQuery
15 48 (6.45%) MongoDB
16 42 (5.65%) Amazon RDS
17 41 (5.51%) Metadata
18 39 (5.24%) Azure SQL Data Warehouse
18 39 (5.24%) SQL Server Reporting Services
Development Applications
1 65 (8.74%) JIRA
2 59 (7.93%) Git (software)
3 31 (4.17%) CircleCI
4 30 (4.03%) Jenkins
5 26 (3.49%) Visual Studio
6 12 (1.61%) Team Foundation Server
7 10 (1.34%) ER Studio
8 9 (1.21%) Bitbucket
8 9 (1.21%) ERwin
9 8 (1.08%) Octopus Deploy
9 8 (1.08%) TeamCity
10 7 (0.94%) NUnit
10 7 (0.94%) Postman
10 7 (0.94%) Selenium
10 7 (0.94%) SpecFlow
11 5 (0.67%) kappa
11 5 (0.67%) PowerDesigner
11 5 (0.67%) SQL Server Management Studio (SSMS)
12 4 (0.54%) GDB
12 4 (0.54%) Visual Studio Code
General
1 176 (23.66%) Finance
2 143 (19.22%) Social Skills
3 76 (10.22%) Analytical Skills
4 40 (5.38%) Retail
5 38 (5.11%) Telecoms
6 33 (4.44%) Banking
7 31 (4.17%) Marketing
8 24 (3.23%) Presentation Skills
9 17 (2.28%) Law
10 13 (1.75%) Advertising
10 13 (1.75%) Front Office
11 9 (1.21%) Manufacturing
12 8 (1.08%) Legal
13 6 (0.81%) Investment Banking
14 5 (0.67%) Financial Institution
14 5 (0.67%) Games
14 5 (0.67%) Influencing Skills
15 4 (0.54%) Czech Language
15 4 (0.54%) Organisational Skills
15 4 (0.54%) Publishing
Job Titles
1 283 (38.04%) Data Engineer
2 186 (25.00%) Architect
3 145 (19.49%) Data Architect
4 80 (10.75%) Developer
5 61 (8.20%) Azure Engineer
6 56 (7.53%) Senior Data Engineer
7 51 (6.85%) Solutions Architect
8 37 (4.97%) AWS Engineer
9 33 (4.44%) Azure Architect
9 33 (4.44%) Python Engineer
10 30 (4.03%) Big Data Architect
10 30 (4.03%) Software Engineer
11 28 (3.76%) Analyst
12 25 (3.36%) Big Data Engineer
12 25 (3.36%) Lead Architect
13 21 (2.82%) Lead Data Architect
14 20 (2.69%) Business Intelligence Developer
15 19 (2.55%) Azure Developer
16 17 (2.28%) Cloud Architect
16 17 (2.28%) Consultant
Libraries, Frameworks & Software Standards
1 93 (12.50%) Kafka
2 67 (9.01%) PySpark
3 32 (4.30%) .NET
3 32 (4.30%) Web Services
4 24 (3.23%) HTML
5 22 (2.96%) React
6 20 (2.69%) Django
7 19 (2.55%) MDX
8 18 (2.42%) CSS
9 15 (2.02%) RESTful
10 14 (1.88%) JSON
10 14 (1.88%) XML
11 12 (1.61%) REST
12 10 (1.34%) .NET Core
13 9 (1.21%) .NET Framework
13 9 (1.21%) AngularJS
13 9 (1.21%) ASP.NET
13 9 (1.21%) HTML5
13 9 (1.21%) Middleware
14 8 (1.08%) jQuery
Miscellaneous
1 32 (4.30%) Greenfield Project
2 30 (4.03%) Management Information System
3 27 (3.63%) Algorithms
3 27 (3.63%) Self-Motivation
4 26 (3.49%) Virtual Team
5 23 (3.09%) Data Structures
6 22 (2.96%) Cloud Native
7 18 (2.42%) Public Cloud
7 18 (2.42%) Renewable Energy
8 12 (1.61%) Data Centre
8 12 (1.61%) Enterprise Software
8 12 (1.61%) User Experience
9 9 (1.21%) Reinsurance
10 8 (1.08%) Foreign Exchange (FX)
11 7 (0.94%) Derivative
12 6 (0.81%) Marketing Technology
13 5 (0.67%) Data Protection Act
13 5 (0.67%) Fixed Income
13 5 (0.67%) Hybrid Cloud
13 5 (0.67%) Reference Data
Operating Systems
1 15 (2.02%) Unix
2 13 (1.75%) Linux
3 12 (1.61%) Windows
4 4 (0.54%) VMS
5 2 (0.27%) Windows Server
Processes & Methodologies
1 339 (45.56%) Analytics
2 306 (41.13%) Business Intelligence
3 265 (35.62%) ETL
4 249 (33.47%) Agile Software Development
5 244 (32.80%) Data Modelling
6 197 (26.48%) Data Engineering
7 179 (24.06%) DevOps
8 178 (23.92%) Data Pipeline
9 134 (18.01%) Data Science
10 109 (14.65%) Data Architecture
11 103 (13.84%) Visualisation
12 99 (13.31%) Microservices
13 94 (12.63%) Problem-Solving
14 92 (12.37%) Data Management
15 81 (10.89%) Data Analytics
16 77 (10.35%) Mentoring
17 75 (10.08%) Data Integration
18 74 (9.95%) Data Strategy
19 71 (9.54%) Scrum
20 67 (9.01%) Software Engineering
Programming Languages
1 428 (57.53%) SQL
2 319 (42.88%) Python
3 109 (14.65%) Java
4 70 (9.41%) C#
5 62 (8.33%) PowerShell
6 48 (6.45%) Scala
7 39 (5.24%) T-SQL
8 36 (4.84%) Data Analysis Expressions (DAX)
8 36 (4.84%) JavaScript
9 34 (4.57%) R
10 22 (2.96%) Go
11 18 (2.42%) Bash Shell
12 13 (1.75%) Kotlin
13 12 (1.61%) U-SQL
14 10 (1.34%) C
15 9 (1.21%) Shell Script
16 7 (0.94%) PL/SQL
17 5 (0.67%) PHP
18 3 (0.40%) Clojure
19 2 (0.27%) COBOL
Qualifications
1 55 (7.39%) Degree
2 11 (1.48%) Computer Science Degree
3 9 (1.21%) Microsoft Certification
4 7 (0.94%) AWS Certification
4 7 (0.94%) ISEB
4 7 (0.94%) ISTQB
5 4 (0.54%) (ISC)2 CCSP
5 4 (0.54%) Cisco Certification
5 4 (0.54%) CISSP
5 4 (0.54%) Master's Degree
6 3 (0.40%) TOGAF Certification
7 2 (0.27%) CCSP
7 2 (0.27%) PhD
7 2 (0.27%) SC Cleared
7 2 (0.27%) Security Cleared
8 1 (0.13%) IBM Certification
8 1 (0.13%) ITIL Foundation Certificate
8 1 (0.13%) Numerate Degree
8 1 (0.13%) PMI Certification
8 1 (0.13%) PMP
Quality Assurance & Compliance
1 64 (8.60%) Data Quality
2 28 (3.76%) QA
3 16 (2.15%) GDPR
4 4 (0.54%) Accessibility
4 4 (0.54%) Actionable Recommendations
4 4 (0.54%) PCI DSS
4 4 (0.54%) SOC 2
5 3 (0.40%) ISO/IEC 27001
6 1 (0.13%) NIST
System Software
1 68 (9.14%) Docker
2 9 (1.21%) Virtual Machines
3 7 (0.94%) Active Directory
4 5 (0.67%) Apache Flume
5 3 (0.40%) HDFS
6 1 (0.13%) Apache ZooKeeper
6 1 (0.13%) Hyper-V
6 1 (0.13%) Virtual Desktop
Systems Management
1 68 (9.14%) Kubernetes
2 29 (3.90%) Terraform
3 7 (0.94%) Grafana
3 7 (0.94%) HP ALM
3 7 (0.94%) HP Quality Center
3 7 (0.94%) Istio
3 7 (0.94%) Prometheus
4 5 (0.67%) Ansible
5 4 (0.54%) Oozie
6 3 (0.40%) Puppet
7 1 (0.13%) Hadoop YARN
7 1 (0.13%) Opscode Chef
Vendors
1 222 (29.84%) Databricks
2 175 (23.52%) Microsoft
3 66 (8.87%) Google
4 28 (3.76%) Salesforce.com
5 26 (3.49%) Oracle
6 22 (2.96%) Talend
7 16 (2.15%) IBM
8 14 (1.88%) Alteryx
9 13 (1.75%) Cloudera
10 11 (1.48%) ServiceNow
11 8 (1.08%) Hortonworks
11 8 (1.08%) Teradata
12 7 (0.94%) HP
12 7 (0.94%) MuleSoft
13 6 (0.81%) Okta
14 5 (0.67%) Netezza
14 5 (0.67%) Palantir
14 5 (0.67%) Sybase
15 4 (0.54%) Cognos
15 4 (0.54%) SAP