Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 16 May 2022 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
16 May 2022		 Same period 2021 Same period 2020
Rank 238 286 229
Rank change year-on-year +48 -57 +184
Permanent jobs citing Data Lake 1,157 377 605
As % of all permanent jobs advertised in London 1.68% 1.13% 1.51%
As % of the Database & Business Intelligence category 5.30% 3.94% 5.52%
Number of salaries quoted 583 308 362
10th Percentile £52,500 £52,500 £55,000
25th Percentile £63,750 £63,750 £61,250
Median annual salary (50th Percentile) £80,000 £80,000 £72,500
Median % change year-on-year - +10.34% +3.19%
75th Percentile £95,000 £100,313 £85,938
90th Percentile £115,000 £109,125 £91,250
England median annual salary £70,000 £70,000 £70,000
% change year-on-year - - +5.26%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,849 9,572 10,961
As % of all permanent IT jobs advertised in London 31.77% 28.61% 27.34%
Number of salaries quoted 8,877 7,010 9,024
10th Percentile £45,000 £43,750 £40,000
25th Percentile £53,750 £52,500 £50,000
Median annual salary (50th Percentile) £70,000 £70,000 £65,000
Median % change year-on-year - +7.69% -
75th Percentile £90,000 £87,500 £85,000
90th Percentile £107,500 £101,250 £105,000
England median annual salary £60,000 £55,000 £55,000
% change year-on-year +9.09% - +4.76%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

Salary distribution for jobs citing Data Lake in London over the 6 months to 16 May 2022.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 16 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Jobs
Central London -21 125 £77,500 -6.06% 27
West London -46 35 £75,000 -3.23% 5
South London -23 24 £48,500 -19.17% 1
East London - 5 £95,000 - 8
North London - 2 £45,750 -
Data Lake
England

For the 6 months to 16 May 2022, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 691 (59.72%) Azure
2 659 (56.96%) Data Warehouse
3 635 (54.88%) SQL
4 591 (51.08%) Python
5 565 (48.83%) Agile
6 533 (46.07%) ETL
7 520 (44.94%) Analytics
8 490 (42.35%) AWS
9 426 (36.82%) Business Intelligence
10 389 (33.62%) Data Engineering
11 371 (32.07%) Finance
12 354 (30.60%) Data Modelling
13 353 (30.51%) Big Data
14 344 (29.73%) Social Skills
15 339 (29.30%) Databricks
16 326 (28.18%) Data Pipeline
17 312 (26.97%) DevOps
18 285 (24.63%) Apache Spark
19 274 (23.68%) Azure Data Factory
20 273 (23.60%) Data Science
21 270 (23.34%) CI/CD
22 261 (22.56%) GCP
23 249 (21.52%) Power Platform
24 248 (21.43%) Power BI
25 243 (21.00%) Machine Learning
26 238 (20.57%) Analytical Skills
27 218 (18.84%) Data Architecture
28 213 (18.41%) NoSQL
28 213 (18.41%) SQL Server
29 211 (18.24%) Java

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 285 (24.63%) Apache Spark
2 139 (12.01%) Apache Airflow
3 118 (10.20%) Apache
4 33 (2.85%) Confluence
5 26 (2.25%) Oracle Workflow
6 21 (1.82%) Elasticsearch
7 14 (1.21%) SAS
8 10 (0.86%) Luigi
8 10 (0.86%) SharePoint
9 8 (0.69%) Apache Pig
9 8 (0.69%) Apache Pulsar
10 3 (0.26%) Oracle Coherence
11 2 (0.17%) IIS
12 1 (0.086%) CMS
12 1 (0.086%) Jupyter
12 1 (0.086%) nginx
Applications
1 23 (1.99%) Microsoft Excel
2 20 (1.73%) Stata
3 5 (0.43%) Microsoft Office
4 4 (0.35%) MS Visio
5 3 (0.26%) Microsoft PowerPoint
6 2 (0.17%) Spreadsheet
7 1 (0.086%) SPSS
Business Applications
1 14 (1.21%) Oracle Payables
2 11 (0.95%) JDE OneWorld
3 4 (0.35%) Magento
3 4 (0.35%) Payment Gateway
3 4 (0.35%) Shopify
4 2 (0.17%) NetSuite
4 2 (0.17%) SAP MDM
5 1 (0.086%) Dynamics AX
5 1 (0.086%) SAP ERP
5 1 (0.086%) SimCorp Dimension
Cloud Services
1 691 (59.72%) Azure
2 490 (42.35%) AWS
3 274 (23.68%) Azure Data Factory
4 261 (22.56%) GCP
5 249 (21.52%) Power Platform
6 185 (15.99%) Azure Synapse Analytics
7 165 (14.26%) Amazon S3
8 137 (11.84%) Serverless
9 124 (10.72%) Snowflake
10 88 (7.61%) Azure Cosmos DB
11 79 (6.83%) Amazon Kinesis
12 74 (6.40%) GitHub
13 64 (5.53%) Amazon EMR
14 63 (5.45%) SaaS
15 53 (4.58%) AWS Lambda
16 42 (3.63%) Amazon CloudWatch
16 42 (3.63%) Azure Service Bus
17 38 (3.28%) Cloud Computing
18 35 (3.03%) Azure Functions
19 30 (2.59%) Azure Monitor
Communications & Networking
1 19 (1.64%) Wireless
2 17 (1.47%) Cisco IPT
3 12 (1.04%) Skype
4 10 (0.86%) Network Security
5 3 (0.26%) Intranet
6 2 (0.17%) VLAN
7 1 (0.086%) DMZ
7 1 (0.086%) DSL
7 1 (0.086%) Firewall
7 1 (0.086%) HTTP
7 1 (0.086%) LAN
7 1 (0.086%) tcpdump
7 1 (0.086%) WAN
7 1 (0.086%) Wireshark
Database & Business Intelligence
1 659 (56.96%) Data Warehouse
2 353 (30.51%) Big Data
3 248 (21.43%) Power BI
4 213 (18.41%) NoSQL
4 213 (18.41%) SQL Server
5 199 (17.20%) Hadoop
6 173 (14.95%) Tableau
7 157 (13.57%) Amazon Redshift
8 141 (12.19%) Relational Database
9 108 (9.33%) SQL Server Integration Services
10 104 (8.99%) Azure SQL Database
11 96 (8.30%) Apache Hive
12 94 (8.12%) Metadata
13 93 (8.04%) BigQuery
14 90 (7.78%) Azure SQL Data Warehouse
15 70 (6.05%) Amazon Athena
16 67 (5.79%) MySQL
17 57 (4.93%) PostgreSQL
17 57 (4.93%) SQL Server Analysis Services
18 52 (4.49%) SQL Server Reporting Services
Development Applications
1 134 (11.58%) Git (software)
2 87 (7.52%) Jenkins
3 64 (5.53%) CircleCI
4 45 (3.89%) JIRA
5 19 (1.64%) Visual Studio
6 15 (1.30%) SonarQube
7 13 (1.12%) ER Studio
7 13 (1.12%) ERwin
8 12 (1.04%) PowerDesigner
9 10 (0.86%) Burp Suite
10 9 (0.78%) SQL Server Management Studio (SSMS)
11 8 (0.69%) GitLab
12 6 (0.52%) Atlassian Bamboo
13 4 (0.35%) NUnit
13 4 (0.35%) Travis CI
14 3 (0.26%) Balsamiq
14 3 (0.26%) Bitbucket
14 3 (0.26%) Fiddler
14 3 (0.26%) SpecFlow
14 3 (0.26%) Subversion
General
1 371 (32.07%) Finance
2 344 (29.73%) Social Skills
3 238 (20.57%) Analytical Skills
4 111 (9.59%) Banking
5 106 (9.16%) Inclusion and Diversity
6 86 (7.43%) Marketing
7 67 (5.79%) Retail
8 56 (4.84%) Law
9 45 (3.89%) Legal
10 41 (3.54%) Public Sector
11 36 (3.11%) Publishing
12 31 (2.68%) Advertising
13 29 (2.51%) Games
14 24 (2.07%) Retail Banking
15 18 (1.56%) Organisational Skills
16 17 (1.47%) Aviation
17 15 (1.30%) Financial Institution
18 12 (1.04%) Presentation Skills
18 12 (1.04%) Telecoms
19 11 (0.95%) Esports
Job Titles
1 538 (46.50%) Data Engineer
2 199 (17.20%) Architect
3 181 (15.64%) Senior Data Engineer
4 150 (12.96%) Data Architect
5 115 (9.94%) Azure Engineer
6 77 (6.66%) Solutions Architect
7 69 (5.96%) Developer
8 64 (5.53%) Analyst
9 48 (4.15%) Consultant
10 47 (4.06%) Software Engineer
11 43 (3.72%) Big Data Engineer
11 43 (3.72%) Security Engineer
12 39 (3.37%) Senior Architect
13 38 (3.28%) Cloud Engineer
14 29 (2.51%) Data Consultant
15 27 (2.33%) Data Analyst
15 27 (2.33%) Senior Analyst
16 25 (2.16%) AWS Engineer
16 25 (2.16%) Business Intelligence Developer
17 24 (2.07%) Big Data Architect
Libraries, Frameworks & Software Standards
1 145 (12.53%) Kafka
2 131 (11.32%) PySpark
3 71 (6.14%) .NET
4 42 (3.63%) Spark Streaming
5 38 (3.28%) Apache Beam
6 37 (3.20%) OAuth
7 36 (3.11%) Node.js
8 30 (2.59%) Web Services
9 25 (2.16%) XML
10 22 (1.90%) Apache NiFi
11 21 (1.82%) .NET Core
11 21 (1.82%) JSON
12 18 (1.56%) RabbitMQ
13 15 (1.30%) React
14 14 (1.21%) Pandas
15 13 (1.12%) REST
15 13 (1.12%) RESTful
15 13 (1.12%) YAML
16 12 (1.04%) Django
16 12 (1.04%) Velocity
Miscellaneous
1 87 (7.52%) Data Structures
2 85 (7.35%) Algorithms
3 74 (6.40%) Self-Motivation
4 73 (6.31%) Greenfield Project
5 57 (4.93%) Cloud Native
6 44 (3.80%) Public Cloud
7 37 (3.20%) Management Information System
8 22 (1.90%) PropTech
9 19 (1.64%) Enterprise Software
9 19 (1.64%) Hybrid Cloud
9 19 (1.64%) Replication
10 16 (1.38%) Reinsurance
11 14 (1.21%) BBC
12 13 (1.12%) Sports Betting
13 11 (0.95%) Online Games
14 10 (0.86%) User Experience
15 9 (0.78%) Legacy Systems
16 8 (0.69%) Data Centre
16 8 (0.69%) IoT
16 8 (0.69%) Reference Data
Operating Systems
1 53 (4.58%) Linux
2 16 (1.38%) Unix
3 12 (1.04%) Windows
4 10 (0.86%) Kali Linux
5 4 (0.35%) Red Hat Enterprise Linux
5 4 (0.35%) Windows Server
6 1 (0.086%) Android
6 1 (0.086%) Apple iOS
6 1 (0.086%) Solaris
6 1 (0.086%) SUSE
6 1 (0.086%) VMS
Processes & Methodologies
1 565 (48.83%) Agile
2 533 (46.07%) ETL
3 520 (44.94%) Analytics
4 426 (36.82%) Business Intelligence
5 389 (33.62%) Data Engineering
6 354 (30.60%) Data Modelling
7 326 (28.18%) Data Pipeline
8 312 (26.97%) DevOps
9 273 (23.60%) Data Science
10 270 (23.34%) CI/CD
11 243 (21.00%) Machine Learning
12 218 (18.84%) Data Architecture
13 211 (18.24%) Data Strategy
14 197 (17.03%) Data Management
15 191 (16.51%) Visualisation
16 167 (14.43%) Data Analytics
17 158 (13.66%) Problem-Solving
18 156 (13.48%) Mentoring
19 149 (12.88%) Software Engineering
20 141 (12.19%) Artificial Intelligence
Programming Languages
1 635 (54.88%) SQL
2 591 (51.08%) Python
3 211 (18.24%) Java
4 159 (13.74%) Scala
5 102 (8.82%) C#
6 100 (8.64%) T-SQL
7 71 (6.14%) R
8 68 (5.88%) Bash
9 65 (5.62%) PowerShell
10 35 (3.03%) JavaScript
11 17 (1.47%) Ruby
12 15 (1.30%) TypeScript
13 14 (1.21%) Go
14 13 (1.12%) C++
15 12 (1.04%) Data Analysis Expressions (DAX)
16 11 (0.95%) U-SQL
17 10 (0.86%) C
17 10 (0.86%) VBA
18 8 (0.69%) PHP
19 7 (0.61%) Shell Script
Qualifications
1 161 (13.92%) Degree
2 54 (4.67%) Computer Science Degree
3 35 (3.03%) AWS Certification
4 22 (1.90%) Master's Degree
4 22 (1.90%) Numerate Degree
5 20 (1.73%) CISSP
6 18 (1.56%) (ISC)2 CCSP
6 18 (1.56%) Cisco Certification
7 16 (1.38%) Microsoft Certification
8 8 (0.69%) PMI Certification
9 5 (0.43%) Security Cleared
10 3 (0.26%) MBA
10 3 (0.26%) TOGAF Certification
11 2 (0.17%) CSSLP
11 2 (0.17%) PMP
11 2 (0.17%) SC Cleared
12 1 (0.086%) BPSS Clearance
12 1 (0.086%) DV Cleared
12 1 (0.086%) IISP
12 1 (0.086%) ITIL Foundation Certificate
Quality Assurance & Compliance
1 113 (9.77%) Data Quality
2 36 (3.11%) GDPR
3 33 (2.85%) QA
4 19 (1.64%) Accessibility
5 10 (0.86%) PCI DSS
6 9 (0.78%) IFRS
6 9 (0.78%) IFRS 17
7 5 (0.43%) SLA
8 4 (0.35%) GxP
9 2 (0.17%) PMO
9 2 (0.17%) Solvency II
System Software
1 78 (6.74%) Docker
2 42 (3.63%) Apache Flume
3 12 (1.04%) HDFS
4 6 (0.52%) Active Directory
5 3 (0.26%) Virtual Machines
6 2 (0.17%) etcd
7 1 (0.086%) VMware Infrastructure
Systems Management
1 172 (14.87%) Terraform
2 125 (10.80%) Kubernetes
3 41 (3.54%) Oozie
4 11 (0.95%) Ansible
5 2 (0.17%) Grafana
5 2 (0.17%) Opscode Chef
6 1 (0.086%) Prometheus
6 1 (0.086%) Puppet
6 1 (0.086%) Red Hat Satellite
6 1 (0.086%) Rundeck
Vendors
1 339 (29.30%) Databricks
2 196 (16.94%) Microsoft
3 96 (8.30%) Google
4 83 (7.17%) Oracle
5 60 (5.19%) Cloudera
6 38 (3.28%) Informatica
7 30 (2.59%) Talend
7 30 (2.59%) Teradata
8 26 (2.25%) Alteryx
9 24 (2.07%) Salesforce.com
10 17 (1.47%) IBM
11 16 (1.38%) SAP
12 15 (1.30%) Atlassian
13 14 (1.21%) CA
13 14 (1.21%) MuleSoft
14 13 (1.12%) MicroStrategy
15 12 (1.04%) Hitachi
15 12 (1.04%) Splunk
16 11 (0.95%) Civica
17 10 (0.86%) Cadence