Period
to

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 9 August 2022 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
9 Aug 2022
Same period 2021 Same period 2020
Rank 266 324 276
Rank change year-on-year +58 -48 +205
Permanent jobs citing Data Lake 2,550 1,208 774
As % of all permanent jobs advertised in the UK 1.50% 1.06% 1.19%
As % of the Database & Business Intelligence category 5.45% 3.79% 4.31%
Number of salaries quoted 1,185 904 475
10th Percentile £46,500 £45,227 £45,000
25th Percentile £55,638 £52,500 £53,750
Median annual salary (50th Percentile) £75,000 £70,000 £67,500
Median % change year-on-year +7.14% +3.70% +3.85%
75th Percentile £90,000 £85,000 £78,750
90th Percentile £100,000 £100,000 £90,000
UK excluding London median annual salary £60,000 £60,000 £57,500
% change year-on-year - +4.35% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 46,771 31,889 17,964
As % of all permanent IT jobs advertised in the UK 27.46% 27.97% 27.62%
Number of salaries quoted 20,892 21,133 14,754
10th Percentile £36,250 £35,000 £32,500
25th Percentile £45,000 £42,500 £41,250
Median annual salary (50th Percentile) £60,000 £55,000 £55,000
Median % change year-on-year +9.09% - +7.53%
75th Percentile £80,000 £75,000 £72,500
90th Percentile £96,250 £92,500 £87,500
UK excluding London median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% +5.56%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 9 August 2022.

Salary histogram for Data Lake in the UK

Data Lake
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 9 August 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +66 2,258 £75,000 +7.14% 161
London +50 1,383 £80,000 - 80
Work from Home +59 1,223 £75,000 +15.38% 74
UK excluding London +63 926 £60,000 - 91
North of England +106 369 £63,750 +6.25% 23
North West +70 216 £60,000 - 18
Midlands +4 204 £61,000 +9.91% 30
South East -25 185 £70,000 +7.69% 14
West Midlands +11 173 £62,500 +22.55% 16
Yorkshire +38 138 £63,750 +6.25% 4
South West +15 77 £54,076 +13.84% 3
East of England -62 49 £65,000 -10.34% 11
Scotland -31 36 £55,000 -12.00% 9
East Midlands -27 27 £60,000 +8.11% 13
Northern Ireland +1 18 - -
North East -3 15 £85,000 +30.77% 1
Wales -20 5 £60,000 +26.32% 1

For the 6 months to 9 August 2022, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 1,583 (62.08%) Azure
2 1,574 (61.73%) SQL
3 1,459 (57.22%) Data Warehouse
4 1,315 (51.57%) Python
5 1,312 (51.45%) Analytics
6 1,150 (45.10%) ETL
7 1,116 (43.76%) Agile
8 994 (38.98%) AWS
9 943 (36.98%) Business Intelligence
10 851 (33.37%) Data Modelling
11 810 (31.76%) Data Pipeline
12 808 (31.69%) Data Engineering
13 745 (29.22%) Databricks
14 716 (28.08%) Data Science
15 659 (25.84%) Big Data
16 658 (25.80%) Finance
17 642 (25.18%) Azure Data Factory
18 626 (24.55%) CI/CD
19 619 (24.27%) Power Platform
20 604 (23.69%) Power BI
21 594 (23.29%) DevOps
21 594 (23.29%) Social Skills
22 565 (22.16%) GCP
23 558 (21.88%) Machine Learning
24 557 (21.84%) SQL Server
25 554 (21.73%) Microsoft
26 515 (20.20%) Apache Spark
27 492 (19.29%) Analytical Skills
28 489 (19.18%) NoSQL
29 472 (18.51%) Azure Synapse Analytics

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 515 (20.20%) Apache Spark
2 253 (9.92%) Apache
3 232 (9.10%) Apache Airflow
4 43 (1.69%) Oracle Workflow
5 25 (0.98%) SharePoint
6 22 (0.86%) Apache Pig
7 20 (0.78%) Confluence
8 15 (0.59%) Luigi
9 14 (0.55%) SAS
10 11 (0.43%) Apache Pulsar
10 11 (0.43%) CMS
11 7 (0.27%) BizTalk Server
11 7 (0.27%) Jupyter
12 4 (0.16%) Oracle SOA Suite
13 3 (0.12%) DataSynapse
14 2 (0.078%) NetWeaver
15 1 (0.039%) Adobe Experience Manager
15 1 (0.039%) MS Exchange
15 1 (0.039%) Oracle Coherence
15 1 (0.039%) SharePoint Server
Applications
1 47 (1.84%) Microsoft Excel
2 22 (0.86%) Microsoft Office
3 20 (0.78%) Stata
4 12 (0.47%) Campfire
5 11 (0.43%) Spreadsheet
6 3 (0.12%) Microsoft PowerPoint
7 2 (0.078%) MS Visio
7 2 (0.078%) SPSS
8 1 (0.039%) Gephi
Business Applications
1 19 (0.75%) Oracle Payables
2 16 (0.63%) JDE OneWorld
3 6 (0.24%) Adobe Campaign
3 6 (0.24%) Dynamics CRM
3 6 (0.24%) SAP S/4HANA
4 5 (0.20%) Acoustic Campaign
4 5 (0.20%) Dynamics AX
5 4 (0.16%) Magento
5 4 (0.16%) Payment Gateway
5 4 (0.16%) SAP MDM
5 4 (0.16%) Shopify
6 3 (0.12%) Infor M3
6 3 (0.12%) NetSuite
6 3 (0.12%) Workday HCM
7 2 (0.078%) SAP ERP
7 2 (0.078%) SAP GRC
7 2 (0.078%) SAP MDG
8 1 (0.039%) Eagle PACE
8 1 (0.039%) SimCorp Dimension
Cloud Services
1 1,583 (62.08%) Azure
2 994 (38.98%) AWS
3 642 (25.18%) Azure Data Factory
4 619 (24.27%) Power Platform
5 565 (22.16%) GCP
6 472 (18.51%) Azure Synapse Analytics
7 339 (13.29%) Snowflake
8 294 (11.53%) Serverless
9 291 (11.41%) Azure Cosmos DB
10 277 (10.86%) Amazon S3
11 245 (9.61%) Azure DevOps
12 152 (5.96%) GitHub
13 145 (5.69%) Matillion
14 136 (5.33%) AWS Lambda
15 123 (4.82%) Amazon Kinesis
16 116 (4.55%) Amazon EMR
17 95 (3.73%) Cloud Computing
18 92 (3.61%) SaaS
19 81 (3.18%) Azure Service Bus
20 78 (3.06%) PaaS
Communications & Networking
1 54 (2.12%) Internet
2 20 (0.78%) Broadband
3 16 (0.63%) Skype
4 12 (0.47%) Cisco IPT
5 10 (0.39%) HTTP
6 6 (0.24%) Network Security
7 5 (0.20%) DNS
7 5 (0.20%) Wireless
8 3 (0.12%) Firewall
8 3 (0.12%) Intranet
8 3 (0.12%) VPN
9 2 (0.078%) Kerberos
9 2 (0.078%) TCP/IP
9 2 (0.078%) VLAN
10 1 (0.039%) AMQP
10 1 (0.039%) DMZ
10 1 (0.039%) DSL
10 1 (0.039%) LAN
10 1 (0.039%) SMS
10 1 (0.039%) WAN
Database & Business Intelligence
1 1,459 (57.22%) Data Warehouse
2 659 (25.84%) Big Data
3 604 (23.69%) Power BI
4 557 (21.84%) SQL Server
5 489 (19.18%) NoSQL
6 364 (14.27%) Hadoop
7 331 (12.98%) Relational Database
8 330 (12.94%) Tableau
9 327 (12.82%) SQL Server Integration Services
10 285 (11.18%) Amazon Redshift
11 206 (8.08%) Azure SQL Database
12 187 (7.33%) Apache Hive
13 165 (6.47%) Elasticsearch
14 159 (6.24%) Azure SQL Data Warehouse
15 158 (6.20%) SQL Server Analysis Services
16 155 (6.08%) Amazon Athena
17 145 (5.69%) BigQuery
18 142 (5.57%) SQL Server Reporting Services
19 139 (5.45%) Metadata
20 120 (4.71%) DynamoDB
Development Applications
1 206 (8.08%) Git (software)
2 128 (5.02%) Jenkins
3 112 (4.39%) GitLab
4 74 (2.90%) JIRA
5 71 (2.78%) CircleCI
6 44 (1.73%) Visual Studio
7 39 (1.53%) SQL Server Management Studio (SSMS)
8 35 (1.37%) ERwin
9 27 (1.06%) ER Studio
10 20 (0.78%) webpack
11 18 (0.71%) PowerDesigner
11 18 (0.71%) SonarQube
12 13 (0.51%) Bitbucket
13 12 (0.47%) NUnit
13 12 (0.47%) Selenium
14 10 (0.39%) Storybook
15 9 (0.35%) Babel
15 9 (0.35%) ESLint
15 9 (0.35%) Mocha
15 9 (0.35%) Postman
General
1 658 (25.80%) Finance
2 594 (23.29%) Social Skills
3 492 (19.29%) Analytical Skills
4 206 (8.08%) Retail
5 173 (6.78%) Marketing
6 149 (5.84%) Banking
7 124 (4.86%) Inclusion and Diversity
8 117 (4.59%) Public Sector
9 114 (4.47%) Law
10 112 (4.39%) Legal
11 72 (2.82%) Games
11 72 (2.82%) Manufacturing
12 65 (2.55%) Automotive
13 44 (1.73%) Advertising
14 39 (1.53%) Aviation
15 38 (1.49%) Presentation Skills
16 37 (1.45%) Publishing
17 36 (1.41%) Telecoms
18 32 (1.25%) Local Government
19 31 (1.22%) Financial Institution
Job Titles
1 1,245 (48.82%) Data Engineer
2 437 (17.14%) Architect
3 392 (15.37%) Senior Data Engineer
4 302 (11.84%) Data Architect
5 246 (9.65%) Azure Engineer
6 185 (7.25%) Developer
7 178 (6.98%) Azure Data Engineer
8 160 (6.27%) Solutions Architect
9 109 (4.27%) Consultant
10 100 (3.92%) Analyst
11 90 (3.53%) Big Data Engineer
12 87 (3.41%) Software Engineer
13 73 (2.86%) Cloud Engineer
14 68 (2.67%) Business Intelligence Developer
15 64 (2.51%) Data Consultant
16 62 (2.43%) Security Engineer
17 60 (2.35%) Senior Architect
18 54 (2.12%) DevOps Engineer
19 51 (2.00%) Data Manager
20 49 (1.92%) Data Analyst
Libraries, Frameworks & Software Standards
1 301 (11.80%) Kafka
2 248 (9.73%) PySpark
3 191 (7.49%) .NET
4 100 (3.92%) Node.js
5 95 (3.73%) REST
6 78 (3.06%) Web Services
7 68 (2.67%) Spark Streaming
8 53 (2.08%) JSON
9 47 (1.84%) Apache Beam
9 47 (1.84%) Apache NiFi
9 47 (1.84%) React
10 41 (1.61%) OAuth
11 40 (1.57%) TensorFlow
12 38 (1.49%) XML
13 35 (1.37%) Pandas
14 33 (1.29%) .NET Core
15 29 (1.14%) Express
15 29 (1.14%) RabbitMQ
15 29 (1.14%) YAML
16 28 (1.10%) scikit-learn
Miscellaneous
1 250 (9.80%) Data Structures
2 173 (6.78%) Algorithms
3 165 (6.47%) Self-Motivation
4 124 (4.86%) Cloud Native
5 115 (4.51%) Greenfield Project
6 103 (4.04%) IoT
7 87 (3.41%) Public Cloud
8 74 (2.90%) Management Information System
9 37 (1.45%) User Experience
10 33 (1.29%) Enterprise Software
10 33 (1.29%) Legacy Systems
11 25 (0.98%) Reinsurance
12 23 (0.90%) BBC
13 22 (0.86%) Blockchain
13 22 (0.86%) Sports Betting
14 19 (0.75%) PropTech
15 18 (0.71%) Data Centre
15 18 (0.71%) Online Games
15 18 (0.71%) PMI
16 17 (0.67%) Virtual Team
Operating Systems
1 113 (4.43%) Linux
2 38 (1.49%) Unix
3 31 (1.22%) Windows
4 13 (0.51%) Windows Server
5 11 (0.43%) Red Hat Enterprise Linux
6 8 (0.31%) Android
7 4 (0.16%) VMS
8 3 (0.12%) Apple iOS
9 1 (0.039%) SUSE
Processes & Methodologies
1 1,312 (51.45%) Analytics
2 1,150 (45.10%) ETL
3 1,116 (43.76%) Agile
4 943 (36.98%) Business Intelligence
5 851 (33.37%) Data Modelling
6 810 (31.76%) Data Pipeline
7 808 (31.69%) Data Engineering
8 716 (28.08%) Data Science
9 626 (24.55%) CI/CD
10 594 (23.29%) DevOps
11 558 (21.88%) Machine Learning
12 462 (18.12%) Data Analytics
13 449 (17.61%) Data Architecture
14 416 (16.31%) Visualisation
15 411 (16.12%) Data Management
16 382 (14.98%) Problem-Solving
17 344 (13.49%) Software Engineering
18 333 (13.06%) Data Strategy
19 330 (12.94%) Artificial Intelligence
20 290 (11.37%) Data Integration
Programming Languages
1 1,574 (61.73%) SQL
2 1,315 (51.57%) Python
3 373 (14.63%) Java
4 307 (12.04%) Scala
5 249 (9.76%) T-SQL
6 204 (8.00%) C#
7 136 (5.33%) R
8 123 (4.82%) PowerShell
9 118 (4.63%) Bash
10 105 (4.12%) JavaScript
11 42 (1.65%) Data Analysis Expressions (DAX)
12 38 (1.49%) C
13 28 (1.10%) Ruby
14 25 (0.98%) C++
15 23 (0.90%) Shell Script
15 23 (0.90%) TypeScript
16 22 (0.86%) VBA
17 21 (0.82%) U-SQL
18 18 (0.71%) Go
19 17 (0.67%) Clojure
Qualifications
1 314 (12.31%) Degree
2 96 (3.76%) Computer Science Degree
3 57 (2.24%) Security Cleared
4 42 (1.65%) Master's Degree
4 42 (1.65%) Microsoft Certification
5 35 (1.37%) CISSP
6 32 (1.25%) SC Cleared
7 31 (1.22%) AWS Certification
8 29 (1.14%) Numerate Degree
9 22 (0.86%) CSSLP
9 22 (0.86%) PMI Certification
10 15 (0.59%) TOGAF Certification
11 13 (0.51%) (ISC)2 CCSP
11 13 (0.51%) Cisco Certification
12 11 (0.43%) MBA
13 9 (0.35%) DV Cleared
14 6 (0.24%) BPSS Clearance
15 5 (0.20%) CTC Cleared
15 5 (0.20%) MCSE
15 5 (0.20%) PRINCE2 Certification
Quality Assurance & Compliance
1 359 (14.08%) Data Quality
2 72 (2.82%) GDPR
3 62 (2.43%) Accessibility
4 49 (1.92%) QA
5 23 (0.90%) SLA
6 8 (0.31%) PCI DSS
7 6 (0.24%) ISO 9001
8 5 (0.20%) GRC
9 4 (0.16%) PMO
10 2 (0.078%) Actionable Recommendations
10 2 (0.078%) GLBA
10 2 (0.078%) NIST
11 1 (0.039%) COBIT
11 1 (0.039%) IFRS
11 1 (0.039%) IFRS 17
System Software
1 156 (6.12%) Docker
2 55 (2.16%) Apache Flume
3 17 (0.67%) Active Directory
4 12 (0.47%) HDFS
5 8 (0.31%) Virtual Machines
6 6 (0.24%) VMware Infrastructure
7 2 (0.078%) etcd
8 1 (0.039%) Apache ZooKeeper
Systems Management
1 276 (10.82%) Terraform
2 203 (7.96%) Kubernetes
3 48 (1.88%) Oozie
4 33 (1.29%) Ansible
5 24 (0.94%) Puppet
6 18 (0.71%) Opscode Chef
7 13 (0.51%) Prometheus
8 10 (0.39%) Grafana
8 10 (0.39%) Kibana
9 8 (0.31%) logstash
9 8 (0.31%) Rancher
10 4 (0.16%) Control-M
11 3 (0.12%) Single Sign-On
12 1 (0.039%) Argo
12 1 (0.039%) Istio
12 1 (0.039%) Red Hat Satellite
12 1 (0.039%) ZABBIX
Vendors
1 745 (29.22%) Databricks
2 554 (21.73%) Microsoft
3 202 (7.92%) Google
4 193 (7.57%) Oracle
5 86 (3.37%) SAP
6 83 (3.25%) Informatica
7 78 (3.06%) Cloudera
8 66 (2.59%) Teradata
9 49 (1.92%) Salesforce.com
10 48 (1.88%) Alteryx
11 38 (1.49%) Talend
12 28 (1.10%) Splunk
13 26 (1.02%) Hitachi
14 23 (0.90%) IBM
15 20 (0.78%) Civica
16 19 (0.75%) CA
17 18 (0.71%) MicroStrategy
18 16 (0.63%) Palantir
19 14 (0.55%) Atlassian
20 13 (0.51%) Cadence