Data Lakes
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 10 December 2023 with a comparison to the same period in the previous 2 years.

6 months to
10 Dec 2023
Same period 2022 Same period 2021
Rank 242 278 280
Rank change year-on-year +36 +2 +13
Permanent jobs citing Data Lake 737 1,614 1,692
As % of all permanent jobs advertised in the UK 1.41% 1.32% 1.33%
As % of the Database & Business Intelligence category 6.57% 5.68% 4.93%
Number of salaries quoted 519 1,090 1,145
10th Percentile £46,294 £49,875 £46,250
25th Percentile £55,000 £57,500 £53,750
Median annual salary (50th Percentile) £75,000 £75,000 £70,000
Median % change year-on-year - +7.14% +3.70%
75th Percentile £90,000 £91,250 £85,000
90th Percentile £110,000 £105,000 £100,000
UK excluding London median annual salary £65,000 £65,000 £60,000
% change year-on-year - +8.33% +9.09%

All Database and Business Intelligence Skills
UK

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 11,214 28,399 34,324
As % of all permanent jobs advertised in the UK 21.45% 23.23% 27.01%
Number of salaries quoted 8,322 17,485 22,575
10th Percentile £36,750 £36,750 £35,457
25th Percentile £46,875 £46,250 £42,625
Median annual salary (50th Percentile) £60,000 £62,500 £58,500
Median % change year-on-year -4.00% +6.84% +6.36%
75th Percentile £80,000 £82,500 £77,500
90th Percentile £95,000 £100,000 £95,000
UK excluding London median annual salary £55,000 £55,000 £50,000
% change year-on-year - +10.00% +2.04%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 10 December 2023.

Salary histogram for Data Lake in the UK

Data Lake
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 10 December 2023. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +34 665 £75,000 - 252
Work from Home +68 366 £71,850 -4.20% 187
UK excluding London +39 366 £65,000 - 145
London +35 321 £80,000 -5.88% 108
North of England +50 138 £62,500 -10.71% 52
South West +99 74 £71,200 +9.54% 11
North West +38 69 £60,000 - 23
South East +92 68 £64,250 -8.21% 35
Yorkshire +62 61 £79,632 +2.75% 17
Scotland +36 39 £79,632 +17.97% 8
Midlands -12 31 £55,000 -8.33% 25
West Midlands +13 19 £56,250 -6.25% 12
East Midlands +21 12 £50,000 -25.93% 13
North East +36 8 £53,750 -36.76% 12
Northern Ireland +27 7 £70,000 +86.67% 2
East of England +94 6 £107,500 +72.00% 14
Wales +16 3 £58,750 -2.08%

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 139 (18.86%) Apache Spark
2 70 (9.50%) Apache
3 23 (3.12%) Apache Airflow
4 15 (2.04%) SharePoint
5 11 (1.49%) Confluence
6 7 (0.95%) SAS
7 6 (0.81%) Adobe Experience Manager
8 5 (0.68%) IBM Domino
9 4 (0.54%) CMS
9 4 (0.54%) WordPress
10 3 (0.41%) MS Exchange
11 2 (0.27%) JBoss
11 2 (0.27%) Jupyter
11 2 (0.27%) Tomcat
11 2 (0.27%) WebSphere
12 1 (0.14%) Apache Synapse
12 1 (0.14%) Luigi
Applications
1 5 (0.68%) MS Visio
2 4 (0.54%) Microsoft Excel
2 4 (0.54%) Microsoft Office
3 1 (0.14%) Microsoft PowerPoint
Business Applications
1 17 (2.31%) Dynamics CRM
2 5 (0.68%) NetSuite
2 5 (0.68%) Shopify
3 4 (0.54%) Dynamics GP
3 4 (0.54%) Dynamics NAV
4 2 (0.27%) Distributed Ledger
4 2 (0.27%) Magento
5 1 (0.14%) Dynamics AX
5 1 (0.14%) Sparx Enterprise Architect
Cloud Services
1 504 (68.39%) Azure
2 244 (33.11%) GCP
3 231 (31.34%) AWS
4 224 (30.39%) Power Platform
5 177 (24.02%) Azure Data Factory
6 146 (19.81%) Azure Synapse Analytics
7 133 (18.05%) PaaS
8 115 (15.60%) SaaS
9 114 (15.47%) IaaS
10 75 (10.18%) Azure DevOps
11 64 (8.68%) GitHub
12 50 (6.78%) GitHub Actions
13 47 (6.38%) Vertex AI
14 41 (5.56%) Serverless
15 37 (5.02%) Snowflake
16 34 (4.61%) Dynamics 365
17 26 (3.53%) Microsoft Purview
17 26 (3.53%) PowerApps
18 23 (3.12%) Azure Cosmos DB
19 21 (2.85%) Power Automate
Communications & Networking
1 30 (4.07%) Wireless
2 10 (1.36%) VPN
3 8 (1.09%) DNS
3 8 (1.09%) VLAN
4 7 (0.95%) IPv4
4 7 (0.95%) OSPF
5 6 (0.81%) DSL
6 5 (0.68%) Firewall
7 4 (0.54%) Network Security
8 2 (0.27%) FTP
9 1 (0.14%) Internet
9 1 (0.14%) TCP/IP
Database & Business Intelligence
1 411 (55.77%) Data Warehouse
2 221 (29.99%) Power BI
3 200 (27.14%) NoSQL
4 167 (22.66%) Big Data
5 93 (12.62%) Tableau
6 85 (11.53%) Relational Database
7 84 (11.40%) Azure SQL Database
8 81 (10.99%) SQL Server
9 75 (10.18%) BigQuery
10 62 (8.41%) PostgreSQL
11 55 (7.46%) Looker
11 55 (7.46%) MySQL
11 55 (7.46%) SQL Server Integration Services
12 48 (6.51%) Bigtable
13 44 (5.97%) Hadoop
14 27 (3.66%) Delta Lake
15 25 (3.39%) Microsoft Analysis Services
16 24 (3.26%) Metadata
17 21 (2.85%) Amazon Redshift
17 21 (2.85%) MongoDB
Development Applications
1 64 (8.68%) Jenkins
2 17 (2.31%) Visual Studio
3 11 (1.49%) JIRA
4 9 (1.22%) Git
5 8 (1.09%) ERwin
6 5 (0.68%) ER Studio
6 5 (0.68%) Oracle Forms
7 3 (0.41%) CircleCI
7 3 (0.41%) Maven
7 3 (0.41%) SQL Server Management Studio (SSMS)
8 2 (0.27%) Eclipse
8 2 (0.27%) JUnit
8 2 (0.27%) Postman
8 2 (0.27%) SpecFlow
8 2 (0.27%) Zephyr
9 1 (0.14%) Ant
9 1 (0.14%) Bitbucket
9 1 (0.14%) Gradle
9 1 (0.14%) MLflow
9 1 (0.14%) PowerDesigner
General
1 276 (37.45%) Finance
2 183 (24.83%) Banking
3 107 (14.52%) Analytical Skills
4 106 (14.38%) Social Skills
5 72 (9.77%) Retail
6 70 (9.50%) Inclusion and Diversity
7 64 (8.68%) Marketing
8 31 (4.21%) Public Sector
9 27 (3.66%) Law
10 15 (2.04%) Legal
11 12 (1.63%) Presentation Skills
12 11 (1.49%) Financial Institution
12 11 (1.49%) Influencing Skills
13 8 (1.09%) Investment Banking
13 8 (1.09%) Manufacturing
14 6 (0.81%) Organisational Skills
14 6 (0.81%) Publishing
15 5 (0.68%) General Ledger
16 4 (0.54%) Telecoms
17 3 (0.41%) Automotive
Job Titles
1 253 (34.33%) Architect
2 213 (28.90%) Data Engineer
3 121 (16.42%) Data Architect
4 112 (15.20%) Enterprise Architect
5 82 (11.13%) Senior
6 64 (8.68%) Lead
7 53 (7.19%) Developer
8 43 (5.83%) Senior Data Engineer
9 42 (5.70%) Cloud Architect
10 40 (5.43%) Commercial Architect
11 34 (4.61%) Azure Engineer
11 34 (4.61%) Solutions Architect
12 30 (4.07%) Azure Architect
12 30 (4.07%) Head of Engineering
12 30 (4.07%) Lead Data Engineer
13 29 (3.93%) Azure Data Engineer
14 25 (3.39%) Analyst
15 22 (2.99%) Business Intelligence Developer
15 22 (2.99%) Consultant
16 21 (2.85%) Data Analytics Architect
Libraries, Frameworks & Software Standards
1 147 (19.95%) Kafka
2 102 (13.84%) OpenID
3 58 (7.87%) REST
4 49 (6.65%) PySpark
5 45 (6.11%) Web Services
6 41 (5.56%) JWT
7 21 (2.85%) .NET
8 20 (2.71%) JSON
8 20 (2.71%) XML
9 12 (1.63%) JRuby
10 10 (1.36%) Apache Beam
11 9 (1.22%) Middleware
12 8 (1.09%) SOAP
13 5 (0.68%) AngularJS
14 4 (0.54%) HTML
14 4 (0.54%) HTML5 Canvas
14 4 (0.54%) Pandas
14 4 (0.54%) React
15 3 (0.41%) EDI
15 3 (0.41%) WCF
Miscellaneous
1 104 (14.11%) Blockchain
2 102 (13.84%) Mainframe
3 94 (12.75%) Public Cloud
4 65 (8.82%) Cloud Native
5 37 (5.02%) Data Structures
6 27 (3.66%) Algorithms
6 27 (3.66%) Management Information System
7 18 (2.44%) Distributed Systems
8 14 (1.90%) Hybrid Cloud
9 13 (1.76%) Product Ownership
10 11 (1.49%) Onboarding
11 9 (1.22%) Distributed Computing
11 9 (1.22%) Enterprise Software
11 9 (1.22%) Greenfield Project
11 9 (1.22%) Low-Code
12 8 (1.09%) Data Centre
12 8 (1.09%) IoT
12 8 (1.09%) Private Cloud
13 7 (0.95%) Reference Data
14 5 (0.68%) Life Science
Operating Systems
1 106 (14.38%) Unix
2 18 (2.44%) Linux
3 9 (1.22%) Windows
4 2 (0.27%) VMS
4 2 (0.27%) Windows Server
5 1 (0.14%) Windows Server 2019
Processes & Methodologies
1 318 (43.15%) Analytics
2 314 (42.61%) Agile
3 296 (40.16%) Business Intelligence
4 255 (34.60%) Machine Learning
5 237 (32.16%) ETL
6 200 (27.14%) Data Pipeline
7 198 (26.87%) Artificial Intelligence
8 187 (25.37%) Data Modelling
9 165 (22.39%) CI/CD
10 164 (22.25%) Roadmaps
11 156 (21.17%) Data Engineering
12 155 (21.03%) Data Architecture
13 143 (19.40%) Data Integration
14 139 (18.86%) DevOps
15 138 (18.72%) Visualisation
16 127 (17.23%) Microservices
16 127 (17.23%) Strategic Roadmap
17 121 (16.42%) Data Visualisation
18 117 (15.88%) Cybersecurity
18 117 (15.88%) Thought Leadership
Programming Languages
1 357 (48.44%) SQL
2 208 (28.22%) Python
3 55 (7.46%) Java
4 49 (6.65%) T-SQL
5 42 (5.70%) C#
6 34 (4.61%) PowerShell
7 31 (4.21%) Scala
8 27 (3.66%) Data Analysis Expressions
9 23 (3.12%) R
10 21 (2.85%) Bash
11 19 (2.58%) Go
12 14 (1.90%) C++
12 14 (1.90%) JavaScript
13 12 (1.63%) Perl
13 12 (1.63%) Ruby
14 7 (0.95%) Bicep
15 6 (0.81%) PL/SQL
16 4 (0.54%) U-SQL
17 3 (0.41%) TypeScript
18 2 (0.27%) C
Qualifications
1 122 (16.55%) Degree
2 57 (7.73%) Computer Science Degree
3 35 (4.75%) Microsoft Certification
4 34 (4.61%) Azure Certification
5 33 (4.48%) Master's Degree
6 24 (3.26%) Security Cleared
7 20 (2.71%) SC Cleared
8 15 (2.04%) AWS Certification
9 3 (0.41%) Numerate Degree
9 3 (0.41%) Tableau Certification
10 2 (0.27%) BPSS Clearance
10 2 (0.27%) DV Cleared
10 2 (0.27%) HND
10 2 (0.27%) MCSA
11 1 (0.14%) AWS Certified DevOps Engineer
11 1 (0.14%) AWS Certified Solutions Architect
11 1 (0.14%) AWS Certified SysOps Administrator
11 1 (0.14%) CCA
11 1 (0.14%) CESG Certified Professional
Quality Assurance & Compliance
1 83 (11.26%) Data Quality
2 24 (3.26%) GDPR
3 12 (1.63%) QA
4 6 (0.81%) SLA
5 3 (0.41%) GMP
5 3 (0.41%) ISO/IEC 27001
6 2 (0.27%) Accessibility
6 2 (0.27%) Cyber Essentials
6 2 (0.27%) Cyber Essentials PLUS
7 1 (0.14%) ISO 22301
7 1 (0.14%) PSD2
System Software
1 39 (5.29%) Docker
2 6 (0.81%) Active Directory
2 6 (0.81%) Virtual Machines
3 4 (0.54%) HDFS
Systems Management
1 90 (12.21%) Kubernetes
2 77 (10.45%) Terraform
3 21 (2.85%) Ansible
4 8 (1.09%) Puppet
5 1 (0.14%) Apache Ranger
5 1 (0.14%) Hadoop YARN
5 1 (0.14%) HP Fortify
Vendors
1 183 (24.83%) Databricks
2 182 (24.69%) Microsoft
3 84 (11.40%) Google
4 23 (3.12%) Oracle
5 16 (2.17%) Informatica
6 11 (1.49%) MuleSoft
7 10 (1.36%) Adobe
8 9 (1.22%) Cognos
9 8 (1.09%) Teradata
10 7 (0.95%) Alteryx
11 6 (0.81%) Sybase
11 6 (0.81%) YouTube
12 5 (0.68%) Cloudera
12 5 (0.68%) IBM
12 5 (0.68%) Xero
13 4 (0.54%) DocuSign
13 4 (0.54%) TIBCO
14 3 (0.41%) Apple
14 3 (0.41%) SAP
14 3 (0.41%) SnapLogic