Data Lake Jobs

Data Lakes
UK

The table below provides summary statistics for permanent job vacancies requiring Data Lake skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Lake over the 6 months leading up to 21 July 2024, comparing them to the same period in the previous two years.

6 months to
21 Jul 2024
Same period 2023 Same period 2022
Rank 225 213 285
Rank change year-on-year -12 +72 +58
Permanent jobs citing Data Lake 1,204 1,354 2,578
As % of all permanent jobs advertised in the UK 1.26% 1.63% 1.45%
As % of the Database & Business Intelligence category 7.66% 7.76% 5.24%
Number of salaries quoted 976 930 1,184
10th Percentile £54,000 £47,500 £46,500
25th Percentile £70,000 £56,856 £55,909
Median annual salary (50th Percentile) £100,000 £77,500 £75,000
Median % change year-on-year +29.03% +3.33% +7.14%
75th Percentile £142,500 £100,000 £90,000
90th Percentile £148,750 £127,750 £100,000
UK excluding London median annual salary £60,000 £60,000 £62,500
% change year-on-year - -4.00% +4.17%

All Database and Business Intelligence Skills
UK

Data Lake falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 15,712 17,443 49,175
As % of all permanent jobs advertised in the UK 16.41% 21.03% 27.71%
Number of salaries quoted 10,377 12,157 21,328
10th Percentile £36,250 £37,500 £36,250
25th Percentile £43,750 £47,500 £45,000
Median annual salary (50th Percentile) £60,000 £62,500 £60,000
Median % change year-on-year -4.00% +4.17% +9.09%
75th Percentile £80,000 £81,250 £80,000
90th Percentile £107,500 £100,000 £96,250
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% +8.25%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 21 July 2024.

Salary histogram for Data Lake in the UK

Data Lake
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 21 July 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +6 1,092 £105,000 +31.86% 66
Work from Home +75 848 £115,000 +43.75% 48
London +61 805 £115,000 +27.78% 30
UK excluding London -130 353 £60,000 - 38
North of England -56 113 £55,500 +0.91% 14
North West -28 77 £55,000 +10.00% 7
Scotland -40 61 £47,500 -31.60%
South East -45 60 £63,500 +1.60% 10
Midlands -50 49 £60,000 +12.68% 2
South West -53 44 £67,500 -0.74% 6
West Midlands -26 29 £60,000 +12.68% 2
Yorkshire -12 28 £56,250 -11.76% 1
East Midlands -39 20 £55,000 -
East of England -21 10 £77,500 +55.00% 5
Wales +12 8 £46,131 -20.12% 1
North East -19 8 £75,000 +15.38% 6
Northern Ireland +11 6 - -
Isle of Man - 2 £82,500 -

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 557 (46.26%) Apache Airflow
2 524 (43.52%) Apache
3 62 (5.15%) Apache Spark
4 15 (1.25%) Confluence
5 6 (0.50%) SharePoint
6 2 (0.17%) Jupyter
7 1 (0.083%) Apache Pig
7 1 (0.083%) IIS
7 1 (0.083%) Microsoft Exchange
Applications
1 21 (1.74%) Microsoft Excel
2 15 (1.25%) Microsoft Office
3 7 (0.58%) Microsoft PowerPoint
Business Applications
1 22 (1.83%) Dynamics CRM
2 6 (0.50%) Dynamics NAV
3 4 (0.33%) Aladdin
3 4 (0.33%) Eagle PACE
3 4 (0.33%) Markit EDM
3 4 (0.33%) SAP S/4HANA
4 3 (0.25%) Dynamics AX
5 2 (0.17%) Primavera
5 2 (0.17%) Salesforce CRM
6 1 (0.083%) HFM
Cloud Services
1 763 (63.37%) AWS
2 578 (48.01%) dbt
3 555 (46.10%) Snowflake
4 534 (44.35%) Azure
5 368 (30.56%) GCP
6 279 (23.17%) Power Platform
7 178 (14.78%) Azure Data Factory
8 144 (11.96%) Azure Synapse Analytics
9 71 (5.90%) Amazon EC2
10 70 (5.81%) Amazon EKS
11 68 (5.65%) Amazon ECS
12 52 (4.32%) Azure DevOps
13 41 (3.41%) PowerApps
14 35 (2.91%) Dynamics 365
15 30 (2.49%) Azure Cosmos DB
16 29 (2.41%) Serverless
17 27 (2.24%) Dagster
18 25 (2.08%) GitHub
19 22 (1.83%) Power Automate
20 19 (1.58%) Azure Logic Apps
Communications & Networking
1 11 (0.91%) Network Security
2 5 (0.42%) Modbus
2 5 (0.42%) MQTT
2 5 (0.42%) Wireless
3 3 (0.25%) DNS
3 3 (0.25%) Firewall
4 2 (0.17%) NetScaler
5 1 (0.083%) HTTP
5 1 (0.083%) SAN
Database & Business Intelligence
1 572 (47.51%) Dremio
2 545 (45.27%) Apache Arrow
3 541 (44.93%) Amazon Athena
4 463 (38.46%) Apache Ignite
5 291 (24.17%) Data Warehouse
6 269 (22.34%) Power BI
7 157 (13.04%) Big Data
8 106 (8.80%) SQL Server
9 86 (7.14%) Tableau
10 81 (6.73%) Azure SQL Database
11 67 (5.56%) Azure SQL Data Warehouse
12 59 (4.90%) Metadata
12 59 (4.90%) SQL Server Integration Services
13 46 (3.82%) Qlik Sense
14 45 (3.74%) NoSQL
15 37 (3.07%) Power Query
16 31 (2.57%) SQL Server Analysis Services
17 30 (2.49%) Relational Database
18 27 (2.24%) BigQuery
18 27 (2.24%) SQL Server Reporting Services
Development Applications
1 21 (1.74%) JIRA
2 17 (1.41%) Git
3 15 (1.25%) MLflow
4 8 (0.66%) Jenkins
5 6 (0.50%) ERwin
5 6 (0.50%) Gatling
5 6 (0.50%) Octopus Deploy
5 6 (0.50%) RStudio
5 6 (0.50%) Visual Studio
6 5 (0.42%) MSI
7 4 (0.33%) CircleCI
7 4 (0.33%) SQL Server Management Studio (SSMS)
7 4 (0.33%) TeamCity
8 3 (0.25%) ER Studio
8 3 (0.25%) GitLab
8 3 (0.25%) Oracle Forms
8 3 (0.25%) Selenium
9 2 (0.17%) MagicDraw
9 2 (0.17%) Postman
9 2 (0.17%) SpecFlow
General
1 782 (64.95%) Finance
2 552 (45.85%) Banking
3 518 (43.02%) Front Office
4 494 (41.03%) Investment Banking
5 154 (12.79%) Social Skills
6 93 (7.72%) Analytical Skills
7 80 (6.64%) Inclusion and Diversity
8 77 (6.40%) Law
9 62 (5.15%) Legal
10 51 (4.24%) Presentation Skills
11 35 (2.91%) Marketing
12 19 (1.58%) Retail Banking
13 17 (1.41%) Financial Institution
14 16 (1.33%) Aerospace
14 16 (1.33%) Billing
15 12 (1.00%) Pharmaceutical
15 12 (1.00%) Telecoms
16 11 (0.91%) Back Office
16 11 (0.91%) Retail
17 10 (0.83%) Publishing
Job Titles
1 326 (27.08%) Senior
2 319 (26.50%) Software Engineer
3 301 (25.00%) Data Engineer
4 268 (22.26%) Lead
5 246 (20.43%) AWS Engineer
6 223 (18.52%) Python Engineer
7 206 (17.11%) Architect
8 189 (15.70%) AWS Software Engineer
9 171 (14.20%) Java Engineer
9 171 (14.20%) Java Software Engineer
10 170 (14.12%) Python Software Engineer
11 166 (13.79%) Developer
12 148 (12.29%) Senior Software Engineer
13 117 (9.72%) Solutions Architect
14 106 (8.80%) Lead Software Engineer
15 103 (8.55%) Lead Developer
15 103 (8.55%) Software Developer
16 102 (8.47%) Lead Software Developer
16 102 (8.47%) Software Team Leader
16 102 (8.47%) Team Leader
Libraries, Frameworks & Software Standards
1 513 (42.61%) gRPC
1 513 (42.61%) Protocol Buffers
2 495 (41.11%) Pandas
3 486 (40.37%) NumPy
3 486 (40.37%) SciPy
4 213 (17.69%) PySpark
5 19 (1.58%) JSON
6 14 (1.16%) .NET
6 14 (1.16%) XML
7 13 (1.08%) Kafka
8 11 (0.91%) CSS
8 11 (0.91%) Web Services
9 10 (0.83%) HTML
10 9 (0.75%) REST
11 6 (0.50%) GraphQL
11 6 (0.50%) Lambda Expressions
11 6 (0.50%) RESTful
12 5 (0.42%) Apache Beam
12 5 (0.42%) Middleware
12 5 (0.42%) React
Miscellaneous
1 545 (45.27%) Hedge funds
2 491 (40.78%) Derivative
2 491 (40.78%) Equities
2 491 (40.78%) Fixed Income
2 491 (40.78%) Foreign Exchange (FX)
3 72 (5.98%) Pricing Data
4 70 (5.81%) Algorithms
5 56 (4.65%) Product Ownership
6 54 (4.49%) Clustering
7 39 (3.24%) Onboarding
8 26 (2.16%) Cloud Native
9 24 (1.99%) Data Structures
10 21 (1.74%) Enterprise Software
10 21 (1.74%) Self-Motivation
11 20 (1.66%) Greenfield Project
12 15 (1.25%) Legacy Applications
13 13 (1.08%) Data Centre
13 13 (1.08%) Replication
14 12 (1.00%) Management Information System
15 11 (0.91%) NHS
Operating Systems
1 25 (2.08%) Linux
2 10 (0.83%) Unix
3 6 (0.50%) Windows
4 2 (0.17%) Windows Server
5 1 (0.083%) AIX
5 1 (0.083%) Android
5 1 (0.083%) Solaris
5 1 (0.083%) VMS
Processes & Methodologies
1 739 (61.38%) Agile
2 592 (49.17%) Asset Management
3 553 (45.93%) Software Engineering
4 429 (35.63%) Investment Management
5 290 (24.09%) Analytics
6 237 (19.68%) Business Intelligence
7 207 (17.19%) Data Engineering
7 207 (17.19%) Line Management
8 198 (16.45%) Data Modelling
9 194 (16.11%) ETL
10 175 (14.53%) Greeks
11 168 (13.95%) DevOps
12 164 (13.62%) Data Pipeline
13 155 (12.87%) Visualisation
14 143 (11.88%) Data Architecture
15 138 (11.46%) Artificial Intelligence
16 135 (11.21%) Machine Learning
17 131 (10.88%) Migration
18 122 (10.13%) Roadmaps
19 116 (9.63%) CI/CD
Programming Languages
1 803 (66.69%) Python
2 629 (52.24%) Java
3 529 (43.94%) JavaScript
4 466 (38.70%) SQL
5 461 (38.29%) TypeScript
6 85 (7.06%) T-SQL
7 58 (4.82%) Go
8 34 (2.82%) Scala
9 32 (2.66%) C#
10 31 (2.57%) Data Analysis Expressions
11 21 (1.74%) R
12 15 (1.25%) Kotlin
13 11 (0.91%) PowerShell
13 11 (0.91%) U-SQL
14 6 (0.50%) VBA
15 4 (0.33%) Julia
16 2 (0.17%) Bicep
16 2 (0.17%) Kusto Query Language
16 2 (0.17%) PL/SQL
16 2 (0.17%) SOQL
Qualifications
1 79 (6.56%) Azure Certification
2 70 (5.81%) Degree
3 66 (5.48%) AWS Certification
4 30 (2.49%) Computer Science Degree
5 28 (2.33%) Microsoft Certification
6 20 (1.66%) SC Cleared
6 20 (1.66%) Security Cleared
7 11 (0.91%) Master's Degree
8 8 (0.66%) DBS Check
8 8 (0.66%) DV Cleared
9 3 (0.25%) MCP
9 3 (0.25%) MCSE
10 2 (0.17%) CIMA
10 2 (0.17%) MCSA
11 1 (0.083%) IBM Certification
11 1 (0.083%) LPIC
11 1 (0.083%) Numerate Degree
Quality Assurance & Compliance
1 297 (24.67%) Data Quality
2 38 (3.16%) GDPR
3 11 (0.91%) QA
4 7 (0.58%) California Consumer Privacy Act
5 3 (0.25%) Accessibility
6 2 (0.17%) HIPAA
6 2 (0.17%) ISO 20022
6 2 (0.17%) PMO
6 2 (0.17%) SLA
7 1 (0.083%) ISO/IEC 27001
7 1 (0.083%) PSD2
System Software
1 16 (1.33%) Docker
2 6 (0.50%) Active Directory
3 3 (0.25%) HDFS
4 1 (0.083%) Apache Flume
4 1 (0.083%) VMware Infrastructure
Systems Management
1 91 (7.56%) Terraform
2 86 (7.14%) Kubernetes
3 54 (4.49%) Prometheus
4 3 (0.25%) Ansible
5 2 (0.17%) Argo
5 2 (0.17%) HP Fortify
5 2 (0.17%) Progress Chef
Vendors
1 240 (19.93%) Databricks
2 208 (17.28%) Microsoft
3 65 (5.40%) Bloomberg
3 65 (5.40%) Reuters
4 50 (4.15%) Alteryx
5 43 (3.57%) Google
6 21 (1.74%) Oracle
7 13 (1.08%) SAP
8 9 (0.75%) Informatica
9 5 (0.42%) Cloudera
9 5 (0.42%) Salesforce
9 5 (0.42%) Talend
10 4 (0.33%) Teradata
11 3 (0.25%) SnapLogic
11 3 (0.25%) Sparx
12 2 (0.17%) CheckPoint
12 2 (0.17%) CrowdStrike
12 2 (0.17%) OpenAI
12 2 (0.17%) StreamSets
12 2 (0.17%) Veracode