Data Lake Jobs

Data Lakes
UK

The table below provides summary statistics for permanent job vacancies requiring Data Lake skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Lake over the 6 months leading up to 23 October 2024, comparing them to the same period in the previous two years.

6 months to
23 Oct 2024
Same period 2023 Same period 2022
Rank 201 235 265
Rank change year-on-year +34 +30 +36
Permanent jobs citing Data Lake 997 905 2,068
As % of all permanent jobs advertised in the UK 1.32% 1.52% 1.47%
As % of the Database & Business Intelligence category 8.18% 7.21% 5.84%
Number of salaries quoted 828 596 1,153
10th Percentile £56,250 £46,306 £47,500
25th Percentile £75,938 £53,750 £57,500
Median annual salary (50th Percentile) £100,000 £72,500 £75,000
Median % change year-on-year +37.93% -3.33% +7.14%
75th Percentile £142,500 £87,813 £90,000
90th Percentile £148,750 £108,125 £105,000
UK excluding London median annual salary £59,500 £65,000 £65,000
% change year-on-year -8.46% - +8.33%

All Database and Business Intelligence Skills
UK

Data Lake falls under the Databases and Business Intelligence category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 12,193 12,560 35,408
As % of all permanent jobs advertised in the UK 16.12% 21.12% 25.20%
Number of salaries quoted 6,209 9,440 18,525
10th Percentile £37,500 £37,000 £36,250
25th Percentile £47,500 £47,250 £46,250
Median annual salary (50th Percentile) £65,000 £60,000 £60,000
Median % change year-on-year +8.33% - +4.35%
75th Percentile £86,250 £80,000 £82,500
90th Percentile £115,000 £95,000 £97,500
UK excluding London median annual salary £52,500 £55,000 £54,000
% change year-on-year -4.55% +1.85% +8.00%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 23 October 2024.

Salary histogram for Data Lake in the UK

Data Lake
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 23 October 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +37 950 £102,500 +36.67% 129
London +103 760 £110,000 +37.50% 62
Work from Home +116 754 £110,000 +57.14% 184
UK excluding London -192 205 £59,500 -8.46% 72
North of England -85 89 £61,250 +2.08% 16
North West -40 67 £60,000 +14.29% 5
South East -58 40 £53,500 -2.73% 22
Midlands -40 29 £60,000 +9.09% 11
Yorkshire -26 20 £65,000 -7.14% 2
West Midlands -35 19 £60,000 +9.09% 11
South West -69 19 £55,000 -22.07% 7
Scotland -40 14 £57,500 -27.79% 4
East Midlands -35 10 £50,000 -
Wales +33 6 £42,750 -27.23% 5
Northern Ireland +15 4 - - 1
East of England -43 4 £107,048 -0.42% 6
North East -37 2 - - 9

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 498 (49.95%) Apache Airflow
2 451 (45.24%) Apache
3 73 (7.32%) Apache Spark
4 15 (1.50%) SharePoint
5 13 (1.30%) Confluence
6 9 (0.90%) Microsoft Exchange
7 2 (0.20%) ArcGIS
8 1 (0.10%) SAS
Applications
1 14 (1.40%) Microsoft Excel
2 7 (0.70%) Microsoft Office
3 4 (0.40%) Microsoft PowerPoint
4 1 (0.10%) Microsoft Project
4 1 (0.10%) MS Visio
Business Applications
1 10 (1.00%) Dynamics CRM
2 4 (0.40%) Aladdin
2 4 (0.40%) Eagle PACE
2 4 (0.40%) Markit EDM
3 3 (0.30%) Dynamics NAV
4 1 (0.10%) Salesforce CRM
4 1 (0.10%) SAP S/4HANA
Cloud Services
1 649 (65.10%) AWS
2 524 (52.56%) dbt
3 463 (46.44%) Snowflake
4 422 (42.33%) Azure
5 308 (30.89%) GCP
6 196 (19.66%) Power Platform
7 131 (13.14%) Azure Data Factory
8 126 (12.64%) Azure Synapse Analytics
9 103 (10.33%) Amazon EC2
10 93 (9.33%) Amazon EKS
11 92 (9.23%) Amazon ECS
12 53 (5.32%) Dagster
13 49 (4.91%) Azure DevOps
14 38 (3.81%) Serverless
15 34 (3.41%) Amazon S3
16 28 (2.81%) GitHub
17 21 (2.11%) AWS Lambda
18 19 (1.91%) Azure Logic Apps
18 19 (1.91%) Dynamics 365
19 18 (1.81%) PowerApps
Communications & Networking
1 19 (1.91%) Modbus
1 19 (1.91%) MQTT
2 13 (1.30%) Wireless
3 5 (0.50%) Network Security
4 4 (0.40%) Firewall
5 1 (0.10%) FTP
5 1 (0.10%) Internet
Database & Business Intelligence
1 507 (50.85%) Dremio
2 476 (47.74%) Amazon Athena
3 453 (45.44%) Apache Arrow
4 404 (40.52%) Apache Ignite
5 207 (20.76%) Data Warehouse
6 193 (19.36%) Power BI
7 109 (10.93%) Big Data
8 70 (7.02%) Tableau
9 68 (6.82%) Azure SQL Database
10 66 (6.62%) SQL Server
11 47 (4.71%) Metadata
12 45 (4.51%) SQL Server Integration Services
13 42 (4.21%) Azure SQL Data Warehouse
14 35 (3.51%) NoSQL
15 24 (2.41%) Data Mining
16 22 (2.21%) SQL Server Reporting Services
17 20 (2.01%) Amazon Redshift
17 20 (2.01%) Hadoop
18 19 (1.91%) Amazon RDS
18 19 (1.91%) BigQuery
Development Applications
1 28 (2.81%) Git
2 19 (1.91%) MSI
3 16 (1.60%) JIRA
4 14 (1.40%) Jenkins
5 13 (1.30%) MLflow
6 8 (0.80%) Visual Studio
7 6 (0.60%) Gatling
8 4 (0.40%) Octopus Deploy
8 4 (0.40%) TeamCity
9 3 (0.30%) ERwin
9 3 (0.30%) Flyway
9 3 (0.30%) GitLab
9 3 (0.30%) Liquibase
10 2 (0.20%) git-flow
10 2 (0.20%) MagicDraw
10 2 (0.20%) TensorBoard
11 1 (0.10%) Eclipse
11 1 (0.10%) Postman
11 1 (0.10%) Subversion
11 1 (0.10%) Visual Studio Code
General
1 637 (63.89%) Finance
2 511 (51.25%) Banking
3 487 (48.85%) Front Office
4 432 (43.33%) Investment Banking
5 112 (11.23%) Social Skills
6 57 (5.72%) Analytical Skills
7 35 (3.51%) Inclusion and Diversity
8 34 (3.41%) Law
9 30 (3.01%) Marketing
9 30 (3.01%) Presentation Skills
10 26 (2.61%) Legal
11 16 (1.60%) Aerospace
12 12 (1.20%) Financial Institution
13 11 (1.10%) Advertising
13 11 (1.10%) Publishing
13 11 (1.10%) Retail Banking
14 10 (1.00%) Brand Awareness
14 10 (1.00%) Organisational Skills
14 10 (1.00%) Pharmaceutical
15 8 (0.80%) Public Sector
Job Titles
1 275 (27.58%) Software Engineer
2 268 (26.88%) Python Engineer
3 264 (26.48%) Senior
4 228 (22.87%) AWS Engineer
5 220 (22.07%) Data Engineer
6 193 (19.36%) AWS Software Engineer
7 189 (18.96%) Lead
8 184 (18.46%) Java Engineer
8 184 (18.46%) Java Software Engineer
8 184 (18.46%) Python Software Engineer
9 174 (17.45%) Architect
10 153 (15.35%) Senior Software Engineer
11 123 (12.34%) Senior Java Engineer
11 123 (12.34%) Senior Java Software Engineer
12 111 (11.13%) Developer
13 80 (8.02%) Solutions Architect
14 79 (7.92%) Python Data Engineer
15 71 (7.12%) Software Developer
16 70 (7.02%) Lead Developer
16 70 (7.02%) Lead Software Engineer
Libraries, Frameworks & Software Standards
1 453 (45.44%) Pandas
2 451 (45.24%) NumPy
3 449 (45.04%) SciPy
4 421 (42.23%) gRPC
4 421 (42.23%) Protocol Buffers
5 202 (20.26%) PySpark
6 27 (2.71%) JSON
7 19 (1.91%) Middleware
8 15 (1.50%) Kafka
9 14 (1.40%) REST
10 13 (1.30%) GraphQL
11 12 (1.20%) XML
12 11 (1.10%) .NET
13 10 (1.00%) CSS
13 10 (1.00%) HTML
14 9 (0.90%) Node.js
14 9 (0.90%) PyTorch
15 8 (0.80%) React
16 7 (0.70%) scikit-learn
16 7 (0.70%) Web Services
Miscellaneous
1 453 (45.44%) Hedge funds
2 429 (43.03%) Derivative
2 429 (43.03%) Equities
2 429 (43.03%) Fixed Income
2 429 (43.03%) Foreign Exchange (FX)
3 102 (10.23%) Pricing Data
4 49 (4.91%) Product Ownership
5 30 (3.01%) Self-Motivation
6 25 (2.51%) Cloud Native
7 24 (2.41%) Clustering
8 16 (1.60%) Enterprise Software
9 15 (1.50%) Legacy Applications
10 14 (1.40%) Data Structures
11 12 (1.20%) Algorithms
12 10 (1.00%) Replication
13 7 (0.70%) Data Fabric
13 7 (0.70%) Reference Data
13 7 (0.70%) Virtual Team
14 6 (0.60%) Analytical Mindset
14 6 (0.60%) Legacy Systems
Operating Systems
1 25 (2.51%) Linux
2 4 (0.40%) Windows
3 3 (0.30%) Unix
4 2 (0.20%) Red Hat Enterprise Linux
4 2 (0.20%) Windows Server
5 1 (0.10%) Android
Processes & Methodologies
1 623 (62.49%) Agile
2 517 (51.86%) Asset Management
3 485 (48.65%) Software Engineering
4 350 (35.11%) Investment Management
5 227 (22.77%) Analytics
6 185 (18.56%) Data Engineering
6 185 (18.56%) Migration
7 181 (18.15%) ETL
8 174 (17.45%) Data Modelling
9 161 (16.15%) Business Intelligence
10 141 (14.14%) Line Management
11 140 (14.04%) DevOps
12 132 (13.24%) Data Pipeline
13 123 (12.34%) Greeks
14 109 (10.93%) Data Governance
15 108 (10.83%) Visualisation
16 98 (9.83%) Data Architecture
17 93 (9.33%) Mentoring
18 80 (8.02%) CI/CD
18 80 (8.02%) Data Visualisation
Programming Languages
1 674 (67.60%) Python
2 511 (51.25%) Java
3 434 (43.53%) JavaScript
4 407 (40.82%) SQL
5 397 (39.82%) TypeScript
6 48 (4.81%) T-SQL
7 30 (3.01%) C#
8 25 (2.51%) Go
9 23 (2.31%) Scala
10 18 (1.81%) Data Analysis Expressions
11 13 (1.30%) PowerShell
12 11 (1.10%) R
13 10 (1.00%) Kotlin
14 9 (0.90%) Bicep
15 8 (0.80%) PL/SQL
16 7 (0.70%) VBA
17 4 (0.40%) Julia
17 4 (0.40%) U-SQL
18 3 (0.30%) Shell Script
19 2 (0.20%) SOQL
Qualifications
1 79 (7.92%) Degree
2 43 (4.31%) AWS Certification
2 43 (4.31%) Azure Certification
3 40 (4.01%) Computer Science Degree
4 16 (1.60%) Master's Degree
5 13 (1.30%) Security Cleared
6 11 (1.10%) SC Cleared
7 8 (0.80%) DBS Check
8 7 (0.70%) AWS Certified Solutions Architect
9 5 (0.50%) Microsoft Certification
10 4 (0.40%) AWS Certified Developer
10 4 (0.40%) AWS Certified SysOps Administrator
11 3 (0.30%) PhD
12 2 (0.20%) AWS Certified DevOps Engineer
12 2 (0.20%) CEH
12 2 (0.20%) CISSP
13 1 (0.10%) Numerate Degree
13 1 (0.10%) PMI Certification
13 1 (0.10%) PMP
13 1 (0.10%) SnowPro
Quality Assurance & Compliance
1 211 (21.16%) Data Quality
2 30 (3.01%) GDPR
3 9 (0.90%) Accessibility
4 6 (0.60%) Cyber Essentials
4 6 (0.60%) NCSC
4 6 (0.60%) NIST
5 5 (0.50%) HIPAA
6 4 (0.40%) ISO 20022
7 3 (0.30%) California Consumer Privacy Act
7 3 (0.30%) QA
8 2 (0.20%) HL7
8 2 (0.20%) SLA
9 1 (0.10%) PMO
System Software
1 14 (1.40%) Docker
2 4 (0.40%) Active Directory
3 3 (0.30%) HDFS
4 2 (0.20%) VMware Infrastructure
Systems Management
1 62 (6.22%) Terraform
2 37 (3.71%) Kubernetes
3 24 (2.41%) Prometheus
4 5 (0.50%) Ansible
5 3 (0.30%) Microsoft Intune
6 2 (0.20%) Progress Chef
Vendors
1 172 (17.25%) Databricks
2 156 (15.65%) Microsoft
3 65 (6.52%) Bloomberg
3 65 (6.52%) Reuters
4 53 (5.32%) Google
5 18 (1.81%) Oracle
6 12 (1.20%) Teradata
7 10 (1.00%) Informatica
8 9 (0.90%) SAP
9 7 (0.70%) Alteryx
10 4 (0.40%) Ab Initio
10 4 (0.40%) Cloudera
10 4 (0.40%) OpenAI
10 4 (0.40%) Salesforce
11 3 (0.30%) RedGate
12 2 (0.20%) Cisco
12 2 (0.20%) Palo Alto
12 2 (0.20%) Red Hat
12 2 (0.20%) Splunk
12 2 (0.20%) VMware