Data Lake Jobs with Work from Home Options

Data Lakes
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 13 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
13 May 2024
Same period 2023 Same period 2022
Rank 181 212 282
Rank change year-on-year +31 +70 +61
Permanent jobs citing Data Lake 598 682 939
As % of all permanent jobs with a WFH option 1.77% 1.65% 1.35%
As % of the Database & Business Intelligence category 7.69% 6.67% 4.59%
Number of salaries quoted 506 519 540
10th Percentile £41,750 £50,984 £47,500
25th Percentile £62,500 £61,180 £52,500
Median annual salary (50th Percentile) £90,000 £80,294 £70,000
Median % change year-on-year +12.09% +14.71% +7.69%
75th Percentile £142,500 £106,250 £86,250
90th Percentile £148,750 £150,000 £100,000
UK median annual salary £85,000 £80,000 £70,000
% change year-on-year +6.25% +14.29% -

All Database and Business Intelligence Skills
Work from Home

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for database or business intelligence skills.

Permanent vacancies with a requirement for database or business intelligence skills 7,775 10,218 20,447
As % of all permanent jobs with a WFH option 23.06% 24.71% 29.48%
Number of salaries quoted 6,203 7,015 11,034
10th Percentile £37,000 £40,000 £36,250
25th Percentile £43,750 £49,375 £45,000
Median annual salary (50th Percentile) £57,500 £65,000 £60,000
Median % change year-on-year -11.54% +8.33% +9.09%
75th Percentile £75,000 £82,500 £78,750
90th Percentile £96,539 £102,500 £93,750
UK median annual salary £57,500 £65,000 £60,000
% change year-on-year -11.54% +8.33% +9.09%

Data Lake
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Data Lake as a proportion of all IT jobs advertised.

Data Lake trend for jobs with a WFH option

Data Lake
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Data Lake.

Data Lake salary trend for jobs with a WFH option

Data Lake
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Data Lake over the 6 months to 13 May 2024.

Data Lake salary histogram for jobs with a WFH option

Data Lake
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 250 (41.81%) Apache Airflow
2 204 (34.11%) Apache
3 45 (7.53%) Apache Spark
4 2 (0.33%) Confluence
4 2 (0.33%) Jupyter
5 1 (0.17%) IIS
5 1 (0.17%) Microsoft Exchange
5 1 (0.17%) SAS
5 1 (0.17%) SharePoint
Applications
1 8 (1.34%) Microsoft Excel
2 5 (0.84%) Microsoft Office
3 1 (0.17%) Microsoft PowerPoint
Business Applications
1 6 (1.00%) Primavera
2 3 (0.50%) SAP S/4HANA
3 1 (0.17%) Salesforce CRM
Cloud Services
1 334 (55.85%) AWS
2 308 (51.51%) Snowflake
3 301 (50.33%) Azure
4 245 (40.97%) dbt
5 126 (21.07%) GCP
6 111 (18.56%) Power Platform
7 87 (14.55%) Azure Data Factory
8 84 (14.05%) Azure Synapse Analytics
9 49 (8.19%) Matillion
10 42 (7.02%) Azure Cosmos DB
11 30 (5.02%) Serverless
12 25 (4.18%) Azure DevOps
13 14 (2.34%) PowerApps
14 13 (2.17%) Power Automate
15 11 (1.84%) Azure Data Lake Analytics
15 11 (1.84%) Azure Machine Learning
16 9 (1.51%) GitHub
17 8 (1.34%) SaaS
18 7 (1.17%) AWS Lambda
18 7 (1.17%) Dynamics 365
Communications & Networking
1 18 (3.01%) Wireless
2 10 (1.67%) Network Security
3 3 (0.50%) DNS
4 1 (0.17%) Firewall
4 1 (0.17%) HTTP
4 1 (0.17%) SAN
Database & Business Intelligence
1 243 (40.64%) Dremio
2 241 (40.30%) Amazon Athena
3 240 (40.13%) Apache Arrow
4 231 (38.63%) Data Warehouse
5 192 (32.11%) Apache Ignite
6 120 (20.07%) Big Data
7 109 (18.23%) Power BI
8 97 (16.22%) SQL Server
9 53 (8.86%) Azure SQL Data Warehouse
10 43 (7.19%) Azure SQL Database
11 33 (5.52%) Star Schema
12 31 (5.18%) Elasticsearch
13 27 (4.52%) Metadata
14 23 (3.85%) NoSQL
15 20 (3.34%) Delta Lake
15 20 (3.34%) Tableau
16 19 (3.18%) Relational Database
17 18 (3.01%) BigQuery
18 13 (2.17%) Data Mining
19 11 (1.84%) PostgreSQL
Development Applications
1 31 (5.18%) GitLab
2 10 (1.67%) MLflow
3 7 (1.17%) Visual Studio
4 6 (1.00%) Git
4 6 (1.00%) Oracle Forms
5 3 (0.50%) JIRA
5 3 (0.50%) Octopus Deploy
6 2 (0.33%) ER Studio
6 2 (0.33%) ERwin
7 1 (0.17%) Jenkins
7 1 (0.17%) Visual Studio Team System
General
1 354 (59.20%) Finance
2 206 (34.45%) Banking
3 192 (32.11%) Front Office
3 192 (32.11%) Investment Banking
4 74 (12.37%) Social Skills
5 51 (8.53%) Analytical Skills
6 50 (8.36%) Presentation Skills
7 21 (3.51%) Retail
8 18 (3.01%) Public Sector
9 15 (2.51%) Billing
10 13 (2.17%) Marketing
10 13 (2.17%) Telecoms
11 10 (1.67%) Back Office
12 9 (1.51%) Influencing Skills
13 8 (1.34%) Legal
14 5 (0.84%) Games
15 4 (0.67%) Wearables
16 3 (0.50%) Inclusion and Diversity
17 2 (0.33%) Manufacturing
17 2 (0.33%) Organisational Skills
Job Titles
1 159 (26.59%) Senior
2 157 (26.25%) Data Engineer
3 124 (20.74%) Lead
4 115 (19.23%) AWS Engineer
5 109 (18.23%) Software Engineer
6 106 (17.73%) Architect
7 81 (13.55%) Python Engineer
8 68 (11.37%) Developer
9 66 (11.04%) Java Engineer
9 66 (11.04%) Java Software Engineer
9 66 (11.04%) Python Software Engineer
10 64 (10.70%) AWS Software Engineer
11 62 (10.37%) Consultant
12 60 (10.03%) Solutions Architect
13 57 (9.53%) Data Consultant
13 57 (9.53%) Senior Software Engineer
14 54 (9.03%) Data Architect
15 50 (8.36%) Big Data Engineer
16 48 (8.03%) Senior Consultant
16 48 (8.03%) Site Reliability Engineer
Libraries, Frameworks & Software Standards
1 240 (40.13%) gRPC
1 240 (40.13%) Protocol Buffers
2 200 (33.44%) Pandas
3 192 (32.11%) NumPy
3 192 (32.11%) SciPy
4 39 (6.52%) PySpark
5 9 (1.51%) Apache Beam
5 9 (1.51%) JSON
5 9 (1.51%) Kafka
6 6 (1.00%) XML
7 5 (0.84%) Web Services
8 4 (0.67%) MDX
8 4 (0.67%) YAML
9 3 (0.50%) .NET
9 3 (0.50%) RESTful
10 2 (0.33%) FastAPI
10 2 (0.33%) Flask
11 1 (0.17%) ARM Templates
11 1 (0.17%) Node.js
11 1 (0.17%) REST
Miscellaneous
1 240 (40.13%) Hedge funds
2 192 (32.11%) Derivative
2 192 (32.11%) Equities
2 192 (32.11%) Fixed Income
2 192 (32.11%) Foreign Exchange (FX)
3 50 (8.36%) Data Structures
4 48 (8.03%) Clustering
5 31 (5.18%) Self-Motivation
6 24 (4.01%) Pricing Data
7 20 (3.34%) Enterprise Software
8 15 (2.51%) Cloud Native
9 14 (2.34%) Algorithms
10 11 (1.84%) Greenfield Project
11 9 (1.51%) Product Ownership
12 8 (1.34%) IoT
13 7 (1.17%) Management Information System
14 6 (1.00%) Public Cloud
15 5 (0.84%) Distributed Computing
15 5 (0.84%) Virtual Team
16 3 (0.50%) Distributed Systems
Operating Systems
1 3 (0.50%) Linux
2 2 (0.33%) Unix
2 2 (0.33%) Windows
3 1 (0.17%) AIX
3 1 (0.17%) Solaris
3 1 (0.17%) VMS
Processes & Methodologies
1 262 (43.81%) Agile
2 240 (40.13%) Asset Management
3 212 (35.45%) Investment Management
4 204 (34.11%) Software Engineering
5 159 (26.59%) Analytics
6 142 (23.75%) Data Pipeline
7 131 (21.91%) Artificial Intelligence
8 130 (21.74%) ETL
9 126 (21.07%) Data Engineering
10 123 (20.57%) Business Intelligence
11 119 (19.90%) Data Modelling
12 110 (18.39%) Data Science
13 106 (17.73%) DevOps
14 102 (17.06%) Machine Learning
15 93 (15.55%) Data Architecture
16 91 (15.22%) Line Management
17 80 (13.38%) Greeks
17 80 (13.38%) Roadmaps
18 72 (12.04%) CI/CD
19 61 (10.20%) Data Analytics
Programming Languages
1 388 (64.88%) Python
2 269 (44.98%) Java
3 241 (40.30%) JavaScript
4 228 (38.13%) SQL
5 192 (32.11%) TypeScript
6 56 (9.36%) Go
7 46 (7.69%) T-SQL
8 24 (4.01%) Data Analysis Expressions
9 19 (3.18%) C#
10 13 (2.17%) R
11 12 (2.01%) Scala
12 10 (1.67%) Kotlin
12 10 (1.67%) U-SQL
13 3 (0.50%) C
14 2 (0.33%) PowerShell
14 2 (0.33%) VBA
15 1 (0.17%) Bash
15 1 (0.17%) Kusto Query Language
15 1 (0.17%) PL/SQL
Qualifications
1 59 (9.87%) Azure Certification
2 47 (7.86%) AWS Certification
3 34 (5.69%) Degree
4 26 (4.35%) Microsoft Certification
5 11 (1.84%) Computer Science Degree
6 9 (1.51%) SC Cleared
6 9 (1.51%) Security Cleared
7 7 (1.17%) DV Cleared
7 7 (1.17%) Master's Degree
8 6 (1.00%) CIMA
9 3 (0.50%) MCP
10 1 (0.17%) IBM Certification
10 1 (0.17%) LPIC
10 1 (0.17%) MCSE
10 1 (0.17%) Numerate Degree
Quality Assurance & Compliance
1 146 (24.41%) Data Quality
2 32 (5.35%) GDPR
3 6 (1.00%) California Consumer Privacy Act
4 4 (0.67%) Accessibility
5 2 (0.33%) PMO
6 1 (0.17%) GMP
6 1 (0.17%) HIPAA
6 1 (0.17%) QA
6 1 (0.17%) SLA
System Software
1 15 (2.51%) Docker
2 1 (0.17%) Active Directory
2 1 (0.17%) Virtual Machines
2 1 (0.17%) VMware Infrastructure
Systems Management
1 77 (12.88%) Kubernetes
2 63 (10.54%) Terraform
3 48 (8.03%) Prometheus
4 2 (0.33%) Argo
4 2 (0.33%) Progress Chef
Vendors
1 128 (21.40%) Databricks
2 91 (15.22%) Microsoft
3 16 (2.68%) Google
4 15 (2.51%) SAP
5 13 (2.17%) Oracle
6 8 (1.34%) Teradata
7 6 (1.00%) Adobe
7 6 (1.00%) Apple
8 5 (0.84%) Talend
9 3 (0.50%) SnapLogic
10 2 (0.33%) CrowdStrike
11 1 (0.17%) Ariba
11 1 (0.17%) Bloomberg
11 1 (0.17%) IBM
11 1 (0.17%) Reuters
11 1 (0.17%) Salesforce
11 1 (0.17%) Sparx
11 1 (0.17%) UiPath
11 1 (0.17%) VMware
11 1 (0.17%) Workday