Job Vacancy Trend Salary Trend Salary Histogram Skill Sets
Period
to

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 21 May 2022 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > Work from Home
6 months to
21 May 2022		 Same period 2021 Same period 2020
Rank 257 327 275
Rank change year-on-year +70 -52 -12
Permanent jobs citing Data Lake 1,005 258 42
As % of all permanent jobs with a WFH option 1.41% 0.82% 0.45%
As % of the Database & Business Intelligence category 4.81% 2.81% 1.58%
Number of salaries quoted 551 203 27
10th Percentile £47,500 £41,900 £36,250
25th Percentile £53,750 £50,000 £46,250
Median annual salary (50th Percentile) £70,000 £62,500 £70,000
Median % change year-on-year +12.00% -10.71% +7.69%
75th Percentile £86,250 £80,000 £75,500
90th Percentile £100,000 £97,500 £93,550
UK median annual salary £70,000 £70,000 £70,000
% change year-on-year - - +6.87%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Work from Home
Permanent vacancies with a requirement for database or business intelligence skills 20,908 9,192 2,657
As % of all permanent jobs with a WFH option 29.28% 29.21% 28.55%
Number of salaries quoted 10,964 7,546 2,241
10th Percentile £36,250 £32,500 £35,000
25th Percentile £45,000 £40,500 £42,500
Median annual salary (50th Percentile) £60,000 £55,000 £55,000
Median % change year-on-year +9.09% - -
75th Percentile £78,750 £72,500 £71,250
90th Percentile £93,750 £85,000 £85,000
UK median annual salary £60,000 £55,000 £52,500
% change year-on-year +9.09% +4.76% +5.00%

Data Lake
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Data Lake as a proportion of all IT jobs advertised.

Data Lake trend for jobs with a WFH option

Data Lake
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Data Lake.

Data Lake salary trend for jobs with a WFH option

Data Lake
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Data Lake over the 6 months to 21 May 2022.

Data Lake salary histogram for jobs with a WFH option

For the 6 months to 21 May 2022, Data Lake job roles required the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent jobs with a WFH option and a requirement for Data Lake.

1 651 (64.78%) Data Warehouse
2 630 (62.69%) SQL
3 626 (62.29%) Azure
4 523 (52.04%) Python
5 481 (47.86%) ETL
6 471 (46.87%) Analytics
7 421 (41.89%) Business Intelligence
8 420 (41.79%) AWS
9 367 (36.52%) Agile
10 337 (33.53%) Data Modelling
11 332 (33.03%) Databricks
12 329 (32.74%) Data Pipeline
13 319 (31.74%) Data Engineering
14 292 (29.05%) Data Science
15 272 (27.06%) Finance
16 264 (26.27%) GCP
17 259 (25.77%) CI/CD
18 257 (25.57%) Azure Data Factory
19 238 (23.68%) Big Data
20 235 (23.38%) Machine Learning
21 231 (22.99%) SQL Server
22 225 (22.39%) Power Platform
23 222 (22.09%) Microsoft
24 219 (21.79%) Social Skills
25 215 (21.39%) Power BI
26 211 (21.00%) Apache Spark
27 187 (18.61%) NoSQL
28 185 (18.41%) DevOps
29 183 (18.21%) Java
30 177 (17.61%) Visualisation

Data Lake
Co-occurring IT Skills with a WFH Option by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 211 (21.00%) Apache Spark
2 123 (12.24%) Apache Airflow
3 79 (7.86%) Apache
4 53 (5.27%) Elasticsearch
5 18 (1.79%) Oracle Workflow
6 10 (1.00%) Luigi
7 8 (0.80%) SharePoint
8 7 (0.70%) Apache Pig
9 6 (0.60%) SAS
10 4 (0.40%) Confluence
11 3 (0.30%) BizTalk Server
11 3 (0.30%) Oracle Coherence
12 1 (0.100%) CMS
12 1 (0.100%) Jupyter
Applications
1 17 (1.69%) Microsoft Excel
2 7 (0.70%) Campfire
3 6 (0.60%) Microsoft Office
3 6 (0.60%) Spreadsheet
4 1 (0.100%) Gephi
4 1 (0.100%) SPSS
Business Applications
1 4 (0.40%) Magento
1 4 (0.40%) Payment Gateway
1 4 (0.40%) SAP MDM
1 4 (0.40%) Shopify
2 2 (0.20%) Dynamics AX
2 2 (0.20%) NetSuite
3 1 (0.100%) Dynamics CRM
3 1 (0.100%) Eagle PACE
3 1 (0.100%) SimCorp Dimension
3 1 (0.100%) Unit4 Business World
Cloud Services
1 626 (62.29%) Azure
2 420 (41.79%) AWS
3 264 (26.27%) GCP
4 257 (25.57%) Azure Data Factory
5 225 (22.39%) Power Platform
6 164 (16.32%) Azure Synapse Analytics
7 151 (15.02%) Amazon S3
8 128 (12.74%) Serverless
9 117 (11.64%) Snowflake
10 84 (8.36%) AWS Lambda
11 83 (8.26%) Azure Cosmos DB
12 65 (6.47%) Amazon Kinesis
13 58 (5.77%) GitHub
14 49 (4.88%) AWS CloudFormation
15 45 (4.48%) Matillion
16 39 (3.88%) Amazon EMR
17 37 (3.68%) SaaS
18 34 (3.38%) Amazon CloudWatch
19 18 (1.79%) Amazon SageMaker
20 17 (1.69%) AWS Step Functions
Communications & Networking
1 12 (1.19%) Broadband
1 12 (1.19%) Internet
2 10 (1.00%) Skype
3 9 (0.90%) Network Security
4 5 (0.50%) Wireless
5 3 (0.30%) Intranet
6 2 (0.20%) Kerberos
6 2 (0.20%) VPN
7 1 (0.100%) AMQP
7 1 (0.100%) DNS
7 1 (0.100%) Firewall
7 1 (0.100%) tcpdump
7 1 (0.100%) Wireshark
Database & Business Intelligence
1 651 (64.78%) Data Warehouse
2 238 (23.68%) Big Data
3 231 (22.99%) SQL Server
4 215 (21.39%) Power BI
5 187 (18.61%) NoSQL
6 177 (17.61%) Hadoop
7 139 (13.83%) Amazon Redshift
8 119 (11.84%) SQL Server Integration Services
9 116 (11.54%) Tableau
10 103 (10.25%) Azure SQL Database
11 100 (9.95%) Relational Database
12 98 (9.75%) Amazon Athena
13 89 (8.86%) Apache Hive
14 80 (7.96%) Azure SQL Data Warehouse
15 78 (7.76%) SQL Server Analysis Services
16 77 (7.66%) SQL Server Reporting Services
17 75 (7.46%) BigQuery
17 75 (7.46%) Metadata
18 47 (4.68%) MySQL
19 44 (4.38%) Star Schema
Development Applications
1 114 (11.34%) Git (software)
2 78 (7.76%) Jenkins
3 36 (3.58%) CircleCI
4 34 (3.38%) GitLab
5 26 (2.59%) SQL Server Management Studio (SSMS)
6 24 (2.39%) Visual Studio
7 18 (1.79%) JIRA
8 14 (1.39%) Atlassian Bamboo
8 14 (1.39%) Subversion
9 13 (1.29%) TeamCity
10 12 (1.19%) ER Studio
10 12 (1.19%) ERwin
11 11 (1.09%) Babel
11 11 (1.09%) ESLint
11 11 (1.09%) Mocha
11 11 (1.09%) Selenium
11 11 (1.09%) webpack
12 4 (0.40%) PowerDesigner
13 3 (0.30%) Balsamiq
14 2 (0.20%) Bitbucket
General
1 272 (27.06%) Finance
2 219 (21.79%) Social Skills
3 154 (15.32%) Analytical Skills
4 113 (11.24%) Banking
5 80 (7.96%) Retail
6 54 (5.37%) Public Sector
7 51 (5.07%) Inclusion and Diversity
8 47 (4.68%) Legal
9 46 (4.58%) Law
10 45 (4.48%) Publishing
11 41 (4.08%) Marketing
12 21 (2.09%) Organisational Skills
12 21 (2.09%) Presentation Skills
13 20 (1.99%) Local Government
14 17 (1.69%) Games
15 16 (1.59%) Manufacturing
16 15 (1.49%) Advertising
16 15 (1.49%) Retail Banking
17 14 (1.39%) Influencing Skills
18 13 (1.29%) Back Office
Job Titles
1 522 (51.94%) Data Engineer
2 138 (13.73%) Senior Data Engineer
3 120 (11.94%) Architect
4 116 (11.54%) Azure Engineer
5 113 (11.24%) Data Architect
6 80 (7.96%) Developer
7 51 (5.07%) Analyst
8 38 (3.78%) Solutions Architect
9 37 (3.68%) Consultant
10 34 (3.38%) Big Data Engineer
10 34 (3.38%) Business Intelligence Developer
11 31 (3.08%) Data Consultant
11 31 (3.08%) Principal Engineer
12 29 (2.89%) Software Engineer
13 25 (2.49%) Data Manager
13 25 (2.49%) Senior Analyst
13 25 (2.49%) Senior Manager
14 23 (2.29%) SQL Developer
15 21 (2.09%) Cloud Engineer
15 21 (2.09%) Product Manager
Libraries, Frameworks & Software Standards
1 151 (15.02%) Kafka
2 119 (11.84%) PySpark
3 55 (5.47%) Spark Streaming
4 49 (4.88%) Node.js
5 40 (3.98%) .NET
6 39 (3.88%) JSON
7 36 (3.58%) OAuth
8 34 (3.38%) React
9 30 (2.99%) XML
10 23 (2.29%) Apache Avro
11 22 (2.19%) ARM Templates
12 19 (1.89%) Web Services
13 17 (1.69%) Express
13 17 (1.69%) REST
14 15 (1.49%) HTML
14 15 (1.49%) React Native
15 14 (1.39%) CSS
15 14 (1.39%) HTML5
15 14 (1.39%) RabbitMQ
15 14 (1.39%) TensorFlow
Miscellaneous
1 133 (13.23%) Data Structures
2 95 (9.45%) Greenfield Project
3 91 (9.05%) Algorithms
4 52 (5.17%) Public Cloud
5 42 (4.18%) Self-Motivation
6 40 (3.98%) IoT
7 36 (3.58%) Management Information System
8 35 (3.48%) Cloud Native
9 20 (1.99%) Reinsurance
10 18 (1.79%) Data Centre
11 17 (1.69%) Sports Betting
12 12 (1.19%) Online Games
13 10 (1.00%) Reference Data
13 10 (1.00%) User Experience
14 9 (0.90%) Enterprise Software
15 8 (0.80%) Housing Association
15 8 (0.80%) Mobile App
15 8 (0.80%) Replication
16 7 (0.70%) Private Cloud
17 6 (0.60%) Legacy Systems
Operating Systems
1 30 (2.99%) Linux
2 16 (1.59%) Unix
3 9 (0.90%) Windows
4 4 (0.40%) Windows Server
5 2 (0.20%) Android
5 2 (0.20%) Apple iOS
6 1 (0.100%) VMS
Processes & Methodologies
1 481 (47.86%) ETL
2 471 (46.87%) Analytics
3 421 (41.89%) Business Intelligence
4 367 (36.52%) Agile
5 337 (33.53%) Data Modelling
6 329 (32.74%) Data Pipeline
7 319 (31.74%) Data Engineering
8 292 (29.05%) Data Science
9 259 (25.77%) CI/CD
10 235 (23.38%) Machine Learning
11 185 (18.41%) DevOps
12 177 (17.61%) Visualisation
13 175 (17.41%) Data Architecture
14 153 (15.22%) Data Strategy
15 151 (15.02%) Data Analytics
16 144 (14.33%) Data Management
17 141 (14.03%) Data Integration
18 130 (12.94%) Migration
19 129 (12.84%) Software Engineering
20 125 (12.44%) Data Transformation
Programming Languages
1 630 (62.69%) SQL
2 523 (52.04%) Python
3 183 (18.21%) Java
4 152 (15.12%) Scala
5 106 (10.55%) T-SQL
6 80 (7.96%) C#
7 69 (6.87%) R
8 56 (5.57%) JavaScript
9 37 (3.68%) Bash
10 33 (3.28%) PowerShell
11 21 (2.09%) TypeScript
12 19 (1.89%) Data Analysis Expressions (DAX)
13 13 (1.29%) Apex Code
13 13 (1.29%) Ruby
13 13 (1.29%) SOQL
13 13 (1.29%) SOSL
14 12 (1.19%) U-SQL
15 10 (1.00%) VBA
16 9 (0.90%) PHP
17 6 (0.60%) C++
Qualifications
1 85 (8.46%) Degree
2 26 (2.59%) Security Cleared
3 23 (2.29%) Computer Science Degree
4 19 (1.89%) SC Cleared
5 8 (0.80%) BPSS Clearance
6 7 (0.70%) Master's Degree
6 7 (0.70%) Microsoft Certification
7 6 (0.60%) AWS Certification
7 6 (0.60%) Numerate Degree
8 5 (0.50%) CTC Cleared
9 2 (0.20%) IIBA
9 2 (0.20%) TOGAF Certification
10 1 (0.100%) DBS Check
10 1 (0.100%) ITIL Foundation Certificate
10 1 (0.100%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 168 (16.72%) Data Quality
2 44 (4.38%) GDPR
3 15 (1.49%) QA
4 6 (0.60%) Accessibility
5 5 (0.50%) SLA
6 4 (0.40%) Cyber Essentials
6 4 (0.40%) Cyber Essentials PLUS
6 4 (0.40%) ISO/IEC 27001
6 4 (0.40%) PCI DSS
7 3 (0.30%) GRC
7 3 (0.30%) ISO 9001
8 2 (0.20%) IFRS
8 2 (0.20%) IFRS 17
8 2 (0.20%) PMO
9 1 (0.100%) HL7
System Software
1 81 (8.06%) Docker
2 41 (4.08%) Apache Flume
3 6 (0.60%) Active Directory
4 3 (0.30%) Virtual Machines
5 1 (0.100%) Apache ZooKeeper
5 1 (0.100%) HDFS
Systems Management
1 143 (14.23%) Terraform
2 95 (9.45%) Kubernetes
3 38 (3.78%) Oozie
4 13 (1.29%) Rancher
5 4 (0.40%) Ansible
6 2 (0.20%) Control-M
6 2 (0.20%) Grafana
6 2 (0.20%) Opscode Chef
6 2 (0.20%) Puppet
7 1 (0.100%) Argo
7 1 (0.100%) Istio
7 1 (0.100%) Kibana
7 1 (0.100%) Prometheus
7 1 (0.100%) Rundeck
7 1 (0.100%) Single Sign-On
7 1 (0.100%) ZABBIX
Vendors
1 332 (33.03%) Databricks
2 222 (22.09%) Microsoft
3 105 (10.45%) Google
4 65 (6.47%) Oracle
5 54 (5.37%) Cloudera
6 32 (3.18%) Salesforce.com
7 30 (2.99%) Informatica
8 21 (2.09%) SAP
9 20 (1.99%) Alteryx
10 18 (1.79%) Hitachi
10 18 (1.79%) Splunk
11 15 (1.49%) Talend
12 14 (1.39%) IBM
13 10 (1.00%) WorldPay
14 8 (0.80%) Civica
14 8 (0.80%) Teradata
15 6 (0.60%) Birst
15 6 (0.60%) Infor
15 6 (0.60%) MicroStrategy
15 6 (0.60%) Netlify