Period
to 29 July 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 29 July 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
29 Jul 2021
Same period 2020 Same period 2019
Rank 318 264 479
Rank change year-on-year -54 +215 +82
Permanent jobs citing Data Lake 1,166 837 890
As % of all permanent jobs advertised in the UK 1.03% 1.21% 0.62%
As % of the Database & Business Intelligence category 3.68% 4.39% 2.22%
Number of salaries quoted 867 498 702
10th Percentile £45,000 £45,000 £42,500
25th Percentile £52,500 £53,875 £51,250
Median annual salary (50th Percentile) £70,000 £67,500 £65,000
Median % change year-on-year +3.70% +3.85% -
75th Percentile £85,000 £79,688 £85,000
90th Percentile £100,000 £90,000 £100,000
UK excluding London median annual salary £60,000 £57,500 £57,500
% change year-on-year +4.35% - +9.52%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 31,672 19,060 40,041
As % of all permanent IT jobs advertised in the UK 28.05% 27.62% 27.81%
Number of salaries quoted 21,204 15,650 33,146
10th Percentile £34,750 £32,500 £31,250
25th Percentile £42,500 £41,250 £37,500
Median annual salary (50th Percentile) £55,000 £55,000 £52,000
Median % change year-on-year - +5.77% +4.00%
75th Percentile £75,000 £72,500 £70,000
90th Percentile £92,500 £88,750 £85,000
UK excluding London median annual salary £48,500 £47,500 £45,000
% change year-on-year +2.11% +5.56% -

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 29 July 2021.

Salary histogram for Data Lake in the UK

Data Lake
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 29 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -73 1,032 £70,000 +3.70% 256
London -96 562 £80,000 +10.34% 120
UK excluding London +8 500 £60,000 +4.35% 144
Work from Home -55 232 £65,000 +10.64% 43
South East -40 143 £65,000 +8.33% 44
North of England -5 130 £60,000 -14.29% 37
Midlands -50 111 £56,500 +2.73% 29
West Midlands -48 83 £55,000 - 14
Yorkshire -16 73 £57,500 -20.69% 11
North West -46 53 £60,000 -14.29% 24
East of England -11 41 £73,750 +28.26% 17
Scotland -52 34 £60,000 +11.63% 8
South West -72 30 £47,500 -22.45% 6
East Midlands -32 28 £60,000 +30.43% 15
Wales -17 9 £47,500 -9.52% 1
North East -19 4 £65,000 - 2
Northern Ireland - 2 £35,000 - 2

For the 6 months to 29 July 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 722 (61.92%) Azure
2 659 (56.52%) SQL
3 647 (55.49%) Data Warehouse
4 567 (48.63%) Business Intelligence
5 521 (44.68%) Analytics
6 464 (39.79%) ETL
7 457 (39.19%) Python
8 403 (34.56%) Data Modelling
9 391 (33.53%) Power Platform
10 390 (33.45%) Agile Software Development
11 383 (32.85%) AWS
12 382 (32.76%) Power BI
13 364 (31.22%) Azure Data Factory
14 358 (30.70%) Databricks
15 311 (26.67%) Microsoft
16 298 (25.56%) Big Data
17 292 (25.04%) DevOps
18 277 (23.76%) SQL Server
19 276 (23.67%) Social Skills
20 259 (22.21%) Data Pipeline
21 257 (22.04%) Data Engineering
22 226 (19.38%) Data Architecture
23 220 (18.87%) Apache Spark
24 209 (17.92%) Finance
24 209 (17.92%) Data Science
25 191 (16.38%) Visualisation
26 188 (16.12%) Azure Synapse Analytics
27 170 (14.58%) SQL Server Integration Services
28 168 (14.41%) GCP
29 166 (14.24%) Data Management

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 220 (18.87%) Apache Spark
2 71 (6.09%) Apache
3 45 (3.86%) Apache Airflow
4 21 (1.80%) Confluence
5 15 (1.29%) Oracle Workflow
5 15 (1.29%) SharePoint
6 9 (0.77%) Tomcat
7 8 (0.69%) Apache Synapse
8 7 (0.60%) Elasticsearch
8 7 (0.60%) GlassFish
8 7 (0.60%) WebLogic
9 6 (0.51%) Apache Pig
10 5 (0.43%) Luigi
10 5 (0.43%) Oracle SOA Suite
11 4 (0.34%) Jupyter
12 3 (0.26%) JBoss
13 2 (0.17%) Mule
13 2 (0.17%) Mule ESB
13 2 (0.17%) SAS
13 2 (0.17%) WebSphere
Applications
1 29 (2.49%) Microsoft Excel
2 14 (1.20%) Microsoft Office
3 6 (0.51%) Microsoft Project
4 5 (0.43%) MS Visio
5 3 (0.26%) Microsoft PowerPoint
Business Applications
1 9 (0.77%) Dynamics CRM
2 7 (0.60%) Magento
2 7 (0.60%) NetSuite
2 7 (0.60%) Oracle EBS
3 5 (0.43%) Dynamics AX
4 4 (0.34%) OPENHousing
5 2 (0.17%) Sparx Enterprise Architect
5 2 (0.17%) Unit4 Business World
Cloud Services
1 722 (61.92%) Azure
2 391 (33.53%) Power Platform
3 383 (32.85%) AWS
4 364 (31.22%) Azure Data Factory
5 188 (16.12%) Azure Synapse Analytics
6 168 (14.41%) GCP
7 87 (7.46%) Snowflake
8 84 (7.20%) Amazon S3
9 79 (6.78%) Serverless
10 76 (6.52%) Azure Cosmos DB
11 64 (5.49%) PaaS
12 47 (4.03%) AWS Lambda
13 43 (3.69%) Amazon Kinesis
14 40 (3.43%) Azure Service Bus
15 39 (3.34%) Amazon EC2
16 34 (2.92%) Azure Stack
17 33 (2.83%) Azure Storage
17 33 (2.83%) SaaS
18 31 (2.66%) Azure Logic Apps
18 31 (2.66%) Dynamics 365
Communications & Networking
1 19 (1.63%) Wireless
2 12 (1.03%) 4G
2 12 (1.03%) 5G
3 5 (0.43%) FTP
3 5 (0.43%) Internet
4 4 (0.34%) Broadband
4 4 (0.34%) Cisco ASA
4 4 (0.34%) Extranet
4 4 (0.34%) Firewall
4 4 (0.34%) HTTP
4 4 (0.34%) VPN
5 2 (0.17%) Cisco IPT
5 2 (0.17%) DNS
5 2 (0.17%) Skype
6 1 (0.086%) ATM
6 1 (0.086%) tcpdump
6 1 (0.086%) Wireshark
Database & Business Intelligence
1 647 (55.49%) Data Warehouse
2 382 (32.76%) Power BI
3 298 (25.56%) Big Data
4 277 (23.76%) SQL Server
5 170 (14.58%) SQL Server Integration Services
6 166 (14.24%) Hadoop
7 162 (13.89%) Azure SQL Database
8 146 (12.52%) NoSQL
9 135 (11.58%) SQL Server Analysis Services
10 123 (10.55%) Azure SQL Data Warehouse
11 122 (10.46%) Relational Database
12 121 (10.38%) SQL Server Reporting Services
13 106 (9.09%) Tableau
14 84 (7.20%) Amazon Redshift
15 67 (5.75%) Enterprise Data Warehouse
16 65 (5.57%) PostgreSQL
17 60 (5.15%) Metadata
18 59 (5.06%) Apache Hive
19 58 (4.97%) Microsoft Analysis Services
20 57 (4.89%) MySQL
Development Applications
1 88 (7.55%) Git (software)
2 55 (4.72%) JIRA
3 29 (2.49%) Jenkins
3 29 (2.49%) Visual Studio
4 28 (2.40%) Oracle APEX
5 18 (1.54%) Babel
5 18 (1.54%) webpack
6 17 (1.46%) CircleCI
7 15 (1.29%) ER Studio
7 15 (1.29%) ERwin
8 13 (1.11%) Bitbucket
9 9 (0.77%) Selenium
10 8 (0.69%) Team Foundation Server
10 8 (0.69%) TeamCity
11 7 (0.60%) SQL Server Management Studio (SSMS)
12 6 (0.51%) Sonatype Nexus
13 5 (0.43%) Postman
13 5 (0.43%) PowerDesigner
13 5 (0.43%) SpecFlow
13 5 (0.43%) Subversion
General
1 276 (23.67%) Social Skills
2 209 (17.92%) Finance
3 106 (9.09%) Analytical Skills
4 70 (6.00%) Retail
5 41 (3.52%) Telecoms
6 34 (2.92%) Presentation Skills
7 30 (2.57%) Law
8 29 (2.49%) Banking
9 21 (1.80%) Marketing
10 15 (1.29%) Wearables
11 11 (0.94%) Legal
11 11 (0.94%) Manufacturing
12 10 (0.86%) Pharmaceutical
13 9 (0.77%) Games
14 8 (0.69%) Front Office
14 8 (0.69%) Influencing Skills
14 8 (0.69%) Public Sector
15 7 (0.60%) Advertising
15 7 (0.60%) Investment Banking
16 6 (0.51%) Publishing
Job Titles
1 434 (37.22%) Data Engineer
2 271 (23.24%) Architect
3 210 (18.01%) Data Architect
4 183 (15.69%) Developer
5 127 (10.89%) Azure Engineer
6 81 (6.95%) Senior Data Engineer
7 78 (6.69%) Solutions Architect
8 72 (6.17%) Analyst
9 65 (5.57%) Azure Architect
10 49 (4.20%) Business Intelligence Developer
10 49 (4.20%) Consultant
11 48 (4.12%) AWS Engineer
12 44 (3.77%) Data Analyst
13 42 (3.60%) Senior Developer
14 37 (3.17%) Python Engineer
15 34 (2.92%) Software Engineer
16 33 (2.83%) Big Data Architect
17 32 (2.74%) Azure Developer
18 29 (2.49%) Big Data Engineer
19 27 (2.32%) Cloud Architect
Libraries, Frameworks & Software Standards
1 115 (9.86%) Kafka
2 76 (6.52%) PySpark
3 62 (5.32%) .NET
4 47 (4.03%) React
5 45 (3.86%) REST
6 43 (3.69%) Web Services
7 39 (3.34%) HTML
8 26 (2.23%) RESTful
8 26 (2.23%) SOAP
9 24 (2.06%) XML
10 22 (1.89%) WCF
11 21 (1.80%) NumPy
12 20 (1.72%) CSS
12 20 (1.72%) JSON
13 19 (1.63%) .NET Core
13 19 (1.63%) Pandas
13 19 (1.63%) React Native
14 18 (1.54%) HTML5
14 18 (1.54%) MDX
15 17 (1.46%) Middleware
Miscellaneous
1 63 (5.40%) Data Structures
2 56 (4.80%) Algorithms
3 44 (3.77%) Greenfield Project
4 41 (3.52%) Cloud Native
4 41 (3.52%) User Experience
5 40 (3.43%) Virtual Team
6 39 (3.34%) Life Science
7 32 (2.74%) Legacy Systems
8 31 (2.66%) Management Information System
9 22 (1.89%) Public Cloud
10 17 (1.46%) Self-Motivation
11 15 (1.29%) 3D Graphics
12 14 (1.20%) Enterprise Software
13 13 (1.11%) Reinsurance
14 10 (0.86%) Reference Data
14 10 (0.86%) Renewable Energy
15 7 (0.60%) BBC
15 7 (0.60%) Derivative
15 7 (0.60%) Foreign Exchange (FX)
15 7 (0.60%) Replication
Operating Systems
1 21 (1.80%) Linux
2 15 (1.29%) Android
2 15 (1.29%) Apple iOS
3 13 (1.11%) Unix
4 12 (1.03%) Windows
5 4 (0.34%) Windows Server
Processes & Methodologies
1 567 (48.63%) Business Intelligence
2 521 (44.68%) Analytics
3 464 (39.79%) ETL
4 403 (34.56%) Data Modelling
5 390 (33.45%) Agile Software Development
6 292 (25.04%) DevOps
7 259 (22.21%) Data Pipeline
8 257 (22.04%) Data Engineering
9 226 (19.38%) Data Architecture
10 209 (17.92%) Data Science
11 191 (16.38%) Visualisation
12 166 (14.24%) Data Management
13 154 (13.21%) Machine Learning
14 141 (12.09%) Problem-Solving
15 137 (11.75%) Microservices
16 136 (11.66%) Artificial Intelligence
17 126 (10.81%) Migration
18 121 (10.38%) Data Analytics
19 116 (9.95%) Data Visualisation
20 115 (9.86%) Data Strategy
Programming Languages
1 659 (56.52%) SQL
2 457 (39.19%) Python
3 132 (11.32%) Java
4 104 (8.92%) T-SQL
5 101 (8.66%) C#
6 87 (7.46%) Scala
7 60 (5.15%) PowerShell
8 57 (4.89%) JavaScript
9 52 (4.46%) R
10 44 (3.77%) Data Analysis Expressions (DAX)
11 29 (2.49%) Go
12 26 (2.23%) Bash Shell
13 25 (2.14%) U-SQL
14 21 (1.80%) PL/SQL
15 17 (1.46%) C
16 15 (1.29%) Kotlin
17 7 (0.60%) Shell Script
18 5 (0.43%) TypeScript
19 4 (0.34%) ANSI SQL
19 4 (0.34%) PHP
Qualifications
1 103 (8.83%) Degree
2 35 (3.00%) Security Cleared
3 32 (2.74%) SC Cleared
4 23 (1.97%) Microsoft Certification
5 14 (1.20%) Computer Science Degree
6 12 (1.03%) TOGAF Certification
7 6 (0.51%) AWS Certification
7 6 (0.51%) DV Cleared
8 5 (0.43%) ISEB
9 4 (0.34%) ISTQB
9 4 (0.34%) MCSA
9 4 (0.34%) MCSE
10 3 (0.26%) BC Cleared
10 3 (0.26%) DBS Check
10 3 (0.26%) Master's Degree
10 3 (0.26%) PhD
11 2 (0.17%) (ISC)2 CCSP
11 2 (0.17%) AAT
11 2 (0.17%) Cisco Certification
11 2 (0.17%) CISSP
Quality Assurance & Compliance
1 101 (8.66%) Data Quality
2 45 (3.86%) QA
3 21 (1.80%) GDPR
4 6 (0.51%) GxP
4 6 (0.51%) ISO/IEC 27001
5 3 (0.26%) SLA
6 2 (0.17%) NIST
6 2 (0.17%) PCI DSS
6 2 (0.17%) SOC 2
7 1 (0.086%) Accessibility
System Software
1 77 (6.60%) Docker
2 16 (1.37%) Firmware
3 15 (1.29%) HDFS
4 14 (1.20%) Active Directory
5 6 (0.51%) Hyper-V
6 5 (0.43%) VMware Infrastructure
7 4 (0.34%) Apache ZooKeeper
8 3 (0.26%) Virtual Machines
9 2 (0.17%) Apache Flume
Systems Management
1 111 (9.52%) Kubernetes
2 43 (3.69%) Terraform
3 16 (1.37%) Puppet
4 15 (1.29%) Ansible
5 6 (0.51%) Grafana
5 6 (0.51%) Istio
5 6 (0.51%) Prometheus
6 5 (0.43%) Hadoop YARN
7 4 (0.34%) HP ALM
7 4 (0.34%) HP Quality Center
7 4 (0.34%) Oozie
7 4 (0.34%) Opscode Chef
8 2 (0.17%) FortiGate
8 2 (0.17%) Rancher
9 1 (0.086%) Active Directory Federation Services
9 1 (0.086%) SCCM
9 1 (0.086%) Single Sign-On
9 1 (0.086%) ZABBIX
Vendors
1 358 (30.70%) Databricks
2 311 (26.67%) Microsoft
3 111 (9.52%) Oracle
4 65 (5.57%) Google
5 43 (3.69%) Salesforce.com
6 36 (3.09%) SAP
7 22 (1.89%) Talend
8 21 (1.80%) Alteryx
8 21 (1.80%) Informatica
8 21 (1.80%) Teradata
9 19 (1.63%) Cloudera
10 14 (1.20%) IBM
11 13 (1.11%) JD Edwards
11 13 (1.11%) StreamSets
12 11 (0.94%) Cognos
13 10 (0.86%) MuleSoft
14 9 (0.77%) Sage
15 7 (0.60%) Hortonworks
15 7 (0.60%) MicroStrategy
15 7 (0.60%) ServiceNow