Period
to 15 October 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 15 October 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
15 Oct 2021
Same period 2020 Same period 2019
Rank 288 258 491
Rank change year-on-year -30 +233 +109
Permanent jobs citing Data Lake 1,515 590 817
As % of all permanent jobs advertised in the UK 1.21% 1.23% 0.59%
As % of the Database & Business Intelligence category 4.34% 4.27% 2.17%
Number of salaries quoted 1,101 467 660
10th Percentile £46,250 £46,250 £41,250
25th Percentile £53,750 £52,500 £49,500
Median annual salary (50th Percentile) £70,000 £65,000 £65,000
Median % change year-on-year +7.69% - -
75th Percentile £85,000 £84,375 £85,000
90th Percentile £100,000 £95,000 £100,000
UK excluding London median annual salary £60,000 £55,000 £55,000
% change year-on-year +9.09% - -8.33%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 34,924 13,805 37,636
As % of all permanent IT jobs advertised in the UK 27.92% 28.81% 27.35%
Number of salaries quoted 22,434 11,711 31,123
10th Percentile £35,000 £33,750 £31,250
25th Percentile £42,500 £42,000 £38,500
Median annual salary (50th Percentile) £57,500 £55,000 £52,500
Median % change year-on-year +4.55% +4.76% +5.00%
75th Percentile £77,500 £72,500 £70,000
90th Percentile £95,000 £88,750 £86,250
UK excluding London median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 15 October 2021.

Salary histogram for Data Lake in the UK

Data Lake
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 15 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -27 1,333 £70,000 +7.69% 223
London -26 745 £80,000 +6.67% 119
UK excluding London -39 620 £60,000 +9.09% 114
Work from Home -35 314 £70,000 +27.27% 45
South East -11 226 £65,000 +8.33% 32
Midlands -77 128 £57,500 +4.55% 21
North of England -126 121 £57,500 -4.17% 28
West Midlands -69 93 £55,000 - 16
North West -111 65 £60,000 -14.29% 17
Scotland -58 53 £60,000 +4.35% 8
East of England -62 53 £65,000 - 17
Yorkshire -81 52 £57,500 +21.05% 10
East Midlands -53 35 £58,750 +16.92% 5
South West -94 31 £39,942 -40.83% 5
Wales - 9 £45,000 - 1
North East -32 4 £60,000 - 1

For the 6 months to 15 October 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 929 (61.32%) Azure
2 883 (58.28%) SQL
3 801 (52.87%) Data Warehouse
4 713 (47.06%) Analytics
5 703 (46.40%) Business Intelligence
6 672 (44.36%) Python
7 602 (39.74%) ETL
8 549 (36.24%) AWS
9 520 (34.32%) Agile Software Development
10 493 (32.54%) Data Modelling
11 481 (31.75%) Databricks
12 460 (30.36%) Power Platform
13 447 (29.50%) Power BI
14 437 (28.84%) Azure Data Factory
15 410 (27.06%) Big Data
16 406 (26.80%) DevOps
17 405 (26.73%) Microsoft
18 341 (22.51%) Social Skills
19 339 (22.38%) Data Engineering
20 317 (20.92%) SQL Server
21 298 (19.67%) Data Pipeline
22 277 (18.28%) Data Science
23 274 (18.09%) Finance
24 273 (18.02%) Apache Spark
25 252 (16.63%) Data Management
26 245 (16.17%) GCP
27 239 (15.78%) Data Architecture
28 236 (15.58%) Java
29 233 (15.38%) Visualisation
30 220 (14.52%) SQL Server Integration Services

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 273 (18.02%) Apache Spark
2 97 (6.40%) Apache
3 80 (5.28%) Apache Airflow
4 34 (2.24%) Confluence
5 14 (0.92%) Elasticsearch
5 14 (0.92%) SharePoint
6 13 (0.86%) Oracle SOA Suite
7 8 (0.53%) Luigi
8 7 (0.46%) Oracle Workflow
8 7 (0.46%) SAS
9 6 (0.40%) Apache Pig
10 5 (0.33%) GlassFish
10 5 (0.33%) Tomcat
10 5 (0.33%) WebLogic
11 4 (0.26%) Jupyter
12 3 (0.20%) Apache Solr
13 2 (0.13%) Apache Synapse
13 2 (0.13%) CMS
14 1 (0.066%) IIS
14 1 (0.066%) JBoss
Applications
1 37 (2.44%) Microsoft Excel
2 23 (1.52%) Microsoft Office
3 9 (0.59%) MS Visio
4 8 (0.53%) Microsoft Project
5 2 (0.13%) Microsoft PowerPoint
6 1 (0.066%) SPSS
Business Applications
1 16 (1.06%) Oracle EBS
2 15 (0.99%) Dynamics CRM
3 8 (0.53%) Adobe Campaign
4 6 (0.40%) Dynamics AX
5 4 (0.26%) OPENHousing
5 4 (0.26%) Unit4 Business World
6 3 (0.20%) Magento
7 2 (0.13%) NetSuite
7 2 (0.13%) Sparx Enterprise Architect
8 1 (0.066%) Maximo
8 1 (0.066%) SAP Oil and Gas
8 1 (0.066%) SAP S/4HANA
Cloud Services
1 929 (61.32%) Azure
2 549 (36.24%) AWS
3 460 (30.36%) Power Platform
4 437 (28.84%) Azure Data Factory
5 245 (16.17%) GCP
6 219 (14.46%) Azure Synapse Analytics
7 136 (8.98%) Amazon S3
8 126 (8.32%) Azure Cosmos DB
9 123 (8.12%) Serverless
10 115 (7.59%) Snowflake
11 89 (5.87%) Amazon Kinesis
12 81 (5.35%) PaaS
13 75 (4.95%) AWS Lambda
13 75 (4.95%) Azure Service Bus
14 64 (4.22%) Microsoft 365
15 63 (4.16%) Amazon EC2
16 49 (3.23%) AWS CloudFormation
17 48 (3.17%) Azure Functions
17 48 (3.17%) Azure Logic Apps
18 46 (3.04%) Amazon SQS
Communications & Networking
1 27 (1.78%) Cisco IPT
2 25 (1.65%) Wireless
3 12 (0.79%) 4G
3 12 (0.79%) 5G
3 12 (0.79%) Internet
4 11 (0.73%) Extranet
5 10 (0.66%) Firewall
6 6 (0.40%) BGP
6 6 (0.40%) LAN
6 6 (0.40%) OSPF
6 6 (0.40%) WAN
7 5 (0.33%) Cisco ASA
7 5 (0.33%) HTTP
8 4 (0.26%) VPN
9 3 (0.20%) Broadband
9 3 (0.20%) FTP
10 2 (0.13%) DNS
11 1 (0.066%) ATM
11 1 (0.066%) Network Security
11 1 (0.066%) TCP/IP
Database & Business Intelligence
1 801 (52.87%) Data Warehouse
2 447 (29.50%) Power BI
3 410 (27.06%) Big Data
4 317 (20.92%) SQL Server
5 220 (14.52%) SQL Server Integration Services
6 218 (14.39%) NoSQL
7 209 (13.80%) Azure SQL Database
8 190 (12.54%) Hadoop
9 153 (10.10%) SQL Server Analysis Services
10 142 (9.37%) Relational Database
11 140 (9.24%) SQL Server Reporting Services
12 139 (9.17%) Tableau
13 126 (8.32%) Azure SQL Data Warehouse
14 121 (7.99%) Amazon Redshift
15 116 (7.66%) MongoDB
16 115 (7.59%) PostgreSQL
17 97 (6.40%) MySQL
18 72 (4.75%) Amazon RDS
19 68 (4.49%) BigQuery
20 66 (4.36%) Apache Hive
Development Applications
1 112 (7.39%) Git (software)
2 82 (5.41%) JIRA
3 43 (2.84%) Visual Studio
4 38 (2.51%) Jenkins
5 34 (2.24%) webpack
6 31 (2.05%) CircleCI
7 27 (1.78%) Babel
7 27 (1.78%) Oracle APEX
8 23 (1.52%) Selenium
9 20 (1.32%) kappa
10 18 (1.19%) SQL Server Management Studio (SSMS)
11 17 (1.12%) Team Foundation Server
12 12 (0.79%) ESLint
12 12 (0.79%) Mocha
13 10 (0.66%) ER Studio
13 10 (0.66%) ERwin
14 9 (0.59%) Bitbucket
15 8 (0.53%) Octopus Deploy
15 8 (0.53%) SpecFlow
15 8 (0.53%) TeamCity
General
1 341 (22.51%) Social Skills
2 274 (18.09%) Finance
3 157 (10.36%) Analytical Skills
4 71 (4.69%) Retail
5 63 (4.16%) Marketing
6 42 (2.77%) Presentation Skills
7 41 (2.71%) Telecoms
8 37 (2.44%) Banking
8 37 (2.44%) Law
9 22 (1.45%) Wearables
10 18 (1.19%) Public Sector
11 16 (1.06%) Manufacturing
12 15 (0.99%) Advertising
12 15 (0.99%) Legal
13 13 (0.86%) Front Office
14 12 (0.79%) Pharmaceutical
15 10 (0.66%) Organisational Skills
16 9 (0.59%) Influencing Skills
17 7 (0.46%) Back Office
18 6 (0.40%) Investment Banking
Job Titles
1 569 (37.56%) Data Engineer
2 306 (20.20%) Architect
3 252 (16.63%) Developer
4 248 (16.37%) Data Architect
5 136 (8.98%) Azure Engineer
6 103 (6.80%) Senior Data Engineer
7 99 (6.53%) Analyst
8 86 (5.68%) Solutions Architect
9 80 (5.28%) Business Intelligence Developer
10 60 (3.96%) Consultant
11 59 (3.89%) Senior Developer
12 58 (3.83%) Azure Architect
13 56 (3.70%) Azure Developer
14 55 (3.63%) AWS Engineer
15 53 (3.50%) Data Analyst
15 53 (3.50%) Security Engineer
16 52 (3.43%) Software Engineer
17 50 (3.30%) Python Engineer
18 48 (3.17%) Big Data Engineer
19 45 (2.97%) Big Data Architect
Libraries, Frameworks & Software Standards
1 155 (10.23%) Kafka
2 112 (7.39%) .NET
3 101 (6.67%) PySpark
4 67 (4.42%) REST
5 63 (4.16%) React
6 56 (3.70%) MDX
7 51 (3.37%) Web Services
8 47 (3.10%) HTML
9 36 (2.38%) XML
10 35 (2.31%) .NET Core
11 34 (2.24%) ARM Templates
11 34 (2.24%) RESTful
12 33 (2.18%) SOAP
13 29 (1.91%) JSON
14 28 (1.85%) React Native
15 27 (1.78%) HTML5
16 25 (1.65%) GraphQL
17 24 (1.58%) NumPy
17 24 (1.58%) Pandas
17 24 (1.58%) Twitter Bootstrap
Miscellaneous
1 72 (4.75%) Data Structures
2 66 (4.36%) Algorithms
3 60 (3.96%) Management Information System
4 51 (3.37%) Cloud Native
5 48 (3.17%) User Experience
6 47 (3.10%) Virtual Team
7 46 (3.04%) Life Science
8 43 (2.84%) Greenfield Project
9 36 (2.38%) Legacy Systems
10 35 (2.31%) Self-Motivation
11 28 (1.85%) Public Cloud
12 22 (1.45%) Renewable Energy
13 21 (1.39%) Enterprise Software
14 19 (1.25%) Reference Data
15 15 (0.99%) 3D Graphics
16 14 (0.92%) Hybrid Cloud
17 13 (0.86%) Data Centre
18 12 (0.79%) Mobile App
19 11 (0.73%) Acoustics
19 11 (0.73%) Client/Server
Operating Systems
1 28 (1.85%) Linux
2 18 (1.19%) VMS
3 17 (1.12%) Unix
4 16 (1.06%) Apple iOS
5 15 (0.99%) Android
5 15 (0.99%) Windows
6 4 (0.26%) Windows Server
7 1 (0.066%) Windows Server 2019
Processes & Methodologies
1 713 (47.06%) Analytics
2 703 (46.40%) Business Intelligence
3 602 (39.74%) ETL
4 520 (34.32%) Agile Software Development
5 493 (32.54%) Data Modelling
6 406 (26.80%) DevOps
7 339 (22.38%) Data Engineering
8 298 (19.67%) Data Pipeline
9 277 (18.28%) Data Science
10 252 (16.63%) Data Management
11 239 (15.78%) Data Architecture
12 233 (15.38%) Visualisation
13 188 (12.41%) Problem-Solving
14 183 (12.08%) Data Analytics
14 183 (12.08%) Microservices
15 176 (11.62%) Machine Learning
16 158 (10.43%) Migration
17 156 (10.30%) Artificial Intelligence
18 142 (9.37%) Data Strategy
19 141 (9.31%) Scrum
Programming Languages
1 883 (58.28%) SQL
2 672 (44.36%) Python
3 236 (15.58%) Java
4 199 (13.14%) C#
5 182 (12.01%) PowerShell
6 128 (8.45%) Scala
7 101 (6.67%) T-SQL
8 93 (6.14%) JavaScript
9 80 (5.28%) R
10 71 (4.69%) Data Analysis Expressions (DAX)
11 56 (3.70%) Go
12 49 (3.23%) Bash Shell
13 27 (1.78%) C
14 21 (1.39%) PL/SQL
15 20 (1.32%) U-SQL
16 15 (0.99%) Kotlin
17 10 (0.66%) Shell Script
18 9 (0.59%) X++
19 8 (0.53%) C++
20 7 (0.46%) ES6
Qualifications
1 120 (7.92%) Degree
2 32 (2.11%) Microsoft Certification
3 27 (1.78%) (ISC)2 CCSP
3 27 (1.78%) AWS Certification
3 27 (1.78%) Cisco Certification
3 27 (1.78%) CISSP
3 27 (1.78%) Security Cleared
4 24 (1.58%) SC Cleared
5 21 (1.39%) Computer Science Degree
6 15 (0.99%) CCSP
6 15 (0.99%) TOGAF Certification
7 11 (0.73%) ISEB
8 8 (0.53%) Master's Degree
9 7 (0.46%) ISTQB
10 4 (0.26%) DV Cleared
10 4 (0.26%) MCSA
10 4 (0.26%) MCSE
11 3 (0.20%) BC Cleared
11 3 (0.20%) MBCS
11 3 (0.20%) PhD
Quality Assurance & Compliance
1 128 (8.45%) Data Quality
2 54 (3.56%) QA
3 29 (1.91%) GDPR
4 7 (0.46%) GxP
5 6 (0.40%) ISO/IEC 27001
5 6 (0.40%) PMO
6 5 (0.33%) Accessibility
7 4 (0.26%) Actionable Recommendations
7 4 (0.26%) PCI DSS
7 4 (0.26%) SOC 2
8 3 (0.20%) SLA
9 2 (0.13%) NIST
10 1 (0.066%) NCSC
System Software
1 113 (7.46%) Docker
2 20 (1.32%) Active Directory
3 16 (1.06%) Firmware
4 11 (0.73%) Virtual Machines
5 6 (0.40%) HDFS
5 6 (0.40%) Hyper-V
6 5 (0.33%) Apache Flume
6 5 (0.33%) VMware Infrastructure
7 1 (0.066%) Apache ZooKeeper
7 1 (0.066%) Virtual Desktop
Systems Management
1 148 (9.77%) Kubernetes
2 61 (4.03%) Terraform
3 13 (0.86%) Ansible
3 13 (0.86%) Puppet
4 7 (0.46%) Grafana
4 7 (0.46%) HP ALM
4 7 (0.46%) HP Quality Center
4 7 (0.46%) Istio
4 7 (0.46%) Opscode Chef
4 7 (0.46%) Prometheus
5 5 (0.33%) Oozie
6 3 (0.20%) FortiGate
7 2 (0.13%) Active Directory Federation Services
7 2 (0.13%) Rancher
8 1 (0.066%) Hadoop YARN
Vendors
1 481 (31.75%) Databricks
2 405 (26.73%) Microsoft
3 133 (8.78%) Oracle
4 97 (6.40%) Google
5 58 (3.83%) Salesforce.com
6 34 (2.24%) SAP
7 33 (2.18%) Palantir
8 32 (2.11%) Talend
9 30 (1.98%) Informatica
10 24 (1.58%) ServiceNow
11 18 (1.19%) Alteryx
12 16 (1.06%) IBM
12 16 (1.06%) StreamSets
13 14 (0.92%) Cloudera
13 14 (0.92%) Teradata
14 12 (0.79%) Adobe
15 10 (0.66%) Cognos
16 9 (0.59%) Hortonworks
16 9 (0.59%) MuleSoft
17 8 (0.53%) HP