Period
to 23 January 2022

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 23 January 2022 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
23 Jan 2022
Same period 2021 Same period 2020
Rank 271 296 498
Rank change year-on-year +25 +202 +99
Permanent jobs citing Data Lake 1,665 669 684
As % of all permanent jobs advertised in the UK 1.30% 1.06% 0.54%
As % of the Database & Business Intelligence category 4.86% 3.85% 2.01%
Number of salaries quoted 1,107 557 585
10th Percentile £46,250 £46,250 £42,500
25th Percentile £52,500 £52,500 £52,500
Median annual salary (50th Percentile) £70,000 £70,000 £69,000
Median % change year-on-year - +1.45% +6.15%
75th Percentile £85,000 £88,750 £85,000
90th Percentile £100,500 £104,250 £95,000
UK excluding London median annual salary £60,000 £55,000 £57,750
% change year-on-year +9.09% -4.76% -7.06%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 34,258 17,398 34,112
As % of all permanent IT jobs advertised in the UK 26.75% 27.49% 27.11%
Number of salaries quoted 21,399 14,716 28,224
10th Percentile £36,250 £33,750 £32,000
25th Percentile £43,750 £41,250 £38,750
Median annual salary (50th Percentile) £60,000 £55,000 £52,500
Median % change year-on-year +9.09% +4.76% -
75th Percentile £77,500 £72,500 £71,250
90th Percentile £95,000 £87,500 £88,750
UK excluding London median annual salary £50,000 £48,500 £45,000
% change year-on-year +3.09% +7.78% -

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 23 January 2022.

Salary histogram for Data Lake in the UK

Data Lake
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 23 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +10 1,471 £70,000 - 222
London -10 746 £75,000 -7.69% 113
UK excluding London +54 737 £60,000 +9.09% 118
Work from Home -24 314 £66,500 +6.40% 47
South East +69 274 £62,500 +13.64% 34
North of England -91 156 £60,000 +9.09% 30
Midlands -2 143 £57,500 +4.55% 24
West Midlands -16 89 £55,000 - 21
North West -92 85 £60,000 -14.29% 16
Scotland -25 63 £52,500 -22.22% 12
Yorkshire -56 61 £60,000 +20.00% 11
East of England -43 55 £65,000 -16.13% 10
East Midlands -29 54 £60,500 +10.00% 3
South West -37 41 £51,500 -1.90% 7
North East -22 10 £70,000 +44.70% 3
Wales - 6 £43,500 - 1
Northern Ireland -31 1 £50,000 -41.18%

For the 6 months to 23 January 2022, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 1,119 (67.21%) Azure
2 903 (54.23%) SQL
3 856 (51.41%) Analytics
4 843 (50.63%) Python
5 783 (47.03%) Data Warehouse
6 767 (46.07%) Agile Software Development
7 740 (44.44%) ETL
8 684 (41.08%) Business Intelligence
9 673 (40.42%) Databricks
10 610 (36.64%) AWS
11 563 (33.81%) Azure Data Factory
12 544 (32.67%) DevOps
13 525 (31.53%) Big Data
14 485 (29.13%) Microsoft
15 476 (28.59%) Data Modelling
16 469 (28.17%) Power Platform
17 461 (27.69%) Power BI
18 428 (25.71%) Java
19 404 (24.26%) Data Engineering
20 403 (24.20%) CI/CD
21 375 (22.52%) Data Pipeline
22 363 (21.80%) Data Management
23 356 (21.38%) Azure Synapse Analytics
24 346 (20.78%) PowerShell
25 340 (20.42%) Social Skills
26 326 (19.58%) SQL Server
27 321 (19.28%) Finance
28 303 (18.20%) NoSQL
29 301 (18.08%) Apache Spark
30 300 (18.02%) Data Science

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 301 (18.08%) Apache Spark
2 137 (8.23%) Apache
3 127 (7.63%) Apache Airflow
4 49 (2.94%) Confluence
5 15 (0.90%) SAS
5 15 (0.90%) SharePoint
6 13 (0.78%) Luigi
7 12 (0.72%) Oracle Workflow
8 11 (0.66%) Oracle SOA Suite
9 10 (0.60%) Elasticsearch
10 7 (0.42%) CMS
11 5 (0.30%) Apache Pig
12 4 (0.24%) Apache Solr
12 4 (0.24%) IIS
13 3 (0.18%) Jupyter
14 2 (0.12%) GlassFish
14 2 (0.12%) Tomcat
14 2 (0.12%) WebLogic
15 1 (0.060%) MS Exchange
15 1 (0.060%) Oracle Coherence
Applications
1 43 (2.58%) Microsoft Excel
2 11 (0.66%) Microsoft Office
3 8 (0.48%) MS Visio
4 4 (0.24%) Microsoft Project
5 2 (0.12%) Microsoft PowerPoint
6 1 (0.060%) Spreadsheet
6 1 (0.060%) SPSS
Business Applications
1 13 (0.78%) Oracle EBS
2 12 (0.72%) Dynamics CRM
3 11 (0.66%) JDE OneWorld
4 9 (0.54%) Dynamics AX
5 8 (0.48%) Adobe Campaign
6 6 (0.36%) NetSuite
7 3 (0.18%) Unit4 Business World
8 2 (0.12%) SAP S/4HANA
8 2 (0.12%) Sparx Enterprise Architect
9 1 (0.060%) Maximo
9 1 (0.060%) SAP ERP
9 1 (0.060%) SAP Oil and Gas
Cloud Services
1 1,119 (67.21%) Azure
2 610 (36.64%) AWS
3 563 (33.81%) Azure Data Factory
4 469 (28.17%) Power Platform
5 356 (21.38%) Azure Synapse Analytics
6 245 (14.71%) Serverless
7 237 (14.23%) GCP
8 184 (11.05%) Amazon S3
8 184 (11.05%) Azure Cosmos DB
9 140 (8.41%) GitHub
10 128 (7.69%) Azure Service Bus
11 119 (7.15%) AWS Lambda
12 118 (7.09%) Azure Functions
13 107 (6.43%) Microsoft 365
14 99 (5.95%) GitHub Actions
15 95 (5.71%) Amazon EMR
16 93 (5.59%) Azure Monitor
17 85 (5.11%) Amazon Kinesis
18 83 (4.98%) Azure Event Grid
18 83 (4.98%) Snowflake
Communications & Networking
1 115 (6.91%) Cisco IPT
2 28 (1.68%) Wireless
3 13 (0.78%) Internet
4 11 (0.66%) Firewall
4 11 (0.66%) Network Security
5 9 (0.54%) Extranet
6 6 (0.36%) BGP
6 6 (0.36%) LAN
6 6 (0.36%) OSPF
6 6 (0.36%) WAN
7 5 (0.30%) HTTP
7 5 (0.30%) SSH
8 2 (0.12%) FTP
8 2 (0.12%) VPN
9 1 (0.060%) Broadband
9 1 (0.060%) Cisco ASA
9 1 (0.060%) TCP/IP
9 1 (0.060%) tcpdump
9 1 (0.060%) Wireshark
Database & Business Intelligence
1 783 (47.03%) Data Warehouse
2 525 (31.53%) Big Data
3 461 (27.69%) Power BI
4 326 (19.58%) SQL Server
5 303 (18.20%) NoSQL
6 289 (17.36%) SQL Server Integration Services
7 222 (13.33%) Azure SQL Database
8 175 (10.51%) Hadoop
9 170 (10.21%) SQL Server Analysis Services
10 159 (9.55%) MongoDB
11 154 (9.25%) Relational Database
12 149 (8.95%) SQL Server Reporting Services
13 137 (8.23%) Azure SQL Data Warehouse
14 136 (8.17%) Amazon Athena
14 136 (8.17%) Tableau
15 135 (8.11%) Amazon Redshift
16 127 (7.63%) Apache Cassandra
17 119 (7.15%) MySQL
18 115 (6.91%) HDInsight
18 115 (6.91%) PostgreSQL
Development Applications
1 109 (6.55%) Git (software)
2 73 (4.38%) Jenkins
3 65 (3.90%) JIRA
4 37 (2.22%) SQL Server Management Studio (SSMS)
5 33 (1.98%) CircleCI
6 31 (1.86%) TeamCity
6 31 (1.86%) Visual Studio
7 23 (1.38%) Atlassian Bamboo
7 23 (1.38%) Subversion
8 21 (1.26%) webpack
9 20 (1.20%) Selenium
10 16 (0.96%) kappa
11 14 (0.84%) Babel
11 14 (0.84%) ESLint
11 14 (0.84%) Mocha
12 12 (0.72%) Team Foundation Server
13 11 (0.66%) ERwin
14 9 (0.54%) Burp Suite
14 9 (0.54%) Oracle APEX
15 8 (0.48%) ER Studio
General
1 340 (20.42%) Social Skills
2 321 (19.28%) Finance
3 199 (11.95%) Analytical Skills
4 74 (4.44%) Marketing
5 66 (3.96%) Banking
6 64 (3.84%) Law
7 42 (2.52%) Inclusion and Diversity
8 36 (2.16%) Public Sector
9 34 (2.04%) Retail
10 31 (1.86%) Legal
10 31 (1.86%) Presentation Skills
11 25 (1.50%) Telecoms
12 24 (1.44%) Back Office
13 21 (1.26%) Manufacturing
14 20 (1.20%) Automotive
15 19 (1.14%) Publishing
16 16 (0.96%) Advertising
16 16 (0.96%) Influencing Skills
17 15 (0.90%) Front Office
18 14 (0.84%) Organisational Skills
Job Titles
1 756 (45.41%) Data Engineer
2 250 (15.02%) Developer
3 238 (14.29%) Architect
4 220 (13.21%) Security Engineer
5 185 (11.11%) Azure Engineer
6 182 (10.93%) Data Architect
7 171 (10.27%) Senior Data Engineer
8 143 (8.59%) Cloud Engineer
9 108 (6.49%) Big Data Engineer
10 101 (6.07%) Senior Cloud Engineer
11 100 (6.01%) Senior Security Engineer
12 93 (5.59%) Business Intelligence Developer
13 92 (5.53%) Analyst
14 89 (5.35%) Cybersecurity Engineer
15 76 (4.56%) AWS Engineer
16 69 (4.14%) Senior Developer
17 58 (3.48%) Azure Developer
18 54 (3.24%) Consultant
19 53 (3.18%) Solutions Architect
20 41 (2.46%) Data Analyst
Libraries, Frameworks & Software Standards
1 208 (12.49%) Kafka
2 181 (10.87%) .NET
3 80 (4.80%) PySpark
4 57 (3.42%) REST
5 53 (3.18%) MDX
6 52 (3.12%) XML
7 49 (2.94%) JSON
8 48 (2.88%) YAML
9 46 (2.76%) ARM Templates
10 43 (2.58%) HTML
11 39 (2.34%) Web Services
12 38 (2.28%) SOAP
13 36 (2.16%) CSS
14 35 (2.10%) ActiveMQ
15 34 (2.04%) React
16 32 (1.92%) HTML5
17 30 (1.80%) Node.js
17 30 (1.80%) RESTful
18 26 (1.56%) .NET Core
19 24 (1.44%) WCF
Miscellaneous
1 75 (4.50%) Management Information System
2 66 (3.96%) Algorithms
3 62 (3.72%) Data Structures
4 55 (3.30%) Self-Motivation
5 49 (2.94%) Cloud Native
6 33 (1.98%) Enterprise Software
7 31 (1.86%) Greenfield Project
8 23 (1.38%) Hybrid Cloud
8 23 (1.38%) Life Science
9 22 (1.32%) User Experience
9 22 (1.32%) Virtual Team
10 20 (1.20%) Data Centre
10 20 (1.20%) Reference Data
11 19 (1.14%) Reinsurance
12 18 (1.08%) Public Cloud
12 18 (1.08%) Replication
13 17 (1.02%) Renewable Energy
14 13 (0.78%) Legacy Systems
15 9 (0.54%) Acoustics
15 9 (0.54%) Client/Server
Operating Systems
1 40 (2.40%) Linux
2 23 (1.38%) VMS
3 22 (1.32%) Unix
4 18 (1.08%) Windows
5 9 (0.54%) Kali Linux
6 4 (0.24%) Solaris
7 3 (0.18%) Apple iOS
8 2 (0.12%) Android
8 2 (0.12%) Red Hat Enterprise Linux
8 2 (0.12%) Windows Server
9 1 (0.060%) Windows Server 2019
Processes & Methodologies
1 856 (51.41%) Analytics
2 767 (46.07%) Agile Software Development
3 740 (44.44%) ETL
4 684 (41.08%) Business Intelligence
5 544 (32.67%) DevOps
6 476 (28.59%) Data Modelling
7 404 (24.26%) Data Engineering
8 403 (24.20%) CI/CD
9 375 (22.52%) Data Pipeline
10 363 (21.80%) Data Management
11 300 (18.02%) Data Science
12 284 (17.06%) Data Analytics
13 231 (13.87%) Data Architecture
14 230 (13.81%) Risk Management
15 220 (13.21%) Visualisation
16 208 (12.49%) SDLC
17 205 (12.31%) Problem-Solving
18 202 (12.13%) Machine Learning
19 183 (10.99%) Data Security
20 179 (10.75%) Microservices
Programming Languages
1 903 (54.23%) SQL
2 843 (50.63%) Python
3 428 (25.71%) Java
4 346 (20.78%) PowerShell
5 283 (17.00%) C#
6 241 (14.47%) Scala
7 163 (9.79%) Bash
8 110 (6.61%) T-SQL
9 85 (5.11%) JavaScript
10 65 (3.90%) Data Analysis Expressions (DAX)
11 63 (3.78%) R
12 51 (3.06%) Go
13 27 (1.62%) C
14 24 (1.44%) TypeScript
15 23 (1.38%) C++
16 22 (1.32%) Apex Code
16 22 (1.32%) SOQL
16 22 (1.32%) SOSL
17 19 (1.14%) PL/SQL
18 11 (0.66%) U-SQL
Qualifications
1 124 (7.45%) Degree
2 115 (6.91%) (ISC)2 CCSP
2 115 (6.91%) Cisco Certification
2 115 (6.91%) CISSP
3 71 (4.26%) AWS Certification
4 38 (2.28%) Computer Science Degree
5 33 (1.98%) Microsoft Certification
6 19 (1.14%) Security Cleared
7 15 (0.90%) CCSP
8 14 (0.84%) SC Cleared
9 8 (0.48%) ISEB
9 8 (0.48%) Master's Degree
10 5 (0.30%) ISTQB
10 5 (0.30%) TOGAF Certification
11 2 (0.12%) DV Cleared
11 2 (0.12%) MBCS
11 2 (0.12%) MOS
11 2 (0.12%) PMI Certification
11 2 (0.12%) PMP
11 2 (0.12%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 150 (9.01%) Data Quality
2 42 (2.52%) QA
3 39 (2.34%) GDPR
4 19 (1.14%) PCI DSS
5 12 (0.72%) Accessibility
5 12 (0.72%) GxP
6 10 (0.60%) IFRS
7 8 (0.48%) PMO
8 5 (0.30%) Actionable Recommendations
9 4 (0.24%) Cyber Essentials
9 4 (0.24%) Cyber Essentials PLUS
9 4 (0.24%) ISO/IEC 27001
10 3 (0.18%) NIST
10 3 (0.18%) SOC 2
11 2 (0.12%) Solvency II
12 1 (0.060%) HL7
12 1 (0.060%) NCSC
System Software
1 107 (6.43%) Docker
2 18 (1.08%) Active Directory
3 11 (0.66%) HDFS
4 9 (0.54%) Apache Flume
5 8 (0.48%) Virtual Machines
6 3 (0.18%) Virtual Desktop
7 2 (0.12%) Apache ZooKeeper
Systems Management
1 168 (10.09%) Kubernetes
2 107 (6.43%) Terraform
3 15 (0.90%) Ansible
4 8 (0.48%) Grafana
5 6 (0.36%) Oozie
6 5 (0.30%) Opscode Chef
6 5 (0.30%) Prometheus
7 4 (0.24%) HP ALM
7 4 (0.24%) HP Quality Center
7 4 (0.24%) Istio
7 4 (0.24%) Puppet
8 2 (0.12%) Rundeck
9 1 (0.060%) Active Directory Federation Services
9 1 (0.060%) FortiGate
9 1 (0.060%) Hadoop YARN
Vendors
1 673 (40.42%) Databricks
2 485 (29.13%) Microsoft
3 110 (6.61%) Oracle
4 92 (5.53%) Google
4 92 (5.53%) Palantir
5 66 (3.96%) Salesforce.com
6 41 (2.46%) Informatica
7 33 (1.98%) Talend
8 32 (1.92%) SAP
9 20 (1.20%) Alteryx
10 17 (1.02%) ServiceNow
11 13 (0.78%) MuleSoft
12 11 (0.66%) Adobe
12 11 (0.66%) IBM
13 10 (0.60%) Civica
13 10 (0.60%) LexisNexis
14 9 (0.54%) Cloudera
14 9 (0.54%) Cognizant
15 8 (0.48%) StreamSets
15 8 (0.48%) Teradata