Period
to 4 August 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 4 August 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
4 Aug 2020
Same period 2019 Same period 2018
Rank 260 459 542
Rank change year-on-year +199 +83 +386
Permanent jobs citing Data Lake 804 894 856
As % of all permanent jobs advertised in the UK 1.21% 0.62% 0.50%
As % of the Database & Business Intelligence category 4.42% 2.28% 1.64%
Number of salaries quoted 488 737 686
Median annual salary £65,000 £65,000 £65,000
10th Percentile £44,775 £42,500 £46,250
90th Percentile £90,000 £98,750 £97,500
UK excluding London median annual salary £57,500 £57,500 £55,000
% change year-on-year - +4.55% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 18,184 39,211 52,348
As % of all permanent IT jobs advertised in the UK 27.32% 27.41% 30.28%
Number of salaries quoted 14,770 32,177 42,664
Median annual salary £55,000 £52,000 £50,000
Median salary % change year-on-year +5.77% +4.00% +5.26%
10th Percentile £32,500 £31,250 £31,250
90th Percentile £88,750 £85,000 £82,500
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 4 August 2020.

Salary histogram for Data Lake in the UK

Data Lake
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 4 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +202 782 £65,000 - 56
London +166 506 £72,500 +3.57% 23
UK excluding London +186 294 £57,500 - 33
South East +136 93 £60,000 - 7
Midlands +157 76 £55,000 - 7
North of England +167 70 £70,000 +54.14% 12
West Midlands +153 63 £55,000 -15.38% 6
North West +144 51 £70,000 +55.56% 11
South West +34 20 £50,000 -18.70% 3
Yorkshire +122 18 £72,500 +60.38% 1
Scotland +90 17 £53,750 +4.37%
East of England +64 17 £55,000 +15.79% 4
Work from Home +40 15 £60,000 -4.00% 8
East Midlands +60 13 £48,000 -12.73% 1
North East +17 1 - -
Wales - 1 £52,500 -

For the 6 months to 4 August 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 561 (69.78%) SQL
2 533 (66.29%) Business Intelligence
3 484 (60.20%) Analytics
4 402 (50.00%) Azure
5 391 (48.63%) SQL Server
6 370 (46.02%) Data Warehouse
7 368 (45.77%) ETL
8 354 (44.03%) Python
9 301 (37.44%) Agile Software Development
10 280 (34.83%) Power Platform
11 273 (33.96%) Power BI
12 265 (32.96%) Analytical Skills
13 262 (32.59%) Microsoft
14 261 (32.46%) Data Analytics
15 252 (31.34%) Tableau
16 251 (31.22%) Big Data
17 222 (27.61%) Finance
18 217 (26.99%) Degree
19 207 (25.75%) Oracle
20 203 (25.25%) Data Analysis
21 200 (24.88%) Data Modelling
22 191 (23.76%) Databricks
23 188 (23.38%) Azure Data Factory
24 185 (23.01%) Teradata
25 176 (21.89%) Alteryx
26 175 (21.77%) Proactive Monitoring
27 172 (21.39%) Visualisation
28 170 (21.14%) AWS
29 163 (20.27%) Data Extraction
30 162 (20.15%) Cadence

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 100 (12.44%) Apache Spark
2 32 (3.98%) Apache
3 10 (1.24%) Apache Pig
4 9 (1.12%) Apache Airflow
4 9 (1.12%) Apache Synapse
4 9 (1.12%) Confluence
5 8 (1.00%) Cloud Foundry
6 7 (0.87%) Elasticsearch
7 6 (0.75%) SharePoint
8 5 (0.62%) Oracle SOA Suite
9 4 (0.50%) Oracle Workflow
10 3 (0.37%) Jupyter
10 3 (0.37%) Luigi
10 3 (0.37%) SAS
11 2 (0.25%) Apache Solr
12 1 (0.12%) Anypoint
12 1 (0.12%) CMS
12 1 (0.12%) IIS
Applications
1 16 (1.99%) Microsoft Excel
2 10 (1.24%) Microsoft Office
Business Applications
1 5 (0.62%) Dynamics CRM
2 3 (0.37%) SAP IS-U
3 1 (0.12%) NetSuite
3 1 (0.12%) Oracle EBS
3 1 (0.12%) SimCorp Dimension
Cloud Services
1 402 (50.00%) Azure
2 280 (34.83%) Power Platform
3 188 (23.38%) Azure Data Factory
4 170 (21.14%) AWS
5 69 (8.58%) SaaS
6 63 (7.84%) PaaS
7 57 (7.09%) GCP
8 48 (5.97%) IaaS
9 40 (4.98%) Serverless
10 34 (4.23%) Amazon S3
11 23 (2.86%) Azure Machine Learning
12 21 (2.61%) Amazon CloudWatch
12 21 (2.61%) Data Lake Analytics
13 20 (2.49%) PowerApps
14 18 (2.24%) Amazon GuardDuty
14 18 (2.24%) AWS CloudTrail
15 14 (1.74%) Azure Active Directory
16 12 (1.49%) AWS Lambda
16 12 (1.49%) Azure Stack
17 11 (1.37%) Logic Apps
Communications & Networking
1 15 (1.87%) Skype
2 2 (0.25%) Internet
3 1 (0.12%) Firewall
3 1 (0.12%) IPsec
3 1 (0.12%) Kerberos
3 1 (0.12%) SSL
Database & Business Intelligence
1 391 (48.63%) SQL Server
2 370 (46.02%) Data Warehouse
3 273 (33.96%) Power BI
4 251 (31.22%) Big Data
5 149 (18.53%) SQL Server Integration Services
6 137 (17.04%) Azure SQL Database
7 125 (15.55%) SQL Server Analysis Services
8 116 (14.43%) Azure SQL Data Warehouse
9 102 (12.69%) SQL Server Reporting Services
10 92 (11.44%) Oracle Reports
11 84 (10.45%) Snowflake Schema
12 77 (9.58%) Hadoop
13 68 (8.46%) NoSQL
14 59 (7.34%) Amazon Redshift
14 59 (7.34%) Cosmos DB
15 54 (6.72%) Relational Database
16 45 (5.60%) Apache Hive
17 43 (5.35%) Microsoft Analysis Services
18 38 (4.73%) BigQuery
19 34 (4.23%) RDBMS
Development Applications
1 62 (7.71%) Git (software)
2 23 (2.86%) Visual Studio
3 19 (2.36%) Jenkins
4 12 (1.49%) Cucumber
5 9 (1.12%) TeamCity
6 8 (1.00%) ERwin
6 8 (1.00%) GitLab
6 8 (1.00%) JIRA
6 8 (1.00%) SQL Server Management Studio (SSMS)
7 7 (0.87%) Atlassian Bamboo
7 7 (0.87%) Octopus Deploy
8 6 (0.75%) Artifactory
9 5 (0.62%) ER Studio
9 5 (0.62%) GDB
9 5 (0.62%) Sourcetree
9 5 (0.62%) Team Foundation Server
10 4 (0.50%) Visual Studio Code
11 3 (0.37%) CircleCI
11 3 (0.37%) GoCD
12 2 (0.25%) SonarQube
General
1 222 (27.61%) Finance
2 89 (11.07%) Legal
3 40 (4.98%) Marketing
4 35 (4.35%) Banking
5 18 (2.24%) Retail
6 10 (1.24%) Advertising
7 7 (0.87%) Police
8 5 (0.62%) Front Office
9 4 (0.50%) Manufacturing
10 3 (0.37%) Law
10 3 (0.37%) Public Sector
11 2 (0.25%) Back Office
11 2 (0.25%) Investment Banking
12 1 (0.12%) Financial Institution
12 1 (0.12%) Publishing
Job Titles
1 245 (30.47%) Data Engineer
2 158 (19.65%) Analyst
3 143 (17.79%) Developer
4 133 (16.54%) Data Analyst
5 121 (15.05%) Architect
6 86 (10.70%) Azure Engineer
7 63 (7.84%) Business Intelligence Developer
8 62 (7.71%) Senior Analyst
8 62 (7.71%) SQL Developer
9 58 (7.21%) Senior Data Analyst
10 57 (7.09%) Data Architect
10 57 (7.09%) Senior Data Engineer
11 50 (6.22%) Solutions Architect
12 49 (6.09%) Data Manager
13 48 (5.97%) Data Warehouse Developer
14 42 (5.22%) SQL BI Developer
15 41 (5.10%) Cloud Architect
16 40 (4.98%) SSIS Developer
16 40 (4.98%) SSRS Developer
17 38 (4.73%) Azure Architect
Libraries, Frameworks & Software Standards
1 96 (11.94%) .NET
2 91 (11.32%) Kafka
3 42 (5.22%) HTML
4 33 (4.10%) ASP.NET
4 33 (4.10%) HTML5
5 31 (3.86%) CSS
6 30 (3.73%) MDX
7 27 (3.36%) PySpark
8 22 (2.74%) ASP.NET Web API
9 20 (2.49%) ASP.NET MVC
10 11 (1.37%) .NET Framework
10 11 (1.37%) Entity Framework
10 11 (1.37%) Web Services
11 9 (1.12%) JSON
12 8 (1.00%) .NET Core
12 8 (1.00%) Apache Avro
12 8 (1.00%) Apache NiFi
12 8 (1.00%) J2EE
12 8 (1.00%) REST
12 8 (1.00%) XML
Miscellaneous
1 265 (32.96%) Analytical Skills
2 55 (6.84%) Greenfield Project
3 34 (4.23%) Data Structures
4 28 (3.48%) Enterprise Software
5 23 (2.86%) Cloud Native
6 22 (2.74%) Management Information System
7 11 (1.37%) Self-Motivation
8 9 (1.12%) Data Centre
9 8 (1.00%) Clustering
10 7 (0.87%) Cyberthreat
11 6 (0.75%) Virtual Team
12 5 (0.62%) Algorithms
12 5 (0.62%) N-Tier
13 4 (0.50%) Credit Risk
13 4 (0.50%) Life Science
13 4 (0.50%) PMI
14 3 (0.37%) Mobile App
14 3 (0.37%) Public Cloud
14 3 (0.37%) Reference Data
15 2 (0.25%) User Experience
Operating Systems
1 40 (4.98%) Windows
2 30 (3.73%) Linux
3 21 (2.61%) Windows Server
4 20 (2.49%) Unix
5 7 (0.87%) Windows 10
6 6 (0.75%) Red Hat Enterprise Linux
7 2 (0.25%) Android
7 2 (0.25%) Apple iOS
Processes & Methodologies
1 533 (66.29%) Business Intelligence
2 484 (60.20%) Analytics
3 368 (45.77%) ETL
4 301 (37.44%) Agile Software Development
5 261 (32.46%) Data Analytics
6 203 (25.25%) Data Analysis
7 200 (24.88%) Data Modelling
8 175 (21.77%) Proactive Monitoring
9 172 (21.39%) Visualisation
10 163 (20.27%) Data Extraction
11 137 (17.04%) DevOps
12 136 (16.92%) Data Engineering
13 99 (12.31%) User Acceptance Testing
14 88 (10.95%) System Integration Testing
15 84 (10.45%) Machine Learning
16 82 (10.20%) Project Management
17 81 (10.07%) Migration
18 77 (9.58%) Continuous Integration
19 76 (9.45%) Data Science
20 75 (9.33%) Test Automation
Programming Languages
1 561 (69.78%) SQL
2 354 (44.03%) Python
3 109 (13.56%) R
4 96 (11.94%) T-SQL
5 82 (10.20%) Scala
6 78 (9.70%) C#
7 63 (7.84%) Java
8 44 (5.47%) Data Analysis Expressions (DAX)
9 42 (5.22%) PowerShell
10 41 (5.10%) JavaScript
11 23 (2.86%) VB.NET
12 21 (2.61%) U-SQL
13 17 (2.11%) C
14 15 (1.87%) C++
15 13 (1.62%) Perl
16 7 (0.87%) VBA
17 6 (0.75%) PL/SQL
17 6 (0.75%) XAML
18 4 (0.50%) Bash Shell
18 4 (0.50%) Ruby
Qualifications
1 217 (26.99%) Degree
2 24 (2.99%) Microsoft Certification
3 11 (1.37%) AWS Certification
4 9 (1.12%) Cisco Certification
5 8 (1.00%) CISSP
6 7 (0.87%) (ISC)2 CCSP
6 7 (0.87%) CCSP
6 7 (0.87%) CompTIA Security+
6 7 (0.87%) Computer Science Degree
7 4 (0.50%) MCSA
7 4 (0.50%) PMI Certification
7 4 (0.50%) Security Cleared
8 3 (0.37%) SC Cleared
9 2 (0.25%) TOGAF Certification
10 1 (0.12%) CCIE
10 1 (0.12%) CCNP
10 1 (0.12%) MBA
10 1 (0.12%) MCSE
10 1 (0.12%) MCTS
10 1 (0.12%) Sun Certification
Quality Assurance & Compliance
1 88 (10.95%) GAAP
2 77 (9.58%) Data Quality
3 20 (2.49%) QA
4 14 (1.74%) NIST
5 12 (1.49%) GDPR
6 5 (0.62%) Sarbanes-Oxley
7 2 (0.25%) IFRS
8 1 (0.12%) EMIR
8 1 (0.12%) ISO/IEC 27001
8 1 (0.12%) MiFID
8 1 (0.12%) SLA
System Software
1 40 (4.98%) Docker
2 17 (2.11%) Active Directory
3 14 (1.74%) HDFS
4 12 (1.49%) Virtual Machines
5 10 (1.24%) Apache ZooKeeper
6 8 (1.00%) Hyper-V
7 1 (0.12%) VMware Infrastructure
Systems Management
1 60 (7.46%) Kubernetes
2 23 (2.86%) Terraform
3 15 (1.87%) Hadoop YARN
4 9 (1.12%) Puppet
5 8 (1.00%) Microsoft Intune
6 7 (0.87%) Kibana
6 7 (0.87%) Opscode Chef
6 7 (0.87%) Rancher
6 7 (0.87%) SCVMM
6 7 (0.87%) Single Sign-On
7 5 (0.62%) Ansible
7 5 (0.62%) Oozie
8 3 (0.37%) Argo
9 2 (0.25%) Fluentd
9 2 (0.25%) Nagios
9 2 (0.25%) Prometheus
10 1 (0.12%) Grafana
10 1 (0.12%) ZABBIX
Vendors
1 262 (32.59%) Microsoft
2 252 (31.34%) Tableau
3 207 (25.75%) Oracle
4 191 (23.76%) Databricks
5 185 (23.01%) Teradata
6 176 (21.89%) Alteryx
7 162 (20.15%) Automation Anywhere
7 162 (20.15%) Blue Prism
7 162 (20.15%) Cadence
7 162 (20.15%) UiPath
8 33 (4.10%) Sparx
9 22 (2.74%) Google
10 20 (2.49%) Informatica
11 18 (2.24%) Hortonworks
12 13 (1.62%) Talend
13 11 (1.37%) IBM
14 9 (1.12%) Netezza
14 9 (1.12%) Splunk
15 8 (1.00%) Cloudera
16 7 (0.87%) PlateSpin