Period
to 10 August 2020

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 10 August 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > UK excluding London
6 months to
10 Aug 2020
Same period 2019 Same period 2018
Rank 319 493 725
Rank change year-on-year +174 +232 +55
Permanent jobs citing Data Lake 291 408 211
As % of all permanent jobs advertised in the UK excluding London 0.81% 0.49% 0.22%
As % of the Database & Business Intelligence category 2.99% 1.84% 0.74%
Number of salaries quoted 215 302 216
Median annual salary £57,500 £57,500 £55,000
Median salary % change year-on-year - +4.55% -
10th Percentile £41,250 £37,625 £43,875
90th Percentile £73,750 £85,000 £77,500
UK median annual salary £65,000 £65,000 £65,000

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 9,740 22,117 28,514
As % of all permanent IT jobs advertised in the UK excluding London 27.27% 26.72% 29.34%
Number of salaries quoted 7,998 17,986 23,838
Median annual salary £47,500 £45,000 £45,000
Median salary % change year-on-year +5.56% - +5.88%
10th Percentile £31,250 £29,000 £28,000
90th Percentile £70,000 £67,500 £66,000
UK median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Data Lake
Job Vacancy Trend in the UK excluding London

Job postings citing Data Lake as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Data Lake in the UK excluding London

Data Lake
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Data Lake in the UK excluding London.

Salary trend for Data Lake in the UK excluding London

Data Lake
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Data Lake in the UK excluding London over the 6 months to 10 August 2020.

Salary histogram for Data Lake in the UK excluding London

Data Lake
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK excluding London region over the 6 months to 10 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East +143 86 £60,000 -4.00% 8
Midlands +143 77 £55,000 -0.90% 9
North of England +155 71 £70,000 +54.14% 14
West Midlands +150 64 £55,000 -15.38% 6
North West +155 53 £70,000 +55.56% 13
South West +42 22 £58,750 -4.47% 4
Yorkshire +131 17 £72,500 +60.38% 1
Scotland +89 17 £53,750 +4.37%
East of England +62 17 £55,000 +15.79% 4
East Midlands +59 13 £48,000 -12.73% 3
North East +14 1 - -
Wales - 1 £52,500 -
Data Lake
UK

For the 6 months to 10 August 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Data Lake.

1 191 (65.64%) Azure
2 168 (57.73%) Analytics
3 167 (57.39%) SQL
4 166 (57.04%) Business Intelligence
5 153 (52.58%) Big Data
6 146 (50.17%) Data Warehouse
7 134 (46.05%) Python
8 127 (43.64%) Microsoft
9 118 (40.55%) Agile Software Development
10 108 (37.11%) SQL Server
11 104 (35.74%) ETL
12 99 (34.02%) Power BI
12 99 (34.02%) Power Platform
13 93 (31.96%) Databricks
14 85 (29.21%) Analytical Skills
15 83 (28.52%) Data Modelling
16 79 (27.15%) Finance
17 78 (26.80%) DevOps
18 76 (26.12%) SQL Server Integration Services
19 75 (25.77%) R
20 66 (22.68%) Azure Data Factory
21 59 (20.27%) Machine Learning
22 58 (19.93%) Migration
23 57 (19.59%) Data Engineering
24 56 (19.24%) AWS
25 55 (18.90%) Data Analytics
26 53 (18.21%) Azure SQL Data Warehouse
26 53 (18.21%) SQL Server Reporting Services
27 52 (17.87%) SQL Server Analysis Services
28 50 (17.18%) Degree

Data Lake
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 31 (10.65%) Apache Spark
2 16 (5.50%) Apache
3 9 (3.09%) Apache Pig
4 6 (2.06%) Apache Synapse
5 5 (1.72%) Elasticsearch
6 4 (1.37%) SharePoint
7 2 (0.69%) Apache Airflow
7 2 (0.69%) Confluence
7 2 (0.69%) Jupyter
7 2 (0.69%) Oracle SOA Suite
8 1 (0.34%) SAS
Applications
1 6 (2.06%) Microsoft Excel
2 2 (0.69%) Microsoft Office
Business Applications
1 4 (1.37%) Dynamics CRM
2 3 (1.03%) SAP IS-U
3 1 (0.34%) Oracle EBS
Cloud Services
1 191 (65.64%) Azure
2 99 (34.02%) Power Platform
3 66 (22.68%) Azure Data Factory
4 56 (19.24%) AWS
5 34 (11.68%) PaaS
6 28 (9.62%) IaaS
6 28 (9.62%) SaaS
7 10 (3.44%) Azure Machine Learning
7 10 (3.44%) Azure Stack
7 10 (3.44%) Serverless
8 9 (3.09%) GCP
9 7 (2.41%) AWS Lambda
9 7 (2.41%) Cortana Intelligence Suite
10 5 (1.72%) Amazon S3
11 4 (1.37%) Amazon EC2
11 4 (1.37%) Amazon Kinesis
11 4 (1.37%) Logic Apps
11 4 (1.37%) Power Automate
11 4 (1.37%) PowerApps
12 3 (1.03%) Amazon EMR
Communications & Networking
1 13 (4.47%) Skype
2 1 (0.34%) Firewall
2 1 (0.34%) Internet
2 1 (0.34%) IPsec
2 1 (0.34%) SSL
Database & Business Intelligence
1 153 (52.58%) Big Data
2 146 (50.17%) Data Warehouse
3 108 (37.11%) SQL Server
4 99 (34.02%) Power BI
5 76 (26.12%) SQL Server Integration Services
6 53 (18.21%) Azure SQL Data Warehouse
6 53 (18.21%) SQL Server Reporting Services
7 52 (17.87%) SQL Server Analysis Services
8 47 (16.15%) Azure SQL Database
9 39 (13.40%) Hadoop
10 24 (8.25%) Apache Hive
10 24 (8.25%) HDInsight
10 24 (8.25%) Snowflake Schema
11 23 (7.90%) Relational Database
12 21 (7.22%) Cosmos DB
13 18 (6.19%) NoSQL
14 14 (4.81%) Impala
15 13 (4.47%) Amazon Redshift
15 13 (4.47%) Apache Cassandra
16 12 (4.12%) Geospatial Data
Development Applications
1 34 (11.68%) Git (software)
2 16 (5.50%) Jenkins
3 13 (4.47%) Cucumber
4 5 (1.72%) Visual Studio
5 4 (1.37%) SQL Server Management Studio (SSMS)
6 3 (1.03%) ERwin
6 3 (1.03%) JIRA
7 1 (0.34%) Bitbucket
7 1 (0.34%) Toad
7 1 (0.34%) Visual Studio Tools for Office
General
1 79 (27.15%) Finance
2 9 (3.09%) Legal
2 9 (3.09%) Retail
3 5 (1.72%) Police
4 4 (1.37%) Banking
4 4 (1.37%) Manufacturing
4 4 (1.37%) Marketing
5 3 (1.03%) Advertising
5 3 (1.03%) Law
6 2 (0.69%) Back Office
7 1 (0.34%) Public Sector
7 1 (0.34%) Publishing
Job Titles
1 77 (26.46%) Data Engineer
1 77 (26.46%) Developer
2 63 (21.65%) Architect
3 40 (13.75%) Solutions Architect
4 36 (12.37%) Business Intelligence Developer
5 34 (11.68%) Cloud Architect
6 33 (11.34%) Cloud Solutions Architect
7 30 (10.31%) Azure Architect
8 28 (9.62%) SQL Developer
9 27 (9.28%) Data Architect
10 26 (8.93%) Data Warehouse Developer
11 24 (8.25%) Azure Developer
11 24 (8.25%) SSIS Developer
11 24 (8.25%) SSRS Developer
11 24 (8.25%) T-SQL Developer
12 22 (7.56%) SQL BI Developer
13 21 (7.22%) Azure Engineer
14 20 (6.87%) Analyst
15 14 (4.81%) Data Analyst
16 11 (3.78%) Senior Analyst
Libraries, Frameworks & Software Standards
1 42 (14.43%) .NET
2 28 (9.62%) ASP.NET
3 26 (8.93%) HTML
4 25 (8.59%) CSS
5 22 (7.56%) Kafka
6 20 (6.87%) HTML5
7 19 (6.53%) ASP.NET MVC
8 18 (6.19%) ASP.NET Web API
9 7 (2.41%) Apache NiFi
9 7 (2.41%) XML
10 6 (2.06%) .NET Framework
10 6 (2.06%) Apache Avro
10 6 (2.06%) Entity Framework
10 6 (2.06%) MDX
11 5 (1.72%) Elastic Stack
11 5 (1.72%) jQuery
11 5 (1.72%) Redux
11 5 (1.72%) Twitter Bootstrap
11 5 (1.72%) XSLT
12 4 (1.37%) Web Services
Miscellaneous
1 85 (29.21%) Analytical Skills
2 9 (3.09%) Data Centre
3 8 (2.75%) Data Structures
4 7 (2.41%) Clustering
5 6 (2.06%) Greenfield Project
6 5 (1.72%) Algorithms
7 4 (1.37%) Credit Risk
8 3 (1.03%) Enterprise Software
8 3 (1.03%) Life Science
8 3 (1.03%) Mobile App
9 1 (0.34%) Blog
9 1 (0.34%) Driving Licence
9 1 (0.34%) Management Information System
9 1 (0.34%) Marketing Technology
9 1 (0.34%) PKI
9 1 (0.34%) Public Cloud
9 1 (0.34%) Self-Motivation
9 1 (0.34%) Social Media
9 1 (0.34%) Taxonomies
9 1 (0.34%) User Experience
Operating Systems
1 21 (7.22%) Windows
2 18 (6.19%) Linux
3 17 (5.84%) Unix
4 7 (2.41%) Windows Server
5 6 (2.06%) Red Hat Enterprise Linux
6 2 (0.69%) Android
6 2 (0.69%) Apple iOS
Processes & Methodologies
1 168 (57.73%) Analytics
2 166 (57.04%) Business Intelligence
3 118 (40.55%) Agile Software Development
4 104 (35.74%) ETL
5 83 (28.52%) Data Modelling
6 78 (26.80%) DevOps
7 59 (20.27%) Machine Learning
8 58 (19.93%) Migration
9 57 (19.59%) Data Engineering
10 55 (18.90%) Data Analytics
11 43 (14.78%) Data Strategy
11 43 (14.78%) Test Automation
12 42 (14.43%) Visualisation
13 41 (14.09%) Continuous Integration
14 38 (13.06%) Enterprise Architecture
15 37 (12.71%) Stakeholder Management
16 34 (11.68%) Data Science
17 29 (9.97%) Artificial Intelligence
18 28 (9.62%) Project Delivery
19 27 (9.28%) Data Analysis
Programming Languages
1 167 (57.39%) SQL
2 134 (46.05%) Python
3 75 (25.77%) R
4 50 (17.18%) T-SQL
5 37 (12.71%) C#
6 29 (9.97%) Java
7 25 (8.59%) Scala
8 20 (6.87%) Data Analysis Expressions (DAX)
9 19 (6.53%) JavaScript
10 14 (4.81%) C++
11 13 (4.47%) Perl
12 12 (4.12%) PowerShell
13 9 (3.09%) VB.NET
14 7 (2.41%) C
15 5 (1.72%) U-SQL
15 5 (1.72%) XAML
16 3 (1.03%) Ruby
16 3 (1.03%) Shell Script
17 2 (0.69%) Bash Shell
18 1 (0.34%) Elm
Qualifications
1 50 (17.18%) Degree
2 9 (3.09%) Microsoft Certification
3 4 (1.37%) Computer Science Degree
4 3 (1.03%) TOGAF Certification
5 2 (0.69%) AWS Certification
5 2 (0.69%) Cisco Certification
5 2 (0.69%) MCSA
6 1 (0.34%) CCIE
6 1 (0.34%) CCNP
6 1 (0.34%) CISSP
6 1 (0.34%) MCSE
6 1 (0.34%) MCTS
6 1 (0.34%) SC Cleared
6 1 (0.34%) Security Cleared
Quality Assurance & Compliance
1 38 (13.06%) Data Quality
2 14 (4.81%) NIST
3 10 (3.44%) QA
4 9 (3.09%) GAAP
5 5 (1.72%) GDPR
5 5 (1.72%) Sarbanes-Oxley
6 1 (0.34%) ISO/IEC 27001
6 1 (0.34%) SLA
System Software
1 26 (8.93%) Docker
2 9 (3.09%) Active Directory
3 7 (2.41%) Hyper-V
3 7 (2.41%) Virtual Machines
4 5 (1.72%) Apache ZooKeeper
4 5 (1.72%) HDFS
Systems Management
1 15 (5.15%) Kubernetes
2 7 (2.41%) SCVMM
3 6 (2.06%) Rancher
3 6 (2.06%) Terraform
4 5 (1.72%) Hadoop YARN
4 5 (1.72%) Kibana
4 5 (1.72%) Opscode Chef
4 5 (1.72%) Puppet
5 2 (0.69%) Fluentd
6 1 (0.34%) Ansible
6 1 (0.34%) Microsoft Intune
6 1 (0.34%) Prometheus
6 1 (0.34%) ZABBIX
Vendors
1 127 (43.64%) Microsoft
2 93 (31.96%) Databricks
3 46 (15.81%) Tableau
4 35 (12.03%) Teradata
5 33 (11.34%) Sparx
6 31 (10.65%) Oracle
7 24 (8.25%) Alteryx
8 15 (5.15%) Automation Anywhere
8 15 (5.15%) Blue Prism
8 15 (5.15%) Cadence
8 15 (5.15%) UiPath
9 12 (4.12%) Informatica
10 9 (3.09%) Hortonworks
11 8 (2.75%) Splunk
12 7 (2.41%) PlateSpin
12 7 (2.41%) VirtaMove
13 6 (2.06%) Ab Initio
13 6 (2.06%) Red Hat
14 5 (1.72%) Cloudera
14 5 (1.72%) Xamarin