Period
to 3 June 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 3 June 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
3 Jun 2020
Same period 2019 Same period 2018
Rank 299 508 538
Rank change year-on-year +209 +30 +449
Permanent jobs citing Data Lake 884 773 884
As % of all permanent jobs advertised in the UK 1.01% 0.54% 0.51%
As % of the Database & Business Intelligence category 3.76% 1.93% 1.68%
Number of salaries quoted 561 635 765
Median annual salary £67,500 £65,000 £62,500
Median salary % change year-on-year +3.85% +4.00% +0.81%
10th Percentile £44,250 £43,750 £46,250
90th Percentile £90,000 £100,750 £95,000
UK excluding London median annual salary £57,500 £61,500 £57,500
% change year-on-year -6.50% +6.96% +4.55%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 23,537 39,968 52,751
As % of all permanent IT jobs advertised in the UK 26.88% 28.02% 30.67%
Number of salaries quoted 19,103 32,570 43,172
Median annual salary £54,000 £51,978 £50,000
Median salary % change year-on-year +3.89% +3.96% +5.26%
10th Percentile £32,500 £31,250 £31,250
90th Percentile £90,000 £85,000 £80,000
UK excluding London median annual salary £47,000 £45,000 £45,000
% change year-on-year +4.44% - +7.14%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 3 June 2020.

Salary histogram for Data Lake in the UK

Data Lake
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 3 June 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +198 858 £70,000 +7.69% 65
London +179 588 £72,500 +3.57% 9
UK excluding London +145 288 £57,500 -6.50% 58
South East +104 104 £65,000 +8.33% 13
North of England +129 61 £65,000 +9.84% 19
Midlands +104 53 £55,000 - 20
West Midlands +113 50 £55,000 -15.38% 19
North West +106 39 £67,500 +58.82% 15
East of England +67 30 £59,000 -9.23% 2
Yorkshire +109 22 £65,000 +30.00% 3
South West +32 22 £54,000 -12.20% 5
Scotland +71 16 £52,500 +5.00% 2
Work from Home +31 15 £67,500 +3.85% 5
East Midlands +36 3 £55,500 +0.91% 1
Channel Islands - 1 - -
Wales - 1 £52,500 -

For the 6 months to 3 June 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 651 (73.64%) SQL
2 600 (67.87%) Business Intelligence
3 539 (60.97%) Analytics
4 445 (50.34%) SQL Server
5 440 (49.77%) Azure
6 438 (49.55%) Data Warehouse
7 437 (49.43%) ETL
8 363 (41.06%) Python
9 329 (37.22%) Power Platform
10 322 (36.43%) Agile Software Development
11 320 (36.20%) Power BI
12 286 (32.35%) Tableau
13 285 (32.24%) Data Analytics
13 285 (32.24%) Microsoft
13 285 (32.24%) Analytical Skills
14 251 (28.39%) Big Data
15 238 (26.92%) Data Modelling
16 234 (26.47%) Oracle
17 229 (25.90%) Data Analysis
18 215 (24.32%) Degree
19 211 (23.87%) Finance
20 206 (23.30%) Azure Data Factory
21 197 (22.29%) Visualisation
22 195 (22.06%) Proactive Monitoring
22 195 (22.06%) Databricks
23 194 (21.95%) Alteryx
24 193 (21.83%) Teradata
25 183 (20.70%) Data Extraction
26 178 (20.14%) Cadence
26 178 (20.14%) Automation Anywhere

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 115 (13.01%) Apache Spark
2 23 (2.60%) Apache
3 20 (2.26%) Apache Airflow
4 13 (1.47%) Confluence
5 12 (1.36%) Elasticsearch
6 8 (0.90%) Apache Pig
7 7 (0.79%) Oracle Workflow
8 6 (0.68%) Oracle SOA Suite
9 5 (0.57%) Apache Synapse
9 5 (0.57%) SAS
10 4 (0.45%) IIS
10 4 (0.45%) Jupyter
10 4 (0.45%) SharePoint
11 3 (0.34%) Luigi
12 2 (0.23%) Anypoint
13 1 (0.11%) Apache Solr
13 1 (0.11%) CMS
Applications
1 17 (1.92%) Microsoft Office
2 15 (1.70%) Microsoft Excel
Business Applications
1 3 (0.34%) Dynamics CRM
1 3 (0.34%) Sparx Enterprise Architect
2 2 (0.23%) NetSuite
2 2 (0.23%) SAP IS-U
3 1 (0.11%) Oracle EBS
3 1 (0.11%) SimCorp Dimension
Cloud Services
1 440 (49.77%) Azure
2 329 (37.22%) Power Platform
3 206 (23.30%) Azure Data Factory
4 163 (18.44%) AWS
5 68 (7.69%) GCP
6 64 (7.24%) PaaS
7 55 (6.22%) SaaS
8 48 (5.43%) IaaS
9 47 (5.32%) Serverless
10 37 (4.19%) Amazon S3
10 37 (4.19%) Data Lake Analytics
11 23 (2.60%) Azure Machine Learning
12 20 (2.26%) Logic Apps
13 19 (2.15%) Amazon EMR
13 19 (2.15%) Azure Active Directory
13 19 (2.15%) PowerApps
14 16 (1.81%) Azure Stack
15 15 (1.70%) Office 365
16 14 (1.58%) Amazon Kinesis
16 14 (1.58%) Azure Functions
Communications & Networking
1 10 (1.13%) Skype
2 2 (0.23%) Internet
3 1 (0.11%) Firewall
Database & Business Intelligence
1 445 (50.34%) SQL Server
2 438 (49.55%) Data Warehouse
3 320 (36.20%) Power BI
4 251 (28.39%) Big Data
5 161 (18.21%) SQL Server Integration Services
6 153 (17.31%) Azure SQL Database
7 141 (15.95%) SQL Server Analysis Services
8 140 (15.84%) Azure SQL Data Warehouse
9 107 (12.10%) SQL Server Reporting Services
10 95 (10.75%) Oracle Reports
11 81 (9.16%) Snowflake Schema
12 77 (8.71%) Hadoop
13 65 (7.35%) NoSQL
14 63 (7.13%) Amazon Redshift
15 58 (6.56%) Microsoft Analysis Services
16 55 (6.22%) Cosmos DB
17 42 (4.75%) Apache Hive
18 41 (4.64%) Relational Database
19 33 (3.73%) BigQuery
20 26 (2.94%) Looker
Development Applications
1 71 (8.03%) Git (software)
2 29 (3.28%) Visual Studio
3 22 (2.49%) Jenkins
4 13 (1.47%) JIRA
5 11 (1.24%) TeamCity
6 10 (1.13%) Cucumber
7 9 (1.02%) ERwin
8 8 (0.90%) GitLab
8 8 (0.90%) Visual Studio Team System
9 7 (0.79%) SQL Server Management Studio (SSMS)
10 5 (0.57%) Atlassian Bamboo
10 5 (0.57%) ER Studio
10 5 (0.57%) GDB
10 5 (0.57%) Octopus Deploy
10 5 (0.57%) Sourcetree
10 5 (0.57%) Travis CI
11 4 (0.45%) Artifactory
11 4 (0.45%) Visual Studio Code
12 3 (0.34%) CircleCI
12 3 (0.34%) GoCD
General
1 211 (23.87%) Finance
2 102 (11.54%) Legal
3 43 (4.86%) Marketing
4 23 (2.60%) Retail
5 18 (2.04%) Banking
6 8 (0.90%) Advertising
7 7 (0.79%) Public Sector
7 7 (0.79%) Publishing
8 5 (0.57%) Police
9 4 (0.45%) Financial Institution
9 4 (0.45%) Investment Banking
9 4 (0.45%) Manufacturing
10 2 (0.23%) Automotive
10 2 (0.23%) Back Office
10 2 (0.23%) Front Office
11 1 (0.11%) Law
11 1 (0.11%) Pharmaceutical
11 1 (0.11%) Telecoms
Job Titles
1 267 (30.20%) Data Engineer
2 184 (20.81%) Analyst
3 161 (18.21%) Developer
4 149 (16.86%) Data Analyst
5 140 (15.84%) Architect
6 94 (10.63%) Azure Engineer
7 78 (8.82%) Data Architect
8 76 (8.60%) Senior Analyst
9 69 (7.81%) Business Intelligence Developer
9 69 (7.81%) SQL Developer
10 67 (7.58%) Senior Data Engineer
11 63 (7.13%) Senior Data Analyst
12 58 (6.56%) Data Manager
13 47 (5.32%) Solutions Architect
14 45 (5.09%) Data Warehouse Developer
15 44 (4.98%) SQL BI Developer
15 44 (4.98%) SSIS Developer
16 41 (4.64%) Cloud Architect
17 40 (4.52%) Consultant
17 40 (4.52%) SSRS Developer
Libraries, Frameworks & Software Standards
1 101 (11.43%) .NET
2 78 (8.82%) Kafka
3 45 (5.09%) HTML
4 35 (3.96%) ASP.NET
5 32 (3.62%) CSS
5 32 (3.62%) HTML5
5 32 (3.62%) MDX
6 31 (3.51%) PySpark
7 21 (2.38%) Web Services
8 20 (2.26%) ASP.NET MVC
9 18 (2.04%) ASP.NET Web API
10 12 (1.36%) XML
11 11 (1.24%) Apache Avro
12 10 (1.13%) Apache NiFi
12 10 (1.13%) JSON
13 9 (1.02%) .NET Framework
13 9 (1.02%) Entity Framework
14 7 (0.79%) jQuery
15 6 (0.68%) RESTful
15 6 (0.68%) XSLT
Miscellaneous
1 285 (32.24%) Analytical Skills
2 63 (7.13%) Greenfield Project
3 36 (4.07%) Management Information System
4 32 (3.62%) Data Structures
5 29 (3.28%) Enterprise Software
6 21 (2.38%) Cloud Native
7 15 (1.70%) Self-Motivation
8 9 (1.02%) Algorithms
8 9 (1.02%) Clustering
8 9 (1.02%) Cyberthreat
8 9 (1.02%) Data Centre
8 9 (1.02%) Reinsurance
9 7 (0.79%) Marketing Technology
9 7 (0.79%) Tandem
9 7 (0.79%) Virtual Team
10 5 (0.57%) N-Tier
10 5 (0.57%) Reference Data
11 4 (0.45%) PMI
11 4 (0.45%) Public Cloud
11 4 (0.45%) Social Media
Operating Systems
1 35 (3.96%) Windows
2 28 (3.17%) Windows Server
3 12 (1.36%) Linux
4 11 (1.24%) Windows 10
5 8 (0.90%) Unix
6 2 (0.23%) Windows 7
7 1 (0.11%) Android
7 1 (0.11%) Apple iOS
7 1 (0.11%) Red Hat Enterprise Linux
Processes & Methodologies
1 600 (67.87%) Business Intelligence
2 539 (60.97%) Analytics
3 437 (49.43%) ETL
4 322 (36.43%) Agile Software Development
5 285 (32.24%) Data Analytics
6 238 (26.92%) Data Modelling
7 229 (25.90%) Data Analysis
8 197 (22.29%) Visualisation
9 195 (22.06%) Proactive Monitoring
10 183 (20.70%) Data Extraction
11 150 (16.97%) Data Engineering
12 135 (15.27%) DevOps
13 115 (13.01%) User Acceptance Testing
14 104 (11.76%) Data Science
15 101 (11.43%) Machine Learning
16 95 (10.75%) Project Management
17 93 (10.52%) System Integration Testing
18 90 (10.18%) Data Architecture
19 87 (9.84%) Change Control
20 85 (9.62%) Migration
Programming Languages
1 651 (73.64%) SQL
2 363 (41.06%) Python
3 106 (11.99%) R
3 106 (11.99%) T-SQL
4 99 (11.20%) Scala
5 92 (10.41%) C#
6 62 (7.01%) Java
7 50 (5.66%) PowerShell
8 49 (5.54%) Data Analysis Expressions (DAX)
9 36 (4.07%) JavaScript
10 31 (3.51%) U-SQL
11 21 (2.38%) VB.NET
12 18 (2.04%) C
13 11 (1.24%) PL/SQL
13 11 (1.24%) VBA
14 6 (0.68%) XAML
15 5 (0.57%) Go
15 5 (0.57%) Ruby
16 4 (0.45%) Bash Shell
16 4 (0.45%) PHP
Qualifications
1 215 (24.32%) Degree
2 23 (2.60%) Microsoft Certification
3 10 (1.13%) Cisco Certification
4 9 (1.02%) (ISC)2 CCSP
4 9 (1.02%) CCSP
4 9 (1.02%) CISSP
4 9 (1.02%) CompTIA Security+
5 6 (0.68%) Computer Science Degree
5 6 (0.68%) Security Cleared
6 5 (0.57%) PMI Certification
7 4 (0.45%) AWS Certification
7 4 (0.45%) SC Cleared
8 1 (0.11%) MCSA
8 1 (0.11%) PhD
8 1 (0.11%) PMP
8 1 (0.11%) PRINCE2 Certification
8 1 (0.11%) TOGAF Certification
Quality Assurance & Compliance
1 93 (10.52%) GAAP
2 81 (9.16%) Data Quality
3 17 (1.92%) GDPR
3 17 (1.92%) QA
4 3 (0.34%) NIST
5 2 (0.23%) EMIR
5 2 (0.23%) IFRS
5 2 (0.23%) MiFID
6 1 (0.11%) ISO/IEC 27001
System Software
1 45 (5.09%) Docker
2 24 (2.71%) Active Directory
3 16 (1.81%) Virtual Machines
4 10 (1.13%) Hyper-V
5 7 (0.79%) Apache ZooKeeper
6 6 (0.68%) HDFS
7 3 (0.34%) VMware Infrastructure
8 2 (0.23%) Apache Flume
Systems Management
1 48 (5.43%) Kubernetes
2 22 (2.49%) Terraform
3 11 (1.24%) Oozie
3 11 (1.24%) Puppet
4 10 (1.13%) Microsoft Intune
5 9 (1.02%) Single Sign-On
6 8 (0.90%) Hadoop YARN
6 8 (0.90%) Opscode Chef
6 8 (0.90%) Rancher
7 7 (0.79%) Ansible
7 7 (0.79%) Kibana
7 7 (0.79%) SCVMM
8 3 (0.34%) Argo
9 2 (0.23%) Prometheus
10 1 (0.11%) Grafana
10 1 (0.11%) ZABBIX
Vendors
1 286 (32.35%) Tableau
2 285 (32.24%) Microsoft
3 234 (26.47%) Oracle
4 195 (22.06%) Databricks
5 194 (21.95%) Alteryx
6 193 (21.83%) Teradata
7 178 (20.14%) Automation Anywhere
7 178 (20.14%) Blue Prism
7 178 (20.14%) Cadence
7 178 (20.14%) UiPath
8 32 (3.62%) Informatica
9 26 (2.94%) Google
10 25 (2.83%) Sparx
11 16 (1.81%) Hortonworks
11 16 (1.81%) Talend
12 15 (1.70%) Salesforce.com
13 10 (1.13%) IBM
14 9 (1.02%) Netezza
15 7 (0.79%) PlateSpin
15 7 (0.79%) SAP