Period
to 8 December 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 8 December 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
8 Dec 2019
Same period 2018 Same period 2017
Rank 478 598 883
Rank change year-on-year +120 +285 +234
Permanent jobs citing Data Lake 766 669 345
As % of all permanent IT jobs advertised in the UK 0.58% 0.42% 0.19%
As % of the Database & Business Intelligence category 2.15% 1.46% 0.63%
Number of salaries quoted 656 515 303
UK median annual salary £65,000 £65,000 £62,500
Median salary % change year-on-year - +4.00% -16.67%
10th Percentile £41,471 £41,250 £46,250
90th Percentile £100,000 £100,000 £100,000
UK excluding London median annual salary £56,250 £62,138 £55,000
% change year-on-year -9.48% +12.98% +10.00%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 35,679 45,842 54,367
As % of all permanent IT jobs advertised in the UK 26.85% 28.85% 30.24%
Number of salaries quoted 29,467 37,707 44,809
UK median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,750 £31,250 £30,000
90th Percentile £87,500 £85,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

The salary distribution of IT jobs citing Data Lake over the 6 months to 8 December 2019.

Salary histogram for Data Lake in the UK

Data Lake
Top 15 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 8 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +117 737 £65,000 - 148
London +84 430 £72,500 +3.57% 83
UK excluding London +140 321 £56,250 -9.48% 74
South East +34 93 £62,500 -3.85% 31
North of England +89 73 £50,000 - 17
East of England +96 68 £47,500 -9.52% 6
South West +9 56 £58,500 -5.85% 7
North West +61 36 £50,000 -16.67% 11
Yorkshire +35 24 £45,412 -9.18% 6
Midlands +30 23 £53,750 -10.42% 4
East Midlands +27 16 £55,000 +4.76% 1
Scotland +18 13 £55,000 +18.92% 6
North East - 13 £42,943 -
West Midlands +18 7 £52,500 -18.90% 3
Wales - 1 - - 3

For the 6 months to 8 December 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 483 (63.05%) Azure
2 470 (61.36%) SQL
3 458 (59.79%) Data Warehouse
4 426 (55.61%) Analytics
5 391 (51.04%) Business Intelligence
6 298 (38.90%) Big Data
7 273 (35.64%) Microsoft
8 270 (35.25%) SQL Server
9 269 (35.12%) ETL
9 269 (35.12%) Power BI
9 269 (35.12%) Power Platform
10 260 (33.94%) Agile Software Development
11 227 (29.63%) Python
12 221 (28.85%) Data Modelling
13 207 (27.02%) Finance
14 199 (25.98%) SQL Server Integration Services
15 190 (24.80%) Azure Data Factory
16 166 (21.67%) DevOps
17 163 (21.28%) Data Science
18 157 (20.50%) Hadoop
19 156 (20.37%) Azure SQL Database
20 151 (19.71%) AWS
21 143 (18.67%) Azure SQL Data Warehouse
22 142 (18.54%) Machine Learning
23 136 (17.75%) Apache Spark
24 135 (17.62%) Databricks
25 133 (17.36%) SQL Server Analysis Services
26 130 (16.97%) Visualisation
27 117 (15.27%) SQL Server Reporting Services
28 111 (14.49%) Data Engineering

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 136 (17.75%) Apache Spark
2 38 (4.96%) Apache
3 16 (2.09%) IIS
3 16 (2.09%) SAS
4 11 (1.44%) Anypoint
4 11 (1.44%) Apache Airflow
5 9 (1.17%) Elasticsearch
6 8 (1.04%) ArcGIS
7 7 (0.91%) SharePoint
8 6 (0.78%) Apache Solr
9 5 (0.65%) Confluence
10 4 (0.52%) Apache Pig
11 3 (0.39%) Jupyter
Applications
1 28 (3.66%) Microsoft Excel
2 17 (2.22%) Spreadsheet
3 13 (1.70%) Microsoft Office
4 2 (0.26%) SPSS
5 1 (0.13%) MS Visio
Business Applications
1 6 (0.78%) Sparx Enterprise Architect
2 2 (0.26%) Dynamics CRM
3 1 (0.13%) HFM
3 1 (0.13%) Markit EDM
3 1 (0.13%) Oracle 11i
3 1 (0.13%) Oracle EBS R12
Cloud Services
1 483 (63.05%) Azure
2 269 (35.12%) Power Platform
3 190 (24.80%) Azure Data Factory
4 151 (19.71%) AWS
5 75 (9.79%) PaaS
6 74 (9.66%) GCP
7 53 (6.92%) Serverless
8 49 (6.40%) Data Lake Analytics
9 47 (6.14%) IaaS
10 31 (4.05%) Amazon Kinesis
11 30 (3.92%) Amazon S3
12 29 (3.79%) SaaS
13 27 (3.52%) Azure Functions
14 25 (3.26%) Azure Active Directory
15 23 (3.00%) Amazon EMR
16 21 (2.74%) Azure Machine Learning
17 16 (2.09%) GitHub
18 10 (1.31%) AWS Lambda
18 10 (1.31%) PowerApps
19 9 (1.17%) Cloud Computing
Communications & Networking
1 5 (0.65%) Internet
2 2 (0.26%) VPN
3 1 (0.13%) Broadband
3 1 (0.13%) LAN
3 1 (0.13%) SAN
3 1 (0.13%) Skype
3 1 (0.13%) TCP/IP
3 1 (0.13%) VLAN
3 1 (0.13%) WAN
3 1 (0.13%) Wi-Fi
Database & Business Intelligence
1 458 (59.79%) Data Warehouse
2 298 (38.90%) Big Data
3 270 (35.25%) SQL Server
4 269 (35.12%) Power BI
5 199 (25.98%) SQL Server Integration Services
6 157 (20.50%) Hadoop
7 156 (20.37%) Azure SQL Database
8 143 (18.67%) Azure SQL Data Warehouse
9 133 (17.36%) SQL Server Analysis Services
10 117 (15.27%) SQL Server Reporting Services
11 96 (12.53%) NoSQL
12 77 (10.05%) Apache Hive
13 67 (8.75%) Amazon Redshift
14 58 (7.57%) Microsoft Analysis Services
15 56 (7.31%) Cosmos DB
16 49 (6.40%) Relational Database
17 39 (5.09%) Snowflake Schema
18 35 (4.57%) HDInsight
18 35 (4.57%) MongoDB
19 34 (4.44%) Impala
Development Applications
1 58 (7.57%) Git (software)
2 33 (4.31%) Visual Studio
3 30 (3.92%) Jenkins
4 26 (3.39%) JIRA
4 26 (3.39%) Visual Studio Team System
5 25 (3.26%) ERwin
6 13 (1.70%) Cucumber
7 12 (1.57%) Octopus Deploy
7 12 (1.57%) Team Foundation Server
8 10 (1.31%) Selenium
9 7 (0.91%) ER Studio
9 7 (0.91%) Subversion
10 6 (0.78%) HP UFT
11 5 (0.65%) PowerDesigner
12 4 (0.52%) TeamCity
13 2 (0.26%) Atlassian Bamboo
13 2 (0.26%) Mocha
13 2 (0.26%) NUnit
13 2 (0.26%) Spock
13 2 (0.26%) SQL Server Management Studio (SSMS)
General
1 207 (27.02%) Finance
2 69 (9.01%) Retail
3 33 (4.31%) Banking
4 24 (3.13%) Marketing
5 16 (2.09%) Public Sector
6 14 (1.83%) Legal
7 12 (1.57%) Advertising
8 11 (1.44%) Publishing
9 9 (1.17%) Pharmaceutical
10 8 (1.04%) Automotive
10 8 (1.04%) Financial Institution
10 8 (1.04%) Telecoms
11 7 (0.91%) Games
12 4 (0.52%) Investment Banking
13 3 (0.39%) Front Office
13 3 (0.39%) Manufacturing
14 1 (0.13%) Back Office
14 1 (0.13%) Electronics
14 1 (0.13%) Law
14 1 (0.13%) Multimedia
Job Titles
1 211 (27.55%) Developer
2 164 (21.41%) Architect
3 154 (20.10%) Data Engineer
4 105 (13.71%) Data Architect
5 86 (11.23%) Business Intelligence Developer
6 81 (10.57%) Analyst
7 73 (9.53%) SQL Developer
8 66 (8.62%) Azure Developer
9 44 (5.74%) Senior Developer
10 43 (5.61%) Azure Engineer
11 41 (5.35%) SQL Server Developer
12 40 (5.22%) Data Analyst
13 35 (4.57%) Database Developer
13 35 (4.57%) Power BI Developer
13 35 (4.57%) SQL Database Developer
14 34 (4.44%) Cloud Architect
14 34 (4.44%) SQL BI Developer
15 33 (4.31%) Solutions Architect
16 32 (4.18%) Business Intelligence Lead
17 31 (4.05%) Azure Architect
Libraries, Frameworks & Software Standards
1 50 (6.53%) Kafka
2 42 (5.48%) MDX
3 28 (3.66%) .NET
4 21 (2.74%) Web Services
5 18 (2.35%) Lambda Expressions
5 18 (2.35%) Natural Language Processing
6 16 (2.09%) .NET Core
7 15 (1.96%) Node.js
8 14 (1.83%) HTML
8 14 (1.83%) XML
9 12 (1.57%) JSON
10 11 (1.44%) .NET Framework
10 11 (1.44%) React
11 10 (1.31%) Entity Framework
11 10 (1.31%) Velocity
12 9 (1.17%) Pandas
13 8 (1.04%) AngularJS
14 7 (0.91%) D3.js
14 7 (0.91%) Leaflet
15 6 (0.78%) REST
Miscellaneous
1 101 (13.19%) Analytical Skills
2 35 (4.57%) Algorithms
3 33 (4.31%) Management Information System
4 31 (4.05%) Greenfield Project
5 14 (1.83%) Data Centre
6 13 (1.70%) Cloud Native
7 12 (1.57%) Clustering
8 11 (1.44%) Data Structures
8 11 (1.44%) Hybrid Cloud
9 10 (1.31%) BBC
10 9 (1.17%) Public Cloud
11 8 (1.04%) Reinsurance
12 7 (0.91%) Marketing Technology
12 7 (0.91%) Private Cloud
12 7 (0.91%) Self-Motivation
12 7 (0.91%) User Experience
13 6 (0.78%) Analytical Mindset
14 5 (0.65%) Online Games
14 5 (0.65%) Tandem
15 4 (0.52%) Replication
Operating Systems
1 46 (6.01%) Windows
2 26 (3.39%) Windows Server
3 20 (2.61%) Unix
4 16 (2.09%) Linux
5 9 (1.17%) Windows 10
6 5 (0.65%) Red Hat Enterprise Linux
6 5 (0.65%) Windows 7
Processes & Methodologies
1 426 (55.61%) Analytics
2 391 (51.04%) Business Intelligence
3 269 (35.12%) ETL
4 260 (33.94%) Agile Software Development
5 221 (28.85%) Data Modelling
6 166 (21.67%) DevOps
7 163 (21.28%) Data Science
8 142 (18.54%) Machine Learning
9 130 (16.97%) Visualisation
10 111 (14.49%) Data Engineering
11 98 (12.79%) Data Analytics
12 96 (12.53%) Stakeholder Management
13 94 (12.27%) Data Architecture
14 92 (12.01%) Problem-Solving
15 83 (10.84%) Data Management
16 73 (9.53%) Migration
17 66 (8.62%) Data Visualisation
18 62 (8.09%) Scrum
19 60 (7.83%) Data Strategy
19 60 (7.83%) Mentoring
Programming Languages
1 470 (61.36%) SQL
2 227 (29.63%) Python
3 105 (13.71%) T-SQL
4 85 (11.10%) R
5 77 (10.05%) Data Analysis Expressions (DAX)
6 70 (9.14%) Scala
7 57 (7.44%) Java
8 43 (5.61%) C#
9 36 (4.70%) PL/SQL
10 35 (4.57%) PowerShell
11 26 (3.39%) VBA
12 24 (3.13%) JavaScript
13 19 (2.48%) U-SQL
14 14 (1.83%) Shell Script
15 11 (1.44%) Bash Shell
16 8 (1.04%) C++
17 6 (0.78%) MATLAB
17 6 (0.78%) VBScript
18 4 (0.52%) C
18 4 (0.52%) Ruby
Qualifications
1 90 (11.75%) Degree
2 31 (4.05%) Computer Science Degree
3 16 (2.09%) Microsoft Certification
4 11 (1.44%) TOGAF Certification
5 6 (0.78%) MBA
5 6 (0.78%) MCSA
6 5 (0.65%) AWS Certification
6 5 (0.65%) Cisco Certification
6 5 (0.65%) Master's Degree
7 4 (0.52%) (ISC)2 CCSP
7 4 (0.52%) CCSP
7 4 (0.52%) CISSP
7 4 (0.52%) CompTIA Security+
7 4 (0.52%) MCSE
8 3 (0.39%) Numerate Degree
9 2 (0.26%) DBS Check
9 2 (0.26%) ITIL Certification
9 2 (0.26%) PhD
9 2 (0.26%) PMI Certification
9 2 (0.26%) PMP
Quality Assurance & Compliance
1 73 (9.53%) Data Quality
2 25 (3.26%) QA
3 13 (1.70%) SLA
4 9 (1.17%) GDPR
5 3 (0.39%) COBIT
6 2 (0.26%) ISO/IEC 27001
7 1 (0.13%) NIST
System Software
1 34 (4.44%) Docker
2 29 (3.79%) HDFS
3 26 (3.39%) Active Directory
4 18 (2.35%) Virtual Machines
5 15 (1.96%) Hyper-V
6 12 (1.57%) VMware Infrastructure
7 7 (0.91%) Apache Flume
8 6 (0.78%) Apache ZooKeeper
9 2 (0.26%) Firmware
9 2 (0.26%) XenApp
10 1 (0.13%) Virtual Servers
Systems Management
1 29 (3.79%) Kubernetes
2 26 (3.39%) Hadoop YARN
3 8 (1.04%) Terraform
4 7 (0.91%) Oozie
5 5 (0.65%) Ansible
5 5 (0.65%) Microsoft Intune
5 5 (0.65%) Opscode Chef
6 4 (0.52%) Puppet
6 4 (0.52%) Single Sign-On
7 3 (0.39%) Grafana
7 3 (0.39%) Prometheus
8 1 (0.13%) Chukwa
8 1 (0.13%) Control-M
8 1 (0.13%) Docker Swarm
Vendors
1 273 (35.64%) Microsoft
2 135 (17.62%) Databricks
3 71 (9.27%) Tableau
4 65 (8.49%) Informatica
5 63 (8.22%) Oracle
6 40 (5.22%) Google
7 36 (4.70%) Cloudera
8 35 (4.57%) Teradata
9 22 (2.87%) MuleSoft
10 19 (2.48%) Talend
11 18 (2.35%) VMware
12 17 (2.22%) Netezza
13 15 (1.96%) Ab Initio
14 10 (1.31%) SAP
15 9 (1.17%) Salesforce.com
16 8 (1.04%) MicroStrategy
17 7 (0.91%) Mapbox
17 7 (0.91%) Sybase
18 6 (0.78%) Apple
19 5 (0.65%) Red Hat