Period
to 28 February 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 28 February 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
28 Feb 2020
Same period 2019 Same period 2018
Rank 421 557 669
Rank change year-on-year +136 +112 +392
Permanent jobs citing Data Lake 835 683 606
As % of all permanent IT jobs advertised in the UK 0.68% 0.45% 0.34%
As % of the Database & Business Intelligence category 2.54% 1.58% 1.13%
Number of salaries quoted 594 548 477
UK median annual salary £70,000 £64,733 £62,500
Median salary % change year-on-year +8.14% +3.57% -10.71%
10th Percentile £43,796 £42,500 £47,000
90th Percentile £95,000 £101,250 £100,000
UK excluding London median annual salary £59,000 £62,138 £57,500
% change year-on-year -5.05% +8.07% +4.55%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 32,928 43,205 53,832
As % of all permanent IT jobs advertised in the UK 26.78% 28.61% 30.55%
Number of salaries quoted 26,984 35,555 44,968
UK median annual salary £52,500 £52,000 £50,000
Median salary % change year-on-year +0.96% +4.00% +5.26%
10th Percentile £32,500 £31,250 £30,000
90th Percentile £88,750 £85,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

The salary distribution of IT jobs citing Data Lake over the 6 months to 28 February 2020.

Salary histogram for Data Lake in the UK

Data Lake
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 28 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +139 803 £70,000 +8.14% 154
London +138 546 £72,500 +8.21% 83
UK excluding London +75 271 £59,000 -5.05% 74
South East +40 102 £65,000 +1.56% 28
North of England +107 66 £50,000 -9.09% 15
East of England +56 46 £59,000 -1.67% 7
North West +68 40 £50,000 -4.76% 6
South West +9 27 £50,500 -18.73% 7
Midlands +40 22 £52,500 -18.90% 14
Yorkshire +41 21 £60,000 +5.86% 7
West Midlands +43 12 £52,500 -19.23% 11
Scotland +37 12 £51,250 -12.77% 2
East Midlands +30 10 £65,000 +44.44% 3
North East - 5 £40,177 - 2
Channel Islands - 1 - -
Wales - 1 - - 1

For the 6 months to 28 February 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 614 (73.53%) SQL
2 505 (60.48%) Business Intelligence
2 505 (60.48%) Analytics
3 460 (55.09%) Azure
4 436 (52.22%) Data Warehouse
5 394 (47.19%) SQL Server
6 390 (46.71%) ETL
7 305 (36.53%) Python
8 277 (33.17%) Power Platform
9 273 (32.69%) Power BI
10 267 (31.98%) Agile Software Development
11 259 (31.02%) Big Data
12 245 (29.34%) Microsoft
13 234 (28.02%) Analytical Skills
14 225 (26.95%) Data Analytics
15 220 (26.35%) Tableau
15 220 (26.35%) Data Modelling
16 184 (22.04%) Visualisation
17 183 (21.92%) Oracle
17 183 (21.92%) Finance
18 181 (21.68%) Degree
19 176 (21.08%) Azure Data Factory
20 170 (20.36%) Azure SQL Database
21 169 (20.24%) Data Analysis
22 167 (20.00%) AWS
23 161 (19.28%) Data Science
24 160 (19.16%) Databricks
25 151 (18.08%) SQL Server Integration Services
26 148 (17.72%) DevOps
27 140 (16.77%) Machine Learning

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 131 (15.69%) Apache Spark
2 35 (4.19%) Apache
3 24 (2.87%) Apache Airflow
4 18 (2.16%) IIS
5 12 (1.44%) Anypoint
5 12 (1.44%) Confluence
5 12 (1.44%) Elasticsearch
6 10 (1.20%) SAS
7 6 (0.72%) Jupyter
8 5 (0.60%) Oracle Workflow
8 5 (0.60%) SharePoint
9 4 (0.48%) Apache Solr
10 3 (0.36%) Apache Pig
11 2 (0.24%) Oracle SOA Suite
12 1 (0.12%) ArcGIS
Applications
1 25 (2.99%) Microsoft Excel
2 19 (2.28%) Microsoft Office
3 1 (0.12%) MS Visio
Business Applications
1 7 (0.84%) Sparx Enterprise Architect
2 2 (0.24%) Dynamics CRM
2 2 (0.24%) NetSuite
3 1 (0.12%) SimCorp Dimension
Cloud Services
1 460 (55.09%) Azure
2 277 (33.17%) Power Platform
3 176 (21.08%) Azure Data Factory
4 167 (20.00%) AWS
5 89 (10.66%) GCP
6 70 (8.38%) PaaS
7 59 (7.07%) Serverless
8 48 (5.75%) Data Lake Analytics
9 38 (4.55%) IaaS
10 36 (4.31%) SaaS
11 31 (3.71%) Amazon S3
12 30 (3.59%) Amazon Kinesis
12 30 (3.59%) Azure Active Directory
12 30 (3.59%) Azure Functions
13 26 (3.11%) Amazon EMR
14 24 (2.87%) GitHub
15 21 (2.51%) Azure Machine Learning
16 15 (1.80%) Dynamics 365
17 14 (1.68%) Office 365
18 11 (1.32%) AWS Lambda
Communications & Networking
1 5 (0.60%) Skype
2 2 (0.24%) Internet
3 1 (0.12%) Firewall
3 1 (0.12%) LAN
3 1 (0.12%) SAN
3 1 (0.12%) TCP/IP
3 1 (0.12%) VLAN
3 1 (0.12%) VPN
3 1 (0.12%) WAN
3 1 (0.12%) Wi-Fi
Database & Business Intelligence
1 436 (52.22%) Data Warehouse
2 394 (47.19%) SQL Server
3 273 (32.69%) Power BI
4 259 (31.02%) Big Data
5 170 (20.36%) Azure SQL Database
6 151 (18.08%) SQL Server Integration Services
7 128 (15.33%) Azure SQL Data Warehouse
8 116 (13.89%) Hadoop
8 116 (13.89%) SQL Server Analysis Services
9 93 (11.14%) SQL Server Reporting Services
10 81 (9.70%) NoSQL
11 75 (8.98%) Amazon Redshift
12 59 (7.07%) Oracle Reports
13 56 (6.71%) Apache Hive
13 56 (6.71%) Microsoft Analysis Services
13 56 (6.71%) Snowflake Schema
14 49 (5.87%) Cosmos DB
15 36 (4.31%) Relational Database
16 33 (3.95%) Impala
16 33 (3.95%) MongoDB
Development Applications
1 56 (6.71%) Git (software)
2 27 (3.23%) Visual Studio
3 24 (2.87%) Visual Studio Team System
4 17 (2.04%) JIRA
5 12 (1.44%) Jenkins
6 9 (1.08%) Octopus Deploy
7 8 (0.96%) ERwin
7 8 (0.96%) TeamCity
8 5 (0.60%) Travis CI
9 4 (0.48%) Subversion
9 4 (0.48%) Team Foundation Server
10 3 (0.36%) Bitbucket
11 2 (0.24%) Atlassian Bamboo
11 2 (0.24%) ER Studio
11 2 (0.24%) SQL Server Management Studio (SSMS)
12 1 (0.12%) CircleCI
12 1 (0.12%) GoCD
12 1 (0.12%) Liquibase
12 1 (0.12%) SonarQube
12 1 (0.12%) Spock
General
1 183 (21.92%) Finance
2 82 (9.82%) Legal
3 33 (3.95%) Retail
4 31 (3.71%) Marketing
5 21 (2.51%) Banking
6 16 (1.92%) Publishing
7 15 (1.80%) Public Sector
8 9 (1.08%) Financial Institution
9 8 (0.96%) Advertising
9 8 (0.96%) Automotive
10 7 (0.84%) Telecoms
11 6 (0.72%) Manufacturing
12 5 (0.60%) Games
12 5 (0.60%) Police
13 4 (0.48%) Investment Banking
14 3 (0.36%) Front Office
15 2 (0.24%) Pharmaceutical
16 1 (0.12%) Back Office
16 1 (0.12%) Electronics
16 1 (0.12%) General Ledger
Job Titles
1 211 (25.27%) Data Engineer
2 179 (21.44%) Developer
3 163 (19.52%) Architect
4 145 (17.37%) Analyst
5 110 (13.17%) Data Analyst
6 97 (11.62%) Data Architect
7 84 (10.06%) Azure Engineer
8 74 (8.86%) SQL Developer
9 60 (7.19%) Senior Data Engineer
10 57 (6.83%) Business Intelligence Developer
10 57 (6.83%) Senior Analyst
11 52 (6.23%) Azure Developer
12 49 (5.87%) Data Manager
13 47 (5.63%) Solutions Architect
14 40 (4.79%) SQL Server Developer
15 38 (4.55%) Senior Data Analyst
16 36 (4.31%) Consultant
16 36 (4.31%) Senior Developer
17 34 (4.07%) Cloud Architect
18 32 (3.83%) SQL BI Developer
Libraries, Frameworks & Software Standards
1 74 (8.86%) Kafka
2 60 (7.19%) .NET
3 30 (3.59%) Web Services
4 29 (3.47%) MDX
5 21 (2.51%) HTML
6 16 (1.92%) XML
7 15 (1.80%) JSON
8 14 (1.68%) .NET Core
8 14 (1.68%) .NET Framework
8 14 (1.68%) ASP.NET
8 14 (1.68%) Entity Framework
9 13 (1.56%) Lambda Expressions
10 11 (1.32%) Natural Language Processing
11 10 (1.20%) Apache Avro
11 10 (1.20%) Node.js
11 10 (1.20%) React
12 9 (1.08%) PySpark
13 8 (0.96%) AngularJS
13 8 (0.96%) HTML5
14 7 (0.84%) CSS
Miscellaneous
1 234 (28.02%) Analytical Skills
2 48 (5.75%) Greenfield Project
3 35 (4.19%) Algorithms
3 35 (4.19%) Management Information System
4 29 (3.47%) Data Structures
5 17 (2.04%) Cloud Native
6 16 (1.92%) Reinsurance
7 13 (1.56%) Clustering
7 13 (1.56%) Enterprise Software
8 12 (1.44%) Marketing Technology
8 12 (1.44%) Self-Motivation
9 11 (1.32%) Tandem
10 10 (1.20%) BBC
11 8 (0.96%) Hybrid Cloud
12 7 (0.84%) Cyberthreat
12 7 (0.84%) Private Cloud
12 7 (0.84%) Public Cloud
13 6 (0.72%) Analytical Mindset
13 6 (0.72%) Social Media
13 6 (0.72%) Virtual Team
Operating Systems
1 41 (4.91%) Windows
2 33 (3.95%) Windows Server
3 13 (1.56%) Windows 10
4 11 (1.32%) Unix
5 7 (0.84%) Linux
6 6 (0.72%) Windows 7
Processes & Methodologies
1 505 (60.48%) Analytics
1 505 (60.48%) Business Intelligence
2 390 (46.71%) ETL
3 267 (31.98%) Agile Software Development
4 225 (26.95%) Data Analytics
5 220 (26.35%) Data Modelling
6 184 (22.04%) Visualisation
7 169 (20.24%) Data Analysis
8 161 (19.28%) Data Science
9 148 (17.72%) DevOps
10 140 (16.77%) Machine Learning
11 135 (16.17%) Data Extraction
12 128 (15.33%) Proactive Monitoring
13 123 (14.73%) Data Engineering
14 108 (12.93%) Data Architecture
15 96 (11.50%) User Acceptance Testing
16 86 (10.30%) Migration
17 82 (9.82%) Project Management
18 79 (9.46%) Problem-Solving
19 73 (8.74%) Data Visualisation
Programming Languages
1 614 (73.53%) SQL
2 305 (36.53%) Python
3 91 (10.90%) T-SQL
4 84 (10.06%) Scala
5 80 (9.58%) R
6 78 (9.34%) Java
7 74 (8.86%) C#
8 41 (4.91%) PowerShell
9 32 (3.83%) Data Analysis Expressions (DAX)
10 31 (3.71%) JavaScript
11 27 (3.23%) U-SQL
12 23 (2.75%) PL/SQL
13 13 (1.56%) VBA
14 10 (1.20%) Bash Shell
15 9 (1.08%) C
16 8 (0.96%) VB.NET
17 7 (0.84%) C++
17 7 (0.84%) PHP
17 7 (0.84%) Ruby
18 6 (0.72%) Shell Script
Qualifications
1 181 (21.68%) Degree
2 21 (2.51%) Computer Science Degree
3 19 (2.28%) Microsoft Certification
4 8 (0.96%) Cisco Certification
5 7 (0.84%) (ISC)2 CCSP
5 7 (0.84%) CCSP
5 7 (0.84%) CISSP
5 7 (0.84%) CompTIA Security+
6 6 (0.72%) MBA
6 6 (0.72%) Security Cleared
7 5 (0.60%) Master's Degree
7 5 (0.60%) SC Cleared
8 3 (0.36%) PMI Certification
8 3 (0.36%) PMP
9 2 (0.24%) PhD
10 1 (0.12%) ISEB
10 1 (0.12%) ISTQB
10 1 (0.12%) ISTQB Foundation Certification
10 1 (0.12%) PRINCE2 Certification
10 1 (0.12%) TOGAF Certification
Quality Assurance & Compliance
1 88 (10.54%) Data Quality
2 59 (7.07%) GAAP
3 22 (2.63%) QA
4 15 (1.80%) GDPR
5 3 (0.36%) COBIT
5 3 (0.36%) SLA
6 2 (0.24%) EMIR
6 2 (0.24%) IFRS
6 2 (0.24%) ISO/IEC 27001
6 2 (0.24%) MiFID
7 1 (0.12%) NIST
System Software
1 33 (3.95%) Docker
2 29 (3.47%) Active Directory
3 20 (2.40%) Virtual Machines
4 19 (2.28%) HDFS
5 15 (1.80%) Hyper-V
6 14 (1.68%) VMware Infrastructure
7 10 (1.20%) Apache ZooKeeper
8 5 (0.60%) Apache Flume
Systems Management
1 35 (4.19%) Kubernetes
2 22 (2.63%) Hadoop YARN
3 18 (2.16%) Terraform
4 13 (1.56%) Oozie
5 8 (0.96%) Microsoft Intune
5 8 (0.96%) Puppet
6 7 (0.84%) Ansible
6 7 (0.84%) Single Sign-On
7 6 (0.72%) Opscode Chef
7 6 (0.72%) Rancher
8 2 (0.24%) Kibana
8 2 (0.24%) Prometheus
9 1 (0.12%) Control-M
9 1 (0.12%) Grafana
9 1 (0.12%) ZABBIX
Vendors
1 245 (29.34%) Microsoft
2 220 (26.35%) Tableau
3 183 (21.92%) Oracle
4 160 (19.16%) Databricks
5 132 (15.81%) Alteryx
6 123 (14.73%) Teradata
7 119 (14.25%) Automation Anywhere
7 119 (14.25%) Blue Prism
7 119 (14.25%) Cadence
7 119 (14.25%) UiPath
8 42 (5.03%) Informatica
9 40 (4.79%) Google
10 24 (2.87%) Cloudera
11 23 (2.75%) Talend
12 19 (2.28%) VMware
13 16 (1.92%) Salesforce.com
14 12 (1.44%) MuleSoft
15 11 (1.32%) Hortonworks
16 10 (1.20%) Netezza
17 9 (1.08%) Sybase