Period
to 22 September 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 22 September 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
22 Sep 2019
Same period 2018 Same period 2017
Rank 474 585 925
Rank change year-on-year +111 +340 +253
Permanent jobs citing Data Lake 853 722 288
As % of all permanent IT jobs advertised in the UK 0.61% 0.43% 0.16%
As % of the Database & Business Intelligence category 2.27% 1.46% 0.53%
Number of salaries quoted 687 529 239
UK median annual salary £65,000 £65,000 £60,000
Median salary % change year-on-year - +8.33% -22.58%
10th Percentile £41,383 £45,000 £41,100
90th Percentile £100,000 £97,500 £100,000
UK excluding London median annual salary £55,000 £58,750 £53,750
% change year-on-year -6.38% +9.30% +10.26%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 37,647 49,485 54,024
As % of all permanent IT jobs advertised in the UK 27.06% 29.72% 30.57%
Number of salaries quoted 30,738 40,368 44,486
UK median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,250 £31,250 £30,000
90th Percentile £85,000 £82,500 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% +2.41%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

The salary distribution of IT jobs citing Data Lake over the 6 months to 22 September 2019.

Salary histogram for Data Lake in the UK

Data Lake
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 22 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +116 826 £65,000 - 109
London +41 458 £72,500 +3.57% 54
UK excluding London +221 377 £55,000 -6.38% 60
South East +68 117 £62,500 -3.85% 26
South West +65 78 £61,500 -19.34% 4
North of England +46 69 £45,412 -24.31% 16
East of England +101 58 £45,000 -18.18% 5
Midlands +25 41 £55,500 +11.00% 4
East Midlands +39 31 £55,000 +7.32% 2
Yorkshire +7 26 £45,000 -25.00% 2
North West +33 24 £50,000 -16.67% 13
North East - 19 £45,412 - 1
Scotland +18 14 £51,500 +9.57% 5
West Midlands +15 10 £65,000 +36.84% 2

For the 6 months to 22 September 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 579 (67.88%) Data Warehouse
2 538 (63.07%) Azure
3 506 (59.32%) SQL
4 493 (57.80%) Analytics
5 469 (54.98%) Business Intelligence
6 356 (41.74%) Agile Software Development
7 349 (40.91%) Big Data
8 345 (40.45%) Microsoft
9 318 (37.28%) Power BI
9 318 (37.28%) Power Platform
10 311 (36.46%) Python
11 298 (34.94%) ETL
12 297 (34.82%) SQL Server
13 277 (32.47%) Data Modelling
14 249 (29.19%) SQL Server Integration Services
15 248 (29.07%) Azure Data Factory
16 247 (28.96%) Finance
17 216 (25.32%) Databricks
18 209 (24.50%) SQL Server Analysis Services
19 207 (24.27%) DevOps
20 191 (22.39%) Azure SQL Database
21 189 (22.16%) Hadoop
22 179 (20.98%) Data Science
23 178 (20.87%) SQL Server Reporting Services
24 176 (20.63%) Azure SQL Data Warehouse
25 164 (19.23%) AWS
26 154 (18.05%) Apache Spark
27 148 (17.35%) Data Analytics
28 141 (16.53%) Data Analysis Expressions (DAX)
29 137 (16.06%) Machine Learning

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (18.05%) Apache Spark
2 46 (5.39%) Apache
3 20 (2.34%) SAS
4 18 (2.11%) Apache Pig
5 11 (1.29%) Apache Solr
6 9 (1.06%) Elasticsearch
7 8 (0.94%) IIS
7 8 (0.94%) SharePoint
8 7 (0.82%) Apache Airflow
8 7 (0.82%) ArcGIS
9 6 (0.70%) BizTalk Server
10 4 (0.47%) Anypoint
10 4 (0.47%) Confluence
11 1 (0.12%) Jupyter
Applications
1 17 (1.99%) Spreadsheet
2 15 (1.76%) Microsoft Excel
3 12 (1.41%) Microsoft Office
4 9 (1.06%) SPSS
5 2 (0.23%) Chatbot
5 2 (0.23%) MS Visio
Business Applications
1 2 (0.23%) HFM
1 2 (0.23%) Markit EDM
1 2 (0.23%) Oracle 11i
1 2 (0.23%) Oracle EBS R12
1 2 (0.23%) Sparx Enterprise Architect
2 1 (0.12%) Infor M3
2 1 (0.12%) Workday HCM
Cloud Services
1 538 (63.07%) Azure
2 318 (37.28%) Power Platform
3 248 (29.07%) Azure Data Factory
4 164 (19.23%) AWS
5 59 (6.92%) Serverless
6 56 (6.57%) PaaS
7 52 (6.10%) GCP
8 42 (4.92%) Data Lake Analytics
9 34 (3.99%) Azure Machine Learning
10 32 (3.75%) IaaS
11 31 (3.63%) Amazon S3
12 29 (3.40%) Azure Functions
13 25 (2.93%) Cortana Intelligence Suite
14 24 (2.81%) Azure Active Directory
15 23 (2.70%) SaaS
16 21 (2.46%) Amazon EMR
17 20 (2.34%) npm
18 17 (1.99%) Amazon Kinesis
19 11 (1.29%) AWS Lambda
19 11 (1.29%) PowerApps
Communications & Networking
1 11 (1.29%) Broadband
2 4 (0.47%) Internet
3 3 (0.35%) VPN
4 1 (0.12%) DHCP
4 1 (0.12%) DNS
4 1 (0.12%) Firewall
4 1 (0.12%) FTP
4 1 (0.12%) HTTP
4 1 (0.12%) HTTPS
4 1 (0.12%) SMTP
4 1 (0.12%) SSL
4 1 (0.12%) Telnet
Database & Business Intelligence
1 579 (67.88%) Data Warehouse
2 349 (40.91%) Big Data
3 318 (37.28%) Power BI
4 297 (34.82%) SQL Server
5 249 (29.19%) SQL Server Integration Services
6 209 (24.50%) SQL Server Analysis Services
7 191 (22.39%) Azure SQL Database
8 189 (22.16%) Hadoop
9 178 (20.87%) SQL Server Reporting Services
10 176 (20.63%) Azure SQL Data Warehouse
11 126 (14.77%) NoSQL
12 98 (11.49%) Microsoft Analysis Services
13 88 (10.32%) Apache Hive
14 76 (8.91%) Cosmos DB
15 63 (7.39%) Relational Database
16 45 (5.28%) Amazon Redshift
17 42 (4.92%) MongoDB
18 40 (4.69%) Geospatial Data
18 40 (4.69%) HDInsight
19 39 (4.57%) Apache Cassandra
Development Applications
1 61 (7.15%) Git (software)
2 39 (4.57%) Visual Studio
3 38 (4.45%) Jenkins
4 27 (3.17%) JIRA
5 25 (2.93%) Team Foundation Server
6 24 (2.81%) Visual Studio Team System
7 23 (2.70%) ERwin
8 22 (2.58%) Cucumber
9 16 (1.88%) Octopus Deploy
10 14 (1.64%) Selenium
11 13 (1.52%) Subversion
12 12 (1.41%) TeamCity
13 11 (1.29%) Sinon.JS
13 11 (1.29%) webpack
14 10 (1.17%) git-flow
15 8 (0.94%) ER Studio
15 8 (0.94%) HP UFT
16 7 (0.82%) PowerDesigner
17 3 (0.35%) Hudson
17 3 (0.35%) SQL Server Management Studio (SSMS)
General
1 247 (28.96%) Finance
2 88 (10.32%) Retail
3 39 (4.57%) Banking
4 16 (1.88%) Marketing
5 14 (1.64%) Advertising
6 13 (1.52%) Pharmaceutical
7 11 (1.29%) Public Sector
8 8 (0.94%) Telecoms
9 6 (0.70%) Legal
10 5 (0.59%) Games
11 4 (0.47%) Investment Banking
11 4 (0.47%) Law
11 4 (0.47%) Publishing
12 3 (0.35%) Front Office
13 2 (0.23%) Automotive
13 2 (0.23%) General Ledger
14 1 (0.12%) Back Office
14 1 (0.12%) Manufacturing
14 1 (0.12%) Multimedia
Job Titles
1 253 (29.66%) Developer
2 175 (20.52%) Data Engineer
3 153 (17.94%) Architect
4 147 (17.23%) Business Intelligence Developer
5 104 (12.19%) Data Architect
6 85 (9.96%) SQL Developer
7 73 (8.56%) Analyst
7 73 (8.56%) Azure Developer
8 69 (8.09%) SQL BI Developer
9 52 (6.10%) Business Intelligence Lead
9 52 (6.10%) Senior Developer
10 51 (5.98%) Power BI Developer
11 45 (5.28%) Database Developer
11 45 (5.28%) SQL Database Developer
12 39 (4.57%) Big Data Engineer
12 39 (4.57%) Data Analyst
12 39 (4.57%) Enterprise Architect
12 39 (4.57%) Lead Developer
12 39 (4.57%) Senior Data Engineer
13 35 (4.10%) Senior Business Intelligence Developer
Libraries, Frameworks & Software Standards
1 99 (11.61%) MDX
2 65 (7.62%) Kafka
3 53 (6.21%) .NET
4 27 (3.17%) JSON
5 25 (2.93%) Apache NiFi
6 22 (2.58%) Web Services
7 20 (2.34%) XML
8 16 (1.88%) HTML
9 15 (1.76%) .NET Framework
10 14 (1.64%) REST
11 13 (1.52%) React
12 11 (1.29%) Jest
12 11 (1.29%) Natural Language Processing
12 11 (1.29%) Velocity
13 10 (1.17%) Pandas
14 9 (1.06%) Lambda Expressions
14 9 (1.06%) Node.js
14 9 (1.06%) RESTful
15 8 (0.94%) AngularJS
15 8 (0.94%) Spring
Miscellaneous
1 91 (10.67%) Analytical Skills
2 43 (5.04%) Management Information System
3 38 (4.45%) Greenfield Project
4 21 (2.46%) Algorithms
5 16 (1.88%) Data Centre
6 15 (1.76%) User Experience
7 14 (1.64%) Data Structures
8 10 (1.17%) Clustering
9 9 (1.06%) Cloud Native
10 8 (0.94%) Hybrid Cloud
11 7 (0.82%) Replication
12 6 (0.70%) Enterprise Cloud
12 6 (0.70%) Podcast
12 6 (0.70%) Public Cloud
13 5 (0.59%) Mobile App
13 5 (0.59%) Self-Motivation
14 4 (0.47%) Derivative
14 4 (0.47%) Online Games
14 4 (0.47%) Private Cloud
14 4 (0.47%) Robotics
Operating Systems
1 36 (4.22%) Windows
2 19 (2.23%) Linux
3 18 (2.11%) Windows Server
4 15 (1.76%) Unix
5 10 (1.17%) Windows 10
6 8 (0.94%) Red Hat Enterprise Linux
7 3 (0.35%) Windows 7
8 1 (0.12%) Windows Server 2008
8 1 (0.12%) Windows Server 2012
Processes & Methodologies
1 493 (57.80%) Analytics
2 469 (54.98%) Business Intelligence
3 356 (41.74%) Agile Software Development
4 298 (34.94%) ETL
5 277 (32.47%) Data Modelling
6 207 (24.27%) DevOps
7 179 (20.98%) Data Science
8 148 (17.35%) Data Analytics
9 137 (16.06%) Machine Learning
10 126 (14.77%) Data Architecture
11 125 (14.65%) Data Engineering
11 125 (14.65%) Visualisation
12 120 (14.07%) Scrum
13 117 (13.72%) Data Strategy
14 102 (11.96%) Kimball Methodology
15 95 (11.14%) Problem-Solving
15 95 (11.14%) Stakeholder Management
16 91 (10.67%) Data Management
17 72 (8.44%) Kanban
18 71 (8.32%) Data Integration
Programming Languages
1 506 (59.32%) SQL
2 311 (36.46%) Python
3 141 (16.53%) Data Analysis Expressions (DAX)
4 117 (13.72%) R
5 113 (13.25%) T-SQL
6 87 (10.20%) C#
7 79 (9.26%) Scala
8 60 (7.03%) Java
9 53 (6.21%) PowerShell
10 30 (3.52%) JavaScript
11 28 (3.28%) VBA
12 26 (3.05%) PL/SQL
13 23 (2.70%) U-SQL
14 12 (1.41%) Ruby
15 11 (1.29%) Go
16 8 (0.94%) Shell Script
16 8 (0.94%) VB.NET
17 6 (0.70%) F#
17 6 (0.70%) MATLAB
17 6 (0.70%) PHP
Qualifications
1 78 (9.14%) Degree
2 29 (3.40%) Computer Science Degree
3 21 (2.46%) TOGAF Certification
4 16 (1.88%) Microsoft Certification
5 9 (1.06%) CISSP
5 9 (1.06%) MCSA
6 8 (0.94%) AWS Certification
7 7 (0.82%) (ISC)2 CCSP
7 7 (0.82%) CCSP
7 7 (0.82%) Cisco Certification
7 7 (0.82%) CompTIA Security+
7 7 (0.82%) MCSE
7 7 (0.82%) PhD
8 5 (0.59%) ISTQB
9 3 (0.35%) MBA
9 3 (0.35%) Numerate Degree
10 2 (0.23%) CGEIT
10 2 (0.23%) CISA
10 2 (0.23%) CISM
10 2 (0.23%) ITIL Certification
Quality Assurance & Compliance
1 63 (7.39%) Data Quality
2 31 (3.63%) QA
3 19 (2.23%) GDPR
4 11 (1.29%) SLA
5 6 (0.70%) HIPAA
6 3 (0.35%) PCI DSS
7 2 (0.23%) ISO/IEC 27001
8 1 (0.12%) COBIT
8 1 (0.12%) NIST
System Software
1 43 (5.04%) Docker
2 24 (2.81%) HDFS
3 21 (2.46%) Active Directory
4 10 (1.17%) Virtual Machines
5 8 (0.94%) Apache Flume
6 6 (0.70%) Hyper-V
7 4 (0.47%) VMware Infrastructure
8 2 (0.23%) Firmware
8 2 (0.23%) XenApp
9 1 (0.12%) Apache ZooKeeper
9 1 (0.12%) Virtual Servers
Systems Management
1 24 (2.81%) Kubernetes
2 16 (1.88%) Opscode Chef
2 16 (1.88%) Terraform
3 15 (1.76%) Hadoop YARN
3 15 (1.76%) Puppet
4 7 (0.82%) Microsoft Intune
4 7 (0.82%) Single Sign-On
5 4 (0.47%) Chukwa
5 4 (0.47%) Grafana
5 4 (0.47%) Prometheus
6 2 (0.23%) Ansible
6 2 (0.23%) Oozie
7 1 (0.12%) Control-M
7 1 (0.12%) Docker Swarm
7 1 (0.12%) Kibana
Vendors
1 345 (40.45%) Microsoft
2 216 (25.32%) Databricks
3 92 (10.79%) Informatica
4 69 (8.09%) Oracle
5 65 (7.62%) Tableau
6 58 (6.80%) Teradata
7 40 (4.69%) Google
8 28 (3.28%) Cloudera
9 26 (3.05%) Ab Initio
10 20 (2.34%) Netezza
11 19 (2.23%) Hortonworks
12 16 (1.88%) MuleSoft
13 12 (1.41%) Talend
14 10 (1.17%) SAP
15 9 (1.06%) MicroStrategy
15 9 (1.06%) Salesforce.com
16 8 (0.94%) Red Hat
17 7 (0.82%) Mapbox
18 6 (0.70%) Cognos
18 6 (0.70%) MapR