Period
to 7 December 2019

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 7 December 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > UK excluding London
6 months to
7 Dec 2019
Same period 2018 Same period 2017
Rank 506 637 793
Rank change year-on-year +131 +156 +118
Permanent jobs citing Data Lake 322 259 130
As % of all permanent IT jobs advertised in the UK excluding London 0.43% 0.29% 0.13%
As % of the Database & Business Intelligence category 1.63% 1.02% 0.42%
Number of salaries quoted 269 213 122
UK excluding London median annual salary £57,500 £62,138 £55,500
Median salary % change year-on-year -7.46% +11.96% +11.00%
10th Percentile £37,500 £37,600 £42,000
90th Percentile £85,000 £83,750 £74,500
UK median annual salary £65,000 £65,000 £62,500
% change year-on-year - +4.00% -16.67%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 19,714 25,376 31,060
As % of all permanent IT jobs advertised in the UK excluding London 26.06% 28.26% 30.93%
Number of salaries quoted 16,323 20,942 26,135
UK excluding London median annual salary £45,000 £45,000 £42,500
Median salary % change year-on-year - +5.88% -
10th Percentile £29,250 £28,500 £27,500
90th Percentile £67,500 £68,750 £62,500
UK median annual salary £52,500 £50,000 £48,000
% change year-on-year +5.00% +4.17% +1.05%

Data Lake
Job Vacancy Trend in the UK excluding London

Job postings citing Data Lake as a percentage of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Data Lake in the UK excluding London

Data Lake
Salary Trend in the UK excluding London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in the UK excluding London.

Salary trend for Data Lake in the UK excluding London

Data Lake
Salary Histogram in the UK excluding London

The salary distribution of IT jobs citing Data Lake in the UK excluding London over the 6 months to 7 December 2019.

Salary histogram for Data Lake in the UK excluding London

Data Lake
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK excluding London region over the 6 months to 7 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East +38 93 £62,500 -3.85% 31
North of England +103 72 £50,000 - 17
East of England +95 68 £47,500 -9.52% 6
South West +3 58 £58,500 -5.85% 7
North West +53 35 £50,000 -16.67% 11
Yorkshire +28 24 £45,412 -9.18% 6
Midlands +20 23 £53,750 -10.42% 4
East Midlands +29 16 £55,000 +10.00% 1
Scotland +25 13 £55,000 +18.92% 6
North East - 13 £42,943 -
West Midlands +9 7 £52,500 -18.90% 3
Wales - 1 - - 3
Data Lake
UK

For the 6 months to 7 December 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Data Lake.

1 199 (61.80%) Data Warehouse
2 185 (57.45%) Analytics
3 176 (54.66%) SQL
4 170 (52.80%) Azure
5 158 (49.07%) Business Intelligence
6 131 (40.68%) Agile Software Development
7 116 (36.02%) Big Data
8 109 (33.85%) ETL
9 102 (31.68%) Python
10 99 (30.75%) Microsoft
11 98 (30.43%) Power BI
11 98 (30.43%) Power Platform
12 96 (29.81%) Data Modelling
13 93 (28.88%) SQL Server
14 86 (26.71%) SQL Server Integration Services
15 77 (23.91%) Hadoop
16 72 (22.36%) Apache Spark
16 72 (22.36%) Finance
17 71 (22.05%) DevOps
18 65 (20.19%) AWS
19 64 (19.88%) Azure SQL Data Warehouse
20 62 (19.25%) Data Science
21 61 (18.94%) Data Engineering
21 61 (18.94%) Informatica
22 59 (18.32%) Visualisation
23 55 (17.08%) Machine Learning
24 53 (16.46%) Azure Data Factory
25 52 (16.15%) Retail
25 52 (16.15%) Data Management
26 51 (15.84%) Analytical Skills

Data Lake
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 72 (22.36%) Apache Spark
2 20 (6.21%) Apache
3 6 (1.86%) SharePoint
4 5 (1.55%) Confluence
5 3 (0.93%) Elasticsearch
5 3 (0.93%) SAS
6 2 (0.62%) Apache Solr
7 1 (0.31%) ArcGIS
7 1 (0.31%) Jupyter
Applications
1 17 (5.28%) Spreadsheet
2 16 (4.97%) Microsoft Excel
3 3 (0.93%) Microsoft Office
4 2 (0.62%) SPSS
5 1 (0.31%) MS Visio
Business Applications
1 2 (0.62%) Sparx Enterprise Architect
2 1 (0.31%) HFM
2 1 (0.31%) Oracle 11i
2 1 (0.31%) Oracle EBS R12
Cloud Services
1 170 (52.80%) Azure
2 98 (30.43%) Power Platform
3 65 (20.19%) AWS
4 53 (16.46%) Azure Data Factory
5 35 (10.87%) PaaS
6 28 (8.70%) IaaS
7 25 (7.76%) GCP
8 18 (5.59%) Data Lake Analytics
9 16 (4.97%) Serverless
10 11 (3.42%) SaaS
11 9 (2.80%) Amazon Kinesis
12 7 (2.17%) Amazon S3
12 7 (2.17%) Azure Functions
13 6 (1.86%) AWS Lambda
14 4 (1.24%) Amazon EMR
15 3 (0.93%) Amazon SageMaker
15 3 (0.93%) AWS CloudFormation
15 3 (0.93%) Azure Active Directory
15 3 (0.93%) Cloud Computing
16 2 (0.62%) Amazon EC2
Communications & Networking
1 5 (1.55%) Internet
2 2 (0.62%) VPN
3 1 (0.31%) SAN
3 1 (0.31%) Skype
Database & Business Intelligence
1 199 (61.80%) Data Warehouse
2 116 (36.02%) Big Data
3 98 (30.43%) Power BI
4 93 (28.88%) SQL Server
5 86 (26.71%) SQL Server Integration Services
6 77 (23.91%) Hadoop
7 64 (19.88%) Azure SQL Data Warehouse
8 39 (12.11%) SQL Server Reporting Services
9 37 (11.49%) Apache Hive
10 30 (9.32%) SQL Server Analysis Services
11 27 (8.39%) Relational Database
12 21 (6.52%) Azure SQL Database
13 19 (5.90%) DataStage
13 19 (5.90%) NoSQL
13 19 (5.90%) Sqoop
14 17 (5.28%) PowerPivot
15 16 (4.97%) Amazon Redshift
15 16 (4.97%) HDInsight
16 13 (4.04%) Oracle Database
17 11 (3.42%) BigQuery
Development Applications
1 22 (6.83%) Jenkins
2 21 (6.52%) JIRA
2 21 (6.52%) Visual Studio
3 19 (5.90%) Git (software)
4 17 (5.28%) ERwin
5 14 (4.35%) Visual Studio Team System
6 13 (4.04%) Cucumber
6 13 (4.04%) Team Foundation Server
7 9 (2.80%) Selenium
8 6 (1.86%) HP UFT
9 3 (0.93%) Octopus Deploy
10 2 (0.62%) Bitbucket
10 2 (0.62%) TeamCity
11 1 (0.31%) ESLint
11 1 (0.31%) git-flow
11 1 (0.31%) ProC
11 1 (0.31%) Sinon.JS
11 1 (0.31%) webpack
General
1 72 (22.36%) Finance
2 52 (16.15%) Retail
3 11 (3.42%) Marketing
4 9 (2.80%) Pharmaceutical
4 9 (2.80%) Public Sector
5 5 (1.55%) Legal
5 5 (1.55%) Telecoms
6 2 (0.62%) Manufacturing
7 1 (0.31%) Banking
7 1 (0.31%) Electronics
7 1 (0.31%) Multimedia
7 1 (0.31%) Police
Job Titles
1 78 (24.22%) Developer
2 77 (23.91%) Data Engineer
3 48 (14.91%) Architect
4 38 (11.80%) Analyst
5 37 (11.49%) Data Architect
6 35 (10.87%) Business Intelligence Developer
7 22 (6.83%) Azure Developer
8 20 (6.21%) Business Intelligence Analyst
9 19 (5.90%) DevOps Engineer
10 17 (5.28%) Enterprise Architect
11 16 (4.97%) Senior Data Engineer
12 15 (4.66%) Big Data Engineer
12 15 (4.66%) Technical Leader
13 14 (4.35%) Power BI Developer
14 12 (3.73%) Data Analyst
14 12 (3.73%) Enterprise Data Architect
14 12 (3.73%) Lead DevOps
15 11 (3.42%) ETL Developer
16 10 (3.11%) Data Scientist
16 10 (3.11%) SQL Analyst
Libraries, Frameworks & Software Standards
1 27 (8.39%) Kafka
2 10 (3.11%) .NET
3 9 (2.80%) Velocity
4 6 (1.86%) .NET Core
4 6 (1.86%) Natural Language Processing
4 6 (1.86%) Pandas
4 6 (1.86%) Web Services
5 5 (1.55%) MDX
5 5 (1.55%) React
6 4 (1.24%) AngularJS
6 4 (1.24%) Node.js
7 3 (0.93%) Apache Beam
7 3 (0.93%) Apache NiFi
7 3 (0.93%) JSON
7 3 (0.93%) XML
7 3 (0.93%) YAML
8 2 (0.62%) MLlib
8 2 (0.62%) NumPy
9 1 (0.31%) Spark Streaming
9 1 (0.31%) Swagger
Miscellaneous
1 51 (15.84%) Analytical Skills
2 15 (4.66%) Greenfield Project
3 11 (3.42%) Data Centre
4 9 (2.80%) Algorithms
4 9 (2.80%) BBC
4 9 (2.80%) Data Structures
4 9 (2.80%) Management Information System
5 6 (1.86%) Hybrid Cloud
5 6 (1.86%) Marketing Technology
6 5 (1.55%) Reinsurance
6 5 (1.55%) Tandem
7 4 (1.24%) Cloud Native
7 4 (1.24%) Replication
8 3 (0.93%) Enterprise Software
8 3 (0.93%) Public Cloud
9 2 (0.62%) Internet of Things
9 2 (0.62%) Smart Meter
10 1 (0.31%) Data Protection Act
10 1 (0.31%) Mobile App
10 1 (0.31%) Reference Data
Operating Systems
1 19 (5.90%) Windows
2 8 (2.48%) Unix
3 6 (1.86%) Linux
4 4 (1.24%) Windows Server
5 2 (0.62%) Red Hat Enterprise Linux
Processes & Methodologies
1 185 (57.45%) Analytics
2 158 (49.07%) Business Intelligence
3 131 (40.68%) Agile Software Development
4 109 (33.85%) ETL
5 96 (29.81%) Data Modelling
6 71 (22.05%) DevOps
7 62 (19.25%) Data Science
8 61 (18.94%) Data Engineering
9 59 (18.32%) Visualisation
10 55 (17.08%) Machine Learning
11 52 (16.15%) Data Management
12 47 (14.60%) Stakeholder Management
13 42 (13.04%) Data Architecture
14 37 (11.49%) Artificial Intelligence
14 37 (11.49%) Mentoring
15 34 (10.56%) Data Strategy
16 32 (9.94%) Data Transformation
17 31 (9.63%) Continuous Improvement
18 30 (9.32%) Scrum
19 28 (8.70%) Kimball Methodology
Programming Languages
1 176 (54.66%) SQL
2 102 (31.68%) Python
3 45 (13.98%) Scala
4 41 (12.73%) T-SQL
5 40 (12.42%) R
6 30 (9.32%) Data Analysis Expressions (DAX)
7 22 (6.83%) Java
7 22 (6.83%) PowerShell
8 20 (6.21%) VBA
9 19 (5.90%) C#
10 16 (4.97%) PL/SQL
11 12 (3.73%) Shell Script
12 8 (2.48%) JavaScript
13 7 (2.17%) Bash Shell
14 5 (1.55%) C++
15 4 (1.24%) Ruby
15 4 (1.24%) U-SQL
16 2 (0.62%) Go
17 1 (0.31%) C
Qualifications
1 21 (6.52%) Degree
2 6 (1.86%) TOGAF Certification
3 5 (1.55%) Master's Degree
4 3 (0.93%) AWS Certification
5 2 (0.62%) Microsoft Certification
5 2 (0.62%) Numerate Degree
5 2 (0.62%) PhD
6 1 (0.31%) Cisco Certification
6 1 (0.31%) ISEB
6 1 (0.31%) ISTQB
6 1 (0.31%) ISTQB Foundation Certification
6 1 (0.31%) ITIL Certification
6 1 (0.31%) SC Cleared
6 1 (0.31%) Security Cleared
Quality Assurance & Compliance
1 49 (15.22%) Data Quality
2 16 (4.97%) QA
3 13 (4.04%) SLA
4 3 (0.93%) GDPR
5 2 (0.62%) ISO/IEC 27001
6 1 (0.31%) NIST
System Software
1 14 (4.35%) Docker
2 6 (1.86%) HDFS
3 4 (1.24%) Active Directory
4 3 (0.93%) Apache Flume
4 3 (0.93%) Apache ZooKeeper
4 3 (0.93%) Virtual Machines
5 2 (0.62%) Firmware
5 2 (0.62%) Hyper-V
5 2 (0.62%) VMware Infrastructure
6 1 (0.31%) Virtual Servers
Systems Management
1 9 (2.80%) Kubernetes
2 6 (1.86%) Hadoop YARN
3 5 (1.55%) Terraform
4 3 (0.93%) Ansible
4 3 (0.93%) Grafana
4 3 (0.93%) Oozie
4 3 (0.93%) Prometheus
5 1 (0.31%) Chukwa
5 1 (0.31%) Control-M
5 1 (0.31%) Microsoft Intune
5 1 (0.31%) Opscode Chef
5 1 (0.31%) Puppet
Vendors
1 99 (30.75%) Microsoft
2 61 (18.94%) Informatica
3 33 (10.25%) Databricks
3 33 (10.25%) Oracle
4 26 (8.07%) Teradata
5 25 (7.76%) Tableau
6 23 (7.14%) Cloudera
7 18 (5.59%) Google
8 15 (4.66%) Ab Initio
9 14 (4.35%) Talend
10 9 (2.80%) Netezza
11 7 (2.17%) SAP
12 5 (1.55%) VMware
13 4 (1.24%) Apple
14 3 (0.93%) Citrix
15 2 (0.62%) Hortonworks
15 2 (0.62%) Red Hat
15 2 (0.62%) Sparx
16 1 (0.31%) Alteryx
16 1 (0.31%) StreamSets