Period
to 27 October 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 27 October 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
27 Oct 2020
Same period 2019 Same period 2018
Rank 266 477 581
Rank change year-on-year +211 +104 +319
Permanent jobs citing Data Lake 594 793 714
As % of all permanent jobs advertised in the UK 1.20% 0.58% 0.44%
As % of the Database & Business Intelligence category 4.21% 2.15% 1.48%
Number of salaries quoted 499 684 594
Median annual salary £65,000 £65,000 £65,000
10th Percentile £46,250 £42,325 £43,500
90th Percentile £95,000 £100,000 £100,000
UK excluding London median annual salary £55,000 £55,000 £60,000
% change year-on-year - -8.33% +7.14%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 14,095 36,912 48,401
As % of all permanent IT jobs advertised in the UK 28.48% 27.15% 29.59%
Number of salaries quoted 11,878 30,354 39,471
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +4.17%
10th Percentile £33,750 £31,250 £31,250
90th Percentile £88,750 £86,250 £82,500
UK excluding London median annual salary £48,000 £45,000 £45,000
% change year-on-year +6.67% - +5.88%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 27 October 2020.

Salary histogram for Data Lake in the UK

Data Lake
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 27 October 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +206 569 £65,000 - 69
London +138 300 £75,000 +3.45% 28
UK excluding London +239 284 £55,000 - 45
North of England +192 105 £55,000 +10.00% 22
North West +174 79 £67,500 +35.00% 13
Midlands +170 77 £55,000 - 8
West Midlands +142 55 £55,000 -25.42% 7
South East +155 49 £60,000 -4.00% 8
Work from Home +32 37 £55,000 -15.38% 15
Yorkshire +132 25 £47,500 +5.07% 8
South West +84 25 £62,500 +4.17% 1
East Midlands +83 22 £50,250 -8.64% 1
Scotland +104 21 £62,500 +21.36% 3
East of England +78 6 £60,000 +33.33% 2
North East +8 1 - - 1
Northern Ireland - 1 £85,000 - 1

For the 6 months to 27 October 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 372 (62.63%) Azure
2 321 (54.04%) SQL
3 309 (52.02%) Data Warehouse
4 291 (48.99%) Business Intelligence
5 275 (46.30%) Analytics
6 252 (42.42%) Python
7 229 (38.55%) Big Data
8 222 (37.37%) Databricks
9 219 (36.87%) Agile Software Development
10 208 (35.02%) Finance
11 205 (34.51%) Microsoft
12 194 (32.66%) ETL
13 193 (32.49%) Power Platform
14 181 (30.47%) Power BI
15 164 (27.61%) AWS
16 160 (26.94%) SQL Server
16 160 (26.94%) Azure Data Factory
17 143 (24.07%) Data Modelling
18 140 (23.57%) DevOps
19 107 (18.01%) SQL Server Integration Services
19 107 (18.01%) Apache Spark
20 105 (17.68%) Data Engineering
21 101 (17.00%) R
22 100 (16.84%) Azure SQL Database
23 97 (16.33%) Analytical Skills
24 87 (14.65%) Hadoop
25 86 (14.48%) Machine Learning
26 83 (13.97%) Data Analytics
27 78 (13.13%) SQL Server Analysis Services
27 78 (13.13%) Migration

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 107 (18.01%) Apache Spark
2 40 (6.73%) Apache
3 18 (3.03%) SharePoint
4 9 (1.52%) Apache Airflow
4 9 (1.52%) Cloud Foundry
5 6 (1.01%) Apache Pig
6 5 (0.84%) Luigi
7 4 (0.67%) Apache Synapse
7 4 (0.67%) Confluence
7 4 (0.67%) Elasticsearch
7 4 (0.67%) Jupyter
8 3 (0.51%) SAS
9 2 (0.34%) Oracle SOA Suite
10 1 (0.17%) Apache Solr
10 1 (0.17%) Mule
10 1 (0.17%) Mule ESB
10 1 (0.17%) Oracle Workflow
Applications
1 14 (2.36%) Microsoft Excel
2 2 (0.34%) SPSS
2 2 (0.34%) SPSS Modeler
Business Applications
1 5 (0.84%) SAP IS-U
2 2 (0.34%) Dynamics AX
2 2 (0.34%) Dynamics CRM
3 1 (0.17%) Sparx Enterprise Architect
Cloud Services
1 372 (62.63%) Azure
2 193 (32.49%) Power Platform
3 164 (27.61%) AWS
4 160 (26.94%) Azure Data Factory
5 71 (11.95%) SaaS
6 62 (10.44%) PaaS
7 59 (9.93%) GCP
8 49 (8.25%) Serverless
9 40 (6.73%) Amazon S3
10 38 (6.40%) IaaS
11 22 (3.70%) Amazon EMR
12 21 (3.54%) AWS Lambda
13 18 (3.03%) Amazon Kinesis
14 16 (2.69%) Amazon CloudWatch
14 16 (2.69%) Amazon GuardDuty
14 16 (2.69%) AWS CloudTrail
15 15 (2.53%) Azure Stack
15 15 (2.53%) PowerApps
16 14 (2.36%) Dynamics 365
17 12 (2.02%) Logic Apps
Communications & Networking
1 18 (3.03%) Skype
2 7 (1.18%) Internet
3 4 (0.67%) Firewall
4 3 (0.51%) Wireless
5 1 (0.17%) IPsec
5 1 (0.17%) Kerberos
5 1 (0.17%) SSL
5 1 (0.17%) VPN
Database & Business Intelligence
1 309 (52.02%) Data Warehouse
2 229 (38.55%) Big Data
3 181 (30.47%) Power BI
4 160 (26.94%) SQL Server
5 107 (18.01%) SQL Server Integration Services
6 100 (16.84%) Azure SQL Database
7 87 (14.65%) Hadoop
8 78 (13.13%) Azure SQL Data Warehouse
8 78 (13.13%) SQL Server Analysis Services
9 73 (12.29%) SQL Server Reporting Services
10 58 (9.76%) Amazon Redshift
10 58 (9.76%) NoSQL
11 57 (9.60%) Tableau
12 53 (8.92%) Snowflake Schema
13 51 (8.59%) Apache Hive
14 45 (7.58%) BigQuery
14 45 (7.58%) Cosmos DB
15 43 (7.24%) Relational Database
16 35 (5.89%) RDBMS
17 32 (5.39%) Amazon Athena
Development Applications
1 30 (5.05%) Git (software)
2 21 (3.54%) Jenkins
3 13 (2.19%) Cucumber
3 13 (2.19%) Visual Studio
4 8 (1.35%) ERwin
5 6 (1.01%) Team Foundation Server
6 4 (0.67%) Atlassian Bamboo
6 4 (0.67%) GitLab
6 4 (0.67%) JIRA
6 4 (0.67%) Octopus Deploy
6 4 (0.67%) TeamCity
7 3 (0.51%) ER Studio
7 3 (0.51%) Visual Studio Team System
8 2 (0.34%) Artifactory
8 2 (0.34%) GDB
8 2 (0.34%) Postman
8 2 (0.34%) PowerBuilder
8 2 (0.34%) SonarQube
8 2 (0.34%) Sourcetree
8 2 (0.34%) xUnit.net
General
1 208 (35.02%) Finance
2 40 (6.73%) Banking
3 18 (3.03%) Marketing
4 16 (2.69%) Retail
5 14 (2.36%) Law
6 13 (2.19%) Front Office
7 9 (1.52%) Advertising
8 4 (0.67%) Investment Banking
9 3 (0.51%) Back Office
9 3 (0.51%) Manufacturing
9 3 (0.51%) Pharmaceutical
9 3 (0.51%) Police
9 3 (0.51%) Telecoms
10 2 (0.34%) Legal
10 2 (0.34%) Public Sector
10 2 (0.34%) Publishing
11 1 (0.17%) Billing
11 1 (0.17%) Dutch Language
11 1 (0.17%) French Language
11 1 (0.17%) Games
Job Titles
1 184 (30.98%) Data Engineer
2 137 (23.06%) Developer
3 135 (22.73%) Architect
4 74 (12.46%) Azure Engineer
5 73 (12.29%) Data Architect
6 70 (11.78%) Business Intelligence Developer
7 57 (9.60%) Solutions Architect
8 53 (8.92%) Azure Architect
9 43 (7.24%) Azure Developer
10 35 (5.89%) Analyst
11 34 (5.72%) Cloud Architect
12 29 (4.88%) Cloud Solutions Architect
12 29 (4.88%) SQL Developer
13 26 (4.38%) Data Warehouse Developer
14 23 (3.87%) Senior Developer
15 22 (3.70%) Lead Developer
16 21 (3.54%) Business Intelligence Lead
16 21 (3.54%) Python Engineer
17 19 (3.20%) AWS Engineer
17 19 (3.20%) SQL BI Developer
Libraries, Frameworks & Software Standards
1 77 (12.96%) Kafka
2 67 (11.28%) .NET
3 25 (4.21%) PySpark
4 20 (3.37%) CSS
5 19 (3.20%) XML
6 16 (2.69%) Web Services
7 13 (2.19%) ASP.NET
7 13 (2.19%) MDX
8 12 (2.02%) jQuery
8 12 (2.02%) JSON
8 12 (2.02%) REST
8 12 (2.02%) Twitter Bootstrap
9 11 (1.85%) Apache NiFi
9 11 (1.85%) ASP.NET Web API
9 11 (1.85%) J2EE
10 10 (1.68%) Ajax
10 10 (1.68%) HTML
11 9 (1.52%) .NET Core
11 9 (1.52%) HTML5
11 9 (1.52%) Spring Boot
Miscellaneous
1 97 (16.33%) Analytical Skills
2 39 (6.57%) Greenfield Project
3 33 (5.56%) Data Structures
4 28 (4.71%) Management Information System
5 20 (3.37%) Cloud Native
6 17 (2.86%) Enterprise Software
7 13 (2.19%) Algorithms
8 9 (1.52%) Credit Risk
8 9 (1.52%) Equities
9 8 (1.35%) Foreign Exchange (FX)
9 8 (1.35%) Hedge funds
10 7 (1.18%) Fixed Income
10 7 (1.18%) Reference Data
11 6 (1.01%) Internet of Things
11 6 (1.01%) Market Risk
12 5 (0.84%) Data Centre
13 4 (0.67%) Blog
14 3 (0.51%) Public Cloud
14 3 (0.51%) Self-Motivation
15 2 (0.34%) Cyberthreat
Operating Systems
1 21 (3.54%) Linux
2 20 (3.37%) Unix
3 19 (3.20%) Windows
4 6 (1.01%) Red Hat Enterprise Linux
5 3 (0.51%) Windows Server
6 1 (0.17%) Android
6 1 (0.17%) Apple iOS
Processes & Methodologies
1 291 (48.99%) Business Intelligence
2 275 (46.30%) Analytics
3 219 (36.87%) Agile Software Development
4 194 (32.66%) ETL
5 143 (24.07%) Data Modelling
6 140 (23.57%) DevOps
7 105 (17.68%) Data Engineering
8 86 (14.48%) Machine Learning
9 83 (13.97%) Data Analytics
10 78 (13.13%) Migration
11 74 (12.46%) Data Science
12 62 (10.44%) Stakeholder Management
13 61 (10.27%) SDLC
14 58 (9.76%) Visualisation
15 56 (9.43%) Continuous Integration
16 54 (9.09%) Test Automation
17 52 (8.75%) Scrum
18 51 (8.59%) Data Strategy
19 48 (8.08%) Microservices
20 47 (7.91%) Computer Science
Programming Languages
1 321 (54.04%) SQL
2 252 (42.42%) Python
3 101 (17.00%) R
4 60 (10.10%) Java
5 57 (9.60%) Scala
5 57 (9.60%) T-SQL
6 42 (7.07%) C#
7 36 (6.06%) PowerShell
8 32 (5.39%) Data Analysis Expressions (DAX)
9 28 (4.71%) JavaScript
10 14 (2.36%) C++
11 13 (2.19%) Perl
12 12 (2.02%) VB.NET
13 9 (1.52%) U-SQL
14 6 (1.01%) C
15 5 (0.84%) Bash Shell
15 5 (0.84%) Shell Script
16 1 (0.17%) Elm
16 1 (0.17%) Go
16 1 (0.17%) Ruby
Qualifications
1 71 (11.95%) Degree
2 13 (2.19%) Computer Science Degree
3 12 (2.02%) AWS Certification
4 9 (1.52%) Microsoft Certification
5 8 (1.35%) ITIL Certification
6 4 (0.67%) MCSA
6 4 (0.67%) TOGAF Certification
7 3 (0.51%) PhD
8 2 (0.34%) Cisco Certification
8 2 (0.34%) Master's Degree
8 2 (0.34%) MCSE
8 2 (0.34%) MCTS
8 2 (0.34%) Numerate Degree
9 1 (0.17%) CCIE
9 1 (0.17%) CCNP
9 1 (0.17%) CISSP
9 1 (0.17%) MBA
9 1 (0.17%) Sun Certification
Quality Assurance & Compliance
1 55 (9.26%) Data Quality
2 14 (2.36%) NIST
2 14 (2.36%) QA
3 7 (1.18%) Sarbanes-Oxley
4 6 (1.01%) GDPR
5 1 (0.17%) Dodd-Frank
5 1 (0.17%) EMIR
5 1 (0.17%) ISO/IEC 27001
5 1 (0.17%) MiFID
5 1 (0.17%) SLA
System Software
1 32 (5.39%) Docker
2 22 (3.70%) HDFS
3 14 (2.36%) Apache ZooKeeper
4 7 (1.18%) Active Directory
5 4 (0.67%) Virtual Machines
6 2 (0.34%) Hyper-V
7 1 (0.17%) Apache Flume
Systems Management
1 45 (7.58%) Kubernetes
2 25 (4.21%) Terraform
3 21 (3.54%) Hadoop YARN
4 9 (1.52%) Puppet
5 8 (1.35%) Grafana
5 8 (1.35%) Packer
6 4 (0.67%) Oozie
7 2 (0.34%) Fluentd
7 2 (0.34%) Nagios
7 2 (0.34%) SCVMM
8 1 (0.17%) Microsoft Intune
Vendors
1 222 (37.37%) Databricks
2 205 (34.51%) Microsoft
3 38 (6.40%) Sparx
4 29 (4.88%) Teradata
5 26 (4.38%) Oracle
6 22 (3.70%) Google
7 15 (2.53%) Cloudera
7 15 (2.53%) Informatica
7 15 (2.53%) Talend
8 14 (2.36%) Ab Initio
9 11 (1.85%) Alteryx
9 11 (1.85%) Hortonworks
10 10 (1.68%) Splunk
11 9 (1.52%) Cognos
11 9 (1.52%) IBM
12 6 (1.01%) Red Hat
12 6 (1.01%) SAP
13 5 (0.84%) Blue Prism
13 5 (0.84%) Netezza
14 3 (0.51%) StreamSets