Period
to 22 January 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 22 January 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
22 Jan 2021
Same period 2020 Same period 2019
Rank 291 489 585
Rank change year-on-year +198 +96 +213
Permanent jobs citing Data Lake 680 682 671
As % of all permanent jobs advertised in the UK 1.06% 0.54% 0.44%
As % of the Database & Business Intelligence category 3.87% 2.00% 1.53%
Number of salaries quoted 627 619 585
Median annual salary £67,500 £67,500 £65,000
Median salary % change year-on-year - +3.85% +4.00%
10th Percentile £46,000 £42,900 £41,750
90th Percentile £102,500 £94,000 £100,000
UK excluding London median annual salary £55,000 £57,500 £62,138
% change year-on-year -4.35% -7.46% +7.13%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 17,557 34,137 43,746
As % of all permanent IT jobs advertised in the UK 27.42% 27.07% 28.81%
Number of salaries quoted 14,707 28,272 36,322
Median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +9.38%
10th Percentile £33,750 £32,000 £31,250
90th Percentile £87,500 £88,750 £85,000
UK excluding London median annual salary £49,000 £45,000 £45,000
% change year-on-year +8.89% - +5.88%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 22 January 2021.

Salary histogram for Data Lake in the UK

Data Lake
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 22 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +190 647 £67,500 -1.10% 106
London +139 351 £80,000 +10.34% 58
UK excluding London +220 291 £55,000 -4.35% 48
North of England +146 133 £55,000 +10.00% 20
North West +125 84 £70,000 +40.00% 12
Work from Home -6 80 £62,500 -12.28% 22
South East +134 53 £57,500 -11.54% 13
Yorkshire +67 45 £47,500 -9.52% 7
Midlands +102 44 £55,000 +0.92% 8
South West +73 29 £52,500 +4.48% 1
West Midlands +73 24 £55,000 -4.35% 3
Scotland +63 21 £67,500 +35.00% 3
East Midlands +67 20 £55,000 +3.77% 5
East of England +60 10 £95,000 +61.02% 4
North East +22 4 £52,500 +15.61% 1
Northern Ireland - 1 £85,000 -

For the 6 months to 22 January 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 458 (67.35%) Azure
2 380 (55.88%) SQL
3 378 (55.59%) Data Warehouse
4 331 (48.68%) Business Intelligence
5 303 (44.56%) Python
6 289 (42.50%) Analytics
7 288 (42.35%) Databricks
8 258 (37.94%) Microsoft
9 240 (35.29%) ETL
10 217 (31.91%) Power Platform
11 214 (31.47%) Azure Data Factory
12 209 (30.74%) Big Data
13 207 (30.44%) SQL Server
14 206 (30.29%) AWS
15 191 (28.09%) Agile Software Development
16 186 (27.35%) Finance
17 184 (27.06%) Power BI
18 172 (25.29%) DevOps
19 162 (23.82%) Data Modelling
20 150 (22.06%) Apache Spark
21 134 (19.71%) Azure SQL Database
22 116 (17.06%) Hadoop
22 116 (17.06%) Data Science
23 112 (16.47%) Data Analytics
23 112 (16.47%) SQL Server Integration Services
24 111 (16.32%) Machine Learning
25 98 (14.41%) Data Engineering
26 93 (13.68%) SQL Server Reporting Services
27 89 (13.09%) SQL Server Analysis Services
28 88 (12.94%) Azure SQL Data Warehouse

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 150 (22.06%) Apache Spark
2 67 (9.85%) Apache
3 39 (5.74%) SharePoint
4 17 (2.50%) Apache Airflow
5 12 (1.76%) Apache Synapse
6 10 (1.47%) Elasticsearch
7 8 (1.18%) Jupyter
8 7 (1.03%) Luigi
9 5 (0.74%) Oracle Workflow
9 5 (0.74%) SAS
10 3 (0.44%) Cloud Foundry
11 2 (0.29%) Apache Pig
11 2 (0.29%) Mule
11 2 (0.29%) Mule ESB
12 1 (0.15%) Confluence
12 1 (0.15%) IIS
12 1 (0.15%) OpenStack
Applications
1 30 (4.41%) Microsoft Excel
2 3 (0.44%) SPSS
2 3 (0.44%) SPSS Modeler
3 1 (0.15%) Microsoft Office
Business Applications
1 3 (0.44%) SAP IS-U
1 3 (0.44%) Sparx Enterprise Architect
2 2 (0.29%) Dynamics AX
3 1 (0.15%) Dynamics CRM
3 1 (0.15%) NetSuite
Cloud Services
1 458 (67.35%) Azure
2 217 (31.91%) Power Platform
3 214 (31.47%) Azure Data Factory
4 206 (30.29%) AWS
5 73 (10.74%) PaaS
5 73 (10.74%) SaaS
6 66 (9.71%) GCP
7 49 (7.21%) Serverless
8 41 (6.03%) Dynamics 365
9 40 (5.88%) Amazon S3
10 34 (5.00%) Amazon Kinesis
11 29 (4.26%) Amazon EMR
11 29 (4.26%) AWS Lambda
12 26 (3.82%) IaaS
13 19 (2.79%) Azure Stack
14 14 (2.06%) Azure Functions
14 14 (2.06%) Logic Apps
15 12 (1.76%) Amazon SageMaker
16 9 (1.32%) Azure Machine Learning
16 9 (1.32%) Data Lake Analytics
Communications & Networking
1 13 (1.91%) Internet
2 12 (1.76%) Skype
3 6 (0.88%) Firewall
4 3 (0.44%) Wireless
5 2 (0.29%) Kerberos
6 1 (0.15%) VPN
Database & Business Intelligence
1 378 (55.59%) Data Warehouse
2 209 (30.74%) Big Data
3 207 (30.44%) SQL Server
4 184 (27.06%) Power BI
5 134 (19.71%) Azure SQL Database
6 116 (17.06%) Hadoop
7 112 (16.47%) SQL Server Integration Services
8 93 (13.68%) SQL Server Reporting Services
9 89 (13.09%) SQL Server Analysis Services
10 88 (12.94%) Azure SQL Data Warehouse
11 87 (12.79%) Amazon Redshift
12 83 (12.21%) NoSQL
13 64 (9.41%) Amazon Athena
14 54 (7.94%) Tableau
15 52 (7.65%) Cosmos DB
16 46 (6.76%) Apache Hive
17 43 (6.32%) Relational Database
17 43 (6.32%) Snowflake Schema
18 37 (5.44%) HBase
19 32 (4.71%) BigQuery
Development Applications
1 20 (2.94%) Git (software)
2 17 (2.50%) Jenkins
3 7 (1.03%) Cucumber
3 7 (1.03%) ERwin
3 7 (1.03%) Oracle APEX
4 6 (0.88%) JIRA
4 6 (0.88%) Maven
4 6 (0.88%) Octopus Deploy
4 6 (0.88%) Visual Studio
5 5 (0.74%) TeamCity
6 4 (0.59%) Postman
6 4 (0.59%) SQL Server Management Studio (SSMS)
7 3 (0.44%) ER Studio
7 3 (0.44%) Team Foundation Server
7 3 (0.44%) Visual Studio Team System
8 2 (0.29%) CircleCI
8 2 (0.29%) NUnit
8 2 (0.29%) PowerBuilder
8 2 (0.29%) xUnit.net
9 1 (0.15%) GoCD
General
1 186 (27.35%) Finance
2 44 (6.47%) Retail
3 37 (5.44%) Public Sector
4 36 (5.29%) Banking
5 23 (3.38%) Marketing
6 21 (3.09%) Law
7 15 (2.21%) Front Office
8 9 (1.32%) Advertising
9 7 (1.03%) Games
10 5 (0.74%) Back Office
10 5 (0.74%) iGaming
10 5 (0.74%) Telecoms
11 4 (0.59%) Housing Association
11 4 (0.59%) Investment Banking
11 4 (0.59%) Manufacturing
12 3 (0.44%) Pharmaceutical
12 3 (0.44%) Publishing
13 2 (0.29%) Billing
13 2 (0.29%) Legal
14 1 (0.15%) General Ledger
Job Titles
1 223 (32.79%) Data Engineer
2 168 (24.71%) Architect
3 125 (18.38%) Developer
4 103 (15.15%) Data Architect
5 79 (11.62%) Azure Architect
6 68 (10.00%) Business Intelligence Developer
7 60 (8.82%) Azure Engineer
8 56 (8.24%) Analyst
9 52 (7.65%) Solutions Architect
10 43 (6.32%) Azure Developer
11 35 (5.15%) Data Analyst
12 34 (5.00%) Enterprise Architect
13 31 (4.56%) Big Data Engineer
14 29 (4.26%) Applications Architect
14 29 (4.26%) Senior Data Engineer
15 27 (3.97%) Business Intelligence Lead
16 26 (3.82%) Lead Developer
17 24 (3.53%) Enterprise Applications Architect
18 23 (3.38%) AWS Engineer
18 23 (3.38%) Cloud Architect
Libraries, Frameworks & Software Standards
1 84 (12.35%) Kafka
2 73 (10.74%) .NET
3 41 (6.03%) XML
4 34 (5.00%) CSS
5 33 (4.85%) jQuery
5 33 (4.85%) Twitter Bootstrap
6 29 (4.26%) Ajax
6 29 (4.26%) PySpark
7 24 (3.53%) Web Services
8 18 (2.65%) Spring Boot
9 17 (2.50%) Apache NiFi
10 15 (2.21%) Pandas
11 14 (2.06%) ADO
11 14 (2.06%) RESTful
12 12 (1.76%) JSON
13 11 (1.62%) .NET Core
13 11 (1.62%) Spring
14 9 (1.32%) MDX
14 9 (1.32%) REST
15 8 (1.18%) SOAP
Miscellaneous
1 86 (12.65%) Analytical Skills
2 32 (4.71%) Management Information System
3 31 (4.56%) Enterprise Software
4 30 (4.41%) Greenfield Project
5 26 (3.82%) Algorithms
5 26 (3.82%) Data Structures
6 13 (1.91%) Internet of Things
7 12 (1.76%) Cloud Native
8 11 (1.62%) Market Risk
9 10 (1.47%) Credit Risk
9 10 (1.47%) Fixed Income
10 9 (1.32%) Equities
11 8 (1.18%) Blog
11 8 (1.18%) Foreign Exchange (FX)
11 8 (1.18%) Hedge funds
12 7 (1.03%) Life Science
12 7 (1.03%) Reference Data
12 7 (1.03%) Virtual Team
13 6 (0.88%) Public Cloud
14 5 (0.74%) PlayStation
Operating Systems
1 11 (1.62%) Unix
2 9 (1.32%) Linux
3 8 (1.18%) Windows
4 2 (0.29%) Windows Server
Processes & Methodologies
1 331 (48.68%) Business Intelligence
2 289 (42.50%) Analytics
3 240 (35.29%) ETL
4 191 (28.09%) Agile Software Development
5 172 (25.29%) DevOps
6 162 (23.82%) Data Modelling
7 116 (17.06%) Data Science
8 112 (16.47%) Data Analytics
9 111 (16.32%) Machine Learning
10 98 (14.41%) Data Engineering
11 86 (12.65%) Migration
12 78 (11.47%) Visualisation
13 76 (11.18%) Microservices
14 75 (11.03%) Data Architecture
15 62 (9.12%) Scrum
16 57 (8.38%) SDLC
16 57 (8.38%) Stakeholder Management
17 55 (8.09%) Continuous Integration
18 53 (7.79%) Computer Science
18 53 (7.79%) Problem-Solving
Programming Languages
1 380 (55.88%) SQL
2 303 (44.56%) Python
3 76 (11.18%) R
4 69 (10.15%) Java
5 59 (8.68%) Scala
6 49 (7.21%) C#
7 42 (6.18%) T-SQL
8 40 (5.88%) PowerShell
9 34 (5.00%) Data Analysis Expressions (DAX)
10 17 (2.50%) JavaScript
11 9 (1.32%) U-SQL
12 7 (1.03%) Bash Shell
13 6 (0.88%) VBA
14 4 (0.59%) Go
15 3 (0.44%) Cython
15 3 (0.44%) Java 8
16 2 (0.29%) Shell Script
16 2 (0.29%) TypeScript
17 1 (0.15%) C++
17 1 (0.15%) PL/SQL
Qualifications
1 72 (10.59%) Degree
2 26 (3.82%) Computer Science Degree
3 15 (2.21%) ITIL Certification
4 8 (1.18%) Microsoft Certification
5 5 (0.74%) AWS Certification
6 4 (0.59%) PhD
7 3 (0.44%) ISEB
7 3 (0.44%) MBCS
7 3 (0.44%) Security Cleared
7 3 (0.44%) TOGAF Certification
8 2 (0.29%) Master's Degree
8 2 (0.29%) Numerate Degree
8 2 (0.29%) PMI Certification
8 2 (0.29%) SC Cleared
9 1 (0.15%) ACCA
9 1 (0.15%) CIMA
9 1 (0.15%) MCSA
9 1 (0.15%) MCSE
9 1 (0.15%) MCTS
9 1 (0.15%) Sun Certification
Quality Assurance & Compliance
1 43 (6.32%) Data Quality
2 14 (2.06%) QA
3 8 (1.18%) GDPR
4 2 (0.29%) ISO/IEC 20000
4 2 (0.29%) Sarbanes-Oxley
4 2 (0.29%) SLA
5 1 (0.15%) Dodd-Frank
5 1 (0.15%) EMIR
5 1 (0.15%) MiFID
System Software
1 28 (4.12%) Docker
2 23 (3.38%) HDFS
3 10 (1.47%) Apache ZooKeeper
4 7 (1.03%) Active Directory
5 1 (0.15%) Apache Flume
5 1 (0.15%) Hyper-V
5 1 (0.15%) VMware Infrastructure
Systems Management
1 40 (5.88%) Terraform
2 35 (5.15%) Kubernetes
3 18 (2.65%) Puppet
4 14 (2.06%) Grafana
4 14 (2.06%) Packer
5 12 (1.76%) Hadoop YARN
5 12 (1.76%) Oozie
6 4 (0.59%) Ansible
6 4 (0.59%) Opscode Chef
7 1 (0.15%) Failover Clustering
7 1 (0.15%) Nagios
7 1 (0.15%) SCCM
7 1 (0.15%) vCenter Server
Vendors
1 288 (42.35%) Databricks
2 258 (37.94%) Microsoft
3 31 (4.56%) Google
4 30 (4.41%) Sparx
5 28 (4.12%) Oracle
6 22 (3.24%) Talend
7 20 (2.94%) Informatica
8 17 (2.50%) Teradata
9 16 (2.35%) Cloudera
9 16 (2.35%) Cognos
10 15 (2.21%) SAP
11 8 (1.18%) Ab Initio
11 8 (1.18%) MuleSoft
12 7 (1.03%) Alteryx
12 7 (1.03%) StreamSets
13 6 (0.88%) Sage
14 5 (0.74%) Blue Prism
14 5 (0.74%) IBM
14 5 (0.74%) Salesforce.com
15 4 (0.59%) Snowplow