Period
to 18 May 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 May 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
18 May 2021
Same period 2020 Same period 2019
Rank 336 306 523
Rank change year-on-year -30 +217 +16
Permanent jobs citing Data Lake 730 878 740
As % of all permanent jobs advertised in England 0.91% 1.00% 0.55%
As % of the Database & Business Intelligence category 3.40% 3.69% 1.95%
Number of salaries quoted 565 566 581
10th Percentile £46,250 £45,625 £43,750
25th Percentile £53,750 £57,000 £55,000
Median annual salary (50th Percentile) £70,000 £70,000 £66,500
Median % change year-on-year - +5.26% +2.31%
75th Percentile £85,000 £80,000 £86,250
90th Percentile £107,000 £90,000 £101,250
UK median annual salary £70,000 £70,000 £65,500
% change year-on-year - +6.87% +0.77%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 21,453 23,805 37,916
As % of all permanent IT jobs advertised in England 26.73% 27.07% 28.15%
Number of salaries quoted 16,781 19,742 31,464
10th Percentile £33,750 £32,500 £31,250
25th Percentile £42,500 £41,250 £38,750
Median annual salary (50th Percentile) £55,000 £55,000 £52,500
Median % change year-on-year - +4.76% +5.00%
75th Percentile £75,000 £73,239 £71,250
90th Percentile £90,000 £90,000 £86,250
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

Salary distribution for jobs citing Data Lake in England over the 6 months to 18 May 2021.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 18 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -44 373 £80,000 +10.34% 79
North of England +50 118 £60,000 -11.11% 28
South East +16 89 £60,000 -7.69% 39
Yorkshire +22 69 £55,000 -21.43% 15
Midlands +16 67 £55,500 +0.91% 30
West Midlands +2 52 £56,250 +2.27% 19
North West +32 48 £65,000 - 13
East of England +20 32 £85,000 +44.07% 10
South West -18 27 £52,500 -8.70% 5
East Midlands +11 15 £55,500 - 11
North East - 1 £66,000 -
Data Lake
UK

For the 6 months to 18 May 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 473 (64.79%) Azure
2 439 (60.14%) SQL
3 433 (59.32%) Data Warehouse
4 366 (50.14%) Business Intelligence
5 303 (41.51%) ETL
6 294 (40.27%) Analytics
7 285 (39.04%) Python
8 273 (37.40%) Power Platform
9 256 (35.07%) Databricks
10 251 (34.38%) Azure Data Factory
11 250 (34.25%) Power BI
12 238 (32.60%) SQL Server
13 230 (31.51%) Data Modelling
13 230 (31.51%) Microsoft
14 227 (31.10%) Agile Software Development
15 220 (30.14%) AWS
16 177 (24.25%) DevOps
17 167 (22.88%) Big Data
18 162 (22.19%) Finance
19 157 (21.51%) Data Engineering
20 154 (21.10%) Apache Spark
21 146 (20.00%) Azure Synapse Analytics
22 143 (19.59%) Data Architecture
23 138 (18.90%) Data Pipeline
24 132 (18.08%) SQL Server Integration Services
25 131 (17.95%) Social Skills
26 123 (16.85%) Data Science
27 122 (16.71%) Azure SQL Database
28 116 (15.89%) SQL Server Analysis Services
29 111 (15.21%) Visualisation

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (21.10%) Apache Spark
2 45 (6.16%) Apache
3 26 (3.56%) SharePoint
4 22 (3.01%) Apache Airflow
5 11 (1.51%) Confluence
6 9 (1.23%) Oracle Workflow
7 6 (0.82%) Apache Synapse
7 6 (0.82%) Tomcat
8 4 (0.55%) GlassFish
8 4 (0.55%) WebLogic
9 3 (0.41%) Jupyter
10 2 (0.27%) Apache Pig
10 2 (0.27%) JBoss
10 2 (0.27%) Luigi
10 2 (0.27%) Mule
10 2 (0.27%) Mule ESB
10 2 (0.27%) SAS
10 2 (0.27%) WebSphere
11 1 (0.14%) Elasticsearch
11 1 (0.14%) IIS
Applications
1 27 (3.70%) Microsoft Excel
2 3 (0.41%) Microsoft Office
3 2 (0.27%) Microsoft PowerPoint
3 2 (0.27%) Microsoft Project
4 1 (0.14%) SPSS
4 1 (0.14%) SPSS Modeler
Business Applications
1 6 (0.82%) Magento
2 5 (0.68%) NetSuite
3 4 (0.55%) Dynamics AX
4 2 (0.27%) Sparx Enterprise Architect
5 1 (0.14%) OPENHousing
Cloud Services
1 473 (64.79%) Azure
2 273 (37.40%) Power Platform
3 251 (34.38%) Azure Data Factory
4 220 (30.14%) AWS
5 146 (20.00%) Azure Synapse Analytics
6 70 (9.59%) GCP
7 54 (7.40%) PaaS
8 47 (6.44%) Serverless
9 43 (5.89%) Amazon S3
10 40 (5.48%) Dynamics 365
11 36 (4.93%) Azure Cosmos DB
12 33 (4.52%) SaaS
13 31 (4.25%) AWS Lambda
14 27 (3.70%) Amazon Kinesis
15 21 (2.88%) Azure Stack
16 20 (2.74%) Azure Storage
17 18 (2.47%) Azure Machine Learning
17 18 (2.47%) Azure Service Bus
18 16 (2.19%) Amazon EC2
19 14 (1.92%) Azure Service Fabric
Communications & Networking
1 11 (1.51%) Wireless
2 6 (0.82%) Internet
3 4 (0.55%) FTP
4 3 (0.41%) Broadband
4 3 (0.41%) Firewall
4 3 (0.41%) Skype
5 2 (0.27%) HTTP
5 2 (0.27%) Kerberos
6 1 (0.14%) Extranet
6 1 (0.14%) tcpdump
6 1 (0.14%) VPN
6 1 (0.14%) Wireshark
Database & Business Intelligence
1 433 (59.32%) Data Warehouse
2 250 (34.25%) Power BI
3 238 (32.60%) SQL Server
4 167 (22.88%) Big Data
5 132 (18.08%) SQL Server Integration Services
6 122 (16.71%) Azure SQL Database
7 116 (15.89%) SQL Server Analysis Services
8 110 (15.07%) Hadoop
9 102 (13.97%) SQL Server Reporting Services
10 95 (13.01%) NoSQL
11 83 (11.37%) Azure SQL Data Warehouse
12 74 (10.14%) Amazon Redshift
13 73 (10.00%) Tableau
14 66 (9.04%) Relational Database
15 51 (6.99%) Apache Hive
16 49 (6.71%) Enterprise Data Warehouse
17 46 (6.30%) Amazon Athena
18 40 (5.48%) Microsoft Analysis Services
19 38 (5.21%) Snowflake Schema
20 33 (4.52%) HBase
Development Applications
1 37 (5.07%) Git (software)
2 22 (3.01%) JIRA
3 20 (2.74%) Jenkins
4 19 (2.60%) Oracle APEX
5 11 (1.51%) ERwin
6 9 (1.23%) ER Studio
7 8 (1.10%) Bitbucket
7 8 (1.10%) Octopus Deploy
8 7 (0.96%) TeamCity
9 6 (0.82%) Maven
9 6 (0.82%) Sonatype Nexus
10 5 (0.68%) Subversion
10 5 (0.68%) Visual Studio
11 4 (0.55%) Babel
11 4 (0.55%) Cucumber
11 4 (0.55%) webpack
12 2 (0.27%) GitLab
12 2 (0.27%) PowerDesigner
12 2 (0.27%) SQL Server Management Studio (SSMS)
13 1 (0.14%) Visual Studio Team System
General
1 162 (22.19%) Finance
2 131 (17.95%) Social Skills
3 64 (8.77%) Analytical Skills
4 47 (6.44%) Retail
5 21 (2.88%) Banking
6 19 (2.60%) Marketing
6 19 (2.60%) Public Sector
7 15 (2.05%) Law
8 14 (1.92%) Telecoms
9 12 (1.64%) Front Office
9 12 (1.64%) Influencing Skills
10 11 (1.51%) Presentation Skills
11 10 (1.37%) Games
12 5 (0.68%) Advertising
12 5 (0.68%) Investment Banking
13 4 (0.55%) Legal
13 4 (0.55%) Publishing
13 4 (0.55%) Wearables
14 3 (0.41%) iGaming
15 2 (0.27%) Retail Banking
Job Titles
1 272 (37.26%) Data Engineer
2 179 (24.52%) Architect
3 133 (18.22%) Data Architect
4 106 (14.52%) Developer
5 82 (11.23%) Azure Engineer
6 72 (9.86%) Azure Architect
7 47 (6.44%) Analyst
8 41 (5.62%) AWS Engineer
9 37 (5.07%) Big Data Engineer
10 36 (4.93%) Business Intelligence Developer
11 35 (4.79%) Senior Data Engineer
12 32 (4.38%) Solutions Architect
13 28 (3.84%) Data Analyst
14 26 (3.56%) Enterprise Architect
14 26 (3.56%) Python Engineer
15 21 (2.88%) ETL Developer
16 20 (2.74%) Applications Architect
16 20 (2.74%) Consultant
16 20 (2.74%) Senior Developer
17 19 (2.60%) Azure Developer
Libraries, Frameworks & Software Standards
1 79 (10.82%) Kafka
2 34 (4.66%) .NET
3 33 (4.52%) PySpark
3 33 (4.52%) XML
4 24 (3.29%) CSS
5 21 (2.88%) jQuery
6 20 (2.74%) Twitter Bootstrap
7 19 (2.60%) Ajax
8 18 (2.47%) Web Services
9 16 (2.19%) SOAP
10 14 (1.92%) WCF
11 13 (1.78%) REST
12 12 (1.64%) JSON
12 12 (1.64%) Pandas
13 11 (1.51%) EDI
13 11 (1.51%) HTML
14 10 (1.37%) Apache NiFi
14 10 (1.37%) NumPy
14 10 (1.37%) React
14 10 (1.37%) RESTful
Miscellaneous
1 31 (4.25%) Data Structures
2 28 (3.84%) Greenfield Project
3 25 (3.42%) Algorithms
4 23 (3.15%) Enterprise Software
5 20 (2.74%) Life Science
6 17 (2.33%) Management Information System
7 16 (2.19%) Reinsurance
8 15 (2.05%) User Experience
9 14 (1.92%) Cloud Native
10 13 (1.78%) Virtual Team
11 7 (0.96%) Data Centre
12 5 (0.68%) BBC
12 5 (0.68%) Internet of Things
12 5 (0.68%) Public Cloud
13 4 (0.55%) 3D Graphics
13 4 (0.55%) Blog
13 4 (0.55%) Clustering
13 4 (0.55%) Cyber Defence
13 4 (0.55%) Self-Motivation
14 3 (0.41%) Housing Association
Operating Systems
1 12 (1.64%) Unix
2 8 (1.10%) Linux
3 6 (0.82%) Windows
4 4 (0.55%) Android
4 4 (0.55%) Apple iOS
5 2 (0.27%) Windows Server
Processes & Methodologies
1 366 (50.14%) Business Intelligence
2 303 (41.51%) ETL
3 294 (40.27%) Analytics
4 230 (31.51%) Data Modelling
5 227 (31.10%) Agile Software Development
6 177 (24.25%) DevOps
7 157 (21.51%) Data Engineering
8 143 (19.59%) Data Architecture
9 138 (18.90%) Data Pipeline
10 123 (16.85%) Data Science
11 111 (15.21%) Visualisation
12 99 (13.56%) Machine Learning
13 96 (13.15%) Migration
14 92 (12.60%) Data Strategy
15 82 (11.23%) Data Analytics
16 78 (10.68%) Data Management
17 76 (10.41%) Microservices
18 65 (8.90%) Scrum
19 64 (8.77%) Problem-Solving
20 63 (8.63%) Data Visualisation
Programming Languages
1 439 (60.14%) SQL
2 285 (39.04%) Python
3 80 (10.96%) T-SQL
4 77 (10.55%) Java
5 65 (8.90%) Scala
6 52 (7.12%) C#
7 37 (5.07%) R
8 32 (4.38%) Data Analysis Expressions (DAX)
9 31 (4.25%) PowerShell
10 17 (2.33%) JavaScript
11 14 (1.92%) U-SQL
12 13 (1.78%) Bash Shell
13 11 (1.51%) C
14 10 (1.37%) PL/SQL
15 5 (0.68%) Kotlin
15 5 (0.68%) VBA
16 4 (0.55%) ANSI SQL
17 3 (0.41%) Google Apps Script
17 3 (0.41%) Java 8
17 3 (0.41%) Korn
Qualifications
1 59 (8.08%) Degree
2 19 (2.60%) Computer Science Degree
3 18 (2.47%) Security Cleared
4 17 (2.33%) SC Cleared
5 12 (1.64%) Microsoft Certification
6 4 (0.55%) AWS Certification
6 4 (0.55%) DV Cleared
6 4 (0.55%) ITIL Certification
7 3 (0.41%) AAT
7 3 (0.41%) ACCA
7 3 (0.41%) CIMA
7 3 (0.41%) DBS Check
7 3 (0.41%) ISEB
7 3 (0.41%) MBCS
8 2 (0.27%) PhD
9 1 (0.14%) Numerate Degree
9 1 (0.14%) PMI Certification
9 1 (0.14%) PMP
9 1 (0.14%) PRINCE2 Practitioner
9 1 (0.14%) TOGAF Certification
Quality Assurance & Compliance
1 66 (9.04%) Data Quality
2 24 (3.29%) QA
3 11 (1.51%) GDPR
4 2 (0.27%) NIST
4 2 (0.27%) SLA
5 1 (0.14%) GxP
System Software
1 23 (3.15%) Docker
2 19 (2.60%) HDFS
3 5 (0.68%) Active Directory
4 4 (0.55%) Apache ZooKeeper
4 4 (0.55%) Firmware
5 3 (0.41%) Hyper-V
5 3 (0.41%) VMware Infrastructure
6 2 (0.27%) Apache Flume
Systems Management
1 36 (4.93%) Kubernetes
2 34 (4.66%) Terraform
3 15 (2.05%) Puppet
4 12 (1.64%) Ansible
5 9 (1.23%) Oozie
6 5 (0.68%) Hadoop YARN
6 5 (0.68%) Opscode Chef
7 3 (0.41%) Grafana
7 3 (0.41%) Packer
8 2 (0.27%) Rancher
8 2 (0.27%) SCCM
9 1 (0.14%) Failover Clustering
9 1 (0.14%) Single Sign-On
9 1 (0.14%) vCenter Server
9 1 (0.14%) ZABBIX
Vendors
1 256 (35.07%) Databricks
2 230 (31.51%) Microsoft
3 53 (7.26%) Oracle
4 29 (3.97%) Google
5 19 (2.60%) Salesforce.com
6 16 (2.19%) Teradata
7 15 (2.05%) Cloudera
7 15 (2.05%) SAP
7 15 (2.05%) Talend
8 14 (1.92%) Alteryx
9 12 (1.64%) Cognos
9 12 (1.64%) Informatica
10 8 (1.10%) JD Edwards
11 7 (0.96%) MuleSoft
12 6 (0.82%) Snowplow
12 6 (0.82%) Sparx
13 5 (0.68%) IBM
13 5 (0.68%) StreamSets
14 4 (0.55%) MicroStrategy
14 4 (0.55%) VMware