Period
to 24 February 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 24 February 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
24 Feb 2021
Same period 2020 Same period 2019
Rank 287 429 553
Rank change year-on-year +142 +124 +112
Permanent jobs citing Data Lake 705 764 664
As % of all permanent jobs advertised in England 1.06% 0.67% 0.48%
As % of the Database & Business Intelligence category 3.93% 2.50% 1.67%
Number of salaries quoted 657 593 573
Median annual salary £67,500 £70,000 £65,000
Median salary % change year-on-year -3.57% +7.69% +6.56%
10th Percentile £45,000 £43,903 £42,300
90th Percentile £105,000 £91,250 £101,250
UK median annual salary £67,500 £70,000 £65,000
% change year-on-year -3.57% +7.69% +8.33%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 17,944 30,585 39,821
As % of all permanent IT jobs advertised in England 27.07% 26.98% 28.74%
Number of salaries quoted 15,061 25,514 33,332
Median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +5.00%
10th Percentile £33,750 £32,500 £31,250
90th Percentile £88,750 £90,000 £85,450
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

Salary distribution for jobs citing Data Lake in England over the 6 months to 24 February 2021.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 24 February 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +79 378 £80,000 +10.34% 72
North of England +153 149 £55,000 +10.00% 28
North West +107 75 £70,000 +40.00% 16
Yorkshire +83 70 £48,750 -17.02% 8
South East +91 63 £57,500 -11.54% 15
Midlands +85 41 £55,000 +0.92% 10
South West +36 26 £52,500 +3.96% 4
West Midlands +68 21 £55,000 -4.35% 7
East Midlands +53 20 £55,000 +3.77% 3
East of England +56 18 £95,000 +52.00% 4
North East +17 4 £52,500 +30.67% 4
Data Lake
UK

For the 6 months to 24 February 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 471 (66.81%) Azure
2 411 (58.30%) Data Warehouse
3 404 (57.30%) SQL
4 360 (51.06%) Business Intelligence
5 311 (44.11%) Python
6 294 (41.70%) Databricks
7 290 (41.13%) Analytics
8 283 (40.14%) Microsoft
9 277 (39.29%) ETL
10 250 (35.46%) Power Platform
11 231 (32.77%) SQL Server
12 227 (32.20%) Azure Data Factory
13 213 (30.21%) Power BI
14 205 (29.08%) AWS
15 199 (28.23%) Big Data
16 195 (27.66%) Agile Software Development
17 182 (25.82%) Finance
18 174 (24.68%) Data Modelling
19 167 (23.69%) DevOps
20 152 (21.56%) Apache Spark
21 133 (18.87%) Azure SQL Database
22 131 (18.58%) SQL Server Integration Services
23 125 (17.73%) Data Science
24 114 (16.17%) Hadoop
25 111 (15.74%) SQL Server Reporting Services
26 109 (15.46%) Data Engineering
27 108 (15.32%) SQL Server Analysis Services
28 104 (14.75%) Data Analytics
29 102 (14.47%) Machine Learning
30 94 (13.33%) Data Architecture

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 152 (21.56%) Apache Spark
2 64 (9.08%) Apache
3 40 (5.67%) SharePoint
4 17 (2.41%) Apache Airflow
5 12 (1.70%) Apache Synapse
6 10 (1.42%) Elasticsearch
7 9 (1.28%) Jupyter
8 7 (0.99%) Luigi
9 5 (0.71%) Oracle Workflow
10 4 (0.57%) GlassFish
10 4 (0.57%) Tomcat
10 4 (0.57%) WebLogic
11 3 (0.43%) SAS
12 2 (0.28%) Confluence
12 2 (0.28%) Mule
12 2 (0.28%) Mule ESB
13 1 (0.14%) Apache Pig
13 1 (0.14%) IIS
13 1 (0.14%) OpenStack
Applications
1 35 (4.96%) Microsoft Excel
2 3 (0.43%) SPSS
2 3 (0.43%) SPSS Modeler
3 1 (0.14%) Microsoft Office
3 1 (0.14%) Microsoft PowerPoint
Business Applications
1 5 (0.71%) NetSuite
2 4 (0.57%) Dynamics AX
3 3 (0.43%) SAP IS-U
4 2 (0.28%) Sparx Enterprise Architect
5 1 (0.14%) Magento
Cloud Services
1 471 (66.81%) Azure
2 250 (35.46%) Power Platform
3 227 (32.20%) Azure Data Factory
4 205 (29.08%) AWS
5 71 (10.07%) PaaS
6 68 (9.65%) SaaS
7 67 (9.50%) GCP
8 50 (7.09%) Dynamics 365
9 44 (6.24%) Amazon S3
9 44 (6.24%) Serverless
10 37 (5.25%) Amazon Kinesis
11 32 (4.54%) AWS Lambda
12 29 (4.11%) Amazon EMR
13 22 (3.12%) IaaS
14 18 (2.55%) Azure Machine Learning
14 18 (2.55%) Azure Stack
15 12 (1.70%) Amazon SageMaker
15 12 (1.70%) Azure Functions
15 12 (1.70%) Logic Apps
16 9 (1.28%) Data Lake Analytics
Communications & Networking
1 12 (1.70%) Internet
2 10 (1.42%) Skype
3 6 (0.85%) Firewall
4 3 (0.43%) Wireless
5 2 (0.28%) FTP
5 2 (0.28%) Kerberos
6 1 (0.14%) Broadband
6 1 (0.14%) Extranet
6 1 (0.14%) VPN
Database & Business Intelligence
1 411 (58.30%) Data Warehouse
2 231 (32.77%) SQL Server
3 213 (30.21%) Power BI
4 199 (28.23%) Big Data
5 133 (18.87%) Azure SQL Database
6 131 (18.58%) SQL Server Integration Services
7 114 (16.17%) Hadoop
8 111 (15.74%) SQL Server Reporting Services
9 108 (15.32%) SQL Server Analysis Services
10 92 (13.05%) Amazon Redshift
11 90 (12.77%) Azure SQL Data Warehouse
12 86 (12.20%) NoSQL
13 70 (9.93%) Amazon Athena
14 62 (8.79%) Tableau
15 48 (6.81%) Cosmos DB
16 46 (6.52%) Apache Hive
17 43 (6.10%) Relational Database
18 41 (5.82%) Snowflake Schema
19 35 (4.96%) Microsoft Analysis Services
20 34 (4.82%) HBase
Development Applications
1 23 (3.26%) Git (software)
2 15 (2.13%) Jenkins
3 10 (1.42%) ERwin
4 9 (1.28%) JIRA
5 8 (1.13%) Oracle APEX
6 7 (0.99%) Octopus Deploy
7 6 (0.85%) Maven
7 6 (0.85%) TeamCity
7 6 (0.85%) Visual Studio
8 5 (0.71%) Cucumber
8 5 (0.71%) ER Studio
9 4 (0.57%) Postman
10 3 (0.43%) SQL Server Management Studio (SSMS)
10 3 (0.43%) Subversion
10 3 (0.43%) Team Foundation Server
11 2 (0.28%) CircleCI
11 2 (0.28%) NUnit
11 2 (0.28%) Visual Studio Team System
11 2 (0.28%) xUnit.net
12 1 (0.14%) GoCD
General
1 182 (25.82%) Finance
2 43 (6.10%) Retail
3 35 (4.96%) Public Sector
4 29 (4.11%) Banking
5 27 (3.83%) Marketing
6 19 (2.70%) Law
7 17 (2.41%) Front Office
8 9 (1.28%) Advertising
9 8 (1.13%) Games
10 5 (0.71%) iGaming
10 5 (0.71%) Manufacturing
10 5 (0.71%) Telecoms
11 4 (0.57%) Housing Association
11 4 (0.57%) Investment Banking
12 3 (0.43%) Pharmaceutical
12 3 (0.43%) Publishing
13 2 (0.28%) Back Office
13 2 (0.28%) Billing
14 1 (0.14%) General Ledger
14 1 (0.14%) Legal
Job Titles
1 234 (33.19%) Data Engineer
2 169 (23.97%) Architect
3 127 (18.01%) Developer
4 107 (15.18%) Data Architect
5 80 (11.35%) Azure Architect
6 67 (9.50%) Azure Engineer
6 67 (9.50%) Business Intelligence Developer
7 63 (8.94%) Analyst
8 41 (5.82%) Data Analyst
8 41 (5.82%) Solutions Architect
9 40 (5.67%) Azure Developer
10 38 (5.39%) Enterprise Architect
11 33 (4.68%) Applications Architect
12 32 (4.54%) Big Data Engineer
13 28 (3.97%) Enterprise Applications Architect
14 27 (3.83%) AWS Engineer
14 27 (3.83%) Senior Data Engineer
15 25 (3.55%) Business Intelligence Lead
15 25 (3.55%) Consultant
16 24 (3.40%) Lead Developer
Libraries, Frameworks & Software Standards
1 73 (10.35%) .NET
2 69 (9.79%) Kafka
3 49 (6.95%) XML
4 39 (5.53%) CSS
5 38 (5.39%) jQuery
6 37 (5.25%) Twitter Bootstrap
7 33 (4.68%) Ajax
8 32 (4.54%) PySpark
9 24 (3.40%) Web Services
10 17 (2.41%) Apache NiFi
10 17 (2.41%) Spring Boot
11 16 (2.27%) Pandas
12 14 (1.99%) ADO
12 14 (1.99%) JSON
13 13 (1.84%) RESTful
14 12 (1.70%) .NET Core
14 12 (1.70%) REST
15 10 (1.42%) Spring
16 9 (1.28%) MDX
16 9 (1.28%) SOAP
Miscellaneous
1 90 (12.77%) Analytical Skills
2 35 (4.96%) Enterprise Software
2 35 (4.96%) Greenfield Project
2 35 (4.96%) Management Information System
3 23 (3.26%) Data Structures
4 20 (2.84%) Algorithms
5 11 (1.56%) Internet of Things
5 11 (1.56%) Market Risk
5 11 (1.56%) Reinsurance
6 10 (1.42%) Credit Risk
6 10 (1.42%) Fixed Income
7 9 (1.28%) Equities
7 9 (1.28%) Hedge funds
8 8 (1.13%) Blog
8 8 (1.13%) Foreign Exchange (FX)
8 8 (1.13%) Life Science
9 7 (0.99%) Cloud Native
9 7 (0.99%) Reference Data
10 6 (0.85%) Public Cloud
10 6 (0.85%) Self-Motivation
Operating Systems
1 10 (1.42%) Unix
2 7 (0.99%) Linux
3 6 (0.85%) Windows
4 1 (0.14%) Windows Server
Processes & Methodologies
1 360 (51.06%) Business Intelligence
2 290 (41.13%) Analytics
3 277 (39.29%) ETL
4 195 (27.66%) Agile Software Development
5 174 (24.68%) Data Modelling
6 167 (23.69%) DevOps
7 125 (17.73%) Data Science
8 109 (15.46%) Data Engineering
9 104 (14.75%) Data Analytics
10 102 (14.47%) Machine Learning
11 94 (13.33%) Data Architecture
12 90 (12.77%) Visualisation
13 82 (11.63%) Migration
14 78 (11.06%) Microservices
15 61 (8.65%) Problem-Solving
16 60 (8.51%) Scrum
17 58 (8.23%) Continuous Integration
17 58 (8.23%) Data Strategy
18 56 (7.94%) Computer Science
18 56 (7.94%) Stakeholder Management
Programming Languages
1 404 (57.30%) SQL
2 311 (44.11%) Python
3 72 (10.21%) R
4 70 (9.93%) Java
5 53 (7.52%) Scala
5 53 (7.52%) T-SQL
6 49 (6.95%) C#
7 40 (5.67%) Data Analysis Expressions (DAX)
8 38 (5.39%) PowerShell
9 14 (1.99%) JavaScript
10 9 (1.28%) U-SQL
11 6 (0.85%) VBA
12 5 (0.71%) PL/SQL
13 4 (0.57%) Go
14 3 (0.43%) Bash Shell
14 3 (0.43%) Cython
14 3 (0.43%) Google Apps Script
14 3 (0.43%) Java 8
15 2 (0.28%) TypeScript
16 1 (0.14%) Shell Script
Qualifications
1 72 (10.21%) Degree
2 30 (4.26%) Computer Science Degree
3 15 (2.13%) ITIL Certification
4 8 (1.13%) Microsoft Certification
4 8 (1.13%) Security Cleared
5 7 (0.99%) SC Cleared
6 4 (0.57%) PhD
7 3 (0.43%) AAT
7 3 (0.43%) ACCA
7 3 (0.43%) AWS Certification
7 3 (0.43%) CIMA
7 3 (0.43%) DBS Check
7 3 (0.43%) ISEB
7 3 (0.43%) MBCS
8 2 (0.28%) Numerate Degree
8 2 (0.28%) PMI Certification
9 1 (0.14%) DV Cleared
9 1 (0.14%) Master's Degree
9 1 (0.14%) MCTS
9 1 (0.14%) TOGAF Certification
Quality Assurance & Compliance
1 45 (6.38%) Data Quality
2 15 (2.13%) QA
3 8 (1.13%) GDPR
4 2 (0.28%) ISO/IEC 20000
4 2 (0.28%) Sarbanes-Oxley
4 2 (0.28%) SLA
5 1 (0.14%) Dodd-Frank
5 1 (0.14%) EMIR
5 1 (0.14%) MiFID
System Software
1 23 (3.26%) Docker
2 21 (2.98%) HDFS
3 8 (1.13%) Apache ZooKeeper
4 6 (0.85%) Active Directory
5 1 (0.14%) Apache Flume
5 1 (0.14%) Hyper-V
5 1 (0.14%) VMware Infrastructure
Systems Management
1 40 (5.67%) Terraform
2 25 (3.55%) Kubernetes
3 19 (2.70%) Puppet
4 14 (1.99%) Grafana
4 14 (1.99%) Packer
5 12 (1.70%) Oozie
6 8 (1.13%) Hadoop YARN
7 5 (0.71%) Ansible
7 5 (0.71%) Opscode Chef
8 1 (0.14%) Failover Clustering
8 1 (0.14%) SCCM
8 1 (0.14%) vCenter Server
Vendors
1 294 (41.70%) Databricks
2 283 (40.14%) Microsoft
3 31 (4.40%) Oracle
4 29 (4.11%) Google
5 24 (3.40%) Sparx
6 22 (3.12%) Talend
7 20 (2.84%) Informatica
8 17 (2.41%) Cognos
8 17 (2.41%) SAP
9 14 (1.99%) Cloudera
10 11 (1.56%) Salesforce.com
11 10 (1.42%) Teradata
12 7 (0.99%) Alteryx
12 7 (0.99%) MuleSoft
12 7 (0.99%) StreamSets
13 6 (0.85%) Ab Initio
13 6 (0.85%) Sage
13 6 (0.85%) Snowplow
14 5 (0.71%) IBM
14 5 (0.71%) JD Edwards