Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 14 April 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 14 April 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
14 Apr 2021		 Same period 2020 Same period 2019
Rank 338 369 545
Rank change year-on-year +31 +176 +38
Permanent jobs citing Data Lake 742 909 743
As % of all permanent jobs advertised in the UK 0.89% 0.80% 0.50%
As % of the Database & Business Intelligence category 3.38% 2.98% 1.75%
Number of salaries quoted 589 598 589
10th Percentile £45,000 £43,750 £42,500
25th Percentile £52,500 £54,625 £54,000
Median annual salary (50th Percentile) £70,000 £70,000 £65,000
Median % change year-on-year - +7.69% +4.00%
75th Percentile £85,000 £82,500 £85,000
90th Percentile £105,000 £91,250 £101,250
UK excluding London median annual salary £60,000 £59,000 £62,138
% change year-on-year +1.69% -5.05% +12.98%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 21,968 30,466 42,380
As % of all permanent IT jobs advertised in the UK 26.38% 26.93% 28.45%
Number of salaries quoted 17,727 25,119 35,071
10th Percentile £33,750 £32,500 £31,250
25th Percentile £41,250 £40,000 £37,500
Median annual salary (50th Percentile) £55,000 £52,500 £52,500
Median % change year-on-year +4.76% - +5.00%
75th Percentile £73,750 £72,500 £70,000
90th Percentile £88,750 £87,500 £85,000
UK excluding London median annual salary £48,500 £45,000 £45,000
% change year-on-year +7.78% - +5.88%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

3-month moving average salary quoted in jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

Salary distribution for jobs citing Data Lake over the 6 months to 14 April 2021.

Salary histogram for Data Lake in the UK

Data Lake
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 14 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +33 684 £70,000 - 165
London -16 345 £80,000 +10.34% 64
UK excluding London +138 333 £60,000 +1.69% 105
North of England +108 137 £61,000 +6.09% 33
Work from Home -37 115 £62,250 -12.01% 48
South East +52 71 £60,000 -7.69% 21
North West +72 67 £66,750 +40.53% 21
Yorkshire +40 65 £55,000 -18.52% 7
Midlands +51 49 £55,500 +5.71% 27
West Midlands +27 29 £55,000 +2.33% 21
South West +28 28 £52,500 +3.96% 5
East of England +42 26 £85,000 +44.07% 12
East Midlands +35 20 £55,500 +11.00% 6
Scotland +8 16 £72,500 +34.88% 7
North East - 5 £52,500 - 5
Wales +40 4 - -
Northern Ireland - 2 £35,000 -

For the 6 months to 14 April 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 495 (66.71%) Azure
2 439 (59.16%) Data Warehouse
3 432 (58.22%) SQL
4 385 (51.89%) Business Intelligence
5 325 (43.80%) Python
6 311 (41.91%) Analytics
7 288 (38.81%) ETL
8 284 (38.27%) Power Platform
9 274 (36.93%) Databricks
10 260 (35.04%) Microsoft
11 257 (34.64%) Power BI
12 250 (33.69%) Azure Data Factory
13 240 (32.35%) SQL Server
14 232 (31.27%) AWS
15 228 (30.73%) Data Modelling
16 221 (29.78%) Agile Software Development
17 202 (27.22%) Big Data
18 184 (24.80%) DevOps
19 174 (23.45%) Apache Spark
20 163 (21.97%) Finance
21 138 (18.60%) Data Engineering
22 137 (18.46%) Data Architecture
22 137 (18.46%) SQL Server Integration Services
23 134 (18.06%) Data Science
24 124 (16.71%) Visualisation
24 124 (16.71%) Hadoop
25 120 (16.17%) Machine Learning
26 119 (16.04%) Azure SQL Database
27 115 (15.50%) SQL Server Analysis Services
28 112 (15.09%) SQL Server Reporting Services

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 174 (23.45%) Apache Spark
2 67 (9.03%) Apache
3 32 (4.31%) SharePoint
4 18 (2.43%) Apache Airflow
5 15 (2.02%) Apache Synapse
6 12 (1.62%) Oracle Workflow
7 10 (1.35%) Elasticsearch
8 7 (0.94%) Confluence
9 6 (0.81%) Jupyter
9 6 (0.81%) Tomcat
10 4 (0.54%) GlassFish
10 4 (0.54%) SAS
10 4 (0.54%) WebLogic
11 3 (0.40%) Luigi
11 3 (0.40%) Mule
11 3 (0.40%) Mule ESB
12 2 (0.27%) JBoss
12 2 (0.27%) WebSphere
13 1 (0.13%) Cloud Foundry
13 1 (0.13%) OpenStack
Applications
1 39 (5.26%) Microsoft Excel
2 2 (0.27%) Microsoft Office
2 2 (0.27%) SPSS
2 2 (0.27%) SPSS Modeler
3 1 (0.13%) Microsoft PowerPoint
3 1 (0.13%) Microsoft Project
Business Applications
1 7 (0.94%) NetSuite
2 4 (0.54%) Dynamics AX
2 4 (0.54%) Magento
3 2 (0.27%) Dynamics CRM
3 2 (0.27%) Oracle EBS
3 2 (0.27%) Sparx Enterprise Architect
4 1 (0.13%) SAP IS-U
Cloud Services
1 495 (66.71%) Azure
2 284 (38.27%) Power Platform
3 250 (33.69%) Azure Data Factory
4 232 (31.27%) AWS
5 78 (10.51%) GCP
6 63 (8.49%) PaaS
7 52 (7.01%) Dynamics 365
8 51 (6.87%) SaaS
9 46 (6.20%) Serverless
10 41 (5.53%) Amazon S3
11 30 (4.04%) AWS Lambda
12 29 (3.91%) Amazon Kinesis
13 26 (3.50%) Amazon EMR
14 23 (3.10%) Azure Stack
15 21 (2.83%) Azure Machine Learning
16 20 (2.70%) Matillion
17 14 (1.89%) Azure Functions
17 14 (1.89%) Logic Apps
18 13 (1.75%) IaaS
19 11 (1.48%) Amazon SageMaker
Communications & Networking
1 10 (1.35%) Internet
2 6 (0.81%) Skype
2 6 (0.81%) Wireless
3 5 (0.67%) Firewall
4 4 (0.54%) FTP
5 2 (0.27%) Kerberos
6 1 (0.13%) Broadband
6 1 (0.13%) Extranet
6 1 (0.13%) tcpdump
6 1 (0.13%) VPN
6 1 (0.13%) Wireshark
Database & Business Intelligence
1 439 (59.16%) Data Warehouse
2 257 (34.64%) Power BI
3 240 (32.35%) SQL Server
4 202 (27.22%) Big Data
5 137 (18.46%) SQL Server Integration Services
6 124 (16.71%) Hadoop
7 119 (16.04%) Azure SQL Database
8 115 (15.50%) SQL Server Analysis Services
9 112 (15.09%) SQL Server Reporting Services
10 101 (13.61%) NoSQL
11 94 (12.67%) Azure SQL Data Warehouse
12 91 (12.26%) Amazon Redshift
13 70 (9.43%) Tableau
14 64 (8.63%) Amazon Athena
15 58 (7.82%) Relational Database
16 55 (7.41%) Enterprise Data Warehouse
17 51 (6.87%) Apache Hive
18 47 (6.33%) Snowflake Schema
19 40 (5.39%) BusinessObjects
20 39 (5.26%) Cosmos DB
Development Applications
1 27 (3.64%) Git (software)
2 16 (2.16%) Oracle APEX
3 15 (2.02%) Jenkins
3 15 (2.02%) JIRA
4 11 (1.48%) ERwin
5 8 (1.08%) ER Studio
6 7 (0.94%) Octopus Deploy
7 6 (0.81%) Bitbucket
7 6 (0.81%) Maven
7 6 (0.81%) TeamCity
8 5 (0.67%) Subversion
9 4 (0.54%) Cucumber
9 4 (0.54%) Sonatype Nexus
9 4 (0.54%) Visual Studio
10 3 (0.40%) Postman
10 3 (0.40%) SQL Server Management Studio (SSMS)
11 2 (0.27%) CircleCI
11 2 (0.27%) GitLab
11 2 (0.27%) Team Foundation Server
12 1 (0.13%) Visual Studio Team System
General
1 163 (21.97%) Finance
2 42 (5.66%) Retail
3 32 (4.31%) Public Sector
4 28 (3.77%) Banking
5 22 (2.96%) Law
5 22 (2.96%) Marketing
6 10 (1.35%) Front Office
6 10 (1.35%) Games
7 8 (1.08%) Telecoms
8 5 (0.67%) Advertising
8 5 (0.67%) iGaming
8 5 (0.67%) Legal
8 5 (0.67%) Manufacturing
9 4 (0.54%) Housing Association
9 4 (0.54%) Publishing
10 3 (0.40%) Investment Banking
10 3 (0.40%) Pharmaceutical
11 2 (0.27%) Back Office
11 2 (0.27%) Retail Banking
12 1 (0.13%) General Ledger
Job Titles
1 276 (37.20%) Data Engineer
2 176 (23.72%) Architect
3 121 (16.31%) Data Architect
4 110 (14.82%) Developer
5 77 (10.38%) Azure Architect
6 74 (9.97%) Azure Engineer
7 61 (8.22%) Analyst
8 45 (6.06%) Business Intelligence Developer
9 43 (5.80%) Senior Data Engineer
10 40 (5.39%) Data Analyst
11 34 (4.58%) Big Data Engineer
12 33 (4.45%) AWS Engineer
12 33 (4.45%) Enterprise Architect
13 30 (4.04%) Solutions Architect
14 24 (3.23%) Applications Architect
14 24 (3.23%) Python Engineer
15 21 (2.83%) Senior Developer
16 20 (2.70%) Enterprise Applications Architect
17 19 (2.56%) Azure Developer
17 19 (2.56%) Consultant
Libraries, Frameworks & Software Standards
1 76 (10.24%) Kafka
2 50 (6.74%) .NET
3 42 (5.66%) XML
4 32 (4.31%) PySpark
5 29 (3.91%) CSS
6 28 (3.77%) jQuery
7 27 (3.64%) Twitter Bootstrap
8 25 (3.37%) Ajax
8 25 (3.37%) Web Services
9 21 (2.83%) Apache NiFi
10 18 (2.43%) Spring Boot
11 14 (1.89%) JSON
11 14 (1.89%) SOAP
12 12 (1.62%) REST
13 11 (1.48%) Pandas
14 10 (1.35%) EDI
14 10 (1.35%) RESTful
15 9 (1.21%) Node.js
15 9 (1.21%) Spring
15 9 (1.21%) WCF
Miscellaneous
1 89 (11.99%) Analytical Skills
2 39 (5.26%) Algorithms
3 32 (4.31%) Greenfield Project
4 29 (3.91%) Enterprise Software
5 26 (3.50%) Data Structures
6 19 (2.56%) Management Information System
7 16 (2.16%) Life Science
7 16 (2.16%) Reinsurance
8 13 (1.75%) Virtual Team
9 10 (1.35%) Cloud Native
9 10 (1.35%) User Experience
10 9 (1.21%) Credit Risk
10 9 (1.21%) Internet of Things
10 9 (1.21%) Market Risk
11 6 (0.81%) Public Cloud
11 6 (0.81%) Self-Motivation
12 5 (0.67%) Blog
12 5 (0.67%) Online Games
13 4 (0.54%) Fixed Income
13 4 (0.54%) Mainframe
Operating Systems
1 11 (1.48%) Unix
2 9 (1.21%) Linux
3 7 (0.94%) Windows
4 2 (0.27%) Windows Server
Processes & Methodologies
1 385 (51.89%) Business Intelligence
2 311 (41.91%) Analytics
3 288 (38.81%) ETL
4 228 (30.73%) Data Modelling
5 221 (29.78%) Agile Software Development
6 184 (24.80%) DevOps
7 138 (18.60%) Data Engineering
8 137 (18.46%) Data Architecture
9 134 (18.06%) Data Science
10 124 (16.71%) Visualisation
11 120 (16.17%) Machine Learning
12 103 (13.88%) Data Analytics
13 91 (12.26%) Migration
14 80 (10.78%) Microservices
15 78 (10.51%) Data Strategy
16 77 (10.38%) Data Management
17 69 (9.30%) Stakeholder Management
18 67 (9.03%) Problem-Solving
19 59 (7.95%) Data Visualisation
20 57 (7.68%) Continuous Integration
Programming Languages
1 432 (58.22%) SQL
2 325 (43.80%) Python
3 70 (9.43%) Scala
4 69 (9.30%) Java
5 61 (8.22%) T-SQL
6 55 (7.41%) C#
7 51 (6.87%) R
8 35 (4.72%) Data Analysis Expressions (DAX)
9 30 (4.04%) PowerShell
10 13 (1.75%) Bash Shell
10 13 (1.75%) JavaScript
10 13 (1.75%) U-SQL
11 10 (1.35%) PL/SQL
12 9 (1.21%) VBA
13 5 (0.67%) Go
14 3 (0.40%) C
14 3 (0.40%) Cython
14 3 (0.40%) Google Apps Script
14 3 (0.40%) Java 8
14 3 (0.40%) TypeScript
Qualifications
1 66 (8.89%) Degree
2 26 (3.50%) Computer Science Degree
3 18 (2.43%) Security Cleared
4 17 (2.29%) SC Cleared
5 9 (1.21%) Microsoft Certification
6 8 (1.08%) ITIL Certification
7 4 (0.54%) AWS Certification
7 4 (0.54%) DV Cleared
8 3 (0.40%) AAT
8 3 (0.40%) ACCA
8 3 (0.40%) CIMA
8 3 (0.40%) DBS Check
8 3 (0.40%) ISEB
8 3 (0.40%) MBCS
8 3 (0.40%) PhD
8 3 (0.40%) PMI Certification
9 1 (0.13%) Numerate Degree
9 1 (0.13%) PMP
9 1 (0.13%) PRINCE2 Practitioner
9 1 (0.13%) TOGAF Certification
Quality Assurance & Compliance
1 59 (7.95%) Data Quality
2 26 (3.50%) QA
3 13 (1.75%) GDPR
4 2 (0.27%) ISO/IEC 20000
4 2 (0.27%) SLA
5 1 (0.13%) NIST
5 1 (0.13%) Sarbanes-Oxley
System Software
1 23 (3.10%) Docker
1 23 (3.10%) HDFS
2 6 (0.81%) Active Directory
2 6 (0.81%) Apache ZooKeeper
3 1 (0.13%) Hyper-V
3 1 (0.13%) VMware Infrastructure
Systems Management
1 36 (4.85%) Kubernetes
1 36 (4.85%) Terraform
2 16 (2.16%) Puppet
3 9 (1.21%) Ansible
3 9 (1.21%) Oozie
4 7 (0.94%) Grafana
4 7 (0.94%) Hadoop YARN
4 7 (0.94%) Packer
5 5 (0.67%) Opscode Chef
6 2 (0.27%) SCCM
7 1 (0.13%) Failover Clustering
7 1 (0.13%) Single Sign-On
7 1 (0.13%) vCenter Server
7 1 (0.13%) ZABBIX
Vendors
1 274 (36.93%) Databricks
2 260 (35.04%) Microsoft
3 51 (6.87%) Oracle
4 31 (4.18%) Google
5 27 (3.64%) SAP
6 20 (2.70%) Cognos
7 19 (2.56%) Cloudera
7 19 (2.56%) Informatica
8 18 (2.43%) Teradata
9 17 (2.29%) Salesforce.com
9 17 (2.29%) Talend
10 12 (1.62%) Sparx
11 10 (1.35%) Sage
12 9 (1.21%) Alteryx
12 9 (1.21%) MuleSoft
13 7 (0.94%) IBM
13 7 (0.94%) JD Edwards
14 6 (0.81%) MicroStrategy
14 6 (0.81%) Snowplow
15 5 (0.67%) StreamSets
179 Data Lake job vacancies Nationwide