Period
to 19 October 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 19 October 2020 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
19 Oct 2020
Same period 2019 Same period 2018
Rank 257 467 577
Rank change year-on-year +210 +110 +311
Permanent jobs citing Data Lake 562 786 693
As % of all permanent jobs advertised in England 1.26% 0.62% 0.45%
As % of the Database & Business Intelligence category 4.45% 2.32% 1.53%
Number of salaries quoted 474 675 569
Median annual salary £65,000 £65,000 £65,000
10th Percentile £46,250 £42,350 £45,000
90th Percentile £95,000 £97,500 £100,000
UK median annual salary £65,000 £65,000 £65,000

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 12,634 33,882 45,308
As % of all permanent IT jobs advertised in England 28.41% 26.91% 29.50%
Number of salaries quoted 10,708 28,153 37,118
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% -
10th Percentile £33,750 £31,589 £31,250
90th Percentile £90,000 £86,250 £83,750
UK median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +4.17%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

Salary distribution for jobs citing Data Lake in England over the 6 months to 19 October 2020.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 19 October 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +138 295 £75,000 +3.45% 31
North of England +201 102 £55,000 +10.00% 19
Midlands +176 79 £55,000 - 7
North West +170 76 £68,750 +37.50% 14
West Midlands +152 58 £55,000 -15.38% 5
South East +159 47 £60,000 -4.00% 7
South West +78 26 £62,500 +4.17% 4
Yorkshire +133 25 £47,500 +5.07% 3
East Midlands +83 21 £50,250 -8.64% 2
East of England +83 7 £65,000 +44.44% 3
North East +4 1 - - 2
Data Lake
UK

For the 6 months to 19 October 2020, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 357 (63.52%) Azure
2 313 (55.69%) SQL
3 296 (52.67%) Data Warehouse
4 283 (50.36%) Business Intelligence
5 262 (46.62%) Analytics
6 228 (40.57%) Python
7 221 (39.32%) Big Data
8 215 (38.26%) Agile Software Development
9 211 (37.54%) Databricks
10 202 (35.94%) Microsoft
11 200 (35.59%) Finance
12 189 (33.63%) ETL
12 189 (33.63%) Power Platform
13 178 (31.67%) Power BI
14 156 (27.76%) Azure Data Factory
15 153 (27.22%) SQL Server
16 144 (25.62%) Data Modelling
17 142 (25.27%) AWS
18 135 (24.02%) DevOps
19 105 (18.68%) SQL Server Integration Services
20 102 (18.15%) Data Engineering
21 101 (17.97%) Apache Spark
22 99 (17.62%) Azure SQL Database
22 99 (17.62%) R
23 96 (17.08%) Analytical Skills
24 83 (14.77%) SQL Server Analysis Services
25 79 (14.06%) Azure SQL Data Warehouse
26 78 (13.88%) Machine Learning
27 76 (13.52%) Data Analytics
27 76 (13.52%) Kafka

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 101 (17.97%) Apache Spark
2 30 (5.34%) Apache
3 17 (3.02%) SharePoint
4 9 (1.60%) Cloud Foundry
5 8 (1.42%) Apache Airflow
6 6 (1.07%) Apache Pig
7 5 (0.89%) Luigi
8 4 (0.71%) Apache Synapse
8 4 (0.71%) Confluence
8 4 (0.71%) Jupyter
9 2 (0.36%) Oracle SOA Suite
9 2 (0.36%) SAS
10 1 (0.18%) Apache Solr
10 1 (0.18%) Elasticsearch
Applications
1 10 (1.78%) Microsoft Excel
2 1 (0.18%) SPSS
2 1 (0.18%) SPSS Modeler
Business Applications
1 5 (0.89%) SAP IS-U
2 2 (0.36%) Dynamics CRM
3 1 (0.18%) Dynamics AX
3 1 (0.18%) Sparx Enterprise Architect
Cloud Services
1 357 (63.52%) Azure
2 189 (33.63%) Power Platform
3 156 (27.76%) Azure Data Factory
4 142 (25.27%) AWS
5 70 (12.46%) SaaS
6 60 (10.68%) PaaS
7 51 (9.07%) GCP
8 41 (7.30%) Serverless
9 38 (6.76%) IaaS
10 34 (6.05%) Amazon S3
11 18 (3.20%) Amazon CloudWatch
11 18 (3.20%) Amazon GuardDuty
11 18 (3.20%) AWS CloudTrail
12 16 (2.85%) PowerApps
13 15 (2.67%) Amazon EMR
13 15 (2.67%) Azure Stack
14 13 (2.31%) Amazon Kinesis
14 13 (2.31%) Dynamics 365
15 12 (2.14%) AWS Lambda
16 11 (1.96%) Logic Apps
Communications & Networking
1 18 (3.20%) Skype
2 4 (0.71%) Internet
3 3 (0.53%) Firewall
4 2 (0.36%) Wireless
5 1 (0.18%) IPsec
5 1 (0.18%) Kerberos
5 1 (0.18%) SSL
5 1 (0.18%) VPN
Database & Business Intelligence
1 296 (52.67%) Data Warehouse
2 221 (39.32%) Big Data
3 178 (31.67%) Power BI
4 153 (27.22%) SQL Server
5 105 (18.68%) SQL Server Integration Services
6 99 (17.62%) Azure SQL Database
7 83 (14.77%) SQL Server Analysis Services
8 79 (14.06%) Azure SQL Data Warehouse
9 76 (13.52%) Hadoop
10 70 (12.46%) SQL Server Reporting Services
11 57 (10.14%) NoSQL
12 52 (9.25%) Snowflake Schema
13 49 (8.72%) Amazon Redshift
14 47 (8.36%) Apache Hive
15 44 (7.83%) BigQuery
16 43 (7.65%) Cosmos DB
17 41 (7.30%) Relational Database
18 34 (6.05%) RDBMS
19 32 (5.69%) HDInsight
20 29 (5.16%) Microsoft Analysis Services
Development Applications
1 30 (5.34%) Git (software)
2 20 (3.56%) Jenkins
3 14 (2.49%) Cucumber
4 13 (2.31%) Visual Studio
5 8 (1.42%) ERwin
6 5 (0.89%) Atlassian Bamboo
6 5 (0.89%) Octopus Deploy
6 5 (0.89%) Team Foundation Server
6 5 (0.89%) TeamCity
7 4 (0.71%) GitLab
7 4 (0.71%) JIRA
8 3 (0.53%) ER Studio
8 3 (0.53%) Visual Studio Team System
9 2 (0.36%) Artifactory
9 2 (0.36%) GDB
9 2 (0.36%) JUnit
9 2 (0.36%) Selenium
9 2 (0.36%) SQL Server Management Studio (SSMS)
9 2 (0.36%) tSQLt
9 2 (0.36%) xUnit.net
General
1 200 (35.59%) Finance
2 38 (6.76%) Banking
3 19 (3.38%) Marketing
4 14 (2.49%) Retail
5 13 (2.31%) Front Office
5 13 (2.31%) Law
6 9 (1.60%) Advertising
7 3 (0.53%) Back Office
7 3 (0.53%) Investment Banking
7 3 (0.53%) Pharmaceutical
7 3 (0.53%) Police
8 2 (0.36%) Legal
8 2 (0.36%) Manufacturing
8 2 (0.36%) Public Sector
8 2 (0.36%) Publishing
8 2 (0.36%) Telecoms
9 1 (0.18%) Billing
9 1 (0.18%) Dutch Language
9 1 (0.18%) French Language
9 1 (0.18%) Games
Job Titles
1 168 (29.89%) Data Engineer
2 133 (23.67%) Developer
3 127 (22.60%) Architect
4 75 (13.35%) Azure Engineer
5 69 (12.28%) Business Intelligence Developer
6 67 (11.92%) Data Architect
7 55 (9.79%) Solutions Architect
8 53 (9.43%) Azure Architect
9 42 (7.47%) Azure Developer
10 33 (5.87%) Cloud Architect
11 30 (5.34%) Analyst
11 30 (5.34%) Cloud Solutions Architect
12 29 (5.16%) SQL Developer
13 27 (4.80%) Data Warehouse Developer
14 23 (4.09%) Senior Developer
15 20 (3.56%) Business Intelligence Lead
15 20 (3.56%) Lead Developer
15 20 (3.56%) Python Engineer
16 19 (3.38%) AWS Engineer
16 19 (3.38%) SQL BI Developer
Libraries, Frameworks & Software Standards
1 76 (13.52%) Kafka
2 71 (12.63%) .NET
3 22 (3.91%) CSS
3 22 (3.91%) PySpark
4 17 (3.02%) XML
5 16 (2.85%) ASP.NET
6 14 (2.49%) ASP.NET Web API
6 14 (2.49%) Web Services
7 13 (2.31%) HTML
7 13 (2.31%) MDX
8 12 (2.14%) HTML5
9 11 (1.96%) jQuery
9 11 (1.96%) JSON
9 11 (1.96%) REST
9 11 (1.96%) Twitter Bootstrap
10 9 (1.60%) .NET Core
10 9 (1.60%) Ajax
11 8 (1.42%) Apache NiFi
11 8 (1.42%) ASP.NET MVC
12 7 (1.25%) RESTful
Miscellaneous
1 96 (17.08%) Analytical Skills
2 36 (6.41%) Greenfield Project
3 31 (5.52%) Data Structures
4 29 (5.16%) Management Information System
5 22 (3.91%) Cloud Native
6 17 (3.02%) Enterprise Software
7 9 (1.60%) Equities
8 8 (1.42%) Algorithms
8 8 (1.42%) Foreign Exchange (FX)
8 8 (1.42%) Hedge funds
8 8 (1.42%) Reference Data
9 7 (1.25%) Fixed Income
10 6 (1.07%) Credit Risk
11 5 (0.89%) Data Centre
12 4 (0.71%) Blog
13 3 (0.53%) Internet of Things
13 3 (0.53%) Market Risk
13 3 (0.53%) Public Cloud
14 2 (0.36%) Self-Motivation
14 2 (0.36%) Virtual Team
Operating Systems
1 20 (3.56%) Linux
2 19 (3.38%) Unix
2 19 (3.38%) Windows
3 6 (1.07%) Red Hat Enterprise Linux
4 3 (0.53%) Windows Server
5 1 (0.18%) Android
5 1 (0.18%) Apple iOS
Processes & Methodologies
1 283 (50.36%) Business Intelligence
2 262 (46.62%) Analytics
3 215 (38.26%) Agile Software Development
4 189 (33.63%) ETL
5 144 (25.62%) Data Modelling
6 135 (24.02%) DevOps
7 102 (18.15%) Data Engineering
8 78 (13.88%) Machine Learning
9 76 (13.52%) Data Analytics
10 74 (13.17%) Migration
11 64 (11.39%) Data Science
12 59 (10.50%) SDLC
12 59 (10.50%) Stakeholder Management
13 54 (9.61%) Visualisation
14 53 (9.43%) Continuous Integration
15 52 (9.25%) Data Strategy
16 51 (9.07%) Test Automation
17 48 (8.54%) Scrum
18 45 (8.01%) Computer Science
18 45 (8.01%) Enterprise Architecture
Programming Languages
1 313 (55.69%) SQL
2 228 (40.57%) Python
3 99 (17.62%) R
4 57 (10.14%) T-SQL
5 55 (9.79%) Scala
6 51 (9.07%) Java
7 41 (7.30%) C#
8 33 (5.87%) Data Analysis Expressions (DAX)
9 32 (5.69%) PowerShell
10 26 (4.63%) JavaScript
11 14 (2.49%) C++
12 13 (2.31%) Perl
13 12 (2.14%) VB.NET
14 10 (1.78%) U-SQL
15 7 (1.25%) C
16 5 (0.89%) Bash Shell
17 4 (0.71%) Shell Script
18 1 (0.18%) Go
18 1 (0.18%) Ruby
18 1 (0.18%) VB
Qualifications
1 68 (12.10%) Degree
2 12 (2.14%) Computer Science Degree
3 11 (1.96%) AWS Certification
4 8 (1.42%) Microsoft Certification
5 6 (1.07%) ITIL Certification
6 4 (0.71%) MCSA
6 4 (0.71%) TOGAF Certification
7 3 (0.53%) PhD
8 2 (0.36%) Cisco Certification
8 2 (0.36%) Master's Degree
8 2 (0.36%) MCSE
8 2 (0.36%) MCTS
9 1 (0.18%) CCIE
9 1 (0.18%) CCNP
9 1 (0.18%) CISSP
9 1 (0.18%) MBA
9 1 (0.18%) Numerate Degree
9 1 (0.18%) Sun Certification
Quality Assurance & Compliance
1 51 (9.07%) Data Quality
2 14 (2.49%) NIST
3 11 (1.96%) QA
4 6 (1.07%) GDPR
4 6 (1.07%) Sarbanes-Oxley
5 1 (0.18%) Dodd-Frank
5 1 (0.18%) EMIR
5 1 (0.18%) ISO/IEC 27001
5 1 (0.18%) MiFID
5 1 (0.18%) SLA
System Software
1 30 (5.34%) Docker
2 20 (3.56%) HDFS
3 13 (2.31%) Apache ZooKeeper
4 7 (1.25%) Active Directory
5 4 (0.71%) Virtual Machines
6 2 (0.36%) Hyper-V
7 1 (0.18%) Apache Flume
Systems Management
1 42 (7.47%) Kubernetes
2 22 (3.91%) Terraform
3 20 (3.56%) Hadoop YARN
4 7 (1.25%) Puppet
5 6 (1.07%) Grafana
5 6 (1.07%) Packer
6 4 (0.71%) Oozie
7 2 (0.36%) Fluentd
7 2 (0.36%) Nagios
7 2 (0.36%) SCVMM
8 1 (0.18%) Microsoft Intune
Vendors
1 211 (37.54%) Databricks
2 202 (35.94%) Microsoft
3 48 (8.54%) Tableau
4 39 (6.94%) Sparx
5 28 (4.98%) Teradata
6 20 (3.56%) Oracle
7 18 (3.20%) Google
8 14 (2.49%) Informatica
8 14 (2.49%) Talend
9 13 (2.31%) Cloudera
10 12 (2.14%) Ab Initio
11 10 (1.78%) Hortonworks
11 10 (1.78%) Splunk
12 9 (1.60%) Alteryx
13 8 (1.42%) IBM
14 6 (1.07%) Red Hat
14 6 (1.07%) SAP
15 5 (0.89%) Blue Prism
16 4 (0.71%) Cognos
16 4 (0.71%) Netezza