Period
to 26 September 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 26 September 2021 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
26 Sep 2021
Same period 2020 Same period 2019
Rank 297 261 471
Rank change year-on-year -36 +210 +116
Permanent jobs citing Data Lake 1,254 542 827
As % of all permanent jobs advertised in England 1.17% 1.22% 0.64%
As % of the Database & Business Intelligence category 4.16% 4.21% 2.33%
Number of salaries quoted 920 423 671
10th Percentile £46,250 £46,250 £41,471
25th Percentile £55,000 £52,500 £50,000
Median annual salary (50th Percentile) £70,000 £67,500 £65,000
Median % change year-on-year +3.70% +3.85% -
75th Percentile £86,250 £78,500 £85,000
90th Percentile £102,500 £90,000 £100,000
UK median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 30,139 12,874 35,510
As % of all permanent IT jobs advertised in England 28.17% 29.02% 27.37%
Number of salaries quoted 19,785 10,910 29,593
10th Percentile £35,000 £33,750 £31,500
25th Percentile £42,500 £42,500 £38,750
Median annual salary (50th Percentile) £57,500 £55,000 £52,500
Median % change year-on-year +4.55% +4.76% +5.00%
75th Percentile £77,500 £73,750 £70,950
90th Percentile £95,000 £90,000 £86,250
UK median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

Salary distribution for jobs citing Data Lake in England over the 6 months to 26 September 2021.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 26 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -21 708 £80,000 +6.67% 112
South East -26 204 £65,000 +8.33% 33
Midlands -80 126 £57,500 +4.55% 24
North of England -124 107 £57,500 -14.81% 30
West Midlands -71 93 £55,000 - 16
North West -113 56 £60,000 -14.29% 20
East of England -57 50 £65,000 -7.14% 12
Yorkshire -78 47 £56,250 +18.42% 5
South West -98 35 £47,500 -32.14% 7
East Midlands -59 33 £60,000 +20.00% 8
North East -27 4 £60,000 - 5
Data Lake
UK

For the 6 months to 26 September 2021, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 773 (61.64%) Azure
2 735 (58.61%) SQL
3 658 (52.47%) Data Warehouse
4 579 (46.17%) Business Intelligence
5 572 (45.61%) Analytics
6 527 (42.03%) Python
7 490 (39.07%) ETL
8 447 (35.65%) AWS
9 445 (35.49%) Agile Software Development
10 406 (32.38%) Data Modelling
11 388 (30.94%) Power Platform
12 378 (30.14%) Power BI
13 365 (29.11%) Databricks
14 358 (28.55%) Azure Data Factory
15 332 (26.48%) Microsoft
16 319 (25.44%) DevOps
17 312 (24.88%) Big Data
18 299 (23.84%) Data Engineering
19 271 (21.61%) Social Skills
20 269 (21.45%) SQL Server
21 241 (19.22%) Data Pipeline
22 229 (18.26%) Apache Spark
23 228 (18.18%) Finance
24 214 (17.07%) Data Science
25 213 (16.99%) Data Management
26 208 (16.59%) Data Architecture
27 189 (15.07%) GCP
28 181 (14.43%) SQL Server Integration Services
29 179 (14.27%) NoSQL
30 176 (14.04%) Azure Synapse Analytics

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 229 (18.26%) Apache Spark
2 66 (5.26%) Apache
3 57 (4.55%) Apache Airflow
4 30 (2.39%) Confluence
5 13 (1.04%) Oracle SOA Suite
5 13 (1.04%) SharePoint
6 10 (0.80%) Elasticsearch
7 7 (0.56%) Luigi
8 6 (0.48%) Apache Pig
9 5 (0.40%) Oracle Workflow
9 5 (0.40%) SAS
10 4 (0.32%) Jupyter
11 3 (0.24%) JBoss
11 3 (0.24%) Tomcat
12 2 (0.16%) Apache Synapse
12 2 (0.16%) WebSphere
13 1 (0.080%) GlassFish
13 1 (0.080%) IIS
13 1 (0.080%) WebLogic
Applications
1 31 (2.47%) Microsoft Excel
2 18 (1.44%) Microsoft Office
3 9 (0.72%) Microsoft Project
3 9 (0.72%) MS Visio
4 2 (0.16%) Microsoft PowerPoint
5 1 (0.080%) SPSS
Business Applications
1 14 (1.12%) Dynamics CRM
2 8 (0.64%) Adobe Campaign
3 5 (0.40%) Dynamics AX
4 4 (0.32%) Magento
4 4 (0.32%) OPENHousing
4 4 (0.32%) Unit4 Business World
5 2 (0.16%) Sparx Enterprise Architect
6 1 (0.080%) Maximo
6 1 (0.080%) SAP Oil and Gas
6 1 (0.080%) SAP S/4HANA
Cloud Services
1 773 (61.64%) Azure
2 447 (35.65%) AWS
3 388 (30.94%) Power Platform
4 358 (28.55%) Azure Data Factory
5 189 (15.07%) GCP
6 176 (14.04%) Azure Synapse Analytics
7 103 (8.21%) Snowflake
8 93 (7.42%) Amazon S3
9 91 (7.26%) Azure Cosmos DB
9 91 (7.26%) Serverless
10 75 (5.98%) PaaS
11 57 (4.55%) Microsoft 365
12 55 (4.39%) AWS Lambda
12 55 (4.39%) Azure Service Bus
13 54 (4.31%) Amazon Kinesis
14 46 (3.67%) Amazon EC2
15 40 (3.19%) SaaS
16 38 (3.03%) Azure Logic Apps
17 36 (2.87%) Azure Storage
18 34 (2.71%) Azure Service Fabric
Communications & Networking
1 23 (1.83%) Wireless
2 12 (0.96%) 4G
2 12 (0.96%) 5G
2 12 (0.96%) Internet
3 11 (0.88%) Extranet
4 10 (0.80%) Cisco IPT
5 8 (0.64%) Firewall
6 5 (0.40%) BGP
6 5 (0.40%) Cisco ASA
6 5 (0.40%) HTTP
6 5 (0.40%) LAN
6 5 (0.40%) OSPF
6 5 (0.40%) WAN
7 4 (0.32%) VPN
8 3 (0.24%) Broadband
9 2 (0.16%) DNS
9 2 (0.16%) FTP
9 2 (0.16%) Skype
10 1 (0.080%) ATM
Database & Business Intelligence
1 658 (52.47%) Data Warehouse
2 378 (30.14%) Power BI
3 312 (24.88%) Big Data
4 269 (21.45%) SQL Server
5 181 (14.43%) SQL Server Integration Services
6 179 (14.27%) NoSQL
7 175 (13.96%) Azure SQL Database
8 149 (11.88%) Hadoop
9 129 (10.29%) SQL Server Analysis Services
10 126 (10.05%) Relational Database
11 111 (8.85%) SQL Server Reporting Services
12 101 (8.05%) Tableau
13 98 (7.81%) Amazon Redshift
14 96 (7.66%) Azure SQL Data Warehouse
15 93 (7.42%) MongoDB
16 77 (6.14%) PostgreSQL
17 65 (5.18%) BigQuery
18 61 (4.86%) Amazon RDS
18 61 (4.86%) Apache Hive
19 59 (4.70%) Metadata
Development Applications
1 92 (7.34%) Git (software)
2 75 (5.98%) JIRA
3 34 (2.71%) Jenkins
4 32 (2.55%) Visual Studio
5 28 (2.23%) CircleCI
6 22 (1.75%) Oracle APEX
6 22 (1.75%) webpack
7 15 (1.20%) Babel
8 13 (1.04%) ER Studio
8 13 (1.04%) kappa
9 12 (0.96%) Bitbucket
9 12 (0.96%) ERwin
10 10 (0.80%) Selenium
11 9 (0.72%) SQL Server Management Studio (SSMS)
11 9 (0.72%) Team Foundation Server
12 8 (0.64%) SpecFlow
12 8 (0.64%) TeamCity
13 7 (0.56%) NUnit
13 7 (0.56%) Postman
13 7 (0.56%) Storybook
General
1 271 (21.61%) Social Skills
2 228 (18.18%) Finance
3 140 (11.16%) Analytical Skills
4 66 (5.26%) Retail
5 50 (3.99%) Marketing
6 41 (3.27%) Telecoms
7 33 (2.63%) Presentation Skills
8 30 (2.39%) Banking
8 30 (2.39%) Law
9 22 (1.75%) Wearables
10 14 (1.12%) Manufacturing
11 12 (0.96%) Advertising
12 10 (0.80%) Influencing Skills
12 10 (0.80%) Pharmaceutical
13 9 (0.72%) Front Office
13 9 (0.72%) Legal
13 9 (0.72%) Organisational Skills
13 9 (0.72%) Public Sector
14 6 (0.48%) Games
14 6 (0.48%) Investment Banking
Job Titles
1 453 (36.12%) Data Engineer
2 271 (21.61%) Architect
3 220 (17.54%) Data Architect
4 198 (15.79%) Developer
5 100 (7.97%) Azure Engineer
6 75 (5.98%) Senior Data Engineer
7 73 (5.82%) Solutions Architect
8 70 (5.58%) Analyst
9 57 (4.55%) Azure Architect
10 52 (4.15%) Senior Developer
11 51 (4.07%) Python Engineer
12 50 (3.99%) AWS Engineer
13 49 (3.91%) Software Engineer
14 47 (3.75%) Business Intelligence Developer
15 43 (3.43%) Consultant
16 41 (3.27%) Data Analyst
17 38 (3.03%) Azure Developer
17 38 (3.03%) Big Data Engineer
18 32 (2.55%) C# Developer
19 31 (2.47%) Big Data Architect
Libraries, Frameworks & Software Standards
1 130 (10.37%) Kafka
2 97 (7.74%) PySpark
3 81 (6.46%) .NET
4 46 (3.67%) React
5 45 (3.59%) REST
6 44 (3.51%) HTML
7 41 (3.27%) Web Services
8 35 (2.79%) MDX
9 30 (2.39%) .NET Core
10 29 (2.31%) RESTful
10 29 (2.31%) SOAP
11 26 (2.07%) HTML5
12 25 (1.99%) ARM Templates
12 25 (1.99%) JSON
13 23 (1.83%) NumPy
14 22 (1.75%) WCF
15 20 (1.59%) Django
15 20 (1.59%) Pandas
16 18 (1.44%) CSS
17 16 (1.28%) GraphQL
Miscellaneous
1 58 (4.63%) Data Structures
2 47 (3.75%) Cloud Native
2 47 (3.75%) User Experience
3 40 (3.19%) Algorithms
3 40 (3.19%) Life Science
4 39 (3.11%) Greenfield Project
5 36 (2.87%) Management Information System
6 35 (2.79%) Virtual Team
7 28 (2.23%) Public Cloud
8 22 (1.75%) Legacy Systems
9 21 (1.67%) Self-Motivation
10 20 (1.59%) Renewable Energy
11 18 (1.44%) Enterprise Software
12 15 (1.20%) 3D Graphics
12 15 (1.20%) Reference Data
13 12 (0.96%) Data Centre
13 12 (0.96%) Mobile App
14 11 (0.88%) Acoustics
14 11 (0.88%) Client/Server
15 9 (0.72%) Reinsurance
Operating Systems
1 19 (1.52%) Linux
2 17 (1.36%) VMS
3 16 (1.28%) Apple iOS
3 16 (1.28%) Unix
4 15 (1.20%) Android
5 13 (1.04%) Windows
6 2 (0.16%) Windows Server
Processes & Methodologies
1 579 (46.17%) Business Intelligence
2 572 (45.61%) Analytics
3 490 (39.07%) ETL
4 445 (35.49%) Agile Software Development
5 406 (32.38%) Data Modelling
6 319 (25.44%) DevOps
7 299 (23.84%) Data Engineering
8 241 (19.22%) Data Pipeline
9 214 (17.07%) Data Science
10 213 (16.99%) Data Management
11 208 (16.59%) Data Architecture
12 164 (13.08%) Visualisation
13 145 (11.56%) Problem-Solving
14 142 (11.32%) Microservices
15 131 (10.45%) Data Analytics
16 130 (10.37%) Data Strategy
17 125 (9.97%) Machine Learning
18 124 (9.89%) Migration
19 122 (9.73%) Artificial Intelligence
20 119 (9.49%) Scrum
Programming Languages
1 735 (58.61%) SQL
2 527 (42.03%) Python
3 170 (13.56%) Java
4 168 (13.40%) C#
5 142 (11.32%) PowerShell
6 93 (7.42%) T-SQL
7 78 (6.22%) JavaScript
8 71 (5.66%) Scala
9 58 (4.63%) Data Analysis Expressions (DAX)
10 55 (4.39%) R
11 31 (2.47%) Bash Shell
11 31 (2.47%) Go
12 27 (2.15%) C
13 20 (1.59%) U-SQL
14 14 (1.12%) Kotlin
14 14 (1.12%) PL/SQL
15 11 (0.88%) Shell Script
16 7 (0.56%) C++
16 7 (0.56%) ES6
16 7 (0.56%) X++
Qualifications
1 93 (7.42%) Degree
2 23 (1.83%) Microsoft Certification
3 22 (1.75%) Security Cleared
4 20 (1.59%) SC Cleared
5 15 (1.20%) Computer Science Degree
6 14 (1.12%) TOGAF Certification
7 12 (0.96%) AWS Certification
8 10 (0.80%) (ISC)2 CCSP
8 10 (0.80%) Cisco Certification
8 10 (0.80%) CISSP
8 10 (0.80%) ISEB
9 8 (0.64%) CCSP
10 7 (0.56%) ISTQB
10 7 (0.56%) Master's Degree
11 5 (0.40%) DV Cleared
12 4 (0.32%) MCSA
12 4 (0.32%) MCSE
13 3 (0.24%) BC Cleared
13 3 (0.24%) PhD
14 2 (0.16%) MBCS
Quality Assurance & Compliance
1 105 (8.37%) Data Quality
2 53 (4.23%) QA
3 27 (2.15%) GDPR
4 7 (0.56%) GxP
5 6 (0.48%) ISO/IEC 27001
6 5 (0.40%) PMO
7 4 (0.32%) PCI DSS
7 4 (0.32%) SOC 2
8 2 (0.16%) Accessibility
8 2 (0.16%) NIST
8 2 (0.16%) SLA
System Software
1 94 (7.50%) Docker
2 17 (1.36%) Active Directory
3 16 (1.28%) Firmware
4 9 (0.72%) Virtual Machines
5 7 (0.56%) HDFS
6 6 (0.48%) Hyper-V
7 5 (0.40%) Apache Flume
7 5 (0.40%) VMware Infrastructure
8 1 (0.080%) Apache ZooKeeper
Systems Management
1 104 (8.29%) Kubernetes
2 46 (3.67%) Terraform
3 14 (1.12%) Puppet
4 13 (1.04%) Ansible
5 7 (0.56%) Grafana
5 7 (0.56%) HP ALM
5 7 (0.56%) HP Quality Center
5 7 (0.56%) Istio
5 7 (0.56%) Prometheus
6 6 (0.48%) Opscode Chef
7 5 (0.40%) Oozie
8 3 (0.24%) FortiGate
9 2 (0.16%) Active Directory Federation Services
9 2 (0.16%) Rancher
10 1 (0.080%) Hadoop YARN
10 1 (0.080%) SCCM
Vendors
1 365 (29.11%) Databricks
2 332 (26.48%) Microsoft
3 94 (7.50%) Oracle
4 82 (6.54%) Google
5 60 (4.78%) Salesforce.com
6 34 (2.71%) SAP
7 25 (1.99%) Talend
8 23 (1.83%) Palantir
9 22 (1.75%) Alteryx
10 19 (1.52%) Informatica
11 18 (1.44%) IBM
11 18 (1.44%) Teradata
12 17 (1.36%) ServiceNow
13 14 (1.12%) Cloudera
14 11 (0.88%) Adobe
14 11 (0.88%) MuleSoft
15 10 (0.80%) Cognos
16 9 (0.72%) Hortonworks
16 9 (0.72%) StreamSets
17 8 (0.64%) HP