Period
to 27 January 2022

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 27 January 2022 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
27 Jan 2022
Same period 2021 Same period 2020
Rank 265 285 494
Rank change year-on-year +20 +209 +64
Permanent jobs citing Data Lake 1,492 643 651
As % of all permanent jobs advertised in England 1.32% 1.10% 0.56%
As % of the Database & Business Intelligence category 4.99% 4.01% 2.08%
Number of salaries quoted 971 542 553
10th Percentile £47,500 £46,250 £43,050
25th Percentile £55,000 £52,500 £53,000
Median annual salary (50th Percentile) £70,000 £70,000 £70,000
Median % change year-on-year - - +7.69%
75th Percentile £85,000 £88,750 £85,000
90th Percentile £102,500 £105,000 £92,500
UK median annual salary £70,000 £70,000 £70,000
% change year-on-year - - +7.69%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 29,929 16,019 31,319
As % of all permanent IT jobs advertised in England 26.55% 27.50% 27.12%
Number of salaries quoted 19,494 13,700 26,099
10th Percentile £36,250 £33,750 £32,500
25th Percentile £43,750 £42,500 £40,000
Median annual salary (50th Percentile) £60,000 £55,000 £52,500
Median % change year-on-year +9.09% +4.76% -
75th Percentile £77,500 £73,750 £72,500
90th Percentile £95,000 £88,750 £90,000
UK median annual salary £60,000 £55,000 £52,500
% change year-on-year +9.09% +4.76% -

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

Salary distribution for jobs citing Data Lake in England over the 6 months to 27 January 2022.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 27 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London -23 756 £75,000 -6.25% 121
South East +75 279 £62,500 +13.64% 40
North of England -87 161 £60,000 +9.09% 34
Midlands +2 145 £57,500 +4.55% 32
West Midlands -6 92 £55,000 - 27
North West -94 87 £60,000 -14.29% 19
Yorkshire -56 65 £60,000 +23.08% 12
East Midlands -20 53 £57,500 +4.55% 5
East of England -59 53 £65,000 -31.58% 14
South West -37 40 £51,500 -1.90% 13
North East -22 9 £70,000 +44.70% 3
Data Lake
UK

For the 6 months to 27 January 2022, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 1,020 (68.36%) Azure
2 789 (52.88%) Analytics
3 788 (52.82%) SQL
4 770 (51.61%) Python
5 754 (50.54%) Agile Software Development
6 687 (46.05%) Data Warehouse
7 676 (45.31%) ETL
8 605 (40.55%) Databricks
9 588 (39.41%) Business Intelligence
10 551 (36.93%) AWS
11 521 (34.92%) Azure Data Factory
12 502 (33.65%) Big Data
13 501 (33.58%) DevOps
14 436 (29.22%) Microsoft
15 427 (28.62%) Power Platform
16 420 (28.15%) Power BI
17 409 (27.41%) Data Modelling
18 408 (27.35%) Java
19 379 (25.40%) CI/CD
20 375 (25.13%) Data Engineering
21 355 (23.79%) Data Management
22 346 (23.19%) PowerShell
23 345 (23.12%) Data Pipeline
24 324 (21.72%) Social Skills
24 324 (21.72%) Azure Synapse Analytics
25 294 (19.71%) Finance
26 283 (18.97%) SQL Server
26 283 (18.97%) NoSQL
27 279 (18.70%) Apache Spark
27 279 (18.70%) C#

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 279 (18.70%) Apache Spark
2 121 (8.11%) Apache
3 110 (7.37%) Apache Airflow
4 47 (3.15%) Confluence
5 16 (1.07%) SAS
6 15 (1.01%) SharePoint
7 14 (0.94%) Luigi
8 11 (0.74%) Oracle SOA Suite
9 8 (0.54%) Elasticsearch
9 8 (0.54%) Oracle Workflow
10 7 (0.47%) CMS
11 6 (0.40%) IIS
12 4 (0.27%) Apache Pig
12 4 (0.27%) Apache Solr
13 2 (0.13%) Jupyter
14 1 (0.067%) MS Exchange
14 1 (0.067%) nginx
14 1 (0.067%) Oracle Coherence
Applications
1 40 (2.68%) Microsoft Excel
2 9 (0.60%) Microsoft Office
3 6 (0.40%) MS Visio
4 3 (0.20%) Microsoft Project
5 2 (0.13%) Microsoft PowerPoint
6 1 (0.067%) Spreadsheet
6 1 (0.067%) SPSS
Business Applications
1 11 (0.74%) JDE OneWorld
2 9 (0.60%) Dynamics CRM
3 8 (0.54%) Adobe Campaign
4 6 (0.40%) Dynamics AX
5 2 (0.13%) NetSuite
5 2 (0.13%) SAP S/4HANA
5 2 (0.13%) Sparx Enterprise Architect
5 2 (0.13%) Unit4 Business World
6 1 (0.067%) Maximo
6 1 (0.067%) SAP ERP
6 1 (0.067%) SAP Oil and Gas
Cloud Services
1 1,020 (68.36%) Azure
2 551 (36.93%) AWS
3 521 (34.92%) Azure Data Factory
4 427 (28.62%) Power Platform
5 324 (21.72%) Azure Synapse Analytics
6 233 (15.62%) Serverless
7 186 (12.47%) Azure Cosmos DB
8 185 (12.40%) GCP
9 149 (9.99%) Amazon S3
10 137 (9.18%) GitHub
11 131 (8.78%) Azure Service Bus
12 118 (7.91%) Azure Functions
13 111 (7.44%) Microsoft 365
14 103 (6.90%) GitHub Actions
15 102 (6.84%) AWS Lambda
16 94 (6.30%) Azure Monitor
17 89 (5.97%) Amazon EMR
18 85 (5.70%) Azure Event Grid
19 81 (5.43%) Snowflake
20 74 (4.96%) Amazon CloudWatch
Communications & Networking
1 118 (7.91%) Cisco IPT
2 29 (1.94%) Wireless
3 13 (0.87%) Firewall
4 12 (0.80%) Internet
4 12 (0.80%) Network Security
5 8 (0.54%) Extranet
6 7 (0.47%) HTTP
7 6 (0.40%) BGP
7 6 (0.40%) LAN
7 6 (0.40%) OSPF
7 6 (0.40%) WAN
8 5 (0.34%) SSH
9 2 (0.13%) VPN
10 1 (0.067%) Broadband
10 1 (0.067%) Cisco ASA
10 1 (0.067%) FTP
10 1 (0.067%) TCP/IP
10 1 (0.067%) tcpdump
10 1 (0.067%) Wireshark
Database & Business Intelligence
1 687 (46.05%) Data Warehouse
2 502 (33.65%) Big Data
3 420 (28.15%) Power BI
4 283 (18.97%) NoSQL
4 283 (18.97%) SQL Server
5 264 (17.69%) SQL Server Integration Services
6 166 (11.13%) Azure SQL Database
7 158 (10.59%) MongoDB
8 150 (10.05%) Hadoop
8 150 (10.05%) SQL Server Analysis Services
9 147 (9.85%) Relational Database
10 128 (8.58%) Apache Cassandra
11 124 (8.31%) SQL Server Reporting Services
12 123 (8.24%) Amazon Athena
13 119 (7.98%) HDInsight
14 118 (7.91%) Amazon Redshift
15 109 (7.31%) Tableau
16 107 (7.17%) Azure SQL Data Warehouse
17 90 (6.03%) PostgreSQL
18 83 (5.56%) Metadata
Development Applications
1 102 (6.84%) Git (software)
2 70 (4.69%) Jenkins
3 61 (4.09%) JIRA
4 34 (2.28%) CircleCI
5 32 (2.14%) TeamCity
6 29 (1.94%) Visual Studio
7 23 (1.54%) Atlassian Bamboo
7 23 (1.54%) Subversion
8 16 (1.07%) SQL Server Management Studio (SSMS)
9 15 (1.01%) kappa
10 12 (0.80%) Team Foundation Server
11 10 (0.67%) Burp Suite
12 9 (0.60%) ER Studio
12 9 (0.60%) ERwin
13 8 (0.54%) Spinnaker
14 7 (0.47%) Octopus Deploy
14 7 (0.47%) PowerDesigner
14 7 (0.47%) Storybook
14 7 (0.47%) webpack
15 6 (0.40%) Oracle APEX
General
1 324 (21.72%) Social Skills
2 294 (19.71%) Finance
3 198 (13.27%) Analytical Skills
4 71 (4.76%) Marketing
5 62 (4.16%) Banking
5 62 (4.16%) Law
6 45 (3.02%) Inclusion and Diversity
7 34 (2.28%) Retail
8 30 (2.01%) Presentation Skills
8 30 (2.01%) Public Sector
9 28 (1.88%) Legal
10 25 (1.68%) Telecoms
11 21 (1.41%) Publishing
12 20 (1.34%) Manufacturing
13 19 (1.27%) Automotive
14 18 (1.21%) Influencing Skills
15 16 (1.07%) Advertising
16 14 (0.94%) Front Office
16 14 (0.94%) Organisational Skills
17 12 (0.80%) Aerospace
Job Titles
1 700 (46.92%) Data Engineer
2 228 (15.28%) Security Engineer
3 211 (14.14%) Architect
4 201 (13.47%) Developer
5 173 (11.60%) Senior Data Engineer
6 162 (10.86%) Azure Engineer
7 161 (10.79%) Data Architect
8 142 (9.52%) Cloud Engineer
9 111 (7.44%) Big Data Engineer
10 104 (6.97%) Senior Cloud Engineer
10 104 (6.97%) Senior Security Engineer
11 93 (6.23%) Cybersecurity Engineer
12 77 (5.16%) AWS Engineer
13 72 (4.83%) Analyst
14 71 (4.76%) Senior Developer
15 59 (3.95%) Business Intelligence Developer
16 45 (3.02%) Consultant
17 39 (2.61%) C# Developer
18 37 (2.48%) Data Analyst
18 37 (2.48%) Solutions Architect
Libraries, Frameworks & Software Standards
1 207 (13.87%) Kafka
2 177 (11.86%) .NET
3 75 (5.03%) PySpark
4 46 (3.08%) YAML
5 43 (2.88%) HTML
6 42 (2.82%) JSON
7 39 (2.61%) MDX
8 38 (2.55%) REST
9 37 (2.48%) SOAP
10 36 (2.41%) CSS
10 36 (2.41%) XML
11 35 (2.35%) ActiveMQ
12 33 (2.21%) Web Services
13 32 (2.14%) HTML5
14 26 (1.74%) RESTful
15 24 (1.61%) ARM Templates
15 24 (1.61%) WCF
16 22 (1.47%) Visualforce
17 21 (1.41%) .NET Core
18 16 (1.07%) React
Miscellaneous
1 69 (4.62%) Management Information System
2 57 (3.82%) Data Structures
3 53 (3.55%) Self-Motivation
4 50 (3.35%) Algorithms
5 44 (2.95%) Cloud Native
6 32 (2.14%) Enterprise Software
7 26 (1.74%) Greenfield Project
8 22 (1.47%) Hybrid Cloud
9 21 (1.41%) Reinsurance
10 19 (1.27%) Data Centre
10 19 (1.27%) Life Science
10 19 (1.27%) Replication
11 18 (1.21%) Public Cloud
11 18 (1.21%) Reference Data
12 17 (1.14%) User Experience
13 16 (1.07%) Renewable Energy
14 11 (0.74%) Virtual Team
15 8 (0.54%) Acoustics
15 8 (0.54%) Legacy Systems
15 8 (0.54%) Mobile App
Operating Systems
1 41 (2.75%) Linux
2 25 (1.68%) VMS
3 22 (1.47%) Unix
4 19 (1.27%) Windows
5 10 (0.67%) Kali Linux
6 6 (0.40%) Solaris
7 3 (0.20%) Apple iOS
8 2 (0.13%) Android
8 2 (0.13%) Red Hat Enterprise Linux
8 2 (0.13%) Windows Server
9 1 (0.067%) Windows Server 2019
Processes & Methodologies
1 789 (52.88%) Analytics
2 754 (50.54%) Agile Software Development
3 676 (45.31%) ETL
4 588 (39.41%) Business Intelligence
5 501 (33.58%) DevOps
6 409 (27.41%) Data Modelling
7 379 (25.40%) CI/CD
8 375 (25.13%) Data Engineering
9 355 (23.79%) Data Management
10 345 (23.12%) Data Pipeline
11 278 (18.63%) Data Analytics
12 256 (17.16%) Data Science
13 237 (15.88%) Risk Management
14 212 (14.21%) SDLC
15 211 (14.14%) Data Architecture
16 185 (12.40%) Data Security
16 185 (12.40%) Problem-Solving
17 178 (11.93%) Test Automation
18 167 (11.19%) Machine Learning
18 167 (11.19%) Visualisation
Programming Languages
1 788 (52.82%) SQL
2 770 (51.61%) Python
3 408 (27.35%) Java
4 346 (23.19%) PowerShell
5 279 (18.70%) C#
6 223 (14.95%) Scala
7 167 (11.19%) Bash
8 88 (5.90%) T-SQL
9 68 (4.56%) JavaScript
10 53 (3.55%) Data Analysis Expressions (DAX)
11 47 (3.15%) R
12 34 (2.28%) Go
13 26 (1.74%) C
14 25 (1.68%) C++
15 22 (1.47%) Apex Code
15 22 (1.47%) SOQL
15 22 (1.47%) SOSL
15 22 (1.47%) TypeScript
16 15 (1.01%) PL/SQL
17 12 (0.80%) U-SQL
Qualifications
1 118 (7.91%) (ISC)2 CCSP
1 118 (7.91%) Cisco Certification
1 118 (7.91%) CISSP
2 112 (7.51%) Degree
3 67 (4.49%) AWS Certification
4 36 (2.41%) Computer Science Degree
5 27 (1.81%) Microsoft Certification
6 14 (0.94%) CCSP
6 14 (0.94%) Security Cleared
7 8 (0.54%) Master's Degree
8 7 (0.47%) ISEB
8 7 (0.47%) SC Cleared
9 5 (0.34%) TOGAF Certification
10 4 (0.27%) ISTQB
11 2 (0.13%) CTC Cleared
11 2 (0.13%) DV Cleared
11 2 (0.13%) MBCS
11 2 (0.13%) MOS
11 2 (0.13%) PMI Certification
11 2 (0.13%) PMP
Quality Assurance & Compliance
1 134 (8.98%) Data Quality
2 41 (2.75%) QA
3 37 (2.48%) GDPR
4 19 (1.27%) PCI DSS
5 11 (0.74%) Accessibility
5 11 (0.74%) GxP
6 10 (0.67%) IFRS
7 8 (0.54%) PMO
8 5 (0.34%) Actionable Recommendations
9 4 (0.27%) Cyber Essentials
9 4 (0.27%) Cyber Essentials PLUS
9 4 (0.27%) ISO/IEC 27001
10 3 (0.20%) NIST
11 2 (0.13%) SOC 2
11 2 (0.13%) Solvency II
12 1 (0.067%) HL7
System Software
1 97 (6.50%) Docker
2 16 (1.07%) Active Directory
3 11 (0.74%) HDFS
4 9 (0.60%) Apache Flume
5 7 (0.47%) Virtual Machines
6 3 (0.20%) Virtual Desktop
7 2 (0.13%) Apache ZooKeeper
Systems Management
1 127 (8.51%) Kubernetes
2 98 (6.57%) Terraform
3 12 (0.80%) Ansible
4 8 (0.54%) Grafana
5 6 (0.40%) Oozie
6 4 (0.27%) Prometheus
7 3 (0.20%) HP ALM
7 3 (0.20%) HP Quality Center
7 3 (0.20%) Istio
7 3 (0.20%) Opscode Chef
7 3 (0.20%) Rundeck
8 1 (0.067%) Active Directory Federation Services
8 1 (0.067%) FortiGate
8 1 (0.067%) Hadoop YARN
8 1 (0.067%) Puppet
8 1 (0.067%) Rancher
Vendors
1 605 (40.55%) Databricks
2 436 (29.22%) Microsoft
3 94 (6.30%) Palantir
4 83 (5.56%) Oracle
5 72 (4.83%) Google
6 64 (4.29%) Salesforce.com
7 40 (2.68%) Informatica
8 31 (2.08%) SAP
9 28 (1.88%) Talend
10 18 (1.21%) Alteryx
11 16 (1.07%) ServiceNow
12 14 (0.94%) MuleSoft
13 11 (0.74%) LexisNexis
14 10 (0.67%) Adobe
14 10 (0.67%) Civica
15 9 (0.60%) Cloudera
15 9 (0.60%) Cognizant
15 9 (0.60%) IBM
16 7 (0.47%) Facebook
16 7 (0.47%) Teradata