Period
to 20 October 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 20 October 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
20 Oct 2019
Same period 2018 Same period 2017
Rank 462 576 880
Rank change year-on-year +114 +304 +261
Permanent jobs citing Data Lake 785 689 290
As % of all permanent IT jobs advertised in England 0.62% 0.45% 0.18%
As % of the Database & Business Intelligence category 2.32% 1.53% 0.58%
Number of salaries quoted 647 508 247
England median annual salary £65,000 £65,000 £60,000
Median salary % change year-on-year - +8.33% -29.41%
10th Percentile £41,471 £44,700 £42,500
90th Percentile £100,000 £100,000 £95,000
UK median annual salary £65,000 £65,000 £60,000
% change year-on-year - +8.33% -22.58%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 33,832 44,951 49,642
As % of all permanent IT jobs advertised in England 26.91% 29.50% 30.35%
Number of salaries quoted 28,130 36,841 41,174
England median annual salary £52,500 £50,000 £50,000
Median salary % change year-on-year +5.00% - +5.26%
10th Percentile £31,589 £31,250 £30,000
90th Percentile £86,250 £83,750 £77,500
UK median annual salary £52,500 £50,000 £48,000
% change year-on-year +5.00% +4.17% +1.05%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

The salary distribution of IT jobs citing Data Lake in England over the 6 months to 20 October 2019.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 20 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +55 444 £73,750 +5.36% 64
South East +59 101 £61,250 -5.77% 22
North of England +72 71 £50,000 -16.67% 11
South West +43 69 £60,000 -3.44% 10
East of England +106 63 £45,000 -14.29% 11
Midlands +44 37 £55,000 +2.33% 12
East Midlands +45 30 £55,000 +4.76% 5
North West +51 29 £50,000 -22.48% 4
Yorkshire +14 22 £45,206 -9.59% 3
North East - 20 £45,412 - 4
West Midlands +21 7 £65,000 +18.18% 6
Data Lake
UK

For the 6 months to 20 October 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 516 (65.73%) Data Warehouse
2 503 (64.08%) Azure
3 492 (62.68%) SQL
4 455 (57.96%) Analytics
5 416 (52.99%) Business Intelligence
6 310 (39.49%) Big Data
7 306 (38.98%) Microsoft
8 301 (38.34%) Agile Software Development
9 294 (37.45%) Power BI
9 294 (37.45%) Power Platform
10 271 (34.52%) SQL Server
11 267 (34.01%) ETL
12 265 (33.76%) Python
13 237 (30.19%) Data Modelling
14 228 (29.04%) Azure Data Factory
15 219 (27.90%) SQL Server Integration Services
16 214 (27.26%) Finance
17 188 (23.95%) Databricks
18 186 (23.69%) DevOps
19 176 (22.42%) SQL Server Analysis Services
20 175 (22.29%) Data Science
21 174 (22.17%) Azure SQL Database
22 165 (21.02%) Hadoop
23 163 (20.76%) Azure SQL Data Warehouse
24 151 (19.24%) AWS
25 144 (18.34%) SQL Server Reporting Services
26 143 (18.22%) Machine Learning
27 135 (17.20%) Apache Spark
28 125 (15.92%) Visualisation
29 124 (15.80%) Data Analytics

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 135 (17.20%) Apache Spark
2 33 (4.20%) Apache
3 18 (2.29%) SAS
4 13 (1.66%) Apache Pig
4 13 (1.66%) IIS
5 9 (1.15%) Apache Airflow
5 9 (1.15%) SharePoint
6 8 (1.02%) Anypoint
6 8 (1.02%) ArcGIS
7 7 (0.89%) Apache Solr
8 6 (0.76%) Elasticsearch
9 5 (0.64%) Confluence
10 3 (0.38%) Jupyter
11 2 (0.25%) BizTalk Server
Applications
1 17 (2.17%) Microsoft Excel
1 17 (2.17%) Spreadsheet
2 14 (1.78%) Microsoft Office
3 7 (0.89%) SPSS
4 2 (0.25%) MS Visio
Business Applications
1 2 (0.25%) Markit EDM
2 1 (0.13%) Infor M3
2 1 (0.13%) Sparx Enterprise Architect
2 1 (0.13%) Workday HCM
Cloud Services
1 503 (64.08%) Azure
2 294 (37.45%) Power Platform
3 228 (29.04%) Azure Data Factory
4 151 (19.24%) AWS
5 60 (7.64%) GCP
6 59 (7.52%) PaaS
7 56 (7.13%) Serverless
8 41 (5.22%) Data Lake Analytics
9 31 (3.95%) Azure Machine Learning
9 31 (3.95%) IaaS
10 30 (3.82%) Azure Functions
11 25 (3.18%) Amazon Kinesis
11 25 (3.18%) Amazon S3
12 23 (2.93%) Azure Active Directory
13 19 (2.42%) Amazon EMR
13 19 (2.42%) SaaS
14 16 (2.04%) npm
15 12 (1.53%) Cortana Intelligence Suite
16 11 (1.40%) PowerApps
17 8 (1.02%) Office 365
Communications & Networking
1 6 (0.76%) Broadband
2 3 (0.38%) VPN
3 1 (0.13%) Internet
3 1 (0.13%) SAN
Database & Business Intelligence
1 516 (65.73%) Data Warehouse
2 310 (39.49%) Big Data
3 294 (37.45%) Power BI
4 271 (34.52%) SQL Server
5 219 (27.90%) SQL Server Integration Services
6 176 (22.42%) SQL Server Analysis Services
7 174 (22.17%) Azure SQL Database
8 165 (21.02%) Hadoop
9 163 (20.76%) Azure SQL Data Warehouse
10 144 (18.34%) SQL Server Reporting Services
11 115 (14.65%) NoSQL
12 85 (10.83%) Microsoft Analysis Services
13 78 (9.94%) Apache Hive
14 71 (9.04%) Cosmos DB
15 54 (6.88%) Amazon Redshift
16 52 (6.62%) Relational Database
17 38 (4.84%) HDInsight
18 36 (4.59%) MongoDB
19 31 (3.95%) OLAP
20 30 (3.82%) BigQuery
Development Applications
1 63 (8.03%) Git (software)
2 41 (5.22%) Visual Studio
3 36 (4.59%) Jenkins
4 28 (3.57%) JIRA
5 25 (3.18%) Visual Studio Team System
6 24 (3.06%) ERwin
7 22 (2.80%) Cucumber
8 20 (2.55%) Team Foundation Server
9 17 (2.17%) Octopus Deploy
10 13 (1.66%) Selenium
10 13 (1.66%) TeamCity
11 11 (1.40%) Sinon.JS
11 11 (1.40%) webpack
12 10 (1.27%) git-flow
12 10 (1.27%) Subversion
13 8 (1.02%) ER Studio
14 7 (0.89%) PowerDesigner
15 6 (0.76%) HP UFT
16 3 (0.38%) Hudson
17 2 (0.25%) Mocha
General
1 214 (27.26%) Finance
2 74 (9.43%) Retail
3 38 (4.84%) Banking
4 19 (2.42%) Marketing
5 13 (1.66%) Pharmaceutical
6 11 (1.40%) Advertising
6 11 (1.40%) Legal
6 11 (1.40%) Public Sector
7 8 (1.02%) Telecoms
8 6 (0.76%) Games
9 5 (0.64%) Publishing
10 4 (0.51%) Automotive
10 4 (0.51%) Investment Banking
11 3 (0.38%) Front Office
12 1 (0.13%) Back Office
12 1 (0.13%) Financial Institution
12 1 (0.13%) General Ledger
12 1 (0.13%) Law
Job Titles
1 231 (29.43%) Developer
2 159 (20.25%) Data Engineer
3 144 (18.34%) Architect
4 119 (15.16%) Business Intelligence Developer
5 90 (11.46%) Data Architect
6 75 (9.55%) SQL Developer
7 69 (8.79%) Azure Developer
8 66 (8.41%) Analyst
9 53 (6.75%) Senior Developer
10 52 (6.62%) SQL BI Developer
11 48 (6.11%) Business Intelligence Lead
12 42 (5.35%) Database Developer
12 42 (5.35%) SQL Database Developer
13 41 (5.22%) Power BI Developer
14 36 (4.59%) SQL Server Developer
15 35 (4.46%) Azure Engineer
15 35 (4.46%) Data Analyst
16 33 (4.20%) Enterprise Architect
16 33 (4.20%) Lead Developer
17 32 (4.08%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 80 (10.19%) MDX
2 53 (6.75%) Kafka
3 44 (5.61%) .NET
4 25 (3.18%) Web Services
5 22 (2.80%) JSON
6 17 (2.17%) .NET Framework
6 17 (2.17%) React
6 17 (2.17%) XML
7 14 (1.78%) Apache NiFi
7 14 (1.78%) HTML
7 14 (1.78%) Natural Language Processing
7 14 (1.78%) Node.js
8 13 (1.66%) Lambda Expressions
9 11 (1.40%) Jest
9 11 (1.40%) REST
10 10 (1.27%) .NET Core
11 9 (1.15%) AngularJS
11 9 (1.15%) Pandas
12 7 (0.89%) ASP.NET Web API
12 7 (0.89%) Leaflet
Miscellaneous
1 96 (12.23%) Analytical Skills
2 44 (5.61%) Management Information System
3 36 (4.59%) Algorithms
4 34 (4.33%) Greenfield Project
5 16 (2.04%) Data Structures
6 15 (1.91%) Data Centre
7 11 (1.40%) Clustering
8 10 (1.27%) Cloud Native
8 10 (1.27%) User Experience
9 8 (1.02%) BBC
10 6 (0.76%) Analytical Mindset
10 6 (0.76%) Podcast
10 6 (0.76%) Private Cloud
10 6 (0.76%) Public Cloud
11 5 (0.64%) Mobile App
11 5 (0.64%) Online Games
11 5 (0.64%) Self-Motivation
12 4 (0.51%) Enterprise Software
12 4 (0.51%) Hybrid Cloud
12 4 (0.51%) Replication
Operating Systems
1 40 (5.10%) Windows
2 21 (2.68%) Windows Server
3 16 (2.04%) Unix
4 15 (1.91%) Linux
5 10 (1.27%) Windows 10
6 5 (0.64%) Windows 7
7 4 (0.51%) Red Hat Enterprise Linux
Processes & Methodologies
1 455 (57.96%) Analytics
2 416 (52.99%) Business Intelligence
3 301 (38.34%) Agile Software Development
4 267 (34.01%) ETL
5 237 (30.19%) Data Modelling
6 186 (23.69%) DevOps
7 175 (22.29%) Data Science
8 143 (18.22%) Machine Learning
9 125 (15.92%) Visualisation
10 124 (15.80%) Data Analytics
11 105 (13.38%) Data Engineering
12 103 (13.12%) Data Architecture
13 102 (12.99%) Scrum
14 93 (11.85%) Problem-Solving
15 89 (11.34%) Stakeholder Management
16 87 (11.08%) Kimball Methodology
17 83 (10.57%) Data Management
18 79 (10.06%) Data Strategy
19 66 (8.41%) Migration
20 63 (8.03%) Data Integration
Programming Languages
1 492 (62.68%) SQL
2 265 (33.76%) Python
3 122 (15.54%) Data Analysis Expressions (DAX)
4 103 (13.12%) T-SQL
5 96 (12.23%) R
6 66 (8.41%) Scala
7 64 (8.15%) C#
8 55 (7.01%) Java
9 39 (4.97%) PowerShell
10 32 (4.08%) PL/SQL
11 27 (3.44%) JavaScript
12 23 (2.93%) VBA
13 22 (2.80%) U-SQL
14 10 (1.27%) Shell Script
15 7 (0.89%) C++
15 7 (0.89%) Go
16 6 (0.76%) Bash Shell
16 6 (0.76%) MATLAB
16 6 (0.76%) Ruby
17 5 (0.64%) C
Qualifications
1 89 (11.34%) Degree
2 30 (3.82%) Computer Science Degree
3 18 (2.29%) TOGAF Certification
4 16 (2.04%) Microsoft Certification
5 7 (0.89%) MCSA
6 6 (0.76%) PhD
7 5 (0.64%) (ISC)2 CCSP
7 5 (0.64%) CCSP
7 5 (0.64%) Cisco Certification
7 5 (0.64%) CISSP
7 5 (0.64%) CompTIA Security+
7 5 (0.64%) MBA
7 5 (0.64%) MCSE
8 4 (0.51%) AWS Certification
8 4 (0.51%) Master's Degree
9 3 (0.38%) ISTQB
9 3 (0.38%) Numerate Degree
10 2 (0.25%) DBS Check
10 2 (0.25%) ITIL Certification
11 1 (0.13%) SC Cleared
Quality Assurance & Compliance
1 56 (7.13%) Data Quality
2 24 (3.06%) QA
3 12 (1.53%) SLA
4 11 (1.40%) GDPR
5 2 (0.25%) HIPAA
6 1 (0.13%) COBIT
6 1 (0.13%) NIST
6 1 (0.13%) PCI DSS
System Software
1 38 (4.84%) Docker
2 22 (2.80%) Active Directory
2 22 (2.80%) HDFS
3 14 (1.78%) Virtual Machines
4 10 (1.27%) Hyper-V
5 7 (0.89%) Apache Flume
5 7 (0.89%) VMware Infrastructure
6 2 (0.25%) Firmware
6 2 (0.25%) XenApp
7 1 (0.13%) Apache ZooKeeper
7 1 (0.13%) Virtual Servers
Systems Management
1 26 (3.31%) Kubernetes
2 19 (2.42%) Hadoop YARN
3 8 (1.02%) Terraform
4 7 (0.89%) Opscode Chef
4 7 (0.89%) Puppet
5 5 (0.64%) Microsoft Intune
5 5 (0.64%) Single Sign-On
6 4 (0.51%) Grafana
6 4 (0.51%) Prometheus
7 3 (0.38%) Chukwa
8 2 (0.25%) Ansible
8 2 (0.25%) Oozie
9 1 (0.13%) Docker Swarm
Vendors
1 306 (38.98%) Microsoft
2 188 (23.95%) Databricks
3 75 (9.55%) Informatica
4 63 (8.03%) Tableau
5 57 (7.26%) Oracle
6 46 (5.86%) Teradata
7 45 (5.73%) Google
8 33 (4.20%) Cloudera
9 21 (2.68%) Netezza
10 20 (2.55%) MuleSoft
11 18 (2.29%) Ab Initio
12 16 (2.04%) Talend
13 11 (1.40%) SAP
14 10 (1.27%) MicroStrategy
14 10 (1.27%) VMware
15 9 (1.15%) Hortonworks
15 9 (1.15%) Salesforce.com
16 7 (0.89%) Mapbox
17 6 (0.76%) Apple
18 5 (0.64%) Sybase