Period
to 17 January 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 17 January 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
17 Jan 2018
Same period 2017 Same period 2016
Rank 769 1053 1209
Rank change year-on-year +284 +156 +39
Permanent jobs citing Data Lake 392 101 40
As % of all permanent IT jobs advertised in England 0.24% 0.060% 0.021%
As % of the Database & Business Intelligence category 0.79% 0.20% 0.065%
Number of salaries quoted 337 89 20
England median annual salary £65,000 £75,000 £80,000
Median salary % change year-on-year -13.33% -6.25% +25.00%
10th Percentile £47,500 £44,700 £59,375
90th Percentile £97,000 £105,000 £123,000
UK median annual salary £62,500 £70,000 £80,000
% change year-on-year -10.71% -12.50% +25.00%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 49,492 49,980 61,296
As % of all permanent IT jobs advertised in England 30.52% 29.76% 31.72%
Number of salaries quoted 41,367 43,114 52,301
England median annual salary £50,000 £47,500 £46,000
Median salary % change year-on-year +5.26% +3.26% +2.22%
10th Percentile £30,500 £29,750 £28,750
90th Percentile £77,500 £77,500 £75,000
UK median annual salary £48,000 £47,500 £45,000
% change year-on-year +1.05% +5.56% +1.69%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

The salary distribution of IT jobs citing Data Lake in England over the 6 months to 17 January 2018.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 17 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +206 254 £70,000 -12.50% 73
South East +37 41 £52,500 +5.11% 8
North of England +27 25 £57,500 -17.86% 3
Midlands - 24 £60,000 - 6
West Midlands - 19 £60,000 - 4
South West +21 17 £57,500 -16.36% 3
East of England +32 16 £50,000 -9.09% 2
North West +8 16 £57,500 +15.00% 3
Yorkshire +33 9 £50,000 -44.44%
East Midlands - 5 £50,000 - 2
Data Lake
UK

For the 6 months to 17 January 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for Data Lake.

1 248 (63.27%) Analytics
2 240 (61.22%) Business Intelligence
3 237 (60.46%) SQL
4 228 (58.16%) Microsoft Azure
5 213 (54.34%) Big Data
6 176 (44.90%) Data Warehouse
7 168 (42.86%) SQL Server
8 161 (41.07%) Microsoft
9 154 (39.29%) Power BI
10 137 (34.95%) Azure Data Factory
11 131 (33.42%) Hadoop
12 118 (30.10%) SQL Server Integration Services
13 107 (27.30%) Tableau
14 100 (25.51%) SQL Server Analysis Services
15 98 (25.00%) Azure SQL Database
16 97 (24.74%) Amazon AWS
17 93 (23.72%) SQL Server Reporting Services
18 88 (22.45%) Agile Software Development
19 85 (21.68%) ETL
19 85 (21.68%) Apache Spark
20 82 (20.92%) Data Analytics
20 82 (20.92%) Machine Learning
21 80 (20.41%) Finance
22 75 (19.13%) Data Modelling
23 69 (17.60%) Migration
24 67 (17.09%) Presales
24 67 (17.09%) Cortana Intelligence Suite
25 66 (16.84%) Oracle
26 65 (16.58%) Java
27 64 (16.33%) HDInsight

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 85 (21.68%) Apache Spark
2 11 (2.81%) SAS
3 10 (2.55%) Apache Pig
3 10 (2.55%) SharePoint
4 8 (2.04%) Apache
5 4 (1.02%) Apache Airflow
6 3 (0.77%) BizTalk Server
7 2 (0.51%) Elasticsearch
8 1 (0.26%) Apache Solr
8 1 (0.26%) CMS
8 1 (0.26%) Confluence
8 1 (0.26%) IBM Domino
8 1 (0.26%) Jupyter
8 1 (0.26%) Luigi
Applications
1 1 (0.26%) SPSS
Business Applications
1 4 (1.02%) Adobe Campaign
2 2 (0.51%) Dynamics CRM
3 1 (0.26%) Dynamics AX
3 1 (0.26%) Maximo
3 1 (0.26%) MetaTrader
3 1 (0.26%) NetSuite
3 1 (0.26%) Oracle AML
Cloud Services
1 228 (58.16%) Microsoft Azure
2 137 (34.95%) Azure Data Factory
3 97 (24.74%) Amazon AWS
4 67 (17.09%) Cortana Intelligence Suite
5 36 (9.18%) Serverless
6 27 (6.89%) Google Cloud Platform
7 23 (5.87%) AWS Lambda
8 22 (5.61%) IaaS
9 15 (3.83%) PaaS
10 14 (3.57%) Amazon Kinesis
11 13 (3.32%) Data Lake Analytics
12 11 (2.81%) Amazon S3
13 9 (2.30%) GitHub
14 8 (2.04%) Cloud Computing
14 8 (2.04%) Office 365
14 8 (2.04%) SaaS
15 7 (1.79%) Azure Machine Learning
16 5 (1.28%) AWS CloudFormation
17 4 (1.02%) Amazon CloudWatch
18 3 (0.77%) Amazon EC2
Communications & Networking
1 5 (1.28%) DNS
2 3 (0.77%) Firewall
2 3 (0.77%) HTTP
2 3 (0.77%) SMTP
3 2 (0.51%) DHCP
3 2 (0.51%) FTP
3 2 (0.51%) HTTPS
3 2 (0.51%) Internet
3 2 (0.51%) SSL
3 2 (0.51%) Telnet
4 1 (0.26%) LDAP
4 1 (0.26%) TCP/IP
4 1 (0.26%) VPN
Database & Business Intelligence
1 213 (54.34%) Big Data
2 176 (44.90%) Data Warehouse
3 168 (42.86%) SQL Server
4 154 (39.29%) Power BI
5 131 (33.42%) Hadoop
6 118 (30.10%) SQL Server Integration Services
7 100 (25.51%) SQL Server Analysis Services
8 98 (25.00%) Azure SQL Database
9 93 (23.72%) SQL Server Reporting Services
10 64 (16.33%) HDInsight
11 47 (11.99%) Azure SQL Data Warehouse
12 44 (11.22%) NoSQL
13 28 (7.14%) MySQL
14 26 (6.63%) Apache Hive
15 24 (6.12%) MongoDB
16 22 (5.61%) QlikView
16 22 (5.61%) Relational Database
17 20 (5.10%) HBase
18 19 (4.85%) SQL Server 2012
19 17 (4.34%) SQL Server 2014
Development Applications
1 41 (10.46%) Visual Studio
2 39 (9.95%) Git (software)
3 12 (3.06%) Jenkins
4 5 (1.28%) JIRA
5 4 (1.02%) Bitbucket
6 3 (0.77%) Atlassian Bamboo
6 3 (0.77%) Subversion
6 3 (0.77%) Visual Studio Team System
7 2 (0.51%) SQL Server Management Studio (SSMS)
8 1 (0.26%) Artifactory
8 1 (0.26%) Cucumber
8 1 (0.26%) GoCD
8 1 (0.26%) JUnit
8 1 (0.26%) Maven
8 1 (0.26%) Sonatype Nexus
General
1 80 (20.41%) Finance
2 27 (6.89%) Advertising
3 22 (5.61%) Retail
4 21 (5.36%) Marketing
5 11 (2.81%) Manufacturing
5 11 (2.81%) Telecoms
6 10 (2.55%) Banking
6 10 (2.55%) Games
7 8 (2.04%) Financial Institution
7 8 (2.04%) Local Government
8 7 (1.79%) Publishing
9 5 (1.28%) Electronics
10 4 (1.02%) Law
11 2 (0.51%) Front Office
12 1 (0.26%) iGaming
12 1 (0.26%) Investment Banking
12 1 (0.26%) Legal
12 1 (0.26%) Spanish Language
Job Titles
1 113 (28.83%) Architect
2 86 (21.94%) Consultant
3 79 (20.15%) Data Architect
4 77 (19.64%) Business Intelligence Consultant
5 75 (19.13%) Developer
6 46 (11.73%) Data Engineer
7 42 (10.71%) Business Intelligence Developer
8 37 (9.44%) Microsoft BI Consultant
9 31 (7.91%) Power BI Consultant
10 30 (7.65%) Azure Architect
11 29 (7.40%) Azure Consultant
12 28 (7.14%) Business Consultant
13 25 (6.38%) Solutions Architect
14 22 (5.61%) Lead Architect
15 18 (4.59%) Big Data Architect
15 18 (4.59%) Big Data Developer
15 18 (4.59%) SQL Developer
16 17 (4.34%) SQL BI Developer
17 16 (4.08%) SSIS Consultant
17 16 (4.08%) SSRS Consultant
Libraries, Frameworks & Software Standards
1 36 (9.18%) Kafka
2 29 (7.40%) MDX
3 27 (6.89%) .NET
4 15 (3.83%) AngularJS
5 11 (2.81%) ASP.NET
5 11 (2.81%) jQuery
6 10 (2.55%) Node.js
6 10 (2.55%) XML
7 9 (2.30%) .NET Framework
8 8 (2.04%) Django
8 8 (2.04%) JSON
8 8 (2.04%) RabbitMQ
8 8 (2.04%) Web Services
9 7 (1.79%) ASP.NET MVC
9 7 (1.79%) Entity Framework
10 6 (1.53%) CSS
10 6 (1.53%) Flask
10 6 (1.53%) HTML
11 4 (1.02%) ASP.NET Web API
11 4 (1.02%) Hibernate
Miscellaneous
1 39 (9.95%) Analytical Skills
2 21 (5.36%) Computer Science
3 13 (3.32%) Driving Licence
4 12 (3.06%) Enterprise Software
5 11 (2.81%) Greenfield Project
6 10 (2.55%) Data Structures
7 7 (1.79%) Fintech
8 6 (1.53%) Cloud Native
8 6 (1.53%) Management Information System
8 6 (1.53%) Social Media
9 5 (1.28%) Algorithms
9 5 (1.28%) Taxonomies
10 4 (1.02%) Equities
11 3 (0.77%) Digital Media
11 3 (0.77%) Fixed Income
11 3 (0.77%) Foreign Exchange (FX)
11 3 (0.77%) Linux Command Line
11 3 (0.77%) Online Games
11 3 (0.77%) Public Cloud
12 2 (0.51%) Virtual Team
Operating Systems
1 25 (6.38%) Linux
2 11 (2.81%) Unix
3 2 (0.51%) Windows
Processes & Methodologies
1 248 (63.27%) Analytics
2 240 (61.22%) Business Intelligence
3 88 (22.45%) Agile Software Development
4 85 (21.68%) ETL
5 82 (20.92%) Data Analytics
5 82 (20.92%) Machine Learning
6 75 (19.13%) Data Modelling
7 69 (17.60%) Migration
8 67 (17.09%) Presales
9 59 (15.05%) Visualisation
10 47 (11.99%) Data Management
10 47 (11.99%) Stakeholder Management
11 46 (11.73%) Data Governance
12 44 (11.22%) Data Visualisation
13 42 (10.71%) Data Architecture
13 42 (10.71%) Data Integration
14 41 (10.46%) Data Migration
15 38 (9.69%) Business Analytics
16 33 (8.42%) Mentoring
17 31 (7.91%) Kimball Methodology
Programming Languages
1 237 (60.46%) SQL
2 65 (16.58%) Java
3 62 (15.82%) C#
4 61 (15.56%) Python
5 51 (13.01%) T-SQL
6 39 (9.95%) Scala
7 29 (7.40%) PowerShell
8 25 (6.38%) R
9 18 (4.59%) U-SQL
10 16 (4.08%) C++
10 16 (4.08%) Data Analysis Expressions (DAX)
10 16 (4.08%) JavaScript
11 6 (1.53%) C
12 2 (0.51%) MATLAB
12 2 (0.51%) Ruby
12 2 (0.51%) Shell Script
12 2 (0.51%) TypeScript
12 2 (0.51%) VB.NET
13 1 (0.26%) Go
13 1 (0.26%) Perl
Qualifications
1 40 (10.20%) Degree
2 16 (4.08%) Computer Science Degree
3 12 (3.06%) Master's Degree
4 6 (1.53%) AWS Certification
4 6 (1.53%) Microsoft Certification
5 5 (1.28%) APMP
5 5 (1.28%) PhD
6 3 (0.77%) Security Cleared
7 2 (0.51%) ISTQB
7 2 (0.51%) MCSA
7 2 (0.51%) MCSE
7 2 (0.51%) SC Cleared
8 1 (0.26%) Numerate Degree
Quality Assurance & Compliance
1 32 (8.16%) Data Quality
2 16 (4.08%) QA
3 15 (3.83%) GDPR
4 5 (1.28%) Actionable Recommendations
4 5 (1.28%) ISO/IEC 27001
5 3 (0.77%) PMO
6 1 (0.26%) COBIT
6 1 (0.26%) GCP
System Software
1 25 (6.38%) HDFS
2 17 (4.34%) Virtual Machines
3 12 (3.06%) Docker
4 3 (0.77%) Apache Flume
5 2 (0.51%) Active Directory
Systems Management
1 5 (1.28%) Kubernetes
1 5 (1.28%) Opscode Chef
1 5 (1.28%) Puppet
2 4 (1.02%) Ambari
2 4 (1.02%) Hadoop YARN
3 3 (0.77%) Rundeck
4 2 (0.51%) Ansible
4 2 (0.51%) Terraform
5 1 (0.26%) Consul
5 1 (0.26%) EMC NetWorker
5 1 (0.26%) Oozie
5 1 (0.26%) Salt
5 1 (0.26%) ZABBIX
Vendors
1 161 (41.07%) Microsoft
2 107 (27.30%) Tableau
3 66 (16.84%) Oracle
4 52 (13.27%) Google
5 24 (6.12%) IBM
6 21 (5.36%) Informatica
7 19 (4.85%) Talend
8 16 (4.08%) Hortonworks
9 11 (2.81%) Cloudera
10 9 (2.30%) Netezza
10 9 (2.30%) Teradata
10 9 (2.30%) Twitter
11 7 (1.79%) Capita
11 7 (1.79%) SAP
12 6 (1.53%) Ab Initio
13 5 (1.28%) Greenplum
14 4 (1.02%) Adobe
14 4 (1.02%) Salesforce.com
15 3 (0.77%) Sybase
15 3 (0.77%) Vertica