Period
to 18 October 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 October 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
18 Oct 2018
Same period 2017 Same period 2016
Rank 566 869 1143
Rank change year-on-year +303 +274 +123
Permanent jobs citing Data Lake 694 292 86
As % of all permanent IT jobs advertised in England 0.45% 0.18% 0.048%
As % of the Database & Business Intelligence category 1.53% 0.59% 0.16%
Number of salaries quoted 510 249 70
England median annual salary £65,000 £60,000 £86,250
Median salary % change year-on-year +8.33% -30.43% +91.67%
10th Percentile £45,000 £42,000 £42,500
90th Percentile £100,000 £95,000 £115,500
UK median annual salary £65,000 £60,000 £80,000
% change year-on-year +8.33% -25.00% +77.78%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 45,219 49,779 53,531
As % of all permanent IT jobs advertised in England 29.50% 30.35% 29.60%
Number of salaries quoted 37,045 41,310 46,096
England median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £83,750 £77,500 £76,250
UK median annual salary £50,000 £48,000 £47,500
% change year-on-year +4.17% +1.05% +5.56%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

The salary distribution of IT jobs citing Data Lake in England over the 6 months to 18 October 2018.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 18 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +294 483 £70,000 - 66
South East 0 86 £65,000 +18.18% 20
South West +24 41 £62,138 +12.98% 9
East of England +48 31 £52,500 -6.67% 2
Midlands +37 31 £52,500 -4.55% 4
North of England +32 25 £60,000 +25.00% 15
West Midlands +47 19 £52,500 -25.00% 2
North West +17 16 £64,500 +35.79% 5
East Midlands -2 12 £52,500 -4.55% 2
Yorkshire +38 9 £50,000 -28.57% 8
Data Lake
UK

For the 6 months to 18 October 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 432 (62.25%) SQL
2 419 (60.37%) Analytics
3 409 (58.93%) Business Intelligence
4 377 (54.32%) Microsoft Azure
5 376 (54.18%) Data Warehouse
6 350 (50.43%) Big Data
7 316 (45.53%) Microsoft
8 303 (43.66%) SQL Server
9 252 (36.31%) Power BI
10 242 (34.87%) SQL Server Integration Services
11 236 (34.01%) Agile Software Development
12 222 (31.99%) Finance
13 212 (30.55%) Hadoop
14 205 (29.54%) ETL
15 203 (29.25%) Data Modelling
16 193 (27.81%) SQL Server Reporting Services
17 190 (27.38%) SQL Server Analysis Services
18 180 (25.94%) Azure SQL Database
18 180 (25.94%) Python
19 178 (25.65%) Azure Data Factory
20 160 (23.05%) Data Analytics
21 154 (22.19%) Machine Learning
22 146 (21.04%) Azure SQL Data Warehouse
23 137 (19.74%) Apache Spark
24 126 (18.16%) Data Science
25 124 (17.87%) Amazon AWS
26 121 (17.44%) C#
27 119 (17.15%) T-SQL
28 116 (16.71%) Visualisation
29 115 (16.57%) Java

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 137 (19.74%) Apache Spark
2 55 (7.93%) Apache
3 31 (4.47%) Apache Pig
4 27 (3.89%) Apache Solr
5 21 (3.03%) SAS
6 18 (2.59%) Elasticsearch
6 18 (2.59%) SharePoint
7 15 (2.16%) Confluence
8 7 (1.01%) Tomcat
9 4 (0.58%) BizTalk Server
10 3 (0.43%) IIS
11 2 (0.29%) Apache Airflow
11 2 (0.29%) Drupal
11 2 (0.29%) JBoss
11 2 (0.29%) Luigi
11 2 (0.29%) Oracle SOA Suite
11 2 (0.29%) Tornado
11 2 (0.29%) WebLogic
12 1 (0.14%) Ethereum
12 1 (0.14%) Kentico
Applications
1 27 (3.89%) Microsoft Excel
2 3 (0.43%) MS Visio
3 2 (0.29%) Microsoft Office
4 1 (0.14%) Chatbot
4 1 (0.14%) SPSS
Business Applications
1 9 (1.30%) Dynamics CRM
2 4 (0.58%) Dynamics AX
3 3 (0.43%) Markit EDM
4 2 (0.29%) Maximo
5 1 (0.14%) NetSuite
Cloud Services
1 377 (54.32%) Microsoft Azure
2 178 (25.65%) Azure Data Factory
3 124 (17.87%) Amazon AWS
4 82 (11.82%) PaaS
5 70 (10.09%) Data Lake Analytics
6 51 (7.35%) Serverless
7 45 (6.48%) Cortana Intelligence Suite
8 39 (5.62%) Azure Machine Learning
9 32 (4.61%) IaaS
10 30 (4.32%) Google Cloud Platform
11 22 (3.17%) Azure Functions
12 21 (3.03%) SaaS
13 19 (2.74%) Amazon Kinesis
14 17 (2.45%) Cloud Computing
15 13 (1.87%) Amazon S3
16 10 (1.44%) AWS Lambda
17 8 (1.15%) Amazon EMR
17 8 (1.15%) Azure Active Directory
17 8 (1.15%) Office 365
18 5 (0.72%) BlazeMeter
Communications & Networking
1 7 (1.01%) HTTP
2 6 (0.86%) Firewall
3 4 (0.58%) Network Security
4 2 (0.29%) GoToMeeting
4 2 (0.29%) Internet
4 2 (0.29%) Kerberos
4 2 (0.29%) SNMP
4 2 (0.29%) SSL
4 2 (0.29%) WebEx
Database & Business Intelligence
1 376 (54.18%) Data Warehouse
2 350 (50.43%) Big Data
3 303 (43.66%) SQL Server
4 252 (36.31%) Power BI
5 242 (34.87%) SQL Server Integration Services
6 212 (30.55%) Hadoop
7 193 (27.81%) SQL Server Reporting Services
8 190 (27.38%) SQL Server Analysis Services
9 180 (25.94%) Azure SQL Database
10 146 (21.04%) Azure SQL Data Warehouse
11 108 (15.56%) NoSQL
12 91 (13.11%) Cosmos DB
13 74 (10.66%) Apache Hive
14 72 (10.37%) Relational Database
15 51 (7.35%) MongoDB
16 50 (7.20%) MySQL
17 49 (7.06%) Microsoft Analysis Services
18 47 (6.77%) Apache Cassandra
19 46 (6.63%) HBase
20 42 (6.05%) RDBMS
Development Applications
1 58 (8.36%) Visual Studio
2 52 (7.49%) Git (software)
3 28 (4.03%) Visual Studio Team System
4 27 (3.89%) Jenkins
5 24 (3.46%) JIRA
6 14 (2.02%) ERwin
7 11 (1.59%) Team Foundation Server
7 11 (1.59%) TeamCity
8 8 (1.15%) Octopus Deploy
9 7 (1.01%) SpecFlow
9 7 (1.01%) Subversion
10 6 (0.86%) Eclipse
10 6 (0.86%) SQL Server Management Studio (SSMS)
10 6 (0.86%) tSQLt
11 5 (0.72%) Atlassian Bamboo
11 5 (0.72%) ER Studio
11 5 (0.72%) SoapUI
12 4 (0.58%) GitLab
12 4 (0.58%) Hudson
13 3 (0.43%) Cucumber
General
1 222 (31.99%) Finance
2 79 (11.38%) Banking
3 68 (9.80%) Retail
4 66 (9.51%) Advertising
5 51 (7.35%) Investment Banking
6 34 (4.90%) Financial Institution
7 31 (4.47%) Marketing
8 22 (3.17%) Games
9 12 (1.73%) Corporate Banking
10 7 (1.01%) Publishing
10 7 (1.01%) Telecoms
11 6 (0.86%) Online Betting
12 5 (0.72%) Front Office
13 4 (0.58%) Automotive
14 3 (0.43%) Billing
15 2 (0.29%) Digital Economy
15 2 (0.29%) General Ledger
16 1 (0.14%) Law
16 1 (0.14%) Legal
16 1 (0.14%) Manufacturing
Job Titles
1 218 (31.41%) Developer
2 133 (19.16%) Architect
3 107 (15.42%) Consultant
4 103 (14.84%) Data Architect
5 100 (14.41%) Business Intelligence Developer
6 96 (13.83%) Data Engineer
7 62 (8.93%) SQL Developer
8 54 (7.78%) Business Intelligence Consultant
9 53 (7.64%) SSIS Developer
10 52 (7.49%) Data Consultant
11 49 (7.06%) Azure Consultant
11 49 (7.06%) Data Warehouse Developer
12 39 (5.62%) SQL BI Developer
13 37 (5.33%) Big Data Developer
14 36 (5.19%) Senior Developer
15 35 (5.04%) SSRS Developer
16 34 (4.90%) Analyst
17 33 (4.76%) SSAS Developer
17 33 (4.76%) T-SQL Developer
18 32 (4.61%) Cloud Architect
Libraries, Frameworks & Software Standards
1 94 (13.54%) Kafka
2 91 (13.11%) .NET
3 48 (6.92%) JSON
4 35 (5.04%) Web Services
5 33 (4.76%) MDX
6 28 (4.03%) Velocity
7 23 (3.31%) RESTful
8 20 (2.88%) HTML
8 20 (2.88%) RabbitMQ
9 19 (2.74%) AngularJS
10 18 (2.59%) Natural Language Processing
11 17 (2.45%) ASP.NET
11 17 (2.45%) REST
12 14 (2.02%) SAML
13 13 (1.87%) HornetQ
13 13 (1.87%) JMS
14 12 (1.73%) ASP.NET MVC
14 12 (1.73%) CSS
15 11 (1.59%) HTML5
15 11 (1.59%) XML
Miscellaneous
1 61 (8.79%) Analytical Skills
2 38 (5.48%) Cyberthreat
3 29 (4.18%) Computer Science
4 23 (3.31%) Greenfield Project
5 21 (3.03%) Algorithms
6 19 (2.74%) Management Information System
7 16 (2.31%) Reference Data
8 14 (2.02%) Equities
8 14 (2.02%) Hedge funds
8 14 (2.02%) Self-Motivation
9 12 (1.73%) Credit Risk
9 12 (1.73%) Derivative
9 12 (1.73%) Driving Licence
9 12 (1.73%) Enterprise Software
10 11 (1.59%) Fintech
11 9 (1.30%) Data Structures
12 8 (1.15%) Clustering
12 8 (1.15%) Fixed Income
12 8 (1.15%) Virtual Team
13 7 (1.01%) Taxonomies
Operating Systems
1 27 (3.89%) Linux
2 19 (2.74%) Unix
2 19 (2.74%) Windows
3 11 (1.59%) Red Hat Enterprise Linux
4 9 (1.30%) CentOS
5 7 (1.01%) Ubuntu
6 4 (0.58%) Windows Server
7 2 (0.29%) Windows Server 2008
8 1 (0.14%) Android
8 1 (0.14%) Apple iOS
8 1 (0.14%) Windows 10
Processes & Methodologies
1 419 (60.37%) Analytics
2 409 (58.93%) Business Intelligence
3 236 (34.01%) Agile Software Development
4 205 (29.54%) ETL
5 203 (29.25%) Data Modelling
6 160 (23.05%) Data Analytics
7 154 (22.19%) Machine Learning
8 126 (18.16%) Data Science
9 116 (16.71%) Visualisation
10 101 (14.55%) Data Architecture
11 81 (11.67%) Problem-Solving
12 79 (11.38%) Data Engineering
13 78 (11.24%) Data Strategy
14 72 (10.37%) Data Governance
15 69 (9.94%) Continuous Integration
16 65 (9.37%) Data Integration
17 61 (8.79%) Mentoring
18 60 (8.65%) Data Management
19 56 (8.07%) Test Automation
20 52 (7.49%) OO
Programming Languages
1 432 (62.25%) SQL
2 180 (25.94%) Python
3 121 (17.44%) C#
4 119 (17.15%) T-SQL
5 115 (16.57%) Java
6 84 (12.10%) Data Analysis Expressions (DAX)
7 83 (11.96%) Scala
8 71 (10.23%) JavaScript
9 59 (8.50%) R
10 58 (8.36%) U-SQL
11 52 (7.49%) PowerShell
12 29 (4.18%) Perl
13 23 (3.31%) Shell Script
14 22 (3.17%) C++
15 11 (1.59%) C
16 4 (0.58%) Go
16 4 (0.58%) VB.NET
17 3 (0.43%) Java 8
18 2 (0.29%) Bash Shell
18 2 (0.29%) ML
Qualifications
1 73 (10.52%) Degree
2 17 (2.45%) Microsoft Certification
3 15 (2.16%) Computer Science Degree
4 8 (1.15%) Master's Degree
4 8 (1.15%) MBA
5 6 (0.86%) GSEC
6 3 (0.43%) MCSA
6 3 (0.43%) MCSE
7 2 (0.29%) AWS Certification
7 2 (0.29%) PhD
7 2 (0.29%) Security Cleared
8 1 (0.14%) Numerate Degree
8 1 (0.14%) SC Cleared
Quality Assurance & Compliance
1 38 (5.48%) Data Quality
2 33 (4.76%) QA
3 9 (1.30%) SLA
4 7 (1.01%) GDPR
4 7 (1.01%) ISO/IEC 27001
5 3 (0.43%) PMO
6 1 (0.14%) Actionable Recommendations
System Software
1 49 (7.06%) HDFS
2 26 (3.75%) Docker
2 26 (3.75%) Virtual Machines
3 18 (2.59%) Apache Flume
4 13 (1.87%) Active Directory
5 12 (1.73%) Apache ZooKeeper
6 4 (0.58%) Hyper-V
6 4 (0.58%) VMware Infrastructure
7 2 (0.29%) XenApp
8 1 (0.14%) Firmware
Systems Management
1 22 (3.17%) Terraform
2 20 (2.88%) Oozie
2 20 (2.88%) Opscode Chef
2 20 (2.88%) Puppet
3 19 (2.74%) Kubernetes
4 11 (1.59%) Kibana
5 4 (0.58%) Grafana
5 4 (0.58%) Hadoop YARN
5 4 (0.58%) Rundeck
6 3 (0.43%) Ambari
7 2 (0.29%) Ansible
8 1 (0.14%) Microsoft Intune
Vendors
1 316 (45.53%) Microsoft
2 113 (16.28%) Oracle
3 104 (14.99%) Tableau
4 54 (7.78%) Cloudera
4 54 (7.78%) Talend
5 51 (7.35%) Informatica
6 43 (6.20%) Databricks
7 36 (5.19%) Teradata
8 35 (5.04%) Hortonworks
9 31 (4.47%) Google
10 26 (3.75%) Netezza
11 22 (3.17%) MapR
11 22 (3.17%) Sybase
12 17 (2.45%) SnapLogic
13 15 (2.16%) Ab Initio
13 15 (2.16%) Salesforce.com
14 13 (1.87%) EXASOL
14 13 (1.87%) SAP
14 13 (1.87%) WorldPay
15 10 (1.44%) Cognos