Period
to 16 August 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 16 August 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
16 Aug 2018
Same period 2017 Same period 2016
Rank 553 925 1186
Rank change year-on-year +372 +261 +82
Permanent jobs citing Data Lake 772 263 58
As % of all permanent IT jobs advertised in England 0.49% 0.16% 0.031%
As % of the Database & Business Intelligence category 1.62% 0.52% 0.10%
Number of salaries quoted 545 223 43
England median annual salary £65,000 £60,000 £70,000
Median salary % change year-on-year +8.33% -14.29% +55.56%
10th Percentile £46,250 £40,500 £42,500
90th Percentile £97,500 £95,000 £120,000
UK median annual salary £65,000 £60,000 £56,500
% change year-on-year +8.33% +6.19% +18.95%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 47,624 50,725 56,047
As % of all permanent IT jobs advertised in England 30.12% 30.50% 30.04%
Number of salaries quoted 38,957 42,636 48,451
England median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £82,500 £77,500 £75,000
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

The salary distribution of IT jobs citing Data Lake in England over the 6 months to 16 August 2018.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 16 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +378 567 £70,000 +2.56% 63
South East -53 69 £65,000 +18.18% 8
Midlands +61 59 £52,500 -4.55% 2
West Midlands +56 41 £52,500 -40.00%
North of England +44 32 £60,000 +25.65% 4
East of England +56 29 £60,000 +6.67% 3
Yorkshire +55 26 £60,000 - 1
East Midlands +18 18 £50,000 -9.09% 2
South West +9 9 £69,500 +15.83% 2
North West +8 6 £50,750 +6.84% 3
Data Lake
UK

For the 6 months to 16 August 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 526 (68.13%) SQL
2 478 (61.92%) Analytics
3 455 (58.94%) Business Intelligence
4 429 (55.57%) Microsoft Azure
5 405 (52.46%) Big Data
6 358 (46.37%) Microsoft
7 325 (42.10%) SQL Server
7 325 (42.10%) Power BI
8 301 (38.99%) Data Warehouse
9 290 (37.56%) SQL Server Integration Services
10 245 (31.74%) Azure Data Factory
11 231 (29.92%) Finance
12 228 (29.53%) SQL Server Analysis Services
13 222 (28.76%) Agile Software Development
14 216 (27.98%) SQL Server Reporting Services
15 214 (27.72%) Azure SQL Database
16 207 (26.81%) Hadoop
17 198 (25.65%) Machine Learning
17 198 (25.65%) Python
18 195 (25.26%) Data Analytics
19 185 (23.96%) Data Science
20 172 (22.28%) ETL
21 171 (22.15%) Data Modelling
22 170 (22.02%) Java
23 161 (20.85%) C#
24 154 (19.95%) Apache Spark
25 145 (18.78%) Tableau
26 138 (17.88%) NoSQL
27 135 (17.49%) Visualisation
28 133 (17.23%) Azure SQL Data Warehouse

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (19.95%) Apache Spark
2 46 (5.96%) Apache
3 23 (2.98%) Apache Pig
4 21 (2.72%) Apache Solr
5 15 (1.94%) SharePoint
6 13 (1.68%) BizTalk Server
6 13 (1.68%) SAS
7 6 (0.78%) Confluence
7 6 (0.78%) Elasticsearch
7 6 (0.78%) Tomcat
8 4 (0.52%) Drupal
9 1 (0.13%) Apache Airflow
9 1 (0.13%) IIS
9 1 (0.13%) Tornado
Applications
1 15 (1.94%) Microsoft Excel
2 13 (1.68%) MS Visio
3 2 (0.26%) Microsoft Office
4 1 (0.13%) Chatbot
Business Applications
1 17 (2.20%) Dynamics CRM
2 4 (0.52%) Dynamics AX
2 4 (0.52%) Markit EDM
3 2 (0.26%) Maximo
4 1 (0.13%) NetSuite
Cloud Services
1 429 (55.57%) Microsoft Azure
2 245 (31.74%) Azure Data Factory
3 112 (14.51%) Amazon AWS
4 86 (11.14%) PaaS
5 79 (10.23%) Cortana Intelligence Suite
6 78 (10.10%) Serverless
7 74 (9.59%) IaaS
8 49 (6.35%) Azure Machine Learning
9 36 (4.66%) Data Lake Analytics
10 19 (2.46%) Google Cloud Platform
11 18 (2.33%) SaaS
12 16 (2.07%) Office 365
13 15 (1.94%) AWS Lambda
14 14 (1.81%) Amazon Kinesis
15 13 (1.68%) Cloud Computing
16 12 (1.55%) Amazon S3
17 10 (1.30%) Azure Functions
18 7 (0.91%) Amazon EMR
19 5 (0.65%) GitHub
19 5 (0.65%) OpenShift
Communications & Networking
1 5 (0.65%) DNS
1 5 (0.65%) Firewall
1 5 (0.65%) HTTP
1 5 (0.65%) SMTP
1 5 (0.65%) TCP/IP
1 5 (0.65%) VPN
2 2 (0.26%) Internet
3 1 (0.13%) Intranet
Database & Business Intelligence
1 405 (52.46%) Big Data
2 325 (42.10%) Power BI
2 325 (42.10%) SQL Server
3 301 (38.99%) Data Warehouse
4 290 (37.56%) SQL Server Integration Services
5 228 (29.53%) SQL Server Analysis Services
6 216 (27.98%) SQL Server Reporting Services
7 214 (27.72%) Azure SQL Database
8 207 (26.81%) Hadoop
9 138 (17.88%) NoSQL
10 133 (17.23%) Azure SQL Data Warehouse
11 96 (12.44%) Cosmos DB
12 84 (10.88%) Apache Hive
13 68 (8.81%) HDInsight
14 59 (7.64%) HBase
15 49 (6.35%) Sqoop
16 42 (5.44%) Relational Database
17 40 (5.18%) Oracle ODI
18 37 (4.79%) QlikView
19 33 (4.27%) Microsoft Analysis Services
Development Applications
1 88 (11.40%) Visual Studio
2 76 (9.84%) Git (software)
3 28 (3.63%) Visual Studio Team System
4 13 (1.68%) Jenkins
5 11 (1.42%) JIRA
6 9 (1.17%) RStudio
7 8 (1.04%) GitLab
8 7 (0.91%) Team Foundation Server
9 5 (0.65%) Artifactory
9 5 (0.65%) GoCD
9 5 (0.65%) Sonatype Nexus
10 4 (0.52%) Cucumber
10 4 (0.52%) ERwin
10 4 (0.52%) SoapUI
11 3 (0.39%) Octopus Deploy
11 3 (0.39%) SQL Server Management Studio (SSMS)
11 3 (0.39%) Subversion
11 3 (0.39%) TeamCity
12 2 (0.26%) SpecFlow
12 2 (0.26%) TestNG
General
1 231 (29.92%) Finance
2 108 (13.99%) Advertising
3 93 (12.05%) Banking
4 57 (7.38%) Marketing
5 50 (6.48%) Investment Banking
6 44 (5.70%) Games
7 43 (5.57%) Retail
8 39 (5.05%) Financial Institution
9 15 (1.94%) Publishing
10 8 (1.04%) Corporate Banking
11 5 (0.65%) Billing
12 4 (0.52%) Front Office
13 3 (0.39%) Automotive
13 3 (0.39%) Local Government
14 1 (0.13%) Back Office
14 1 (0.13%) Law
Job Titles
1 253 (32.77%) Developer
2 175 (22.67%) Consultant
3 117 (15.16%) Architect
4 102 (13.21%) Business Intelligence Consultant
5 98 (12.69%) Business Intelligence Developer
6 97 (12.56%) Azure Consultant
7 86 (11.14%) Data Engineer
8 84 (10.88%) Data Architect
9 72 (9.33%) Data Consultant
10 65 (8.42%) SQL Developer
11 62 (8.03%) Power BI Consultant
12 51 (6.61%) Microsoft BI Consultant
12 51 (6.61%) SSIS Developer
13 47 (6.09%) Big Data Developer
14 43 (5.57%) SQL BI Developer
15 41 (5.31%) SSRS Developer
16 40 (5.18%) Senior Developer
17 39 (5.05%) T-SQL Developer
18 38 (4.92%) Data Warehouse Developer
19 36 (4.66%) SSAS Developer
Libraries, Frameworks & Software Standards
1 93 (12.05%) .NET
2 86 (11.14%) Kafka
3 48 (6.22%) AngularJS
4 33 (4.27%) JSON
4 33 (4.27%) Velocity
5 29 (3.76%) ASP.NET
5 29 (3.76%) RabbitMQ
6 28 (3.63%) Natural Language Processing
7 26 (3.37%) jQuery
8 25 (3.24%) HTML
9 24 (3.11%) MDX
10 23 (2.98%) ASP.NET MVC
10 23 (2.98%) HornetQ
10 23 (2.98%) JMS
11 21 (2.72%) .NET Core
11 21 (2.72%) ASP.NET Web API
11 21 (2.72%) REST
11 21 (2.72%) Web Services
12 18 (2.33%) .NET Framework
13 17 (2.20%) Entity Framework
Miscellaneous
1 54 (6.99%) Computer Science
2 43 (5.57%) Analytical Skills
3 39 (5.05%) Cyberthreat
4 34 (4.40%) Fintech
5 29 (3.76%) Self-Motivation
6 18 (2.33%) Algorithms
6 18 (2.33%) Driving Licence
7 17 (2.20%) Hedge funds
8 16 (2.07%) Management Information System
9 15 (1.94%) Data Structures
9 15 (1.94%) Greenfield Project
10 14 (1.81%) Fixed Income
10 14 (1.81%) Public Cloud
11 12 (1.55%) Derivative
11 12 (1.55%) Equities
11 12 (1.55%) User Experience
12 11 (1.42%) Graphic Design
12 11 (1.42%) Virtual Team
13 9 (1.17%) Reference Data
14 8 (1.04%) Credit Risk
Operating Systems
1 24 (3.11%) Linux
2 21 (2.72%) Unix
3 3 (0.39%) Red Hat Enterprise Linux
Processes & Methodologies
1 478 (61.92%) Analytics
2 455 (58.94%) Business Intelligence
3 222 (28.76%) Agile Software Development
4 198 (25.65%) Machine Learning
5 195 (25.26%) Data Analytics
6 185 (23.96%) Data Science
7 172 (22.28%) ETL
8 171 (22.15%) Data Modelling
9 135 (17.49%) Visualisation
10 109 (14.12%) Problem-Solving
11 84 (10.88%) Data Governance
12 80 (10.36%) OO
13 79 (10.23%) Migration
14 78 (10.10%) Data Engineering
14 78 (10.10%) Presales
15 70 (9.07%) Data Visualisation
15 70 (9.07%) Mathematics
16 68 (8.81%) Data Architecture
17 59 (7.64%) TDD
18 57 (7.38%) Mentoring
Programming Languages
1 526 (68.13%) SQL
2 198 (25.65%) Python
3 170 (22.02%) Java
4 161 (20.85%) C#
5 124 (16.06%) T-SQL
6 100 (12.95%) Data Analysis Expressions (DAX)
7 91 (11.79%) Scala
8 74 (9.59%) JavaScript
9 68 (8.81%) R
9 68 (8.81%) U-SQL
10 47 (6.09%) PowerShell
11 39 (5.05%) Perl
12 33 (4.27%) C++
13 26 (3.37%) Shell Script
14 12 (1.55%) Java 8
15 10 (1.30%) C
16 9 (1.17%) Go
17 6 (0.78%) Ruby
18 4 (0.52%) AWK
18 4 (0.52%) VB.NET
Qualifications
1 118 (15.28%) Degree
2 41 (5.31%) Computer Science Degree
3 33 (4.27%) Master's Degree
4 16 (2.07%) Security Cleared
5 14 (1.81%) Microsoft Certification
6 8 (1.04%) MBA
7 6 (0.78%) GSEC
8 5 (0.65%) Numerate Degree
8 5 (0.65%) SC Cleared
9 3 (0.39%) AWS Certification
9 3 (0.39%) MCSA
9 3 (0.39%) MCSE
10 1 (0.13%) PhD
Quality Assurance & Compliance
1 26 (3.37%) Data Quality
2 19 (2.46%) QA
3 14 (1.81%) GDPR
4 3 (0.39%) GCP
4 3 (0.39%) PMO
5 1 (0.13%) Actionable Recommendations
5 1 (0.13%) SLA
System Software
1 78 (10.10%) HDFS
2 50 (6.48%) Virtual Machines
3 36 (4.66%) Docker
4 20 (2.59%) Apache Flume
5 17 (2.20%) Apache ZooKeeper
6 11 (1.42%) Active Directory
7 2 (0.26%) Firmware
Systems Management
1 31 (4.02%) Kubernetes
2 20 (2.59%) Oozie
3 13 (1.68%) Ambari
3 13 (1.68%) Terraform
4 12 (1.55%) Opscode Chef
5 7 (0.91%) Hadoop YARN
5 7 (0.91%) Puppet
6 5 (0.65%) Ansible
6 5 (0.65%) Consul
6 5 (0.65%) Kibana
6 5 (0.65%) Salt
7 4 (0.52%) Docker Swarm
8 2 (0.26%) Mesos
9 1 (0.13%) Systems Management Server (SMS)
Vendors
1 358 (46.37%) Microsoft
2 145 (18.78%) Tableau
3 114 (14.77%) Oracle
4 67 (8.68%) Talend
5 53 (6.87%) Cloudera
6 47 (6.09%) Informatica
7 36 (4.66%) WorldPay
8 34 (4.40%) Sybase
9 27 (3.50%) SnapLogic
10 25 (3.24%) Google
11 24 (3.11%) Hortonworks
12 23 (2.98%) EXASOL
13 22 (2.85%) Databricks
13 22 (2.85%) Netezza
14 18 (2.33%) Cognos
15 17 (2.20%) Alteryx
16 16 (2.07%) Cognizant
17 12 (1.55%) Salesforce.com
18 10 (1.30%) IBM
18 10 (1.30%) SAP