Period
to 18 September 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 September 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
18 Sep 2018
Same period 2017 Same period 2016
Rank 571 925 1193
Rank change year-on-year +354 +268 +114
Permanent jobs citing Data Lake 738 285 78
As % of all permanent IT jobs advertised in the UK 0.44% 0.16% 0.041%
As % of the Database & Business Intelligence category 1.48% 0.53% 0.14%
Number of salaries quoted 539 234 64
UK median annual salary £65,000 £60,000 £77,500
Median salary % change year-on-year +8.33% -22.58% +72.22%
10th Percentile £46,000 £40,725 £42,500
90th Percentile £97,500 £98,500 £118,125
UK excluding London median annual salary £57,500 £53,750 £47,500
% change year-on-year +6.98% +13.16% +35.71%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 49,898 54,000 57,357
As % of all permanent IT jobs advertised in the UK 29.75% 30.62% 29.79%
Number of salaries quoted 40,690 44,484 48,890
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £82,500 £77,500 £75,000
UK excluding London median annual salary £45,000 £42,500 £41,500
% change year-on-year +5.88% +2.41% +3.75%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

The salary distribution of IT jobs citing Data Lake over the 6 months to 18 September 2018.

Salary histogram for Data Lake in the UK

Data Lake
Top 13 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 18 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +348 724 £65,000 +8.33% 68
London +341 529 £70,000 - 44
UK excluding London +73 198 £57,500 +6.98% 26
South East -23 72 £65,000 +30.00% 7
Midlands +50 44 £50,000 -9.09% 3
North of England +34 35 £60,000 +26.32% 4
East of England +44 30 £55,000 -2.22% 1
West Midlands +50 29 £47,500 -45.71%
Yorkshire +41 22 £60,000 -14.29%
East Midlands +15 15 £50,000 -6.98% 3
North West +23 13 £60,000 +26.32% 4
South West -2 13 £73,750 +22.92% 9
Scotland +3 10 £47,000 -12.96% 2

For the 6 months to 18 September 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 489 (66.26%) SQL
2 456 (61.79%) Analytics
3 447 (60.57%) Business Intelligence
4 412 (55.83%) Microsoft Azure
5 375 (50.81%) Big Data
6 347 (47.02%) Microsoft
7 338 (45.80%) Data Warehouse
8 327 (44.31%) SQL Server
9 307 (41.60%) Power BI
10 270 (36.59%) SQL Server Integration Services
11 228 (30.89%) Azure Data Factory
12 221 (29.95%) Agile Software Development
13 214 (29.00%) SQL Server Analysis Services
14 213 (28.86%) Azure SQL Database
15 211 (28.59%) Hadoop
16 209 (28.32%) Finance
17 208 (28.18%) SQL Server Reporting Services
18 188 (25.47%) Data Analytics
19 184 (24.93%) ETL
20 181 (24.53%) Machine Learning
21 180 (24.39%) Data Modelling
22 178 (24.12%) Python
23 158 (21.41%) Data Science
24 147 (19.92%) Azure SQL Data Warehouse
25 143 (19.38%) Java
26 136 (18.43%) Apache Spark
27 135 (18.29%) C#
28 124 (16.80%) Tableau
29 123 (16.67%) Visualisation
30 117 (15.85%) T-SQL

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 136 (18.43%) Apache Spark
2 52 (7.05%) Apache
3 27 (3.66%) Apache Pig
4 25 (3.39%) Apache Solr
5 18 (2.44%) SharePoint
6 17 (2.30%) SAS
7 10 (1.36%) Confluence
8 8 (1.08%) Tomcat
9 5 (0.68%) BizTalk Server
9 5 (0.68%) Elasticsearch
10 4 (0.54%) Drupal
11 3 (0.41%) IIS
12 2 (0.27%) Apache Airflow
12 2 (0.27%) JBoss
12 2 (0.27%) Tornado
13 1 (0.14%) Luigi
13 1 (0.14%) SharePoint 2013
Applications
1 23 (3.12%) Microsoft Excel
2 7 (0.95%) MS Visio
3 2 (0.27%) Microsoft Office
4 1 (0.14%) Chatbot
Business Applications
1 8 (1.08%) Dynamics CRM
2 4 (0.54%) Dynamics AX
3 3 (0.41%) Markit EDM
4 2 (0.27%) Maximo
5 1 (0.14%) NetSuite
Cloud Services
1 412 (55.83%) Microsoft Azure
2 228 (30.89%) Azure Data Factory
3 115 (15.58%) Amazon AWS
4 80 (10.84%) PaaS
5 67 (9.08%) Cortana Intelligence Suite
5 67 (9.08%) Serverless
6 56 (7.59%) Data Lake Analytics
7 52 (7.05%) IaaS
8 43 (5.83%) Azure Machine Learning
9 23 (3.12%) Google Cloud Platform
10 17 (2.30%) SaaS
11 16 (2.17%) Amazon Kinesis
12 15 (2.03%) Azure Functions
13 13 (1.76%) AWS Lambda
14 12 (1.63%) Amazon S3
14 12 (1.63%) Cloud Computing
15 8 (1.08%) Office 365
16 6 (0.81%) Amazon EMR
17 5 (0.68%) Azure Active Directory
18 3 (0.41%) Dynamics 365
Communications & Networking
1 3 (0.41%) Internet
2 2 (0.27%) Firewall
2 2 (0.27%) Kerberos
2 2 (0.27%) SSL
2 2 (0.27%) VPN
3 1 (0.14%) Intranet
Database & Business Intelligence
1 375 (50.81%) Big Data
2 338 (45.80%) Data Warehouse
3 327 (44.31%) SQL Server
4 307 (41.60%) Power BI
5 270 (36.59%) SQL Server Integration Services
6 214 (29.00%) SQL Server Analysis Services
7 213 (28.86%) Azure SQL Database
8 211 (28.59%) Hadoop
9 208 (28.18%) SQL Server Reporting Services
10 147 (19.92%) Azure SQL Data Warehouse
11 113 (15.31%) NoSQL
12 95 (12.87%) Cosmos DB
13 76 (10.30%) Apache Hive
14 58 (7.86%) HDInsight
15 53 (7.18%) HBase
16 50 (6.78%) Relational Database
17 48 (6.50%) Microsoft Analysis Services
18 37 (5.01%) Sqoop
19 36 (4.88%) QlikView
20 35 (4.74%) SQL Server 2012
Development Applications
1 72 (9.76%) Visual Studio
2 59 (7.99%) Git (software)
3 21 (2.85%) Visual Studio Team System
4 15 (2.03%) Jenkins
5 11 (1.49%) JIRA
6 7 (0.95%) ERwin
7 6 (0.81%) GitLab
7 6 (0.81%) Team Foundation Server
7 6 (0.81%) TeamCity
8 5 (0.68%) SoapUI
8 5 (0.68%) Subversion
9 4 (0.54%) Hudson
9 4 (0.54%) Octopus Deploy
9 4 (0.54%) SpecFlow
9 4 (0.54%) SQL Server Management Studio (SSMS)
10 3 (0.41%) Atlassian Bamboo
10 3 (0.41%) Cucumber
10 3 (0.41%) Maven
10 3 (0.41%) RStudio
10 3 (0.41%) tSQLt
General
1 209 (28.32%) Finance
2 92 (12.47%) Advertising
3 88 (11.92%) Banking
4 50 (6.78%) Investment Banking
5 47 (6.37%) Marketing
6 42 (5.69%) Retail
7 35 (4.74%) Financial Institution
8 33 (4.47%) Games
9 12 (1.63%) Corporate Banking
9 12 (1.63%) Publishing
10 5 (0.68%) Billing
11 4 (0.54%) Automotive
11 4 (0.54%) Front Office
12 3 (0.41%) Telecoms
13 2 (0.27%) Manufacturing
13 2 (0.27%) Online Betting
14 1 (0.14%) Law
14 1 (0.14%) Legal
14 1 (0.14%) Local Government
Job Titles
1 234 (31.71%) Developer
2 156 (21.14%) Consultant
3 129 (17.48%) Architect
4 96 (13.01%) Business Intelligence Developer
5 95 (12.87%) Data Architect
6 90 (12.20%) Data Engineer
7 81 (10.98%) Business Intelligence Consultant
8 77 (10.43%) Azure Consultant
9 70 (9.49%) Data Consultant
10 66 (8.94%) SQL Developer
11 53 (7.18%) SSIS Developer
12 45 (6.10%) Data Warehouse Developer
13 44 (5.96%) Microsoft BI Consultant
14 43 (5.83%) Big Data Developer
14 43 (5.83%) SQL BI Developer
15 42 (5.69%) Power BI Consultant
16 40 (5.42%) SSRS Developer
17 38 (5.15%) T-SQL Developer
18 37 (5.01%) Senior Developer
19 35 (4.74%) SSAS Developer
Libraries, Frameworks & Software Standards
1 87 (11.79%) .NET
2 82 (11.11%) Kafka
3 41 (5.56%) JSON
4 34 (4.61%) AngularJS
5 30 (4.07%) Velocity
6 28 (3.79%) MDX
7 27 (3.66%) Web Services
8 25 (3.39%) RabbitMQ
9 24 (3.25%) Natural Language Processing
10 20 (2.71%) REST
11 19 (2.57%) jQuery
12 18 (2.44%) HornetQ
12 18 (2.44%) JMS
12 18 (2.44%) RESTful
13 17 (2.30%) ASP.NET
14 16 (2.17%) HTML
15 14 (1.90%) .NET Core
15 14 (1.90%) ASP.NET MVC
15 14 (1.90%) ASP.NET Web API
16 10 (1.36%) .NET Framework
Miscellaneous
1 57 (7.72%) Analytical Skills
2 47 (6.37%) Computer Science
3 35 (4.74%) Cyberthreat
4 27 (3.66%) Self-Motivation
5 20 (2.71%) Algorithms
5 20 (2.71%) Fintech
6 17 (2.30%) Driving Licence
6 17 (2.30%) Reference Data
7 16 (2.17%) Greenfield Project
8 14 (1.90%) Equities
8 14 (1.90%) Hedge funds
8 14 (1.90%) Management Information System
9 12 (1.63%) Credit Risk
9 12 (1.63%) Derivative
9 12 (1.63%) Enterprise Software
10 11 (1.49%) Public Cloud
11 9 (1.22%) Data Structures
11 9 (1.22%) Virtual Team
12 8 (1.08%) Fixed Income
12 8 (1.08%) Taxonomies
Operating Systems
1 20 (2.71%) Linux
2 19 (2.57%) Unix
3 7 (0.95%) Red Hat Enterprise Linux
4 5 (0.68%) Windows
5 4 (0.54%) CentOS
6 2 (0.27%) Ubuntu
Processes & Methodologies
1 456 (61.79%) Analytics
2 447 (60.57%) Business Intelligence
3 221 (29.95%) Agile Software Development
4 188 (25.47%) Data Analytics
5 184 (24.93%) ETL
6 181 (24.53%) Machine Learning
7 180 (24.39%) Data Modelling
8 158 (21.41%) Data Science
9 123 (16.67%) Visualisation
10 100 (13.55%) Problem-Solving
11 81 (10.98%) Data Architecture
12 74 (10.03%) Data Governance
13 69 (9.35%) Data Engineering
14 67 (9.08%) OO
15 64 (8.67%) Migration
16 63 (8.54%) Data Integration
16 63 (8.54%) Data Visualisation
17 62 (8.40%) Data Management
18 59 (7.99%) Presales
19 58 (7.86%) Data Strategy
Programming Languages
1 489 (66.26%) SQL
2 178 (24.12%) Python
3 143 (19.38%) Java
4 135 (18.29%) C#
5 117 (15.85%) T-SQL
6 92 (12.47%) Data Analysis Expressions (DAX)
7 85 (11.52%) Scala
8 67 (9.08%) U-SQL
9 65 (8.81%) JavaScript
10 64 (8.67%) R
11 45 (6.10%) PowerShell
12 35 (4.74%) Perl
13 27 (3.66%) C++
14 24 (3.25%) Shell Script
15 10 (1.36%) C
16 8 (1.08%) Java 8
17 4 (0.54%) Bash Shell
17 4 (0.54%) Go
18 3 (0.41%) AWK
18 3 (0.41%) Ruby
Qualifications
1 92 (12.47%) Degree
2 30 (4.07%) Computer Science Degree
3 26 (3.52%) Master's Degree
4 18 (2.44%) Microsoft Certification
5 11 (1.49%) Security Cleared
6 8 (1.08%) MBA
7 6 (0.81%) GSEC
8 5 (0.68%) SC Cleared
9 4 (0.54%) PhD
10 3 (0.41%) MCSA
10 3 (0.41%) MCSE
11 2 (0.27%) AWS Certification
11 2 (0.27%) Numerate Degree
12 1 (0.14%) CISM
12 1 (0.14%) CISSP
12 1 (0.14%) CompTIA Security+
Quality Assurance & Compliance
1 34 (4.61%) Data Quality
2 19 (2.57%) QA
3 8 (1.08%) GDPR
4 7 (0.95%) SLA
5 5 (0.68%) GCP
6 3 (0.41%) ISO/IEC 27001
6 3 (0.41%) PMO
7 1 (0.14%) Actionable Recommendations
System Software
1 70 (9.49%) HDFS
2 37 (5.01%) Virtual Machines
3 29 (3.93%) Docker
4 21 (2.85%) Apache Flume
5 16 (2.17%) Apache ZooKeeper
6 10 (1.36%) Active Directory
7 2 (0.27%) Firmware
7 2 (0.27%) Hyper-V
7 2 (0.27%) VMware Infrastructure
7 2 (0.27%) XenApp
Systems Management
1 23 (3.12%) Kubernetes
2 20 (2.71%) Oozie
3 15 (2.03%) Opscode Chef
3 15 (2.03%) Puppet
3 15 (2.03%) Terraform
4 7 (0.95%) Ambari
4 7 (0.95%) Hadoop YARN
5 5 (0.68%) Kibana
6 4 (0.54%) Docker Swarm
7 2 (0.27%) Ansible
8 1 (0.14%) Grafana
8 1 (0.14%) Mesos
8 1 (0.14%) Salt
8 1 (0.14%) Systems Management Server (SMS)
Vendors
1 347 (47.02%) Microsoft
2 124 (16.80%) Tableau
3 104 (14.09%) Oracle
4 61 (8.27%) Talend
5 55 (7.45%) Cloudera
6 39 (5.28%) Informatica
7 31 (4.20%) Databricks
8 27 (3.66%) Sybase
9 23 (3.12%) Google
9 23 (3.12%) WorldPay
10 22 (2.98%) Hortonworks
10 22 (2.98%) SnapLogic
11 18 (2.44%) EXASOL
12 17 (2.30%) Netezza
13 14 (1.90%) Cognizant
14 13 (1.76%) MapR
14 13 (1.76%) Salesforce.com
14 13 (1.76%) Teradata
15 12 (1.63%) Cognos
15 12 (1.63%) SAP