Period
to 18 July 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 July 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
18 Jul 2018
Same period 2017 Same period 2016
Rank 544 947 1231
Rank change year-on-year +403 +284 +85
Permanent jobs citing Data Lake 873 265 63
As % of all permanent IT jobs advertised in the UK 0.50% 0.15% 0.031%
As % of the Database & Business Intelligence category 1.64% 0.49% 0.10%
Number of salaries quoted 605 216 37
UK median annual salary £65,000 £62,000 £66,000
Median salary % change year-on-year +4.84% -6.06% +38.95%
10th Percentile £46,250 £40,250 £42,500
90th Percentile £97,500 £95,000 £120,000
UK excluding London median annual salary £55,000 £55,000 £48,750
% change year-on-year - +12.82% +39.29%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 53,134 54,488 61,531
As % of all permanent IT jobs advertised in the UK 30.43% 30.68% 30.25%
Number of salaries quoted 43,303 45,729 52,448
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,750 £28,750
90th Percentile £81,250 £77,500 £75,000
UK excluding London median annual salary £45,000 £42,500 £41,000
% change year-on-year +5.88% +3.66% +2.50%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

The salary distribution of IT jobs citing Data Lake over the 6 months to 18 July 2018.

Salary histogram for Data Lake in the UK

Data Lake
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 18 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +393 849 £65,000 +4.84% 84
London +369 611 £70,000 - 57
UK excluding London +88 236 £55,000 - 34
South East -41 74 £65,000 +17.12% 13
Midlands +65 68 £52,500 -4.55% 2
West Midlands +73 53 £52,500 -54.35%
North of England +52 48 £60,000 +20.00% 9
Yorkshire +61 40 £60,000 - 2
East of England +37 27 £60,000 - 1
South West +3 17 £57,500 -4.17% 2
East Midlands +11 15 £50,000 -9.09% 2
Scotland -6 15 £47,500 -20.83% 7
North West +8 5 £50,000 +5.26% 7
North East -14 3 £65,000 +30.00%

For the 6 months to 18 July 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 581 (66.55%) SQL
2 562 (64.38%) Analytics
3 499 (57.16%) Business Intelligence
4 479 (54.87%) Microsoft Azure
5 472 (54.07%) Big Data
6 390 (44.67%) Microsoft
7 348 (39.86%) Power BI
8 334 (38.26%) SQL Server
9 296 (33.91%) SQL Server Integration Services
10 295 (33.79%) Data Warehouse
11 284 (32.53%) Azure Data Factory
12 249 (28.52%) Agile Software Development
13 246 (28.18%) Finance
14 245 (28.06%) Hadoop
15 236 (27.03%) Python
16 231 (26.46%) Data Analytics
17 230 (26.35%) SQL Server Analysis Services
18 229 (26.23%) Machine Learning
19 224 (25.66%) Azure SQL Database
20 220 (25.20%) Data Science
21 213 (24.40%) SQL Server Reporting Services
22 207 (23.71%) Java
23 196 (22.45%) ETL
24 188 (21.53%) Apache Spark
25 185 (21.19%) C#
26 183 (20.96%) Tableau
27 181 (20.73%) Data Modelling
28 157 (17.98%) NoSQL
29 151 (17.30%) Visualisation
30 142 (16.27%) Amazon AWS

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 188 (21.53%) Apache Spark
2 46 (5.27%) Apache
3 27 (3.09%) Apache Solr
4 26 (2.98%) Apache Pig
5 21 (2.41%) SharePoint
6 16 (1.83%) BizTalk Server
7 13 (1.49%) SAS
8 7 (0.80%) Elasticsearch
9 6 (0.69%) Tomcat
10 4 (0.46%) Drupal
11 2 (0.23%) Confluence
12 1 (0.11%) Apache Airflow
12 1 (0.11%) IIS
12 1 (0.11%) SharePoint 2013
12 1 (0.11%) Tornado
Applications
1 14 (1.60%) MS Visio
2 13 (1.49%) Microsoft Excel
3 2 (0.23%) Microsoft Office
4 1 (0.11%) Chatbot
Business Applications
1 25 (2.86%) Dynamics CRM
2 4 (0.46%) Markit EDM
3 3 (0.34%) Dynamics AX
Cloud Services
1 479 (54.87%) Microsoft Azure
2 284 (32.53%) Azure Data Factory
3 142 (16.27%) Amazon AWS
4 103 (11.80%) Cortana Intelligence Suite
5 99 (11.34%) Serverless
6 96 (11.00%) IaaS
7 78 (8.93%) PaaS
8 52 (5.96%) Azure Machine Learning
9 29 (3.32%) Data Lake Analytics
10 26 (2.98%) SaaS
11 24 (2.75%) AWS Lambda
12 22 (2.52%) Office 365
13 21 (2.41%) Amazon S3
14 20 (2.29%) Google Cloud Platform
15 17 (1.95%) Amazon EMR
15 17 (1.95%) GitHub
16 15 (1.72%) Amazon Kinesis
17 14 (1.60%) Cloud Computing
18 10 (1.15%) OpenShift
19 9 (1.03%) Datadog
Communications & Networking
1 11 (1.26%) VPN
2 9 (1.03%) DNS
2 9 (1.03%) Firewall
2 9 (1.03%) HTTP
2 9 (1.03%) SMTP
2 9 (1.03%) TCP/IP
3 2 (0.23%) Internet
4 1 (0.11%) Intranet
Database & Business Intelligence
1 472 (54.07%) Big Data
2 348 (39.86%) Power BI
3 334 (38.26%) SQL Server
4 296 (33.91%) SQL Server Integration Services
5 295 (33.79%) Data Warehouse
6 245 (28.06%) Hadoop
7 230 (26.35%) SQL Server Analysis Services
8 224 (25.66%) Azure SQL Database
9 213 (24.40%) SQL Server Reporting Services
10 157 (17.98%) NoSQL
11 124 (14.20%) Azure SQL Data Warehouse
12 106 (12.14%) Apache Hive
13 92 (10.54%) HDInsight
14 91 (10.42%) Cosmos DB
15 68 (7.79%) HBase
16 59 (6.76%) Sqoop
17 45 (5.15%) Oracle ODI
17 45 (5.15%) Relational Database
18 39 (4.47%) QlikView
18 39 (4.47%) SQL Server 2014
Development Applications
1 113 (12.94%) Visual Studio
2 99 (11.34%) Git (software)
3 34 (3.89%) Visual Studio Team System
4 27 (3.09%) Jenkins
5 17 (1.95%) RStudio
5 17 (1.95%) Sonatype Nexus
6 13 (1.49%) JIRA
7 11 (1.26%) GitLab
8 9 (1.03%) Artifactory
8 9 (1.03%) GoCD
9 7 (0.80%) Team Foundation Server
10 6 (0.69%) ERwin
11 5 (0.57%) Cucumber
12 4 (0.46%) TeamCity
13 3 (0.34%) JUnit
13 3 (0.34%) Maven
13 3 (0.34%) Octopus Deploy
14 2 (0.23%) NUnit
14 2 (0.23%) SQL Server Management Studio (SSMS)
14 2 (0.23%) Subversion
General
1 246 (28.18%) Finance
2 113 (12.94%) Advertising
3 105 (12.03%) Banking
4 63 (7.22%) Marketing
5 49 (5.61%) Investment Banking
6 42 (4.81%) Financial Institution
6 42 (4.81%) Games
7 41 (4.70%) Retail
8 18 (2.06%) Publishing
9 7 (0.80%) Billing
10 6 (0.69%) Front Office
11 4 (0.46%) Automotive
11 4 (0.46%) Corporate Banking
12 3 (0.34%) Local Government
13 2 (0.23%) Law
14 1 (0.11%) Back Office
14 1 (0.11%) Manufacturing
14 1 (0.11%) Pharmaceutical
Job Titles
1 271 (31.04%) Developer
2 194 (22.22%) Consultant
3 130 (14.89%) Architect
4 121 (13.86%) Business Intelligence Consultant
5 103 (11.80%) Azure Consultant
6 100 (11.45%) Data Engineer
7 94 (10.77%) Data Architect
8 89 (10.19%) Business Intelligence Developer
9 75 (8.59%) Power BI Consultant
10 73 (8.36%) Data Consultant
11 62 (7.10%) Microsoft BI Consultant
12 57 (6.53%) SQL Developer
13 56 (6.41%) Big Data Developer
14 44 (5.04%) SSIS Developer
15 39 (4.47%) SSRS Developer
16 38 (4.35%) SQL BI Developer
17 36 (4.12%) C# Developer
17 36 (4.12%) DBA
17 36 (4.12%) Senior Developer
18 35 (4.01%) Data Scientist
Libraries, Frameworks & Software Standards
1 107 (12.26%) .NET
1 107 (12.26%) Kafka
2 59 (6.76%) AngularJS
3 35 (4.01%) ASP.NET
3 35 (4.01%) Velocity
4 34 (3.89%) jQuery
4 34 (3.89%) JSON
4 34 (3.89%) RabbitMQ
5 33 (3.78%) HTML
6 30 (3.44%) Natural Language Processing
7 29 (3.32%) HornetQ
7 29 (3.32%) JMS
8 28 (3.21%) ASP.NET MVC
9 23 (2.63%) .NET Core
9 23 (2.63%) ASP.NET Web API
9 23 (2.63%) REST
9 23 (2.63%) Web Services
10 22 (2.52%) .NET Framework
11 21 (2.41%) Entity Framework
11 21 (2.41%) XML
Miscellaneous
1 73 (8.36%) Computer Science
2 65 (7.45%) Analytical Skills
3 41 (4.70%) Cyberthreat
3 41 (4.70%) Self-Motivation
4 37 (4.24%) Fintech
5 25 (2.86%) Algorithms
6 23 (2.63%) Driving Licence
7 20 (2.29%) Hedge funds
8 19 (2.18%) Data Structures
9 18 (2.06%) Greenfield Project
10 17 (1.95%) Fixed Income
10 17 (1.95%) Public Cloud
10 17 (1.95%) User Experience
11 16 (1.83%) Graphic Design
12 15 (1.72%) Management Information System
13 14 (1.60%) Virtual Team
14 12 (1.37%) Derivative
14 12 (1.37%) Enterprise Software
15 10 (1.15%) Equities
15 10 (1.15%) Taxonomies
Operating Systems
1 38 (4.35%) Linux
2 24 (2.75%) Unix
3 10 (1.15%) Red Hat Enterprise Linux
4 2 (0.23%) CentOS
Processes & Methodologies
1 562 (64.38%) Analytics
2 499 (57.16%) Business Intelligence
3 249 (28.52%) Agile Software Development
4 231 (26.46%) Data Analytics
5 229 (26.23%) Machine Learning
6 220 (25.20%) Data Science
7 196 (22.45%) ETL
8 181 (20.73%) Data Modelling
9 151 (17.30%) Visualisation
10 119 (13.63%) Problem-Solving
11 105 (12.03%) Data Governance
12 101 (11.57%) Presales
13 97 (11.11%) Migration
14 91 (10.42%) OO
15 86 (9.85%) Data Engineering
16 80 (9.16%) Data Visualisation
16 80 (9.16%) Mathematics
17 75 (8.59%) Data Architecture
18 70 (8.02%) Service Delivery
19 66 (7.56%) Mentoring
Programming Languages
1 581 (66.55%) SQL
2 236 (27.03%) Python
3 207 (23.71%) Java
4 185 (21.19%) C#
5 138 (15.81%) T-SQL
6 108 (12.37%) Scala
7 90 (10.31%) R
8 87 (9.97%) Data Analysis Expressions (DAX)
9 82 (9.39%) JavaScript
9 82 (9.39%) U-SQL
10 62 (7.10%) PowerShell
11 40 (4.58%) C++
12 39 (4.47%) Perl
13 26 (2.98%) Shell Script
14 16 (1.83%) Java 8
15 14 (1.60%) C
16 13 (1.49%) Go
17 12 (1.37%) Ruby
18 5 (0.57%) VB.NET
19 4 (0.46%) MATLAB
Qualifications
1 141 (16.15%) Degree
2 60 (6.87%) Computer Science Degree
3 49 (5.61%) Master's Degree
4 20 (2.29%) Security Cleared
5 12 (1.37%) Microsoft Certification
6 10 (1.15%) AWS Certification
7 8 (0.92%) MBA
8 6 (0.69%) GSEC
9 5 (0.57%) Numerate Degree
9 5 (0.57%) SC Cleared
10 2 (0.23%) MCSA
10 2 (0.23%) MCSE
10 2 (0.23%) PhD
11 1 (0.11%) CISM
11 1 (0.11%) CISSP
11 1 (0.11%) CompTIA Security+
11 1 (0.11%) DBS Check
Quality Assurance & Compliance
1 38 (4.35%) Data Quality
2 17 (1.95%) GDPR
2 17 (1.95%) QA
3 5 (0.57%) GCP
3 5 (0.57%) PMO
4 1 (0.11%) HIPAA
4 1 (0.11%) ISO/IEC 27001
4 1 (0.11%) Sarbanes-Oxley
4 1 (0.11%) SLA
System Software
1 93 (10.65%) HDFS
2 68 (7.79%) Virtual Machines
3 42 (4.81%) Docker
4 21 (2.41%) Apache Flume
5 19 (2.18%) Active Directory
5 19 (2.18%) Apache ZooKeeper
6 2 (0.23%) Firmware
Systems Management
1 38 (4.35%) Kubernetes
2 28 (3.21%) Oozie
3 21 (2.41%) Opscode Chef
4 17 (1.95%) Terraform
5 15 (1.72%) Ambari
6 11 (1.26%) Ansible
7 10 (1.15%) Puppet
7 10 (1.15%) Salt
8 9 (1.03%) Consul
8 9 (1.03%) Hadoop YARN
9 5 (0.57%) Kibana
10 4 (0.46%) Docker Swarm
11 2 (0.23%) Mesos
12 1 (0.11%) Systems Management Server (SMS)
Vendors
1 390 (44.67%) Microsoft
2 183 (20.96%) Tableau
3 123 (14.09%) Oracle
4 83 (9.51%) Talend
5 65 (7.45%) Cloudera
6 51 (5.84%) Informatica
7 35 (4.01%) Sybase
7 35 (4.01%) WorldPay
8 33 (3.78%) Google
9 30 (3.44%) SnapLogic
10 29 (3.32%) EXASOL
11 25 (2.86%) Alteryx
12 23 (2.63%) Hortonworks
13 20 (2.29%) Cognos
14 19 (2.18%) Netezza
15 18 (2.06%) Cognizant
16 16 (1.83%) IBM
17 15 (1.72%) Databricks
17 15 (1.72%) Salesforce.com
18 10 (1.15%) Red Hat