Period
to 18 January 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 January 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
18 Jan 2019
Same period 2018 Same period 2017
Rank 565 795 1080
Rank change year-on-year +230 +285 +172
Permanent jobs citing Data Lake 670 413 116
As % of all permanent IT jobs advertised in the UK 0.44% 0.24% 0.065%
As % of the Database & Business Intelligence category 1.54% 0.78% 0.22%
Number of salaries quoted 534 357 97
UK median annual salary £65,000 £62,500 £70,000
Median salary % change year-on-year +4.00% -10.71% -12.50%
10th Percentile £41,250 £47,500 £41,500
90th Percentile £100,000 £95,000 £103,500
UK excluding London median annual salary £62,138 £55,000 £50,000
% change year-on-year +12.98% +10.00% -27.27%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 43,372 53,095 52,956
As % of all permanent IT jobs advertised in the UK 28.64% 30.52% 29.87%
Number of salaries quoted 35,650 43,998 45,315
UK median annual salary £52,500 £48,000 £47,500
Median salary % change year-on-year +9.38% +1.05% +5.56%
10th Percentile £31,250 £30,000 £29,250
90th Percentile £85,000 £77,500 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +4.94%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

The salary distribution of IT jobs citing Data Lake over the 6 months to 18 January 2019.

Salary histogram for Data Lake in the UK

Data Lake
Top 13 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 18 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +235 663 £65,000 +4.00% 99
London +150 392 £70,000 - 52
UK excluding London +185 278 £62,138 +12.98% 50
South East +95 107 £65,000 +23.81% 23
South West +86 66 £62,138 +8.07% 4
East of England +72 52 £56,250 +7.14% 5
North of England +43 27 £57,500 - 8
Midlands +40 24 £64,733 +7.89% 8
Yorkshire +18 14 £50,000 -9.09% 2
West Midlands +28 13 £65,000 +8.33% 6
North West +22 13 £60,000 +4.35% 4
East Midlands +27 11 £52,500 +5.00% 2
Scotland +9 6 £55,000 +10.00% 2

For the 6 months to 18 January 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 403 (60.15%) Data Warehouse
2 384 (57.31%) Analytics
3 373 (55.67%) Business Intelligence
4 367 (54.78%) SQL
5 359 (53.58%) Microsoft Azure
6 305 (45.52%) Big Data
7 256 (38.21%) Agile Software Development
8 255 (38.06%) SQL Server
9 247 (36.87%) Microsoft
10 233 (34.78%) ETL
11 222 (33.13%) Data Modelling
12 213 (31.79%) Hadoop
13 204 (30.45%) SQL Server Integration Services
14 189 (28.21%) Power BI
15 183 (27.31%) Python
16 158 (23.58%) SQL Server Analysis Services
17 157 (23.43%) Finance
18 154 (22.99%) Apache Spark
19 142 (21.19%) Azure Data Factory
20 140 (20.90%) Amazon AWS
21 139 (20.75%) Machine Learning
22 138 (20.60%) SQL Server Reporting Services
23 135 (20.15%) Azure SQL Database
24 125 (18.66%) Data Science
25 123 (18.36%) Visualisation
26 118 (17.61%) Data Architecture
27 116 (17.31%) Data Analytics
28 110 (16.42%) Azure SQL Data Warehouse
28 110 (16.42%) Oracle
29 105 (15.67%) Data Engineering

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (22.99%) Apache Spark
2 53 (7.91%) Apache
3 32 (4.78%) SAS
4 31 (4.63%) Apache Solr
5 27 (4.03%) Apache Pig
6 24 (3.58%) SharePoint
7 22 (3.28%) Elasticsearch
8 15 (2.24%) Confluence
9 9 (1.34%) BizTalk Server
10 6 (0.90%) Apache Airflow
11 4 (0.60%) IIS
11 4 (0.60%) Luigi
12 3 (0.45%) JBoss
12 3 (0.45%) Jupyter
12 3 (0.45%) Oracle SOA Suite
12 3 (0.45%) Tomcat
12 3 (0.45%) WebLogic
13 2 (0.30%) CMS
13 2 (0.30%) Kentico
14 1 (0.15%) nginx
Applications
1 31 (4.63%) Microsoft Excel
2 7 (1.04%) Microsoft Office
3 5 (0.75%) SPSS
Business Applications
1 18 (2.69%) Dynamics CRM
2 2 (0.30%) Maximo
3 1 (0.15%) Dynamics AX
3 1 (0.15%) Eagle PACE
3 1 (0.15%) Markit EDM
3 1 (0.15%) NetSuite
Cloud Services
1 359 (53.58%) Microsoft Azure
2 142 (21.19%) Azure Data Factory
3 140 (20.90%) Amazon AWS
4 93 (13.88%) Data Lake Analytics
5 72 (10.75%) PaaS
6 53 (7.91%) Google Cloud Platform
7 46 (6.87%) Serverless
8 33 (4.93%) Azure Machine Learning
9 27 (4.03%) Cortana Intelligence Suite
10 22 (3.28%) SaaS
11 18 (2.69%) AWS Lambda
11 18 (2.69%) IaaS
12 17 (2.54%) GitHub
13 16 (2.39%) Amazon S3
13 16 (2.39%) Cloud Computing
14 15 (2.24%) Azure Functions
15 13 (1.94%) Amazon Kinesis
16 11 (1.64%) Azure Active Directory
17 6 (0.90%) Amazon EMR
18 5 (0.75%) BlazeMeter
Communications & Networking
1 12 (1.79%) Firewall
2 7 (1.04%) HTTP
3 6 (0.90%) Kerberos
4 5 (0.75%) Network Security
5 4 (0.60%) Internet
6 3 (0.45%) GoToMeeting
6 3 (0.45%) SNMP
6 3 (0.45%) SSL
6 3 (0.45%) WebEx
7 2 (0.30%) TCP/IP
8 1 (0.15%) SAN
8 1 (0.15%) Wireless
Database & Business Intelligence
1 403 (60.15%) Data Warehouse
2 305 (45.52%) Big Data
3 255 (38.06%) SQL Server
4 213 (31.79%) Hadoop
5 204 (30.45%) SQL Server Integration Services
6 189 (28.21%) Power BI
7 158 (23.58%) SQL Server Analysis Services
8 138 (20.60%) SQL Server Reporting Services
9 135 (20.15%) Azure SQL Database
10 110 (16.42%) Azure SQL Data Warehouse
11 99 (14.78%) NoSQL
12 89 (13.28%) Apache Hive
12 89 (13.28%) Cosmos DB
13 73 (10.90%) MongoDB
13 73 (10.90%) Relational Database
14 70 (10.45%) MySQL
15 64 (9.55%) Microsoft Analysis Services
16 52 (7.76%) Apache Cassandra
16 52 (7.76%) HBase
17 49 (7.31%) Amazon Redshift
Development Applications
1 54 (8.06%) Git (software)
2 49 (7.31%) Visual Studio
3 39 (5.82%) Jenkins
4 36 (5.37%) JIRA
5 31 (4.63%) Visual Studio Team System
6 25 (3.73%) ERwin
7 16 (2.39%) ER Studio
8 14 (2.09%) Team Foundation Server
9 11 (1.64%) Octopus Deploy
9 11 (1.64%) TeamCity
10 8 (1.19%) Eclipse
11 7 (1.04%) SpecFlow
11 7 (1.04%) Subversion
11 7 (1.04%) tSQLt
12 6 (0.90%) Maven
13 5 (0.75%) Atlassian Bamboo
13 5 (0.75%) SoapUI
13 5 (0.75%) SQL Server Management Studio (SSMS)
14 4 (0.60%) FindBugs
14 4 (0.60%) Hudson
General
1 157 (23.43%) Finance
2 75 (11.19%) Retail
3 33 (4.93%) Banking
4 28 (4.18%) Marketing
5 22 (3.28%) Advertising
6 14 (2.09%) Telecoms
7 13 (1.94%) Investment Banking
8 9 (1.34%) Games
9 8 (1.19%) Corporate Banking
10 7 (1.04%) Pharmaceutical
11 6 (0.90%) Online Betting
12 5 (0.75%) Manufacturing
13 3 (0.45%) General Ledger
14 2 (0.30%) Digital Economy
14 2 (0.30%) Electronics
14 2 (0.30%) Legal
15 1 (0.15%) Automotive
15 1 (0.15%) Front Office
15 1 (0.15%) Law
Job Titles
1 168 (25.07%) Architect
2 160 (23.88%) Developer
3 128 (19.10%) Data Architect
4 116 (17.31%) Data Engineer
5 84 (12.54%) Business Intelligence Developer
6 63 (9.40%) Analyst
7 56 (8.36%) Cloud Architect
8 49 (7.31%) Consultant
9 44 (6.57%) SQL Developer
10 40 (5.97%) Big Data Engineer
11 38 (5.67%) Business Analyst
12 37 (5.52%) SQL BI Developer
13 33 (4.93%) Solutions Architect
14 30 (4.48%) Data Warehouse Developer
15 28 (4.18%) Business Intelligence Analyst
16 27 (4.03%) SSIS Developer
17 26 (3.88%) Azure Architect
17 26 (3.88%) Business Intelligence Business Analyst
18 25 (3.73%) Data Consultant
18 25 (3.73%) Microsoft Consultant
Libraries, Frameworks & Software Standards
1 94 (14.03%) Kafka
2 82 (12.24%) .NET
3 55 (8.21%) JSON
4 36 (5.37%) MDX
5 30 (4.48%) Web Services
6 21 (3.13%) XML
7 18 (2.69%) Apache NiFi
8 15 (2.24%) HTML
8 15 (2.24%) REST
9 14 (2.09%) CSS
10 13 (1.94%) AngularJS
10 13 (1.94%) Spark Streaming
11 12 (1.79%) HTML5
11 12 (1.79%) Natural Language Processing
11 12 (1.79%) SAML
12 11 (1.64%) .NET Framework
12 11 (1.64%) RabbitMQ
12 11 (1.64%) Velocity
13 10 (1.49%) scikit-learn
13 10 (1.49%) TensorFlow
Miscellaneous
1 72 (10.75%) Analytical Skills
2 24 (3.58%) Data Structures
2 24 (3.58%) Management Information System
3 18 (2.69%) Greenfield Project
4 16 (2.39%) Clustering
4 16 (2.39%) Reference Data
5 14 (2.09%) Cloud Native
5 14 (2.09%) Reinsurance
6 12 (1.79%) Enterprise Software
7 11 (1.64%) Algorithms
8 10 (1.49%) Public Cloud
9 9 (1.34%) Credit Risk
9 9 (1.34%) EPoS
9 9 (1.34%) Virtual Team
10 8 (1.19%) Equities
10 8 (1.19%) Pricing Data
10 8 (1.19%) User Experience
11 7 (1.04%) Fintech
11 7 (1.04%) Life Science
12 5 (0.75%) NHS
Operating Systems
1 72 (10.75%) Linux
2 35 (5.22%) Windows
3 30 (4.48%) Unix
4 21 (3.13%) Red Hat Enterprise Linux
5 18 (2.69%) CentOS
6 15 (2.24%) Ubuntu
7 12 (1.79%) Windows Server
8 10 (1.49%) Windows Server 2008
9 3 (0.45%) Oracle Linux
9 3 (0.45%) Windows 10
10 2 (0.30%) Android
10 2 (0.30%) Apple iOS
10 2 (0.30%) VMS
Processes & Methodologies
1 384 (57.31%) Analytics
2 373 (55.67%) Business Intelligence
3 256 (38.21%) Agile Software Development
4 233 (34.78%) ETL
5 222 (33.13%) Data Modelling
6 139 (20.75%) Machine Learning
7 125 (18.66%) Data Science
8 123 (18.36%) Visualisation
9 118 (17.61%) Data Architecture
10 116 (17.31%) Data Analytics
11 105 (15.67%) Data Engineering
12 83 (12.39%) Data Integration
13 81 (12.09%) Data Strategy
14 73 (10.90%) Data Governance
15 69 (10.30%) Data Management
16 65 (9.70%) Stakeholder Management
17 64 (9.55%) Scrum
18 63 (9.40%) Migration
19 62 (9.25%) DevOps
20 60 (8.96%) Artificial Intelligence
Programming Languages
1 367 (54.78%) SQL
2 183 (27.31%) Python
3 102 (15.22%) T-SQL
4 98 (14.63%) C#
5 75 (11.19%) Java
6 69 (10.30%) R
7 67 (10.00%) Scala
8 65 (9.70%) PowerShell
9 55 (8.21%) Data Analysis Expressions (DAX)
10 48 (7.16%) U-SQL
11 40 (5.97%) JavaScript
12 15 (2.24%) Shell Script
13 11 (1.64%) Ruby
14 10 (1.49%) C++
15 9 (1.34%) HiveQL
16 8 (1.19%) PL/SQL
17 6 (0.90%) Bash Shell
18 5 (0.75%) Perl
19 3 (0.45%) C
19 3 (0.45%) PHP
Qualifications
1 58 (8.66%) Degree
2 20 (2.99%) Microsoft Certification
3 14 (2.09%) TOGAF Certification
4 8 (1.19%) Computer Science Degree
5 7 (1.04%) PhD
6 6 (0.90%) AWS Certification
7 5 (0.75%) Master's Degree
8 4 (0.60%) MCAD
8 4 (0.60%) MCDBA
8 4 (0.60%) MCSD
9 3 (0.45%) MCP
9 3 (0.45%) MCSE
10 2 (0.30%) CEH
10 2 (0.30%) MCSA
10 2 (0.30%) PMI Certification
10 2 (0.30%) SC Cleared
10 2 (0.30%) Security Cleared
Quality Assurance & Compliance
1 74 (11.04%) Data Quality
2 46 (6.87%) QA
3 19 (2.84%) SLA
4 15 (2.24%) ISO/IEC 27001
5 12 (1.79%) GDPR
6 4 (0.60%) PCI DSS
7 1 (0.15%) Actionable Recommendations
7 1 (0.15%) IFRS
7 1 (0.15%) ISO 20022
7 1 (0.15%) Solvency II
System Software
1 36 (5.37%) HDFS
2 20 (2.99%) Apache Flume
3 18 (2.69%) Docker
4 16 (2.39%) Active Directory
5 14 (2.09%) Virtual Machines
6 11 (1.64%) Apache ZooKeeper
7 5 (0.75%) Hyper-V
7 5 (0.75%) VMware Infrastructure
8 3 (0.45%) XenApp
Systems Management
1 24 (3.58%) Opscode Chef
1 24 (3.58%) Terraform
2 23 (3.43%) Oozie
2 23 (3.43%) Puppet
3 14 (2.09%) Kubernetes
4 12 (1.79%) Kibana
5 7 (1.04%) Ansible
6 6 (0.90%) Grafana
7 4 (0.60%) Rundeck
8 3 (0.45%) Ambari
8 3 (0.45%) Control-M
9 2 (0.30%) ArcSight ESM
9 2 (0.30%) Microsoft Intune
9 2 (0.30%) Salt
10 1 (0.15%) Hadoop YARN
10 1 (0.15%) logstash
Vendors
1 247 (36.87%) Microsoft
2 110 (16.42%) Oracle
3 102 (15.22%) Tableau
4 53 (7.91%) Google
5 50 (7.46%) Databricks
5 50 (7.46%) Teradata
6 48 (7.16%) Cloudera
6 48 (7.16%) Informatica
7 34 (5.07%) Hortonworks
7 34 (5.07%) Talend
8 27 (4.03%) Netezza
9 23 (3.43%) Ab Initio
10 19 (2.84%) Alteryx
10 19 (2.84%) MapR
10 19 (2.84%) Red Hat
10 19 (2.84%) Salesforce.com
11 15 (2.24%) Cognizant
12 13 (1.94%) SAP
12 13 (1.94%) WorldPay
13 11 (1.64%) IDERA