Period
to 23 May 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 23 May 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
UK
6 months to
23 May 2019
Same period 2018 Same period 2017
Rank 505 541 969
Rank change year-on-year +36 +428 +262
Permanent jobs citing Data Lake 771 869 199
As % of all permanent IT jobs advertised in the UK 0.54% 0.51% 0.12%
As % of the Database & Business Intelligence category 1.91% 1.65% 0.38%
Number of salaries quoted 600 633 154
UK median annual salary £65,500 £65,000 £64,181
Median salary % change year-on-year +0.77% +1.28% +3.94%
10th Percentile £43,750 £47,500 £35,000
90th Percentile £101,250 £97,500 £95,000
UK excluding London median annual salary £61,819 £55,000 £55,000
% change year-on-year +12.40% - +22.22%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 40,459 52,734 52,306
As % of all permanent IT jobs advertised in the UK 28.09% 30.68% 30.92%
Number of salaries quoted 32,976 43,359 44,408
UK median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,250 £31,250 £29,500
90th Percentile £85,000 £80,000 £77,500
UK excluding London median annual salary £45,000 £44,471 £42,000
% change year-on-year +1.19% +5.88% +1.20%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake.

Salary trend for Data Lake in the UK

Data Lake
Salary Histogram

The salary distribution of IT jobs citing Data Lake over the 6 months to 23 May 2019.

Salary histogram for Data Lake in the UK

Data Lake
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the UK over the 6 months to 23 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +30 745 £66,250 +1.92% 72
London -23 419 £70,000 - 33
UK excluding London +143 330 £61,819 +12.40% 39
South East +105 127 £64,600 -0.62% 13
South West +73 65 £61,500 +6.96% 3
North of England +23 49 £63,354 +5.59% 16
East of England +77 39 £75,000 +25.00% 1
Midlands -6 38 £55,000 +4.76% 6
East Midlands +39 27 £55,000 +10.00% 1
North West +56 23 £42,500 -22.73% 11
Yorkshire -12 20 £50,000 -16.67% 2
Scotland +16 12 £52,500 +10.53%
West Midlands -32 11 £65,000 +18.18% 5
North East +19 6 £67,500 +3.85% 3

For the 6 months to 23 May 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Lake.

1 493 (63.94%) Data Warehouse
2 439 (56.94%) SQL
3 436 (56.55%) Microsoft Azure
4 411 (53.31%) Analytics
5 385 (49.94%) Business Intelligence
6 368 (47.73%) Agile Software Development
7 306 (39.69%) Big Data
8 298 (38.65%) Python
9 283 (36.71%) Microsoft
10 264 (34.24%) SQL Server
11 238 (30.87%) ETL
12 234 (30.35%) Power BI
12 234 (30.35%) Power Platform
13 225 (29.18%) Data Modelling
14 223 (28.92%) Hadoop
15 222 (28.79%) SQL Server Integration Services
16 203 (26.33%) Finance
17 193 (25.03%) Azure Data Factory
18 189 (24.51%) SQL Server Analysis Services
19 176 (22.83%) DevOps
20 173 (22.44%) Apache Spark
21 170 (22.05%) Amazon AWS
22 166 (21.53%) Azure SQL Database
22 166 (21.53%) SQL Server Reporting Services
23 165 (21.40%) Databricks
24 151 (19.58%) Data Analytics
24 151 (19.58%) Data Architecture
25 148 (19.20%) Machine Learning
25 148 (19.20%) Data Science
26 128 (16.60%) Azure SQL Data Warehouse

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 173 (22.44%) Apache Spark
2 69 (8.95%) Apache
3 33 (4.28%) SAS
4 24 (3.11%) Apache Solr
5 20 (2.59%) Apache Pig
6 19 (2.46%) Elasticsearch
7 18 (2.33%) BizTalk Server
8 15 (1.95%) SharePoint
9 7 (0.91%) IIS
10 4 (0.52%) Confluence
11 3 (0.39%) Apache Airflow
11 3 (0.39%) Jupyter
12 2 (0.26%) Anypoint
13 1 (0.13%) Luigi
13 1 (0.13%) nginx
13 1 (0.13%) Oracle SOA Suite
13 1 (0.13%) WebLogic
Applications
1 17 (2.20%) SPSS
2 15 (1.95%) Microsoft Office
3 3 (0.39%) Microsoft Excel
4 2 (0.26%) Chatbot
4 2 (0.26%) Spreadsheet
5 1 (0.13%) MS Visio
Business Applications
1 22 (2.85%) Dynamics CRM
2 2 (0.26%) Adobe Campaign
2 2 (0.26%) Infor M3
2 2 (0.26%) Markit EDM
2 2 (0.26%) SAP ERP
3 1 (0.13%) Eagle PACE
Cloud Services
1 436 (56.55%) Microsoft Azure
2 234 (30.35%) Power Platform
3 193 (25.03%) Azure Data Factory
4 170 (22.05%) Amazon AWS
5 67 (8.69%) Google Cloud Platform
6 58 (7.52%) Data Lake Analytics
7 57 (7.39%) Serverless
8 49 (6.36%) PaaS
9 38 (4.93%) SaaS
10 37 (4.80%) Cortana Intelligence Suite
11 26 (3.37%) Amazon S3
11 26 (3.37%) Azure Machine Learning
12 24 (3.11%) Azure Functions
12 24 (3.11%) IaaS
13 21 (2.72%) Azure Active Directory
14 17 (2.20%) GitHub
15 16 (2.08%) AWS Lambda
16 14 (1.82%) npm
17 12 (1.56%) Amazon EMR
18 10 (1.30%) Cloud Computing
Communications & Networking
1 15 (1.95%) Broadband
2 5 (0.65%) Firewall
3 3 (0.39%) Kerberos
4 2 (0.26%) Internet
4 2 (0.26%) TCP/IP
5 1 (0.13%) DHCP
5 1 (0.13%) DNS
5 1 (0.13%) FTP
5 1 (0.13%) HTTP
5 1 (0.13%) HTTPS
5 1 (0.13%) SAN
5 1 (0.13%) SMTP
5 1 (0.13%) SSL
5 1 (0.13%) Telnet
5 1 (0.13%) Wireless
Database & Business Intelligence
1 493 (63.94%) Data Warehouse
2 306 (39.69%) Big Data
3 264 (34.24%) SQL Server
4 234 (30.35%) Power BI
5 223 (28.92%) Hadoop
6 222 (28.79%) SQL Server Integration Services
7 189 (24.51%) SQL Server Analysis Services
8 166 (21.53%) Azure SQL Database
8 166 (21.53%) SQL Server Reporting Services
9 128 (16.60%) Azure SQL Data Warehouse
10 127 (16.47%) NoSQL
11 81 (10.51%) Relational Database
12 74 (9.60%) Apache Hive
12 74 (9.60%) Microsoft Analysis Services
13 72 (9.34%) Cosmos DB
14 62 (8.04%) MongoDB
15 48 (6.23%) BigQuery
16 46 (5.97%) Apache Cassandra
17 43 (5.58%) SQL Server 2016
18 40 (5.19%) Geospatial Data
Development Applications
1 61 (7.91%) Visual Studio
2 49 (6.36%) Git (software)
3 40 (5.19%) Visual Studio Team System
4 28 (3.63%) Jenkins
5 26 (3.37%) JIRA
6 16 (2.08%) Team Foundation Server
7 13 (1.69%) Octopus Deploy
8 12 (1.56%) TeamCity
9 10 (1.30%) ER Studio
10 8 (1.04%) ERwin
10 8 (1.04%) git-flow
10 8 (1.04%) Sinon.JS
10 8 (1.04%) webpack
11 7 (0.91%) Cucumber
11 7 (0.91%) Mercurial
11 7 (0.91%) Selenium
12 6 (0.78%) Subversion
13 5 (0.65%) RStudio
14 4 (0.52%) Maven
14 4 (0.52%) Sonatype Nexus
General
1 203 (26.33%) Finance
2 59 (7.65%) Retail
3 30 (3.89%) Marketing
4 26 (3.37%) Banking
5 19 (2.46%) Advertising
6 14 (1.82%) Telecoms
7 10 (1.30%) Pharmaceutical
8 9 (1.17%) General Ledger
8 9 (1.17%) Law
9 8 (1.04%) Games
10 3 (0.39%) Manufacturing
11 2 (0.26%) Back Office
11 2 (0.26%) Electronics
11 2 (0.26%) Publishing
12 1 (0.13%) Automotive
12 1 (0.13%) Front Office
12 1 (0.13%) Investment Banking
12 1 (0.13%) Legal
Job Titles
1 208 (26.98%) Developer
2 175 (22.70%) Architect
3 160 (20.75%) Data Engineer
4 124 (16.08%) Business Intelligence Developer
5 123 (15.95%) Data Architect
6 70 (9.08%) SQL Developer
7 63 (8.17%) SQL BI Developer
8 51 (6.61%) Azure Developer
9 49 (6.36%) Cloud Architect
10 48 (6.23%) Enterprise Architect
11 46 (5.97%) Senior Developer
12 43 (5.58%) Big Data Engineer
13 41 (5.32%) Analyst
14 39 (5.06%) Senior Data Engineer
15 38 (4.93%) Senior Business Intelligence Developer
15 38 (4.93%) SSRS Developer
16 37 (4.80%) Business Intelligence Lead
16 37 (4.80%) Power BI Developer
17 34 (4.41%) T-SQL Developer
18 33 (4.28%) Senior Architect
Libraries, Frameworks & Software Standards
1 102 (13.23%) Kafka
2 94 (12.19%) .NET
3 88 (11.41%) MDX
4 53 (6.87%) JSON
5 30 (3.89%) XML
6 29 (3.76%) Apache NiFi
7 26 (3.37%) .NET Framework
8 25 (3.24%) REST
8 25 (3.24%) Web Services
9 22 (2.85%) HTML
10 16 (2.08%) CSS
10 16 (2.08%) Pandas
10 16 (2.08%) Spring
11 15 (1.95%) Natural Language Processing
11 15 (1.95%) SciPy
12 14 (1.82%) RabbitMQ
12 14 (1.82%) SAML
13 12 (1.56%) AngularJS
13 12 (1.56%) React
14 11 (1.43%) PySpark
Miscellaneous
1 80 (10.38%) Analytical Skills
2 37 (4.80%) Management Information System
3 29 (3.76%) Data Structures
4 26 (3.37%) User Experience
5 25 (3.24%) Algorithms
5 25 (3.24%) Reinsurance
6 20 (2.59%) Clustering
6 20 (2.59%) Greenfield Project
7 12 (1.56%) Fintech
8 10 (1.30%) Self-Motivation
9 9 (1.17%) Hybrid Cloud
10 8 (1.04%) Data Centre
10 8 (1.04%) Reference Data
11 7 (0.91%) Replication
11 7 (0.91%) Robotics
12 6 (0.78%) Enterprise Cloud
12 6 (0.78%) Life Science
12 6 (0.78%) Market Risk
12 6 (0.78%) Mobile App
12 6 (0.78%) Podcast
Operating Systems
1 62 (8.04%) Linux
2 39 (5.06%) Windows
3 24 (3.11%) Unix
4 21 (2.72%) Windows Server
5 13 (1.69%) Windows Server 2008
6 11 (1.43%) CentOS
6 11 (1.43%) Red Hat Enterprise Linux
6 11 (1.43%) Ubuntu
7 7 (0.91%) Windows 10
8 4 (0.52%) Oracle Linux
9 2 (0.26%) AIX
9 2 (0.26%) VMS
9 2 (0.26%) Windows 7
10 1 (0.13%) Windows Server 2012
Processes & Methodologies
1 411 (53.31%) Analytics
2 385 (49.94%) Business Intelligence
3 368 (47.73%) Agile Software Development
4 238 (30.87%) ETL
5 225 (29.18%) Data Modelling
6 176 (22.83%) DevOps
7 151 (19.58%) Data Analytics
7 151 (19.58%) Data Architecture
8 148 (19.20%) Data Science
8 148 (19.20%) Machine Learning
9 125 (16.21%) Visualisation
10 124 (16.08%) Scrum
11 106 (13.75%) Data Strategy
12 102 (13.23%) Data Engineering
13 97 (12.58%) Data Management
14 94 (12.19%) Data Integration
15 85 (11.02%) Problem-Solving
16 84 (10.89%) Software Engineering
17 83 (10.77%) Data Ingestion
18 78 (10.12%) Artificial Intelligence
Programming Languages
1 439 (56.94%) SQL
2 298 (38.65%) Python
3 110 (14.27%) C#
4 99 (12.84%) Java
5 95 (12.32%) R
6 91 (11.80%) T-SQL
7 85 (11.02%) Data Analysis Expressions (DAX)
8 74 (9.60%) Scala
9 57 (7.39%) JavaScript
10 56 (7.26%) PowerShell
11 29 (3.76%) Ruby
12 26 (3.37%) U-SQL
13 19 (2.46%) VBA
14 12 (1.56%) PL/SQL
15 11 (1.43%) Shell Script
16 10 (1.30%) C++
17 9 (1.17%) PHP
18 8 (1.04%) Go
18 8 (1.04%) VB.NET
19 7 (0.91%) F#
Qualifications
1 47 (6.10%) Degree
2 31 (4.02%) TOGAF Certification
3 16 (2.08%) Computer Science Degree
4 9 (1.17%) Microsoft Certification
5 8 (1.04%) MCP
6 6 (0.78%) CISSP
6 6 (0.78%) PhD
7 5 (0.65%) ISTQB
7 5 (0.65%) MCSE
8 4 (0.52%) (ISC)2 CCSP
8 4 (0.52%) CCSP
8 4 (0.52%) Cisco Certification
8 4 (0.52%) CompTIA Security+
8 4 (0.52%) MCSA
9 2 (0.26%) CEH
9 2 (0.26%) CISA
9 2 (0.26%) CISM
9 2 (0.26%) PMI Certification
9 2 (0.26%) SC Cleared
9 2 (0.26%) Security Cleared
Quality Assurance & Compliance
1 73 (9.47%) Data Quality
2 35 (4.54%) QA
3 28 (3.63%) GDPR
4 13 (1.69%) ISO/IEC 27001
4 13 (1.69%) SLA
5 7 (0.91%) PCI DSS
6 6 (0.78%) HIPAA
7 2 (0.26%) COBIT
7 2 (0.26%) IFRS
7 2 (0.26%) Solvency II
8 1 (0.13%) ISO 20022
System Software
1 28 (3.63%) Docker
2 22 (2.85%) HDFS
3 18 (2.33%) Active Directory
4 15 (1.95%) Apache Flume
5 14 (1.82%) Virtual Machines
6 4 (0.52%) Apache ZooKeeper
7 2 (0.26%) Hyper-V
7 2 (0.26%) Tivoli Workload Scheduler
7 2 (0.26%) VMware Infrastructure
Systems Management
1 27 (3.50%) Opscode Chef
2 25 (3.24%) Puppet
2 25 (3.24%) Terraform
3 16 (2.08%) Kubernetes
4 15 (1.95%) Oozie
5 8 (1.04%) Hadoop YARN
6 6 (0.78%) Ansible
7 5 (0.65%) Kibana
8 4 (0.52%) Chukwa
8 4 (0.52%) Control-M
8 4 (0.52%) Microsoft Intune
8 4 (0.52%) Single Sign-On
9 3 (0.39%) Ambari
10 2 (0.26%) Salt
10 2 (0.26%) Tivoli
11 1 (0.13%) HP Quality Center
Vendors
1 283 (36.71%) Microsoft
2 165 (21.40%) Databricks
3 97 (12.58%) Oracle
4 80 (10.38%) Tableau
5 69 (8.95%) Google
6 51 (6.61%) Informatica
7 37 (4.80%) Teradata
8 30 (3.89%) Hortonworks
9 24 (3.11%) Cloudera
10 19 (2.46%) Alteryx
10 19 (2.46%) Talend
11 18 (2.33%) Red Hat
12 14 (1.82%) ServiceNow
13 12 (1.56%) Dynatrace
13 12 (1.56%) MapR
13 12 (1.56%) Netezza
13 12 (1.56%) SolarWinds
14 10 (1.30%) Ab Initio
14 10 (1.30%) IBM
14 10 (1.30%) Salesforce.com