Period
to 10 December 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 10 December 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
10 Dec 2018
Same period 2017 Same period 2016
Rank 575 852 1092
Rank change year-on-year +277 +240 +159
Permanent jobs citing Data Lake 665 326 106
As % of all permanent IT jobs advertised in England 0.45% 0.20% 0.061%
As % of the Database & Business Intelligence category 1.55% 0.65% 0.20%
Number of salaries quoted 513 284 93
England median annual salary £65,000 £63,750 £77,500
Median salary % change year-on-year +1.96% -17.74% +10.71%
10th Percentile £41,250 £46,250 £45,000
90th Percentile £100,000 £105,000 £113,000
UK median annual salary £65,000 £62,500 £75,000
% change year-on-year +4.00% -16.67% +7.14%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 42,911 50,501 51,869
As % of all permanent IT jobs advertised in England 28.83% 30.21% 29.72%
Number of salaries quoted 35,495 42,009 44,743
England median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £31,250 £30,000 £29,500
90th Percentile £85,000 £77,500 £77,500
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

The salary distribution of IT jobs citing Data Lake in England over the 6 months to 10 December 2018.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 10 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +249 413 £70,000 - 58
South East +57 102 £65,000 +16.07% 13
South West +56 64 £62,138 +10.47% 9
East of England +56 39 £52,500 -4.55% 6
Midlands +49 27 £60,000 +20.00% 6
North of England +20 26 £50,000 -13.04% 7
West Midlands +45 16 £64,733 +7.89% 1
North West +14 15 £60,000 +4.35% 3
Yorkshire +35 11 £50,000 - 2
East Midlands +13 11 £50,000 - 5
Data Lake
UK

For the 6 months to 10 December 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 408 (61.35%) Data Warehouse
2 398 (59.85%) Business Intelligence
3 394 (59.25%) SQL
4 383 (57.59%) Analytics
5 369 (55.49%) Microsoft Azure
6 307 (46.17%) Big Data
7 279 (41.95%) Microsoft
8 277 (41.65%) SQL Server
9 239 (35.94%) Agile Software Development
10 228 (34.29%) ETL
11 226 (33.98%) SQL Server Integration Services
12 223 (33.53%) Data Modelling
12 223 (33.53%) Power BI
13 212 (31.88%) Hadoop
14 181 (27.22%) SQL Server Analysis Services
15 176 (26.47%) Finance
16 164 (24.66%) Python
17 162 (24.36%) Azure Data Factory
18 161 (24.21%) SQL Server Reporting Services
19 154 (23.16%) Azure SQL Database
20 141 (21.20%) Apache Spark
21 128 (19.25%) Azure SQL Data Warehouse
22 127 (19.10%) Visualisation
22 127 (19.10%) Amazon AWS
23 126 (18.95%) Machine Learning
24 121 (18.20%) T-SQL
25 119 (17.89%) Data Analytics
26 115 (17.29%) Data Science
27 107 (16.09%) Data Architecture
28 104 (15.64%) C#

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 141 (21.20%) Apache Spark
2 57 (8.57%) Apache
3 33 (4.96%) Apache Pig
4 32 (4.81%) Apache Solr
5 29 (4.36%) SAS
6 21 (3.16%) Elasticsearch
7 18 (2.71%) SharePoint
8 15 (2.26%) Confluence
9 4 (0.60%) IIS
9 4 (0.60%) Tomcat
10 3 (0.45%) Apache Airflow
10 3 (0.45%) BizTalk Server
10 3 (0.45%) JBoss
10 3 (0.45%) Luigi
11 2 (0.30%) CMS
11 2 (0.30%) Kentico
11 2 (0.30%) Oracle SOA Suite
11 2 (0.30%) Tornado
11 2 (0.30%) WebLogic
12 1 (0.15%) Jupyter
Applications
1 33 (4.96%) Microsoft Excel
2 3 (0.45%) SPSS
3 2 (0.30%) Microsoft Office
Business Applications
1 10 (1.50%) Dynamics CRM
2 2 (0.30%) Dynamics AX
2 2 (0.30%) Markit EDM
2 2 (0.30%) Maximo
3 1 (0.15%) Eagle PACE
3 1 (0.15%) NetSuite
Cloud Services
1 369 (55.49%) Microsoft Azure
2 162 (24.36%) Azure Data Factory
3 127 (19.10%) Amazon AWS
4 84 (12.63%) Data Lake Analytics
5 77 (11.58%) PaaS
6 42 (6.32%) Serverless
7 39 (5.86%) Google Cloud Platform
8 33 (4.96%) Azure Machine Learning
9 29 (4.36%) Cortana Intelligence Suite
10 20 (3.01%) SaaS
11 19 (2.86%) IaaS
12 18 (2.71%) Azure Functions
13 16 (2.41%) Cloud Computing
14 14 (2.11%) Amazon Kinesis
15 12 (1.80%) Amazon S3
15 12 (1.80%) AWS Lambda
16 10 (1.50%) Azure Active Directory
17 7 (1.05%) GitHub
18 6 (0.90%) BlazeMeter
18 6 (0.90%) Office 365
Communications & Networking
1 10 (1.50%) Firewall
2 7 (1.05%) HTTP
3 5 (0.75%) Network Security
4 4 (0.60%) Kerberos
5 3 (0.45%) GoToMeeting
5 3 (0.45%) Internet
5 3 (0.45%) SNMP
5 3 (0.45%) SSL
5 3 (0.45%) WebEx
6 1 (0.15%) SAN
6 1 (0.15%) TCP/IP
6 1 (0.15%) Wireless
Database & Business Intelligence
1 408 (61.35%) Data Warehouse
2 307 (46.17%) Big Data
3 277 (41.65%) SQL Server
4 226 (33.98%) SQL Server Integration Services
5 223 (33.53%) Power BI
6 212 (31.88%) Hadoop
7 181 (27.22%) SQL Server Analysis Services
8 161 (24.21%) SQL Server Reporting Services
9 154 (23.16%) Azure SQL Database
10 128 (19.25%) Azure SQL Data Warehouse
11 95 (14.29%) NoSQL
12 87 (13.08%) Cosmos DB
13 81 (12.18%) Apache Hive
14 74 (11.13%) Relational Database
15 65 (9.77%) MongoDB
16 64 (9.62%) MySQL
17 62 (9.32%) Microsoft Analysis Services
18 54 (8.12%) Apache Cassandra
19 44 (6.62%) Amazon Redshift
19 44 (6.62%) HBase
Development Applications
1 49 (7.37%) Visual Studio
2 48 (7.22%) Git (software)
3 35 (5.26%) Visual Studio Team System
4 34 (5.11%) Jenkins
5 30 (4.51%) JIRA
6 20 (3.01%) ERwin
7 16 (2.41%) Team Foundation Server
8 11 (1.65%) ER Studio
8 11 (1.65%) TeamCity
9 9 (1.35%) Octopus Deploy
10 7 (1.05%) SpecFlow
10 7 (1.05%) Subversion
10 7 (1.05%) tSQLt
11 6 (0.90%) Atlassian Bamboo
11 6 (0.90%) Eclipse
11 6 (0.90%) SQL Server Management Studio (SSMS)
12 5 (0.75%) SoapUI
13 4 (0.60%) Axure RP
13 4 (0.60%) Hudson
13 4 (0.60%) Maven
General
1 176 (26.47%) Finance
2 72 (10.83%) Retail
3 45 (6.77%) Banking
4 37 (5.56%) Advertising
5 26 (3.91%) Investment Banking
6 24 (3.61%) Marketing
7 13 (1.95%) Games
8 12 (1.80%) Corporate Banking
9 11 (1.65%) Telecoms
10 9 (1.35%) Financial Institution
11 6 (0.90%) Online Betting
12 3 (0.45%) Automotive
12 3 (0.45%) Front Office
12 3 (0.45%) General Ledger
12 3 (0.45%) Pharmaceutical
13 2 (0.30%) Digital Economy
13 2 (0.30%) Legal
13 2 (0.30%) Manufacturing
14 1 (0.15%) Electronics
14 1 (0.15%) Law
Job Titles
1 185 (27.82%) Developer
2 144 (21.65%) Architect
3 116 (17.44%) Data Architect
4 105 (15.79%) Data Engineer
5 94 (14.14%) Business Intelligence Developer
6 68 (10.23%) Consultant
7 55 (8.27%) Analyst
8 54 (8.12%) SQL Developer
9 41 (6.17%) Cloud Architect
9 41 (6.17%) SQL BI Developer
9 41 (6.17%) SSIS Developer
10 37 (5.56%) Data Consultant
10 37 (5.56%) Data Warehouse Developer
11 36 (5.41%) Business Analyst
12 34 (5.11%) Solutions Architect
13 32 (4.81%) Big Data Engineer
14 30 (4.51%) Business Intelligence Consultant
15 28 (4.21%) Big Data Developer
15 28 (4.21%) Business Intelligence Analyst
15 28 (4.21%) Senior Developer
Libraries, Frameworks & Software Standards
1 92 (13.83%) Kafka
2 73 (10.98%) .NET
3 47 (7.07%) JSON
4 34 (5.11%) MDX
5 26 (3.91%) Web Services
6 19 (2.86%) Velocity
7 18 (2.71%) AngularJS
8 15 (2.26%) HTML
8 15 (2.26%) RESTful
9 13 (1.95%) CSS
9 13 (1.95%) HTML5
9 13 (1.95%) SAML
9 13 (1.95%) XML
10 12 (1.80%) REST
11 11 (1.65%) Spark Streaming
12 10 (1.50%) .NET Core
12 10 (1.50%) RabbitMQ
12 10 (1.50%) TensorFlow
12 10 (1.50%) Twitter Bootstrap
13 9 (1.35%) Apache Tez
Miscellaneous
1 71 (10.68%) Analytical Skills
2 20 (3.01%) Management Information System
3 18 (2.71%) Greenfield Project
4 17 (2.56%) Reference Data
5 14 (2.11%) Cyberthreat
6 13 (1.95%) Algorithms
6 13 (1.95%) Clustering
6 13 (1.95%) Credit Risk
7 12 (1.80%) Data Structures
7 12 (1.80%) Enterprise Software
7 12 (1.80%) Equities
8 10 (1.50%) Virtual Team
9 9 (1.35%) Cloud Native
9 9 (1.35%) Driving Licence
9 9 (1.35%) Pricing Data
9 9 (1.35%) Public Cloud
10 8 (1.20%) NHS
11 7 (1.05%) EPoS
11 7 (1.05%) Fintech
11 7 (1.05%) Reinsurance
Operating Systems
1 45 (6.77%) Linux
2 26 (3.91%) Windows
3 24 (3.61%) Unix
4 17 (2.56%) Red Hat Enterprise Linux
5 14 (2.11%) CentOS
6 11 (1.65%) Ubuntu
7 5 (0.75%) Windows Server
8 3 (0.45%) Windows 10
8 3 (0.45%) Windows Server 2008
9 2 (0.30%) Android
9 2 (0.30%) Apple iOS
10 1 (0.15%) VMS
Processes & Methodologies
1 398 (59.85%) Business Intelligence
2 383 (57.59%) Analytics
3 239 (35.94%) Agile Software Development
4 228 (34.29%) ETL
5 223 (33.53%) Data Modelling
6 127 (19.10%) Visualisation
7 126 (18.95%) Machine Learning
8 119 (17.89%) Data Analytics
9 115 (17.29%) Data Science
10 107 (16.09%) Data Architecture
11 92 (13.83%) Data Engineering
12 74 (11.13%) Data Strategy
13 73 (10.98%) Data Governance
13 73 (10.98%) Data Integration
14 70 (10.53%) Data Management
15 64 (9.62%) Problem-Solving
16 61 (9.17%) Stakeholder Management
17 60 (9.02%) Scrum
18 58 (8.72%) Continuous Integration
19 55 (8.27%) DevOps
Programming Languages
1 394 (59.25%) SQL
2 164 (24.66%) Python
3 121 (18.20%) T-SQL
4 104 (15.64%) C#
5 78 (11.73%) Java
6 76 (11.43%) Data Analysis Expressions (DAX)
7 67 (10.08%) PowerShell
8 66 (9.92%) Scala
9 63 (9.47%) R
10 50 (7.52%) U-SQL
11 47 (7.07%) JavaScript
12 14 (2.11%) Shell Script
13 13 (1.95%) Perl
14 12 (1.80%) C++
15 10 (1.50%) C
16 9 (1.35%) HiveQL
17 7 (1.05%) Ruby
18 5 (0.75%) PL/SQL
19 4 (0.60%) Bash Shell
20 3 (0.45%) VB.NET
Qualifications
1 56 (8.42%) Degree
2 22 (3.31%) Microsoft Certification
3 6 (0.90%) Computer Science Degree
3 6 (0.90%) Master's Degree
4 5 (0.75%) AWS Certification
4 5 (0.75%) MCSE
4 5 (0.75%) PhD
5 4 (0.60%) MCAD
5 4 (0.60%) MCDBA
5 4 (0.60%) MCSA
5 4 (0.60%) MCSD
6 3 (0.45%) TOGAF Certification
7 2 (0.30%) GSEC
7 2 (0.30%) MBA
8 1 (0.15%) CEH
8 1 (0.15%) PMI Certification
8 1 (0.15%) SC Cleared
8 1 (0.15%) Security Cleared
Quality Assurance & Compliance
1 63 (9.47%) Data Quality
2 44 (6.62%) QA
3 12 (1.80%) SLA
4 11 (1.65%) ISO/IEC 27001
5 9 (1.35%) GDPR
6 2 (0.30%) PCI DSS
7 1 (0.15%) Actionable Recommendations
7 1 (0.15%) IFRS
7 1 (0.15%) PMO
7 1 (0.15%) Solvency II
System Software
1 36 (5.41%) HDFS
2 21 (3.16%) Apache Flume
3 18 (2.71%) Docker
4 15 (2.26%) Active Directory
5 13 (1.95%) Apache ZooKeeper
5 13 (1.95%) Virtual Machines
6 5 (0.75%) Hyper-V
6 5 (0.75%) VMware Infrastructure
7 3 (0.45%) XenApp
Systems Management
1 26 (3.91%) Terraform
2 24 (3.61%) Opscode Chef
2 24 (3.61%) Puppet
3 20 (3.01%) Oozie
4 13 (1.95%) Kibana
5 11 (1.65%) Kubernetes
6 6 (0.90%) Grafana
7 5 (0.75%) Ansible
8 4 (0.60%) Rundeck
9 2 (0.30%) ArcSight ESM
9 2 (0.30%) Microsoft Intune
10 1 (0.15%) Ambari
10 1 (0.15%) Hadoop YARN
10 1 (0.15%) logstash
10 1 (0.15%) Salt
Vendors
1 279 (41.95%) Microsoft
2 101 (15.19%) Oracle
3 97 (14.59%) Tableau
4 52 (7.82%) Databricks
5 51 (7.67%) Informatica
6 50 (7.52%) Cloudera
7 48 (7.22%) Teradata
8 40 (6.02%) Google
8 40 (6.02%) Talend
9 33 (4.96%) Hortonworks
10 30 (4.51%) Netezza
11 25 (3.76%) MapR
12 23 (3.46%) Ab Initio
13 16 (2.41%) Salesforce.com
14 14 (2.11%) SAP
15 12 (1.80%) Alteryx
15 12 (1.80%) Cognizant
15 12 (1.80%) Red Hat
16 10 (1.50%) WorldPay
17 9 (1.35%) SnapLogic