Period
to 18 June 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 18 June 2018 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
18 Jun 2018
Same period 2017 Same period 2016
Rank 509 930 1208
Rank change year-on-year +421 +278 +73
Permanent jobs citing Data Lake 842 218 45
As % of all permanent IT jobs advertised in England 0.52% 0.13% 0.024%
As % of the Database & Business Intelligence category 1.71% 0.44% 0.078%
Number of salaries quoted 603 177 18
England median annual salary £65,000 £62,000 £68,250
Median salary % change year-on-year +4.84% -9.16% -9.00%
10th Percentile £47,500 £35,000 £42,500
90th Percentile £97,500 £94,250 £123,000
UK median annual salary £65,000 £62,000 £53,000
% change year-on-year +4.84% +16.98% -29.33%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 49,343 49,524 57,452
As % of all permanent IT jobs advertised in England 30.67% 30.58% 30.59%
Number of salaries quoted 40,647 42,322 49,543
England median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,750 £28,750
90th Percentile £81,250 £77,500 £75,000
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

The salary distribution of IT jobs citing Data Lake in England over the 6 months to 18 June 2018.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 18 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +356 586 £70,000 - 38
Midlands +73 75 £52,500 -4.55% 2
South East -20 67 £65,000 +18.18% 16
West Midlands +70 60 £52,500 -40.00% 1
North of England +45 53 £60,000 +20.00% 3
Yorkshire +60 44 £60,000 - 1
East of England +28 37 £60,000 - 6
South West +9 17 £57,500 -4.17%
East Midlands +10 15 £50,000 -9.09% 1
North West +3 6 £50,000 +5.26% 2
North East -16 3 £65,000 +30.00%
Data Lake
UK

For the 6 months to 18 June 2018, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 554 (65.80%) SQL
2 550 (65.32%) Analytics
3 480 (57.01%) Business Intelligence
4 465 (55.23%) Big Data
5 464 (55.11%) Microsoft Azure
6 357 (42.40%) Microsoft
7 316 (37.53%) Power BI
8 304 (36.10%) SQL Server
9 288 (34.20%) Azure Data Factory
10 276 (32.78%) SQL Server Integration Services
11 254 (30.17%) Data Warehouse
12 230 (27.32%) Hadoop
13 229 (27.20%) Agile Software Development
14 227 (26.96%) Data Analytics
15 222 (26.37%) Finance
16 221 (26.25%) Azure SQL Database
17 219 (26.01%) SQL Server Analysis Services
18 217 (25.77%) Machine Learning
18 217 (25.77%) Data Science
19 215 (25.53%) Python
20 211 (25.06%) Java
21 208 (24.70%) SQL Server Reporting Services
22 200 (23.75%) Tableau
23 193 (22.92%) Apache Spark
24 178 (21.14%) C#
25 174 (20.67%) ETL
26 166 (19.71%) Data Modelling
27 155 (18.41%) NoSQL
28 148 (17.58%) Amazon AWS
29 136 (16.15%) Degree

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 193 (22.92%) Apache Spark
2 36 (4.28%) Apache
3 24 (2.85%) Apache Solr
4 22 (2.61%) SharePoint
5 20 (2.38%) Apache Pig
6 18 (2.14%) BizTalk Server
7 12 (1.43%) SAS
8 7 (0.83%) Elasticsearch
9 5 (0.59%) Tomcat
10 4 (0.48%) Drupal
11 2 (0.24%) Apache Airflow
12 1 (0.12%) Confluence
12 1 (0.12%) IBM Domino
12 1 (0.12%) Luigi
Applications
1 14 (1.66%) MS Visio
2 11 (1.31%) Microsoft Excel
3 1 (0.12%) Chatbot
Business Applications
1 27 (3.21%) Dynamics CRM
2 3 (0.36%) Markit EDM
3 2 (0.24%) Dynamics AX
4 1 (0.12%) MetaTrader
Cloud Services
1 464 (55.11%) Microsoft Azure
2 288 (34.20%) Azure Data Factory
3 148 (17.58%) Amazon AWS
4 116 (13.78%) Cortana Intelligence Suite
5 109 (12.95%) Serverless
6 100 (11.88%) IaaS
7 70 (8.31%) PaaS
8 48 (5.70%) Azure Machine Learning
9 35 (4.16%) AWS Lambda
10 26 (3.09%) Data Lake Analytics
11 25 (2.97%) Office 365
11 25 (2.97%) SaaS
12 23 (2.73%) Amazon S3
13 20 (2.38%) Google Cloud Platform
14 17 (2.02%) Amazon EMR
15 16 (1.90%) Amazon Kinesis
16 15 (1.78%) GitHub
17 10 (1.19%) OpenShift
18 9 (1.07%) Datadog
19 6 (0.71%) Cloud Computing
Communications & Networking
1 10 (1.19%) DNS
1 10 (1.19%) Firewall
1 10 (1.19%) HTTP
1 10 (1.19%) SMTP
2 9 (1.07%) TCP/IP
2 9 (1.07%) VPN
3 2 (0.24%) Internet
4 1 (0.12%) DHCP
4 1 (0.12%) FTP
4 1 (0.12%) HTTPS
4 1 (0.12%) Intranet
4 1 (0.12%) SSL
4 1 (0.12%) Telnet
Database & Business Intelligence
1 465 (55.23%) Big Data
2 316 (37.53%) Power BI
3 304 (36.10%) SQL Server
4 276 (32.78%) SQL Server Integration Services
5 254 (30.17%) Data Warehouse
6 230 (27.32%) Hadoop
7 221 (26.25%) Azure SQL Database
8 219 (26.01%) SQL Server Analysis Services
9 208 (24.70%) SQL Server Reporting Services
10 155 (18.41%) NoSQL
11 105 (12.47%) HDInsight
12 104 (12.35%) Apache Hive
12 104 (12.35%) Azure SQL Data Warehouse
13 87 (10.33%) Cosmos DB
14 64 (7.60%) HBase
15 59 (7.01%) Sqoop
16 44 (5.23%) QlikView
17 43 (5.11%) Oracle ODI
18 37 (4.39%) SQL Server 2014
19 34 (4.04%) Relational Database
Development Applications
1 119 (14.13%) Visual Studio
2 114 (13.54%) Git (software)
3 31 (3.68%) Visual Studio Team System
4 22 (2.61%) Jenkins
5 21 (2.49%) RStudio
6 17 (2.02%) Sonatype Nexus
7 12 (1.43%) JIRA
8 11 (1.31%) GitLab
9 9 (1.07%) Artifactory
9 9 (1.07%) GoCD
10 6 (0.71%) ERwin
11 4 (0.48%) SQL Server Management Studio (SSMS)
11 4 (0.48%) Team Foundation Server
12 3 (0.36%) Cucumber
12 3 (0.36%) Octopus Deploy
12 3 (0.36%) TeamCity
13 2 (0.24%) JUnit
13 2 (0.24%) Maven
13 2 (0.24%) Selenium
13 2 (0.24%) SpecFlow
General
1 222 (26.37%) Finance
2 105 (12.47%) Advertising
3 88 (10.45%) Banking
4 62 (7.36%) Marketing
5 42 (4.99%) Games
6 38 (4.51%) Retail
7 37 (4.39%) Investment Banking
8 34 (4.04%) Financial Institution
9 21 (2.49%) Publishing
10 7 (0.83%) Billing
11 5 (0.59%) Front Office
11 5 (0.59%) Manufacturing
12 4 (0.48%) Electronics
12 4 (0.48%) Telecoms
13 3 (0.36%) Automotive
13 3 (0.36%) Local Government
14 2 (0.24%) Law
15 1 (0.12%) Back Office
15 1 (0.12%) Pharmaceutical
Job Titles
1 248 (29.45%) Developer
2 186 (22.09%) Consultant
3 131 (15.56%) Business Intelligence Consultant
4 130 (15.44%) Architect
5 101 (12.00%) Azure Consultant
6 97 (11.52%) Data Engineer
7 90 (10.69%) Data Architect
8 84 (9.98%) Power BI Consultant
9 73 (8.67%) Business Intelligence Developer
10 66 (7.84%) Microsoft BI Consultant
11 57 (6.77%) Data Consultant
12 55 (6.53%) Big Data Developer
13 43 (5.11%) DBA
14 42 (4.99%) SQL Developer
15 37 (4.39%) C# Developer
15 37 (4.39%) SQL DBA
16 34 (4.04%) Lead Architect
17 33 (3.92%) .NET Developer
17 33 (3.92%) SSIS Developer
18 32 (3.80%) Azure Architect
Libraries, Frameworks & Software Standards
1 108 (12.83%) .NET
2 95 (11.28%) Kafka
3 61 (7.24%) AngularJS
4 40 (4.75%) ASP.NET
5 38 (4.51%) jQuery
6 33 (3.92%) ASP.NET MVC
6 33 (3.92%) RabbitMQ
7 31 (3.68%) Velocity
8 30 (3.56%) HTML
9 29 (3.44%) JSON
9 29 (3.44%) Natural Language Processing
10 28 (3.33%) .NET Framework
10 28 (3.33%) HornetQ
10 28 (3.33%) JMS
11 25 (2.97%) Entity Framework
12 22 (2.61%) .NET Core
12 22 (2.61%) ASP.NET Web API
13 20 (2.38%) REST
13 20 (2.38%) Web Services
14 18 (2.14%) XML
Miscellaneous
1 73 (8.67%) Computer Science
2 62 (7.36%) Analytical Skills
3 42 (4.99%) Self-Motivation
4 35 (4.16%) Fintech
5 32 (3.80%) Cyberthreat
6 25 (2.97%) Data Structures
6 25 (2.97%) Driving Licence
7 19 (2.26%) User Experience
8 18 (2.14%) Graphic Design
8 18 (2.14%) Management Information System
9 16 (1.90%) Algorithms
9 16 (1.90%) Hedge funds
10 15 (1.78%) Fixed Income
10 15 (1.78%) Greenfield Project
10 15 (1.78%) Public Cloud
11 14 (1.66%) Virtual Team
12 11 (1.31%) Taxonomies
13 9 (1.07%) Derivative
13 9 (1.07%) Enterprise Software
13 9 (1.07%) Linux Command Line
Operating Systems
1 38 (4.51%) Linux
2 22 (2.61%) Unix
3 8 (0.95%) Red Hat Enterprise Linux
Processes & Methodologies
1 550 (65.32%) Analytics
2 480 (57.01%) Business Intelligence
3 229 (27.20%) Agile Software Development
4 227 (26.96%) Data Analytics
5 217 (25.77%) Data Science
5 217 (25.77%) Machine Learning
6 174 (20.67%) ETL
7 166 (19.71%) Data Modelling
8 133 (15.80%) Visualisation
9 116 (13.78%) Presales
10 111 (13.18%) Migration
11 107 (12.71%) Problem-Solving
12 104 (12.35%) Data Governance
13 88 (10.45%) OO
14 81 (9.62%) Mathematics
15 75 (8.91%) Data Engineering
15 75 (8.91%) Data Visualisation
15 75 (8.91%) Service Delivery
16 68 (8.08%) Data Architecture
17 65 (7.72%) Mentoring
Programming Languages
1 554 (65.80%) SQL
2 215 (25.53%) Python
3 211 (25.06%) Java
4 178 (21.14%) C#
5 124 (14.73%) T-SQL
6 108 (12.83%) Scala
7 82 (9.74%) U-SQL
8 81 (9.62%) R
9 74 (8.79%) JavaScript
10 66 (7.84%) PowerShell
11 64 (7.60%) Data Analysis Expressions (DAX)
12 37 (4.39%) C++
13 34 (4.04%) Perl
14 25 (2.97%) Shell Script
15 23 (2.73%) Java 8
16 13 (1.54%) Go
17 10 (1.19%) Ruby
18 9 (1.07%) C
19 5 (0.59%) VB.NET
20 4 (0.48%) MATLAB
Qualifications
1 136 (16.15%) Degree
2 64 (7.60%) Computer Science Degree
3 50 (5.94%) Master's Degree
4 21 (2.49%) Security Cleared
5 10 (1.19%) AWS Certification
6 8 (0.95%) Microsoft Certification
7 6 (0.71%) MBA
8 5 (0.59%) Numerate Degree
8 5 (0.59%) SC Cleared
9 4 (0.48%) GSEC
9 4 (0.48%) PhD
10 1 (0.12%) DBS Check
10 1 (0.12%) MCSA
10 1 (0.12%) MCSE
Quality Assurance & Compliance
1 40 (4.75%) Data Quality
2 19 (2.26%) GDPR
3 17 (2.02%) QA
4 4 (0.48%) PMO
5 3 (0.36%) Actionable Recommendations
5 3 (0.36%) GCP
6 2 (0.24%) ISO/IEC 27001
7 1 (0.12%) HIPAA
7 1 (0.12%) Sarbanes-Oxley
7 1 (0.12%) SLA
System Software
1 92 (10.93%) HDFS
2 74 (8.79%) Virtual Machines
3 41 (4.87%) Docker
4 21 (2.49%) Active Directory
5 17 (2.02%) Apache ZooKeeper
6 16 (1.90%) Apache Flume
7 2 (0.24%) Firmware
Systems Management
1 39 (4.63%) Kubernetes
2 25 (2.97%) Oozie
3 17 (2.02%) Opscode Chef
4 15 (1.78%) Ambari
5 14 (1.66%) Terraform
6 10 (1.19%) Ansible
7 9 (1.07%) Consul
7 9 (1.07%) Hadoop YARN
7 9 (1.07%) Salt
8 5 (0.59%) Puppet
9 4 (0.48%) Docker Swarm
9 4 (0.48%) Kibana
10 2 (0.24%) Mesos
11 1 (0.12%) Systems Management Server (SMS)
Vendors
1 357 (42.40%) Microsoft
2 200 (23.75%) Tableau
3 122 (14.49%) Oracle
4 78 (9.26%) Talend
5 58 (6.89%) Cloudera
6 48 (5.70%) Informatica
7 46 (5.46%) Google
8 35 (4.16%) WorldPay
9 30 (3.56%) Sybase
10 28 (3.33%) EXASOL
10 28 (3.33%) SnapLogic
11 26 (3.09%) Alteryx
12 24 (2.85%) IBM
13 20 (2.38%) Cognos
14 19 (2.26%) Hortonworks
15 16 (1.90%) Cognizant
15 16 (1.90%) Netezza
16 15 (1.78%) Salesforce.com
17 10 (1.19%) Red Hat
18 9 (1.07%) SAP