Period
to 19 June 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 19 June 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
UK > England
6 months to
19 Jun 2019
Same period 2018 Same period 2017
Rank 483 536 949
Rank change year-on-year +53 +413 +258
Permanent jobs citing Data Lake 771 836 218
As % of all permanent IT jobs advertised in England 0.58% 0.52% 0.13%
As % of the Database & Business Intelligence category 2.09% 1.69% 0.44%
Number of salaries quoted 601 597 177
England median annual salary £65,000 £65,000 £62,000
Median salary % change year-on-year - +4.84% -9.16%
10th Percentile £43,750 £47,500 £35,000
90th Percentile £101,250 £97,500 £94,250
UK median annual salary £65,000 £65,000 £62,000
% change year-on-year - +4.84% +16.98%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 36,885 49,409 49,556
As % of all permanent IT jobs advertised in England 27.74% 30.67% 30.56%
Number of salaries quoted 30,422 40,703 42,338
England median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,250 £31,250 £29,750
90th Percentile £86,250 £81,250 £77,500
UK median annual salary £51,943 £50,000 £47,500
% change year-on-year +3.89% +5.26% -

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in England.

Salary trend for Data Lake in England

Data Lake
Salary Histogram in England

The salary distribution of IT jobs citing Data Lake in England over the 6 months to 19 June 2019.

Salary histogram for Data Lake in England

Data Lake
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the England region over the 6 months to 19 June 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -12 431 £70,000 - 35
South East +104 133 £60,000 -7.69% 10
South West +71 71 £61,500 +6.96% 1
North of England +31 55 £55,000 -8.33% 12
Midlands +9 38 £55,500 +5.71% 4
East of England +65 36 £62,500 +4.17% 4
East Midlands +41 28 £55,000 +10.00% 1
North West +52 25 £42,500 -15.00% 7
Yorkshire -28 22 £50,000 -16.67% 4
West Midlands -16 10 £65,000 +23.81% 3
North East +29 8 £66,250 +1.92% 1
Data Lake
UK

For the 6 months to 19 June 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Data Lake.

1 504 (65.37%) Data Warehouse
2 451 (58.50%) Microsoft Azure
3 438 (56.81%) SQL
4 423 (54.86%) Analytics
5 378 (49.03%) Business Intelligence
6 372 (48.25%) Agile Software Development
7 320 (41.50%) Python
7 320 (41.50%) Big Data
8 294 (38.13%) Microsoft
9 267 (34.63%) SQL Server
10 242 (31.39%) Power BI
10 242 (31.39%) Power Platform
11 233 (30.22%) ETL
12 231 (29.96%) Hadoop
13 227 (29.44%) Finance
14 221 (28.66%) Data Modelling
15 216 (28.02%) SQL Server Integration Services
16 210 (27.24%) Azure Data Factory
17 194 (25.16%) SQL Server Analysis Services
18 188 (24.38%) DevOps
19 184 (23.87%) Databricks
20 170 (22.05%) Apache Spark
20 170 (22.05%) Amazon AWS
21 167 (21.66%) SQL Server Reporting Services
22 166 (21.53%) Azure SQL Database
23 157 (20.36%) Data Analytics
24 152 (19.71%) Machine Learning
25 149 (19.33%) Data Science
26 145 (18.81%) Data Architecture
27 139 (18.03%) Scrum

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 170 (22.05%) Apache Spark
2 60 (7.78%) Apache
3 28 (3.63%) SAS
4 20 (2.59%) Apache Pig
4 20 (2.59%) Apache Solr
5 18 (2.33%) BizTalk Server
5 18 (2.33%) Elasticsearch
6 17 (2.20%) SharePoint
7 6 (0.78%) Confluence
7 6 (0.78%) IIS
8 3 (0.39%) Apache Airflow
9 2 (0.26%) Anypoint
10 1 (0.13%) Jupyter
10 1 (0.13%) Luigi
10 1 (0.13%) nginx
10 1 (0.13%) Oracle SOA Suite
10 1 (0.13%) WebLogic
Applications
1 21 (2.72%) Microsoft Office
2 16 (2.08%) SPSS
3 2 (0.26%) Chatbot
3 2 (0.26%) MS Visio
3 2 (0.26%) Spreadsheet
4 1 (0.13%) Microsoft Excel
Business Applications
1 14 (1.82%) Dynamics CRM
2 2 (0.26%) Adobe Campaign
2 2 (0.26%) Infor M3
2 2 (0.26%) Markit EDM
2 2 (0.26%) SAP ERP
3 1 (0.13%) Workday HCM
Cloud Services
1 451 (58.50%) Microsoft Azure
2 242 (31.39%) Power Platform
3 210 (27.24%) Azure Data Factory
4 170 (22.05%) Amazon AWS
5 65 (8.43%) Google Cloud Platform
6 61 (7.91%) Serverless
7 53 (6.87%) PaaS
8 46 (5.97%) Data Lake Analytics
9 37 (4.80%) SaaS
10 36 (4.67%) Cortana Intelligence Suite
11 30 (3.89%) IaaS
12 27 (3.50%) Azure Functions
12 27 (3.50%) Azure Machine Learning
13 23 (2.98%) Amazon S3
14 22 (2.85%) Azure Active Directory
15 17 (2.20%) npm
16 15 (1.95%) AWS Lambda
17 13 (1.69%) GitHub
18 12 (1.56%) Amazon EMR
19 9 (1.17%) Office 365
Communications & Networking
1 15 (1.95%) Broadband
2 3 (0.39%) Kerberos
3 2 (0.26%) Firewall
3 2 (0.26%) Internet
3 2 (0.26%) VPN
4 1 (0.13%) DHCP
4 1 (0.13%) DNS
4 1 (0.13%) FTP
4 1 (0.13%) HTTP
4 1 (0.13%) HTTPS
4 1 (0.13%) SMTP
4 1 (0.13%) SSL
4 1 (0.13%) TCP/IP
4 1 (0.13%) Telnet
Database & Business Intelligence
1 504 (65.37%) Data Warehouse
2 320 (41.50%) Big Data
3 267 (34.63%) SQL Server
4 242 (31.39%) Power BI
5 231 (29.96%) Hadoop
6 216 (28.02%) SQL Server Integration Services
7 194 (25.16%) SQL Server Analysis Services
8 167 (21.66%) SQL Server Reporting Services
9 166 (21.53%) Azure SQL Database
10 137 (17.77%) Azure SQL Data Warehouse
11 128 (16.60%) NoSQL
12 81 (10.51%) Microsoft Analysis Services
13 80 (10.38%) Apache Hive
14 74 (9.60%) Relational Database
15 67 (8.69%) Cosmos DB
16 52 (6.74%) MongoDB
17 44 (5.71%) Apache Cassandra
17 44 (5.71%) HDInsight
18 43 (5.58%) BigQuery
19 42 (5.45%) Geospatial Data
Development Applications
1 57 (7.39%) Visual Studio
2 47 (6.10%) Git (software)
3 37 (4.80%) Visual Studio Team System
4 33 (4.28%) Jenkins
5 27 (3.50%) JIRA
6 21 (2.72%) Team Foundation Server
7 15 (1.95%) Cucumber
8 14 (1.82%) Octopus Deploy
8 14 (1.82%) TeamCity
9 13 (1.69%) Selenium
10 11 (1.43%) Sinon.JS
10 11 (1.43%) webpack
11 10 (1.30%) git-flow
12 8 (1.04%) ER Studio
13 7 (0.91%) Subversion
14 6 (0.78%) ERwin
15 5 (0.65%) Mercurial
15 5 (0.65%) RStudio
16 4 (0.52%) HP UFT
16 4 (0.52%) Sonatype Nexus
General
1 227 (29.44%) Finance
2 65 (8.43%) Retail
3 30 (3.89%) Banking
4 25 (3.24%) Marketing
5 19 (2.46%) Advertising
6 14 (1.82%) Telecoms
7 9 (1.17%) General Ledger
8 8 (1.04%) Games
8 8 (1.04%) Law
8 8 (1.04%) Pharmaceutical
9 2 (0.26%) Back Office
9 2 (0.26%) Electronics
9 2 (0.26%) Manufacturing
9 2 (0.26%) Publishing
10 1 (0.13%) Automotive
10 1 (0.13%) Front Office
10 1 (0.13%) Legal
Job Titles
1 225 (29.18%) Developer
2 161 (20.88%) Architect
3 160 (20.75%) Data Engineer
4 131 (16.99%) Business Intelligence Developer
5 105 (13.62%) Data Architect
6 72 (9.34%) SQL Developer
7 65 (8.43%) SQL BI Developer
8 60 (7.78%) Azure Developer
9 50 (6.49%) Senior Developer
10 47 (6.10%) Cloud Architect
11 44 (5.71%) Enterprise Architect
12 43 (5.58%) Business Intelligence Lead
12 43 (5.58%) Senior Business Intelligence Developer
13 42 (5.45%) Senior Data Engineer
14 40 (5.19%) Big Data Engineer
15 38 (4.93%) Lead Developer
16 37 (4.80%) SSRS Developer
17 36 (4.67%) Power BI Developer
18 32 (4.15%) Senior Architect
18 32 (4.15%) T-SQL Developer
Libraries, Frameworks & Software Standards
1 97 (12.58%) MDX
2 96 (12.45%) Kafka
3 90 (11.67%) .NET
4 45 (5.84%) JSON
5 28 (3.63%) .NET Framework
5 28 (3.63%) Apache NiFi
5 28 (3.63%) Web Services
6 25 (3.24%) XML
7 23 (2.98%) REST
8 20 (2.59%) HTML
9 16 (2.08%) CSS
10 15 (1.95%) React
11 14 (1.82%) Pandas
11 14 (1.82%) Spring
12 13 (1.69%) SciPy
13 12 (1.56%) AngularJS
13 12 (1.56%) SAML
14 11 (1.43%) Jest
14 11 (1.43%) RabbitMQ
15 10 (1.30%) GeoJSON
Miscellaneous
1 84 (10.89%) Analytical Skills
2 39 (5.06%) Management Information System
3 30 (3.89%) Data Structures
4 29 (3.76%) Algorithms
5 26 (3.37%) User Experience
6 25 (3.24%) Reinsurance
7 24 (3.11%) Greenfield Project
8 16 (2.08%) Clustering
9 9 (1.17%) Self-Motivation
10 7 (0.91%) Hybrid Cloud
10 7 (0.91%) Robotics
11 6 (0.78%) Data Centre
11 6 (0.78%) Enterprise Cloud
11 6 (0.78%) Market Risk
11 6 (0.78%) Mobile App
11 6 (0.78%) Podcast
11 6 (0.78%) Reference Data
11 6 (0.78%) Replication
12 5 (0.65%) Cloud Native
12 5 (0.65%) Credit Risk
Operating Systems
1 56 (7.26%) Linux
2 46 (5.97%) Windows
3 25 (3.24%) Windows Server
4 20 (2.59%) Unix
5 13 (1.69%) Windows Server 2008
6 10 (1.30%) Red Hat Enterprise Linux
7 9 (1.17%) Windows 10
8 8 (1.04%) CentOS
8 8 (1.04%) Ubuntu
9 4 (0.52%) Oracle Linux
10 2 (0.26%) AIX
10 2 (0.26%) Windows 7
11 1 (0.13%) VMS
11 1 (0.13%) Windows Server 2012
Processes & Methodologies
1 423 (54.86%) Analytics
2 378 (49.03%) Business Intelligence
3 372 (48.25%) Agile Software Development
4 233 (30.22%) ETL
5 221 (28.66%) Data Modelling
6 188 (24.38%) DevOps
7 157 (20.36%) Data Analytics
8 152 (19.71%) Machine Learning
9 149 (19.33%) Data Science
10 145 (18.81%) Data Architecture
11 139 (18.03%) Scrum
12 114 (14.79%) Visualisation
13 113 (14.66%) Data Strategy
14 103 (13.36%) Data Engineering
15 97 (12.58%) Data Management
16 93 (12.06%) Data Integration
17 85 (11.02%) Data Ingestion
18 84 (10.89%) Problem-Solving
19 81 (10.51%) Kimball Methodology
20 77 (9.99%) Software Engineering
Programming Languages
1 438 (56.81%) SQL
2 320 (41.50%) Python
3 111 (14.40%) C#
4 105 (13.62%) Data Analysis Expressions (DAX)
5 100 (12.97%) R
6 96 (12.45%) Java
7 84 (10.89%) T-SQL
8 80 (10.38%) Scala
9 55 (7.13%) PowerShell
10 53 (6.87%) JavaScript
11 27 (3.50%) Ruby
11 27 (3.50%) U-SQL
12 17 (2.20%) VBA
13 10 (1.30%) Go
14 9 (1.17%) PL/SQL
14 9 (1.17%) Shell Script
15 8 (1.04%) C
15 8 (1.04%) C++
15 8 (1.04%) VB.NET
16 7 (0.91%) PHP
Qualifications
1 54 (7.00%) Degree
2 31 (4.02%) TOGAF Certification
3 16 (2.08%) Computer Science Degree
4 10 (1.30%) Microsoft Certification
5 9 (1.17%) CISSP
6 8 (1.04%) MCP
7 7 (0.91%) (ISC)2 CCSP
7 7 (0.91%) CCSP
7 7 (0.91%) Cisco Certification
7 7 (0.91%) CompTIA Security+
7 7 (0.91%) MCSA
7 7 (0.91%) MCSE
7 7 (0.91%) PhD
8 6 (0.78%) ISTQB
9 3 (0.39%) AWS Certification
10 2 (0.26%) CGEIT
10 2 (0.26%) CISA
10 2 (0.26%) CISM
10 2 (0.26%) SC Cleared
10 2 (0.26%) Security Cleared
Quality Assurance & Compliance
1 62 (8.04%) Data Quality
2 35 (4.54%) QA
3 27 (3.50%) GDPR
4 13 (1.69%) SLA
5 10 (1.30%) ISO/IEC 27001
6 7 (0.91%) PCI DSS
7 6 (0.78%) HIPAA
8 2 (0.26%) COBIT
9 1 (0.13%) IFRS
9 1 (0.13%) NIST
9 1 (0.13%) Solvency II
System Software
1 34 (4.41%) Docker
2 25 (3.24%) HDFS
3 20 (2.59%) Active Directory
4 17 (2.20%) Apache Flume
4 17 (2.20%) Virtual Machines
5 4 (0.52%) Apache ZooKeeper
6 3 (0.39%) Hyper-V
7 2 (0.26%) Tivoli Workload Scheduler
7 2 (0.26%) VMware Infrastructure
8 1 (0.13%) XenApp
Systems Management
1 23 (2.98%) Opscode Chef
1 23 (2.98%) Terraform
2 21 (2.72%) Puppet
3 19 (2.46%) Kubernetes
4 16 (2.08%) Oozie
5 9 (1.17%) Hadoop YARN
6 7 (0.91%) Microsoft Intune
6 7 (0.91%) Single Sign-On
7 5 (0.65%) Chukwa
8 4 (0.52%) Control-M
8 4 (0.52%) Kibana
9 3 (0.39%) Ansible
10 2 (0.26%) Grafana
10 2 (0.26%) Prometheus
10 2 (0.26%) Tivoli
11 1 (0.13%) HP Quality Center
Vendors
1 294 (38.13%) Microsoft
2 184 (23.87%) Databricks
3 80 (10.38%) Oracle
4 73 (9.47%) Tableau
5 67 (8.69%) Google
6 62 (8.04%) Informatica
7 44 (5.71%) Teradata
8 28 (3.63%) Hortonworks
9 26 (3.37%) Cloudera
10 18 (2.33%) Netezza
11 17 (2.20%) Talend
12 16 (2.08%) Ab Initio
13 15 (1.95%) Red Hat
14 14 (1.82%) ServiceNow
15 13 (1.69%) Alteryx
16 12 (1.56%) Dynatrace
16 12 (1.56%) SolarWinds
17 11 (1.43%) MapR
17 11 (1.43%) SAP
18 10 (1.30%) Salesforce.com