Period
to 22 April 2019

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 22 April 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
England > London
6 months to
22 Apr 2019
Same period 2018 Same period 2017
Rank 405 392 737
Rank change year-on-year -13 +345 +130
Permanent jobs citing Data Lake 413 522 83
As % of all permanent IT jobs advertised in London 0.68% 0.75% 0.12%
As % of the Database & Business Intelligence category 2.35% 2.42% 0.40%
Number of salaries quoted 346 391 72
London median annual salary £70,000 £70,000 £70,000
10th Percentile £47,500 £50,000 £47,500
90th Percentile £99,375 £111,250 £93,750
England median annual salary £65,500 £62,500 £65,000
% change year-on-year +4.80% -3.85% -18.75%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 17,577 21,564 20,677
As % of all permanent IT jobs advertised in London 28.99% 30.80% 30.14%
Number of salaries quoted 14,610 17,678 17,975
London median annual salary £65,000 £60,000 £60,000
Median salary % change year-on-year +8.33% - +9.09%
10th Percentile £38,750 £37,500 £35,000
90th Percentile £95,000 £92,500 £88,750
England median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in London.

Salary trend for Data Lake in London

Data Lake
Salary Histogram in London

The salary distribution of IT jobs citing Data Lake in London over the 6 months to 22 April 2019.

Salary histogram for Data Lake in London

Data Lake
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the London region over the 6 months to 22 April 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +18 124 £70,000 - 7
West London +19 18 £73,500 +40.00%
South London +6 5 £60,000 +17.07% 2
North London +21 2 £86,250 -
East London +19 1 - - 1
Data Lake
England

For the 6 months to 22 April 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Lake.

1 257 (62.23%) Microsoft Azure
2 249 (60.29%) Data Warehouse
3 233 (56.42%) SQL
4 228 (55.21%) Analytics
5 208 (50.36%) Business Intelligence
6 181 (43.83%) Big Data
7 175 (42.37%) SQL Server
7 175 (42.37%) Agile Software Development
8 167 (40.44%) Microsoft
9 160 (38.74%) Python
10 143 (34.62%) Power BI
11 140 (33.90%) Data Modelling
12 139 (33.66%) Finance
13 138 (33.41%) SQL Server Integration Services
14 127 (30.75%) SQL Server Analysis Services
15 123 (29.78%) ETL
16 114 (27.60%) Azure Data Factory
17 112 (27.12%) Hadoop
18 109 (26.39%) SQL Server Reporting Services
19 99 (23.97%) Amazon AWS
20 98 (23.73%) Azure SQL Database
21 91 (22.03%) Visualisation
22 88 (21.31%) Apache Spark
23 84 (20.34%) Machine Learning
24 83 (20.10%) Data Science
25 81 (19.61%) Databricks
26 79 (19.13%) T-SQL
27 75 (18.16%) Data Analytics
28 74 (17.92%) DevOps
29 72 (17.43%) C#

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 88 (21.31%) Apache Spark
2 37 (8.96%) Apache
3 20 (4.84%) Apache Solr
4 16 (3.87%) Elasticsearch
5 15 (3.63%) SAS
6 11 (2.66%) Apache Pig
7 4 (0.97%) Apache Airflow
7 4 (0.97%) BizTalk Server
7 4 (0.97%) Confluence
8 3 (0.73%) Jupyter
8 3 (0.73%) SharePoint
9 2 (0.48%) IIS
9 2 (0.48%) Luigi
10 1 (0.24%) nginx
Applications
1 7 (1.69%) Microsoft Excel
2 4 (0.97%) SPSS
3 3 (0.73%) Microsoft Office
4 2 (0.48%) Spreadsheet
5 1 (0.24%) Chatbot
5 1 (0.24%) MS Visio
Business Applications
1 16 (3.87%) Dynamics CRM
2 2 (0.48%) Adobe Campaign
2 2 (0.48%) SAP ERP
3 1 (0.24%) Eagle PACE
3 1 (0.24%) Markit EDM
Cloud Services
1 257 (62.23%) Microsoft Azure
2 114 (27.60%) Azure Data Factory
3 99 (23.97%) Amazon AWS
4 55 (13.32%) Data Lake Analytics
5 39 (9.44%) Google Cloud Platform
6 32 (7.75%) PaaS
6 32 (7.75%) Serverless
7 23 (5.57%) SaaS
8 21 (5.08%) Cortana Intelligence Suite
9 19 (4.60%) Azure Machine Learning
10 13 (3.15%) Amazon S3
11 11 (2.66%) AWS Lambda
11 11 (2.66%) Azure Active Directory
11 11 (2.66%) Azure Functions
12 10 (2.42%) IaaS
13 9 (2.18%) GitHub
14 6 (1.45%) Amazon EMR
14 6 (1.45%) Apigee
14 6 (1.45%) Cloud Computing
15 5 (1.21%) AWS CloudFormation
Communications & Networking
1 2 (0.48%) Firewall
1 2 (0.48%) Kerberos
2 1 (0.24%) Internet
Database & Business Intelligence
1 249 (60.29%) Data Warehouse
2 181 (43.83%) Big Data
3 175 (42.37%) SQL Server
4 143 (34.62%) Power BI
5 138 (33.41%) SQL Server Integration Services
6 127 (30.75%) SQL Server Analysis Services
7 112 (27.12%) Hadoop
8 109 (26.39%) SQL Server Reporting Services
9 98 (23.73%) Azure SQL Database
10 72 (17.43%) Azure SQL Data Warehouse
11 68 (16.46%) NoSQL
12 54 (13.08%) Microsoft Analysis Services
13 49 (11.86%) Relational Database
14 48 (11.62%) Cosmos DB
15 37 (8.96%) SQL Server 2016
16 30 (7.26%) MongoDB
17 27 (6.54%) Apache Hive
18 26 (6.30%) HDInsight
19 24 (5.81%) Amazon Redshift
19 24 (5.81%) BigQuery
Development Applications
1 35 (8.47%) Visual Studio
2 29 (7.02%) Git (software)
3 20 (4.84%) Visual Studio Team System
4 15 (3.63%) Jenkins
4 15 (3.63%) JIRA
5 11 (2.66%) ER Studio
5 11 (2.66%) ERwin
6 10 (2.42%) Team Foundation Server
7 5 (1.21%) RStudio
8 4 (0.97%) Maven
8 4 (0.97%) Sonatype Nexus
8 4 (0.97%) Subversion
9 3 (0.73%) Artifactory
9 3 (0.73%) Selenium
10 2 (0.48%) Ant
10 2 (0.48%) Gerrit
10 2 (0.48%) Octopus Deploy
10 2 (0.48%) SpecFlow
10 2 (0.48%) TeamCity
10 2 (0.48%) tSQLt
General
1 139 (33.66%) Finance
2 24 (5.81%) Banking
3 19 (4.60%) Retail
4 16 (3.87%) Marketing
5 14 (3.39%) Advertising
6 10 (2.42%) General Ledger
7 9 (2.18%) Law
8 8 (1.94%) Telecoms
9 4 (0.97%) Games
10 3 (0.73%) Investment Banking
11 2 (0.48%) Back Office
12 1 (0.24%) Automotive
12 1 (0.24%) Front Office
Job Titles
1 140 (33.90%) Developer
2 96 (23.24%) Architect
3 85 (20.58%) Business Intelligence Developer
4 78 (18.89%) Data Architect
5 63 (15.25%) Data Engineer
6 54 (13.08%) SQL Developer
7 47 (11.38%) SQL BI Developer
8 33 (7.99%) Azure Developer
9 32 (7.75%) SSRS Developer
10 31 (7.51%) Power BI Developer
11 28 (6.78%) T-SQL Developer
12 27 (6.54%) Senior Developer
13 26 (6.30%) Analyst
13 26 (6.30%) Business Intelligence Lead
14 23 (5.57%) Lead Developer
15 22 (5.33%) Cloud Architect
15 22 (5.33%) Solutions Architect
16 20 (4.84%) Senior Business Intelligence Developer
17 19 (4.60%) Consultant
18 17 (4.12%) Software Engineer
Libraries, Frameworks & Software Standards
1 70 (16.95%) Kafka
2 63 (15.25%) MDX
3 60 (14.53%) .NET
4 32 (7.75%) JSON
5 21 (5.08%) HTML
5 21 (5.08%) Web Services
5 21 (5.08%) XML
6 20 (4.84%) REST
7 17 (4.12%) CSS
8 14 (3.39%) RabbitMQ
8 14 (3.39%) Spring
9 11 (2.66%) XSLT
10 10 (2.42%) Apache NiFi
10 10 (2.42%) Oracle Fusion
11 8 (1.94%) Apache Flex
11 8 (1.94%) Pandas
11 8 (1.94%) SAML
12 7 (1.69%) NumPy
12 7 (1.69%) PySpark
12 7 (1.69%) SciPy
Miscellaneous
1 37 (8.96%) Analytical Skills
2 24 (5.81%) Data Structures
2 24 (5.81%) User Experience
3 17 (4.12%) Greenfield Project
4 14 (3.39%) Reinsurance
5 11 (2.66%) Algorithms
6 10 (2.42%) Clustering
6 10 (2.42%) Management Information System
7 9 (2.18%) Fintech
8 7 (1.69%) Cloud Native
8 7 (1.69%) Virtual Team
9 6 (1.45%) Credit Risk
9 6 (1.45%) Market Risk
9 6 (1.45%) Robotics
10 5 (1.21%) Data Centre
10 5 (1.21%) Self-Motivation
11 4 (0.97%) Enterprise Cloud
11 4 (0.97%) Public Cloud
11 4 (0.97%) Reference Data
11 4 (0.97%) Replication
Operating Systems
1 30 (7.26%) Linux
2 9 (2.18%) Windows
3 6 (1.45%) CentOS
3 6 (1.45%) Red Hat Enterprise Linux
3 6 (1.45%) Ubuntu
3 6 (1.45%) Unix
4 4 (0.97%) Oracle Linux
4 4 (0.97%) Windows 10
4 4 (0.97%) Windows Server
5 2 (0.48%) AIX
5 2 (0.48%) Windows 7
Processes & Methodologies
1 228 (55.21%) Analytics
2 208 (50.36%) Business Intelligence
3 175 (42.37%) Agile Software Development
4 140 (33.90%) Data Modelling
5 123 (29.78%) ETL
6 91 (22.03%) Visualisation
7 84 (20.34%) Machine Learning
8 83 (20.10%) Data Science
9 75 (18.16%) Data Analytics
10 74 (17.92%) DevOps
11 61 (14.77%) Scrum
12 60 (14.53%) Data Architecture
13 58 (14.04%) Problem-Solving
14 53 (12.83%) Data Engineering
15 48 (11.62%) Kimball Methodology
16 47 (11.38%) Data Strategy
16 47 (11.38%) Software Engineering
17 46 (11.14%) Data Ingestion
18 41 (9.93%) Artificial Intelligence
19 39 (9.44%) Enterprise Architecture
Programming Languages
1 233 (56.42%) SQL
2 160 (38.74%) Python
3 79 (19.13%) T-SQL
4 72 (17.43%) C#
5 63 (15.25%) Java
6 59 (14.29%) Data Analysis Expressions (DAX)
7 50 (12.11%) R
8 42 (10.17%) JavaScript
9 30 (7.26%) Scala
10 29 (7.02%) PowerShell
11 22 (5.33%) U-SQL
12 21 (5.08%) Ruby
13 12 (2.91%) VBA
14 11 (2.66%) PL/SQL
15 8 (1.94%) C++
16 6 (1.45%) PHP
17 5 (1.21%) Go
17 5 (1.21%) Kotlin
17 5 (1.21%) VB.NET
18 4 (0.97%) F#
Qualifications
1 28 (6.78%) Degree
2 9 (2.18%) Microsoft Certification
3 6 (1.45%) MCP
4 4 (0.97%) CISSP
4 4 (0.97%) Computer Science Degree
4 4 (0.97%) MCAD
4 4 (0.97%) MCDBA
4 4 (0.97%) MCSD
4 4 (0.97%) PhD
5 3 (0.73%) TOGAF Certification
6 2 (0.48%) (ISC)2 CCSP
6 2 (0.48%) CCSP
6 2 (0.48%) CISA
6 2 (0.48%) Cisco Certification
6 2 (0.48%) CISM
6 2 (0.48%) CompTIA Security+
6 2 (0.48%) Master's Degree
6 2 (0.48%) MCSA
6 2 (0.48%) MCSE
6 2 (0.48%) PMI Certification
Quality Assurance & Compliance
1 37 (8.96%) Data Quality
2 26 (6.30%) QA
3 16 (3.87%) GDPR
4 8 (1.94%) ISO/IEC 27001
4 8 (1.94%) PCI DSS
5 4 (0.97%) HIPAA
6 2 (0.48%) IFRS
6 2 (0.48%) SLA
6 2 (0.48%) Solvency II
7 1 (0.24%) ISO 20022
System Software
1 13 (3.15%) HDFS
2 12 (2.91%) Docker
3 11 (2.66%) Active Directory
4 8 (1.94%) Apache ZooKeeper
5 7 (1.69%) Apache Flume
6 2 (0.48%) Tivoli Workload Scheduler
6 2 (0.48%) Virtual Machines
Systems Management
1 14 (3.39%) Opscode Chef
2 13 (3.15%) Terraform
3 12 (2.91%) Puppet
4 11 (2.66%) Oozie
5 9 (2.18%) Kubernetes
6 5 (1.21%) Ansible
7 4 (0.97%) Control-M
7 4 (0.97%) Hadoop YARN
7 4 (0.97%) Kibana
8 2 (0.48%) Ambari
8 2 (0.48%) ArcSight ESM
8 2 (0.48%) Microsoft Intune
8 2 (0.48%) Salt
8 2 (0.48%) Single Sign-On
8 2 (0.48%) Tivoli
9 1 (0.24%) Grafana
9 1 (0.24%) HP Quality Center
Vendors
1 167 (40.44%) Microsoft
2 81 (19.61%) Databricks
3 57 (13.80%) Oracle
4 45 (10.90%) Tableau
5 40 (9.69%) Google
6 13 (3.15%) Red Hat
7 11 (2.66%) Alteryx
7 11 (2.66%) Talend
8 10 (2.42%) WorldPay
9 9 (2.18%) Hortonworks
9 9 (2.18%) Informatica
10 8 (1.94%) Cloudera
10 8 (1.94%) Cognizant
10 8 (1.94%) Sybase
11 6 (1.45%) IDERA
11 6 (1.45%) Salesforce.com
11 6 (1.45%) Teradata
12 4 (0.97%) MapR
13 3 (0.73%) IBM
14 2 (0.48%) Cisco