Period
to 11 November 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 11 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
11 Nov 2019
Same period 2018 Same period 2017
Rank 215 309 515
Rank change year-on-year +94 +206 +26
Contract jobs citing Data Lake 413 349 129
As % of all contract IT jobs advertised in London 1.15% 0.77% 0.28%
As % of the Database & Business Intelligence category 4.82% 3.13% 1.17%
Number of daily rates quoted 329 246 91
London median daily rate £550 £525 £550
Median daily rate % change year-on-year +4.76% -4.55% -12.00%
10th Percentile £413 £410 £363
90th Percentile £700 £704 £700
England median daily rate £550 £525 £550
% change year-on-year +4.76% -4.55% -8.33%
Number of hourly rates quoted 0 0 0
London median hourly rate - - -
England median hourly rate £72.50 £49.75 £45.00
% change year-on-year +45.73% +10.56% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,572 11,138 11,044
As % of all contract IT jobs advertised in London 23.95% 24.52% 23.73%
Number of daily rates quoted 6,208 8,300 8,164
London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +5.26%
10th Percentile £363 £363 £350
90th Percentile £700 £675 £655
England median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 57 50 61
London median hourly rate £35.00 £27.62 £26.61
Median hourly rate % change year-on-year +26.74% +3.80% -23.99%
10th Percentile £15.56 £16.15 £18.25
90th Percentile £53.75 £48.73 £58.75
England median hourly rate £32.50 £30.00 £31.08
% change year-on-year +8.33% -3.46% +10.63%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in London.

Contractor daily rate trend for Data Lake in London

Data Lake
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Lake in London over the 6 months to 11 November 2019.

Contractor daily rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 11 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +104 101 £531 -3.41% 27
South London +40 8 £454 -4.47% 1
East London +20 5 £750 +51.90% 6
West London +12 5 £500 +2.56% 2
North London +3 1 £575 -3.16%
Data Lake
England

For the 6 months to 11 November 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 266 (64.41%) Azure
2 216 (52.30%) SQL
3 174 (42.13%) Data Warehouse
3 174 (42.13%) Analytics
4 151 (36.56%) Azure Data Factory
5 148 (35.84%) Business Intelligence
6 143 (34.62%) Python
7 129 (31.23%) Agile Software Development
8 124 (30.02%) Microsoft
9 109 (26.39%) Big Data
10 107 (25.91%) Power Platform
10 107 (25.91%) Power BI
11 106 (25.67%) AWS
12 96 (23.24%) Finance
13 91 (22.03%) C#
14 88 (21.31%) Serverless
15 86 (20.82%) ETL
16 85 (20.58%) Azure SQL Database
16 85 (20.58%) DevOps
17 84 (20.34%) Databricks
18 80 (19.37%) Data Modelling
19 79 (19.13%) Hadoop
20 75 (18.16%) SQL Server Integration Services
21 72 (17.43%) SQL Server
22 66 (15.98%) Apache Spark
23 65 (15.74%) Data Science
24 62 (15.01%) Azure SQL Data Warehouse
25 58 (14.04%) Scala
26 52 (12.59%) .NET
27 51 (12.35%) Data Lake Analytics

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 66 (15.98%) Apache Spark
2 13 (3.15%) Apache Airflow
2 13 (3.15%) SharePoint
3 7 (1.69%) Apache
3 7 (1.69%) Confluence
4 6 (1.45%) Elasticsearch
5 4 (0.97%) Apache Solr
6 3 (0.73%) Jupyter
7 2 (0.48%) SharePoint 2013
8 1 (0.24%) Apache Pig
8 1 (0.24%) Cloud Foundry
8 1 (0.24%) CMS
8 1 (0.24%) Headless CMS
8 1 (0.24%) SAS
8 1 (0.24%) WordPress
Applications
1 10 (2.42%) Microsoft Excel
2 2 (0.48%) AutoCAD
3 1 (0.24%) Microsoft Office
Business Applications
1 4 (0.97%) SAP Oil and Gas
2 3 (0.73%) Eloqua
2 3 (0.73%) FINCAD Analytics
3 2 (0.48%) Dynamics AX
3 2 (0.48%) Dynamics CRM
3 2 (0.48%) Dynamics NAV
4 1 (0.24%) Markit EDM
4 1 (0.24%) NetSuite
4 1 (0.24%) Payment Gateway
4 1 (0.24%) SAP MDG
4 1 (0.24%) SAP MDM
4 1 (0.24%) SAP PLM
4 1 (0.24%) Sparx Enterprise Architect
Cloud Services
1 266 (64.41%) Azure
2 151 (36.56%) Azure Data Factory
3 107 (25.91%) Power Platform
4 106 (25.67%) AWS
5 88 (21.31%) Serverless
6 51 (12.35%) Data Lake Analytics
7 43 (10.41%) Azure Functions
8 42 (10.17%) GCP
9 30 (7.26%) Amazon S3
10 20 (4.84%) AWS Lambda
11 14 (3.39%) Azure Machine Learning
12 12 (2.91%) GitHub
13 11 (2.66%) PaaS
14 10 (2.42%) Amazon EMR
14 10 (2.42%) Azure Active Directory
15 8 (1.94%) Azure Stack
16 7 (1.69%) IaaS
16 7 (1.69%) Office 365
17 6 (1.45%) AWS CloudFormation
18 5 (1.21%) Amazon Kinesis
Communications & Networking
1 3 (0.73%) Internet
1 3 (0.73%) Kerberos
2 2 (0.48%) Extranet
2 2 (0.48%) Firewall
2 2 (0.48%) Intranet
2 2 (0.48%) Software-Defined Networking
3 1 (0.24%) DNS
3 1 (0.24%) HTTP
3 1 (0.24%) SSL
3 1 (0.24%) VPN
Database & Business Intelligence
1 174 (42.13%) Data Warehouse
2 109 (26.39%) Big Data
3 107 (25.91%) Power BI
4 85 (20.58%) Azure SQL Database
5 79 (19.13%) Hadoop
6 75 (18.16%) SQL Server Integration Services
7 72 (17.43%) SQL Server
8 62 (15.01%) Azure SQL Data Warehouse
9 42 (10.17%) Amazon Redshift
10 40 (9.69%) SQL Server Reporting Services
11 36 (8.72%) NoSQL
12 35 (8.47%) Apache Hive
12 35 (8.47%) SQL Server Analysis Services
13 29 (7.02%) Cosmos DB
14 26 (6.30%) Snowflake Schema
15 19 (4.60%) Microsoft Analysis Services
15 19 (4.60%) Relational Database
16 18 (4.36%) Redis
17 17 (4.12%) BigQuery
18 15 (3.63%) Amazon Athena
Development Applications
1 29 (7.02%) Git (software)
2 23 (5.57%) Jenkins
3 21 (5.08%) Visual Studio Team System
4 16 (3.87%) JIRA
5 11 (2.66%) Team Foundation Server
6 7 (1.69%) Cucumber
7 6 (1.45%) Atlassian Bamboo
7 6 (1.45%) Jasmine
7 6 (1.45%) Maven
7 6 (1.45%) NUnit
7 6 (1.45%) PowerDesigner
8 5 (1.21%) Visual Studio
9 4 (0.97%) ERwin
9 4 (0.97%) Moq
9 4 (0.97%) Selenium
9 4 (0.97%) TeamCity
10 3 (0.73%) ER Studio
10 3 (0.73%) Sonatype Nexus
11 2 (0.48%) Hudson
11 2 (0.48%) Mocha
General
1 96 (23.24%) Finance
2 18 (4.36%) Marketing
2 18 (4.36%) Retail
3 16 (3.87%) Front Office
4 13 (3.15%) Advertising
5 8 (1.94%) Banking
5 8 (1.94%) Legal
6 5 (1.21%) Public Sector
7 3 (0.73%) Publishing
7 3 (0.73%) Telecoms
8 2 (0.48%) Games
8 2 (0.48%) Local Government
9 1 (0.24%) Automotive
9 1 (0.24%) Financial Institution
9 1 (0.24%) Investment Banking
Job Titles
1 106 (25.67%) Data Engineer
2 102 (24.70%) Architect
3 93 (22.52%) Developer
4 86 (20.82%) Data Architect
5 51 (12.35%) Azure Developer
6 46 (11.14%) Azure Engineer
7 41 (9.93%) Azure Architect
8 26 (6.30%) Big Data Engineer
9 23 (5.57%) C# Developer
10 18 (4.36%) Senior Data Engineer
10 18 (4.36%) SQL Developer
11 16 (3.87%) Business Intelligence Developer
12 14 (3.39%) Solutions Architect
13 13 (3.15%) .NET Developer
13 13 (3.15%) Consultant
13 13 (3.15%) Senior Developer
14 12 (2.91%) Big Data Architect
15 11 (2.66%) Analyst
15 11 (2.66%) Data Manager
15 11 (2.66%) Project Manager
Libraries, Frameworks & Software Standards
1 52 (12.59%) .NET
2 45 (10.90%) Kafka
3 22 (5.33%) JSON
3 22 (5.33%) Web Services
4 21 (5.08%) .NET Core
5 17 (4.12%) XML
6 14 (3.39%) AngularJS
7 13 (3.15%) React
8 8 (1.94%) MDX
9 7 (1.69%) .NET Framework
10 6 (1.45%) Node.js
10 6 (1.45%) PySpark
11 5 (1.21%) Apache NiFi
11 5 (1.21%) NumPy
11 5 (1.21%) Pandas
11 5 (1.21%) REST
11 5 (1.21%) Spark Streaming
12 4 (0.97%) Akka
12 4 (0.97%) Natural Language Processing
12 4 (0.97%) RESTful
Miscellaneous
1 42 (10.17%) Greenfield Project
2 34 (8.23%) Analytical Skills
3 17 (4.12%) Public Cloud
4 14 (3.39%) Data Structures
5 13 (3.15%) Algorithms
6 5 (1.21%) Cloud Native
6 5 (1.21%) Self-Motivation
6 5 (1.21%) Virtual Team
7 4 (0.97%) Private Cloud
8 3 (0.73%) Blog
8 3 (0.73%) Derivative
8 3 (0.73%) Fixed Income
8 3 (0.73%) Hedge funds
8 3 (0.73%) Management Information System
8 3 (0.73%) Mobile App
8 3 (0.73%) Reference Data
8 3 (0.73%) Replication
9 2 (0.48%) Data Centre
9 2 (0.48%) PMI
9 2 (0.48%) User Experience
Operating Systems
1 17 (4.12%) Unix
2 16 (3.87%) Linux
3 9 (2.18%) Windows
4 8 (1.94%) VMS
5 2 (0.48%) CentOS
Processes & Methodologies
1 174 (42.13%) Analytics
2 148 (35.84%) Business Intelligence
3 129 (31.23%) Agile Software Development
4 86 (20.82%) ETL
5 85 (20.58%) DevOps
6 80 (19.37%) Data Modelling
7 65 (15.74%) Data Science
8 43 (10.41%) Migration
9 41 (9.93%) Data Architecture
9 41 (9.93%) Test Automation
10 39 (9.44%) Data Engineering
10 39 (9.44%) Microservices
11 37 (8.96%) Visualisation
12 35 (8.47%) Machine Learning
13 34 (8.23%) TDD
14 32 (7.75%) Artificial Intelligence
14 32 (7.75%) Data Governance
14 32 (7.75%) Stakeholder Management
15 31 (7.51%) Problem-Solving
15 31 (7.51%) Scrum
Programming Languages
1 216 (52.30%) SQL
2 143 (34.62%) Python
3 91 (22.03%) C#
4 58 (14.04%) Scala
5 35 (8.47%) Java
6 24 (5.81%) PowerShell
7 23 (5.57%) R
8 21 (5.08%) T-SQL
9 19 (4.60%) JavaScript
10 10 (2.42%) U-SQL
11 8 (1.94%) Go
12 7 (1.69%) Bash Shell
12 7 (1.69%) Data Analysis Expressions (DAX)
13 5 (1.21%) C
13 5 (1.21%) C++
13 5 (1.21%) PL/SQL
14 4 (0.97%) Perl
14 4 (0.97%) Ruby
15 3 (0.73%) Java 8
15 3 (0.73%) Shell Script
Qualifications
1 11 (2.66%) Degree
2 10 (2.42%) Security Cleared
3 8 (1.94%) SC Cleared
4 3 (0.73%) CEH
4 3 (0.73%) Computer Science Degree
5 2 (0.48%) DBS Check
5 2 (0.48%) PhD
5 2 (0.48%) PMI Certification
5 2 (0.48%) TOGAF Certification
6 1 (0.24%) CISA
6 1 (0.24%) CISM
6 1 (0.24%) CISSP
6 1 (0.24%) GIAC
6 1 (0.24%) ISEB
6 1 (0.24%) ISEB Practitioner
6 1 (0.24%) OSCP
6 1 (0.24%) PRINCE2 Certification
Quality Assurance & Compliance
1 29 (7.02%) Data Quality
2 10 (2.42%) GDPR
3 5 (1.21%) QA
4 1 (0.24%) ISO/IEC 27001
4 1 (0.24%) PCI DSS
4 1 (0.24%) SLA
System Software
1 36 (8.72%) Docker
2 17 (4.12%) HDFS
3 12 (2.91%) Active Directory
4 10 (2.42%) Virtual Machines
5 7 (1.69%) Apache Flume
6 4 (0.97%) VMware Infrastructure
7 2 (0.48%) NFS
7 2 (0.48%) Samba
7 2 (0.48%) VMware ESXi
8 1 (0.24%) Postfix
Systems Management
1 37 (8.96%) Kubernetes
2 10 (2.42%) Ansible
3 6 (1.45%) Grafana
3 6 (1.45%) Hadoop YARN
3 6 (1.45%) Terraform
4 3 (0.73%) Opscode Chef
5 2 (0.48%) Ambari
5 2 (0.48%) Nessus
5 2 (0.48%) Puppet
5 2 (0.48%) Salt
6 1 (0.24%) AirWatch
6 1 (0.24%) Kubeflow
6 1 (0.24%) SCCM
6 1 (0.24%) yum
Vendors
1 124 (30.02%) Microsoft
2 84 (20.34%) Databricks
3 38 (9.20%) Tableau
4 23 (5.57%) Google
4 23 (5.57%) Oracle
5 20 (4.84%) Alteryx
6 17 (4.12%) Informatica
7 16 (3.87%) Talend
8 13 (3.15%) Cloudera
9 9 (2.18%) SAP
10 7 (1.69%) Splunk
11 6 (1.45%) Hortonworks
11 6 (1.45%) MuleSoft
11 6 (1.45%) StreamSets
12 5 (1.21%) Teradata
13 4 (0.97%) VMware
14 3 (0.73%) Atlassian
14 3 (0.73%) Bloomberg
14 3 (0.73%) Cisco
14 3 (0.73%) Siebel