Period
to 17 July 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 17 July 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
17 Jul 2019
Same period 2018 Same period 2017
Rank 248 352 473
Rank change year-on-year +104 +121 +113
Contract jobs citing Data Lake 446 306 115
As % of all contract IT jobs advertised in London 1.09% 0.66% 0.28%
As % of the Database & Business Intelligence category 4.37% 2.63% 1.14%
Number of daily rates quoted 358 203 80
London median daily rate £525 £525 £550
Median daily rate % change year-on-year - -4.55% +4.76%
10th Percentile £418 £400 £399
90th Percentile £700 £713 £703
England median daily rate £525 £515 £525
% change year-on-year +1.94% -1.90% -4.55%
Number of hourly rates quoted 0 1 0
London median hourly rate - £24.00 -
England median hourly rate £72.50 £47.25 -
% change year-on-year +53.44% - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 10,208 11,656 10,102
As % of all contract IT jobs advertised in London 24.88% 25.17% 24.17%
Number of daily rates quoted 7,416 8,720 7,325
London median daily rate £525 £519 £500
Median daily rate % change year-on-year +1.20% +3.75% +5.26%
10th Percentile £363 £356 £325
90th Percentile £688 £675 £650
England median daily rate £485 £475 £450
% change year-on-year +2.11% +5.56% +5.88%
Number of hourly rates quoted 66 74 48
London median hourly rate £35.00 £30.00 £27.16
Median hourly rate % change year-on-year +16.67% +10.46% +6.15%
10th Percentile £17.16 £20.25 £18.05
90th Percentile £56.50 £47.46 £47.88
England median hourly rate £35.00 £33.00 £29.81
% change year-on-year +6.06% +10.70% +4.60%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in London.

Contractor daily rate trend for Data Lake in London

Data Lake
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Lake in London over the 6 months to 17 July 2019.

Contractor daily rate histogram for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 17 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +90 137 £525 +5.00% 30
West London +22 10 £475 - 3
South London +25 6 £464 -
East London -4 2 £550 +33.33% 3
North London - 1 - - 2
Data Lake
England

For the 6 months to 17 July 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 260 (58.30%) Microsoft Azure
2 196 (43.95%) SQL
3 173 (38.79%) Data Warehouse
4 164 (36.77%) Big Data
5 152 (34.08%) Python
6 137 (30.72%) Hadoop
7 127 (28.48%) Business Intelligence
8 120 (26.91%) Analytics
9 117 (26.23%) Microsoft
10 116 (26.01%) Finance
11 114 (25.56%) Apache Spark
12 106 (23.77%) Agile Software Development
13 104 (23.32%) Azure Data Factory
14 91 (20.40%) Amazon AWS
15 89 (19.96%) Data Modelling
16 86 (19.28%) C#
17 84 (18.83%) Power Platform
17 84 (18.83%) Power BI
18 83 (18.61%) Kafka
19 75 (16.82%) Serverless
20 74 (16.59%) ETL
21 68 (15.25%) SQL Server
22 67 (15.02%) Data Science
23 64 (14.35%) .NET
23 64 (14.35%) Azure SQL Database
24 62 (13.90%) Microservices
25 59 (13.23%) DevOps
25 59 (13.23%) Apache Hive
25 59 (13.23%) Greenfield Project
26 58 (13.00%) Databricks

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 114 (25.56%) Apache Spark
2 16 (3.59%) Apache
3 13 (2.91%) SharePoint
4 7 (1.57%) Apache Airflow
5 6 (1.35%) Confluence
6 5 (1.12%) Elasticsearch
6 5 (1.12%) Luigi
7 3 (0.67%) Apache Solr
7 3 (0.67%) Jupyter
8 2 (0.45%) Apache Pig
9 1 (0.22%) Anypoint
9 1 (0.22%) Cloud Foundry
9 1 (0.22%) nginx
9 1 (0.22%) SAS
Applications
1 4 (0.90%) Microsoft Excel
2 3 (0.67%) Microsoft Office
3 1 (0.22%) AutoCAD
3 1 (0.22%) Spreadsheet
Business Applications
1 12 (2.69%) Dynamics CRM
2 7 (1.57%) SAP Oil and Gas
3 6 (1.35%) Dynamics AX
3 6 (1.35%) Dynamics NAV
4 4 (0.90%) SAP ERP
4 4 (0.90%) SAP S/4HANA
5 1 (0.22%) Eloqua
5 1 (0.22%) Markit EDM
5 1 (0.22%) Oracle Retail
5 1 (0.22%) Salesforce.com CRM
5 1 (0.22%) SAP HR
5 1 (0.22%) Sparx Enterprise Architect
Cloud Services
1 260 (58.30%) Microsoft Azure
2 104 (23.32%) Azure Data Factory
3 91 (20.40%) Amazon AWS
4 84 (18.83%) Power Platform
5 75 (16.82%) Serverless
6 41 (9.19%) Google Cloud Platform
7 24 (5.38%) Azure Functions
8 22 (4.93%) Amazon S3
8 22 (4.93%) PaaS
9 21 (4.71%) Data Lake Analytics
10 20 (4.48%) AWS Lambda
11 15 (3.36%) Amazon Kinesis
12 12 (2.69%) Amazon EMR
12 12 (2.69%) Office 365
13 9 (2.02%) SaaS
14 8 (1.79%) Azure Machine Learning
15 7 (1.57%) GitHub
15 7 (1.57%) IaaS
16 6 (1.35%) Apigee
16 6 (1.35%) Dynamics 365
Communications & Networking
1 6 (1.35%) Internet
2 4 (0.90%) Kerberos
3 2 (0.45%) Software-Defined Networking
4 1 (0.22%) Firewall
4 1 (0.22%) HTTP
Database & Business Intelligence
1 173 (38.79%) Data Warehouse
2 164 (36.77%) Big Data
3 137 (30.72%) Hadoop
4 84 (18.83%) Power BI
5 68 (15.25%) SQL Server
6 64 (14.35%) Azure SQL Database
7 59 (13.23%) Apache Hive
8 57 (12.78%) Azure SQL Data Warehouse
9 55 (12.33%) Cosmos DB
10 45 (10.09%) NoSQL
11 42 (9.42%) SQL Server Integration Services
12 32 (7.17%) Redis
12 32 (7.17%) SQL Server Analysis Services
13 30 (6.73%) SQL Server Reporting Services
14 25 (5.61%) HBase
14 25 (5.61%) MongoDB
15 24 (5.38%) Apache Cassandra
16 18 (4.04%) Microsoft Analysis Services
17 17 (3.81%) MySQL
17 17 (3.81%) PostgreSQL
Development Applications
1 39 (8.74%) Visual Studio Team System
2 38 (8.52%) Git (software)
3 21 (4.71%) Jenkins
4 18 (4.04%) JIRA
5 12 (2.69%) TeamCity
6 10 (2.24%) Cucumber
7 9 (2.02%) Octopus Deploy
7 9 (2.02%) SpecFlow
7 9 (2.02%) Team Foundation Server
8 8 (1.79%) tSQLt
9 7 (1.57%) Visual Studio
10 5 (1.12%) Hudson
11 4 (0.90%) Atlassian Bamboo
11 4 (0.90%) ERwin
11 4 (0.90%) Maven
11 4 (0.90%) Moq
11 4 (0.90%) NUnit
11 4 (0.90%) PowerDesigner
11 4 (0.90%) Subversion
12 3 (0.67%) JUnit
General
1 116 (26.01%) Finance
2 28 (6.28%) Banking
3 26 (5.83%) Retail
4 10 (2.24%) Marketing
5 8 (1.79%) Legal
6 7 (1.57%) Investment Banking
7 6 (1.35%) Advertising
8 5 (1.12%) French Language
8 5 (1.12%) Publishing
9 4 (0.90%) Front Office
10 3 (0.67%) Financial Institution
10 3 (0.67%) Telecoms
11 2 (0.45%) Automotive
12 1 (0.22%) Games
12 1 (0.22%) Manufacturing
12 1 (0.22%) Retail Banking
Job Titles
1 146 (32.74%) Data Engineer
2 106 (23.77%) Architect
3 77 (17.26%) Developer
4 67 (15.02%) Data Architect
5 48 (10.76%) Big Data Engineer
6 44 (9.87%) Azure Architect
7 42 (9.42%) Azure Engineer
8 33 (7.40%) Azure Developer
9 26 (5.83%) Solutions Architect
10 21 (4.71%) Analyst
11 20 (4.48%) .NET Developer
11 20 (4.48%) Big Data Architect
11 20 (4.48%) Project Manager
12 17 (3.81%) C# Developer
13 16 (3.59%) Business Analyst
13 16 (3.59%) Consultant
13 16 (3.59%) Senior Developer
14 15 (3.36%) AWS Engineer
14 15 (3.36%) Business Intelligence Developer
14 15 (3.36%) Technical Architect
Libraries, Frameworks & Software Standards
1 83 (18.61%) Kafka
2 64 (14.35%) .NET
3 30 (6.73%) .NET Core
3 30 (6.73%) AngularJS
4 22 (4.93%) Web Services
5 20 (4.48%) REST
6 16 (3.59%) ASP.NET Web API
7 15 (3.36%) .NET Framework
8 13 (2.91%) Velocity
9 12 (2.69%) JSON
10 11 (2.47%) ASP.NET
11 10 (2.24%) XML
12 9 (2.02%) ASP.NET MVC
13 8 (1.79%) Spark Streaming
14 7 (1.57%) Entity Framework
14 7 (1.57%) MDX
14 7 (1.57%) RESTful
15 6 (1.35%) Angular 2
15 6 (1.35%) Node.js
16 5 (1.12%) React
Miscellaneous
1 59 (13.23%) Greenfield Project
2 43 (9.64%) Analytical Skills
3 20 (4.48%) Algorithms
4 15 (3.36%) Data Structures
5 10 (2.24%) Self-Motivation
6 7 (1.57%) Public Cloud
7 6 (1.35%) Internet of Things
7 6 (1.35%) User Experience
7 6 (1.35%) Virtual Team
8 5 (1.12%) Hybrid Cloud
9 4 (0.90%) Cloud Native
9 4 (0.90%) Management Information System
9 4 (0.90%) Taxonomies
10 3 (0.67%) Linux Command Line
10 3 (0.67%) Mobile App
10 3 (0.67%) Reference Data
11 2 (0.45%) Data Protection Act
11 2 (0.45%) Private Cloud
12 1 (0.22%) Fixed Income
12 1 (0.22%) SCADA
Operating Systems
1 12 (2.69%) Linux
2 9 (2.02%) Unix
3 5 (1.12%) Windows
4 4 (0.90%) CentOS
4 4 (0.90%) VMS
5 1 (0.22%) Android
5 1 (0.22%) Apple iOS
Processes & Methodologies
1 127 (28.48%) Business Intelligence
2 120 (26.91%) Analytics
3 106 (23.77%) Agile Software Development
4 89 (19.96%) Data Modelling
5 74 (16.59%) ETL
6 67 (15.02%) Data Science
7 62 (13.90%) Microservices
8 59 (13.23%) DevOps
9 51 (11.43%) Scrum
10 49 (10.99%) Migration
11 43 (9.64%) Problem-Solving
12 42 (9.42%) Data Engineering
13 39 (8.74%) TDD
14 33 (7.40%) Fintech
15 31 (6.95%) Data Architecture
15 31 (6.95%) Machine Learning
15 31 (6.95%) Stakeholder Management
16 30 (6.73%) Test Automation
16 30 (6.73%) Visualisation
17 27 (6.05%) Data Analytics
Programming Languages
1 196 (43.95%) SQL
2 152 (34.08%) Python
3 86 (19.28%) C#
4 58 (13.00%) Java
5 48 (10.76%) Scala
6 26 (5.83%) JavaScript
7 24 (5.38%) R
8 21 (4.71%) T-SQL
9 19 (4.26%) PowerShell
9 19 (4.26%) U-SQL
10 8 (1.79%) Go
11 7 (1.57%) Shell Script
12 6 (1.35%) Bash Shell
12 6 (1.35%) Data Analysis Expressions (DAX)
13 5 (1.12%) Perl
14 2 (0.45%) Clojure
14 2 (0.45%) Groovy
14 2 (0.45%) Java 8
14 2 (0.45%) PL/SQL
15 1 (0.22%) Java 9
Qualifications
1 18 (4.04%) Degree
2 7 (1.57%) Computer Science Degree
3 6 (1.35%) Security Cleared
4 5 (1.12%) Master's Degree
4 5 (1.12%) PhD
4 5 (1.12%) SC Cleared
5 4 (0.90%) CISA
5 4 (0.90%) CISM
5 4 (0.90%) CISSP
5 4 (0.90%) PRINCE2 Certification
6 3 (0.67%) CEH
6 3 (0.67%) GIAC
6 3 (0.67%) OSCP
7 1 (0.22%) CGEIT
7 1 (0.22%) DBS Check
7 1 (0.22%) ISEB
7 1 (0.22%) ISEB Practitioner
7 1 (0.22%) TOGAF Certification
Quality Assurance & Compliance
1 19 (4.26%) Data Quality
2 8 (1.79%) QA
3 5 (1.12%) GDPR
4 2 (0.45%) PMO
4 2 (0.45%) Sarbanes-Oxley
5 1 (0.22%) ISO/IEC 27001
5 1 (0.22%) PCI DSS
5 1 (0.22%) SLA
System Software
1 56 (12.56%) Docker
2 25 (5.61%) Apache Flume
3 17 (3.81%) HDFS
4 4 (0.90%) Samba
4 4 (0.90%) Virtual Machines
4 4 (0.90%) VMware ESXi
4 4 (0.90%) VMware Infrastructure
5 3 (0.67%) Active Directory
6 1 (0.22%) NFS
6 1 (0.22%) Postfix
Systems Management
1 48 (10.76%) Kubernetes
2 9 (2.02%) Hadoop YARN
3 8 (1.79%) Ansible
4 6 (1.35%) Terraform
5 4 (0.90%) Ambari
6 2 (0.45%) Puppet
7 1 (0.22%) Control-M
7 1 (0.22%) Microsoft Intune
7 1 (0.22%) Oozie
7 1 (0.22%) Opscode Chef
7 1 (0.22%) SCCM
7 1 (0.22%) yum
Vendors
1 117 (26.23%) Microsoft
2 58 (13.00%) Databricks
3 36 (8.07%) Cloudera
4 32 (7.17%) Google
5 30 (6.73%) Talend
6 21 (4.71%) Tableau
7 14 (3.14%) Oracle
8 10 (2.24%) Alteryx
8 10 (2.24%) Hortonworks
8 10 (2.24%) Informatica
8 10 (2.24%) SAP
9 6 (1.35%) MuleSoft
9 6 (1.35%) Teradata
10 5 (1.12%) Dataiku
11 4 (0.90%) Ab Initio
11 4 (0.90%) Red Hat
11 4 (0.90%) Salesforce.com
11 4 (0.90%) StreamSets
11 4 (0.90%) VMware
11 4 (0.90%) Workday