Period
to 15 October 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 15 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
15 Oct 2021
Same period 2020 Same period 2019
Rank 163 192 226
Rank change year-on-year +29 +34 +130
Contract jobs citing Data Lake 621 178 437
As % of all contract jobs advertised in London 1.75% 1.29% 1.18%
As % of the Database & Business Intelligence category 7.33% 5.10% 4.79%
Number of daily rates quoted 419 122 349
10th Percentile £425 £410 £413
25th Percentile £475 £463 £488
Median daily rate (50th Percentile) £550 £550 £550
75th Percentile £638 £650 £638
90th Percentile £725 £724 £703
England median daily rate £525 £550 £550
% change year-on-year -4.55% - +7.32%
Number of hourly rates quoted 1 0 0
Median hourly rate £44.50 - -
England median hourly rate £44.50 - £72.50

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,474 3,490 9,129
As % of all contract IT jobs advertised in London 23.92% 25.36% 24.62%
Number of daily rates quoted 6,154 2,499 6,723
10th Percentile £388 £357 £363
25th Percentile £463 £425 £425
Median daily rate (50th Percentile) £550 £525 £525
Median % change year-on-year +4.76% - -
75th Percentile £670 £625 £613
90th Percentile £738 £713 £700
England median daily rate £525 £500 £480
% change year-on-year +5.00% +4.17% +1.05%
Number of hourly rates quoted 44 18 50
10th Percentile £15.73 £19.10 £15.47
25th Percentile £24.50 £26.44 £20.67
Median hourly rate £34.75 £37.93 £29.96
Median % change year-on-year -8.38% +26.59% -0.13%
75th Percentile £57.53 £41.50 £44.69
90th Percentile £64.55 £53.83 £51.25
England median hourly rate £34.50 £26.48 £30.00
% change year-on-year +30.29% -11.73% -

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Lake in London.

Daily rate trend for Data Lake in London

Data Lake
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Lake in London over the 6 months to 15 October 2021.

Daily rate histogram for Data Lake in London

Data Lake
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Lake in London.

Hourly rate trend for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 15 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -18 64 £550 +15.79% 31
West London -11 10 £493 -10.05% 8
South London - 8 £540 - 7
Data Lake
England

For the 6 months to 15 October 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 420 (67.63%) Azure
2 298 (47.99%) SQL
3 254 (40.90%) Databricks
4 236 (38.00%) Data Warehouse
5 230 (37.04%) Business Intelligence
6 227 (36.55%) Agile Software Development
7 218 (35.10%) Azure Data Factory
8 209 (33.66%) DevOps
9 199 (32.05%) Python
10 194 (31.24%) Data Modelling
11 192 (30.92%) Analytics
12 169 (27.21%) Microsoft
13 164 (26.41%) Power Platform
14 159 (25.60%) Power BI
15 150 (24.15%) AWS
16 138 (22.22%) ETL
17 136 (21.90%) Big Data
18 135 (21.74%) Finance
19 129 (20.77%) Social Skills
20 116 (18.68%) Azure SQL Database
21 109 (17.55%) SQL Server
22 108 (17.39%) Apache Spark
23 105 (16.91%) Scrum
24 101 (16.26%) Data Engineering
25 90 (14.49%) Data Pipeline
26 88 (14.17%) Hadoop
27 85 (13.69%) Azure Synapse Analytics
28 80 (12.88%) Data Science
28 80 (12.88%) Migration
29 76 (12.24%) Serverless

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 108 (17.39%) Apache Spark
2 33 (5.31%) Apache
3 23 (3.70%) Apache Airflow
4 14 (2.25%) Apache Pig
5 12 (1.93%) Confluence
6 10 (1.61%) SharePoint
7 5 (0.81%) Elasticsearch
8 4 (0.64%) BizTalk Server
8 4 (0.64%) SAS
9 3 (0.48%) MQSeries
9 3 (0.48%) Oracle Coherence
10 2 (0.32%) Cloud Foundry
11 1 (0.16%) JBoss
11 1 (0.16%) Jupyter
11 1 (0.16%) Luigi
Applications
1 12 (1.93%) Microsoft Excel
2 3 (0.48%) Microsoft Office
2 3 (0.48%) SPSS
3 2 (0.32%) Oracle Smart View
4 1 (0.16%) Microsoft PowerPoint
Business Applications
1 16 (2.58%) Dynamics CRM
2 4 (0.64%) SAP Oil and Gas
2 4 (0.64%) SAP S/4HANA
3 3 (0.48%) Sparx Enterprise Architect
4 2 (0.32%) Dynamics AX
4 2 (0.32%) Eloqua
4 2 (0.32%) Maximo
4 2 (0.32%) SAP ERP
5 1 (0.16%) Aligne
Cloud Services
1 420 (67.63%) Azure
2 218 (35.10%) Azure Data Factory
3 164 (26.41%) Power Platform
4 150 (24.15%) AWS
5 85 (13.69%) Azure Synapse Analytics
6 76 (12.24%) Serverless
7 56 (9.02%) Amazon S3
8 48 (7.73%) Azure Cosmos DB
9 42 (6.76%) AWS Lambda
10 40 (6.44%) PaaS
11 35 (5.64%) Azure Functions
11 35 (5.64%) GCP
12 29 (4.67%) IaaS
13 26 (4.19%) Azure Active Directory
13 26 (4.19%) Azure Storage
14 23 (3.70%) Azure Logic Apps
14 23 (3.70%) Dynamics 365
15 22 (3.54%) Snowflake
16 21 (3.38%) Amazon EMR
17 18 (2.90%) AWS CloudFormation
Communications & Networking
1 14 (2.25%) FTP
2 3 (0.48%) Firewall
3 2 (0.32%) Internet
4 1 (0.16%) Cisco ASA
4 1 (0.16%) DNS
4 1 (0.16%) SSL
4 1 (0.16%) Unified Communications
Database & Business Intelligence
1 236 (38.00%) Data Warehouse
2 159 (25.60%) Power BI
3 136 (21.90%) Big Data
4 116 (18.68%) Azure SQL Database
5 109 (17.55%) SQL Server
6 88 (14.17%) Hadoop
7 55 (8.86%) NoSQL
8 54 (8.70%) Relational Database
8 54 (8.70%) SQL Server Integration Services
9 47 (7.57%) Metadata
10 45 (7.25%) Tableau
11 40 (6.44%) Azure SQL Data Warehouse
12 39 (6.28%) SQL Server Reporting Services
13 34 (5.48%) SQL Server Analysis Services
14 30 (4.83%) PostgreSQL
15 29 (4.67%) Amazon Redshift
15 29 (4.67%) Apache Hive
16 28 (4.51%) MongoDB
17 27 (4.35%) Amazon Athena
17 27 (4.35%) RDBMS
Development Applications
1 55 (8.86%) Git (software)
2 33 (5.31%) JIRA
3 29 (4.67%) Jenkins
4 25 (4.03%) PowerDesigner
5 18 (2.90%) Visual Studio
6 12 (1.93%) Visual Studio Team System
7 11 (1.77%) ER Studio
7 11 (1.77%) kappa
7 11 (1.77%) Subversion
8 10 (1.61%) ERwin
9 7 (1.13%) GitLab
10 6 (0.97%) Cucumber
10 6 (0.97%) SpecFlow
11 5 (0.81%) Atlassian Bamboo
11 5 (0.81%) MLflow
11 5 (0.81%) Octopus Deploy
12 3 (0.48%) Selenium
12 3 (0.48%) Sonatype Nexus
12 3 (0.48%) Team Foundation Server
12 3 (0.48%) TeamCity
General
1 135 (21.74%) Finance
2 129 (20.77%) Social Skills
3 74 (11.92%) Analytical Skills
4 39 (6.28%) Banking
5 31 (4.99%) Presentation Skills
6 21 (3.38%) Marketing
7 17 (2.74%) Influencing Skills
8 11 (1.77%) Public Sector
9 10 (1.61%) Retail
10 8 (1.29%) Front Office
10 8 (1.29%) Legal
10 8 (1.29%) Retail Banking
11 7 (1.13%) Documentation Skills
11 7 (1.13%) Financial Institution
11 7 (1.13%) Investment Banking
12 6 (0.97%) Games
12 6 (0.97%) Law
13 5 (0.81%) Pharmaceutical
14 4 (0.64%) Manufacturing
15 3 (0.48%) Advertising
Job Titles
1 194 (31.24%) Data Engineer
2 127 (20.45%) Architect
3 110 (17.71%) Azure Engineer
4 78 (12.56%) Developer
5 66 (10.63%) Data Architect
6 52 (8.37%) Analyst
6 52 (8.37%) Solutions Architect
7 47 (7.57%) Azure Architect
8 30 (4.83%) Project Manager
9 29 (4.67%) Data Analyst
9 29 (4.67%) Senior Data Engineer
10 26 (4.19%) Azure Developer
10 26 (4.19%) DevOps Engineer
11 24 (3.86%) AWS Engineer
12 20 (3.22%) Consultant
13 18 (2.90%) Business Analyst
13 18 (2.90%) Business Intelligence Developer
13 18 (2.90%) Senior Architect
14 17 (2.74%) Azure DevOps Engineer
15 13 (2.09%) Python Engineer
Libraries, Frameworks & Software Standards
1 50 (8.05%) Kafka
2 49 (7.89%) .NET
3 43 (6.92%) JSON
4 40 (6.44%) PySpark
5 33 (5.31%) RESTful
6 24 (3.86%) XML
7 21 (3.38%) REST
8 18 (2.90%) .NET Framework
9 16 (2.58%) AngularJS
10 13 (2.09%) ASP.NET
10 13 (2.09%) Entity Framework
11 12 (1.93%) Web Services
12 11 (1.77%) SOAP
13 9 (1.45%) React
14 8 (1.29%) ASP.NET MVC
15 7 (1.13%) Lambda Expressions
16 6 (0.97%) Gherkin
16 6 (0.97%) pytest
16 6 (0.97%) RabbitMQ
16 6 (0.97%) Spark Streaming
Miscellaneous
1 27 (4.35%) Cloud Native
2 22 (3.54%) Data Structures
3 21 (3.38%) Virtual Team
4 16 (2.58%) Self-Motivation
5 14 (2.25%) Enterprise Software
6 13 (2.09%) Data Protection Act
7 12 (1.93%) Greenfield Project
8 10 (1.61%) Reference Data
9 9 (1.45%) Market Risk
10 8 (1.29%) Algorithms
10 8 (1.29%) Legacy Applications
10 8 (1.29%) Management Information System
10 8 (1.29%) User Experience
11 7 (1.13%) Hybrid Cloud
11 7 (1.13%) Public Cloud
12 6 (0.97%) Derivative
13 5 (0.81%) FMCG
14 4 (0.64%) Hedge funds
14 4 (0.64%) Legacy Systems
14 4 (0.64%) Replication
Operating Systems
1 17 (2.74%) Linux
2 9 (1.45%) Unix
3 7 (1.13%) Windows
4 3 (0.48%) Debian
4 3 (0.48%) Red Hat Enterprise Linux
4 3 (0.48%) Ubuntu
5 1 (0.16%) VMS
Processes & Methodologies
1 230 (37.04%) Business Intelligence
2 227 (36.55%) Agile Software Development
3 209 (33.66%) DevOps
4 194 (31.24%) Data Modelling
5 192 (30.92%) Analytics
6 138 (22.22%) ETL
7 105 (16.91%) Scrum
8 101 (16.26%) Data Engineering
9 90 (14.49%) Data Pipeline
10 80 (12.88%) Data Science
10 80 (12.88%) Migration
11 74 (11.92%) Data Architecture
12 69 (11.11%) Data Management
13 68 (10.95%) Data Integration
14 60 (9.66%) Data Analysis
14 60 (9.66%) Stakeholder Management
15 57 (9.18%) Visualisation
16 56 (9.02%) Problem-Solving
17 53 (8.53%) Data Ingestion
17 53 (8.53%) Data Transformation
Programming Languages
1 298 (47.99%) SQL
2 199 (32.05%) Python
3 64 (10.31%) Java
4 61 (9.82%) C#
5 45 (7.25%) T-SQL
6 39 (6.28%) Scala
7 36 (5.80%) PowerShell
8 31 (4.99%) JavaScript
9 16 (2.58%) PL/SQL
10 14 (2.25%) Data Analysis Expressions (DAX)
10 14 (2.25%) R
11 11 (1.77%) Bash Shell
12 7 (1.13%) COBOL
13 6 (0.97%) C
13 6 (0.97%) Perl
13 6 (0.97%) PHP
13 6 (0.97%) U-SQL
14 5 (0.81%) C++
14 5 (0.81%) Go
14 5 (0.81%) Shell Script
Qualifications
1 44 (7.09%) Degree
2 13 (2.09%) Security Cleared
3 12 (1.93%) Computer Science Degree
3 12 (1.93%) SC Cleared
4 10 (1.61%) Master's Degree
5 6 (0.97%) AWS Certification
6 4 (0.64%) Microsoft Certification
7 1 (0.16%) BPSS Clearance
7 1 (0.16%) CBAP
7 1 (0.16%) CCA
7 1 (0.16%) CISA
7 1 (0.16%) CISM
7 1 (0.16%) CISSP
7 1 (0.16%) CompTIA Security+
7 1 (0.16%) ISTQB
7 1 (0.16%) MCSA
7 1 (0.16%) MCSE
7 1 (0.16%) PMI Certification
7 1 (0.16%) SSCP
7 1 (0.16%) TOGAF Certification
Quality Assurance & Compliance
1 42 (6.76%) Data Quality
2 20 (3.22%) QA
3 18 (2.90%) GDPR
4 11 (1.77%) Sarbanes-Oxley
5 5 (0.81%) PMO
6 3 (0.48%) COBIT
6 3 (0.48%) PCI DSS
7 2 (0.32%) IFRS
7 2 (0.32%) ISO/IEC 27001
7 2 (0.32%) NCSC
7 2 (0.32%) NIST
7 2 (0.32%) PSD2
8 1 (0.16%) Cyber Essentials
8 1 (0.16%) Solvency II
System Software
1 24 (3.86%) Active Directory
2 21 (3.38%) Docker
3 11 (1.77%) HDFS
4 2 (0.32%) Virtual Machines
5 1 (0.16%) VMware Infrastructure
Systems Management
1 47 (7.57%) Kubernetes
2 33 (5.31%) Terraform
3 13 (2.09%) Ansible
4 7 (1.13%) Hadoop YARN
5 6 (0.97%) Oozie
6 3 (0.48%) Opscode Chef
6 3 (0.48%) Puppet
6 3 (0.48%) Single Sign-On
7 2 (0.32%) Active Directory Federation Services
7 2 (0.32%) Kibana
7 2 (0.32%) Kubeflow
7 2 (0.32%) logstash
8 1 (0.16%) Control-M
8 1 (0.16%) FortiGate
8 1 (0.16%) Grafana
8 1 (0.16%) Microsoft Clustering
8 1 (0.16%) Prometheus
8 1 (0.16%) Salt
Vendors
1 254 (40.90%) Databricks
2 169 (27.21%) Microsoft
3 37 (5.96%) Oracle
4 32 (5.15%) SAP
5 30 (4.83%) Salesforce.com
6 23 (3.70%) Google
7 21 (3.38%) BiZZdesign
8 17 (2.74%) Cloudera
9 16 (2.58%) Alteryx
9 16 (2.58%) Informatica
9 16 (2.58%) MuleSoft
10 14 (2.25%) Teradata
11 9 (1.45%) Splunk
12 8 (1.29%) AppDynamics
13 7 (1.13%) Talend
13 7 (1.13%) Workday
14 6 (0.97%) Hortonworks
14 6 (0.97%) IBM
15 5 (0.81%) Netezza
16 4 (0.64%) Red Hat