Period
to 23 January 2022

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 23 January 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
England > London
6 months to
23 Jan 2022
Same period 2021 Same period 2020
Rank 163 189 206
Rank change year-on-year +26 +17 +96
Contract jobs citing Data Lake 655 232 387
As % of all contract jobs advertised in London 1.78% 1.32% 1.28%
As % of the Database & Business Intelligence category 7.67% 5.61% 5.38%
Number of daily rates quoted 430 171 302
10th Percentile £425 £400 £413
25th Percentile £500 £463 £467
Median daily rate (50th Percentile) £575 £550 £550
Median % change year-on-year +4.55% - +4.76%
75th Percentile £663 £625 £638
90th Percentile £725 £700 £700
England median daily rate £575 £525 £525
% change year-on-year +9.52% - -
Number of hourly rates quoted 0 1 0
Median hourly rate - £66.50 -
England median hourly rate - £66.50 £72.50
% change year-on-year - -8.28% +195.92%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,541 4,133 7,196
As % of all contract IT jobs advertised in London 23.17% 23.48% 23.88%
Number of daily rates quoted 6,356 2,975 5,231
10th Percentile £400 £350 £363
25th Percentile £488 £425 £425
Median daily rate (50th Percentile) £575 £525 £525
Median % change year-on-year +9.52% - -
75th Percentile £675 £619 £613
90th Percentile £763 £700 £700
England median daily rate £540 £488 £475
% change year-on-year +10.77% +2.63% -
Number of hourly rates quoted 42 25 37
10th Percentile £24.50 £21.40 £16.95
25th Percentile £26.00 £30.25 £25.00
Median hourly rate £36.88 £47.50 £32.50
Median % change year-on-year -22.36% +46.15% +17.69%
75th Percentile £60.75 £63.75 £48.63
90th Percentile £65.00 £68.00 £54.45
England median hourly rate £43.85 £26.00 £26.50
% change year-on-year +68.65% -1.89% -8.32%

Data Lake
Job Vacancy Trend in London

Job postings citing Data Lake as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Lake in London

Data Lake
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Lake in London.

Daily rate trend for Data Lake in London

Data Lake
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Lake in London over the 6 months to 23 January 2022.

Daily rate histogram for Data Lake in London

Data Lake
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Lake in London.

Hourly rate trend for Data Lake in London

Data Lake
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the London region over the 6 months to 23 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London -26 57 £575 -4.17% 38
West London -1 23 £615 +8.85% 2
South London -5 7 £540 -13.60% 1
East London - 1 £650 - 8
Data Lake
England

For the 6 months to 23 January 2022, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Lake.

1 403 (61.53%) Azure
2 283 (43.21%) Data Warehouse
3 261 (39.85%) SQL
4 244 (37.25%) Agile Software Development
5 240 (36.64%) Databricks
6 219 (33.44%) Analytics
7 214 (32.67%) Business Intelligence
8 209 (31.91%) Azure Data Factory
9 206 (31.45%) Python
10 203 (30.99%) Data Modelling
11 197 (30.08%) DevOps
12 190 (29.01%) ETL
13 178 (27.18%) AWS
14 167 (25.50%) Big Data
14 167 (25.50%) Finance
15 156 (23.82%) Power Platform
16 149 (22.75%) Power BI
17 142 (21.68%) Microsoft
18 139 (21.22%) Social Skills
19 131 (20.00%) CI/CD
20 123 (18.78%) SQL Server
21 107 (16.34%) Apache Spark
22 100 (15.27%) Scrum
23 93 (14.20%) Data Analysis
24 92 (14.05%) Data Integration
24 92 (14.05%) Data Engineering
25 90 (13.74%) Data Pipeline
26 85 (12.98%) Data Quality
27 82 (12.52%) Data Architecture
28 80 (12.21%) C#

Data Lake
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 107 (16.34%) Apache Spark
2 36 (5.50%) Apache Airflow
3 35 (5.34%) Apache
4 18 (2.75%) Confluence
5 10 (1.53%) Elasticsearch
6 7 (1.07%) SharePoint
7 6 (0.92%) Apache Pig
7 6 (0.92%) nginx
8 5 (0.76%) BizTalk Server
9 4 (0.61%) SAS
10 3 (0.46%) Jupyter
11 2 (0.31%) Luigi
12 1 (0.15%) Apache Synapse
12 1 (0.15%) Camunda
12 1 (0.15%) JBoss
Applications
1 15 (2.29%) Microsoft Excel
2 3 (0.46%) SPSS
3 2 (0.31%) Microsoft PowerPoint
3 2 (0.31%) Spreadsheet
4 1 (0.15%) MS Visio
Business Applications
1 7 (1.07%) Dynamics CRM
2 3 (0.46%) SAP CO
2 3 (0.46%) SAP FI
2 3 (0.46%) SAP FI/CO
3 2 (0.31%) Dynamics AX
3 2 (0.31%) SAP ERP
3 2 (0.31%) SAP Oil and Gas
3 2 (0.31%) SAP S/4HANA
3 2 (0.31%) SAP SD
3 2 (0.31%) Sparx Enterprise Architect
4 1 (0.15%) NetSuite
4 1 (0.15%) Primavera
Cloud Services
1 403 (61.53%) Azure
2 209 (31.91%) Azure Data Factory
3 178 (27.18%) AWS
4 156 (23.82%) Power Platform
5 73 (11.15%) Serverless
6 68 (10.38%) Azure Synapse Analytics
7 63 (9.62%) Amazon S3
8 55 (8.40%) Azure Cosmos DB
9 39 (5.95%) Snowflake
10 36 (5.50%) PaaS
11 33 (5.04%) Amazon EMR
11 33 (5.04%) AWS Lambda
12 32 (4.89%) Azure Functions
12 32 (4.89%) Azure Logic Apps
13 26 (3.97%) GCP
14 25 (3.82%) Collibra
15 24 (3.66%) Azure Storage
16 23 (3.51%) AWS CloudFormation
16 23 (3.51%) Azure Monitor
17 22 (3.36%) Azure Active Directory
Communications & Networking
1 10 (1.53%) FTP
2 5 (0.76%) Cisco IPT
2 5 (0.76%) IPFS
3 3 (0.46%) Firewall
3 3 (0.46%) Network Security
4 1 (0.15%) DKIM
4 1 (0.15%) DNS
4 1 (0.15%) HTTP
4 1 (0.15%) Internet
4 1 (0.15%) Intrusion Detection
Database & Business Intelligence
1 283 (43.21%) Data Warehouse
2 167 (25.50%) Big Data
3 149 (22.75%) Power BI
4 123 (18.78%) SQL Server
5 77 (11.76%) Azure SQL Database
6 74 (11.30%) Hadoop
7 70 (10.69%) NoSQL
8 65 (9.92%) Relational Database
9 62 (9.47%) Tableau
10 55 (8.40%) Amazon Redshift
10 55 (8.40%) Metadata
11 48 (7.33%) SQL Server Integration Services
12 41 (6.26%) Amazon Athena
13 38 (5.80%) PostgreSQL
14 37 (5.65%) Azure SQL Data Warehouse
15 36 (5.50%) RDBMS
16 29 (4.43%) SQL Server Analysis Services
17 26 (3.97%) MongoDB
18 25 (3.82%) SQL Server Reporting Services
19 21 (3.21%) Apache Hive
Development Applications
1 50 (7.63%) Git (software)
2 38 (5.80%) Jenkins
3 37 (5.65%) JIRA
4 32 (4.89%) PowerDesigner
5 25 (3.82%) kappa
6 21 (3.21%) ER Studio
6 21 (3.21%) Visual Studio
7 17 (2.60%) ERwin
8 13 (1.98%) Visual Studio Team System
9 12 (1.83%) GitLab
10 11 (1.68%) Subversion
11 7 (1.07%) TeamCity
12 6 (0.92%) CircleCI
13 5 (0.76%) Atlassian Bamboo
13 5 (0.76%) Maven
14 4 (0.61%) Bitbucket
14 4 (0.61%) Selenium
15 3 (0.46%) MLflow
15 3 (0.46%) Team Foundation Server
16 2 (0.31%) Cucumber
General
1 167 (25.50%) Finance
2 139 (21.22%) Social Skills
3 62 (9.47%) Analytical Skills
4 55 (8.40%) Banking
5 37 (5.65%) Presentation Skills
6 27 (4.12%) Marketing
7 22 (3.36%) Investment Banking
8 17 (2.60%) Influencing Skills
8 17 (2.60%) Public Sector
9 14 (2.14%) Financial Institution
9 14 (2.14%) Front Office
10 12 (1.83%) Legal
11 10 (1.53%) Law
11 10 (1.53%) Retail
12 9 (1.37%) Manufacturing
13 7 (1.07%) Documentation Skills
13 7 (1.07%) Telecoms
14 6 (0.92%) Electronics
15 5 (0.76%) Retail Banking
16 4 (0.61%) Organisational Skills
Job Titles
1 217 (33.13%) Data Engineer
2 143 (21.83%) Architect
3 94 (14.35%) Azure Engineer
3 94 (14.35%) Developer
4 92 (14.05%) Data Architect
5 57 (8.70%) Solutions Architect
6 46 (7.02%) Analyst
7 35 (5.34%) Azure Architect
8 34 (5.19%) Python Engineer
9 32 (4.89%) AWS Engineer
10 28 (4.27%) Azure Developer
11 27 (4.12%) Data Analyst
12 26 (3.97%) Senior Data Engineer
13 25 (3.82%) Business Intelligence Developer
14 22 (3.36%) Project Manager
15 21 (3.21%) Data Modeller
16 20 (3.05%) Cloud Engineer
17 18 (2.75%) Business Analyst
18 17 (2.60%) DevOps Engineer
19 15 (2.29%) Power BI Developer
Libraries, Frameworks & Software Standards
1 74 (11.30%) Kafka
2 49 (7.48%) .NET
3 48 (7.33%) PySpark
4 36 (5.50%) JSON
5 23 (3.51%) REST
5 23 (3.51%) XML
6 19 (2.90%) RESTful
7 14 (2.14%) ARM Templates
8 13 (1.98%) .NET Framework
9 12 (1.83%) Web Services
10 10 (1.53%) AngularJS
10 10 (1.53%) React
10 10 (1.53%) Spark Streaming
11 9 (1.37%) SOAP
12 8 (1.22%) Apache NiFi
12 8 (1.22%) ASP.NET
13 7 (1.07%) Entity Framework
13 7 (1.07%) MDX
14 6 (0.92%) ASP.NET MVC
14 6 (0.92%) Node.js
Miscellaneous
1 24 (3.66%) Virtual Team
2 20 (3.05%) Data Structures
3 17 (2.60%) Cloud Native
3 17 (2.60%) User Experience
4 15 (2.29%) Reference Data
5 14 (2.14%) Enterprise Software
5 14 (2.14%) Public Cloud
6 13 (1.98%) Data Protection Act
7 12 (1.83%) Hedge funds
8 11 (1.68%) Self-Motivation
9 10 (1.53%) Management Information System
10 8 (1.22%) Data Centre
10 8 (1.22%) Greenfield Project
10 8 (1.22%) Market Risk
11 7 (1.07%) FMCG
11 7 (1.07%) Legacy Systems
12 6 (0.92%) Algorithms
12 6 (0.92%) NVMe
13 5 (0.76%) Data Fabric
14 4 (0.61%) Linux Command Line
Operating Systems
1 32 (4.89%) Linux
2 9 (1.37%) Unix
2 9 (1.37%) Windows
3 2 (0.31%) Red Hat Enterprise Linux
Processes & Methodologies
1 244 (37.25%) Agile Software Development
2 219 (33.44%) Analytics
3 214 (32.67%) Business Intelligence
4 203 (30.99%) Data Modelling
5 197 (30.08%) DevOps
6 190 (29.01%) ETL
7 131 (20.00%) CI/CD
8 100 (15.27%) Scrum
9 93 (14.20%) Data Analysis
10 92 (14.05%) Data Engineering
10 92 (14.05%) Data Integration
11 90 (13.74%) Data Pipeline
12 82 (12.52%) Data Architecture
13 70 (10.69%) Data Science
13 70 (10.69%) Migration
14 69 (10.53%) Data Management
15 61 (9.31%) Microservices
16 60 (9.16%) Data Governance
17 58 (8.85%) Visualisation
18 55 (8.40%) SDLC
Programming Languages
1 261 (39.85%) SQL
2 206 (31.45%) Python
3 80 (12.21%) C#
4 70 (10.69%) Java
5 66 (10.08%) PowerShell
6 35 (5.34%) Scala
6 35 (5.34%) T-SQL
7 31 (4.73%) Bash
8 24 (3.66%) Data Analysis Expressions (DAX)
9 18 (2.75%) JavaScript
10 13 (1.98%) R
11 11 (1.68%) PL/SQL
12 7 (1.07%) Shell Script
13 5 (0.76%) Kotlin
14 4 (0.61%) VB
15 3 (0.46%) COBOL
15 3 (0.46%) Go
15 3 (0.46%) Perl
16 2 (0.31%) PHP
16 2 (0.31%) U-SQL
Qualifications
1 32 (4.89%) Degree
2 20 (3.05%) Security Cleared
3 15 (2.29%) AWS Certification
4 12 (1.83%) SC Cleared
5 11 (1.68%) Computer Science Degree
5 11 (1.68%) Master's Degree
6 5 (0.76%) (ISC)2 CCSP
6 5 (0.76%) Cisco Certification
6 5 (0.76%) CISSP
7 4 (0.61%) Microsoft Certification
7 4 (0.61%) PMI Certification
8 3 (0.46%) FFIEC
8 3 (0.46%) PMP
9 2 (0.31%) DV Cleared
9 2 (0.31%) ISTQB
9 2 (0.31%) TOGAF Certification
10 1 (0.15%) CBAP
10 1 (0.15%) IBM Certification
10 1 (0.15%) ITIL Certification
10 1 (0.15%) PRINCE2 Certification
Quality Assurance & Compliance
1 85 (12.98%) Data Quality
2 22 (3.36%) GDPR
3 20 (3.05%) QA
4 14 (2.14%) Accessibility
5 9 (1.37%) SLA
6 7 (1.07%) Sarbanes-Oxley
7 4 (0.61%) NIST
8 3 (0.46%) GLBA
8 3 (0.46%) NIST 800
8 3 (0.46%) PCI DSS
9 2 (0.31%) IFRS
9 2 (0.31%) ISO 13485
9 2 (0.31%) ISO/IEC 17025
9 2 (0.31%) ISO/IEC 27001
9 2 (0.31%) NCSC
10 1 (0.15%) GMP
10 1 (0.15%) PMO
10 1 (0.15%) Solvency II
System Software
1 38 (5.80%) Docker
2 22 (3.36%) Active Directory
3 11 (1.68%) HDFS
4 8 (1.22%) Virtual Machines
5 3 (0.46%) Apache Flume
5 3 (0.46%) Virtual Desktop
6 1 (0.15%) Apache ZooKeeper
6 1 (0.15%) Snort
6 1 (0.15%) VMware Infrastructure
Systems Management
1 52 (7.94%) Terraform
2 45 (6.87%) Kubernetes
3 17 (2.60%) Ansible
4 7 (1.07%) Grafana
4 7 (1.07%) Opscode Chef
4 7 (1.07%) Prometheus
5 4 (0.61%) Oozie
6 2 (0.31%) Control-M
6 2 (0.31%) Hadoop YARN
7 1 (0.15%) Active Directory Federation Services
7 1 (0.15%) Host Intrusion Detection System
7 1 (0.15%) Kubeflow
7 1 (0.15%) Microsoft Clustering
7 1 (0.15%) Puppet
Vendors
1 240 (36.64%) Databricks
2 142 (21.68%) Microsoft
3 41 (6.26%) Oracle
4 30 (4.58%) SAP
5 27 (4.12%) BiZZdesign
6 24 (3.66%) Google
7 22 (3.36%) Salesforce.com
8 18 (2.75%) Informatica
8 18 (2.75%) Teradata
9 17 (2.60%) Talend
10 16 (2.44%) Cloudera
11 14 (2.14%) Alteryx
12 13 (1.98%) MuleSoft
13 10 (1.53%) ServiceNow
14 8 (1.22%) Splunk
15 7 (1.07%) AppDynamics
16 6 (0.92%) Adobe
16 6 (0.92%) Workday
17 5 (0.76%) Netezza
18 3 (0.46%) IBM