Period
to

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 25 May 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
25 May 2022
Same period 2021 Same period 2020
Rank 222 193 224
Rank change year-on-year -29 +31 +94
Contract jobs citing Data Lake 860 646 509
As % of all contract jobs advertised in England 1.22% 1.39% 1.19%
As % of the Database & Business Intelligence category 6.30% 6.57% 5.43%
Number of daily rates quoted 578 441 376
10th Percentile £421 £396 £396
25th Percentile £508 £450 £439
Median daily rate (50th Percentile) £590 £525 £525
Median % change year-on-year +12.38% - -
75th Percentile £699 £606 £600
90th Percentile £775 £675 £675
UK median daily rate £575 £525 £525
% change year-on-year +9.52% - -
Number of hourly rates quoted 4 3 3
10th Percentile - £26.35 £26.00
25th Percentile - £30.25 £37.63
Median hourly rate £35.00 £44.50 £59.00
Median % change year-on-year -21.35% -24.58% +140.82%
75th Percentile £45.94 £65.02 £66.13
90th Percentile £65.63 £72.68 £69.20
UK median hourly rate £35.00 £44.75 £59.00
% change year-on-year -21.79% -24.15% +140.82%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 13,640 9,837 9,378
As % of all contract IT jobs advertised in England 19.37% 21.12% 21.92%
Number of daily rates quoted 9,893 6,814 6,531
10th Percentile £363 £325 £325
25th Percentile £450 £413 £406
Median daily rate (50th Percentile) £550 £500 £500
Median % change year-on-year +10.00% - +2.56%
75th Percentile £653 £600 £588
90th Percentile £750 £700 £675
UK median daily rate £550 £500 £488
% change year-on-year +10.00% +2.56% +2.63%
Number of hourly rates quoted 163 173 133
10th Percentile £14.25 £11.40 £14.40
25th Percentile £21.38 £18.25 £18.25
Median hourly rate £42.50 £24.50 £25.00
Median % change year-on-year +73.47% -2.00% -16.67%
75th Percentile £64.18 £48.75 £46.00
90th Percentile £75.00 £64.90 £60.40
UK median hourly rate £44.48 £26.73 £24.71
% change year-on-year +66.39% +8.17% -13.30%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Lake in England.

Daily rate trend for Data Lake in England

Data Lake
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Lake in England over the 6 months to 25 May 2022.

Daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Lake in England.

Hourly rate trend for Data Lake in England

Data Lake
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Lake in England over the 6 months to 25 May 2022.

Hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 25 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London -20 577 £600 +9.09% 75
South East -22 85 £600 +14.29% 17
North of England -42 59 £575 +15.00% 9
Midlands -19 52 £500 +17.65% 12
West Midlands -14 41 £475 -5.00% 8
North West -37 31 £569 +8.33% 6
Yorkshire -39 27 £600 +29.73% 2
East of England -19 17 £500 +11.11% 11
South West -39 11 £525 -7.08% 5
East Midlands -27 10 £625 +51.52% 4
North East - 1 £530 - 1
Data Lake
UK

For the 6 months to 25 May 2022, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 537 (62.44%) Azure
2 406 (47.21%) Data Warehouse
3 331 (38.49%) SQL
4 322 (37.44%) Analytics
5 311 (36.16%) Azure Data Factory
6 302 (35.12%) Python
7 295 (34.30%) Databricks
8 292 (33.95%) ETL
9 287 (33.37%) Agile
10 252 (29.30%) Data Modelling
11 251 (29.19%) DevOps
12 235 (27.33%) Business Intelligence
13 227 (26.40%) AWS
14 217 (25.23%) Big Data
14 217 (25.23%) Power Platform
15 206 (23.95%) Finance
16 196 (22.79%) Power BI
17 163 (18.95%) Microsoft
18 156 (18.14%) Social Skills
18 156 (18.14%) CI/CD
19 154 (17.91%) Data Analysis
20 149 (17.33%) SQL Server
21 140 (16.28%) Azure Synapse Analytics
22 137 (15.93%) Data Integration
23 136 (15.81%) Data Engineering
23 136 (15.81%) Apache Spark
24 128 (14.88%) Data Pipeline
25 122 (14.19%) Data Architecture
25 122 (14.19%) Migration
26 108 (12.56%) Data Management

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 136 (15.81%) Apache Spark
2 31 (3.60%) Apache
3 24 (2.79%) Apache Airflow
4 12 (1.40%) SharePoint
5 11 (1.28%) Confluence
6 8 (0.93%) Elasticsearch
7 6 (0.70%) SAS
8 5 (0.58%) Apache Pig
9 3 (0.35%) Jupyter
10 2 (0.23%) IBM HTTP Server
10 2 (0.23%) Oracle Coherence
10 2 (0.23%) Oracle Workflow
11 1 (0.12%) Apache Synapse
Applications
1 16 (1.86%) Microsoft Excel
2 5 (0.58%) SPSS
3 4 (0.47%) Microsoft Office
3 4 (0.47%) Microsoft PowerPoint
4 3 (0.35%) Spreadsheet
5 2 (0.23%) MS Visio
Business Applications
1 12 (1.40%) Dynamics CRM
1 12 (1.40%) SAP Oil and Gas
2 9 (1.05%) Sparx Enterprise Architect
3 8 (0.93%) Oracle Financials
4 4 (0.47%) SAP S/4HANA
5 3 (0.35%) Dynamics AX
6 2 (0.23%) SAP CO
6 2 (0.23%) SAP FI
6 2 (0.23%) SAP FI/CO
7 1 (0.12%) NetSuite
7 1 (0.12%) SAP BPC
Cloud Services
1 537 (62.44%) Azure
2 311 (36.16%) Azure Data Factory
3 227 (26.40%) AWS
4 217 (25.23%) Power Platform
5 140 (16.28%) Azure Synapse Analytics
6 108 (12.56%) Serverless
7 69 (8.02%) Amazon S3
8 68 (7.91%) Snowflake
9 56 (6.51%) GCP
10 55 (6.40%) Azure Cosmos DB
11 51 (5.93%) Azure Functions
12 49 (5.70%) AWS Lambda
13 45 (5.23%) PaaS
14 34 (3.95%) Azure Logic Apps
15 33 (3.84%) PowerApps
16 30 (3.49%) Azure Monitor
17 29 (3.37%) GitHub
18 25 (2.91%) Amazon Kinesis
19 23 (2.67%) IaaS
19 23 (2.67%) Power Automate
Communications & Networking
1 6 (0.70%) FTP
2 5 (0.58%) LAN
2 5 (0.58%) SSH
2 5 (0.58%) WAN
3 3 (0.35%) Firewall
3 3 (0.35%) IPFS
3 3 (0.35%) VPN
4 2 (0.23%) AMQP
4 2 (0.23%) Cisco IPT
4 2 (0.23%) Cisco Nexus
4 2 (0.23%) HTTP
4 2 (0.23%) MVNO
4 2 (0.23%) NGFW
4 2 (0.23%) SSL
4 2 (0.23%) Wi-Fi
5 1 (0.12%) DKIM
5 1 (0.12%) Intrusion Detection
5 1 (0.12%) Kerberos
Database & Business Intelligence
1 406 (47.21%) Data Warehouse
2 217 (25.23%) Big Data
3 196 (22.79%) Power BI
4 149 (17.33%) SQL Server
5 95 (11.05%) Azure SQL Database
6 94 (10.93%) NoSQL
7 89 (10.35%) Relational Database
8 66 (7.67%) SQL Server Integration Services
9 62 (7.21%) Metadata
10 54 (6.28%) Hadoop
11 47 (5.47%) Azure SQL Data Warehouse
12 45 (5.23%) PostgreSQL
12 45 (5.23%) RDBMS
12 45 (5.23%) Tableau
13 44 (5.12%) SQL Server Analysis Services
14 41 (4.77%) Amazon Athena
15 40 (4.65%) Amazon Redshift
16 35 (4.07%) SQL Server Reporting Services
17 34 (3.95%) MongoDB
18 30 (3.49%) Neo4j
Development Applications
1 49 (5.70%) kappa
2 47 (5.47%) Git (software)
3 34 (3.95%) PowerDesigner
4 33 (3.84%) JIRA
5 31 (3.60%) ERwin
6 26 (3.02%) Jenkins
7 20 (2.33%) Visual Studio
8 19 (2.21%) ER Studio
9 10 (1.16%) Subversion
10 8 (0.93%) GitLab
11 6 (0.70%) Maven
11 6 (0.70%) SonarQube
11 6 (0.70%) Visual Studio Team System
12 5 (0.58%) Selenium
13 4 (0.47%) Cucumber
13 4 (0.47%) HP UFT
13 4 (0.47%) JBehave
13 4 (0.47%) SQL Server Management Studio (SSMS)
13 4 (0.47%) TestComplete
13 4 (0.47%) Visual Studio Coded UI
General
1 206 (23.95%) Finance
2 156 (18.14%) Social Skills
3 62 (7.21%) Analytical Skills
4 55 (6.40%) Banking
5 40 (4.65%) Marketing
6 38 (4.42%) Public Sector
7 22 (2.56%) Presentation Skills
7 22 (2.56%) Telecoms
8 21 (2.44%) Legal
9 19 (2.21%) Front Office
10 18 (2.09%) Investment Banking
11 16 (1.86%) Manufacturing
12 14 (1.63%) Financial Institution
12 14 (1.63%) Law
13 13 (1.51%) Electronics
14 11 (1.28%) Retail
15 10 (1.16%) Automotive
15 10 (1.16%) Influencing Skills
16 9 (1.05%) Documentation Skills
16 9 (1.05%) Pharmaceutical
Job Titles
1 315 (36.63%) Data Engineer
2 230 (26.74%) Architect
3 158 (18.37%) Data Architect
4 128 (14.88%) Azure Engineer
5 85 (9.88%) Developer
6 65 (7.56%) Solutions Architect
7 48 (5.58%) Analyst
8 43 (5.00%) Python Engineer
9 37 (4.30%) Senior Data Engineer
10 33 (3.84%) AWS Engineer
11 32 (3.72%) Azure Architect
11 32 (3.72%) Data Analyst
12 30 (3.49%) Project Manager
13 29 (3.37%) Business Intelligence Developer
14 28 (3.26%) Azure Developer
15 25 (2.91%) Data Modeller
15 25 (2.91%) Lead Architect
16 24 (2.79%) Cloud Engineer
17 22 (2.56%) DevOps Engineer
18 20 (2.33%) Consultant
Libraries, Frameworks & Software Standards
1 88 (10.23%) Kafka
2 40 (4.65%) .NET
3 39 (4.53%) PySpark
4 23 (2.67%) React
5 20 (2.33%) Spark Streaming
6 18 (2.09%) JSON
6 18 (2.09%) Pandas
7 17 (1.98%) ARM Templates
8 15 (1.74%) REST
9 13 (1.51%) Web Services
10 10 (1.16%) Flask
11 9 (1.05%) AngularJS
11 9 (1.05%) Apache NiFi
12 8 (0.93%) ADO
12 8 (0.93%) MDX
12 8 (0.93%) RESTful
12 8 (0.93%) YAML
13 7 (0.81%) NumPy
13 7 (0.81%) TensorFlow
14 6 (0.70%) .NET Core
Miscellaneous
1 37 (4.30%) Data Protection Act
2 36 (4.19%) Management Information System
3 33 (3.84%) Data Structures
3 33 (3.84%) Virtual Team
4 31 (3.60%) Public Cloud
5 28 (3.26%) Cloud Native
6 26 (3.02%) Legacy Systems
7 20 (2.33%) Enterprise Software
8 16 (1.86%) Greenfield Project
9 15 (1.74%) Reference Data
10 13 (1.51%) IoT
10 13 (1.51%) Linux Command Line
11 12 (1.40%) Hedge funds
12 10 (1.16%) Algorithms
13 9 (1.05%) Blockchain
13 9 (1.05%) Renewable Energy
13 9 (1.05%) User Experience
14 8 (0.93%) Credit Risk
14 8 (0.93%) Hybrid Cloud
15 7 (0.81%) Self-Motivation
Operating Systems
1 33 (3.84%) Linux
2 4 (0.47%) Unix
2 4 (0.47%) VMS
3 3 (0.35%) Windows
4 1 (0.12%) Debian
4 1 (0.12%) Red Hat Enterprise Linux
4 1 (0.12%) Ubuntu
Processes & Methodologies
1 322 (37.44%) Analytics
2 292 (33.95%) ETL
3 287 (33.37%) Agile
4 252 (29.30%) Data Modelling
5 251 (29.19%) DevOps
6 235 (27.33%) Business Intelligence
7 156 (18.14%) CI/CD
8 154 (17.91%) Data Analysis
9 137 (15.93%) Data Integration
10 136 (15.81%) Data Engineering
11 128 (14.88%) Data Pipeline
12 122 (14.19%) Data Architecture
12 122 (14.19%) Migration
13 108 (12.56%) Data Management
14 98 (11.40%) Scrum
15 87 (10.12%) Microservices
16 81 (9.42%) Data Science
17 79 (9.19%) Enterprise Architecture
17 79 (9.19%) Visualisation
18 77 (8.95%) Data Governance
Programming Languages
1 331 (38.49%) SQL
2 302 (35.12%) Python
3 103 (11.98%) Java
4 96 (11.16%) C#
5 61 (7.09%) PowerShell
6 39 (4.53%) Scala
7 38 (4.42%) T-SQL
8 37 (4.30%) Bash
9 31 (3.60%) R
10 26 (3.02%) JavaScript
11 24 (2.79%) Data Analysis Expressions (DAX)
12 11 (1.28%) Shell Script
13 10 (1.16%) PL/SQL
14 5 (0.58%) Bicep
15 4 (0.47%) Go
15 4 (0.47%) VBScript
16 3 (0.35%) C
16 3 (0.35%) C++
17 2 (0.23%) Perl
17 2 (0.23%) U-SQL
Qualifications
1 70 (8.14%) Security Cleared
2 45 (5.23%) SC Cleared
3 38 (4.42%) Degree
4 19 (2.21%) AWS Certification
5 13 (1.51%) Master's Degree
6 10 (1.16%) FFIEC
6 10 (1.16%) PMI Certification
7 9 (1.05%) Computer Science Degree
7 9 (1.05%) PMP
8 8 (0.93%) PhD
9 5 (0.58%) DV Cleared
9 5 (0.58%) TOGAF Certification
10 3 (0.35%) ACCA
10 3 (0.35%) CIMA
10 3 (0.35%) CISSP
11 2 (0.23%) (ISC)2 CCSP
11 2 (0.23%) BPSS Clearance
11 2 (0.23%) Cisco Certification
11 2 (0.23%) CTC Cleared
11 2 (0.23%) Microsoft Certification
Quality Assurance & Compliance
1 107 (12.44%) Data Quality
2 30 (3.49%) QA
3 21 (2.44%) GDPR
4 16 (1.86%) Accessibility
5 11 (1.28%) NIST
6 10 (1.16%) GLBA
6 10 (1.16%) PCI DSS
7 5 (0.58%) GxP
7 5 (0.58%) SLA
8 4 (0.47%) PMO
9 3 (0.35%) ISO/IEC 27001
9 3 (0.35%) Sarbanes-Oxley
10 2 (0.23%) ISO 13485
10 2 (0.23%) ISO/IEC 17025
10 2 (0.23%) NIST 800
11 1 (0.12%) Disclosure Scotland
11 1 (0.12%) GMP
11 1 (0.12%) IFRS
System Software
1 48 (5.58%) Docker
2 20 (2.33%) Virtual Machines
3 12 (1.40%) Active Directory
4 9 (1.05%) HDFS
5 1 (0.12%) Apache ZooKeeper
5 1 (0.12%) Snort
Systems Management
1 68 (7.91%) Terraform
2 39 (4.53%) Kubernetes
3 8 (0.93%) Ansible
4 4 (0.47%) Control-M
5 3 (0.35%) Puppet
6 2 (0.23%) Kibana
6 2 (0.23%) logstash
6 2 (0.23%) Microsoft Intune
6 2 (0.23%) Nessus
6 2 (0.23%) Opscode Chef
6 2 (0.23%) SCCM
6 2 (0.23%) SCOM
7 1 (0.12%) Grafana
7 1 (0.12%) Hadoop YARN
7 1 (0.12%) Host Intrusion Detection System
7 1 (0.12%) Kubeflow
7 1 (0.12%) QRadar
Vendors
1 295 (34.30%) Databricks
2 163 (18.95%) Microsoft
3 64 (7.44%) Oracle
4 57 (6.63%) SAP
5 37 (4.30%) Google
6 33 (3.84%) Talend
7 32 (3.72%) BiZZdesign
7 32 (3.72%) Informatica
8 26 (3.02%) Salesforce.com
9 19 (2.21%) Alteryx
10 18 (2.09%) Cloudera
11 13 (1.51%) Netezza
12 10 (1.16%) Adobe
13 9 (1.05%) Sparx
14 8 (0.93%) StreamSets
14 8 (0.93%) Teradata
14 8 (0.93%) Workday
15 6 (0.70%) ESRI
15 6 (0.70%) MapR
15 6 (0.70%) Splunk