Data Lake Contracts

Data Lakes
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 20 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
20 Apr 2024
Same period 2023 Same period 2022
Rank 213 214 208
Rank change year-on-year +1 -6 +13
Contract jobs citing Data Lake 478 772 1,240
As % of all contract jobs advertised in the UK 1.10% 1.28% 1.38%
As % of the Database & Business Intelligence category 6.62% 7.06% 6.82%
Number of daily rates quoted 348 573 791
10th Percentile £404 £450 £425
25th Percentile £463 £500 £500
Median daily rate (50th Percentile) £550 £570 £575
Median % change year-on-year -3.51% -0.87% +12.47%
75th Percentile £750 £675 £675
90th Percentile £850 £750 £738
UK excluding London median daily rate £500 £550 £556
% change year-on-year -9.09% -1.12% +14.69%
Number of hourly rates quoted 3 5 3
10th Percentile £30.30 - -
25th Percentile £34.13 - -
Median hourly rate £40.50 £35.00 £35.00
Median % change year-on-year +15.71% - -21.35%
75th Percentile £51.00 - £56.88
90th Percentile £57.30 - £70.00
UK excluding London median hourly rate £40.50 £35.00 £35.00
% change year-on-year +15.71% - -

All Database and Business Intelligence Skills
UK

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,219 10,934 18,169
As % of all contract IT jobs advertised in the UK 16.62% 18.08% 20.22%
Number of daily rates quoted 5,130 7,777 12,957
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £548 £540
Median % change year-on-year -4.11% +1.39% +8.00%
75th Percentile £650 £663 £650
90th Percentile £758 £750 £750
UK excluding London median daily rate £480 £500 £480
% change year-on-year -4.00% +4.17% +9.71%
Number of hourly rates quoted 146 184 192
10th Percentile £14.00 £21.24 £15.12
25th Percentile £20.98 £35.00 £22.40
Median hourly rate £40.00 £61.25 £42.00
Median % change year-on-year -34.69% +45.83% +57.01%
75th Percentile £54.78 £71.75 £60.00
90th Percentile £72.50 £79.76 £69.05
UK excluding London median hourly rate £40.00 £60.00 £35.00
% change year-on-year -33.33% +71.43% +45.83%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 20 April 2024.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 20 April 2024.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 20 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +1 432 £550 -4.35% 174
London +8 291 £648 +7.92% 99
Work from Home +40 208 £575 +4.55% 98
UK excluding London -13 127 £500 -9.09% 81
North of England +9 46 £485 -19.17% 23
North West +5 38 £490 -18.33% 18
South East -8 27 £575 +6.98% 19
Midlands +21 23 £513 +2.50% 11
South West +17 16 £450 -16.28% 8
West Midlands +25 13 £394 -37.00% 8
Scotland +39 11 £488 -7.14% 9
East Midlands +7 10 £513 +13.89% 3
Yorkshire +14 7 £450 -32.58% 5
East of England +1 4 £410 -31.67% 6
North East +18 1 £850 +61.90%

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 74 (15.48%) Apache Airflow
2 65 (13.60%) Apache
3 46 (9.62%) Apache Spark
4 11 (2.30%) SAS
5 4 (0.84%) Confluence
6 1 (0.21%) SharePoint
Applications
1 3 (0.63%) Microsoft Excel
2 1 (0.21%) Microsoft Office
2 1 (0.21%) Microsoft PowerPoint
2 1 (0.21%) Spreadsheet
Business Applications
1 29 (6.07%) Dynamics AX
2 14 (2.93%) Dynamics CRM
3 4 (0.84%) Oracle EBS
4 3 (0.63%) Oracle ERP
4 3 (0.63%) Primavera
5 2 (0.42%) Magento
5 2 (0.42%) Maximo
5 2 (0.42%) Salesforce CRM
5 2 (0.42%) SAP S/4HANA
6 1 (0.21%) Oracle General Ledger
6 1 (0.21%) thinkFolio
Cloud Services
1 272 (56.90%) Azure
2 159 (33.26%) AWS
3 140 (29.29%) Power Platform
4 103 (21.55%) Snowflake
5 100 (20.92%) Azure Data Factory
6 84 (17.57%) GCP
7 69 (14.44%) Azure DevOps
7 69 (14.44%) Azure Synapse Analytics
8 66 (13.81%) dbt
9 58 (12.13%) Power Automate
10 54 (11.30%) Dynamics 365
11 48 (10.04%) Serverless
12 44 (9.21%) PowerApps
13 25 (5.23%) Amazon S3
14 24 (5.02%) AWS Lambda
15 20 (4.18%) Azure Functions
16 18 (3.77%) Amazon Kinesis
16 18 (3.77%) Azure Key Vault
16 18 (3.77%) Azure Logic Apps
17 15 (3.14%) Azure Monitor
Communications & Networking
1 3 (0.63%) Firewall
1 3 (0.63%) VPN
2 2 (0.42%) FTP
3 1 (0.21%) DNS
3 1 (0.21%) Network Security
3 1 (0.21%) SSL
Database & Business Intelligence
1 162 (33.89%) Data Warehouse
2 129 (26.99%) Power BI
3 85 (17.78%) Big Data
4 72 (15.06%) Amazon Athena
5 57 (11.92%) Apache Arrow
5 57 (11.92%) Dremio
6 51 (10.67%) SQL Server
7 49 (10.25%) Apache Ignite
8 45 (9.41%) Azure SQL Database
9 30 (6.28%) Amazon Redshift
9 30 (6.28%) NoSQL
10 24 (5.02%) Relational Database
11 20 (4.18%) Tableau
12 19 (3.97%) Metadata
13 18 (3.77%) DynamoDB
13 18 (3.77%) SQL Server Integration Services
14 16 (3.35%) RDBMS
14 16 (3.35%) Spark SQL
15 15 (3.14%) Delta Lake
15 15 (3.14%) SQL Server Analysis Services
Development Applications
1 27 (5.65%) Git
2 10 (2.09%) JIRA
3 7 (1.46%) SQL Server Management Studio (SSMS)
4 6 (1.26%) SonarQube
4 6 (1.26%) Visual Studio Team System
5 4 (0.84%) Jenkins
5 4 (0.84%) Maven
6 3 (0.63%) Deequ
6 3 (0.63%) kappa
7 2 (0.42%) Ant
7 2 (0.42%) ER Studio
7 2 (0.42%) ERwin
7 2 (0.42%) GitLab
7 2 (0.42%) Gradle
7 2 (0.42%) JUnit
7 2 (0.42%) Liquibase
7 2 (0.42%) MLflow
8 1 (0.21%) NUnit
8 1 (0.21%) TestComplete
8 1 (0.21%) Visual Studio
General
1 167 (34.94%) Finance
2 127 (26.57%) Social Skills
3 79 (16.53%) Analytical Skills
4 68 (14.23%) Banking
5 51 (10.67%) Investment Banking
6 49 (10.25%) Front Office
7 47 (9.83%) Public Sector
8 40 (8.37%) Retail
9 28 (5.86%) General Ledger
10 15 (3.14%) Pharmaceutical
11 14 (2.93%) Marketing
12 10 (2.09%) Telecoms
13 9 (1.88%) Presentation Skills
14 8 (1.67%) Influencing Skills
14 8 (1.67%) Manufacturing
15 6 (1.26%) Electronics
15 6 (1.26%) Legal
16 4 (0.84%) Inclusion and Diversity
17 2 (0.42%) Law
17 2 (0.42%) Organisational Skills
Job Titles
1 139 (29.08%) Data Engineer
2 103 (21.55%) Architect
3 63 (13.18%) Azure Engineer
4 57 (11.92%) Lead
5 56 (11.72%) Azure Data Engineer
6 51 (10.67%) Data Architect
7 50 (10.46%) Consultant
7 50 (10.46%) Developer
7 50 (10.46%) Solutions Architect
8 45 (9.41%) AWS Engineer
9 37 (7.74%) Senior
10 34 (7.11%) Analyst
11 27 (5.65%) Software Engineer
12 25 (5.23%) Azure Architect
13 24 (5.02%) Data Analyst
14 23 (4.81%) Dynamics 365 Consultant
15 20 (4.18%) Python Engineer
16 19 (3.97%) AWS Data Engineer
16 19 (3.97%) Microsoft Consultant
17 18 (3.77%) Lead Developer
Libraries, Frameworks & Software Standards
1 59 (12.34%) PySpark
2 58 (12.13%) Protocol Buffers
3 57 (11.92%) gRPC
4 49 (10.25%) NumPy
4 49 (10.25%) Pandas
4 49 (10.25%) SciPy
5 21 (4.39%) JSON
6 19 (3.97%) Kafka
7 16 (3.35%) .NET
8 13 (2.72%) XML
9 12 (2.51%) ARM Templates
10 8 (1.67%) Oracle Fusion
11 7 (1.46%) Apache Avro
11 7 (1.46%) REST
11 7 (1.46%) Web Services
12 6 (1.26%) YAML
13 5 (1.05%) Middleware
14 4 (0.84%) .NET Framework
14 4 (0.84%) OpenID
14 4 (0.84%) Swagger
Miscellaneous
1 60 (12.55%) Hedge funds
2 50 (10.46%) Derivative
3 49 (10.25%) Equities
3 49 (10.25%) Fixed Income
3 49 (10.25%) Foreign Exchange (FX)
4 38 (7.95%) Data Structures
5 15 (3.14%) Product Ownership
6 8 (1.67%) Clustering
7 7 (1.46%) Data Fabric
7 7 (1.46%) Distributed Computing
7 7 (1.46%) Management Information System
8 5 (1.05%) Algorithms
8 5 (1.05%) Cloud Native
8 5 (1.05%) CMDB
8 5 (1.05%) Data Protection Act
8 5 (1.05%) Hybrid Cloud
8 5 (1.05%) Public Cloud
8 5 (1.05%) Self-Motivation
9 4 (0.84%) Onboarding
9 4 (0.84%) Reference Data
Operating Systems
1 20 (4.18%) Linux
2 3 (0.63%) Unix
2 3 (0.63%) Windows
3 1 (0.21%) Android
3 1 (0.21%) Apple iOS
3 1 (0.21%) VMS
3 1 (0.21%) Windows Server 2012
Processes & Methodologies
1 150 (31.38%) Agile
1 150 (31.38%) Business Intelligence
2 127 (26.57%) DevOps
3 125 (26.15%) Analytics
4 122 (25.52%) Data Modelling
5 121 (25.31%) ETL
6 84 (17.57%) Data Engineering
6 84 (17.57%) Data Pipeline
7 65 (13.60%) Software Engineering
8 61 (12.76%) Asset Management
8 61 (12.76%) CI/CD
8 61 (12.76%) Investment Management
9 59 (12.34%) Data Governance
10 53 (11.09%) Migration
10 53 (11.09%) Problem-Solving
11 46 (9.62%) Data Architecture
11 46 (9.62%) Visualisation
12 44 (9.21%) Machine Learning
12 44 (9.21%) Scrum
13 43 (9.00%) Data Integration
Programming Languages
1 188 (39.33%) Python
2 184 (38.49%) SQL
3 82 (17.15%) Java
4 57 (11.92%) JavaScript
5 49 (10.25%) TypeScript
6 26 (5.44%) Scala
7 25 (5.23%) T-SQL
8 23 (4.81%) PowerShell
9 16 (3.35%) C#
10 15 (3.14%) Go
11 14 (2.93%) R
12 12 (2.51%) Data Analysis Expressions
13 7 (1.46%) Bash
13 7 (1.46%) Bicep
14 4 (0.84%) X++
15 3 (0.63%) C
15 3 (0.63%) C++
15 3 (0.63%) Shell Script
16 2 (0.42%) U-SQL
17 1 (0.21%) Kusto Query Language
Qualifications
1 50 (10.46%) Degree
2 43 (9.00%) Security Cleared
3 39 (8.16%) SC Cleared
4 21 (4.39%) AWS Certification
5 14 (2.93%) Computer Science Degree
5 14 (2.93%) DV Cleared
6 13 (2.72%) Master's Degree
7 12 (2.51%) Azure Certification
8 4 (0.84%) AWS Certified Solutions Architect
9 3 (0.63%) CIMA
9 3 (0.63%) Microsoft Certification
10 1 (0.21%) ISO 27001 Lead Implementer
10 1 (0.21%) PhD
10 1 (0.21%) PMI Certification
10 1 (0.21%) PMP
Quality Assurance & Compliance
1 54 (11.30%) Data Quality
2 17 (3.56%) QA
3 6 (1.26%) GDPR
4 5 (1.05%) PMO
5 4 (0.84%) Accessibility
5 4 (0.84%) ISO/IEC 27001
6 3 (0.63%) ISO 22301
7 2 (0.42%) NIST
7 2 (0.42%) SLA
8 1 (0.21%) CDISC
8 1 (0.21%) COBIT
8 1 (0.21%) Cyber Essentials
8 1 (0.21%) GxP
System Software
1 20 (4.18%) Docker
2 7 (1.46%) Virtual Machines
3 5 (1.05%) Active Directory
4 3 (0.63%) HDFS
5 1 (0.21%) Apache ZooKeeper
Systems Management
1 51 (10.67%) Terraform
2 33 (6.90%) Kubernetes
3 19 (3.97%) Ansible
4 11 (2.30%) Puppet
5 8 (1.67%) Prometheus
6 6 (1.26%) HP Fortify
7 2 (0.42%) Ambari
7 2 (0.42%) Oozie
8 1 (0.21%) Hadoop YARN
8 1 (0.21%) Kibana
8 1 (0.21%) Kubeflow
Vendors
1 138 (28.87%) Databricks
2 129 (26.99%) Microsoft
3 33 (6.90%) SAP
4 21 (4.39%) Oracle
5 16 (3.35%) Google
6 12 (2.51%) Informatica
7 11 (2.30%) Talend
8 8 (1.67%) Salesforce
9 7 (1.46%) Dataiku
9 7 (1.46%) ServiceNow
10 6 (1.26%) Alteryx
10 6 (1.26%) Splunk
10 6 (1.26%) Trillium
11 3 (0.63%) Ab Initio
11 3 (0.63%) BiZZdesign
11 3 (0.63%) Teradata
12 2 (0.42%) Bloomberg
12 2 (0.42%) Cloudera
12 2 (0.42%) Marketo
12 2 (0.42%) Salesforce Marketing Cloud