Data Lake Contracts

Data Lakes
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 12 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
12 May 2024
Same period 2023 Same period 2022
Rank 192 205 219
Rank change year-on-year +13 +14 -12
Contract jobs citing Data Lake 517 759 1,193
As % of all contract jobs advertised in the UK 1.20% 1.30% 1.36%
As % of the Database & Business Intelligence category 7.10% 7.28% 6.80%
Number of daily rates quoted 385 577 765
10th Percentile £413 £450 £425
25th Percentile £475 £500 £500
Median daily rate (50th Percentile) £575 £570 £575
Median % change year-on-year +0.88% -0.87% +12.75%
75th Percentile £850 £675 £675
90th Percentile £888 £750 £753
UK excluding London median daily rate £500 £525 £575
% change year-on-year -4.76% -8.70% +19.79%
Number of hourly rates quoted 3 4 3
10th Percentile £30.30 - -
25th Percentile £34.13 - -
Median hourly rate £40.50 £35.00 £35.00
Median % change year-on-year +15.71% - -21.35%
75th Percentile £51.00 - £56.88
90th Percentile £57.30 - £70.00
UK excluding London median hourly rate £40.50 £35.00 £35.00
% change year-on-year +15.71% - -

All Database and Business Intelligence Skills
UK

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,284 10,421 17,542
As % of all contract IT jobs advertised in the UK 16.94% 17.91% 20.02%
Number of daily rates quoted 5,210 7,416 12,469
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £542 £548
Median % change year-on-year -3.05% -1.23% +9.65%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +11.24%
Number of hourly rates quoted 145 186 194
10th Percentile £14.00 £21.24 £15.37
25th Percentile £20.98 £33.05 £22.43
Median hourly rate £40.00 £58.59 £45.00
Median % change year-on-year -31.73% +30.20% +66.79%
75th Percentile £61.60 £73.74 £64.94
90th Percentile £74.00 £81.25 £75.00
UK excluding London median hourly rate £40.00 £55.00 £35.00
% change year-on-year -27.27% +57.14% +42.45%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 12 May 2024.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 12 May 2024.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 12 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +9 473 £585 +1.74% 189
London +18 328 £673 +12.08% 107
Work from Home +44 236 £700 +27.27% 101
UK excluding London +3 136 £500 -4.76% 86
North of England +1 53 £495 -17.50% 19
North West +12 44 £500 -21.57% 11
South East +4 30 £575 +9.52% 21
Midlands +13 23 £488 -2.50% 12
South West +11 17 £488 -7.14% 17
West Midlands +11 13 £400 -31.91% 9
Scotland +37 11 £488 -7.14% 8
East Midlands +10 10 £513 +13.89% 3
Yorkshire +13 8 £470 -29.59% 7
East of England -4 2 £418 -24.09% 8
North East +7 1 £850 +41.67% 1

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 108 (20.89%) Apache Airflow
2 95 (18.38%) Apache
3 49 (9.48%) Apache Spark
4 13 (2.51%) SAS
5 4 (0.77%) Confluence
6 1 (0.19%) Jupyter
6 1 (0.19%) SharePoint
Applications
1 3 (0.58%) Microsoft Excel
2 1 (0.19%) Microsoft Office
2 1 (0.19%) Microsoft PowerPoint
Business Applications
1 28 (5.42%) Dynamics AX
2 14 (2.71%) Dynamics CRM
3 4 (0.77%) Oracle EBS
4 3 (0.58%) Maximo
4 3 (0.58%) Oracle ERP
4 3 (0.58%) Primavera
4 3 (0.58%) SAP S/4HANA
5 2 (0.39%) Magento
5 2 (0.39%) Oracle Payables
5 2 (0.39%) Oracle Receivables
5 2 (0.39%) PeopleSoft CRM
5 2 (0.39%) Salesforce CRM
6 1 (0.19%) Oracle General Ledger
6 1 (0.19%) thinkFolio
Cloud Services
1 281 (54.35%) Azure
2 185 (35.78%) AWS
3 145 (28.05%) Power Platform
4 136 (26.31%) Snowflake
5 110 (21.28%) Azure Data Factory
6 100 (19.34%) dbt
7 95 (18.38%) GCP
8 71 (13.73%) Azure Synapse Analytics
9 67 (12.96%) Azure DevOps
10 59 (11.41%) Power Automate
11 51 (9.86%) Dynamics 365
12 47 (9.09%) Serverless
13 45 (8.70%) PowerApps
14 22 (4.26%) Azure Functions
15 21 (4.06%) Amazon S3
15 21 (4.06%) AWS Lambda
15 21 (4.06%) Azure Logic Apps
16 19 (3.68%) Amazon Kinesis
16 19 (3.68%) Azure Key Vault
17 16 (3.09%) Azure Monitor
Communications & Networking
1 4 (0.77%) Firewall
2 3 (0.58%) VPN
3 2 (0.39%) FTP
4 1 (0.19%) DNS
4 1 (0.19%) Network Security
4 1 (0.19%) SSL
Database & Business Intelligence
1 164 (31.72%) Data Warehouse
2 133 (25.73%) Power BI
3 104 (20.12%) Amazon Athena
4 97 (18.76%) Big Data
5 90 (17.41%) Apache Arrow
5 90 (17.41%) Dremio
6 76 (14.70%) Apache Ignite
7 49 (9.48%) Azure SQL Database
8 44 (8.51%) SQL Server
9 32 (6.19%) NoSQL
10 25 (4.84%) Amazon Redshift
11 24 (4.64%) Relational Database
12 19 (3.68%) Delta Lake
13 17 (3.29%) BigQuery
14 16 (3.09%) DynamoDB
14 16 (3.09%) Spark SQL
15 15 (2.90%) Metadata
15 15 (2.90%) OLTP
16 14 (2.71%) RDBMS
16 14 (2.71%) SQL Server Integration Services
Development Applications
1 29 (5.61%) Git
2 8 (1.55%) JIRA
3 6 (1.16%) SonarQube
3 6 (1.16%) SQL Server Management Studio (SSMS)
3 6 (1.16%) Visual Studio Team System
4 4 (0.77%) Deequ
4 4 (0.77%) Jenkins
5 3 (0.58%) ERwin
5 3 (0.58%) kappa
5 3 (0.58%) Maven
6 2 (0.39%) Ant
6 2 (0.39%) ER Studio
6 2 (0.39%) GitLab
6 2 (0.39%) Gradle
6 2 (0.39%) JUnit
6 2 (0.39%) Liquibase
6 2 (0.39%) MLflow
7 1 (0.19%) Octopus Deploy
7 1 (0.19%) TestComplete
7 1 (0.19%) Zephyr
General
1 204 (39.46%) Finance
2 128 (24.76%) Social Skills
3 94 (18.18%) Banking
4 83 (16.05%) Analytical Skills
5 78 (15.09%) Investment Banking
6 76 (14.70%) Front Office
7 46 (8.90%) Public Sector
8 40 (7.74%) Retail
9 30 (5.80%) General Ledger
10 18 (3.48%) Pharmaceutical
11 11 (2.13%) Marketing
12 9 (1.74%) Influencing Skills
13 7 (1.35%) Presentation Skills
14 6 (1.16%) Legal
15 5 (0.97%) Financial Institution
15 5 (0.97%) Telecoms
16 4 (0.77%) Inclusion and Diversity
16 4 (0.77%) Manufacturing
17 3 (0.58%) Documentation Skills
17 3 (0.58%) Electronics
Job Titles
1 143 (27.66%) Data Engineer
2 115 (22.24%) Architect
3 65 (12.57%) Azure Engineer
4 61 (11.80%) Lead
5 58 (11.22%) AWS Engineer
5 58 (11.22%) Azure Data Engineer
6 57 (11.03%) Solutions Architect
7 55 (10.64%) Data Architect
8 54 (10.44%) Senior
9 52 (10.06%) Developer
10 47 (9.09%) Consultant
11 45 (8.70%) Software Engineer
12 34 (6.58%) Analyst
13 32 (6.19%) Python Engineer
14 27 (5.22%) Java Engineer
15 26 (5.03%) Java Software Engineer
15 26 (5.03%) Python Software Engineer
16 25 (4.84%) Azure Architect
16 25 (4.84%) Senior Software Engineer
17 24 (4.64%) AWS Software Engineer
Libraries, Frameworks & Software Standards
1 90 (17.41%) gRPC
1 90 (17.41%) Protocol Buffers
2 77 (14.89%) NumPy
2 77 (14.89%) Pandas
3 76 (14.70%) SciPy
4 67 (12.96%) PySpark
5 20 (3.87%) JSON
6 18 (3.48%) Kafka
7 15 (2.90%) .NET
8 13 (2.51%) ARM Templates
8 13 (2.51%) XML
9 9 (1.74%) Apache Avro
10 8 (1.55%) Oracle Fusion
11 7 (1.35%) REST
11 7 (1.35%) Web Services
12 6 (1.16%) Middleware
13 5 (0.97%) JSON Schema
13 5 (0.97%) YAML
14 4 (0.77%) Apache NiFi
14 4 (0.77%) Swagger
Miscellaneous
1 93 (17.99%) Hedge funds
2 76 (14.70%) Derivative
2 76 (14.70%) Equities
2 76 (14.70%) Fixed Income
2 76 (14.70%) Foreign Exchange (FX)
3 37 (7.16%) Data Structures
4 15 (2.90%) Product Ownership
5 14 (2.71%) Clustering
6 8 (1.55%) Pricing Data
7 7 (1.35%) Data Fabric
7 7 (1.35%) Distributed Computing
8 6 (1.16%) Cloud Native
8 6 (1.16%) Reference Data
9 5 (0.97%) Algorithms
9 5 (0.97%) Data Centre
9 5 (0.97%) Hybrid Cloud
9 5 (0.97%) Management Information System
9 5 (0.97%) Self-Motivation
10 4 (0.77%) Blockchain
10 4 (0.77%) Renewable Energy
Operating Systems
1 18 (3.48%) Linux
2 4 (0.77%) Windows
3 3 (0.58%) Unix
4 1 (0.19%) Android
4 1 (0.19%) Apple iOS
4 1 (0.19%) VMS
4 1 (0.19%) Windows Server
4 1 (0.19%) Windows Server 2012
Processes & Methodologies
1 180 (34.82%) Agile
2 150 (29.01%) Business Intelligence
3 136 (26.31%) DevOps
4 135 (26.11%) Data Modelling
5 124 (23.98%) Analytics
6 123 (23.79%) ETL
7 95 (18.38%) Data Pipeline
8 94 (18.18%) Asset Management
9 93 (17.99%) Data Engineering
9 93 (17.99%) Software Engineering
10 84 (16.25%) Investment Management
11 66 (12.77%) CI/CD
12 64 (12.38%) Data Governance
13 53 (10.25%) Migration
13 53 (10.25%) Problem-Solving
14 51 (9.86%) Data Architecture
15 48 (9.28%) Visualisation
16 45 (8.70%) Data Integration
17 43 (8.32%) Scrum
18 41 (7.93%) Data Science
Programming Languages
1 232 (44.87%) Python
2 193 (37.33%) SQL
3 112 (21.66%) Java
4 90 (17.41%) JavaScript
5 76 (14.70%) TypeScript
6 28 (5.42%) T-SQL
7 26 (5.03%) PowerShell
7 26 (5.03%) Scala
8 21 (4.06%) Go
9 16 (3.09%) C#
10 11 (2.13%) R
11 10 (1.93%) Data Analysis Expressions
12 7 (1.35%) Bash
12 7 (1.35%) Bicep
13 4 (0.77%) X++
14 3 (0.58%) C
14 3 (0.58%) C++
15 2 (0.39%) Shell Script
15 2 (0.39%) U-SQL
16 1 (0.19%) Kusto Query Language
Qualifications
1 52 (10.06%) Degree
2 44 (8.51%) Security Cleared
3 39 (7.54%) SC Cleared
4 19 (3.68%) AWS Certification
5 14 (2.71%) DV Cleared
6 12 (2.32%) Computer Science Degree
7 11 (2.13%) Azure Certification
7 11 (2.13%) Master's Degree
8 3 (0.58%) AWS Certified Solutions Architect
8 3 (0.58%) CIMA
8 3 (0.58%) Microsoft Certification
9 1 (0.19%) ISO 27001 Lead Implementer
9 1 (0.19%) PhD
9 1 (0.19%) PMI Certification
9 1 (0.19%) PMP
Quality Assurance & Compliance
1 75 (14.51%) Data Quality
2 17 (3.29%) QA
3 6 (1.16%) GDPR
4 4 (0.77%) Accessibility
4 4 (0.77%) ISO/IEC 27001
5 3 (0.58%) ISO 22301
5 3 (0.58%) PMO
6 2 (0.39%) NIST
6 2 (0.39%) SLA
7 1 (0.19%) CDISC
7 1 (0.19%) COBIT
7 1 (0.19%) Cyber Essentials
7 1 (0.19%) GxP
System Software
1 20 (3.87%) Docker
2 8 (1.55%) Virtual Machines
3 5 (0.97%) Active Directory
4 2 (0.39%) HDFS
Systems Management
1 58 (11.22%) Terraform
2 37 (7.16%) Kubernetes
3 19 (3.68%) Ansible
4 14 (2.71%) Prometheus
5 11 (2.13%) Puppet
6 6 (1.16%) HP Fortify
7 2 (0.39%) Ambari
7 2 (0.39%) Oozie
8 1 (0.19%) Kibana
8 1 (0.19%) Kubeflow
Vendors
1 145 (28.05%) Databricks
2 121 (23.40%) Microsoft
3 29 (5.61%) SAP
4 22 (4.26%) Oracle
5 15 (2.90%) Google
6 11 (2.13%) Informatica
7 10 (1.93%) Talend
8 8 (1.55%) Salesforce
9 7 (1.35%) Dataiku
10 6 (1.16%) Alteryx
10 6 (1.16%) ServiceNow
10 6 (1.16%) Splunk
10 6 (1.16%) Trillium
11 3 (0.58%) Ab Initio
11 3 (0.58%) BiZZdesign
11 3 (0.58%) Cloudera
11 3 (0.58%) Teradata
12 2 (0.39%) Bloomberg
12 2 (0.39%) Marketo
12 2 (0.39%) PeopleSoft