Period
to 29 November 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 29 November 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
29 Nov 2020
Same period 2019 Same period 2018
Rank 232 267 405
Rank change year-on-year +35 +138 +220
Contract jobs citing Data Lake 330 737 590
As % of all contract jobs advertised in England 1.08% 0.99% 0.62%
As % of the Database & Business Intelligence category 4.83% 4.53% 2.73%
Number of daily rates quoted 270 535 401
Median daily rate £525 £550 £525
Median daily rate % change year-on-year -4.55% +4.76% -4.55%
10th Percentile £400 £406 £400
90th Percentile £700 £713 £700
UK median daily rate £525 £550 £525
% change year-on-year -4.55% +4.76% -4.55%
Number of hourly rates quoted 3 5 2
Median hourly rate £35.00 £72.50 £49.75
Median hourly rate % change year-on-year -51.72% +45.73% +10.56%
UK median hourly rate £35.00 £72.50 £49.75
% change year-on-year -51.72% +45.73% +10.56%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 6,829 16,255 21,629
As % of all contract IT jobs advertised in England 22.29% 21.79% 22.77%
Number of daily rates quoted 4,426 11,074 15,227
Median daily rate £488 £475 £475
Median daily rate % change year-on-year +2.63% - +3.26%
10th Percentile £313 £325 £317
90th Percentile £675 £663 £638
UK median daily rate £480 £475 £475
% change year-on-year +1.05% - +5.56%
Number of hourly rates quoted 141 242 231
Median hourly rate £35.00 £30.00 £32.48
Median hourly rate % change year-on-year +16.67% -7.62% +3.10%
10th Percentile £14.00 £13.77 £14.00
90th Percentile £56.00 £71.93 £57.33
Median hourly rate £35.00 £30.50 £32.00
% change year-on-year +14.75% -4.69% +4.07%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Lake in England.

Daily rate trend for Data Lake in England

Data Lake
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Lake in England over the 6 months to 29 November 2020.

Daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Lake in England.

Hourly rate trend for Data Lake in England

Data Lake
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Lake in England over the 6 months to 29 November 2020.

Hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 29 November 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +22 206 £550 - 44
North of England +123 37 £550 +10.00% 20
South East +45 32 £463 -5.13% 13
North West +86 27 £550 +10.00% 12
Midlands +83 22 £475 -5.00% 8
East Midlands +50 12 £472 -19.66% 3
South West +78 10 £513 -26.79% 4
West Midlands +58 10 £488 -1.02% 5
Yorkshire +60 9 £550 -4.35% 5
East of England +55 5 £475 -24.00% 7
North East +37 2 £475 +2.70% 3
Data Lake
UK

For the 6 months to 29 November 2020, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 225 (68.18%) Azure
2 147 (44.55%) Data Warehouse
3 146 (44.24%) SQL
4 135 (40.91%) Business Intelligence
5 128 (38.79%) Data Modelling
6 120 (36.36%) Databricks
7 109 (33.03%) Azure Data Factory
7 109 (33.03%) Microsoft
8 105 (31.82%) Analytics
9 97 (29.39%) Agile Software Development
10 92 (27.88%) Python
11 83 (25.15%) Big Data
12 81 (24.55%) ETL
12 81 (24.55%) Power Platform
13 80 (24.24%) Power BI
14 77 (23.33%) DevOps
15 68 (20.61%) AWS
16 67 (20.30%) Azure SQL Database
17 60 (18.18%) Finance
18 57 (17.27%) Data Architecture
19 49 (14.85%) Azure SQL Data Warehouse
20 43 (13.03%) Data Quality
21 42 (12.73%) Data Governance
21 42 (12.73%) SQL Server
22 41 (12.42%) Data Management
23 38 (11.52%) Data Engineering
24 37 (11.21%) Serverless
25 35 (10.61%) Data Analysis
26 34 (10.30%) Migration
27 33 (10.00%) SAP

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 29 (8.79%) Apache Spark
2 16 (4.85%) Confluence
3 6 (1.82%) Apache
3 6 (1.82%) SAS
4 5 (1.52%) Apache Pig
4 5 (1.52%) ArcGIS
4 5 (1.52%) Elasticsearch
4 5 (1.52%) SharePoint
5 2 (0.61%) Apache Synapse
5 2 (0.61%) CMS
6 1 (0.30%) Adobe Experience Manager
6 1 (0.30%) Apache Airflow
6 1 (0.30%) Apache Solr
Applications
1 5 (1.52%) Microsoft Office
2 4 (1.21%) Microsoft Excel
2 4 (1.21%) Microsoft PowerPoint
2 4 (1.21%) MS Visio
3 1 (0.30%) SPSS
Business Applications
1 6 (1.82%) SAP S/4HANA
2 4 (1.21%) SAP Oil and Gas
3 3 (0.91%) Dynamics CRM
3 3 (0.91%) SAP IS-U
3 3 (0.91%) SAP MDG
4 2 (0.61%) Aligne
4 2 (0.61%) SAP APO
4 2 (0.61%) SAP CRM
4 2 (0.61%) SAP ERP
5 1 (0.30%) Bloomberg AIM
5 1 (0.30%) Dynamics AX
5 1 (0.30%) Markit EDM
5 1 (0.30%) Oracle EBS
5 1 (0.30%) SAP FI-CA
5 1 (0.30%) SAP MM
5 1 (0.30%) SimCorp Dimension
5 1 (0.30%) thinkFolio
Cloud Services
1 225 (68.18%) Azure
2 109 (33.03%) Azure Data Factory
3 81 (24.55%) Power Platform
4 68 (20.61%) AWS
5 37 (11.21%) Serverless
6 26 (7.88%) Azure Functions
7 21 (6.36%) AWS Lambda
8 20 (6.06%) Amazon S3
9 18 (5.45%) GCP
10 15 (4.55%) Logic Apps
11 14 (4.24%) PaaS
12 13 (3.94%) Dynamics 365
13 10 (3.03%) Amazon EMR
13 10 (3.03%) Azure Active Directory
14 7 (2.12%) Amazon EC2
15 6 (1.82%) Amazon ECS
15 6 (1.82%) Amazon SageMaker
15 6 (1.82%) SaaS
16 5 (1.52%) AWS Fargate
16 5 (1.52%) GitHub
Communications & Networking
1 3 (0.91%) WAN
2 2 (0.61%) Extranet
2 2 (0.61%) Internet
2 2 (0.61%) LAN
2 2 (0.61%) Skype
2 2 (0.61%) TCP/IP
2 2 (0.61%) Wi-Fi
2 2 (0.61%) X.21
3 1 (0.30%) Firewall
3 1 (0.30%) VLAN
3 1 (0.30%) VPN
Database & Business Intelligence
1 147 (44.55%) Data Warehouse
2 83 (25.15%) Big Data
3 80 (24.24%) Power BI
4 67 (20.30%) Azure SQL Database
5 49 (14.85%) Azure SQL Data Warehouse
6 42 (12.73%) SQL Server
7 25 (7.58%) SQL Server Integration Services
8 24 (7.27%) Hadoop
9 22 (6.67%) Cosmos DB
10 21 (6.36%) NoSQL
11 20 (6.06%) HDInsight
12 19 (5.76%) Tableau
13 18 (5.45%) Amazon Athena
13 18 (5.45%) Amazon Redshift
14 17 (5.15%) Apache Hive
14 17 (5.15%) Relational Database
14 17 (5.15%) SQL Server Analysis Services
15 15 (4.55%) Microsoft Analysis Services
16 11 (3.33%) MySQL
16 11 (3.33%) RDBMS
Development Applications
1 31 (9.39%) Git (software)
2 27 (8.18%) JIRA
3 18 (5.45%) Jenkins
3 18 (5.45%) Visual Studio Team System
4 14 (4.24%) GitLab
5 7 (2.12%) kappa
6 6 (1.82%) ERwin
7 5 (1.52%) Atlassian Bamboo
8 4 (1.21%) PowerDesigner
8 4 (1.21%) Selenium
8 4 (1.21%) Subversion
8 4 (1.21%) Team Foundation Server
8 4 (1.21%) Terragrunt
9 3 (0.91%) Artifactory
9 3 (0.91%) ER Studio
9 3 (0.91%) JUnit
9 3 (0.91%) SonarQube
9 3 (0.91%) Visual Studio
10 2 (0.61%) Octopus Deploy
10 2 (0.61%) TeamCity
General
1 60 (18.18%) Finance
2 20 (6.06%) Marketing
3 14 (4.24%) Public Sector
4 12 (3.64%) Banking
5 8 (2.42%) Advertising
6 7 (2.12%) Manufacturing
7 5 (1.52%) Pharmaceutical
8 4 (1.21%) Back Office
8 4 (1.21%) Legal
8 4 (1.21%) Retail
9 3 (0.91%) Law
9 3 (0.91%) Publishing
10 2 (0.61%) Electronics
10 2 (0.61%) Telecoms
11 1 (0.30%) Financial Institution
11 1 (0.30%) Front Office
11 1 (0.30%) Games
11 1 (0.30%) General Ledger
11 1 (0.30%) German Language
11 1 (0.30%) Investment Banking
Job Titles
1 106 (32.12%) Architect
2 88 (26.67%) Data Engineer
3 78 (23.64%) Data Architect
4 58 (17.58%) Developer
5 44 (13.33%) Azure Engineer
6 32 (9.70%) Analyst
7 28 (8.48%) Azure Developer
8 24 (7.27%) Azure Architect
9 23 (6.97%) AWS Engineer
10 16 (4.85%) Business Analyst
11 15 (4.55%) Solutions Architect
12 14 (4.24%) Enterprise Data Architect
12 14 (4.24%) Python Engineer
13 13 (3.94%) Business Intelligence Developer
13 13 (3.94%) Data Business Analyst
13 13 (3.94%) Enterprise Architect
14 11 (3.33%) Technical Analyst
14 11 (3.33%) Technical Business Analyst
15 10 (3.03%) Cloud Architect
15 10 (3.03%) Consultant
Libraries, Frameworks & Software Standards
1 27 (8.18%) Kafka
2 25 (7.58%) PySpark
3 15 (4.55%) .NET
4 9 (2.73%) REST
5 8 (2.42%) XML
6 7 (2.12%) JSON
7 6 (1.82%) Web Services
8 5 (1.52%) GraphQL
8 5 (1.52%) React
9 3 (0.91%) .NET Core
9 3 (0.91%) .NET Framework
9 3 (0.91%) MDX
9 3 (0.91%) Middleware
10 2 (0.61%) Akka
10 2 (0.61%) Apache NiFi
10 2 (0.61%) Spark Streaming
10 2 (0.61%) YAML
11 1 (0.30%) OAuth
11 1 (0.30%) RESTful
11 1 (0.30%) Seaborn
Miscellaneous
1 29 (8.79%) Analytical Skills
2 24 (7.27%) Data Structures
3 23 (6.97%) Greenfield Project
4 21 (6.36%) Management Information System
5 9 (2.73%) Cloud Native
6 6 (1.82%) Reference Data
6 6 (1.82%) Virtual Team
7 5 (1.52%) FMCG
7 5 (1.52%) Replication
7 5 (1.52%) User Experience
8 4 (1.21%) Algorithms
8 4 (1.21%) Public Cloud
9 3 (0.91%) Enterprise Software
9 3 (0.91%) Market Risk
9 3 (0.91%) NHS
9 3 (0.91%) Taxonomies
10 2 (0.61%) Client/Server
10 2 (0.61%) Credit Risk
10 2 (0.61%) SCADA
11 1 (0.30%) Robotics
Operating Systems
1 12 (3.64%) Linux
1 12 (3.64%) Windows
2 5 (1.52%) Android
2 5 (1.52%) Apple iOS
3 4 (1.21%) Debian
3 4 (1.21%) Red Hat Enterprise Linux
3 4 (1.21%) Ubuntu
4 3 (0.91%) Unix
5 2 (0.61%) VMS
5 2 (0.61%) Windows 10
Processes & Methodologies
1 135 (40.91%) Business Intelligence
2 128 (38.79%) Data Modelling
3 105 (31.82%) Analytics
4 97 (29.39%) Agile Software Development
5 81 (24.55%) ETL
6 77 (23.33%) DevOps
7 57 (17.27%) Data Architecture
8 42 (12.73%) Data Governance
9 41 (12.42%) Data Management
10 38 (11.52%) Data Engineering
11 35 (10.61%) Data Analysis
12 34 (10.30%) Migration
13 31 (9.39%) Problem-Solving
14 28 (8.48%) Machine Learning
15 27 (8.18%) Data Ingestion
15 27 (8.18%) Scrum
16 26 (7.88%) TOGAF
17 25 (7.58%) Data Integration
17 25 (7.58%) Kimball Methodology
17 25 (7.58%) Master Data Management
Programming Languages
1 146 (44.24%) SQL
2 92 (27.88%) Python
3 26 (7.88%) C#
4 19 (5.76%) T-SQL
5 15 (4.55%) Java
6 10 (3.03%) Scala
7 9 (2.73%) JavaScript
7 9 (2.73%) PowerShell
8 7 (2.12%) R
9 6 (1.82%) C
9 6 (1.82%) Perl
9 6 (1.82%) PHP
10 5 (1.52%) Data Analysis Expressions (DAX)
11 4 (1.21%) TypeScript
12 3 (0.91%) Bash Shell
12 3 (0.91%) U-SQL
13 1 (0.30%) PROC SQL
13 1 (0.30%) SAS Macro
13 1 (0.30%) VB
13 1 (0.30%) VBA
Qualifications
1 15 (4.55%) Security Cleared
1 15 (4.55%) TOGAF Certification
2 12 (3.64%) SC Cleared
3 10 (3.03%) Microsoft Certification
4 7 (2.12%) AWS Certification
4 7 (2.12%) Degree
5 4 (1.21%) Computer Science Degree
5 4 (1.21%) CTC Cleared
6 1 (0.30%) ISTQB
6 1 (0.30%) ITIL Certification
6 1 (0.30%) MCSA
6 1 (0.30%) MCSE
6 1 (0.30%) MCTS
Quality Assurance & Compliance
1 43 (13.03%) Data Quality
2 24 (7.27%) QA
3 3 (0.91%) GDPR
4 2 (0.61%) Sarbanes-Oxley
5 1 (0.30%) IFRS
5 1 (0.30%) PCI DSS
System Software
1 24 (7.27%) Docker
2 10 (3.03%) Active Directory
3 9 (2.73%) HDFS
4 4 (1.21%) Apache Flume
5 3 (0.91%) Apache ZooKeeper
6 2 (0.61%) Virtual Machines
7 1 (0.30%) VMware ESXi
7 1 (0.30%) VMware Infrastructure
Systems Management
1 26 (7.88%) Kubernetes
2 9 (2.73%) Terraform
3 7 (2.12%) Grafana
3 7 (2.12%) Hadoop YARN
4 6 (1.82%) Ansible
4 6 (1.82%) Opscode Chef
5 5 (1.52%) Prometheus
6 3 (0.91%) Nagios
7 1 (0.30%) HP Quality Center
7 1 (0.30%) MIIS
7 1 (0.30%) Oozie
7 1 (0.30%) Puppet
Vendors
1 120 (36.36%) Databricks
2 109 (33.03%) Microsoft
3 33 (10.00%) SAP
4 15 (4.55%) Salesforce.com
5 13 (3.94%) Oracle
6 8 (2.42%) Informatica
6 8 (2.42%) MuleSoft
7 7 (2.12%) Atlassian
7 7 (2.12%) BiZZdesign
7 7 (2.12%) Cloudera
7 7 (2.12%) Google
7 7 (2.12%) Talend
8 5 (1.52%) ESRI
9 4 (1.21%) CA Agile Central
9 4 (1.21%) Red Hat
9 4 (1.21%) Sage
9 4 (1.21%) Sparx
9 4 (1.21%) Teradata
9 4 (1.21%) VMware
10 3 (0.91%) GoldenSource