Period
to 6 August 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 6 August 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
6 Aug 2020
Same period 2019 Same period 2018
Rank 236 303 467
Rank change year-on-year +67 +164 +197
Contract jobs citing Data Lake 344 703 464
As % of all contract jobs advertised in England 1.10% 0.85% 0.50%
As % of the Database & Business Intelligence category 4.99% 3.80% 2.16%
Number of daily rates quoted 252 532 302
Median daily rate £535 £525 £525
Median daily rate % change year-on-year +1.90% - -4.55%
10th Percentile £406 £401 £390
90th Percentile £725 £688 £713
UK median daily rate £525 £525 £500
% change year-on-year - +5.00% -9.09%
Number of hourly rates quoted 4 4 4
Median hourly rate £47.00 £72.50 £47.25
Median hourly rate % change year-on-year -35.17% +53.44% -
10th Percentile £35.00 £45.88 £29.48
90th Percentile £68.18 £73.75 £55.25
UK median hourly rate £47.00 £72.50 £47.25
% change year-on-year -35.17% +53.44% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 6,887 18,523 21,500
As % of all contract IT jobs advertised in England 21.92% 22.30% 22.95%
Number of daily rates quoted 4,528 12,854 15,143
Median daily rate £500 £475 £475
Median daily rate % change year-on-year +5.26% - +5.56%
10th Percentile £325 £325 £313
90th Percentile £700 £650 £638
UK median daily rate £500 £475 £463
% change year-on-year +5.26% +2.70% +2.78%
Number of hourly rates quoted 144 234 226
Median hourly rate £35.00 £35.00 £31.00
Median hourly rate % change year-on-year - +12.90% +3.33%
10th Percentile £15.28 £14.13 £14.14
90th Percentile £54.70 £60.00 £53.13
Median hourly rate £35.00 £35.00 £31.00
% change year-on-year - +12.90% -

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Lake in England.

Daily rate trend for Data Lake in England

Data Lake
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Lake in England over the 6 months to 6 August 2020.

Daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Lake in England.

Hourly rate trend for Data Lake in England

Data Lake
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Lake in England over the 6 months to 6 August 2020.

Hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 6 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +33 172 £550 +2.33% 24
South East +133 104 £525 +5.00% 8
East of England +87 24 £525 +5.00% 6
North of England +83 19 £525 +5.00% 15
North West +57 14 £525 +5.00% 14
South West +83 11 £475 +2.70% 3
Midlands +68 6 £650 +52.94% 6
Yorkshire +69 5 £500 +8.11% 1
West Midlands +52 4 £650 +52.94% 5
East Midlands +57 2 - - 1
Data Lake
UK

For the 6 months to 6 August 2020, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 246 (71.51%) Azure
2 176 (51.16%) SQL
3 158 (45.93%) Business Intelligence
4 155 (45.06%) Data Warehouse
5 145 (42.15%) Analytics
6 127 (36.92%) Agile Software Development
7 122 (35.47%) DevOps
8 121 (35.17%) Microsoft
9 107 (31.10%) Data Modelling
10 104 (30.23%) Power Platform
11 103 (29.94%) Power BI
12 99 (28.78%) Azure Data Factory
13 97 (28.20%) Big Data
14 87 (25.29%) Python
15 80 (23.26%) Databricks
16 77 (22.38%) ETL
17 73 (21.22%) SQL Server Integration Services
18 63 (18.31%) AWS
19 61 (17.73%) Azure SQL Database
20 60 (17.44%) C#
21 59 (17.15%) Scrum
22 56 (16.28%) Finance
23 53 (15.41%) SQL Server
24 51 (14.83%) Data Architecture
25 50 (14.53%) Azure SQL Data Warehouse
26 49 (14.24%) Apache Spark
27 44 (12.79%) Test Automation
28 43 (12.50%) Continuous Integration
28 43 (12.50%) Machine Learning
29 40 (11.63%) Java

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 49 (14.24%) Apache Spark
2 7 (2.03%) SharePoint
3 6 (1.74%) Apache Pig
4 3 (0.87%) Confluence
4 3 (0.87%) Elasticsearch
4 3 (0.87%) nginx
5 2 (0.58%) Apache
6 1 (0.29%) Cloud Foundry
6 1 (0.29%) Luigi
6 1 (0.29%) SAS
Applications
1 4 (1.16%) Microsoft Excel
1 4 (1.16%) Microsoft PowerPoint
2 2 (0.58%) MS Visio
2 2 (0.58%) Sketch
3 1 (0.29%) Chatbot
3 1 (0.29%) Microsoft Office
3 1 (0.29%) Spreadsheet
3 1 (0.29%) SPSS
Business Applications
1 7 (2.03%) SAP Oil and Gas
2 5 (1.45%) Dynamics AX
2 5 (1.45%) SAP S/4HANA
3 4 (1.16%) Sparx Enterprise Architect
4 3 (0.87%) SAP MDG
5 2 (0.58%) Oracle EBS
6 1 (0.29%) Actimize
6 1 (0.29%) Bloomberg AIM
6 1 (0.29%) FINCAD Analytics
6 1 (0.29%) Markit EDM
6 1 (0.29%) Oracle Payroll
6 1 (0.29%) Sage BI
6 1 (0.29%) SimCorp Dimension
6 1 (0.29%) thinkFolio
Cloud Services
1 246 (71.51%) Azure
2 104 (30.23%) Power Platform
3 99 (28.78%) Azure Data Factory
4 63 (18.31%) AWS
5 30 (8.72%) Amazon S3
6 27 (7.85%) PaaS
7 26 (7.56%) GCP
8 24 (6.98%) Serverless
9 21 (6.10%) IaaS
10 20 (5.81%) Azure Functions
10 20 (5.81%) Logic Apps
11 16 (4.65%) Azure Active Directory
12 12 (3.49%) PowerApps
13 10 (2.91%) Amazon EC2
13 10 (2.91%) Amazon EMR
13 10 (2.91%) Amazon SQS
14 8 (2.33%) GitHub
15 7 (2.03%) Dynamics 365
15 7 (2.03%) Power Automate
16 6 (1.74%) AWS Lambda
Communications & Networking
1 3 (0.87%) Skype
2 2 (0.58%) VPN
3 1 (0.29%) FTP
3 1 (0.29%) Internet
3 1 (0.29%) WAN
Database & Business Intelligence
1 155 (45.06%) Data Warehouse
2 103 (29.94%) Power BI
3 97 (28.20%) Big Data
4 73 (21.22%) SQL Server Integration Services
5 61 (17.73%) Azure SQL Database
6 53 (15.41%) SQL Server
7 50 (14.53%) Azure SQL Data Warehouse
8 39 (11.34%) Hadoop
8 39 (11.34%) HDInsight
9 32 (9.30%) Cosmos DB
10 29 (8.43%) Amazon Redshift
11 27 (7.85%) NoSQL
12 25 (7.27%) SQL Server Analysis Services
13 19 (5.52%) MySQL
14 16 (4.65%) Microsoft Analysis Services
15 15 (4.36%) Apache Hive
16 14 (4.07%) Amazon Athena
16 14 (4.07%) Amazon RDS
17 13 (3.78%) SAP BW
17 13 (3.78%) SQL Server Reporting Services
Development Applications
1 39 (11.34%) Git (software)
2 26 (7.56%) Visual Studio
3 22 (6.40%) Visual Studio Team System
4 16 (4.65%) Team Foundation Server
5 9 (2.62%) Jenkins
6 8 (2.33%) GitLab
7 7 (2.03%) Artifactory
7 7 (2.03%) JIRA
7 7 (2.03%) SpecFlow
8 5 (1.45%) Octopus Deploy
8 5 (1.45%) TeamCity
9 4 (1.16%) Cucumber
9 4 (1.16%) Selenium
9 4 (1.16%) Subversion
10 3 (0.87%) CircleCI
10 3 (0.87%) JUnit
10 3 (0.87%) PowerDesigner
10 3 (0.87%) SonarQube
10 3 (0.87%) SQL Server Management Studio (SSMS)
11 2 (0.58%) ERwin
General
1 56 (16.28%) Finance
2 15 (4.36%) Marketing
2 15 (4.36%) Retail
3 10 (2.91%) Banking
4 9 (2.62%) Pharmaceutical
4 9 (2.62%) Public Sector
5 7 (2.03%) Front Office
6 6 (1.74%) Advertising
7 4 (1.16%) Law
8 3 (0.87%) Legal
8 3 (0.87%) Telecoms
9 2 (0.58%) Games
9 2 (0.58%) Retail Banking
10 1 (0.29%) Back Office
10 1 (0.29%) Billing
10 1 (0.29%) Electronics
10 1 (0.29%) General Ledger
10 1 (0.29%) Investment Banking
10 1 (0.29%) Manufacturing
10 1 (0.29%) Police
Job Titles
1 81 (23.55%) Architect
2 65 (18.90%) Data Engineer
3 62 (18.02%) Developer
4 59 (17.15%) Data Architect
5 58 (16.86%) Azure Engineer
6 40 (11.63%) DevOps Engineer
7 29 (8.43%) Analyst
8 21 (6.10%) Azure Developer
9 19 (5.52%) Business Intelligence Developer
10 18 (5.23%) Azure DevOps
10 18 (5.23%) Azure DevOps Engineer
11 16 (4.65%) Azure Architect
12 15 (4.36%) Lead DevOps
13 14 (4.07%) Data Analytics Architect
14 13 (3.78%) Big Data Engineer
14 13 (3.78%) Data Analyst
14 13 (3.78%) Technical Leader
15 12 (3.49%) Business Analyst
16 11 (3.20%) Business Intelligence Analyst
16 11 (3.20%) Solutions Architect
Libraries, Frameworks & Software Standards
1 27 (7.85%) .NET
2 24 (6.98%) Kafka
3 14 (4.07%) PySpark
4 12 (3.49%) XML
5 7 (2.03%) .NET Framework
5 7 (2.03%) CSS
5 7 (2.03%) HTML
6 6 (1.74%) ASP.NET
6 6 (1.74%) ASP.NET MVC
6 6 (1.74%) Entity Framework
6 6 (1.74%) jQuery
6 6 (1.74%) Redux
6 6 (1.74%) Twitter Bootstrap
6 6 (1.74%) Web Services
6 6 (1.74%) XSLT
7 5 (1.45%) JSON
7 5 (1.45%) NumPy
7 5 (1.45%) Pandas
7 5 (1.45%) RESTful
7 5 (1.45%) SciPy
Miscellaneous
1 29 (8.43%) Analytical Skills
2 18 (5.23%) Greenfield Project
3 17 (4.94%) Data Structures
4 16 (4.65%) Management Information System
5 10 (2.91%) Algorithms
6 9 (2.62%) FMCG
7 8 (2.33%) Cloud Native
8 7 (2.03%) User Experience
9 6 (1.74%) Enterprise Software
10 4 (1.16%) Life Science
10 4 (1.16%) PMI
10 4 (1.16%) Replication
10 4 (1.16%) Taxonomies
11 3 (0.87%) Public Cloud
11 3 (0.87%) Reference Data
11 3 (0.87%) Social Media
11 3 (0.87%) Virtual Team
12 2 (0.58%) Blog
12 2 (0.58%) Derivative
12 2 (0.58%) Private Cloud
Operating Systems
1 34 (9.88%) Windows
2 29 (8.43%) Linux
3 17 (4.94%) VMS
4 6 (1.74%) Debian
4 6 (1.74%) Red Hat Enterprise Linux
4 6 (1.74%) Ubuntu
5 2 (0.58%) Unix
5 2 (0.58%) Windows Server
Processes & Methodologies
1 158 (45.93%) Business Intelligence
2 145 (42.15%) Analytics
3 127 (36.92%) Agile Software Development
4 122 (35.47%) DevOps
5 107 (31.10%) Data Modelling
6 77 (22.38%) ETL
7 59 (17.15%) Scrum
8 51 (14.83%) Data Architecture
9 44 (12.79%) Test Automation
10 43 (12.50%) Continuous Integration
10 43 (12.50%) Machine Learning
11 40 (11.63%) Data Management
12 36 (10.47%) Continuous Delivery
12 36 (10.47%) Data Governance
13 32 (9.30%) Data Integration
14 29 (8.43%) Data Engineering
14 29 (8.43%) Data Science
15 27 (7.85%) Migration
16 26 (7.56%) Data Security
16 26 (7.56%) Visualisation
Programming Languages
1 176 (51.16%) SQL
2 87 (25.29%) Python
3 60 (17.44%) C#
4 40 (11.63%) Java
5 39 (11.34%) PowerShell
5 39 (11.34%) T-SQL
6 22 (6.40%) JavaScript
7 20 (5.81%) Scala
8 10 (2.91%) PHP
9 9 (2.62%) Shell Script
10 6 (1.74%) C
10 6 (1.74%) Perl
10 6 (1.74%) XAML
11 5 (1.45%) R
12 4 (1.16%) Data Analysis Expressions (DAX)
12 4 (1.16%) Go
12 4 (1.16%) U-SQL
12 4 (1.16%) VB
13 3 (0.87%) Bash Shell
14 2 (0.58%) TypeScript
Qualifications
1 10 (2.91%) Degree
1 10 (2.91%) Security Cleared
2 8 (2.33%) Microsoft Certification
3 7 (2.03%) SC Cleared
4 5 (1.45%) AWS Certification
5 4 (1.16%) PMI Certification
6 3 (0.87%) TOGAF Certification
7 1 (0.29%) BPSS Clearance
7 1 (0.29%) Computer Science Degree
7 1 (0.29%) MCSA
7 1 (0.29%) MCSE
7 1 (0.29%) MCTS
Quality Assurance & Compliance
1 24 (6.98%) Data Quality
2 17 (4.94%) QA
3 10 (2.91%) GDPR
4 2 (0.58%) GxP
5 1 (0.29%) IFRS
System Software
1 24 (6.98%) Virtual Machines
2 22 (6.40%) Docker
3 17 (4.94%) Active Directory
4 2 (0.58%) HDFS
Systems Management
1 29 (8.43%) Kubernetes
2 7 (2.03%) Terraform
3 5 (1.45%) Ansible
4 3 (0.87%) Nagios
4 3 (0.87%) Puppet
5 2 (0.58%) CASB
5 2 (0.58%) Grafana
5 2 (0.58%) Kibana
5 2 (0.58%) Kubeflow
5 2 (0.58%) Oozie
5 2 (0.58%) Opscode Chef
5 2 (0.58%) Prometheus
5 2 (0.58%) Single Sign-On
6 1 (0.29%) Docker Swarm
6 1 (0.29%) Hadoop YARN
6 1 (0.29%) HP Quality Center
6 1 (0.29%) Packer
Vendors
1 121 (35.17%) Microsoft
2 80 (23.26%) Databricks
3 25 (7.27%) SAP
4 22 (6.40%) Informatica
4 22 (6.40%) Tableau
5 16 (4.65%) Google
5 16 (4.65%) Oracle
6 15 (4.36%) Talend
7 10 (2.91%) Hortonworks
8 9 (2.62%) Cloudera
9 8 (2.33%) Salesforce.com
10 7 (2.03%) MuleSoft
11 6 (1.74%) Red Hat
11 6 (1.74%) Sparx
11 6 (1.74%) Xamarin
12 4 (1.16%) IBM
12 4 (1.16%) StreamSets
13 3 (0.87%) New Relic
14 2 (0.58%) BiZZdesign
14 2 (0.58%) Palantir