Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 23 January 2020

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 23 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
23 Jan 2020		 Same period 2019 Same period 2018
Rank 240 384 569
Rank change year-on-year +144 +185 +127
Contract jobs citing Data Lake 775 658 330
As % of all contract IT jobs advertised in the UK 1.07% 0.66% 0.33%
As % of the Database & Business Intelligence category 5.09% 2.94% 1.49%
Number of daily rates quoted 551 456 264
UK median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% -9.09%
10th Percentile £398 £409 £371
90th Percentile £700 £725 £638
UK excluding London median daily rate £500 £525 £500
% change year-on-year -4.76% +5.00% +5.26%
Number of hourly rates quoted 3 0 1
UK median hourly rate £72.50 - £45.00
10th Percentile £28.85 - £40.00
90th Percentile £73.75 - £50.00
UK excluding London median hourly rate £72.50 - £45.00

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 15,223 22,361 22,113
As % of all contract IT jobs advertised in the UK 21.02% 22.44% 21.99%
Number of daily rates quoted 10,143 15,420 15,393
UK median daily rate £475 £475 £455
Median daily rate % change year-on-year - +4.40% +7.06%
10th Percentile £319 £317 £310
90th Percentile £663 £645 £625
UK excluding London median daily rate £438 £425 £400
% change year-on-year +2.94% +6.25% +3.23%
Number of hourly rates quoted 238 246 254
UK median hourly rate £32.00 £32.75 £30.63
Median hourly rate % change year-on-year -2.29% +6.94% +8.68%
10th Percentile £13.19 £13.25 £14.54
90th Percentile £53.75 £56.66 £56.41
UK excluding London median hourly rate £27.50 £32.75 £35.00
% change year-on-year -16.03% -6.43% +32.08%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake.

Contractor daily rate trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Lake over the 6 months to 23 January 2020.

Contractor daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake.

Contractor hourly rate trend for Data Lake in the UK

Data Lake
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Lake over the 6 months to 23 January 2020.

Contractor hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 23 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +139 746 £525 - 147
London +84 387 £550 +4.76% 97
UK excluding London +173 383 £500 -4.76% 57
South East +104 207 £488 -7.14% 23
South West +50 51 £700 +27.27% 6
North of England +34 43 £525 +5.00% 9
East of England +62 34 £650 +20.93% 5
Midlands +59 24 £471 -23.53% 7
North West +23 23 £500 -4.76% 5
Scotland +30 15 £500 +33.33% 7
West Midlands +58 14 £521 +19.14% 5
Yorkshire +42 14 £613 +20.10% 4
East Midlands +40 10 £425 -49.70% 2
Wales +38 10 £525 -6.25%
North East +14 6 £650 +28.40%

For the 6 months to 23 January 2020, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 504 (65.03%) Azure
2 404 (52.13%) Analytics
3 394 (50.84%) SQL
4 326 (42.06%) Data Warehouse
5 311 (40.13%) Business Intelligence
6 296 (38.19%) Microsoft
7 278 (35.87%) Agile Software Development
8 273 (35.23%) Power Platform
9 272 (35.10%) Power BI
10 229 (29.55%) Azure Data Factory
11 219 (28.26%) DevOps
12 212 (27.35%) Big Data
13 202 (26.06%) SQL Server Integration Services
14 198 (25.55%) Python
15 178 (22.97%) ETL
16 173 (22.32%) AWS
17 165 (21.29%) Data Modelling
18 134 (17.29%) SQL Server
19 123 (15.87%) Databricks
20 117 (15.10%) Azure SQL Database
21 109 (14.06%) Data Management
22 108 (13.94%) Finance
23 107 (13.81%) Hadoop
24 105 (13.55%) Data Architecture
25 103 (13.29%) Data Science
26 100 (12.90%) Azure SQL Data Warehouse
27 98 (12.65%) Data Analytics
27 98 (12.65%) PowerShell
28 94 (12.13%) C#
28 94 (12.13%) Serverless

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 77 (9.94%) Apache Spark
2 21 (2.71%) Apache
3 18 (2.32%) Apache Airflow
4 17 (2.19%) SAS
5 13 (1.68%) SharePoint
6 11 (1.42%) Jupyter
7 7 (0.90%) Elasticsearch
8 5 (0.65%) CMS
8 5 (0.65%) Confluence
9 3 (0.39%) Apache Solr
9 3 (0.39%) Headless CMS
9 3 (0.39%) IBM Domino
10 2 (0.26%) EPiServer
10 2 (0.26%) MQSeries
10 2 (0.26%) Oracle Coherence
10 2 (0.26%) SharePoint 2013
11 1 (0.13%) Apache Pig
11 1 (0.13%) IIS
11 1 (0.13%) nginx
11 1 (0.13%) WordPress
Applications
1 18 (2.32%) Microsoft Excel
2 5 (0.65%) Microsoft Office
3 4 (0.52%) SPSS
4 1 (0.13%) AutoCAD
Business Applications
1 8 (1.03%) SAP Oil and Gas
2 6 (0.77%) SAP S/4HANA
3 5 (0.65%) Sparx Enterprise Architect
4 4 (0.52%) Dynamics CRM
4 4 (0.52%) Salesforce.com CRM
5 3 (0.39%) FINCAD Analytics
6 2 (0.26%) Eloqua
6 2 (0.26%) Maximo
6 2 (0.26%) SAP ERP
6 2 (0.26%) SAP HR
6 2 (0.26%) SAP PLM
7 1 (0.13%) NetSuite
7 1 (0.13%) Payment Gateway
7 1 (0.13%) SAP MDG
7 1 (0.13%) SAP MDM
Cloud Services
1 504 (65.03%) Azure
2 273 (35.23%) Power Platform
3 229 (29.55%) Azure Data Factory
4 173 (22.32%) AWS
5 94 (12.13%) Serverless
6 91 (11.74%) Data Lake Analytics
7 67 (8.65%) PaaS
8 55 (7.10%) Amazon S3
9 51 (6.58%) IaaS
10 47 (6.06%) Azure Functions
11 42 (5.42%) GCP
12 26 (3.35%) AWS Lambda
13 25 (3.23%) Azure Machine Learning
13 25 (3.23%) SaaS
14 19 (2.45%) Amazon EC2
15 17 (2.19%) Azure Active Directory
16 16 (2.06%) GitHub
17 15 (1.94%) Amazon EMR
18 12 (1.55%) Amazon Kinesis
18 12 (1.55%) Azure Stack
Communications & Networking
1 10 (1.29%) SAN
2 5 (0.65%) Firewall
3 4 (0.52%) DNS
3 4 (0.52%) SSL
4 3 (0.39%) Internet
5 2 (0.26%) Extranet
5 2 (0.26%) FTP
5 2 (0.26%) Intranet
6 1 (0.13%) DHCP
6 1 (0.13%) HTTP
6 1 (0.13%) HTTPS
6 1 (0.13%) Kerberos
6 1 (0.13%) Skype
6 1 (0.13%) SMTP
6 1 (0.13%) Telnet
6 1 (0.13%) VPN
Database & Business Intelligence
1 326 (42.06%) Data Warehouse
2 272 (35.10%) Power BI
3 212 (27.35%) Big Data
4 202 (26.06%) SQL Server Integration Services
5 134 (17.29%) SQL Server
6 117 (15.10%) Azure SQL Database
7 107 (13.81%) Hadoop
8 100 (12.90%) Azure SQL Data Warehouse
9 78 (10.06%) NoSQL
10 72 (9.29%) HDInsight
10 72 (9.29%) SQL Server Analysis Services
11 64 (8.26%) Amazon Redshift
12 62 (8.00%) SQL Server Reporting Services
13 50 (6.45%) Cosmos DB
14 48 (6.19%) Relational Database
15 34 (4.39%) Snowflake Schema
16 32 (4.13%) Data Mart
17 29 (3.74%) Amazon Athena
18 26 (3.35%) BigQuery
18 26 (3.35%) MongoDB
Development Applications
1 90 (11.61%) Visual Studio
2 83 (10.71%) Visual Studio Team System
3 36 (4.65%) Git (software)
4 29 (3.74%) Jenkins
5 20 (2.58%) JIRA
6 14 (1.81%) Team Foundation Server
7 8 (1.03%) Maven
8 7 (0.90%) Atlassian Bamboo
8 7 (0.90%) Cucumber
8 7 (0.90%) ERwin
8 7 (0.90%) TeamCity
9 6 (0.77%) NUnit
9 6 (0.77%) PowerDesigner
9 6 (0.77%) Selenium
10 5 (0.65%) Subversion
11 4 (0.52%) Concordion
11 4 (0.52%) EasyMock
11 4 (0.52%) Gradle
11 4 (0.52%) Mockito
11 4 (0.52%) Moq
General
1 108 (13.94%) Finance
2 37 (4.77%) Retail
3 28 (3.61%) Marketing
4 22 (2.84%) Public Sector
5 19 (2.45%) Front Office
6 13 (1.68%) Banking
7 12 (1.55%) Legal
8 9 (1.16%) Telecoms
9 7 (0.90%) Advertising
9 7 (0.90%) Pharmaceutical
10 5 (0.65%) Automotive
10 5 (0.65%) Manufacturing
11 3 (0.39%) Aerospace
11 3 (0.39%) Back Office
11 3 (0.39%) Games
11 3 (0.39%) Local Government
12 2 (0.26%) Investment Banking
12 2 (0.26%) Law
12 2 (0.26%) Retail Banking
13 1 (0.13%) Publishing
Job Titles
1 209 (26.97%) Architect
2 157 (20.26%) Data Architect
3 139 (17.94%) Data Engineer
3 139 (17.94%) Developer
4 83 (10.71%) Azure Engineer
5 72 (9.29%) DevOps Engineer
6 71 (9.16%) Analyst
7 70 (9.03%) Azure Architect
8 58 (7.48%) Azure Developer
9 43 (5.55%) Consultant
9 43 (5.55%) Solutions Architect
10 33 (4.26%) Business Intelligence Developer
11 32 (4.13%) Azure DevOps Engineer
12 28 (3.61%) Data Consultant
13 27 (3.48%) Enterprise Architect
14 26 (3.35%) Service Analyst
15 25 (3.23%) SQL Developer
16 24 (3.10%) Service Transition Analyst
16 24 (3.10%) Transition Analyst
17 22 (2.84%) Azure Consultant
Libraries, Frameworks & Software Standards
1 52 (6.71%) .NET
2 36 (4.65%) Kafka
3 23 (2.97%) MDX
3 23 (2.97%) XML
4 22 (2.84%) JSON
5 19 (2.45%) Node.js
5 19 (2.45%) REST
5 19 (2.45%) Web Services
6 14 (1.81%) Apache NiFi
7 13 (1.68%) SOAP
8 11 (1.42%) .NET Core
8 11 (1.42%) PySpark
9 10 (1.29%) React
10 9 (1.16%) .NET Framework
11 8 (1.03%) AngularJS
12 7 (0.90%) GraphQL
12 7 (0.90%) Lambda Expressions
12 7 (0.90%) Natural Language Processing
13 6 (0.77%) Django
13 6 (0.77%) Pandas
Miscellaneous
1 45 (5.81%) Analytical Skills
2 39 (5.03%) Greenfield Project
3 20 (2.58%) Data Structures
3 20 (2.58%) Management Information System
3 20 (2.58%) Public Cloud
4 17 (2.19%) Algorithms
5 12 (1.55%) Reference Data
6 11 (1.42%) Data Centre
6 11 (1.42%) Private Cloud
7 7 (0.90%) Cloud Native
7 7 (0.90%) Hybrid Cloud
7 7 (0.90%) Replication
8 6 (0.77%) Clustering
8 6 (0.77%) Social Media
9 5 (0.65%) Linux Command Line
10 4 (0.52%) Enterprise Software
11 3 (0.39%) Enterprise Cloud
11 3 (0.39%) Hedge funds
11 3 (0.39%) Self-Motivation
11 3 (0.39%) Virtual Team
Operating Systems
1 52 (6.71%) Windows
2 28 (3.61%) Linux
3 15 (1.94%) Windows Server
4 13 (1.68%) Unix
5 12 (1.55%) Red Hat Enterprise Linux
6 10 (1.29%) CentOS
7 8 (1.03%) VMS
8 1 (0.13%) Apple iOS
8 1 (0.13%) Windows 10
8 1 (0.13%) Windows Server 2008
8 1 (0.13%) Windows Server 2012
Processes & Methodologies
1 404 (52.13%) Analytics
2 311 (40.13%) Business Intelligence
3 278 (35.87%) Agile Software Development
4 219 (28.26%) DevOps
5 178 (22.97%) ETL
6 165 (21.29%) Data Modelling
7 109 (14.06%) Data Management
8 105 (13.55%) Data Architecture
9 103 (13.29%) Data Science
10 98 (12.65%) Data Analytics
11 91 (11.74%) Test Automation
12 86 (11.10%) Migration
13 85 (10.97%) Machine Learning
14 76 (9.81%) Data Engineering
15 70 (9.03%) Continuous Integration
15 70 (9.03%) Infrastructure as Code
16 68 (8.77%) Data Governance
17 67 (8.65%) Master Data Management
18 65 (8.39%) Scrum
19 64 (8.26%) Visualisation
Programming Languages
1 394 (50.84%) SQL
2 198 (25.55%) Python
3 98 (12.65%) PowerShell
4 94 (12.13%) C#
5 75 (9.68%) Scala
6 53 (6.84%) R
7 43 (5.55%) Java
8 28 (3.61%) T-SQL
9 24 (3.10%) Data Analysis Expressions (DAX)
10 20 (2.58%) JavaScript
11 18 (2.32%) U-SQL
12 16 (2.06%) Bash Shell
13 11 (1.42%) C
14 10 (1.29%) Ruby
15 7 (0.90%) C++
16 6 (0.77%) PL/SQL
17 4 (0.52%) Java 8
17 4 (0.52%) Perl
17 4 (0.52%) VBA
18 3 (0.39%) Go
Qualifications
1 26 (3.35%) Degree
2 18 (2.32%) Security Cleared
3 14 (1.81%) SC Cleared
4 10 (1.29%) DBS Check
5 6 (0.77%) TOGAF Certification
6 5 (0.65%) AWS Certification
7 3 (0.39%) ITIL Certification
8 2 (0.26%) BPSS Clearance
8 2 (0.26%) CEH
8 2 (0.26%) Cisco Certification
8 2 (0.26%) CISSP
8 2 (0.26%) Microsoft Certification
8 2 (0.26%) PMI Certification
9 1 (0.13%) (ISC)2 CCSP
9 1 (0.13%) CCSP
9 1 (0.13%) CISM
9 1 (0.13%) CompTIA Security+
9 1 (0.13%) ISEB
9 1 (0.13%) PRINCE2 Certification
9 1 (0.13%) SSCP
Quality Assurance & Compliance
1 51 (6.58%) Data Quality
2 25 (3.23%) QA
3 17 (2.19%) GDPR
4 2 (0.26%) ISO/IEC 27001
4 2 (0.26%) PCI DSS
5 1 (0.13%) COBIT
5 1 (0.13%) IFRS
5 1 (0.13%) IFRS 9
5 1 (0.13%) Solvency II
System Software
1 46 (5.94%) Virtual Machines
2 39 (5.03%) Docker
3 20 (2.58%) Active Directory
4 10 (1.29%) HDFS
4 10 (1.29%) Virtual Desktop
4 10 (1.29%) Virtual Servers
5 4 (0.52%) Apache ZooKeeper
5 4 (0.52%) VMware Infrastructure
6 2 (0.26%) Hyper-V
7 1 (0.13%) Apache Flume
7 1 (0.13%) NFS
Systems Management
1 39 (5.03%) Kubernetes
2 29 (3.74%) Terraform
3 15 (1.94%) Ansible
4 12 (1.55%) Oozie
5 11 (1.42%) Puppet
6 8 (1.03%) Grafana
7 4 (0.52%) Kibana
7 4 (0.52%) logstash
7 4 (0.52%) Packer
8 2 (0.26%) Control-M
8 2 (0.26%) Nessus
8 2 (0.26%) Opscode Chef
8 2 (0.26%) Salt
9 1 (0.13%) AirWatch
9 1 (0.13%) Hadoop YARN
9 1 (0.13%) Kubeflow
9 1 (0.13%) Microsoft Intune
9 1 (0.13%) Prometheus
9 1 (0.13%) SCCM
9 1 (0.13%) Single Sign-On
Vendors
1 296 (38.19%) Microsoft
2 123 (15.87%) Databricks
3 76 (9.81%) Tableau
4 51 (6.58%) Oracle
5 41 (5.29%) Informatica
6 39 (5.03%) SAP
7 37 (4.77%) Cloudera
8 34 (4.39%) Talend
9 24 (3.10%) Alteryx
10 15 (1.94%) Google
11 14 (1.81%) StreamSets
12 12 (1.55%) Hortonworks
13 11 (1.42%) Salesforce.com
14 9 (1.16%) Teradata
15 7 (0.90%) Splunk
16 5 (0.65%) Sparx
16 5 (0.65%) VMware
17 4 (0.52%) AppDynamics
17 4 (0.52%) Cisco
17 4 (0.52%) MicroStrategy