Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 19 November 2019

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 19 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
19 Nov 2019		 Same period 2018 Same period 2017
Rank 284 425 663
Rank change year-on-year +141 +238 +89
Contract jobs citing Data Lake 765 584 230
As % of all contract IT jobs advertised in the UK 0.91% 0.57% 0.23%
As % of the Database & Business Intelligence category 4.28% 2.51% 1.03%
Number of daily rates quoted 541 396 173
UK median daily rate £550 £525 £550
Median daily rate % change year-on-year +4.76% -4.55% -6.38%
10th Percentile £406 £381 £361
90th Percentile £713 £706 £700
UK excluding London median daily rate £500 £500 £550
% change year-on-year - -9.09% +15.79%
Number of hourly rates quoted 6 2 1
UK median hourly rate £72.50 £49.75 £45.00
Median hourly rate % change year-on-year +45.73% +10.56% -
10th Percentile £53.13 £43.28 £40.00
90th Percentile £73.75 £56.43 £50.00
UK excluding London median hourly rate £72.50 £49.75 £45.00
% change year-on-year +45.73% +10.56% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 17,891 23,226 22,428
As % of all contract IT jobs advertised in the UK 21.35% 22.49% 22.11%
Number of daily rates quoted 12,079 16,160 15,317
UK median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +5.88%
10th Percentile £319 £313 £310
90th Percentile £657 £638 £625
UK excluding London median daily rate £438 £425 £400
% change year-on-year +2.94% +6.25% +5.96%
Number of hourly rates quoted 257 241 285
UK median hourly rate £32.58 £33.50 £31.15
Median hourly rate % change year-on-year -2.75% +7.54% +10.54%
10th Percentile £12.75 £13.69 £14.00
90th Percentile £71.55 £57.50 £58.00
UK excluding London median hourly rate £30.00 £35.00 £35.00
% change year-on-year -14.29% - +24.20%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake.

Contractor daily rate trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Lake over the 6 months to 19 November 2019.

Contractor daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake.

Contractor hourly rate trend for Data Lake in the UK

Data Lake
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Lake over the 6 months to 19 November 2019.

Contractor hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 19 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +145 736 £550 +4.76% 95
London +93 426 £550 - 57
UK excluding London +151 336 £500 - 45
South East +74 164 £500 -3.61% 14
North of England +49 42 £500 -4.31% 11
East of England +64 38 £613 +16.67% 4
South West +18 37 £700 +43.59% 2
Midlands +71 29 £500 +14.29% 7
North West +20 29 £500 -4.76% 8
West Midlands +51 22 £493 +12.57% 4
Scotland +23 20 £475 +30.14% 4
Yorkshire +29 10 £563 +3.21% 3
East Midlands +30 7 £563 - 3
Wales +32 6 £675 +28.57% 3
North East +21 3 £525 -8.70%

For the 6 months to 19 November 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 492 (64.31%) Azure
2 372 (48.63%) SQL
3 349 (45.62%) Data Warehouse
3 349 (45.62%) Analytics
4 304 (39.74%) Business Intelligence
5 262 (34.25%) Microsoft
6 254 (33.20%) Power Platform
7 253 (33.07%) Power BI
8 250 (32.68%) Big Data
9 246 (32.16%) Agile Software Development
10 238 (31.11%) Azure Data Factory
11 207 (27.06%) Python
12 187 (24.44%) DevOps
13 174 (22.75%) SQL Server Integration Services
14 167 (21.83%) ETL
15 166 (21.70%) AWS
16 152 (19.87%) Data Modelling
17 149 (19.48%) Databricks
18 142 (18.56%) Hadoop
19 131 (17.12%) SQL Server
20 123 (16.08%) Azure SQL Database
21 117 (15.29%) C#
22 116 (15.16%) Finance
23 114 (14.90%) Serverless
24 108 (14.12%) Azure SQL Data Warehouse
24 108 (14.12%) Apache Spark
25 101 (13.20%) Data Science
26 93 (12.16%) Migration
27 92 (12.03%) Machine Learning
28 91 (11.90%) Data Architecture

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 108 (14.12%) Apache Spark
2 25 (3.27%) Apache
3 21 (2.75%) SAS
4 15 (1.96%) Apache Airflow
4 15 (1.96%) SharePoint
5 10 (1.31%) Jupyter
6 8 (1.05%) Elasticsearch
7 7 (0.92%) Confluence
8 4 (0.52%) Apache Solr
9 3 (0.39%) IBM Domino
10 2 (0.26%) OpenStack
10 2 (0.26%) SharePoint 2013
11 1 (0.13%) Apache Pig
11 1 (0.13%) CMS
11 1 (0.13%) Headless CMS
11 1 (0.13%) IIS
11 1 (0.13%) MQSeries
11 1 (0.13%) Oracle Coherence
11 1 (0.13%) WordPress
Applications
1 19 (2.48%) Microsoft Excel
2 4 (0.52%) SPSS
3 2 (0.26%) AutoCAD
3 2 (0.26%) Sketch
4 1 (0.13%) Microsoft Office
Business Applications
1 8 (1.05%) SAP Oil and Gas
2 6 (0.78%) Sparx Enterprise Architect
3 5 (0.65%) Dynamics CRM
4 3 (0.39%) Eloqua
4 3 (0.39%) FINCAD Analytics
5 2 (0.26%) Dynamics AX
5 2 (0.26%) Dynamics NAV
5 2 (0.26%) Maximo
5 2 (0.26%) SAP ERP
5 2 (0.26%) SAP HR
5 2 (0.26%) SAP PLM
5 2 (0.26%) Workday HCM
6 1 (0.13%) Markit EDM
6 1 (0.13%) NetSuite
6 1 (0.13%) Payment Gateway
6 1 (0.13%) SAP MDG
6 1 (0.13%) SAP MDM
Cloud Services
1 492 (64.31%) Azure
2 254 (33.20%) Power Platform
3 238 (31.11%) Azure Data Factory
4 166 (21.70%) AWS
5 114 (14.90%) Serverless
6 88 (11.50%) Data Lake Analytics
7 55 (7.19%) Amazon S3
8 49 (6.41%) Azure Functions
9 45 (5.88%) PaaS
10 44 (5.75%) GCP
11 34 (4.44%) IaaS
12 29 (3.79%) AWS Lambda
13 27 (3.53%) SaaS
14 23 (3.01%) Azure Machine Learning
15 20 (2.61%) iPaaS
16 18 (2.35%) Amazon EMR
17 17 (2.22%) Amazon EC2
18 15 (1.96%) GitHub
19 14 (1.83%) Azure Active Directory
20 10 (1.31%) Office 365
Communications & Networking
1 7 (0.92%) SAN
2 5 (0.65%) Firewall
2 5 (0.65%) Internet
3 2 (0.26%) DNS
3 2 (0.26%) Extranet
3 2 (0.26%) FTP
3 2 (0.26%) HTTP
3 2 (0.26%) Intranet
3 2 (0.26%) Kerberos
3 2 (0.26%) Software-Defined Networking
3 2 (0.26%) SSL
4 1 (0.13%) DHCP
4 1 (0.13%) HTTPS
4 1 (0.13%) SMTP
4 1 (0.13%) Telnet
4 1 (0.13%) VPN
Database & Business Intelligence
1 349 (45.62%) Data Warehouse
2 253 (33.07%) Power BI
3 250 (32.68%) Big Data
4 174 (22.75%) SQL Server Integration Services
5 142 (18.56%) Hadoop
6 131 (17.12%) SQL Server
7 123 (16.08%) Azure SQL Database
8 108 (14.12%) Azure SQL Data Warehouse
9 87 (11.37%) SQL Server Analysis Services
10 71 (9.28%) SQL Server Reporting Services
11 66 (8.63%) Cosmos DB
12 63 (8.24%) NoSQL
13 53 (6.93%) Amazon Redshift
14 52 (6.80%) Apache Hive
15 48 (6.27%) Relational Database
16 45 (5.88%) HDInsight
17 35 (4.58%) Data Mart
18 29 (3.79%) Microsoft Analysis Services
19 27 (3.53%) Snowflake Schema
20 24 (3.14%) Impala
Development Applications
1 80 (10.46%) Visual Studio Team System
2 52 (6.80%) Visual Studio
3 44 (5.75%) Git (software)
4 33 (4.31%) Jenkins
5 30 (3.92%) JIRA
6 16 (2.09%) Team Foundation Server
7 12 (1.57%) Cucumber
8 11 (1.44%) PowerDesigner
9 10 (1.31%) ERwin
10 9 (1.18%) Atlassian Bamboo
10 9 (1.18%) Maven
11 8 (1.05%) Selenium
12 7 (0.92%) TeamCity
13 6 (0.78%) Jasmine
13 6 (0.78%) NUnit
14 5 (0.65%) ER Studio
15 4 (0.52%) Bitbucket
15 4 (0.52%) Concordion
15 4 (0.52%) EasyMock
15 4 (0.52%) Gradle
General
1 116 (15.16%) Finance
2 37 (4.84%) Retail
3 27 (3.53%) Public Sector
4 26 (3.40%) Marketing
5 17 (2.22%) Banking
6 16 (2.09%) Front Office
7 14 (1.83%) Advertising
7 14 (1.83%) Legal
8 9 (1.18%) Telecoms
9 3 (0.39%) Investment Banking
9 3 (0.39%) Local Government
9 3 (0.39%) Pharmaceutical
9 3 (0.39%) Publishing
9 3 (0.39%) Retail Banking
10 2 (0.26%) Automotive
10 2 (0.26%) Games
11 1 (0.13%) Financial Institution
11 1 (0.13%) Manufacturing
Job Titles
1 217 (28.37%) Architect
2 166 (21.70%) Data Architect
3 140 (18.30%) Data Engineer
4 137 (17.91%) Developer
5 78 (10.20%) Azure Engineer
6 67 (8.76%) Azure Architect
7 63 (8.24%) Azure Developer
8 49 (6.41%) Analyst
9 48 (6.27%) DevOps Engineer
10 44 (5.75%) Consultant
11 38 (4.97%) Azure DevOps
11 38 (4.97%) Solutions Architect
12 35 (4.58%) Business Intelligence Developer
13 30 (3.92%) Azure DevOps Engineer
13 30 (3.92%) SQL Developer
14 29 (3.79%) Big Data Engineer
15 24 (3.14%) Data Consultant
16 23 (3.01%) C# Developer
17 22 (2.88%) Senior Data Engineer
18 21 (2.75%) Azure Consultant
Libraries, Frameworks & Software Standards
1 59 (7.71%) .NET
2 58 (7.58%) Kafka
3 38 (4.97%) JSON
4 36 (4.71%) Web Services
5 34 (4.44%) XML
6 27 (3.53%) MDX
7 23 (3.01%) REST
8 20 (2.61%) .NET Core
9 18 (2.35%) SOAP
10 14 (1.83%) AngularJS
10 14 (1.83%) React
11 12 (1.57%) Apache NiFi
12 11 (1.44%) Apache Avro
13 9 (1.18%) .NET Framework
13 9 (1.18%) Node.js
14 8 (1.05%) Lambda Expressions
14 8 (1.05%) PySpark
14 8 (1.05%) RESTful
15 7 (0.92%) Velocity
16 6 (0.78%) Spark Streaming
Miscellaneous
1 52 (6.80%) Analytical Skills
2 48 (6.27%) Greenfield Project
3 23 (3.01%) Management Information System
4 17 (2.22%) Data Structures
4 17 (2.22%) Public Cloud
5 15 (1.96%) Private Cloud
6 13 (1.70%) Algorithms
7 11 (1.44%) Reference Data
8 9 (1.18%) User Experience
9 7 (0.92%) Hybrid Cloud
9 7 (0.92%) Virtual Team
10 6 (0.78%) Cloud Native
10 6 (0.78%) Replication
11 5 (0.65%) Data Centre
11 5 (0.65%) Linux Command Line
11 5 (0.65%) Self-Motivation
12 4 (0.52%) Clustering
13 3 (0.39%) Fixed Income
13 3 (0.39%) Hedge funds
13 3 (0.39%) Learning Management System
Operating Systems
1 29 (3.79%) Linux
1 29 (3.79%) Windows
2 24 (3.14%) Unix
3 11 (1.44%) VMS
3 11 (1.44%) Windows Server
4 9 (1.18%) Red Hat Enterprise Linux
5 8 (1.05%) CentOS
6 1 (0.13%) Apple iOS
6 1 (0.13%) Windows Server 2008
6 1 (0.13%) Windows Server 2012
Processes & Methodologies
1 349 (45.62%) Analytics
2 304 (39.74%) Business Intelligence
3 246 (32.16%) Agile Software Development
4 187 (24.44%) DevOps
5 167 (21.83%) ETL
6 152 (19.87%) Data Modelling
7 101 (13.20%) Data Science
8 93 (12.16%) Migration
9 92 (12.03%) Machine Learning
10 91 (11.90%) Data Architecture
11 88 (11.50%) Data Management
12 84 (10.98%) Data Analytics
13 74 (9.67%) Test Automation
14 72 (9.41%) Data Governance
14 72 (9.41%) Visualisation
15 71 (9.28%) Data Engineering
15 71 (9.28%) Master Data Management
15 71 (9.28%) Scrum
16 70 (9.15%) Data Integration
17 58 (7.58%) Stakeholder Management
Programming Languages
1 372 (48.63%) SQL
2 207 (27.06%) Python
3 117 (15.29%) C#
4 79 (10.33%) PowerShell
5 72 (9.41%) Scala
6 56 (7.32%) R
7 49 (6.41%) Java
8 29 (3.79%) T-SQL
9 28 (3.66%) Data Analysis Expressions (DAX)
10 21 (2.75%) JavaScript
11 19 (2.48%) U-SQL
12 11 (1.44%) Bash Shell
13 8 (1.05%) C
13 8 (1.05%) C++
13 8 (1.05%) Go
14 7 (0.92%) PL/SQL
15 5 (0.65%) Ruby
16 4 (0.52%) Perl
16 4 (0.52%) Shell Script
17 3 (0.39%) Java 8
Qualifications
1 31 (4.05%) Degree
2 28 (3.66%) Security Cleared
3 23 (3.01%) SC Cleared
4 10 (1.31%) DBS Check
5 6 (0.78%) TOGAF Certification
6 4 (0.52%) AWS Certification
7 3 (0.39%) CEH
8 2 (0.26%) CISM
8 2 (0.26%) CISSP
8 2 (0.26%) Computer Science Degree
8 2 (0.26%) ISEB
8 2 (0.26%) Microsoft Certification
8 2 (0.26%) PMI Certification
8 2 (0.26%) PRINCE2 Certification
9 1 (0.13%) BPSS Clearance
9 1 (0.13%) CISA
9 1 (0.13%) Cisco Certification
9 1 (0.13%) GIAC
9 1 (0.13%) OSCP
9 1 (0.13%) SSCP
Quality Assurance & Compliance
1 66 (8.63%) Data Quality
2 17 (2.22%) QA
3 15 (1.96%) GDPR
4 2 (0.26%) ISO/IEC 27001
4 2 (0.26%) PCI DSS
5 1 (0.13%) GxP
System Software
1 49 (6.41%) Docker
2 23 (3.01%) HDFS
3 21 (2.75%) Virtual Machines
4 17 (2.22%) Active Directory
5 7 (0.92%) Virtual Desktop
5 7 (0.92%) Virtual Servers
6 5 (0.65%) Apache Flume
6 5 (0.65%) VMware Infrastructure
7 2 (0.26%) Apache ZooKeeper
7 2 (0.26%) Hyper-V
7 2 (0.26%) NFS
8 1 (0.13%) Postfix
8 1 (0.13%) Samba
8 1 (0.13%) VMware ESXi
Systems Management
1 51 (6.67%) Kubernetes
2 21 (2.75%) Terraform
3 19 (2.48%) Ansible
4 10 (1.31%) Oozie
5 9 (1.18%) Puppet
6 8 (1.05%) Grafana
7 7 (0.92%) Hadoop YARN
8 4 (0.52%) Opscode Chef
8 4 (0.52%) Packer
9 3 (0.39%) Control-M
10 2 (0.26%) Kibana
10 2 (0.26%) logstash
10 2 (0.26%) Nessus
10 2 (0.26%) Salt
11 1 (0.13%) AirWatch
11 1 (0.13%) Ambari
11 1 (0.13%) Kubeflow
11 1 (0.13%) SCCM
11 1 (0.13%) yum
Vendors
1 262 (34.25%) Microsoft
2 149 (19.48%) Databricks
3 84 (10.98%) Tableau
4 48 (6.27%) Oracle
5 41 (5.36%) Informatica
6 39 (5.10%) Talend
7 37 (4.84%) Cloudera
8 28 (3.66%) Google
9 27 (3.53%) SAP
10 23 (3.01%) Alteryx
11 13 (1.70%) Splunk
11 13 (1.70%) StreamSets
12 12 (1.57%) Teradata
13 11 (1.44%) Hortonworks
14 6 (0.78%) MuleSoft
14 6 (0.78%) SnapLogic
14 6 (0.78%) Sparx
14 6 (0.78%) VMware
15 5 (0.65%) MicroStrategy
15 5 (0.65%) TIBCO