Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 18 December 2018

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 18 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
18 Dec 2018		 Same period 2017 Same period 2016
Rank 390 625 728
Rank change year-on-year +235 +103 +162
Contract jobs citing Data Lake 651 284 162
As % of all contract IT jobs advertised in the UK 0.62% 0.27% 0.16%
As % of the Database & Business Intelligence category 2.74% 1.25% 0.70%
Number of daily rates quoted 436 221 112
UK median daily rate £525 £550 £551
Median daily rate % change year-on-year -4.55% -0.23% +0.23%
10th Percentile £381 £363 £401
90th Percentile £713 £675 £745
UK excluding London median daily rate £513 £550 £475
% change year-on-year -6.82% +15.79% -13.64%
Number of hourly rates quoted 0 1 0
UK median hourly rate - £45.00 -
UK excluding London median hourly rate - £45.00 -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 23,717 22,661 23,016
As % of all contract IT jobs advertised in the UK 22.62% 21.94% 22.60%
Number of daily rates quoted 16,455 15,623 15,230
UK median daily rate £475 £450 £425
Median daily rate % change year-on-year +5.56% +5.88% +3.03%
10th Percentile £314 £310 £288
90th Percentile £638 £625 £600
UK excluding London median daily rate £425 £400 £385
% change year-on-year +6.25% +3.90% +2.67%
Number of hourly rates quoted 261 264 345
UK median hourly rate £32.00 £30.95 £28.18
Median hourly rate % change year-on-year +3.39% +9.83% +2.47%
10th Percentile £13.69 £14.54 £10.52
90th Percentile £57.33 £56.84 £48.75
UK excluding London median hourly rate £32.50 £35.00 £28.00
% change year-on-year -7.14% +25.00% -

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake.

Contractor daily rate trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Lake over the 6 months to 18 December 2018.

Contractor daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake.

Contractor hourly rate trend for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 18 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +216 622 £525 -4.55% 84
London +196 401 £550 - 45
UK excluding London +81 241 £513 -6.82% 42
South East +66 146 £525 -8.70% 15
North of England +13 34 £515 -15.57% 9
North West +7 21 £525 -13.93% 4
Scotland +7 19 £375 -11.76% 3
South West -22 18 £572 +27.11% 7
Midlands -7 14 £616 +54.06% 4
Yorkshire -2 13 £620 +1.64% 3
East of England -15 9 £538 -4.87% 4
East Midlands +15 7 £845 +170.40% 3
West Midlands -27 7 £438 -7.89% 1
North East -10 3 £525 -13.93% 2
Wales - 1 £525 -

For the 6 months to 18 December 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 358 (54.99%) Microsoft Azure
2 289 (44.39%) Analytics
3 287 (44.09%) SQL
4 271 (41.63%) Business Intelligence
5 255 (39.17%) Data Warehouse
6 248 (38.10%) Big Data
7 245 (37.63%) Agile Software Development
8 199 (30.57%) Hadoop
9 190 (29.19%) ETL
10 186 (28.57%) Microsoft
11 181 (27.80%) Power BI
12 167 (25.65%) SQL Server
13 158 (24.27%) SQL Server Integration Services
13 158 (24.27%) Azure Data Factory
14 149 (22.89%) Data Modelling
15 144 (22.12%) Apache Spark
16 132 (20.28%) Python
17 115 (17.67%) Finance
18 114 (17.51%) Scrum
18 114 (17.51%) Apache Hive
19 106 (16.28%) Amazon AWS
20 103 (15.82%) Azure SQL Database
21 102 (15.67%) DevOps
22 97 (14.90%) Data Science
23 91 (13.98%) SQL Server Analysis Services
24 90 (13.82%) HDInsight
25 88 (13.52%) Kafka
26 84 (12.90%) Data Management
27 83 (12.75%) .NET
28 80 (12.29%) Visual Studio Team System

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 144 (22.12%) Apache Spark
2 40 (6.14%) Apache
3 39 (5.99%) SAS
4 14 (2.15%) Confluence
5 12 (1.84%) Elasticsearch
6 9 (1.38%) Apache Pig
7 7 (1.08%) Apache Solr
7 7 (1.08%) SharePoint
8 2 (0.31%) Apache Airflow
8 2 (0.31%) K2 blackpearl
8 2 (0.31%) Oracle SOA Suite
8 2 (0.31%) PowerExchange
8 2 (0.31%) SharePoint 2013
9 1 (0.15%) Alfresco
9 1 (0.15%) Apache ServiceMix
9 1 (0.15%) Appian
9 1 (0.15%) Jupyter
9 1 (0.15%) Luigi
9 1 (0.15%) nginx
9 1 (0.15%) Umbraco
Applications
1 14 (2.15%) Microsoft Excel
2 2 (0.31%) Spreadsheet
2 2 (0.31%) SPSS
3 1 (0.15%) Microsoft Office
3 1 (0.15%) Microsoft Project
Business Applications
1 15 (2.30%) SAP Oil and Gas
2 9 (1.38%) Dynamics CRM
3 3 (0.46%) Dynamics AX
3 3 (0.46%) Dynamics NAV
4 2 (0.31%) Markit EDM
4 2 (0.31%) NetSuite
4 2 (0.31%) PolarLake
4 2 (0.31%) SAP APO
4 2 (0.31%) SAP ERP
4 2 (0.31%) SAP MDM
4 2 (0.31%) SAP MM
4 2 (0.31%) SAP PLM
5 1 (0.15%) HFM
5 1 (0.15%) Oracle EBS
5 1 (0.15%) Salesforce.com CRM
5 1 (0.15%) Summit
Cloud Services
1 358 (54.99%) Microsoft Azure
2 158 (24.27%) Azure Data Factory
3 106 (16.28%) Amazon AWS
4 71 (10.91%) Serverless
5 64 (9.83%) PaaS
6 56 (8.60%) Data Lake Analytics
7 32 (4.92%) IaaS
8 31 (4.76%) Azure Functions
9 30 (4.61%) Google Cloud Platform
10 29 (4.45%) Amazon S3
11 23 (3.53%) Amazon Kinesis
12 20 (3.07%) Azure Machine Learning
13 16 (2.46%) Amazon EMR
13 16 (2.46%) Azure Active Directory
14 14 (2.15%) AWS Lambda
15 13 (2.00%) Cortana Intelligence Suite
16 12 (1.84%) Amazon EC2
17 11 (1.69%) SaaS
18 10 (1.54%) Dynamics 365
19 9 (1.38%) GitHub
Communications & Networking
1 6 (0.92%) Firewall
1 6 (0.92%) Internet
1 6 (0.92%) Network Security
2 4 (0.61%) Kerberos
2 4 (0.61%) VPN
3 3 (0.46%) DNS
4 2 (0.31%) SSL
4 2 (0.31%) Wi-Fi
5 1 (0.15%) Intranet
Database & Business Intelligence
1 255 (39.17%) Data Warehouse
2 248 (38.10%) Big Data
3 199 (30.57%) Hadoop
4 181 (27.80%) Power BI
5 167 (25.65%) SQL Server
6 158 (24.27%) SQL Server Integration Services
7 114 (17.51%) Apache Hive
8 103 (15.82%) Azure SQL Database
9 91 (13.98%) SQL Server Analysis Services
10 90 (13.82%) HDInsight
11 77 (11.83%) Azure SQL Data Warehouse
12 76 (11.67%) SQL Server Reporting Services
13 70 (10.75%) Relational Database
14 68 (10.45%) Cosmos DB
15 64 (9.83%) NoSQL
16 51 (7.83%) HBase
17 42 (6.45%) Impala
18 40 (6.14%) Microsoft Analysis Services
19 37 (5.68%) MongoDB
20 32 (4.92%) Redis
Development Applications
1 80 (12.29%) Visual Studio Team System
2 47 (7.22%) Git (software)
3 39 (5.99%) Visual Studio
4 33 (5.07%) Jenkins
5 28 (4.30%) JIRA
6 22 (3.38%) Team Foundation Server
7 11 (1.69%) NUnit
8 10 (1.54%) Moq
9 5 (0.77%) ERwin
9 5 (0.77%) JUnit
10 4 (0.61%) Ant
10 4 (0.61%) CruiseControl
10 4 (0.61%) IBM UrbanCode
10 4 (0.61%) Maven
10 4 (0.61%) RStudio
10 4 (0.61%) Selenium
10 4 (0.61%) Sonatype Nexus
11 3 (0.46%) TeamCity
12 2 (0.31%) FishEye
12 2 (0.31%) SoapUI
General
1 115 (17.67%) Finance
2 65 (9.98%) Retail
3 47 (7.22%) Banking
4 8 (1.23%) Front Office
4 8 (1.23%) Marketing
4 8 (1.23%) Pharmaceutical
5 7 (1.08%) Back Office
5 7 (1.08%) Investment Banking
6 6 (0.92%) Legal
6 6 (0.92%) Publishing
7 4 (0.61%) Games
7 4 (0.61%) Telecoms
8 2 (0.31%) Advertising
8 2 (0.31%) Manufacturing
8 2 (0.31%) Retail Banking
9 1 (0.15%) Dutch Language
9 1 (0.15%) Electronics
9 1 (0.15%) French Language
9 1 (0.15%) Spanish Language
Job Titles
1 209 (32.10%) Developer
2 141 (21.66%) Architect
3 107 (16.44%) Data Engineer
4 87 (13.36%) Data Architect
5 74 (11.37%) Azure Developer
6 52 (7.99%) Business Intelligence Developer
7 44 (6.76%) Big Data Engineer
8 42 (6.45%) Azure Architect
9 41 (6.30%) Azure Engineer
10 31 (4.76%) Consultant
11 29 (4.45%) .NET Developer
12 26 (3.99%) DevOps Engineer
13 25 (3.84%) Technical Architect
14 24 (3.69%) Big Data Architect
14 24 (3.69%) Solutions Architect
15 23 (3.53%) Analyst
16 21 (3.23%) Azure DevOps
16 21 (3.23%) C# Developer
17 20 (3.07%) Big Data Developer
17 20 (3.07%) ETL Developer
Libraries, Frameworks & Software Standards
1 88 (13.52%) Kafka
2 83 (12.75%) .NET
3 34 (5.22%) AngularJS
3 34 (5.22%) ASP.NET Web API
4 32 (4.92%) REST
5 30 (4.61%) JSON
6 27 (4.15%) .NET Core
7 23 (3.53%) HTML
8 19 (2.92%) CSS
9 17 (2.61%) Node.js
10 16 (2.46%) .NET Framework
11 15 (2.30%) ASP.NET
11 15 (2.30%) React
11 15 (2.30%) Twitter Bootstrap
12 12 (1.84%) Express
12 12 (1.84%) Vue.js
13 11 (1.69%) Angular 2
13 11 (1.69%) Pug
14 9 (1.38%) Web Services
14 9 (1.38%) XML
Miscellaneous
1 70 (10.75%) Analytical Skills
2 52 (7.99%) Greenfield Project
3 32 (4.92%) Data Structures
4 24 (3.69%) Algorithms
5 14 (2.15%) Fintech
5 14 (2.15%) Management Information System
6 9 (1.38%) Virtual Team
7 8 (1.23%) Cloud Native
8 7 (1.08%) Self-Motivation
9 6 (0.92%) EPoS
9 6 (0.92%) Private Cloud
10 5 (0.77%) Enterprise Software
11 4 (0.61%) Fixed Income
11 4 (0.61%) Public Cloud
11 4 (0.61%) Reference Data
12 3 (0.46%) Cyberthreat
12 3 (0.46%) Digital Media
12 3 (0.46%) FMCG
12 3 (0.46%) Foreign Exchange (FX)
12 3 (0.46%) NHS
Operating Systems
1 24 (3.69%) Windows
2 21 (3.23%) Linux
3 13 (2.00%) Unix
4 2 (0.31%) VMS
5 1 (0.15%) Oracle Linux
5 1 (0.15%) Red Hat Enterprise Linux
5 1 (0.15%) Ubuntu
5 1 (0.15%) Windows Server
Processes & Methodologies
1 289 (44.39%) Analytics
2 271 (41.63%) Business Intelligence
3 245 (37.63%) Agile Software Development
4 190 (29.19%) ETL
5 149 (22.89%) Data Modelling
6 114 (17.51%) Scrum
7 102 (15.67%) DevOps
8 97 (14.90%) Data Science
9 84 (12.90%) Data Management
10 66 (10.14%) Visualisation
11 63 (9.68%) Migration
12 62 (9.52%) Data Analytics
12 62 (9.52%) Data Architecture
13 61 (9.37%) Continuous Integration
14 60 (9.22%) Machine Learning
15 55 (8.45%) Data Integration
16 54 (8.29%) TDD
17 47 (7.22%) Test Automation
18 43 (6.61%) Data Engineering
19 39 (5.99%) Stakeholder Management
Programming Languages
1 287 (44.09%) SQL
2 132 (20.28%) Python
3 69 (10.60%) C#
4 66 (10.14%) Java
4 66 (10.14%) PowerShell
5 57 (8.76%) T-SQL
6 56 (8.60%) R
7 53 (8.14%) Scala
8 35 (5.38%) JavaScript
9 28 (4.30%) U-SQL
10 14 (2.15%) Data Analysis Expressions (DAX)
11 13 (2.00%) Shell Script
12 8 (1.23%) VB
13 7 (1.08%) Bash Shell
13 7 (1.08%) C
13 7 (1.08%) MATLAB
14 6 (0.92%) Ruby
15 4 (0.61%) Perl
16 3 (0.46%) TypeScript
16 3 (0.46%) VBA
Qualifications
1 25 (3.84%) Degree
2 16 (2.46%) Computer Science Degree
3 11 (1.69%) BPSS Clearance
4 7 (1.08%) Security Cleared
5 4 (0.61%) CEH
5 4 (0.61%) CISSP
5 4 (0.61%) SC Cleared
6 3 (0.46%) ITIL Certification
6 3 (0.46%) Microsoft Certification
7 2 (0.31%) AWS Certification
7 2 (0.31%) CISM
7 2 (0.31%) Numerate Degree
7 2 (0.31%) PMI Certification
7 2 (0.31%) Postgraduate
7 2 (0.31%) TOGAF Certification
8 1 (0.15%) (ISC)2 CCSP
8 1 (0.15%) BC Cleared
8 1 (0.15%) DBS Check
8 1 (0.15%) DV Cleared
8 1 (0.15%) Master's Degree
Quality Assurance & Compliance
1 40 (6.14%) Data Quality
2 23 (3.53%) QA
3 11 (1.69%) GDPR
4 3 (0.46%) Disclosure Scotland
5 2 (0.31%) HL7
5 2 (0.31%) PCI DSS
5 2 (0.31%) SLA
5 2 (0.31%) Solvency II
6 1 (0.15%) GLP
6 1 (0.15%) GMP
6 1 (0.15%) GxP
6 1 (0.15%) IFRS
6 1 (0.15%) PMO
System Software
1 33 (5.07%) HDFS
2 31 (4.76%) Apache Flume
3 25 (3.84%) Virtual Machines
4 22 (3.38%) Docker
5 14 (2.15%) Active Directory
6 5 (0.77%) Apache ZooKeeper
Systems Management
1 20 (3.07%) Oozie
2 18 (2.76%) Terraform
3 17 (2.61%) Kubernetes
4 13 (2.00%) Ansible
5 12 (1.84%) Hadoop YARN
5 12 (1.84%) Puppet
6 8 (1.23%) Opscode Chef
7 7 (1.08%) Control-M
8 6 (0.92%) ITRS Geneos
9 3 (0.46%) Ambari
9 3 (0.46%) Kibana
10 2 (0.31%) Ganglia
10 2 (0.31%) HP ALM
10 2 (0.31%) logstash
10 2 (0.31%) Nagios
10 2 (0.31%) Salt
10 2 (0.31%) Single Sign-On
Vendors
1 186 (28.57%) Microsoft
2 72 (11.06%) Tableau
3 64 (9.83%) Oracle
4 62 (9.52%) Cloudera
5 55 (8.45%) Informatica
6 53 (8.14%) Talend
7 37 (5.68%) SAP
8 29 (4.45%) Databricks
9 28 (4.30%) Google
10 27 (4.15%) Alteryx
11 25 (3.84%) Hortonworks
12 21 (3.23%) Splunk
13 16 (2.46%) Teradata
14 15 (2.30%) Ab Initio
15 9 (1.38%) MapR
16 6 (0.92%) MicroStrategy
17 5 (0.77%) Atlassian
17 5 (0.77%) Workday
18 4 (0.61%) Netezza
18 4 (0.61%) Salesforce.com