Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 15 August 2018

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 15 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
15 Aug 2018		 Same period 2017 Same period 2016
Rank 462 692 840
Rank change year-on-year +230 +148 +40
Contract jobs citing Data Lake 488 175 77
As % of all contract IT jobs advertised in the UK 0.48% 0.18% 0.071%
As % of the Database & Business Intelligence category 2.09% 0.81% 0.32%
Number of daily rates quoted 311 130 51
UK median daily rate £525 £550 £500
Median daily rate % change year-on-year -4.55% +10.00% -
10th Percentile £385 £374 £390
90th Percentile £713 £725 £800
UK excluding London median daily rate £500 £525 £479
% change year-on-year -4.76% +9.66% -
Number of hourly rates quoted 4 0 0
UK median hourly rate £47.25 - -
UK excluding London median hourly rate £50.00 - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 23,320 21,627 24,168
As % of all contract IT jobs advertised in the UK 22.79% 22.62% 22.15%
Number of daily rates quoted 16,285 14,408 16,212
UK median daily rate £463 £450 £425
Median daily rate % change year-on-year +2.78% +5.88% +6.25%
10th Percentile £313 £300 £281
90th Percentile £638 £625 £600
UK excluding London median daily rate £418 £400 £375
% change year-on-year +4.38% +6.67% +2.74%
Number of hourly rates quoted 236 249 379
UK median hourly rate £30.00 £31.50 £28.50
Median hourly rate % change year-on-year -4.76% +10.53% +8.57%
10th Percentile £13.38 £11.24 £11.50
90th Percentile £53.13 £52.50 £49.56
UK excluding London median hourly rate £32.00 £34.00 £30.10
% change year-on-year -5.88% +12.95% +11.49%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake.

Contractor daily rate trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Lake over the 6 months to 15 August 2018.

Contractor daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake.

Contractor hourly rate trend for Data Lake in the UK

Data Lake
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Lake over the 6 months to 15 August 2018.

Contractor hourly rate histogram for Data Lake in the UK

Data Lake
Top 14 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 15 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +205 458 £525 -4.55% 77
London +150 297 £525 -4.55% 59
UK excluding London +92 185 £500 -4.76% 25
South East +79 129 £500 -9.09% 6
Scotland -23 23 £400 -15.79% 7
North of England -12 16 £550 -9.84% 4
North West -8 10 £563 -7.79% 3
East of England -10 7 £538 - 3
Yorkshire -12 7 £488 -20.08% 1
Midlands -27 5 £475 +46.15% 3
South West -14 4 £475 -4.04% 2
West Midlands -24 3 £425 -37.04%
East Midlands -6 2 £525 +68.00% 3
Wales - 1 £525 -

For the 6 months to 15 August 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 258 (52.87%) Microsoft Azure
2 255 (52.25%) Business Intelligence
3 254 (52.05%) Big Data
4 245 (50.20%) Analytics
5 241 (49.39%) Data Warehouse
6 228 (46.72%) SQL
7 194 (39.75%) Hadoop
8 178 (36.48%) ETL
9 173 (35.45%) Microsoft
10 169 (34.63%) Agile Software Development
11 150 (30.74%) Power BI
12 140 (28.69%) SQL Server
13 131 (26.84%) Data Modelling
14 123 (25.20%) Apache Spark
15 115 (23.57%) Python
16 107 (21.93%) Azure Data Factory
17 99 (20.29%) SQL Server Integration Services
18 96 (19.67%) Finance
19 89 (18.24%) Visualisation
20 88 (18.03%) Amazon AWS
21 82 (16.80%) Analytical Skills
22 81 (16.60%) Apache Hive
23 76 (15.57%) HDInsight
24 74 (15.16%) NoSQL
25 73 (14.96%) SQL Server Analysis Services
26 71 (14.55%) SQL Server Reporting Services
27 69 (14.14%) Tableau
28 67 (13.73%) Data Integration
29 66 (13.52%) Machine Learning
29 66 (13.52%) Oracle

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 123 (25.20%) Apache Spark
2 35 (7.17%) Apache
2 35 (7.17%) SAS
3 15 (3.07%) Elasticsearch
4 14 (2.87%) Apache Pig
4 14 (2.87%) Apache Solr
5 8 (1.64%) Confluence
6 3 (0.61%) BizTalk Server
7 2 (0.41%) Apache Airflow
7 2 (0.41%) Oracle SOA Suite
7 2 (0.41%) PowerExchange
8 1 (0.20%) Alfresco
8 1 (0.20%) Apache ServiceMix
8 1 (0.20%) Appian
8 1 (0.20%) CMS
8 1 (0.20%) Content Management Server
8 1 (0.20%) Documentum
8 1 (0.20%) JBoss
8 1 (0.20%) Tomcat
8 1 (0.20%) WebSphere
Applications
1 5 (1.02%) Microsoft Excel
2 3 (0.61%) Microsoft Project
3 1 (0.20%) Microsoft Office
3 1 (0.20%) Microsoft PowerPoint
3 1 (0.20%) MS Visio
3 1 (0.20%) Shockwave
Business Applications
1 14 (2.87%) SAP Oil and Gas
2 7 (1.43%) SAP APO
2 7 (1.43%) SAP MM
3 5 (1.02%) Markit EDM
3 5 (1.02%) SAP ERP
3 5 (1.02%) SAP MDM
4 4 (0.82%) Dynamics CRM
5 3 (0.61%) SAP HR
6 2 (0.41%) Global One
6 2 (0.41%) PolarLake
7 1 (0.20%) Cognos TM1
7 1 (0.20%) HFM
7 1 (0.20%) Oracle EBS
7 1 (0.20%) Salesforce.com CRM
7 1 (0.20%) SAP S/4HANA
Cloud Services
1 258 (52.87%) Microsoft Azure
2 107 (21.93%) Azure Data Factory
3 88 (18.03%) Amazon AWS
4 46 (9.43%) Data Lake Analytics
5 42 (8.61%) PaaS
6 35 (7.17%) Serverless
7 28 (5.74%) Azure Machine Learning
8 24 (4.92%) Amazon S3
9 21 (4.30%) Amazon Kinesis
10 18 (3.69%) Azure Functions
10 18 (3.69%) Cortana Intelligence Suite
11 17 (3.48%) SaaS
12 13 (2.66%) Dynamics 365
13 12 (2.46%) IaaS
14 11 (2.25%) AWS Lambda
14 11 (2.25%) Google Cloud Platform
15 10 (2.05%) Amazon EMR
15 10 (2.05%) Azure Active Directory
16 7 (1.43%) Amazon EC2
17 6 (1.23%) GitHub
Communications & Networking
1 8 (1.64%) VPN
2 6 (1.23%) Kerberos
2 6 (1.23%) SSL
3 4 (0.82%) Firewall
3 4 (0.82%) Network Security
4 2 (0.41%) DNS
4 2 (0.41%) Internet
5 1 (0.20%) Intranet
Database & Business Intelligence
1 254 (52.05%) Big Data
2 241 (49.39%) Data Warehouse
3 194 (39.75%) Hadoop
4 150 (30.74%) Power BI
5 140 (28.69%) SQL Server
6 99 (20.29%) SQL Server Integration Services
7 81 (16.60%) Apache Hive
8 76 (15.57%) HDInsight
9 74 (15.16%) NoSQL
10 73 (14.96%) SQL Server Analysis Services
11 71 (14.55%) SQL Server Reporting Services
12 66 (13.52%) Cosmos DB
12 66 (13.52%) Relational Database
13 63 (12.91%) Azure SQL Database
14 56 (11.48%) Azure SQL Data Warehouse
15 51 (10.45%) HBase
16 48 (9.84%) MongoDB
17 36 (7.38%) OLAP
18 34 (6.97%) Apache Cassandra
19 31 (6.35%) MySQL
Development Applications
1 47 (9.63%) Git (software)
2 38 (7.79%) Visual Studio Team System
3 28 (5.74%) Jenkins
4 24 (4.92%) Team Foundation Server
5 23 (4.71%) Visual Studio
6 21 (4.30%) JIRA
7 11 (2.25%) SpecFlow
8 8 (1.64%) TeamCity
9 7 (1.43%) ERwin
9 7 (1.43%) tSQLt
10 6 (1.23%) FishEye
10 6 (1.23%) Maven
11 5 (1.02%) JUnit
11 5 (1.02%) Octopus Deploy
12 4 (0.82%) Ant
12 4 (0.82%) Cucumber
12 4 (0.82%) Sonatype Nexus
13 3 (0.61%) Selenium
13 3 (0.61%) Subversion
14 2 (0.41%) NUnit
General
1 96 (19.67%) Finance
2 38 (7.79%) Retail
3 24 (4.92%) Banking
4 18 (3.69%) Games
5 11 (2.25%) Pharmaceutical
6 8 (1.64%) Legal
7 7 (1.43%) Marketing
8 6 (1.23%) Back Office
9 5 (1.02%) Investment Banking
9 5 (1.02%) Publishing
10 4 (0.82%) Digital Economy
10 4 (0.82%) Front Office
11 3 (0.61%) Telecoms
12 2 (0.41%) Retail Banking
12 2 (0.41%) Spanish Language
13 1 (0.20%) Dutch Language
13 1 (0.20%) Electronics
13 1 (0.20%) French Language
13 1 (0.20%) German Language
13 1 (0.20%) Italian Language
Job Titles
1 133 (27.25%) Developer
2 115 (23.57%) Architect
3 80 (16.39%) Data Engineer
4 77 (15.78%) Data Architect
5 41 (8.40%) Analyst
6 34 (6.97%) Azure Architect
6 34 (6.97%) Business Intelligence Developer
7 32 (6.56%) Big Data Engineer
8 30 (6.15%) Consultant
9 27 (5.53%) Azure Developer
9 27 (5.53%) Azure Engineer
9 27 (5.53%) Big Data Architect
10 26 (5.33%) Big Data Developer
11 24 (4.92%) Solutions Architect
12 21 (4.30%) Data Analyst
13 18 (3.69%) Business Analyst
14 17 (3.48%) Azure Consultant
14 17 (3.48%) Cloud Architect
15 16 (3.28%) Business Intelligence Analyst
16 15 (3.07%) ETL Developer
Libraries, Frameworks & Software Standards
1 60 (12.30%) Kafka
2 55 (11.27%) .NET
3 23 (4.71%) JSON
4 21 (4.30%) RESTful
5 13 (2.66%) Web Services
5 13 (2.66%) XML
6 12 (2.46%) AngularJS
6 12 (2.46%) HTML
6 12 (2.46%) MDX
6 12 (2.46%) REST
7 11 (2.25%) ASP.NET Web API
8 10 (2.05%) HTML5
8 10 (2.05%) Natural Language Processing
9 9 (1.84%) .NET Framework
9 9 (1.84%) Spark Streaming
9 9 (1.84%) Velocity
10 8 (1.64%) .NET Core
10 8 (1.64%) Angular 2
10 8 (1.64%) React
11 7 (1.43%) RabbitMQ
Miscellaneous
1 82 (16.80%) Analytical Skills
2 22 (4.51%) Greenfield Project
3 17 (3.48%) Algorithms
4 16 (3.28%) Computer Science
5 14 (2.87%) Data Structures
5 14 (2.87%) Self-Motivation
6 13 (2.66%) Fintech
6 13 (2.66%) Management Information System
7 8 (1.64%) Private Cloud
8 7 (1.43%) Enterprise Software
9 6 (1.23%) Cloud Native
9 6 (1.23%) Market Risk
10 4 (0.82%) AS400
10 4 (0.82%) Data Centre
10 4 (0.82%) Fixed Income
10 4 (0.82%) Reference Data
11 3 (0.61%) Cyberthreat
11 3 (0.61%) Mobile App
11 3 (0.61%) User Experience
12 2 (0.41%) Hybrid Cloud
Operating Systems
1 27 (5.53%) Unix
2 22 (4.51%) Linux
3 7 (1.43%) Windows
4 2 (0.41%) Ubuntu
Processes & Methodologies
1 255 (52.25%) Business Intelligence
2 245 (50.20%) Analytics
3 178 (36.48%) ETL
4 169 (34.63%) Agile Software Development
5 131 (26.84%) Data Modelling
6 89 (18.24%) Visualisation
7 67 (13.73%) Data Integration
8 66 (13.52%) Machine Learning
9 62 (12.70%) Data Architecture
9 62 (12.70%) Data Science
10 61 (12.50%) Scrum
11 58 (11.89%) Migration
11 58 (11.89%) Problem-Solving
12 57 (11.68%) DevOps
13 53 (10.86%) Data Analytics
14 52 (10.66%) Stakeholder Management
15 51 (10.45%) Data Management
16 42 (8.61%) Data Governance
17 38 (7.79%) Data Visualisation
18 36 (7.38%) Test Automation
Programming Languages
1 228 (46.72%) SQL
2 115 (23.57%) Python
3 64 (13.11%) C#
4 55 (11.27%) Java
4 55 (11.27%) R
5 47 (9.63%) T-SQL
6 44 (9.02%) Scala
7 37 (7.58%) JavaScript
8 28 (5.74%) PowerShell
9 27 (5.53%) U-SQL
10 13 (2.66%) Shell Script
11 10 (2.05%) VB
12 8 (1.64%) Bash Shell
12 8 (1.64%) Data Analysis Expressions (DAX)
12 8 (1.64%) Perl
13 7 (1.43%) MATLAB
14 5 (1.02%) C
15 4 (0.82%) Ruby
16 2 (0.41%) C++
16 2 (0.41%) VBA
Qualifications
1 25 (5.12%) Degree
2 11 (2.25%) Computer Science Degree
3 9 (1.84%) Microsoft Certification
4 6 (1.23%) Security Cleared
5 4 (0.82%) SC Cleared
6 3 (0.61%) CISSP
7 2 (0.41%) Numerate Degree
8 1 (0.20%) (ISC)2 CCSP
8 1 (0.20%) AWS Certification
8 1 (0.20%) BC Cleared
8 1 (0.20%) BPSS Clearance
8 1 (0.20%) CEH
8 1 (0.20%) Cisco Certification
8 1 (0.20%) CISM
8 1 (0.20%) ITIL Certification
8 1 (0.20%) Master's Degree
8 1 (0.20%) PhD
8 1 (0.20%) Postgraduate
Quality Assurance & Compliance
1 54 (11.07%) Data Quality
2 21 (4.30%) QA
3 18 (3.69%) GDPR
4 4 (0.82%) GCP
5 3 (0.61%) SLA
6 2 (0.41%) PCI DSS
6 2 (0.41%) Solvency II
7 1 (0.20%) GLP
7 1 (0.20%) GMP
7 1 (0.20%) GxP
7 1 (0.20%) PMO
System Software
1 34 (6.97%) HDFS
2 18 (3.69%) Apache Flume
3 13 (2.66%) Docker
4 11 (2.25%) Virtual Machines
5 10 (2.05%) Active Directory
6 7 (1.43%) Apache ZooKeeper
7 1 (0.20%) Hyper-V
7 1 (0.20%) VMware Infrastructure
Systems Management
1 16 (3.28%) Terraform
2 15 (3.07%) Oozie
3 12 (2.46%) Ansible
4 10 (2.05%) Opscode Chef
4 10 (2.05%) Puppet
5 9 (1.84%) Hadoop YARN
6 8 (1.64%) Kubernetes
7 6 (1.23%) HP ALM
8 5 (1.02%) Kibana
9 2 (0.41%) Ambari
9 2 (0.41%) logstash
9 2 (0.41%) Packer
10 1 (0.20%) Consul
10 1 (0.20%) Failover Clustering
10 1 (0.20%) Ganglia
10 1 (0.20%) Nagios
10 1 (0.20%) SCVMM
Vendors
1 173 (35.45%) Microsoft
2 69 (14.14%) Tableau
3 66 (13.52%) Oracle
4 47 (9.63%) Cloudera
4 47 (9.63%) Informatica
4 47 (9.63%) SAP
5 37 (7.58%) Talend
6 22 (4.51%) Hortonworks
7 21 (4.30%) Alteryx
8 19 (3.89%) Databricks
9 16 (3.28%) Ab Initio
10 15 (3.07%) Teradata
11 11 (2.25%) Google
12 10 (2.05%) IBM
13 8 (1.64%) Netezza
14 7 (1.43%) Atlassian
14 7 (1.43%) Cognos
14 7 (1.43%) MapR
14 7 (1.43%) Salesforce.com
15 6 (1.23%) Workday