Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 15 October 2018

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 15 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
15 Oct 2018		 Same period 2017 Same period 2016
Rank 445 679 788
Rank change year-on-year +234 +109 +114
Contract jobs citing Data Lake 512 202 119
As % of all contract IT jobs advertised in the UK 0.50% 0.21% 0.11%
As % of the Database & Business Intelligence category 2.20% 0.92% 0.50%
Number of daily rates quoted 335 149 86
UK median daily rate £500 £550 £600
Median daily rate % change year-on-year -9.09% -8.33% -7.69%
10th Percentile £377 £363 £395
90th Percentile £707 £728 £763
UK excluding London median daily rate £500 £525 £475
% change year-on-year -4.76% +10.53% -
Number of hourly rates quoted 2 1 0
UK median hourly rate £49.75 £45.00 -
Median hourly rate % change year-on-year +10.56% - -
UK excluding London median hourly rate £49.75 £45.00 -
% change year-on-year +10.56% - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 23,249 21,872 23,783
As % of all contract IT jobs advertised in the UK 22.55% 22.22% 22.46%
Number of daily rates quoted 16,225 14,706 15,849
UK median daily rate £475 £450 £425
Median daily rate % change year-on-year +5.56% +5.88% +6.25%
10th Percentile £313 £306 £281
90th Percentile £638 £625 £588
UK excluding London median daily rate £425 £400 £375
% change year-on-year +6.25% +6.67% -
Number of hourly rates quoted 230 281 394
UK median hourly rate £32.00 £30.00 £28.50
Median hourly rate % change year-on-year +6.67% +5.26% +1.33%
10th Percentile £12.72 £13.63 £10.65
90th Percentile £56.17 £53.75 £48.75
UK excluding London median hourly rate £32.50 £32.00 £28.50
% change year-on-year +1.56% +12.28% -3.39%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake.

Contractor daily rate trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Lake over the 6 months to 15 October 2018.

Contractor daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake.

Contractor hourly rate trend for Data Lake in the UK

Data Lake
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Lake over the 6 months to 15 October 2018.

Contractor hourly rate histogram for Data Lake in the UK

Data Lake
Top 14 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 15 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +192 483 £513 -6.82% 124
London +173 316 £525 -4.55% 73
UK excluding London +76 188 £500 -4.76% 52
South East +76 124 £500 -6.98% 13
North of England -6 21 £518 -15.16% 18
Scotland -9 20 £388 -8.82% 1
Yorkshire -12 13 £450 -26.23% 9
South West -15 10 £500 +14.29% 9
North West -12 9 £550 -9.84% 8
East of England -8 6 £525 - 3
Midlands -28 6 £438 +20.69% 8
West Midlands -5 5 £438 -21.35% 6
East Midlands -14 1 - - 2
Wales - 1 £525 -

For the 6 months to 15 October 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 262 (51.17%) Microsoft Azure
2 257 (50.20%) Business Intelligence
3 244 (47.66%) Analytics
4 237 (46.29%) Data Warehouse
5 227 (44.34%) SQL
6 218 (42.58%) Big Data
7 205 (40.04%) Agile Software Development
8 175 (34.18%) Hadoop
9 171 (33.40%) ETL
10 164 (32.03%) Microsoft
11 157 (30.66%) SQL Server
12 140 (27.34%) Power BI
13 121 (23.63%) Apache Spark
13 121 (23.63%) Azure Data Factory
14 119 (23.24%) SQL Server Integration Services
15 118 (23.05%) Data Modelling
16 117 (22.85%) Python
17 99 (19.34%) Finance
18 86 (16.80%) Amazon AWS
19 85 (16.60%) SQL Server Analysis Services
20 82 (16.02%) Apache Hive
21 80 (15.63%) Scrum
22 76 (14.84%) HDInsight
23 74 (14.45%) SQL Server Reporting Services
23 74 (14.45%) Visualisation
24 71 (13.87%) Kafka
24 71 (13.87%) Analytical Skills
25 70 (13.67%) NoSQL
26 68 (13.28%) Azure SQL Database
27 66 (12.89%) Data Science

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 121 (23.63%) Apache Spark
2 35 (6.84%) Apache
3 32 (6.25%) SAS
4 13 (2.54%) Apache Solr
4 13 (2.54%) Elasticsearch
5 12 (2.34%) Apache Pig
6 11 (2.15%) Confluence
7 3 (0.59%) BizTalk Server
8 2 (0.39%) Apache Airflow
8 2 (0.39%) SharePoint
9 1 (0.20%) Alfresco
9 1 (0.20%) Apache ServiceMix
9 1 (0.20%) Appian
9 1 (0.20%) Content Management Server
9 1 (0.20%) Documentum
9 1 (0.20%) Umbraco
9 1 (0.20%) WebSphere
Applications
1 10 (1.95%) Microsoft Excel
2 3 (0.59%) Microsoft Project
3 1 (0.20%) Microsoft Office
3 1 (0.20%) Microsoft PowerPoint
3 1 (0.20%) MS Visio
3 1 (0.20%) Shockwave
Business Applications
1 11 (2.15%) SAP Oil and Gas
2 7 (1.37%) SAP APO
2 7 (1.37%) SAP MM
3 5 (0.98%) Dynamics CRM
3 5 (0.98%) Markit EDM
3 5 (0.98%) SAP ERP
3 5 (0.98%) SAP MDM
4 3 (0.59%) SAP HR
5 2 (0.39%) Global One
5 2 (0.39%) PolarLake
6 1 (0.20%) Dynamics AX
6 1 (0.20%) Dynamics NAV
6 1 (0.20%) HFM
6 1 (0.20%) Oracle EBS
6 1 (0.20%) Salesforce.com CRM
6 1 (0.20%) SAP S/4HANA
6 1 (0.20%) Summit
Cloud Services
1 262 (51.17%) Microsoft Azure
2 121 (23.63%) Azure Data Factory
3 86 (16.80%) Amazon AWS
4 43 (8.40%) Data Lake Analytics
4 43 (8.40%) PaaS
5 33 (6.45%) Serverless
6 27 (5.27%) Amazon S3
7 25 (4.88%) Azure Machine Learning
8 22 (4.30%) Amazon Kinesis
9 17 (3.32%) Cortana Intelligence Suite
10 16 (3.13%) Azure Functions
11 15 (2.93%) SaaS
12 13 (2.54%) Amazon EMR
12 13 (2.54%) Google Cloud Platform
12 13 (2.54%) IaaS
13 11 (2.15%) Azure Active Directory
14 10 (1.95%) Amazon EC2
14 10 (1.95%) Dynamics 365
15 8 (1.56%) AWS Lambda
16 7 (1.37%) GitHub
Communications & Networking
1 8 (1.56%) VPN
2 6 (1.17%) Firewall
3 5 (0.98%) Kerberos
3 5 (0.98%) Network Security
4 4 (0.78%) SSL
5 3 (0.59%) DNS
6 2 (0.39%) Internet
7 1 (0.20%) Intranet
Database & Business Intelligence
1 237 (46.29%) Data Warehouse
2 218 (42.58%) Big Data
3 175 (34.18%) Hadoop
4 157 (30.66%) SQL Server
5 140 (27.34%) Power BI
6 119 (23.24%) SQL Server Integration Services
7 85 (16.60%) SQL Server Analysis Services
8 82 (16.02%) Apache Hive
9 76 (14.84%) HDInsight
10 74 (14.45%) SQL Server Reporting Services
11 70 (13.67%) NoSQL
12 68 (13.28%) Azure SQL Database
13 64 (12.50%) Relational Database
14 59 (11.52%) Azure SQL Data Warehouse
15 55 (10.74%) Cosmos DB
16 48 (9.38%) HBase
17 38 (7.42%) MongoDB
18 34 (6.64%) Microsoft Analysis Services
19 32 (6.25%) Impala
19 32 (6.25%) MySQL
Development Applications
1 47 (9.18%) Visual Studio Team System
2 42 (8.20%) Git (software)
3 26 (5.08%) Team Foundation Server
4 25 (4.88%) Jenkins
5 24 (4.69%) JIRA
6 20 (3.91%) Visual Studio
7 8 (1.56%) NUnit
8 6 (1.17%) Moq
9 5 (0.98%) ERwin
9 5 (0.98%) JUnit
10 4 (0.78%) Ant
10 4 (0.78%) CruiseControl
10 4 (0.78%) FishEye
10 4 (0.78%) IBM UrbanCode
10 4 (0.78%) Maven
10 4 (0.78%) Sonatype Nexus
11 3 (0.59%) Cucumber
11 3 (0.59%) RStudio
11 3 (0.59%) SpecFlow
11 3 (0.59%) TeamCity
General
1 99 (19.34%) Finance
2 45 (8.79%) Retail
3 27 (5.27%) Banking
4 11 (2.15%) Games
5 10 (1.95%) Pharmaceutical
6 7 (1.37%) Front Office
7 6 (1.17%) Back Office
7 6 (1.17%) Publishing
8 4 (0.78%) Legal
8 4 (0.78%) Marketing
9 3 (0.59%) Investment Banking
9 3 (0.59%) Telecoms
10 2 (0.39%) Digital Economy
10 2 (0.39%) Manufacturing
11 1 (0.20%) Advertising
11 1 (0.20%) Electronics
11 1 (0.20%) Financial Institution
11 1 (0.20%) Retail Banking
11 1 (0.20%) Spanish Language
Job Titles
1 168 (32.81%) Developer
2 113 (22.07%) Architect
3 74 (14.45%) Data Architect
4 65 (12.70%) Data Engineer
5 58 (11.33%) Azure Developer
6 46 (8.98%) Business Intelligence Developer
7 33 (6.45%) Azure Architect
7 33 (6.45%) Consultant
8 31 (6.05%) Big Data Engineer
9 29 (5.66%) Analyst
10 25 (4.88%) Big Data Architect
11 23 (4.49%) ETL Developer
12 22 (4.30%) Big Data Developer
13 20 (3.91%) Solutions Architect
14 19 (3.71%) Azure Engineer
15 17 (3.32%) Cloud Architect
15 17 (3.32%) Power BI Developer
16 16 (3.13%) .NET Developer
16 16 (3.13%) SQL Developer
16 16 (3.13%) Technical Architect
Libraries, Frameworks & Software Standards
1 71 (13.87%) Kafka
2 64 (12.50%) .NET
3 25 (4.88%) JSON
4 21 (4.10%) ASP.NET Web API
5 18 (3.52%) REST
6 17 (3.32%) .NET Core
7 14 (2.73%) AngularJS
8 12 (2.34%) .NET Framework
9 11 (2.15%) HTML
9 11 (2.15%) Spark Streaming
10 9 (1.76%) RabbitMQ
11 8 (1.56%) Angular 2
11 8 (1.56%) Entity Framework
11 8 (1.56%) Natural Language Processing
11 8 (1.56%) React
11 8 (1.56%) RESTful
12 7 (1.37%) HTML5
12 7 (1.37%) MDX
12 7 (1.37%) Web Services
13 6 (1.17%) ASP.NET
Miscellaneous
1 71 (13.87%) Analytical Skills
2 30 (5.86%) Greenfield Project
3 22 (4.30%) Data Structures
4 17 (3.32%) Algorithms
5 14 (2.73%) Computer Science
6 13 (2.54%) Fintech
7 9 (1.76%) Management Information System
7 9 (1.76%) Self-Motivation
8 6 (1.17%) Cloud Native
8 6 (1.17%) Private Cloud
9 5 (0.98%) Virtual Team
10 4 (0.78%) AS400
10 4 (0.78%) Enterprise Software
10 4 (0.78%) Fixed Income
10 4 (0.78%) Reference Data
11 3 (0.59%) Cyberthreat
11 3 (0.59%) EPoS
11 3 (0.59%) Mobile App
11 3 (0.59%) PKI
11 3 (0.59%) User Experience
Operating Systems
1 22 (4.30%) Linux
2 16 (3.13%) Unix
3 8 (1.56%) Windows
4 1 (0.20%) Oracle Linux
4 1 (0.20%) Red Hat Enterprise Linux
4 1 (0.20%) Ubuntu
4 1 (0.20%) Windows Server
Processes & Methodologies
1 257 (50.20%) Business Intelligence
2 244 (47.66%) Analytics
3 205 (40.04%) Agile Software Development
4 171 (33.40%) ETL
5 118 (23.05%) Data Modelling
6 80 (15.63%) Scrum
7 74 (14.45%) Visualisation
8 66 (12.89%) Data Science
9 57 (11.13%) DevOps
10 56 (10.94%) Machine Learning
11 55 (10.74%) Data Management
12 53 (10.35%) Data Integration
12 53 (10.35%) Migration
13 51 (9.96%) Data Architecture
14 50 (9.77%) Data Analytics
15 48 (9.38%) Stakeholder Management
16 47 (9.18%) Problem-Solving
17 41 (8.01%) TDD
18 35 (6.84%) Data Governance
19 32 (6.25%) Data Visualisation
Programming Languages
1 227 (44.34%) SQL
2 117 (22.85%) Python
3 62 (12.11%) Java
4 59 (11.52%) C#
5 54 (10.55%) Scala
6 52 (10.16%) T-SQL
7 45 (8.79%) R
8 38 (7.42%) PowerShell
9 31 (6.05%) JavaScript
10 24 (4.69%) U-SQL
11 15 (2.93%) VB
12 10 (1.95%) Data Analysis Expressions (DAX)
12 10 (1.95%) Shell Script
13 7 (1.37%) MATLAB
14 6 (1.17%) Bash Shell
14 6 (1.17%) C
15 4 (0.78%) Perl
15 4 (0.78%) Ruby
16 3 (0.59%) TypeScript
16 3 (0.59%) VBA
Qualifications
1 21 (4.10%) Degree
2 11 (2.15%) Computer Science Degree
3 7 (1.37%) Microsoft Certification
4 6 (1.17%) Security Cleared
5 5 (0.98%) BPSS Clearance
5 5 (0.98%) CISSP
6 4 (0.78%) Numerate Degree
6 4 (0.78%) SC Cleared
7 3 (0.59%) CEH
7 3 (0.59%) CISM
8 2 (0.39%) AWS Certification
9 1 (0.20%) (ISC)2 CCSP
9 1 (0.20%) BC Cleared
9 1 (0.20%) Cisco Certification
9 1 (0.20%) DV Cleared
9 1 (0.20%) ITIL Certification
9 1 (0.20%) Master's Degree
9 1 (0.20%) PhD
9 1 (0.20%) Postgraduate
Quality Assurance & Compliance
1 49 (9.57%) Data Quality
2 29 (5.66%) QA
3 11 (2.15%) GDPR
4 2 (0.39%) HL7
4 2 (0.39%) PCI DSS
4 2 (0.39%) SLA
4 2 (0.39%) Solvency II
5 1 (0.20%) Disclosure Scotland
5 1 (0.20%) GLP
5 1 (0.20%) GMP
5 1 (0.20%) GxP
5 1 (0.20%) IFRS
5 1 (0.20%) PMO
System Software
1 34 (6.64%) HDFS
2 20 (3.91%) Docker
3 18 (3.52%) Apache Flume
4 12 (2.34%) Virtual Machines
5 11 (2.15%) Active Directory
6 9 (1.76%) Apache ZooKeeper
7 1 (0.20%) Hyper-V
Systems Management
1 16 (3.13%) Oozie
1 16 (3.13%) Terraform
2 12 (2.34%) Kubernetes
3 10 (1.95%) Ansible
3 10 (1.95%) Hadoop YARN
3 10 (1.95%) Puppet
4 9 (1.76%) Opscode Chef
5 6 (1.17%) HP ALM
6 5 (0.98%) Kibana
7 3 (0.59%) Ambari
8 2 (0.39%) Control-M
8 2 (0.39%) Ganglia
8 2 (0.39%) logstash
8 2 (0.39%) Nagios
9 1 (0.20%) Consul
9 1 (0.20%) Failover Clustering
9 1 (0.20%) ITRS Geneos
9 1 (0.20%) Packer
9 1 (0.20%) SCVMM
Vendors
1 164 (32.03%) Microsoft
2 62 (12.11%) Tableau
3 50 (9.77%) Oracle
4 48 (9.38%) Cloudera
5 45 (8.79%) Informatica
6 36 (7.03%) SAP
7 35 (6.84%) Talend
8 26 (5.08%) Hortonworks
9 21 (4.10%) Databricks
10 19 (3.71%) Teradata
11 18 (3.52%) Google
12 17 (3.32%) Ab Initio
13 16 (3.13%) Alteryx
14 11 (2.15%) MapR
15 10 (1.95%) Splunk
16 7 (1.37%) HP
16 7 (1.37%) MicroStrategy
17 6 (1.17%) Workday
18 5 (0.98%) IBM
18 5 (0.98%) Netezza
125 Data Lake job vacancies Nationwide