Period
to 14 November 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 14 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
14 Nov 2018
Same period 2017 Same period 2016
Rank 411 647 726
Rank change year-on-year +236 +79 +130
Contract jobs citing Data Lake 547 221 145
As % of all contract IT jobs advertised in England 0.57% 0.23% 0.15%
As % of the Database & Business Intelligence category 2.54% 1.06% 0.65%
Number of daily rates quoted 373 167 99
England median daily rate £525 £550 £600
Median daily rate % change year-on-year -4.55% -8.33% +9.09%
10th Percentile £400 £362 £405
90th Percentile £707 £710 £750
UK median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 2 1 0
England median hourly rate £49.75 £45.00 -
Median hourly rate % change year-on-year +10.56% - -
UK median hourly rate £49.75 £45.00 -
% change year-on-year +10.56% - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 21,576 20,912 22,182
As % of all contract IT jobs advertised in England 22.62% 22.08% 22.61%
Number of daily rates quoted 15,187 14,449 14,879
England median daily rate £475 £450 £425
Median daily rate % change year-on-year +5.56% +5.88% +3.03%
10th Percentile £319 £312 £288
90th Percentile £644 £638 £600
UK median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 224 259 326
England median hourly rate £33.50 £31.31 £28.00
Median hourly rate % change year-on-year +6.99% +11.82% +0.79%
10th Percentile £14.00 £14.25 £11.25
90th Percentile £56.94 £54.00 £48.75
UK median hourly rate £32.50 £30.88 £28.18
% change year-on-year +5.26% +9.56% -1.12%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in England.

Contractor daily rate trend for Data Lake in England

Data Lake
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Data Lake in England over the 6 months to 14 November 2018.

Contractor daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake in England.

Contractor hourly rate trend for Data Lake in England

Data Lake
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Data Lake in England over the 6 months to 14 November 2018.

Contractor hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 14 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +181 359 £525 -4.55% 58
South East +67 129 £500 -9.09% 13
North of England +13 30 £525 -13.93% 10
North West -1 16 £550 -9.84% 6
Yorkshire -4 15 £545 -10.66% 3
South West -24 14 £488 +8.33% 9
East of England +13 8 £525 - 7
Midlands -11 7 £438 +40.00% 6
West Midlands -25 6 £438 - 5
North East -4 2 £575 -5.74% 1
East Midlands +8 1 - - 1
Data Lake
UK

For the 6 months to 14 November 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 286 (52.29%) Microsoft Azure
2 251 (45.89%) Business Intelligence
3 238 (43.51%) Analytics
4 234 (42.78%) SQL
5 229 (41.86%) Data Warehouse
6 221 (40.40%) Agile Software Development
7 209 (38.21%) Big Data
8 169 (30.90%) ETL
9 159 (29.07%) SQL Server
10 158 (28.88%) Microsoft
10 158 (28.88%) Hadoop
11 147 (26.87%) Power BI
12 140 (25.59%) SQL Server Integration Services
13 133 (24.31%) Azure Data Factory
14 122 (22.30%) Python
15 118 (21.57%) Data Modelling
15 118 (21.57%) Apache Spark
16 106 (19.38%) Finance
17 98 (17.92%) Scrum
18 91 (16.64%) Amazon AWS
19 85 (15.54%) Apache Hive
20 81 (14.81%) Data Science
21 80 (14.63%) SQL Server Analysis Services
22 78 (14.26%) .NET
23 73 (13.35%) HDInsight
24 71 (12.98%) Analytical Skills
24 71 (12.98%) Relational Database
25 70 (12.80%) SQL Server Reporting Services
25 70 (12.80%) Azure SQL Database
26 69 (12.61%) Kafka

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (21.57%) Apache Spark
2 34 (6.22%) SAS
3 30 (5.48%) Apache
4 12 (2.19%) Confluence
5 11 (2.01%) Elasticsearch
6 8 (1.46%) Apache Solr
7 6 (1.10%) Apache Pig
8 5 (0.91%) SharePoint
9 2 (0.37%) K2 blackpearl
9 2 (0.37%) Oracle SOA Suite
9 2 (0.37%) SharePoint 2013
10 1 (0.18%) Alfresco
10 1 (0.18%) Apache Airflow
10 1 (0.18%) Apache ServiceMix
10 1 (0.18%) Appian
10 1 (0.18%) BizTalk Server
10 1 (0.18%) Content Management Server
10 1 (0.18%) Documentum
Applications
1 15 (2.74%) Microsoft Excel
2 3 (0.55%) Microsoft Project
3 2 (0.37%) Microsoft Office
3 2 (0.37%) Spreadsheet
3 2 (0.37%) SPSS
4 1 (0.18%) Microsoft PowerPoint
4 1 (0.18%) MS Visio
4 1 (0.18%) Shockwave
Business Applications
1 9 (1.65%) SAP Oil and Gas
2 7 (1.28%) SAP APO
2 7 (1.28%) SAP MM
3 5 (0.91%) SAP ERP
3 5 (0.91%) SAP MDM
4 3 (0.55%) SAP HR
5 2 (0.37%) Dynamics CRM
5 2 (0.37%) Global One
5 2 (0.37%) Markit EDM
5 2 (0.37%) PolarLake
6 1 (0.18%) Dynamics AX
6 1 (0.18%) Dynamics NAV
6 1 (0.18%) HFM
6 1 (0.18%) Oracle EBS
6 1 (0.18%) Salesforce.com CRM
6 1 (0.18%) SAP S/4HANA
6 1 (0.18%) Summit
Cloud Services
1 286 (52.29%) Microsoft Azure
2 133 (24.31%) Azure Data Factory
3 91 (16.64%) Amazon AWS
4 54 (9.87%) Serverless
5 49 (8.96%) Data Lake Analytics
6 43 (7.86%) PaaS
7 29 (5.30%) Amazon S3
8 25 (4.57%) Amazon Kinesis
8 25 (4.57%) Azure Functions
9 24 (4.39%) Azure Machine Learning
10 23 (4.20%) Google Cloud Platform
11 21 (3.84%) IaaS
12 16 (2.93%) Amazon EMR
13 14 (2.56%) AWS Lambda
14 13 (2.38%) SaaS
15 10 (1.83%) Amazon EC2
15 10 (1.83%) Cortana Intelligence Suite
16 9 (1.65%) Azure Active Directory
17 8 (1.46%) GitHub
18 6 (1.10%) Google Analytics
Communications & Networking
1 7 (1.28%) Firewall
2 6 (1.10%) Network Security
3 5 (0.91%) VPN
4 3 (0.55%) DNS
4 3 (0.55%) Kerberos
5 2 (0.37%) Internet
5 2 (0.37%) SSL
5 2 (0.37%) Wi-Fi
6 1 (0.18%) Intranet
Database & Business Intelligence
1 229 (41.86%) Data Warehouse
2 209 (38.21%) Big Data
3 159 (29.07%) SQL Server
4 158 (28.88%) Hadoop
5 147 (26.87%) Power BI
6 140 (25.59%) SQL Server Integration Services
7 85 (15.54%) Apache Hive
8 80 (14.63%) SQL Server Analysis Services
9 73 (13.35%) HDInsight
10 71 (12.98%) Relational Database
11 70 (12.80%) Azure SQL Database
11 70 (12.80%) SQL Server Reporting Services
12 63 (11.52%) Azure SQL Data Warehouse
13 62 (11.33%) NoSQL
14 49 (8.96%) Cosmos DB
15 43 (7.86%) HBase
16 36 (6.58%) Impala
17 31 (5.67%) MongoDB
18 30 (5.48%) Microsoft Analysis Services
19 28 (5.12%) Amazon Redshift
Development Applications
1 64 (11.70%) Visual Studio Team System
2 43 (7.86%) Git (software)
3 30 (5.48%) Visual Studio
4 28 (5.12%) Jenkins
5 25 (4.57%) Team Foundation Server
6 24 (4.39%) JIRA
7 10 (1.83%) NUnit
8 9 (1.65%) Moq
9 6 (1.10%) ERwin
10 5 (0.91%) JUnit
11 4 (0.73%) Ant
11 4 (0.73%) CruiseControl
11 4 (0.73%) IBM UrbanCode
11 4 (0.73%) Maven
11 4 (0.73%) Sonatype Nexus
12 3 (0.55%) RStudio
12 3 (0.55%) TeamCity
13 2 (0.37%) FishEye
13 2 (0.37%) Octopus Deploy
13 2 (0.37%) SoapUI
General
1 106 (19.38%) Finance
2 50 (9.14%) Retail
3 37 (6.76%) Banking
4 10 (1.83%) Pharmaceutical
5 8 (1.46%) Front Office
5 8 (1.46%) Publishing
6 6 (1.10%) Back Office
7 5 (0.91%) Legal
8 4 (0.73%) Games
8 4 (0.73%) Investment Banking
9 3 (0.55%) Marketing
9 3 (0.55%) Telecoms
10 2 (0.37%) Advertising
11 1 (0.18%) Dutch Language
11 1 (0.18%) Financial Institution
11 1 (0.18%) French Language
11 1 (0.18%) Manufacturing
11 1 (0.18%) Spanish Language
Job Titles
1 180 (32.91%) Developer
2 117 (21.39%) Architect
3 77 (14.08%) Data Engineer
4 68 (12.43%) Data Architect
5 65 (11.88%) Azure Developer
6 53 (9.69%) Business Intelligence Developer
7 35 (6.40%) Azure Architect
8 34 (6.22%) Big Data Engineer
9 29 (5.30%) Analyst
9 29 (5.30%) Consultant
10 25 (4.57%) Azure Engineer
11 24 (4.39%) Solutions Architect
12 22 (4.02%) .NET Developer
13 19 (3.47%) Big Data Architect
13 19 (3.47%) Big Data Developer
13 19 (3.47%) Cloud Architect
13 19 (3.47%) DevOps Engineer
13 19 (3.47%) Technical Architect
14 17 (3.11%) Designer
15 16 (2.93%) C# Developer
Libraries, Frameworks & Software Standards
1 78 (14.26%) .NET
2 69 (12.61%) Kafka
3 29 (5.30%) ASP.NET Web API
4 25 (4.57%) JSON
4 25 (4.57%) REST
5 22 (4.02%) AngularJS
6 21 (3.84%) .NET Core
7 15 (2.74%) HTML
8 13 (2.38%) ASP.NET
9 11 (2.01%) .NET Framework
9 11 (2.01%) CSS
9 11 (2.01%) Node.js
10 10 (1.83%) React
11 9 (1.65%) Twitter Bootstrap
11 9 (1.65%) Web Services
12 8 (1.46%) Entity Framework
12 8 (1.46%) MDX
13 7 (1.28%) Angular 2
13 7 (1.28%) RESTful
13 7 (1.28%) Vue.js
Miscellaneous
1 71 (12.98%) Analytical Skills
2 42 (7.68%) Greenfield Project
3 24 (4.39%) Data Structures
4 19 (3.47%) Algorithms
5 18 (3.29%) Computer Science
6 12 (2.19%) Fintech
7 11 (2.01%) Management Information System
8 8 (1.46%) Self-Motivation
9 7 (1.28%) Virtual Team
10 6 (1.10%) Cloud Native
11 4 (0.73%) AS400
11 4 (0.73%) Enterprise Software
11 4 (0.73%) Fixed Income
11 4 (0.73%) Private Cloud
11 4 (0.73%) Reference Data
12 3 (0.55%) Digital Media
12 3 (0.55%) EPoS
12 3 (0.55%) Hybrid Cloud
12 3 (0.55%) Mobile App
12 3 (0.55%) PKI
Operating Systems
1 21 (3.84%) Linux
2 18 (3.29%) Windows
3 15 (2.74%) Unix
4 1 (0.18%) Oracle Linux
4 1 (0.18%) Ubuntu
4 1 (0.18%) Windows Server
Processes & Methodologies
1 251 (45.89%) Business Intelligence
2 238 (43.51%) Analytics
3 221 (40.40%) Agile Software Development
4 169 (30.90%) ETL
5 118 (21.57%) Data Modelling
6 98 (17.92%) Scrum
7 81 (14.81%) Data Science
8 67 (12.25%) DevOps
9 65 (11.88%) Data Management
10 61 (11.15%) Migration
11 60 (10.97%) Visualisation
12 51 (9.32%) TDD
13 48 (8.78%) Data Integration
14 47 (8.59%) Data Analytics
14 47 (8.59%) Data Architecture
15 46 (8.41%) Continuous Integration
15 46 (8.41%) Machine Learning
16 41 (7.50%) Test Automation
17 38 (6.95%) Kimball Methodology
18 37 (6.76%) Problem-Solving
Programming Languages
1 234 (42.78%) SQL
2 122 (22.30%) Python
3 66 (12.07%) Java
4 65 (11.88%) C#
5 57 (10.42%) PowerShell
6 55 (10.05%) Scala
7 51 (9.32%) T-SQL
8 50 (9.14%) R
9 29 (5.30%) JavaScript
9 29 (5.30%) U-SQL
10 15 (2.74%) Data Analysis Expressions (DAX)
11 13 (2.38%) Shell Script
12 12 (2.19%) VB
13 7 (1.28%) C
13 7 (1.28%) MATLAB
14 6 (1.10%) Bash Shell
14 6 (1.10%) Ruby
15 4 (0.73%) Perl
16 3 (0.55%) VBA
17 2 (0.37%) PHP
Qualifications
1 26 (4.75%) Degree
2 14 (2.56%) Computer Science Degree
3 7 (1.28%) Microsoft Certification
4 5 (0.91%) CEH
4 5 (0.91%) CISSP
5 4 (0.73%) BPSS Clearance
5 4 (0.73%) SC Cleared
5 4 (0.73%) Security Cleared
6 3 (0.55%) CISM
6 3 (0.55%) Numerate Degree
7 2 (0.37%) AWS Certification
7 2 (0.37%) PMI Certification
8 1 (0.18%) (ISC)2 CCSP
8 1 (0.18%) Cisco Certification
8 1 (0.18%) DBS Check
8 1 (0.18%) ITIL Certification
8 1 (0.18%) Master's Degree
8 1 (0.18%) PhD
8 1 (0.18%) Postgraduate
8 1 (0.18%) SAS Certification
Quality Assurance & Compliance
1 47 (8.59%) Data Quality
2 29 (5.30%) QA
3 11 (2.01%) GDPR
4 2 (0.37%) HL7
4 2 (0.37%) PCI DSS
4 2 (0.37%) SLA
4 2 (0.37%) Solvency II
5 1 (0.18%) Disclosure Scotland
5 1 (0.18%) GLP
5 1 (0.18%) GMP
5 1 (0.18%) GxP
5 1 (0.18%) IFRS
5 1 (0.18%) PMO
System Software
1 32 (5.85%) HDFS
2 21 (3.84%) Apache Flume
2 21 (3.84%) Docker
3 15 (2.74%) Virtual Machines
4 9 (1.65%) Active Directory
5 5 (0.91%) Apache ZooKeeper
Systems Management
1 17 (3.11%) Oozie
2 16 (2.93%) Kubernetes
3 12 (2.19%) Ansible
3 12 (2.19%) Terraform
4 9 (1.65%) Puppet
5 8 (1.46%) Hadoop YARN
6 7 (1.28%) Control-M
7 6 (1.10%) HP ALM
7 6 (1.10%) ITRS Geneos
7 6 (1.10%) Opscode Chef
8 4 (0.73%) Kibana
9 3 (0.55%) Ambari
10 2 (0.37%) Ganglia
10 2 (0.37%) logstash
10 2 (0.37%) Nagios
10 2 (0.37%) Salt
10 2 (0.37%) Single Sign-On
11 1 (0.18%) Consul
11 1 (0.18%) Packer
Vendors
1 158 (28.88%) Microsoft
2 58 (10.60%) Tableau
3 54 (9.87%) Oracle
4 53 (9.69%) Cloudera
5 50 (9.14%) Informatica
6 40 (7.31%) Talend
7 32 (5.85%) SAP
8 26 (4.75%) Google
9 22 (4.02%) Alteryx
10 21 (3.84%) Databricks
11 19 (3.47%) Hortonworks
12 16 (2.93%) Splunk
12 16 (2.93%) Teradata
13 14 (2.56%) Ab Initio
14 8 (1.46%) MapR
15 7 (1.28%) HP
16 6 (1.10%) MicroStrategy
16 6 (1.10%) Workday
17 5 (0.91%) Netezza
18 4 (0.73%) JD Edwards