Period
to 22 January 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 22 January 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
22 Jan 2019
Same period 2018 Same period 2017
Rank 369 542 675
Rank change year-on-year +173 +133 +153
Contract jobs citing Data Lake 633 317 170
As % of all contract IT jobs advertised in England 0.69% 0.35% 0.19%
As % of the Database & Business Intelligence category 3.07% 1.57% 0.85%
Number of daily rates quoted 442 253 111
England median daily rate £525 £513 £550
Median daily rate % change year-on-year +2.44% -6.82% -
10th Percentile £413 £370 £400
90th Percentile £725 £643 £675
UK median daily rate £525 £500 £550
% change year-on-year +5.00% -9.09% -
Number of hourly rates quoted 0 1 0
England median hourly rate - £45.00 -
UK median hourly rate - £45.00 -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 20,644 20,134 19,979
As % of all contract IT jobs advertised in England 22.61% 21.95% 22.57%
Number of daily rates quoted 14,355 14,172 13,462
England median daily rate £483 £475 £430
Median daily rate % change year-on-year +1.68% +10.47% +1.18%
10th Percentile £323 £313 £295
90th Percentile £650 £631 £613
UK median daily rate £475 £455 £425
% change year-on-year +4.40% +7.06% +2.41%
Number of hourly rates quoted 218 225 264
England median hourly rate £35.00 £30.75 £27.50
Median hourly rate % change year-on-year +13.82% +11.82% -8.33%
10th Percentile £14.85 £15.07 £9.63
90th Percentile £56.40 £58.00 £46.93
UK median hourly rate £32.75 £30.50 £28.18
% change year-on-year +7.38% +8.23% -6.07%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in England.

Contractor daily rate trend for Data Lake in England

Data Lake
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Data Lake in England over the 6 months to 22 January 2019.

Contractor daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake in England.

Contractor hourly rate trend for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 22 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +160 395 £525 +2.44% 56
South East +60 150 £525 -8.70% 23
North of England +20 43 £500 -18.03% 10
South West -23 23 £550 +22.22% 4
North West +14 22 £525 -13.93% 6
Yorkshire 0 20 £510 -16.39% 2
Midlands +7 14 £616 +29.74% 8
East of England +6 8 £538 -4.87% 6
West Midlands -20 8 £438 -9.09% 6
East Midlands +15 6 £845 +87.78% 2
North East -8 4 £506 -17.01% 2
Data Lake
UK

For the 6 months to 22 January 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 343 (54.19%) Microsoft Azure
2 280 (44.23%) SQL
3 265 (41.86%) Analytics
4 246 (38.86%) Data Warehouse
5 244 (38.55%) Agile Software Development
6 238 (37.60%) Business Intelligence
7 223 (35.23%) Big Data
8 183 (28.91%) Hadoop
9 165 (26.07%) Microsoft
10 160 (25.28%) ETL
11 155 (24.49%) SQL Server
12 154 (24.33%) Power BI
13 153 (24.17%) Azure Data Factory
14 151 (23.85%) SQL Server Integration Services
15 143 (22.59%) Apache Spark
16 141 (22.27%) Python
17 136 (21.48%) Data Modelling
18 124 (19.59%) Scrum
19 113 (17.85%) Apache Hive
19 113 (17.85%) DevOps
20 110 (17.38%) Finance
21 102 (16.11%) Azure SQL Database
22 100 (15.80%) Amazon AWS
23 96 (15.17%) Data Management
24 95 (15.01%) Data Science
25 87 (13.74%) HDInsight
26 82 (12.95%) Kafka
27 81 (12.80%) Visual Studio Team System
27 81 (12.80%) Azure SQL Data Warehouse
27 81 (12.80%) Serverless

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 143 (22.59%) Apache Spark
2 33 (5.21%) Apache
3 28 (4.42%) SAS
4 16 (2.53%) Confluence
5 15 (2.37%) Elasticsearch
6 9 (1.42%) Apache Pig
6 9 (1.42%) SharePoint
7 4 (0.63%) Apache Airflow
7 4 (0.63%) Apache Solr
8 2 (0.32%) Jupyter
8 2 (0.32%) K2 blackpearl
8 2 (0.32%) Luigi
8 2 (0.32%) nginx
8 2 (0.32%) Oracle SOA Suite
8 2 (0.32%) PowerExchange
8 2 (0.32%) SharePoint 2013
9 1 (0.16%) Alfresco
9 1 (0.16%) Content Management Server
9 1 (0.16%) OpenStack
Applications
1 14 (2.21%) Microsoft Excel
2 3 (0.47%) Spreadsheet
3 2 (0.32%) SPSS
4 1 (0.16%) Microsoft Office
4 1 (0.16%) MS Visio
Business Applications
1 11 (1.74%) SAP Oil and Gas
2 10 (1.58%) Dynamics CRM
3 4 (0.63%) Dynamics AX
3 4 (0.63%) Dynamics NAV
4 2 (0.32%) Markit EDM
4 2 (0.32%) NetSuite
4 2 (0.32%) PolarLake
5 1 (0.16%) SAP PLM
5 1 (0.16%) Summit
Cloud Services
1 343 (54.19%) Microsoft Azure
2 153 (24.17%) Azure Data Factory
3 100 (15.80%) Amazon AWS
4 81 (12.80%) Serverless
5 67 (10.58%) PaaS
6 59 (9.32%) Data Lake Analytics
7 39 (6.16%) Azure Functions
7 39 (6.16%) IaaS
8 35 (5.53%) Amazon S3
9 33 (5.21%) Google Cloud Platform
10 23 (3.63%) Azure Machine Learning
11 22 (3.48%) Amazon Kinesis
12 20 (3.16%) Amazon EMR
13 16 (2.53%) Azure Active Directory
14 14 (2.21%) AWS Lambda
15 11 (1.74%) Cortana Intelligence Suite
16 10 (1.58%) Amazon EC2
16 10 (1.58%) GitHub
17 9 (1.42%) SaaS
18 6 (0.95%) Office 365
Communications & Networking
1 6 (0.95%) Firewall
1 6 (0.95%) Network Security
2 4 (0.63%) Internet
2 4 (0.63%) Kerberos
2 4 (0.63%) VPN
3 3 (0.47%) DNS
4 2 (0.32%) SSL
4 2 (0.32%) Wi-Fi
Database & Business Intelligence
1 246 (38.86%) Data Warehouse
2 223 (35.23%) Big Data
3 183 (28.91%) Hadoop
4 155 (24.49%) SQL Server
5 154 (24.33%) Power BI
6 151 (23.85%) SQL Server Integration Services
7 113 (17.85%) Apache Hive
8 102 (16.11%) Azure SQL Database
9 87 (13.74%) HDInsight
10 81 (12.80%) Azure SQL Data Warehouse
11 72 (11.37%) SQL Server Analysis Services
12 69 (10.90%) Cosmos DB
12 69 (10.90%) Relational Database
13 65 (10.27%) SQL Server Reporting Services
14 56 (8.85%) NoSQL
15 44 (6.95%) HBase
16 36 (5.69%) Impala
17 31 (4.90%) Redis
17 31 (4.90%) Sqoop
18 28 (4.42%) MongoDB
Development Applications
1 81 (12.80%) Visual Studio Team System
2 48 (7.58%) Visual Studio
3 44 (6.95%) Git (software)
4 31 (4.90%) Jenkins
5 27 (4.27%) JIRA
6 19 (3.00%) Team Foundation Server
7 12 (1.90%) NUnit
8 11 (1.74%) Moq
9 6 (0.95%) Selenium
10 5 (0.79%) ERwin
10 5 (0.79%) JUnit
11 4 (0.63%) Ant
11 4 (0.63%) CruiseControl
11 4 (0.63%) IBM UrbanCode
11 4 (0.63%) Maven
11 4 (0.63%) Sonatype Nexus
12 3 (0.47%) RStudio
12 3 (0.47%) SoapUI
13 2 (0.32%) FishEye
13 2 (0.32%) TeamCity
General
1 110 (17.38%) Finance
2 60 (9.48%) Retail
3 46 (7.27%) Banking
4 18 (2.84%) Marketing
5 8 (1.26%) Front Office
6 7 (1.11%) Back Office
6 7 (1.11%) Investment Banking
6 7 (1.11%) Legal
7 6 (0.95%) Publishing
8 5 (0.79%) Telecoms
9 4 (0.63%) Games
9 4 (0.63%) Pharmaceutical
10 1 (0.16%) Advertising
10 1 (0.16%) Dutch Language
10 1 (0.16%) French Language
10 1 (0.16%) Manufacturing
10 1 (0.16%) Retail Banking
Job Titles
1 187 (29.54%) Developer
2 135 (21.33%) Architect
3 113 (17.85%) Data Engineer
4 84 (13.27%) Data Architect
5 76 (12.01%) Azure Developer
6 44 (6.95%) Business Intelligence Developer
7 43 (6.79%) Azure Architect
8 40 (6.32%) Azure Engineer
8 40 (6.32%) Big Data Engineer
9 38 (6.00%) DevOps Engineer
10 31 (4.90%) .NET Developer
11 29 (4.58%) Technical Architect
12 24 (3.79%) Analyst
12 24 (3.79%) Consultant
13 23 (3.63%) C# Developer
14 21 (3.32%) Azure DevOps
15 20 (3.16%) Solutions Architect
16 19 (3.00%) Designer
17 18 (2.84%) Senior Developer
18 17 (2.69%) Python Engineer
Libraries, Frameworks & Software Standards
1 82 (12.95%) Kafka
2 78 (12.32%) .NET
3 37 (5.85%) AngularJS
4 35 (5.53%) ASP.NET Web API
5 33 (5.21%) REST
6 30 (4.74%) JSON
7 29 (4.58%) .NET Core
8 22 (3.48%) HTML
9 18 (2.84%) CSS
10 17 (2.69%) Node.js
10 17 (2.69%) React
11 16 (2.53%) .NET Framework
11 16 (2.53%) ASP.NET
12 15 (2.37%) Twitter Bootstrap
13 12 (1.90%) Angular 2
13 12 (1.90%) Apache NiFi
13 12 (1.90%) Express
13 12 (1.90%) Vue.js
14 11 (1.74%) Pug
15 10 (1.58%) XML
Miscellaneous
1 63 (9.95%) Analytical Skills
2 60 (9.48%) Greenfield Project
3 33 (5.21%) Data Structures
4 18 (2.84%) Algorithms
5 15 (2.37%) Fintech
6 13 (2.05%) Management Information System
7 11 (1.74%) Virtual Team
8 8 (1.26%) Cloud Native
9 5 (0.79%) Digital Media
9 5 (0.79%) Self-Motivation
10 4 (0.63%) Enterprise Software
10 4 (0.63%) EPoS
10 4 (0.63%) Fixed Income
10 4 (0.63%) Hybrid Cloud
10 4 (0.63%) Private Cloud
10 4 (0.63%) Public Cloud
10 4 (0.63%) Reference Data
11 3 (0.47%) Cyberthreat
11 3 (0.47%) Data Centre
11 3 (0.47%) NHS
Operating Systems
1 33 (5.21%) Windows
2 20 (3.16%) Linux
3 11 (1.74%) Unix
4 2 (0.32%) VMS
5 1 (0.16%) Oracle Linux
5 1 (0.16%) Ubuntu
5 1 (0.16%) Windows Server
Processes & Methodologies
1 265 (41.86%) Analytics
2 244 (38.55%) Agile Software Development
3 238 (37.60%) Business Intelligence
4 160 (25.28%) ETL
5 136 (21.48%) Data Modelling
6 124 (19.59%) Scrum
7 113 (17.85%) DevOps
8 96 (15.17%) Data Management
9 95 (15.01%) Data Science
10 73 (11.53%) Continuous Integration
11 64 (10.11%) Migration
12 58 (9.16%) Data Architecture
12 58 (9.16%) Test Automation
13 57 (9.00%) Data Analytics
14 54 (8.53%) TDD
15 53 (8.37%) Machine Learning
16 48 (7.58%) Continuous Delivery
17 46 (7.27%) Data Integration
18 45 (7.11%) Kimball Methodology
18 45 (7.11%) Microservices
Programming Languages
1 280 (44.23%) SQL
2 141 (22.27%) Python
3 79 (12.48%) PowerShell
4 71 (11.22%) C#
5 70 (11.06%) Java
6 60 (9.48%) Scala
7 44 (6.95%) T-SQL
8 42 (6.64%) R
9 34 (5.37%) JavaScript
10 27 (4.27%) U-SQL
11 14 (2.21%) Data Analysis Expressions (DAX)
12 12 (1.90%) Shell Script
13 8 (1.26%) Bash Shell
14 7 (1.11%) C
15 6 (0.95%) Ruby
15 6 (0.95%) VB
16 4 (0.63%) Perl
17 3 (0.47%) VBA
18 2 (0.32%) C++
18 2 (0.32%) PHP
Qualifications
1 18 (2.84%) Degree
2 11 (1.74%) Computer Science Degree
3 9 (1.42%) BPSS Clearance
4 5 (0.79%) Security Cleared
4 5 (0.79%) TOGAF Certification
5 4 (0.63%) CEH
5 4 (0.63%) Microsoft Certification
6 3 (0.47%) AWS Certification
6 3 (0.47%) ITIL Certification
6 3 (0.47%) Postgraduate
6 3 (0.47%) SC Cleared
7 2 (0.32%) CISM
7 2 (0.32%) CISSP
7 2 (0.32%) Numerate Degree
7 2 (0.32%) PMI Certification
8 1 (0.16%) DBS Check
8 1 (0.16%) DV Cleared
8 1 (0.16%) ISEB
8 1 (0.16%) ISTQB
8 1 (0.16%) SAS Certification
Quality Assurance & Compliance
1 34 (5.37%) Data Quality
2 24 (3.79%) QA
3 6 (0.95%) GDPR
4 2 (0.32%) Disclosure Scotland
4 2 (0.32%) HL7
4 2 (0.32%) Solvency II
5 1 (0.16%) GLP
5 1 (0.16%) GMP
5 1 (0.16%) GxP
5 1 (0.16%) IFRS
5 1 (0.16%) PCI DSS
5 1 (0.16%) PMO
5 1 (0.16%) SLA
System Software
1 35 (5.53%) Virtual Machines
2 34 (5.37%) Apache Flume
3 32 (5.06%) Docker
4 31 (4.90%) HDFS
5 14 (2.21%) Active Directory
6 5 (0.79%) Apache ZooKeeper
Systems Management
1 29 (4.58%) Kubernetes
2 19 (3.00%) Oozie
3 17 (2.69%) Terraform
4 12 (1.90%) Ansible
4 12 (1.90%) Hadoop YARN
5 10 (1.58%) Puppet
6 7 (1.11%) Control-M
7 6 (0.95%) ITRS Geneos
7 6 (0.95%) Opscode Chef
8 3 (0.47%) Ambari
9 2 (0.32%) Ganglia
9 2 (0.32%) Kibana
9 2 (0.32%) logstash
9 2 (0.32%) Nagios
9 2 (0.32%) Salt
9 2 (0.32%) Single Sign-On
Vendors
1 165 (26.07%) Microsoft
2 60 (9.48%) Cloudera
3 58 (9.16%) Oracle
4 53 (8.37%) Tableau
5 46 (7.27%) Talend
6 45 (7.11%) Informatica
7 32 (5.06%) Databricks
8 31 (4.90%) Google
9 27 (4.27%) SAP
10 23 (3.63%) Hortonworks
11 20 (3.16%) Splunk
12 16 (2.53%) Alteryx
13 12 (1.90%) Teradata
14 11 (1.74%) Ab Initio
15 9 (1.42%) MapR
16 6 (0.95%) Atlassian
17 5 (0.79%) ATG
18 4 (0.63%) Cisco
18 4 (0.63%) MicroStrategy
18 4 (0.63%) Sybase