Period
to 25 September 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 25 September 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
25 Sep 2018
Same period 2017 Same period 2016
Rank 450 647 779
Rank change year-on-year +197 +132 +84
Contract jobs citing Data Lake 473 191 102
As % of all contract IT jobs advertised in England 0.50% 0.21% 0.10%
As % of the Database & Business Intelligence category 2.19% 0.95% 0.47%
Number of daily rates quoted 321 141 71
England median daily rate £525 £550 £600
Median daily rate % change year-on-year -4.55% -8.33% -25.00%
10th Percentile £390 £363 £390
90th Percentile £725 £738 £775
UK median daily rate £513 £550 £575
% change year-on-year -6.82% -4.35% -28.13%
Number of hourly rates quoted 2 1 0
England median hourly rate £49.75 £45.00 -
Median hourly rate % change year-on-year +10.56% - -
UK median hourly rate £49.75 £45.00 -
% change year-on-year +10.56% - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 21,553 20,172 21,891
As % of all contract IT jobs advertised in England 22.93% 22.34% 22.31%
Number of daily rates quoted 15,253 13,626 14,830
England median daily rate £475 £450 £425
Median daily rate % change year-on-year +5.56% +5.88% +6.25%
10th Percentile £313 £306 £288
90th Percentile £638 £625 £600
UK median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 224 255 339
England median hourly rate £27.87 £30.00 £30.00
Median hourly rate % change year-on-year -7.12% - +7.14%
10th Percentile £14.00 £12.43 £11.50
90th Percentile £55.70 £52.50 £50.20
UK median hourly rate £27.73 £29.56 £30.10
% change year-on-year -6.19% -1.80% +2.04%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in England.

Contractor daily rate trend for Data Lake in England

Data Lake
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Data Lake in England over the 6 months to 25 September 2018.

Contractor daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake in England.

Contractor hourly rate trend for Data Lake in England

Data Lake
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Data Lake in England over the 6 months to 25 September 2018.

Contractor hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 25 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +160 308 £525 -4.55% 56
South East +57 128 £500 -6.98% 7
North of England -4 18 £550 -9.84% 10
North West -17 11 £550 -9.84% 7
South West -13 10 £500 +21.21% 11
Yorkshire -21 8 £488 -20.08% 3
East of England -7 7 £538 - 3
Midlands -29 2 £425 +17.24% 2
East Midlands -6 1 - - 2
West Midlands -24 1 £425 -23.60%
Data Lake
UK

For the 6 months to 25 September 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 241 (50.95%) Business Intelligence
2 232 (49.05%) Microsoft Azure
3 227 (47.99%) Analytics
4 226 (47.78%) Data Warehouse
5 217 (45.88%) Big Data
6 207 (43.76%) SQL
7 178 (37.63%) Agile Software Development
8 169 (35.73%) ETL
9 163 (34.46%) Hadoop
10 152 (32.14%) Microsoft
11 142 (30.02%) SQL Server
12 128 (27.06%) Power BI
13 116 (24.52%) Apache Spark
13 116 (24.52%) Python
14 109 (23.04%) Data Modelling
15 101 (21.35%) SQL Server Integration Services
16 97 (20.51%) Azure Data Factory
17 89 (18.82%) Amazon AWS
17 89 (18.82%) Finance
18 81 (17.12%) Apache Hive
19 73 (15.43%) Analytical Skills
20 71 (15.01%) NoSQL
21 70 (14.80%) Scrum
22 68 (14.38%) Data Science
22 68 (14.38%) Visualisation
22 68 (14.38%) SQL Server Analysis Services
23 66 (13.95%) SQL Server Reporting Services
24 65 (13.74%) Kafka
24 65 (13.74%) Relational Database
25 63 (13.32%) HDInsight

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 116 (24.52%) Apache Spark
2 35 (7.40%) SAS
3 31 (6.55%) Apache
4 13 (2.75%) Apache Pig
4 13 (2.75%) Elasticsearch
5 12 (2.54%) Apache Solr
6 9 (1.90%) Confluence
7 3 (0.63%) BizTalk Server
8 2 (0.42%) SharePoint
9 1 (0.21%) Alfresco
9 1 (0.21%) Apache Airflow
9 1 (0.21%) Apache ServiceMix
9 1 (0.21%) Appian
9 1 (0.21%) Content Management Server
9 1 (0.21%) Documentum
9 1 (0.21%) JBoss
9 1 (0.21%) Tomcat
9 1 (0.21%) WebSphere
Applications
1 6 (1.27%) Microsoft Excel
2 3 (0.63%) Microsoft Project
3 1 (0.21%) Microsoft Office
3 1 (0.21%) Microsoft PowerPoint
3 1 (0.21%) MS Visio
3 1 (0.21%) Shockwave
Business Applications
1 13 (2.75%) SAP Oil and Gas
2 7 (1.48%) SAP APO
2 7 (1.48%) SAP MM
3 5 (1.06%) Markit EDM
3 5 (1.06%) SAP ERP
3 5 (1.06%) SAP MDM
4 3 (0.63%) SAP HR
5 2 (0.42%) Global One
5 2 (0.42%) PolarLake
6 1 (0.21%) Cognos TM1
6 1 (0.21%) Dynamics CRM
6 1 (0.21%) HFM
6 1 (0.21%) Oracle EBS
6 1 (0.21%) Salesforce.com CRM
6 1 (0.21%) SAP S/4HANA
Cloud Services
1 232 (49.05%) Microsoft Azure
2 97 (20.51%) Azure Data Factory
3 89 (18.82%) Amazon AWS
4 38 (8.03%) Data Lake Analytics
5 31 (6.55%) PaaS
6 29 (6.13%) Serverless
7 27 (5.71%) Amazon S3
8 26 (5.50%) Azure Machine Learning
9 19 (4.02%) Amazon Kinesis
10 16 (3.38%) Cortana Intelligence Suite
11 15 (3.17%) SaaS
12 13 (2.75%) Amazon EMR
13 12 (2.54%) Azure Functions
13 12 (2.54%) Google Cloud Platform
14 11 (2.33%) IaaS
15 10 (2.11%) Azure Active Directory
16 9 (1.90%) AWS Lambda
17 8 (1.69%) Amazon EC2
18 7 (1.48%) GitHub
19 5 (1.06%) Google Analytics
Communications & Networking
1 7 (1.48%) VPN
2 5 (1.06%) Kerberos
2 5 (1.06%) SSL
3 4 (0.85%) Network Security
4 2 (0.42%) DNS
4 2 (0.42%) Firewall
4 2 (0.42%) Internet
5 1 (0.21%) Intranet
Database & Business Intelligence
1 226 (47.78%) Data Warehouse
2 217 (45.88%) Big Data
3 163 (34.46%) Hadoop
4 142 (30.02%) SQL Server
5 128 (27.06%) Power BI
6 101 (21.35%) SQL Server Integration Services
7 81 (17.12%) Apache Hive
8 71 (15.01%) NoSQL
9 68 (14.38%) SQL Server Analysis Services
10 66 (13.95%) SQL Server Reporting Services
11 65 (13.74%) Relational Database
12 63 (13.32%) HDInsight
13 58 (12.26%) Cosmos DB
14 56 (11.84%) Azure SQL Data Warehouse
15 48 (10.15%) HBase
16 47 (9.94%) Azure SQL Database
17 37 (7.82%) MongoDB
18 31 (6.55%) MySQL
18 31 (6.55%) OLAP
19 28 (5.92%) SAP BW
Development Applications
1 46 (9.73%) Git (software)
2 40 (8.46%) Visual Studio Team System
3 28 (5.92%) Jenkins
4 25 (5.29%) Team Foundation Server
5 22 (4.65%) JIRA
6 20 (4.23%) Visual Studio
7 7 (1.48%) ERwin
7 7 (1.48%) NUnit
8 6 (1.27%) JUnit
8 6 (1.27%) Sonatype Nexus
9 5 (1.06%) FishEye
9 5 (1.06%) Maven
9 5 (1.06%) Moq
10 4 (0.85%) Ant
10 4 (0.85%) CruiseControl
10 4 (0.85%) Cucumber
10 4 (0.85%) IBM UrbanCode
10 4 (0.85%) TeamCity
11 3 (0.63%) RStudio
11 3 (0.63%) SpecFlow
General
1 89 (18.82%) Finance
2 43 (9.09%) Retail
3 16 (3.38%) Games
4 15 (3.17%) Banking
5 11 (2.33%) Pharmaceutical
6 6 (1.27%) Back Office
6 6 (1.27%) Publishing
7 5 (1.06%) Front Office
7 5 (1.06%) Marketing
8 3 (0.63%) Investment Banking
8 3 (0.63%) Legal
9 2 (0.42%) Digital Economy
9 2 (0.42%) Telecoms
10 1 (0.21%) Advertising
10 1 (0.21%) Financial Institution
10 1 (0.21%) Spanish Language
Job Titles
1 138 (29.18%) Developer
2 110 (23.26%) Architect
3 73 (15.43%) Data Architect
4 70 (14.80%) Data Engineer
5 44 (9.30%) Azure Developer
6 35 (7.40%) Business Intelligence Developer
7 32 (6.77%) Analyst
7 32 (6.77%) Big Data Engineer
8 31 (6.55%) Azure Architect
9 25 (5.29%) Solutions Architect
10 24 (5.07%) Consultant
11 23 (4.86%) Big Data Developer
12 21 (4.44%) Big Data Architect
12 21 (4.44%) Cloud Architect
13 20 (4.23%) Azure Engineer
14 16 (3.38%) Business Analyst
15 15 (3.17%) AWS Engineer
16 14 (2.96%) Hadoop Engineer
17 13 (2.75%) Data Analyst
17 13 (2.75%) Technical Architect
Libraries, Frameworks & Software Standards
1 65 (13.74%) Kafka
2 58 (12.26%) .NET
3 20 (4.23%) JSON
4 18 (3.81%) ASP.NET Web API
5 17 (3.59%) REST
6 15 (3.17%) .NET Core
7 13 (2.75%) AngularJS
8 11 (2.33%) RESTful
9 10 (2.11%) .NET Framework
9 10 (2.11%) HTML
9 10 (2.11%) MDX
10 9 (1.90%) Angular 2
10 9 (1.90%) Natural Language Processing
11 8 (1.69%) HTML5
11 8 (1.69%) RabbitMQ
11 8 (1.69%) React
11 8 (1.69%) Spark Streaming
12 7 (1.48%) Entity Framework
12 7 (1.48%) XML
13 6 (1.27%) ASP.NET
Miscellaneous
1 73 (15.43%) Analytical Skills
2 26 (5.50%) Greenfield Project
3 21 (4.44%) Data Structures
4 18 (3.81%) Algorithms
5 13 (2.75%) Computer Science
6 12 (2.54%) Fintech
7 11 (2.33%) Management Information System
8 7 (1.48%) Self-Motivation
9 6 (1.27%) Cloud Native
9 6 (1.27%) Enterprise Software
10 4 (0.85%) AS400
10 4 (0.85%) Fixed Income
10 4 (0.85%) Private Cloud
10 4 (0.85%) Reference Data
10 4 (0.85%) Virtual Team
11 3 (0.63%) Cyberthreat
11 3 (0.63%) Mobile App
12 2 (0.42%) Data Centre
12 2 (0.42%) Hybrid Cloud
12 2 (0.42%) User Experience
Operating Systems
1 18 (3.81%) Linux
1 18 (3.81%) Unix
2 6 (1.27%) Windows
3 1 (0.21%) Oracle Linux
3 1 (0.21%) Ubuntu
Processes & Methodologies
1 241 (50.95%) Business Intelligence
2 227 (47.99%) Analytics
3 178 (37.63%) Agile Software Development
4 169 (35.73%) ETL
5 109 (23.04%) Data Modelling
6 70 (14.80%) Scrum
7 68 (14.38%) Data Science
7 68 (14.38%) Visualisation
8 60 (12.68%) Data Architecture
9 56 (11.84%) Data Management
9 56 (11.84%) Migration
10 54 (11.42%) Data Integration
11 53 (11.21%) DevOps
12 51 (10.78%) Problem-Solving
13 47 (9.94%) Machine Learning
14 45 (9.51%) Data Analytics
15 44 (9.30%) Stakeholder Management
16 40 (8.46%) Data Governance
17 39 (8.25%) TDD
18 32 (6.77%) Data Mapping
Programming Languages
1 207 (43.76%) SQL
2 116 (24.52%) Python
3 55 (11.63%) C#
4 53 (11.21%) Java
5 49 (10.36%) Scala
6 47 (9.94%) R
7 36 (7.61%) T-SQL
8 30 (6.34%) JavaScript
9 27 (5.71%) PowerShell
10 24 (5.07%) U-SQL
11 14 (2.96%) VB
12 11 (2.33%) Shell Script
13 8 (1.69%) Data Analysis Expressions (DAX)
14 7 (1.48%) Bash Shell
14 7 (1.48%) MATLAB
14 7 (1.48%) Perl
15 6 (1.27%) C
16 4 (0.85%) Ruby
17 2 (0.42%) TypeScript
17 2 (0.42%) VBA
Qualifications
1 19 (4.02%) Degree
2 11 (2.33%) Computer Science Degree
3 9 (1.90%) Microsoft Certification
4 4 (0.85%) CISSP
4 4 (0.85%) Numerate Degree
5 3 (0.63%) SC Cleared
5 3 (0.63%) Security Cleared
6 2 (0.42%) CEH
6 2 (0.42%) CISM
7 1 (0.21%) (ISC)2 CCSP
7 1 (0.21%) BPSS Clearance
7 1 (0.21%) Cisco Certification
7 1 (0.21%) ITIL Certification
7 1 (0.21%) Master's Degree
7 1 (0.21%) PhD
7 1 (0.21%) Postgraduate
Quality Assurance & Compliance
1 54 (11.42%) Data Quality
2 24 (5.07%) QA
3 12 (2.54%) GDPR
4 2 (0.42%) HL7
4 2 (0.42%) PCI DSS
4 2 (0.42%) SLA
4 2 (0.42%) Solvency II
5 1 (0.21%) Disclosure Scotland
5 1 (0.21%) GLP
5 1 (0.21%) GMP
5 1 (0.21%) GxP
5 1 (0.21%) IFRS
5 1 (0.21%) PMO
System Software
1 31 (6.55%) HDFS
2 17 (3.59%) Docker
3 15 (3.17%) Apache Flume
4 10 (2.11%) Active Directory
4 10 (2.11%) Virtual Machines
5 7 (1.48%) Apache ZooKeeper
6 1 (0.21%) Hyper-V
Systems Management
1 17 (3.59%) Terraform
2 15 (3.17%) Oozie
3 11 (2.33%) Ansible
3 11 (2.33%) Kubernetes
3 11 (2.33%) Puppet
4 10 (2.11%) Opscode Chef
5 9 (1.90%) Hadoop YARN
6 6 (1.27%) HP ALM
7 5 (1.06%) Kibana
8 3 (0.63%) Ambari
9 2 (0.42%) Ganglia
9 2 (0.42%) logstash
9 2 (0.42%) Nagios
10 1 (0.21%) Consul
10 1 (0.21%) Control-M
10 1 (0.21%) Failover Clustering
10 1 (0.21%) Packer
10 1 (0.21%) SCVMM
Vendors
1 152 (32.14%) Microsoft
2 57 (12.05%) Tableau
3 55 (11.63%) Oracle
4 48 (10.15%) Informatica
5 44 (9.30%) Cloudera
6 41 (8.67%) Talend
7 38 (8.03%) SAP
8 23 (4.86%) Hortonworks
9 20 (4.23%) Databricks
10 18 (3.81%) Alteryx
11 17 (3.59%) Ab Initio
12 15 (3.17%) Google
13 13 (2.75%) Teradata
14 9 (1.90%) MapR
14 9 (1.90%) Splunk
15 7 (1.48%) IBM
15 7 (1.48%) MicroStrategy
15 7 (1.48%) Netezza
16 6 (1.27%) Cognos
16 6 (1.27%) HP