Period
to 21 June 2018

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 21 June 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
21 Jun 2018
Same period 2017 Same period 2016
Rank 457 652 811
Rank change year-on-year +195 +159 +13
Contract jobs citing Data Lake 453 158 58
As % of all contract IT jobs advertised in England 0.50% 0.19% 0.059%
As % of the Database & Business Intelligence category 2.19% 0.83% 0.27%
Number of daily rates quoted 310 99 38
England median daily rate £500 £525 £525
Median daily rate % change year-on-year -4.76% - -
10th Percentile £400 £362 £363
90th Percentile £688 £675 £765
UK median daily rate £500 £525 £500
% change year-on-year -4.76% +5.00% -
Number of hourly rates quoted 4 0 0
England median hourly rate £47.25 - -
UK median hourly rate £47.25 - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 20,716 19,028 21,731
As % of all contract IT jobs advertised in England 22.68% 22.64% 22.12%
Number of daily rates quoted 14,548 12,761 14,826
England median daily rate £475 £450 £425
Median daily rate % change year-on-year +5.56% +5.88% +6.25%
10th Percentile £313 £300 £285
90th Percentile £638 £616 £600
UK median daily rate £463 £440 £425
% change year-on-year +5.11% +3.53% +6.25%
Number of hourly rates quoted 214 234 338
England median hourly rate £35.00 £28.25 £32.20
Median hourly rate % change year-on-year +23.89% -12.27% +28.80%
10th Percentile £14.08 £9.25 £12.60
90th Percentile £54.63 £50.00 £54.26
UK median hourly rate £35.00 £29.00 £31.00
% change year-on-year +20.69% -6.45% +19.23%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in England.

Contractor daily rate trend for Data Lake in England

Data Lake
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Data Lake in England over the 6 months to 21 June 2018.

Contractor daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake in England.

Contractor hourly rate trend for Data Lake in England

Data Lake
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Data Lake in England over the 6 months to 21 June 2018.

Contractor hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 21 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +126 289 £525 - 42
South East +81 126 £500 +1.27% 17
North of England -18 16 £550 +4.76% 5
Yorkshire -4 9 £475 - 1
Midlands -9 9 £488 -7.14% 1
East of England +10 7 £425 -
North West -3 7 £550 +4.76% 4
South West +1 6 £450 -9.09% 1
West Midlands -7 6 £488 -11.36%
East Midlands -2 3 £450 -14.29% 1
North East - 2 £604 -
Data Lake
UK

For the 6 months to 21 June 2018, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 253 (55.85%) Big Data
2 220 (48.57%) Analytics
3 219 (48.34%) Business Intelligence
4 217 (47.90%) SQL
5 215 (47.46%) Microsoft Azure
6 214 (47.24%) Data Warehouse
7 192 (42.38%) Hadoop
8 161 (35.54%) Agile Software Development
9 158 (34.88%) SQL Server
10 150 (33.11%) ETL
11 142 (31.35%) Microsoft
12 121 (26.71%) Apache Spark
13 116 (25.61%) Data Modelling
14 113 (24.94%) Power BI
15 109 (24.06%) Python
16 94 (20.75%) Finance
17 90 (19.87%) Amazon AWS
18 86 (18.98%) Apache Hive
19 83 (18.32%) SQL Server Integration Services
19 83 (18.32%) Azure Data Factory
20 82 (18.10%) HDInsight
21 73 (16.11%) Analytical Skills
21 73 (16.11%) Scrum
21 73 (16.11%) Java
22 72 (15.89%) Problem-Solving
23 71 (15.67%) C#
24 65 (14.35%) Visualisation
24 65 (14.35%) Data Architecture
24 65 (14.35%) NoSQL
25 61 (13.47%) Cloudera

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 121 (26.71%) Apache Spark
2 26 (5.74%) SAS
3 24 (5.30%) Apache
4 17 (3.75%) Apache Pig
5 12 (2.65%) Apache Solr
5 12 (2.65%) Elasticsearch
6 7 (1.55%) Confluence
7 3 (0.66%) Oracle SOA Suite
7 3 (0.66%) SharePoint
8 2 (0.44%) BizTalk Server
8 2 (0.44%) WebSphere
9 1 (0.22%) CMS
9 1 (0.22%) IBM Domino
9 1 (0.22%) IPython
9 1 (0.22%) JBoss
9 1 (0.22%) Jupyter
9 1 (0.22%) Tomcat
Applications
1 7 (1.55%) Microsoft Excel
2 3 (0.66%) SPSS
3 2 (0.44%) Microsoft Office
3 2 (0.44%) Microsoft PowerPoint
3 2 (0.44%) Microsoft Project
3 2 (0.44%) MS Visio
4 1 (0.22%) Shockwave
Business Applications
1 15 (3.31%) SAP Oil and Gas
2 9 (1.99%) SAP APO
3 7 (1.55%) SAP ERP
4 6 (1.32%) SAP MM
5 4 (0.88%) Markit EDM
5 4 (0.88%) SAP MDM
6 3 (0.66%) SAP HR
7 2 (0.44%) Global One
7 2 (0.44%) Oracle Financials
8 1 (0.22%) Cognos TM1
8 1 (0.22%) Dynamics CRM
8 1 (0.22%) PolarLake
8 1 (0.22%) SAP S/4HANA
Cloud Services
1 215 (47.46%) Microsoft Azure
2 90 (19.87%) Amazon AWS
3 83 (18.32%) Azure Data Factory
4 32 (7.06%) Data Lake Analytics
5 29 (6.40%) Serverless
6 25 (5.52%) PaaS
7 20 (4.42%) Amazon Kinesis
7 20 (4.42%) Amazon S3
8 18 (3.97%) Cortana Intelligence Suite
9 13 (2.87%) Azure Machine Learning
9 13 (2.87%) SaaS
10 11 (2.43%) AWS Lambda
10 11 (2.43%) Google Tag Manager
11 9 (1.99%) Amazon EMR
12 6 (1.32%) IaaS
12 6 (1.32%) iPaaS
13 5 (1.10%) Azure Active Directory
13 5 (1.10%) Google Cloud Platform
14 4 (0.88%) Dynamics 365
15 2 (0.44%) Amazon EC2
Communications & Networking
1 7 (1.55%) Kerberos
1 7 (1.55%) VPN
2 6 (1.32%) SSL
3 1 (0.22%) Firewall
Database & Business Intelligence
1 253 (55.85%) Big Data
2 214 (47.24%) Data Warehouse
3 192 (42.38%) Hadoop
4 158 (34.88%) SQL Server
5 113 (24.94%) Power BI
6 86 (18.98%) Apache Hive
7 83 (18.32%) SQL Server Integration Services
8 82 (18.10%) HDInsight
9 65 (14.35%) NoSQL
10 61 (13.47%) SQL Server Reporting Services
11 60 (13.25%) Cosmos DB
11 60 (13.25%) HBase
12 55 (12.14%) SQL Server Analysis Services
13 51 (11.26%) MongoDB
13 51 (11.26%) PostgreSQL
13 51 (11.26%) Relational Database
14 43 (9.49%) Azure SQL Data Warehouse
14 43 (9.49%) Azure SQL Database
15 38 (8.39%) Impala
16 36 (7.95%) MySQL
Development Applications
1 45 (9.93%) Git (software)
2 21 (4.64%) Jenkins
3 20 (4.42%) Team Foundation Server
4 16 (3.53%) JIRA
5 14 (3.09%) Visual Studio
6 12 (2.65%) Visual Studio Team System
7 11 (2.43%) SpecFlow
8 9 (1.99%) ERwin
9 7 (1.55%) Maven
9 7 (1.55%) Selenium
9 7 (1.55%) TeamCity
9 7 (1.55%) tSQLt
10 6 (1.32%) FishEye
11 5 (1.10%) JUnit
11 5 (1.10%) Octopus Deploy
12 4 (0.88%) Cucumber
12 4 (0.88%) GitLab
12 4 (0.88%) JSUnit
13 3 (0.66%) Sonatype Nexus
14 2 (0.44%) Ant
General
1 94 (20.75%) Finance
2 30 (6.62%) Retail
3 27 (5.96%) Games
4 24 (5.30%) Banking
5 11 (2.43%) Legal
6 8 (1.77%) Marketing
7 7 (1.55%) Investment Banking
8 5 (1.10%) Digital Economy
8 5 (1.10%) Pharmaceutical
9 4 (0.88%) Back Office
10 3 (0.66%) Financial Institution
10 3 (0.66%) Publishing
11 2 (0.44%) Dutch Language
11 2 (0.44%) French Language
11 2 (0.44%) German Language
11 2 (0.44%) Italian Language
11 2 (0.44%) Manufacturing
11 2 (0.44%) Spanish Language
12 1 (0.22%) Advertising
12 1 (0.22%) Front Office
Job Titles
1 120 (26.49%) Developer
2 94 (20.75%) Architect
3 71 (15.67%) Data Engineer
4 65 (14.35%) Data Architect
5 51 (11.26%) Analyst
6 33 (7.28%) Big Data Developer
7 32 (7.06%) Consultant
8 31 (6.84%) Azure Architect
9 27 (5.96%) Big Data Engineer
10 26 (5.74%) Azure Developer
11 25 (5.52%) Business Analyst
11 25 (5.52%) Business Intelligence Developer
12 24 (5.30%) Data Analyst
13 22 (4.86%) Azure Engineer
13 22 (4.86%) Big Data Architect
13 22 (4.86%) Business Intelligence Analyst
13 22 (4.86%) Solutions Architect
14 19 (4.19%) Azure Consultant
15 17 (3.75%) Data Business Analyst
15 17 (3.75%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 59 (13.02%) Kafka
2 46 (10.15%) .NET
3 42 (9.27%) RESTful
4 30 (6.62%) Web Services
5 20 (4.42%) JSON
6 15 (3.31%) XML
7 14 (3.09%) SOAP
8 12 (2.65%) HTML
8 12 (2.65%) REST
9 11 (2.43%) MDX
10 10 (2.21%) ASP.NET Web API
10 10 (2.21%) HTML5
11 8 (1.77%) ASP.NET
11 8 (1.77%) CSS
11 8 (1.77%) Spark Streaming
12 7 (1.55%) AngularJS
12 7 (1.55%) Natural Language Processing
12 7 (1.55%) Velocity
13 6 (1.32%) RabbitMQ
13 6 (1.32%) React
Miscellaneous
1 73 (16.11%) Analytical Skills
2 28 (6.18%) Greenfield Project
3 26 (5.74%) Computer Science
4 17 (3.75%) Management Information System
5 14 (3.09%) Self-Motivation
6 12 (2.65%) Algorithms
7 10 (2.21%) Fintech
8 9 (1.99%) Enterprise Software
9 6 (1.32%) Hybrid Cloud
9 6 (1.32%) Market Risk
9 6 (1.32%) User Experience
10 5 (1.10%) Data Structures
11 4 (0.88%) Private Cloud
11 4 (0.88%) Virtual Team
12 3 (0.66%) AS400
12 3 (0.66%) Client/Server
12 3 (0.66%) NHS
13 2 (0.44%) Blog
13 2 (0.44%) Clustering
13 2 (0.44%) Replication
Operating Systems
1 36 (7.95%) Linux
2 22 (4.86%) Unix
3 15 (3.31%) CentOS
4 9 (1.99%) Windows
5 2 (0.44%) Ubuntu
5 2 (0.44%) Windows Server
Processes & Methodologies
1 220 (48.57%) Analytics
2 219 (48.34%) Business Intelligence
3 161 (35.54%) Agile Software Development
4 150 (33.11%) ETL
5 116 (25.61%) Data Modelling
6 73 (16.11%) Scrum
7 72 (15.89%) Problem-Solving
8 65 (14.35%) Data Architecture
8 65 (14.35%) Visualisation
9 61 (13.47%) Data Integration
10 58 (12.80%) Stakeholder Management
11 53 (11.70%) Data Management
12 49 (10.82%) Data Science
12 49 (10.82%) DevOps
13 47 (10.38%) Migration
14 42 (9.27%) Test Automation
15 40 (8.83%) Data Analytics
16 39 (8.61%) Data Governance
17 35 (7.73%) Data Engineering
18 34 (7.51%) Data Strategy
Programming Languages
1 217 (47.90%) SQL
2 109 (24.06%) Python
3 73 (16.11%) Java
4 71 (15.67%) C#
5 56 (12.36%) Scala
6 51 (11.26%) JavaScript
7 48 (10.60%) T-SQL
8 38 (8.39%) R
9 24 (5.30%) Bash Shell
10 23 (5.08%) PowerShell
11 18 (3.97%) U-SQL
12 13 (2.87%) VB
13 10 (2.21%) Shell Script
14 8 (1.77%) Perl
15 6 (1.32%) Data Analysis Expressions (DAX)
16 5 (1.10%) PL/SQL
16 5 (1.10%) Ruby
17 4 (0.88%) Apex Code
17 4 (0.88%) C
17 4 (0.88%) C++
Qualifications
1 37 (8.17%) Degree
2 12 (2.65%) Computer Science Degree
3 9 (1.99%) Master's Degree
4 8 (1.77%) Microsoft Certification
5 7 (1.55%) Security Cleared
6 6 (1.32%) SC Cleared
7 5 (1.10%) Numerate Degree
8 2 (0.44%) DV Cleared
9 1 (0.22%) AWS Certification
9 1 (0.22%) CEH
9 1 (0.22%) CISM
9 1 (0.22%) CISSP
9 1 (0.22%) Postgraduate
Quality Assurance & Compliance
1 43 (9.49%) Data Quality
2 24 (5.30%) QA
3 14 (3.09%) GDPR
4 2 (0.44%) SLA
5 1 (0.22%) HL7
System Software
1 43 (9.49%) HDFS
2 29 (6.40%) Apache Flume
3 11 (2.43%) Docker
4 8 (1.77%) Apache ZooKeeper
5 7 (1.55%) Virtual Machines
6 5 (1.10%) Active Directory
7 3 (0.66%) Hyper-V
7 3 (0.66%) VMware Infrastructure
8 2 (0.44%) VMware ESXi
9 1 (0.22%) Samba
9 1 (0.22%) Virtual Servers
Systems Management
1 31 (6.84%) Oozie
2 15 (3.31%) Terraform
3 10 (2.21%) Ansible
4 9 (1.99%) Opscode Chef
4 9 (1.99%) Puppet
5 7 (1.55%) Hadoop YARN
6 5 (1.10%) HP ALM
7 4 (0.88%) Failover Clustering
7 4 (0.88%) Kubernetes
8 3 (0.66%) SCVMM
9 2 (0.44%) Kibana
9 2 (0.44%) Packer
10 1 (0.22%) Ambari
10 1 (0.22%) Consul
Vendors
1 142 (31.35%) Microsoft
2 61 (13.47%) Cloudera
3 53 (11.70%) Oracle
4 52 (11.48%) SAP
5 46 (10.15%) Tableau
6 41 (9.05%) Hortonworks
6 41 (9.05%) Talend
7 35 (7.73%) Informatica
8 24 (5.30%) Salesforce.com
9 21 (4.64%) MapR
10 18 (3.97%) Alteryx
10 18 (3.97%) Google
11 13 (2.87%) IBM
12 12 (2.65%) Ab Initio
13 11 (2.43%) Tealium
14 10 (2.21%) Netezza
15 8 (1.77%) Cognos
15 8 (1.77%) Databricks
16 7 (1.55%) CA
16 7 (1.55%) Teradata