Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 22 May 2019

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 22 May 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
22 May 2019		 Same period 2018 Same period 2017
Rank 326 457 669
Rank change year-on-year +131 +212 +195
Contract jobs citing Data Lake 736 491 165
As % of all contract IT jobs advertised in the UK 0.81% 0.49% 0.18%
As % of the Database & Business Intelligence category 3.62% 2.17% 0.81%
Number of daily rates quoted 544 345 106
UK median daily rate £525 £500 £525
Median daily rate % change year-on-year +5.00% -4.76% +5.00%
10th Percentile £413 £398 £361
90th Percentile £700 £670 £650
UK excluding London median daily rate £500 £488 £499
% change year-on-year +2.56% -2.26% -10.54%
Number of hourly rates quoted 0 2 0
UK median hourly rate - £37.00 -
UK excluding London median hourly rate - £50.00 -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 20,327 22,602 20,352
As % of all contract IT jobs advertised in the UK 22.35% 22.45% 22.58%
Number of daily rates quoted 13,922 15,739 13,587
UK median daily rate £475 £470 £435
Median daily rate % change year-on-year +1.06% +8.05% +2.35%
10th Percentile £325 £313 £294
90th Percentile £650 £625 £613
UK excluding London median daily rate £425 £415 £390
% change year-on-year +2.41% +6.41% +4.00%
Number of hourly rates quoted 249 223 255
UK median hourly rate £35.00 £32.00 £29.82
Median hourly rate % change year-on-year +9.38% +7.33% +8.42%
10th Percentile £13.85 £14.00 £9.30
90th Percentile £57.50 £53.35 £50.00
UK excluding London median hourly rate £30.00 £31.75 £28.25
% change year-on-year -5.51% +12.39% +5.61%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake.

Contractor daily rate trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Lake over the 6 months to 22 May 2019.

Contractor daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake.

Contractor hourly rate trend for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 22 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +153 713 £525 - 74
London +103 433 £525 - 36
UK excluding London +101 299 £500 +2.56% 38
South East +59 176 £525 - 14
North of England +44 42 £475 -13.64% 14
South West -7 23 £500 +11.11% 3
Midlands +32 22 £450 -7.69% 6
North West +27 18 £588 +6.82% 10
Yorkshire +18 18 £400 -15.79% 2
East of England +26 17 £500 - 1
Scotland +23 17 £455 -4.21%
East Midlands +28 11 £623 +31.05% 1
West Midlands +10 10 £425 -12.82% 5
North East +17 6 £482 -20.24% 2
Wales - 2 £570 -

For the 6 months to 22 May 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 399 (54.21%) Microsoft Azure
2 314 (42.66%) SQL
3 279 (37.91%) Data Warehouse
4 259 (35.19%) Analytics
5 254 (34.51%) Big Data
6 236 (32.07%) Business Intelligence
7 221 (30.03%) Hadoop
8 217 (29.48%) Microsoft
9 213 (28.94%) Agile Software Development
10 183 (24.86%) Apache Spark
10 183 (24.86%) Python
11 178 (24.18%) Power BI
11 178 (24.18%) Power Platform
12 148 (20.11%) Data Modelling
13 146 (19.84%) Azure Data Factory
14 140 (19.02%) Finance
15 135 (18.34%) DevOps
16 130 (17.66%) ETL
17 126 (17.12%) Amazon AWS
18 115 (15.63%) SQL Server
18 115 (15.63%) Azure SQL Database
19 113 (15.35%) SQL Server Integration Services
20 111 (15.08%) Data Science
21 105 (14.27%) Scrum
22 99 (13.45%) Apache Hive
22 99 (13.45%) Kafka
23 97 (13.18%) Azure SQL Data Warehouse
24 93 (12.64%) Serverless
25 86 (11.68%) Visual Studio Team System
25 86 (11.68%) Migration

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 183 (24.86%) Apache Spark
2 44 (5.98%) Apache
3 16 (2.17%) Elasticsearch
4 15 (2.04%) SharePoint
5 13 (1.77%) Confluence
6 11 (1.49%) Apache Airflow
7 10 (1.36%) SAS
8 9 (1.22%) Apache Pig
9 7 (0.95%) Luigi
10 6 (0.82%) Jupyter
11 5 (0.68%) Apache Solr
12 2 (0.27%) nginx
12 2 (0.27%) OpenStack
13 1 (0.14%) Anypoint
13 1 (0.14%) Cloud Foundry
13 1 (0.14%) OpenEdge
13 1 (0.14%) Oracle Workflow
Applications
1 14 (1.90%) Microsoft Excel
2 7 (0.95%) Microsoft Office
3 3 (0.41%) MS Visio
4 2 (0.27%) Spreadsheet
Business Applications
1 21 (2.85%) Dynamics CRM
2 12 (1.63%) SAP Oil and Gas
3 7 (0.95%) Dynamics AX
3 7 (0.95%) Dynamics NAV
4 6 (0.82%) Salesforce.com CRM
5 5 (0.68%) SAP ERP
6 4 (0.54%) SAP HR
6 4 (0.54%) SAP S/4HANA
7 2 (0.27%) NetSuite
8 1 (0.14%) Oracle Retail
Cloud Services
1 399 (54.21%) Microsoft Azure
2 178 (24.18%) Power Platform
3 146 (19.84%) Azure Data Factory
4 126 (17.12%) Amazon AWS
5 93 (12.64%) Serverless
6 75 (10.19%) PaaS
7 48 (6.52%) Google Cloud Platform
8 46 (6.25%) Data Lake Analytics
9 41 (5.57%) IaaS
10 34 (4.62%) Azure Functions
11 33 (4.48%) Amazon S3
12 26 (3.53%) Amazon Kinesis
13 24 (3.26%) AWS Lambda
14 22 (2.99%) Amazon EMR
15 19 (2.58%) Office 365
16 17 (2.31%) Azure Machine Learning
17 16 (2.17%) SaaS
18 15 (2.04%) Azure ExpressRoute
19 9 (1.22%) Azure Active Directory
19 9 (1.22%) Cortana Intelligence Suite
Communications & Networking
1 10 (1.36%) Internet
2 5 (0.68%) Kerberos
3 2 (0.27%) Firewall
4 1 (0.14%) Skype
4 1 (0.14%) SSL
4 1 (0.14%) VPN
Database & Business Intelligence
1 279 (37.91%) Data Warehouse
2 254 (34.51%) Big Data
3 221 (30.03%) Hadoop
4 178 (24.18%) Power BI
5 115 (15.63%) Azure SQL Database
5 115 (15.63%) SQL Server
6 113 (15.35%) SQL Server Integration Services
7 99 (13.45%) Apache Hive
8 97 (13.18%) Azure SQL Data Warehouse
9 83 (11.28%) Cosmos DB
10 81 (11.01%) NoSQL
11 75 (10.19%) HDInsight
12 54 (7.34%) SQL Server Reporting Services
13 53 (7.20%) Relational Database
14 44 (5.98%) SQL Server Analysis Services
15 39 (5.30%) Apache Cassandra
16 37 (5.03%) Redis
17 31 (4.21%) HBase
18 29 (3.94%) MongoDB
19 28 (3.80%) PostgreSQL
Development Applications
1 86 (11.68%) Visual Studio Team System
2 53 (7.20%) Visual Studio
3 44 (5.98%) Git (software)
4 35 (4.76%) JIRA
5 27 (3.67%) Jenkins
6 14 (1.90%) Team Foundation Server
7 11 (1.49%) TeamCity
8 9 (1.22%) Cucumber
8 9 (1.22%) Octopus Deploy
9 8 (1.09%) ERwin
9 8 (1.09%) SpecFlow
9 8 (1.09%) tSQLt
10 7 (0.95%) Maven
11 6 (0.82%) Moq
11 6 (0.82%) NUnit
11 6 (0.82%) Selenium
11 6 (0.82%) Subversion
12 5 (0.68%) ER Studio
12 5 (0.68%) Hudson
13 3 (0.41%) Bower
General
1 140 (19.02%) Finance
2 52 (7.07%) Retail
3 38 (5.16%) Banking
4 25 (3.40%) Marketing
5 11 (1.49%) Investment Banking
5 11 (1.49%) Telecoms
6 9 (1.22%) Legal
7 7 (0.95%) Publishing
8 5 (0.68%) Billing
8 5 (0.68%) French Language
8 5 (0.68%) Manufacturing
9 4 (0.54%) Electronics
10 3 (0.41%) Financial Institution
10 3 (0.41%) Front Office
10 3 (0.41%) Retail Banking
11 2 (0.27%) Automotive
11 2 (0.27%) Games
12 1 (0.14%) Back Office
Job Titles
1 187 (25.41%) Data Engineer
2 172 (23.37%) Architect
3 120 (16.30%) Developer
4 102 (13.86%) Data Architect
5 70 (9.51%) Azure Architect
6 69 (9.38%) Azure Engineer
7 52 (7.07%) Big Data Engineer
8 43 (5.84%) DevOps Engineer
9 42 (5.71%) Analyst
9 42 (5.71%) Azure Developer
10 34 (4.62%) Solutions Architect
11 30 (4.08%) Consultant
12 27 (3.67%) Azure DevOps
12 27 (3.67%) Business Intelligence Developer
12 27 (3.67%) Project Manager
12 27 (3.67%) Technical Architect
13 26 (3.53%) Business Analyst
14 25 (3.40%) .NET Developer
15 24 (3.26%) Big Data Architect
16 23 (3.13%) AWS Engineer
Libraries, Frameworks & Software Standards
1 99 (13.45%) Kafka
2 73 (9.92%) .NET
3 40 (5.43%) AngularJS
4 32 (4.35%) .NET Core
5 25 (3.40%) REST
6 24 (3.26%) JSON
7 23 (3.13%) .NET Framework
8 20 (2.72%) ASP.NET Web API
9 13 (1.77%) MDX
9 13 (1.77%) Web Services
9 13 (1.77%) XML
10 12 (1.63%) ASP.NET
10 12 (1.63%) Velocity
11 11 (1.49%) React
12 10 (1.36%) Angular 2
12 10 (1.36%) HTML
13 9 (1.22%) ASP.NET MVC
14 8 (1.09%) CSS
14 8 (1.09%) Entity Framework
14 8 (1.09%) Node.js
Miscellaneous
1 74 (10.05%) Greenfield Project
2 66 (8.97%) Analytical Skills
3 30 (4.08%) Fintech
4 29 (3.94%) Data Structures
5 25 (3.40%) Management Information System
6 22 (2.99%) Algorithms
7 15 (2.04%) Hybrid Cloud
8 13 (1.77%) Self-Motivation
9 11 (1.49%) Data Centre
10 9 (1.22%) Public Cloud
11 7 (0.95%) Virtual Team
12 6 (0.82%) Cloud Native
12 6 (0.82%) Internet of Things
13 5 (0.68%) NHS
13 5 (0.68%) Taxonomies
13 5 (0.68%) User Experience
14 3 (0.41%) Data Protection Act
14 3 (0.41%) Enterprise Software
14 3 (0.41%) FMCG
14 3 (0.41%) SCADA
Operating Systems
1 28 (3.80%) Windows
2 15 (2.04%) Linux
3 7 (0.95%) Unix
4 5 (0.68%) VMS
5 4 (0.54%) CentOS
6 1 (0.14%) Android
6 1 (0.14%) Apple iOS
Processes & Methodologies
1 259 (35.19%) Analytics
2 236 (32.07%) Business Intelligence
3 213 (28.94%) Agile Software Development
4 148 (20.11%) Data Modelling
5 135 (18.34%) DevOps
6 130 (17.66%) ETL
7 111 (15.08%) Data Science
8 105 (14.27%) Scrum
9 86 (11.68%) Migration
10 78 (10.60%) Data Management
11 74 (10.05%) Microservices
12 62 (8.42%) Machine Learning
13 61 (8.29%) Continuous Integration
13 61 (8.29%) Data Engineering
14 60 (8.15%) Data Analytics
15 59 (8.02%) Data Architecture
16 53 (7.20%) Infrastructure as Code
16 53 (7.20%) Problem-Solving
17 52 (7.07%) Test Automation
18 51 (6.93%) TDD
Programming Languages
1 314 (42.66%) SQL
2 183 (24.86%) Python
3 85 (11.55%) C#
4 72 (9.78%) Java
5 66 (8.97%) PowerShell
6 65 (8.83%) Scala
7 32 (4.35%) JavaScript
7 32 (4.35%) R
7 32 (4.35%) T-SQL
8 31 (4.21%) U-SQL
9 10 (1.36%) Data Analysis Expressions (DAX)
9 10 (1.36%) Shell Script
10 8 (1.09%) Bash Shell
11 7 (0.95%) PL/SQL
12 6 (0.82%) Perl
13 4 (0.54%) Go
13 4 (0.54%) VBA
14 3 (0.41%) C
15 2 (0.27%) Clojure
15 2 (0.27%) VB.NET
Qualifications
1 26 (3.53%) Degree
2 17 (2.31%) Security Cleared
3 11 (1.49%) Computer Science Degree
4 10 (1.36%) SC Cleared
5 7 (0.95%) TOGAF Certification
6 6 (0.82%) Master's Degree
7 5 (0.68%) BPSS Clearance
7 5 (0.68%) CISA
7 5 (0.68%) CISM
7 5 (0.68%) CISSP
8 4 (0.54%) PhD
9 3 (0.41%) CEH
9 3 (0.41%) GIAC
9 3 (0.41%) ITIL Certification
9 3 (0.41%) Microsoft Certification
9 3 (0.41%) OSCP
9 3 (0.41%) Postgraduate
9 3 (0.41%) PRINCE2 Certification
10 2 (0.27%) CGEIT
11 1 (0.14%) ISTQB
Quality Assurance & Compliance
1 25 (3.40%) Data Quality
2 16 (2.17%) QA
3 9 (1.22%) GDPR
4 4 (0.54%) PMO
5 3 (0.41%) Sarbanes-Oxley
6 2 (0.27%) HL7
6 2 (0.27%) ISO/IEC 27001
6 2 (0.27%) PCI DSS
6 2 (0.27%) SLA
7 1 (0.14%) Disclosure Scotland
System Software
1 57 (7.74%) Docker
2 40 (5.43%) Apache Flume
3 28 (3.80%) HDFS
3 28 (3.80%) Virtual Machines
4 9 (1.22%) Active Directory
5 4 (0.54%) Samba
5 4 (0.54%) VMware ESXi
5 4 (0.54%) VMware Infrastructure
Systems Management
1 50 (6.79%) Kubernetes
2 17 (2.31%) Terraform
3 13 (1.77%) Hadoop YARN
4 9 (1.22%) Oozie
4 9 (1.22%) Puppet
5 7 (0.95%) Opscode Chef
6 6 (0.82%) Ansible
7 4 (0.54%) Ambari
8 1 (0.14%) Control-M
8 1 (0.14%) Microsoft Intune
8 1 (0.14%) SCCM
Vendors
1 217 (29.48%) Microsoft
2 66 (8.97%) Databricks
3 62 (8.42%) Cloudera
4 49 (6.66%) Oracle
5 45 (6.11%) Talend
6 36 (4.89%) Google
7 35 (4.76%) SAP
8 27 (3.67%) Tableau
9 26 (3.53%) Informatica
10 18 (2.45%) Hortonworks
10 18 (2.45%) Workday
11 16 (2.17%) Ab Initio
12 11 (1.49%) Alteryx
12 11 (1.49%) Salesforce.com
13 10 (1.36%) Teradata
14 7 (0.95%) ATG
15 6 (0.82%) Splunk
16 5 (0.68%) Dataiku
16 5 (0.68%) MuleSoft
17 4 (0.54%) Twitter