Period
to 17 August 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 17 August 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
17 Aug 2019
Same period 2018 Same period 2017
Rank 310 458 654
Rank change year-on-year +148 +196 +167
Contract jobs citing Data Lake 695 465 167
As % of all contract IT jobs advertised in England 0.84% 0.49% 0.19%
As % of the Database & Business Intelligence category 3.78% 2.15% 0.84%
Number of daily rates quoted 526 292 123
England median daily rate £525 £525 £550
Median daily rate % change year-on-year - -4.55% -
10th Percentile £403 £390 £363
90th Percentile £688 £713 £725
UK median daily rate £525 £523 £550
% change year-on-year +0.48% -5.00% +10.00%
Number of hourly rates quoted 5 4 0
England median hourly rate £72.50 £47.25 -
Median hourly rate % change year-on-year +53.44% - -
UK median hourly rate £72.50 £47.25 -
% change year-on-year +53.44% - -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 18,395 21,604 19,967
As % of all contract IT jobs advertised in England 22.12% 22.96% 22.63%
Number of daily rates quoted 12,751 15,226 13,429
England median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +5.88%
10th Percentile £325 £313 £300
90th Percentile £650 £638 £625
UK median daily rate £475 £463 £450
% change year-on-year +2.70% +2.78% +5.88%
Number of hourly rates quoted 241 227 229
England median hourly rate £35.00 £30.00 £30.00
Median hourly rate % change year-on-year +16.67% - +5.26%
10th Percentile £14.32 £14.00 £11.18
90th Percentile £60.00 £52.60 £52.50
UK median hourly rate £35.00 £28.75 £31.00
% change year-on-year +21.74% -7.26% +8.77%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in England.

Contractor daily rate trend for Data Lake in England

Data Lake
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Data Lake in England over the 6 months to 17 August 2019.

Contractor daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake in England.

Contractor hourly rate trend for Data Lake in England

Data Lake
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Data Lake in England over the 6 months to 17 August 2019.

Contractor hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 17 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +109 444 £525 - 73
South East +29 139 £500 -2.44% 34
North of England +59 45 £500 -9.09% 13
North West +33 31 £500 -11.11% 8
Midlands +54 28 £425 -10.53% 1
East of England +38 25 £525 -2.33% 7
West Midlands +36 19 £425 - 1
South West -9 15 £488 +2.63% 5
Yorkshire +18 9 £400 -17.95% 4
East Midlands +31 8 £425 -19.05%
North East - 5 £469 - 1
Data Lake
UK

For the 6 months to 17 August 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 398 (57.27%) Microsoft Azure
2 317 (45.61%) SQL
3 291 (41.87%) Data Warehouse
4 254 (36.55%) Big Data
5 251 (36.12%) Business Intelligence
6 226 (32.52%) Microsoft
7 225 (32.37%) Analytics
8 201 (28.92%) Python
9 197 (28.35%) Agile Software Development
10 196 (28.20%) Power BI
10 196 (28.20%) Power Platform
11 194 (27.91%) Hadoop
12 162 (23.31%) Azure Data Factory
13 160 (23.02%) Apache Spark
14 135 (19.42%) DevOps
15 132 (18.99%) Data Modelling
15 132 (18.99%) Amazon AWS
16 127 (18.27%) Finance
17 124 (17.84%) ETL
17 124 (17.84%) SQL Server Integration Services
18 121 (17.41%) C#
19 116 (16.69%) SQL Server
20 112 (16.12%) Databricks
21 106 (15.25%) Azure SQL Database
22 105 (15.11%) Data Science
23 101 (14.53%) Serverless
23 101 (14.53%) Kafka
24 97 (13.96%) Migration
25 91 (13.09%) Azure SQL Data Warehouse
26 90 (12.95%) Scrum

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 160 (23.02%) Apache Spark
2 31 (4.46%) Apache
3 16 (2.30%) SharePoint
4 12 (1.73%) SAS
5 11 (1.58%) Apache Airflow
6 9 (1.29%) Jupyter
7 7 (1.01%) Apache Solr
8 6 (0.86%) Confluence
8 6 (0.86%) Elasticsearch
9 5 (0.72%) Luigi
10 4 (0.58%) Apache Pig
11 2 (0.29%) OpenStack
12 1 (0.14%) Anypoint
12 1 (0.14%) Cloud Foundry
12 1 (0.14%) IIS
12 1 (0.14%) Oracle Workflow
12 1 (0.14%) SharePoint 2013
Applications
1 19 (2.73%) Microsoft Excel
2 8 (1.15%) Microsoft Office
3 2 (0.29%) AutoCAD
3 2 (0.29%) Sketch
4 1 (0.14%) Spreadsheet
Business Applications
1 16 (2.30%) Dynamics CRM
2 10 (1.44%) SAP Oil and Gas
3 6 (0.86%) Dynamics AX
3 6 (0.86%) Dynamics NAV
3 6 (0.86%) Salesforce.com CRM
4 5 (0.72%) SAP ERP
5 4 (0.58%) SAP HR
5 4 (0.58%) SAP S/4HANA
6 2 (0.29%) Eloqua
6 2 (0.29%) Sparx Enterprise Architect
6 2 (0.29%) Workday HCM
7 1 (0.14%) Markit EDM
7 1 (0.14%) Oracle Retail
Cloud Services
1 398 (57.27%) Microsoft Azure
2 196 (28.20%) Power Platform
3 162 (23.31%) Azure Data Factory
4 132 (18.99%) Amazon AWS
5 101 (14.53%) Serverless
6 49 (7.05%) Data Lake Analytics
7 44 (6.33%) Google Cloud Platform
8 42 (6.04%) PaaS
9 38 (5.47%) Amazon S3
10 28 (4.03%) Azure Functions
11 27 (3.88%) AWS Lambda
12 26 (3.74%) Amazon EMR
12 26 (3.74%) IaaS
13 25 (3.60%) SaaS
14 18 (2.59%) Amazon Kinesis
15 13 (1.87%) iPaaS
16 12 (1.73%) Amazon EC2
16 12 (1.73%) Dynamics 365
16 12 (1.73%) Office 365
17 10 (1.44%) Azure Machine Learning
Communications & Networking
1 6 (0.86%) Internet
2 4 (0.58%) Kerberos
3 3 (0.43%) Firewall
3 3 (0.43%) SAN
4 2 (0.29%) FTP
4 2 (0.29%) HTTP
4 2 (0.29%) Software-Defined Networking
5 1 (0.14%) DHCP
5 1 (0.14%) DNS
5 1 (0.14%) Extranet
5 1 (0.14%) HTTPS
5 1 (0.14%) Intranet
5 1 (0.14%) SMTP
5 1 (0.14%) SSL
5 1 (0.14%) Telnet
Database & Business Intelligence
1 291 (41.87%) Data Warehouse
2 254 (36.55%) Big Data
3 196 (28.20%) Power BI
4 194 (27.91%) Hadoop
5 124 (17.84%) SQL Server Integration Services
6 116 (16.69%) SQL Server
7 106 (15.25%) Azure SQL Database
8 91 (13.09%) Azure SQL Data Warehouse
9 79 (11.37%) Apache Hive
10 70 (10.07%) Cosmos DB
11 66 (9.50%) NoSQL
12 65 (9.35%) SQL Server Analysis Services
13 60 (8.63%) SQL Server Reporting Services
14 55 (7.91%) HDInsight
15 48 (6.91%) Relational Database
16 32 (4.60%) Microsoft Analysis Services
17 30 (4.32%) HBase
17 30 (4.32%) Redis
18 27 (3.88%) MongoDB
19 25 (3.60%) Amazon Redshift
Development Applications
1 74 (10.65%) Visual Studio Team System
2 50 (7.19%) Git (software)
3 36 (5.18%) Visual Studio
4 28 (4.03%) Jenkins
4 28 (4.03%) JIRA
5 14 (2.01%) Team Foundation Server
6 13 (1.87%) TeamCity
7 11 (1.58%) Cucumber
8 9 (1.29%) Octopus Deploy
8 9 (1.29%) SpecFlow
9 8 (1.15%) ERwin
9 8 (1.15%) tSQLt
10 6 (0.86%) Atlassian Bamboo
10 6 (0.86%) Maven
10 6 (0.86%) PowerDesigner
11 5 (0.72%) Jasmine
12 4 (0.58%) Concordion
12 4 (0.58%) ER Studio
12 4 (0.58%) Hudson
12 4 (0.58%) Mockito
General
1 127 (18.27%) Finance
2 36 (5.18%) Retail
3 27 (3.88%) Banking
4 17 (2.45%) Marketing
5 12 (1.73%) Telecoms
6 10 (1.44%) Legal
7 8 (1.15%) Advertising
7 8 (1.15%) Investment Banking
7 8 (1.15%) Publishing
8 6 (0.86%) Front Office
9 5 (0.72%) French Language
10 4 (0.58%) Automotive
10 4 (0.58%) Manufacturing
11 3 (0.43%) Electronics
11 3 (0.43%) Financial Institution
12 1 (0.14%) Games
12 1 (0.14%) Pharmaceutical
12 1 (0.14%) Retail Banking
Job Titles
1 165 (23.74%) Architect
1 165 (23.74%) Data Engineer
2 115 (16.55%) Data Architect
3 95 (13.67%) Developer
4 73 (10.50%) Azure Engineer
5 52 (7.48%) Azure Architect
5 52 (7.48%) Big Data Engineer
6 41 (5.90%) DevOps Engineer
7 39 (5.61%) Consultant
8 38 (5.47%) Analyst
9 34 (4.89%) Solutions Architect
10 31 (4.46%) Azure Developer
11 30 (4.32%) Project Manager
12 29 (4.17%) Azure DevOps
13 26 (3.74%) Business Intelligence Developer
14 25 (3.60%) Azure DevOps Engineer
14 25 (3.60%) Big Data Architect
15 21 (3.02%) Business Analyst
15 21 (3.02%) SQL Developer
16 20 (2.88%) AWS Engineer
Libraries, Frameworks & Software Standards
1 101 (14.53%) Kafka
2 69 (9.93%) .NET
3 34 (4.89%) JSON
4 33 (4.75%) Web Services
5 29 (4.17%) .NET Core
5 29 (4.17%) AngularJS
6 24 (3.45%) XML
7 21 (3.02%) MDX
7 21 (3.02%) REST
8 15 (2.16%) .NET Framework
9 14 (2.01%) Velocity
10 13 (1.87%) Apache Avro
11 11 (1.58%) ASP.NET Web API
12 10 (1.44%) RESTful
12 10 (1.44%) SOAP
13 9 (1.29%) React
13 9 (1.29%) Spark Streaming
14 8 (1.15%) PySpark
15 7 (1.01%) ASP.NET
15 7 (1.01%) ASP.NET MVC
Miscellaneous
1 67 (9.64%) Analytical Skills
2 66 (9.50%) Greenfield Project
3 22 (3.17%) Algorithms
3 22 (3.17%) Management Information System
4 16 (2.30%) Data Structures
5 13 (1.87%) Self-Motivation
6 12 (1.73%) User Experience
7 11 (1.58%) Data Centre
8 10 (1.44%) Public Cloud
9 8 (1.15%) Virtual Team
10 7 (1.01%) Private Cloud
11 6 (0.86%) Hybrid Cloud
11 6 (0.86%) Internet of Things
12 5 (0.72%) Cloud Native
13 4 (0.58%) Linux Command Line
13 4 (0.58%) Replication
14 3 (0.43%) Data Protection Act
14 3 (0.43%) FMCG
14 3 (0.43%) NHS
14 3 (0.43%) SCADA
Operating Systems
1 24 (3.45%) Windows
2 21 (3.02%) Linux
3 18 (2.59%) Unix
4 9 (1.29%) VMS
5 7 (1.01%) CentOS
6 4 (0.58%) Windows Server
7 3 (0.43%) Red Hat Enterprise Linux
8 1 (0.14%) Android
8 1 (0.14%) Apple iOS
8 1 (0.14%) Windows Server 2008
8 1 (0.14%) Windows Server 2012
Processes & Methodologies
1 251 (36.12%) Business Intelligence
2 225 (32.37%) Analytics
3 197 (28.35%) Agile Software Development
4 135 (19.42%) DevOps
5 132 (18.99%) Data Modelling
6 124 (17.84%) ETL
7 105 (15.11%) Data Science
8 97 (13.96%) Migration
9 90 (12.95%) Scrum
10 68 (9.78%) Data Architecture
11 65 (9.35%) Microservices
12 64 (9.21%) Machine Learning
13 61 (8.78%) Visualisation
14 60 (8.63%) Data Engineering
14 60 (8.63%) Problem-Solving
15 55 (7.91%) Stakeholder Management
16 54 (7.77%) Data Management
16 54 (7.77%) Test Automation
17 52 (7.48%) Data Analytics
17 52 (7.48%) Data Integration
Programming Languages
1 317 (45.61%) SQL
2 201 (28.92%) Python
3 121 (17.41%) C#
4 71 (10.22%) Java
5 62 (8.92%) PowerShell
6 59 (8.49%) Scala
7 44 (6.33%) R
8 36 (5.18%) JavaScript
9 31 (4.46%) T-SQL
10 28 (4.03%) U-SQL
11 21 (3.02%) Data Analysis Expressions (DAX)
12 11 (1.58%) Go
13 9 (1.29%) Bash Shell
13 9 (1.29%) Shell Script
14 8 (1.15%) PL/SQL
15 6 (0.86%) Perl
16 4 (0.58%) VBA
17 3 (0.43%) C++
17 3 (0.43%) Java 8
18 2 (0.29%) VB.NET
Qualifications
1 29 (4.17%) Degree
1 29 (4.17%) Security Cleared
2 23 (3.31%) SC Cleared
3 7 (1.01%) Computer Science Degree
4 6 (0.86%) DBS Check
5 5 (0.72%) PRINCE2 Certification
6 4 (0.58%) CEH
6 4 (0.58%) CISA
6 4 (0.58%) CISM
6 4 (0.58%) CISSP
6 4 (0.58%) Master's Degree
6 4 (0.58%) PhD
7 3 (0.43%) GIAC
7 3 (0.43%) OSCP
7 3 (0.43%) TOGAF Certification
8 2 (0.29%) Microsoft Certification
9 1 (0.14%) Cisco Certification
9 1 (0.14%) ISEB
9 1 (0.14%) MCSE
9 1 (0.14%) PMI Certification
Quality Assurance & Compliance
1 43 (6.19%) Data Quality
2 19 (2.73%) QA
3 11 (1.58%) GDPR
4 4 (0.58%) PMO
5 3 (0.43%) ISO/IEC 27001
6 2 (0.29%) Sarbanes-Oxley
7 1 (0.14%) GxP
7 1 (0.14%) HL7
7 1 (0.14%) PCI DSS
7 1 (0.14%) SLA
System Software
1 66 (9.50%) Docker
2 33 (4.75%) HDFS
3 23 (3.31%) Apache Flume
4 11 (1.58%) Virtual Machines
5 6 (0.86%) Active Directory
6 4 (0.58%) Samba
6 4 (0.58%) VMware ESXi
6 4 (0.58%) VMware Infrastructure
7 3 (0.43%) Virtual Desktop
7 3 (0.43%) Virtual Servers
8 2 (0.29%) NFS
9 1 (0.14%) Postfix
Systems Management
1 62 (8.92%) Kubernetes
2 13 (1.87%) Ansible
2 13 (1.87%) Terraform
3 12 (1.73%) Hadoop YARN
4 10 (1.44%) Puppet
5 6 (0.86%) Oozie
5 6 (0.86%) Opscode Chef
6 5 (0.72%) Grafana
7 4 (0.58%) Ambari
8 2 (0.29%) Packer
8 2 (0.29%) SCCM
9 1 (0.14%) AirWatch
9 1 (0.14%) Control-M
9 1 (0.14%) Microsoft Intune
9 1 (0.14%) Salt
9 1 (0.14%) yum
Vendors
1 226 (32.52%) Microsoft
2 112 (16.12%) Databricks
3 41 (5.90%) Cloudera
3 41 (5.90%) Tableau
4 37 (5.32%) Talend
5 36 (5.18%) Google
6 35 (5.04%) Informatica
6 35 (5.04%) Oracle
7 25 (3.60%) SAP
8 16 (2.30%) Workday
9 15 (2.16%) Alteryx
10 12 (1.73%) Hortonworks
11 11 (1.58%) StreamSets
12 10 (1.44%) Ab Initio
12 10 (1.44%) Salesforce.com
12 10 (1.44%) Splunk
12 10 (1.44%) Teradata
13 7 (1.01%) MuleSoft
14 5 (0.72%) SnapLogic
15 4 (0.58%) VMware