Period
to 21 November 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 21 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
21 Nov 2019
Same period 2018 Same period 2017
Rank 270 410 638
Rank change year-on-year +140 +228 +85
Contract jobs citing Data Lake 727 561 236
As % of all contract IT jobs advertised in England 0.96% 0.59% 0.25%
As % of the Database & Business Intelligence category 4.45% 2.61% 1.13%
Number of daily rates quoted 516 386 176
England median daily rate £550 £525 £550
Median daily rate % change year-on-year +4.76% -4.55% -8.33%
10th Percentile £406 £400 £363
90th Percentile £716 £710 £700
UK median daily rate £550 £525 £550
% change year-on-year +4.76% -4.55% -7.37%
Number of hourly rates quoted 6 2 1
England median hourly rate £72.50 £49.75 £45.00
Median hourly rate % change year-on-year +45.73% +10.56% -
10th Percentile £53.13 £43.28 £40.00
90th Percentile £73.75 £56.43 £50.00
UK median hourly rate £72.50 £49.75 £45.00
% change year-on-year +45.73% +10.56% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 16,329 21,489 20,968
As % of all contract IT jobs advertised in England 21.52% 22.58% 22.10%
Number of daily rates quoted 11,150 15,119 14,523
England median daily rate £475 £475 £460
Median daily rate % change year-on-year - +3.26% +8.24%
10th Percentile £325 £319 £313
90th Percentile £668 £644 £638
UK median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 228 224 264
England median hourly rate £32.54 £35.00 £31.75
Median hourly rate % change year-on-year -7.03% +10.24% +13.39%
10th Percentile £14.00 £14.11 £14.34
90th Percentile £72.88 £57.45 £56.41
UK median hourly rate £35.00 £33.50 £31.23
% change year-on-year +4.48% +7.27% +11.54%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a percentage of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake in England.

Contractor daily rate trend for Data Lake in England

Data Lake
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Data Lake in England over the 6 months to 21 November 2019.

Contractor daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake in England.

Contractor hourly rate trend for Data Lake in England

Data Lake
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Data Lake in England over the 6 months to 21 November 2019.

Contractor hourly rate histogram for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 21 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +86 418 £550 +1.15% 86
South East +64 162 £500 -3.61% 30
North of England +49 41 £500 -3.85% 16
East of England +61 37 £619 +17.86% 6
South West +19 37 £700 +47.37% 4
Midlands +73 31 £525 +20.00% 6
North West +31 28 £500 -4.76% 13
West Midlands +59 23 £496 +13.43% 4
Yorkshire +32 10 £563 +3.21% 3
East Midlands +34 8 £563 - 2
North East +24 3 £525 -8.70%
Data Lake
UK

For the 6 months to 21 November 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 475 (65.34%) Azure
2 357 (49.11%) SQL
3 336 (46.22%) Analytics
4 333 (45.80%) Data Warehouse
5 300 (41.27%) Business Intelligence
6 259 (35.63%) Microsoft
7 249 (34.25%) Power Platform
8 248 (34.11%) Power BI
9 244 (33.56%) Agile Software Development
10 234 (32.19%) Big Data
11 229 (31.50%) Azure Data Factory
12 199 (27.37%) Python
13 184 (25.31%) DevOps
14 174 (23.93%) SQL Server Integration Services
15 158 (21.73%) AWS
15 158 (21.73%) ETL
16 144 (19.81%) Data Modelling
17 140 (19.26%) Databricks
18 130 (17.88%) SQL Server
19 123 (16.92%) Hadoop
20 113 (15.54%) C#
21 112 (15.41%) Finance
21 112 (15.41%) Azure SQL Database
22 109 (14.99%) Serverless
23 103 (14.17%) Azure SQL Data Warehouse
24 98 (13.48%) Data Science
25 96 (13.20%) Apache Spark
26 92 (12.65%) Machine Learning
27 88 (12.10%) Data Lake Analytics
28 87 (11.97%) SQL Server Analysis Services

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 96 (13.20%) Apache Spark
2 23 (3.16%) Apache
3 20 (2.75%) SAS
4 14 (1.93%) Apache Airflow
4 14 (1.93%) SharePoint
5 10 (1.38%) Jupyter
6 8 (1.10%) Elasticsearch
7 7 (0.96%) Confluence
8 4 (0.55%) Apache Solr
9 3 (0.41%) IBM Domino
10 2 (0.28%) MQSeries
10 2 (0.28%) OpenStack
10 2 (0.28%) Oracle Coherence
10 2 (0.28%) SharePoint 2013
11 1 (0.14%) Apache Pig
11 1 (0.14%) CMS
11 1 (0.14%) Headless CMS
11 1 (0.14%) IIS
11 1 (0.14%) WordPress
Applications
1 19 (2.61%) Microsoft Excel
2 4 (0.55%) SPSS
3 2 (0.28%) AutoCAD
3 2 (0.28%) Sketch
4 1 (0.14%) Microsoft Office
Business Applications
1 7 (0.96%) SAP Oil and Gas
2 6 (0.83%) Sparx Enterprise Architect
3 5 (0.69%) Dynamics CRM
4 3 (0.41%) Eloqua
4 3 (0.41%) FINCAD Analytics
5 2 (0.28%) Dynamics AX
5 2 (0.28%) Dynamics NAV
5 2 (0.28%) Maximo
5 2 (0.28%) SAP ERP
5 2 (0.28%) SAP HR
5 2 (0.28%) Workday HCM
6 1 (0.14%) Markit EDM
6 1 (0.14%) NetSuite
6 1 (0.14%) Payment Gateway
6 1 (0.14%) SAP MDG
6 1 (0.14%) SAP MDM
6 1 (0.14%) SAP PLM
Cloud Services
1 475 (65.34%) Azure
2 249 (34.25%) Power Platform
3 229 (31.50%) Azure Data Factory
4 158 (21.73%) AWS
5 109 (14.99%) Serverless
6 88 (12.10%) Data Lake Analytics
7 49 (6.74%) Amazon S3
7 49 (6.74%) Azure Functions
8 45 (6.19%) PaaS
9 43 (5.91%) GCP
10 34 (4.68%) IaaS
11 28 (3.85%) AWS Lambda
12 27 (3.71%) SaaS
13 23 (3.16%) Azure Machine Learning
14 20 (2.75%) iPaaS
15 18 (2.48%) Amazon EMR
16 15 (2.06%) Amazon EC2
16 15 (2.06%) GitHub
17 14 (1.93%) Azure Active Directory
18 10 (1.38%) Office 365
Communications & Networking
1 7 (0.96%) SAN
2 5 (0.69%) Firewall
3 3 (0.41%) Internet
4 2 (0.28%) DNS
4 2 (0.28%) Extranet
4 2 (0.28%) FTP
4 2 (0.28%) HTTP
4 2 (0.28%) Intranet
4 2 (0.28%) Software-Defined Networking
4 2 (0.28%) SSL
5 1 (0.14%) DHCP
5 1 (0.14%) HTTPS
5 1 (0.14%) Kerberos
5 1 (0.14%) SMTP
5 1 (0.14%) Telnet
5 1 (0.14%) VPN
Database & Business Intelligence
1 333 (45.80%) Data Warehouse
2 248 (34.11%) Power BI
3 234 (32.19%) Big Data
4 174 (23.93%) SQL Server Integration Services
5 130 (17.88%) SQL Server
6 123 (16.92%) Hadoop
7 112 (15.41%) Azure SQL Database
8 103 (14.17%) Azure SQL Data Warehouse
9 87 (11.97%) SQL Server Analysis Services
10 71 (9.77%) SQL Server Reporting Services
11 57 (7.84%) NoSQL
12 54 (7.43%) Cosmos DB
13 53 (7.29%) Amazon Redshift
14 47 (6.46%) Apache Hive
15 46 (6.33%) HDInsight
15 46 (6.33%) Relational Database
16 35 (4.81%) Data Mart
17 29 (3.99%) Microsoft Analysis Services
18 27 (3.71%) Snowflake Schema
19 21 (2.89%) MongoDB
Development Applications
1 81 (11.14%) Visual Studio Team System
2 52 (7.15%) Visual Studio
3 43 (5.91%) Git (software)
4 33 (4.54%) Jenkins
5 29 (3.99%) JIRA
6 15 (2.06%) Team Foundation Server
7 12 (1.65%) Cucumber
8 10 (1.38%) ERwin
8 10 (1.38%) PowerDesigner
9 9 (1.24%) Atlassian Bamboo
9 9 (1.24%) Maven
10 8 (1.10%) Selenium
11 7 (0.96%) TeamCity
12 6 (0.83%) Jasmine
12 6 (0.83%) NUnit
13 4 (0.55%) Bitbucket
13 4 (0.55%) Concordion
13 4 (0.55%) EasyMock
13 4 (0.55%) ER Studio
13 4 (0.55%) Gradle
General
1 112 (15.41%) Finance
2 34 (4.68%) Retail
3 26 (3.58%) Marketing
4 25 (3.44%) Public Sector
5 16 (2.20%) Front Office
6 14 (1.93%) Advertising
6 14 (1.93%) Legal
7 12 (1.65%) Banking
8 9 (1.24%) Telecoms
9 4 (0.55%) Pharmaceutical
10 3 (0.41%) Local Government
10 3 (0.41%) Publishing
11 2 (0.28%) Automotive
11 2 (0.28%) Games
12 1 (0.14%) Dutch Language
12 1 (0.14%) Financial Institution
12 1 (0.14%) Investment Banking
Job Titles
1 202 (27.79%) Architect
2 153 (21.05%) Data Architect
3 139 (19.12%) Developer
4 125 (17.19%) Data Engineer
5 74 (10.18%) Azure Engineer
6 65 (8.94%) Azure Architect
7 64 (8.80%) Azure Developer
8 49 (6.74%) Analyst
9 48 (6.60%) DevOps Engineer
10 43 (5.91%) Consultant
11 38 (5.23%) Azure DevOps
12 36 (4.95%) Solutions Architect
13 35 (4.81%) Business Intelligence Developer
14 30 (4.13%) Azure DevOps Engineer
14 30 (4.13%) SQL Developer
15 27 (3.71%) Big Data Engineer
16 24 (3.30%) C# Developer
16 24 (3.30%) Data Consultant
17 22 (3.03%) Enterprise Architect
18 21 (2.89%) Azure Consultant
Libraries, Frameworks & Software Standards
1 56 (7.70%) Kafka
2 53 (7.29%) .NET
3 38 (5.23%) JSON
4 36 (4.95%) Web Services
5 34 (4.68%) XML
6 26 (3.58%) MDX
7 22 (3.03%) REST
8 18 (2.48%) SOAP
9 16 (2.20%) .NET Core
10 13 (1.79%) React
11 12 (1.65%) Apache NiFi
12 11 (1.51%) AngularJS
13 9 (1.24%) .NET Framework
13 9 (1.24%) Apache Avro
13 9 (1.24%) Node.js
14 8 (1.10%) Lambda Expressions
14 8 (1.10%) PySpark
14 8 (1.10%) RESTful
15 6 (0.83%) HTML
15 6 (0.83%) Spark Streaming
Miscellaneous
1 50 (6.88%) Analytical Skills
2 42 (5.78%) Greenfield Project
3 22 (3.03%) Management Information System
4 17 (2.34%) Public Cloud
5 16 (2.20%) Data Structures
6 15 (2.06%) Private Cloud
7 12 (1.65%) Algorithms
8 9 (1.24%) User Experience
9 8 (1.10%) Reference Data
10 7 (0.96%) Hybrid Cloud
11 6 (0.83%) Cloud Native
11 6 (0.83%) Virtual Team
12 5 (0.69%) Data Centre
12 5 (0.69%) Linux Command Line
12 5 (0.69%) Replication
12 5 (0.69%) Self-Motivation
13 4 (0.55%) Clustering
14 3 (0.41%) Fixed Income
14 3 (0.41%) Hedge funds
14 3 (0.41%) Learning Management System
Operating Systems
1 29 (3.99%) Windows
2 28 (3.85%) Linux
3 23 (3.16%) Unix
4 11 (1.51%) Windows Server
5 10 (1.38%) VMS
6 9 (1.24%) Red Hat Enterprise Linux
7 7 (0.96%) CentOS
8 1 (0.14%) Windows Server 2008
8 1 (0.14%) Windows Server 2012
Processes & Methodologies
1 336 (46.22%) Analytics
2 300 (41.27%) Business Intelligence
3 244 (33.56%) Agile Software Development
4 184 (25.31%) DevOps
5 158 (21.73%) ETL
6 144 (19.81%) Data Modelling
7 98 (13.48%) Data Science
8 92 (12.65%) Machine Learning
9 87 (11.97%) Migration
10 84 (11.55%) Data Analytics
10 84 (11.55%) Data Architecture
11 82 (11.28%) Data Management
12 76 (10.45%) Test Automation
13 70 (9.63%) Scrum
14 69 (9.49%) Data Integration
15 68 (9.35%) Visualisation
16 66 (9.08%) Data Governance
16 66 (9.08%) Master Data Management
17 62 (8.53%) Data Engineering
18 55 (7.57%) Stakeholder Management
Programming Languages
1 357 (49.11%) SQL
2 199 (27.37%) Python
3 113 (15.54%) C#
4 81 (11.14%) PowerShell
5 69 (9.49%) Scala
6 55 (7.57%) R
7 50 (6.88%) Java
8 29 (3.99%) T-SQL
9 27 (3.71%) Data Analysis Expressions (DAX)
10 20 (2.75%) JavaScript
11 19 (2.61%) U-SQL
12 11 (1.51%) Bash Shell
13 8 (1.10%) C
13 8 (1.10%) Go
14 7 (0.96%) C++
14 7 (0.96%) PL/SQL
15 5 (0.69%) Ruby
16 4 (0.55%) Java 8
16 4 (0.55%) Perl
17 3 (0.41%) Shell Script
Qualifications
1 28 (3.85%) Degree
1 28 (3.85%) Security Cleared
2 23 (3.16%) SC Cleared
3 10 (1.38%) DBS Check
4 6 (0.83%) TOGAF Certification
5 4 (0.55%) AWS Certification
6 3 (0.41%) CEH
7 2 (0.28%) CISM
7 2 (0.28%) CISSP
7 2 (0.28%) ISEB
7 2 (0.28%) Microsoft Certification
7 2 (0.28%) PMI Certification
7 2 (0.28%) PRINCE2 Certification
8 1 (0.14%) CISA
8 1 (0.14%) Cisco Certification
8 1 (0.14%) GIAC
8 1 (0.14%) MCSA
8 1 (0.14%) MCSE
8 1 (0.14%) PhD
8 1 (0.14%) SSCP
Quality Assurance & Compliance
1 65 (8.94%) Data Quality
2 18 (2.48%) QA
3 12 (1.65%) GDPR
4 2 (0.28%) ISO/IEC 27001
4 2 (0.28%) PCI DSS
5 1 (0.14%) GxP
5 1 (0.14%) IFRS
5 1 (0.14%) IFRS 9
5 1 (0.14%) Solvency II
System Software
1 44 (6.05%) Docker
2 21 (2.89%) HDFS
2 21 (2.89%) Virtual Machines
3 17 (2.34%) Active Directory
4 7 (0.96%) Virtual Desktop
4 7 (0.96%) Virtual Servers
5 5 (0.69%) Apache Flume
6 4 (0.55%) VMware Infrastructure
7 2 (0.28%) Apache ZooKeeper
7 2 (0.28%) Hyper-V
7 2 (0.28%) NFS
8 1 (0.14%) Postfix
Systems Management
1 47 (6.46%) Kubernetes
2 19 (2.61%) Ansible
3 18 (2.48%) Terraform
4 9 (1.24%) Puppet
5 8 (1.10%) Grafana
6 7 (0.96%) Oozie
7 6 (0.83%) Hadoop YARN
8 4 (0.55%) Opscode Chef
8 4 (0.55%) Packer
9 2 (0.28%) Kibana
9 2 (0.28%) logstash
9 2 (0.28%) Nessus
9 2 (0.28%) Salt
10 1 (0.14%) AirWatch
10 1 (0.14%) Kubeflow
10 1 (0.14%) SCCM
10 1 (0.14%) yum
Vendors
1 259 (35.63%) Microsoft
2 140 (19.26%) Databricks
3 82 (11.28%) Tableau
4 48 (6.60%) Oracle
5 39 (5.36%) Informatica
6 37 (5.09%) Talend
7 32 (4.40%) Cloudera
8 27 (3.71%) Google
9 24 (3.30%) SAP
10 21 (2.89%) Alteryx
11 13 (1.79%) Splunk
11 13 (1.79%) StreamSets
12 10 (1.38%) Hortonworks
13 8 (1.10%) Teradata
14 6 (0.83%) Sparx
15 5 (0.69%) SnapLogic
15 5 (0.69%) TIBCO
16 4 (0.55%) Cisco
16 4 (0.55%) MicroStrategy
16 4 (0.55%) Salesforce.com