Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 19 September 2019

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 19 September 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK
6 months to
19 Sep 2019		 Same period 2018 Same period 2017
Rank 305 465 696
Rank change year-on-year +160 +231 +115
Contract jobs citing Data Lake 770 501 190
As % of all contract IT jobs advertised in the UK 0.87% 0.49% 0.19%
As % of the Database & Business Intelligence category 4.01% 2.14% 0.86%
Number of daily rates quoted 563 334 139
UK median daily rate £525 £518 £550
Median daily rate % change year-on-year +1.45% -5.91% -4.35%
10th Percentile £406 £383 £363
90th Percentile £688 £717 £740
UK excluding London median daily rate £500 £500 £525
% change year-on-year - -4.76% +10.53%
Number of hourly rates quoted 6 3 1
UK median hourly rate £72.50 £50.00 £45.00
Median hourly rate % change year-on-year +45.00% +11.11% -
10th Percentile £53.13 £43.80 £40.00
90th Percentile £73.75 £56.00 £50.00
UK excluding London median hourly rate £72.50 £50.00 £45.00
% change year-on-year +45.00% +11.11% -

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 19,185 23,434 22,189
As % of all contract IT jobs advertised in the UK 21.59% 22.73% 22.47%
Number of daily rates quoted 13,051 16,431 14,800
UK median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +5.88%
10th Percentile £325 £313 £305
90th Percentile £650 £638 £625
UK excluding London median daily rate £438 £425 £400
% change year-on-year +2.94% +6.25% +6.67%
Number of hourly rates quoted 254 238 277
UK median hourly rate £35.00 £29.75 £29.50
Median hourly rate % change year-on-year +17.65% +0.85% -1.47%
10th Percentile £12.66 £13.43 £12.23
90th Percentile £60.00 £56.01 £53.75
UK excluding London median hourly rate £35.00 £29.50 £30.00
% change year-on-year +18.64% -1.67% +5.26%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a percentage of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Lake.

Contractor daily rate trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Lake over the 6 months to 19 September 2019.

Contractor daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Lake.

Contractor hourly rate trend for Data Lake in the UK

Data Lake
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Lake over the 6 months to 19 September 2019.

Contractor hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 19 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +164 741 £525 - 111
London +107 445 £550 +4.76% 56
UK excluding London +146 322 £500 - 59
South East +66 172 £500 - 24
North of England +54 41 £500 -9.09% 16
North West +39 31 £500 -9.09% 14
Midlands +55 28 £425 - 6
East of England +47 28 £550 +2.33% 4
South West +8 27 £700 +40.00% 5
Scotland +37 22 £500 +25.00% 4
West Midlands +52 18 £395 -7.06% 4
East Midlands +28 9 £425 - 2
Yorkshire +22 6 £500 +2.56% 1
Wales +27 4 £675 +28.57%
North East - 4 £463 - 1

For the 6 months to 19 September 2019, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Lake.

1 442 (57.40%) Azure
2 350 (45.45%) SQL
3 342 (44.42%) Data Warehouse
4 296 (38.44%) Big Data
5 290 (37.66%) Analytics
6 289 (37.53%) Business Intelligence
7 241 (31.30%) Microsoft
8 227 (29.48%) Python
9 226 (29.35%) Agile Software Development
9 226 (29.35%) Power Platform
10 225 (29.22%) Power BI
11 205 (26.62%) Hadoop
12 189 (24.55%) Azure Data Factory
13 171 (22.21%) Apache Spark
13 171 (22.21%) AWS
14 164 (21.30%) Data Modelling
15 163 (21.17%) DevOps
16 155 (20.13%) ETL
17 149 (19.35%) SQL Server Integration Services
18 135 (17.53%) SQL Server
19 131 (17.01%) Databricks
20 130 (16.88%) Finance
21 119 (15.45%) C#
22 118 (15.32%) Data Science
23 112 (14.55%) Serverless
24 110 (14.29%) Azure SQL Database
25 107 (13.90%) Kafka
26 104 (13.51%) Migration
27 96 (12.47%) Azure SQL Data Warehouse
28 88 (11.43%) Scrum

Data Lake
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 171 (22.21%) Apache Spark
2 32 (4.16%) Apache
3 18 (2.34%) SharePoint
4 17 (2.21%) SAS
5 16 (2.08%) Apache Airflow
6 12 (1.56%) Jupyter
7 7 (0.91%) Apache Solr
7 7 (0.91%) Confluence
7 7 (0.91%) Elasticsearch
8 4 (0.52%) Apache Pig
8 4 (0.52%) Luigi
9 2 (0.26%) OpenStack
9 2 (0.26%) SharePoint 2013
10 1 (0.13%) Anypoint
10 1 (0.13%) Cloud Foundry
10 1 (0.13%) IIS
Applications
1 23 (2.99%) Microsoft Excel
2 8 (1.04%) Microsoft Office
3 2 (0.26%) AutoCAD
3 2 (0.26%) Sketch
Business Applications
1 11 (1.43%) Dynamics CRM
2 7 (0.91%) SAP Oil and Gas
3 6 (0.78%) Salesforce.com CRM
4 5 (0.65%) Dynamics AX
4 5 (0.65%) Dynamics NAV
5 3 (0.39%) Eloqua
6 2 (0.26%) SAP ERP
6 2 (0.26%) SAP HR
6 2 (0.26%) Sparx Enterprise Architect
6 2 (0.26%) Workday HCM
7 1 (0.13%) FINCAD Analytics
7 1 (0.13%) Markit EDM
7 1 (0.13%) Oracle Retail
7 1 (0.13%) SAP S/4HANA
Cloud Services
1 442 (57.40%) Azure
2 226 (29.35%) Power Platform
3 189 (24.55%) Azure Data Factory
4 171 (22.21%) AWS
5 112 (14.55%) Serverless
6 67 (8.70%) Data Lake Analytics
7 55 (7.14%) Amazon S3
8 51 (6.62%) GCP
9 47 (6.10%) PaaS
10 38 (4.94%) IaaS
11 32 (4.16%) SaaS
12 30 (3.90%) AWS Lambda
13 27 (3.51%) Azure Functions
14 26 (3.38%) Amazon EMR
15 20 (2.60%) iPaaS
16 17 (2.21%) Amazon Kinesis
17 16 (2.08%) Azure Machine Learning
17 16 (2.08%) GitHub
18 15 (1.95%) Amazon EC2
19 13 (1.69%) Office 365
Communications & Networking
1 11 (1.43%) Internet
2 7 (0.91%) SAN
3 5 (0.65%) Kerberos
4 4 (0.52%) Firewall
5 2 (0.26%) Extranet
5 2 (0.26%) FTP
5 2 (0.26%) HTTP
5 2 (0.26%) Intranet
5 2 (0.26%) Software-Defined Networking
5 2 (0.26%) SSL
6 1 (0.13%) DHCP
6 1 (0.13%) DNS
6 1 (0.13%) HTTPS
6 1 (0.13%) SMTP
6 1 (0.13%) Telnet
6 1 (0.13%) VPN
Database & Business Intelligence
1 342 (44.42%) Data Warehouse
2 296 (38.44%) Big Data
3 225 (29.22%) Power BI
4 205 (26.62%) Hadoop
5 149 (19.35%) SQL Server Integration Services
6 135 (17.53%) SQL Server
7 110 (14.29%) Azure SQL Database
8 96 (12.47%) Azure SQL Data Warehouse
9 86 (11.17%) Apache Hive
10 82 (10.65%) Cosmos DB
11 79 (10.26%) SQL Server Analysis Services
12 69 (8.96%) NoSQL
13 60 (7.79%) SQL Server Reporting Services
14 57 (7.40%) Relational Database
15 55 (7.14%) HDInsight
16 44 (5.71%) Amazon Redshift
17 39 (5.06%) Data Mart
18 31 (4.03%) Impala
18 31 (4.03%) Microsoft Analysis Services
19 28 (3.64%) HBase
Development Applications
1 79 (10.26%) Visual Studio Team System
2 47 (6.10%) Git (software)
3 46 (5.97%) Visual Studio
4 38 (4.94%) Jenkins
5 24 (3.12%) JIRA
6 16 (2.08%) Cucumber
7 15 (1.95%) TeamCity
8 13 (1.69%) Team Foundation Server
9 12 (1.56%) Maven
10 11 (1.43%) Atlassian Bamboo
11 8 (1.04%) ERwin
12 7 (0.91%) Concordion
12 7 (0.91%) EasyMock
12 7 (0.91%) Mockito
12 7 (0.91%) Octopus Deploy
12 7 (0.91%) SpecFlow
13 6 (0.78%) Gradle
13 6 (0.78%) Jasmine
13 6 (0.78%) tSQLt
14 5 (0.65%) PowerDesigner
General
1 130 (16.88%) Finance
2 41 (5.32%) Retail
3 26 (3.38%) Banking
4 24 (3.12%) Public Sector
5 22 (2.86%) Marketing
6 13 (1.69%) Advertising
7 12 (1.56%) Telecoms
8 10 (1.30%) Front Office
8 10 (1.30%) Legal
9 7 (0.91%) Investment Banking
9 7 (0.91%) Publishing
10 5 (0.65%) Retail Banking
11 3 (0.39%) Electronics
11 3 (0.39%) Local Government
11 3 (0.39%) Manufacturing
12 2 (0.26%) Automotive
12 2 (0.26%) Financial Institution
12 2 (0.26%) French Language
12 2 (0.26%) Games
13 1 (0.13%) Pharmaceutical
Job Titles
1 203 (26.36%) Architect
2 183 (23.77%) Data Engineer
3 146 (18.96%) Data Architect
4 99 (12.86%) Developer
5 77 (10.00%) Azure Engineer
6 64 (8.31%) Azure Architect
7 56 (7.27%) Big Data Engineer
8 48 (6.23%) Analyst
9 45 (5.84%) DevOps Engineer
10 43 (5.58%) Consultant
11 41 (5.32%) Solutions Architect
12 32 (4.16%) Azure DevOps
13 30 (3.90%) Big Data Architect
14 29 (3.77%) Azure Developer
14 29 (3.77%) Business Intelligence Developer
15 27 (3.51%) Azure DevOps Engineer
15 27 (3.51%) Senior Data Engineer
16 26 (3.38%) AWS Engineer
17 23 (2.99%) Project Manager
18 21 (2.73%) SQL Developer
Libraries, Frameworks & Software Standards
1 107 (13.90%) Kafka
2 61 (7.92%) .NET
3 43 (5.58%) JSON
4 36 (4.68%) Web Services
5 33 (4.29%) XML
6 27 (3.51%) .NET Core
7 26 (3.38%) REST
8 23 (2.99%) MDX
9 21 (2.73%) AngularJS
10 18 (2.34%) SOAP
11 14 (1.82%) Apache Avro
12 12 (1.56%) React
12 12 (1.56%) Velocity
13 11 (1.43%) .NET Framework
13 11 (1.43%) Spark Streaming
14 10 (1.30%) Apache NiFi
14 10 (1.30%) Node.js
15 9 (1.17%) PySpark
16 8 (1.04%) Gherkin
17 7 (0.91%) Lambda Expressions
Miscellaneous
1 66 (8.57%) Analytical Skills
2 50 (6.49%) Greenfield Project
3 25 (3.25%) Algorithms
4 24 (3.12%) Management Information System
5 20 (2.60%) Data Structures
6 18 (2.34%) Public Cloud
7 13 (1.69%) Private Cloud
8 12 (1.56%) User Experience
9 11 (1.43%) Self-Motivation
10 9 (1.17%) Reference Data
11 8 (1.04%) Data Centre
11 8 (1.04%) Internet of Things
11 8 (1.04%) Linux Command Line
11 8 (1.04%) Virtual Team
12 6 (0.78%) Hybrid Cloud
13 5 (0.65%) Cloud Native
14 4 (0.52%) Enterprise Software
14 4 (0.52%) Replication
15 3 (0.39%) FMCG
15 3 (0.39%) SCADA
Operating Systems
1 34 (4.42%) Windows
2 29 (3.77%) Linux
3 25 (3.25%) Unix
4 13 (1.69%) VMS
5 11 (1.43%) CentOS
6 9 (1.17%) Windows Server
7 7 (0.91%) Red Hat Enterprise Linux
8 1 (0.13%) Android
8 1 (0.13%) Apple iOS
8 1 (0.13%) Windows Server 2008
8 1 (0.13%) Windows Server 2012
Processes & Methodologies
1 290 (37.66%) Analytics
2 289 (37.53%) Business Intelligence
3 226 (29.35%) Agile Software Development
4 164 (21.30%) Data Modelling
5 163 (21.17%) DevOps
6 155 (20.13%) ETL
7 118 (15.32%) Data Science
8 104 (13.51%) Migration
9 88 (11.43%) Scrum
10 85 (11.04%) Data Architecture
11 80 (10.39%) Machine Learning
12 72 (9.35%) Data Engineering
13 68 (8.83%) Data Management
13 68 (8.83%) Visualisation
14 67 (8.70%) Data Analytics
15 64 (8.31%) Data Governance
16 62 (8.05%) Data Integration
17 60 (7.79%) Microservices
18 59 (7.66%) Problem-Solving
18 59 (7.66%) Test Automation
Programming Languages
1 350 (45.45%) SQL
2 227 (29.48%) Python
3 119 (15.45%) C#
4 81 (10.52%) Java
5 76 (9.87%) Scala
6 73 (9.48%) PowerShell
7 50 (6.49%) R
8 32 (4.16%) T-SQL
9 29 (3.77%) JavaScript
10 27 (3.51%) U-SQL
11 24 (3.12%) Data Analysis Expressions (DAX)
12 13 (1.69%) Bash Shell
13 11 (1.43%) Go
14 9 (1.17%) PL/SQL
14 9 (1.17%) Shell Script
15 8 (1.04%) Perl
16 4 (0.52%) C++
16 4 (0.52%) Java 8
16 4 (0.52%) VBA
17 3 (0.39%) Ruby
Qualifications
1 37 (4.81%) Security Cleared
2 36 (4.68%) Degree
3 30 (3.90%) SC Cleared
4 9 (1.17%) DBS Check
5 7 (0.91%) Computer Science Degree
6 5 (0.65%) TOGAF Certification
7 4 (0.52%) CEH
7 4 (0.52%) PhD
7 4 (0.52%) PRINCE2 Certification
8 3 (0.39%) CISA
8 3 (0.39%) CISM
8 3 (0.39%) CISSP
9 2 (0.26%) AWS Certification
9 2 (0.26%) GIAC
9 2 (0.26%) Master's Degree
9 2 (0.26%) Microsoft Certification
9 2 (0.26%) OSCP
9 2 (0.26%) PMI Certification
10 1 (0.13%) BPSS Clearance
10 1 (0.13%) Cisco Certification
Quality Assurance & Compliance
1 64 (8.31%) Data Quality
2 19 (2.47%) QA
3 13 (1.69%) GDPR
4 4 (0.52%) PMO
5 3 (0.39%) ISO/IEC 27001
6 1 (0.13%) GxP
6 1 (0.13%) PCI DSS
6 1 (0.13%) Sarbanes-Oxley
6 1 (0.13%) SLA
System Software
1 66 (8.57%) Docker
2 37 (4.81%) HDFS
3 22 (2.86%) Apache Flume
4 17 (2.21%) Virtual Machines
5 7 (0.91%) Active Directory
5 7 (0.91%) Virtual Desktop
5 7 (0.91%) Virtual Servers
6 5 (0.65%) VMware Infrastructure
7 4 (0.52%) Samba
7 4 (0.52%) VMware ESXi
8 2 (0.26%) NFS
9 1 (0.13%) Postfix
Systems Management
1 65 (8.44%) Kubernetes
2 22 (2.86%) Terraform
3 21 (2.73%) Ansible
4 14 (1.82%) Oozie
5 13 (1.69%) Hadoop YARN
6 12 (1.56%) Puppet
7 6 (0.78%) Grafana
7 6 (0.78%) Opscode Chef
8 4 (0.52%) Ambari
8 4 (0.52%) Control-M
8 4 (0.52%) Packer
9 2 (0.26%) Nessus
9 2 (0.26%) Salt
9 2 (0.26%) SCCM
10 1 (0.13%) AirWatch
10 1 (0.13%) Microsoft Intune
10 1 (0.13%) yum
Vendors
1 241 (31.30%) Microsoft
2 131 (17.01%) Databricks
3 58 (7.53%) Tableau
4 50 (6.49%) Cloudera
5 47 (6.10%) Oracle
6 45 (5.84%) Talend
7 37 (4.81%) Informatica
8 33 (4.29%) Google
9 22 (2.86%) SAP
10 21 (2.73%) Alteryx
11 17 (2.21%) Hortonworks
12 15 (1.95%) Teradata
12 15 (1.95%) Workday
13 14 (1.82%) StreamSets
14 13 (1.69%) Ab Initio
14 13 (1.69%) Splunk
15 9 (1.17%) Salesforce.com
16 8 (1.04%) MuleSoft
17 5 (0.65%) SnapLogic
17 5 (0.65%) VMware