Period
to 5 December 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 5 December 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Lakes
UK > England
6 months to
5 Dec 2021
Same period 2020 Same period 2019
Rank 192 234 268
Rank change year-on-year +42 +34 +142
Contract jobs citing Data Lake 1,035 343 741
As % of all contract jobs advertised in England 1.47% 1.09% 0.99%
As % of the Database & Business Intelligence category 6.82% 4.89% 4.53%
Number of daily rates quoted 671 243 540
10th Percentile £413 £400 £406
25th Percentile £463 £463 £459
Median daily rate (50th Percentile) £550 £525 £550
Median % change year-on-year +4.76% -4.55% +4.76%
75th Percentile £650 £613 £638
90th Percentile £725 £700 £725
UK median daily rate £550 £521 £550
% change year-on-year +5.67% -5.36% +4.76%
Number of hourly rates quoted 0 1 4
Median hourly rate - £66.50 £72.50
Median % change year-on-year - -8.28% +45.73%
UK median hourly rate £24.00 £66.50 £72.50
% change year-on-year -63.91% -8.28% +45.73%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 15,180 7,015 16,358
As % of all contract IT jobs advertised in England 21.54% 22.38% 21.90%
Number of daily rates quoted 10,938 4,919 11,318
10th Percentile £356 £312 £325
25th Percentile £425 £400 £400
Median daily rate (50th Percentile) £525 £498 £475
Median % change year-on-year +5.53% +4.74% -
75th Percentile £638 £600 £575
90th Percentile £725 £675 £663
UK median daily rate £525 £490 £475
% change year-on-year +7.14% +3.16% -
Number of hourly rates quoted 198 114 223
10th Percentile £17.52 £12.63 £12.75
25th Percentile £24.50 £19.44 £17.12
Median hourly rate £39.40 £27.75 £28.25
Median % change year-on-year +41.98% -1.77% -4.24%
75th Percentile £58.44 £47.50 £45.00
90th Percentile £66.57 £60.18 £70.00
UK median hourly rate £38.54 £27.23 £28.25
% change year-on-year +41.53% -3.61% -0.88%

Data Lake
Job Vacancy Trend in England

Job postings citing Data Lake as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Lake in England

Data Lake
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Lake in England.

Daily rate trend for Data Lake in England

Data Lake
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Lake in England over the 6 months to 5 December 2021.

Daily rate histogram for Data Lake in England

Data Lake
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Lake in England.

Hourly rate trend for Data Lake in England

Data Lake
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the England region over the 6 months to 5 December 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +50 671 £575 +8.75% 122
North of England +7 116 £475 -13.64% 30
South East -30 81 £500 +5.26% 27
Yorkshire +7 60 £488 -11.36% 7
Midlands -46 55 £500 +5.26% 16
North West -32 45 £450 -21.74% 20
West Midlands -38 33 £488 -2.50% 13
East Midlands -26 21 £517 +21.53% 3
East of England -43 17 £501 +5.53% 6
South West -54 13 £513 -6.82% 7
North East 0 11 £663 +39.47% 3
Data Lake
UK

For the 6 months to 5 December 2021, IT contractor jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Lake.

1 686 (66.28%) Azure
2 483 (46.67%) SQL
3 411 (39.71%) Databricks
4 386 (37.29%) Data Warehouse
5 367 (35.46%) Azure Data Factory
6 361 (34.88%) Business Intelligence
7 355 (34.30%) Agile Software Development
8 345 (33.33%) Python
9 332 (32.08%) DevOps
10 324 (31.30%) Analytics
11 307 (29.66%) Data Modelling
11 307 (29.66%) Power Platform
12 291 (28.12%) Power BI
13 270 (26.09%) Microsoft
14 253 (24.44%) AWS
15 252 (24.35%) ETL
16 229 (22.13%) Big Data
17 215 (20.77%) Finance
18 201 (19.42%) Social Skills
19 189 (18.26%) Azure SQL Database
20 186 (17.97%) SQL Server
21 159 (15.36%) Apache Spark
22 156 (15.07%) Azure Synapse Analytics
23 154 (14.88%) Data Pipeline
24 147 (14.20%) Data Engineering
25 140 (13.53%) Scrum
26 127 (12.27%) Hadoop
27 124 (11.98%) Serverless
28 116 (11.21%) Migration
29 114 (11.01%) Data Integration

Data Lake
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 159 (15.36%) Apache Spark
2 52 (5.02%) Apache
3 41 (3.96%) Apache Airflow
4 19 (1.84%) Confluence
5 17 (1.64%) SharePoint
6 11 (1.06%) Apache Pig
6 11 (1.06%) Elasticsearch
7 9 (0.87%) Jupyter
7 9 (0.87%) SAS
8 6 (0.58%) nginx
8 6 (0.58%) WebLogic
9 5 (0.48%) BizTalk Server
10 4 (0.39%) JBoss
11 3 (0.29%) Luigi
12 2 (0.19%) Apache Synapse
13 1 (0.097%) ArcGIS
13 1 (0.097%) Camunda
13 1 (0.097%) MQSeries
13 1 (0.097%) Oracle Coherence
13 1 (0.097%) Oracle SOA Suite
Applications
1 20 (1.93%) Microsoft Excel
2 5 (0.48%) Microsoft Office
3 3 (0.29%) SPSS
4 2 (0.19%) Microsoft PowerPoint
4 2 (0.19%) Oracle Smart View
5 1 (0.097%) Spreadsheet
Business Applications
1 13 (1.26%) Dynamics CRM
2 4 (0.39%) SAP S/4HANA
3 3 (0.29%) Adobe Campaign
3 3 (0.29%) SAP CO
3 3 (0.29%) SAP ERP
3 3 (0.29%) SAP FI
3 3 (0.29%) SAP FI/CO
3 3 (0.29%) SAP Oil and Gas
3 3 (0.29%) Sparx Enterprise Architect
3 3 (0.29%) Unit4 Business World
4 2 (0.19%) Dynamics AX
4 2 (0.19%) Eloqua
4 2 (0.19%) Maximo
4 2 (0.19%) SAP SD
5 1 (0.097%) Primavera
5 1 (0.097%) Workday HCM
Cloud Services
1 686 (66.28%) Azure
2 367 (35.46%) Azure Data Factory
3 307 (29.66%) Power Platform
4 253 (24.44%) AWS
5 156 (15.07%) Azure Synapse Analytics
6 124 (11.98%) Serverless
7 107 (10.34%) Azure Cosmos DB
8 76 (7.34%) Amazon S3
9 60 (5.80%) AWS Lambda
10 58 (5.60%) Azure Storage
11 57 (5.51%) Azure Functions
11 57 (5.51%) PaaS
12 56 (5.41%) Snowflake
13 51 (4.93%) GCP
14 47 (4.54%) Azure Logic Apps
15 43 (4.15%) Azure Active Directory
16 39 (3.77%) Amazon EMR
16 39 (3.77%) IaaS
17 33 (3.19%) AWS CloudFormation
18 31 (3.00%) Amazon Kinesis
Communications & Networking
1 17 (1.64%) FTP
2 7 (0.68%) Firewall
3 6 (0.58%) Cisco IPT
4 5 (0.48%) Network Security
5 4 (0.39%) Extranet
5 4 (0.39%) Internet
5 4 (0.39%) IPFS
5 4 (0.39%) Kerberos
6 3 (0.29%) Cisco ASA
7 2 (0.19%) DNS
8 1 (0.097%) 2G
8 1 (0.097%) 3G
8 1 (0.097%) 4G
8 1 (0.097%) 5G
8 1 (0.097%) AMQP
8 1 (0.097%) LAN
8 1 (0.097%) MPLS
8 1 (0.097%) SAN
8 1 (0.097%) VPN
8 1 (0.097%) WAN
Database & Business Intelligence
1 386 (37.29%) Data Warehouse
2 291 (28.12%) Power BI
3 229 (22.13%) Big Data
4 189 (18.26%) Azure SQL Database
5 186 (17.97%) SQL Server
6 127 (12.27%) Hadoop
7 96 (9.28%) SQL Server Integration Services
8 91 (8.79%) NoSQL
9 79 (7.63%) Tableau
10 76 (7.34%) Azure SQL Data Warehouse
11 75 (7.25%) Relational Database
12 68 (6.57%) Amazon Redshift
12 68 (6.57%) Metadata
13 67 (6.47%) SQL Server Analysis Services
14 57 (5.51%) SQL Server Reporting Services
15 54 (5.22%) Amazon Athena
16 46 (4.44%) MongoDB
17 40 (3.86%) Delta Lake
17 40 (3.86%) RDBMS
18 38 (3.67%) PostgreSQL
Development Applications
1 81 (7.83%) Git (software)
2 61 (5.89%) Jenkins
3 46 (4.44%) JIRA
4 34 (3.29%) PowerDesigner
5 26 (2.51%) kappa
6 22 (2.13%) Visual Studio
7 19 (1.84%) ER Studio
8 15 (1.45%) ERwin
9 13 (1.26%) Visual Studio Team System
10 12 (1.16%) Subversion
11 8 (0.77%) GitLab
12 7 (0.68%) MLflow
12 7 (0.68%) TeamCity
13 5 (0.48%) Cucumber
13 5 (0.48%) Octopus Deploy
13 5 (0.48%) SpecFlow
14 4 (0.39%) Atlassian Bamboo
14 4 (0.39%) Bitbucket
14 4 (0.39%) CircleCI
14 4 (0.39%) Team Foundation Server
General
1 215 (20.77%) Finance
2 201 (19.42%) Social Skills
3 108 (10.43%) Analytical Skills
4 64 (6.18%) Banking
5 38 (3.67%) Presentation Skills
6 32 (3.09%) Marketing
7 30 (2.90%) Public Sector
8 29 (2.80%) Legal
9 26 (2.51%) Retail
10 25 (2.42%) Financial Institution
11 19 (1.84%) Investment Banking
12 15 (1.45%) Influencing Skills
12 15 (1.45%) Law
13 13 (1.26%) Telecoms
14 12 (1.16%) Publishing
15 11 (1.06%) Documentation Skills
15 11 (1.06%) Front Office
16 9 (0.87%) Manufacturing
16 9 (0.87%) Retail Banking
17 6 (0.58%) Electronics
Job Titles
1 312 (30.14%) Data Engineer
2 227 (21.93%) Architect
3 174 (16.81%) Azure Engineer
4 136 (13.14%) Developer
5 133 (12.85%) Data Architect
6 81 (7.83%) Analyst
7 77 (7.44%) Solutions Architect
8 70 (6.76%) Azure Architect
9 50 (4.83%) Project Manager
10 46 (4.44%) Data Analyst
11 41 (3.96%) Azure Developer
12 39 (3.77%) Cloud Engineer
12 39 (3.77%) Senior Data Engineer
13 35 (3.38%) Consultant
14 34 (3.29%) Business Intelligence Developer
15 31 (3.00%) DevOps Engineer
16 28 (2.71%) AWS Engineer
16 28 (2.71%) Business Analyst
16 28 (2.71%) Cloud Architect
17 25 (2.42%) Python Engineer
Libraries, Frameworks & Software Standards
1 99 (9.57%) Kafka
2 93 (8.99%) PySpark
3 82 (7.92%) .NET
4 71 (6.86%) JSON
5 38 (3.67%) XML
6 36 (3.48%) REST
7 30 (2.90%) RESTful
8 26 (2.51%) Web Services
9 25 (2.42%) .NET Framework
10 24 (2.32%) Spark Streaming
11 19 (1.84%) ARM Templates
11 19 (1.84%) ASP.NET
12 16 (1.55%) AngularJS
12 16 (1.55%) Pandas
13 15 (1.45%) SOAP
14 13 (1.26%) ASP.NET MVC
15 12 (1.16%) .NET Core
15 12 (1.16%) EDI
15 12 (1.16%) SAML
16 11 (1.06%) Entity Framework
Miscellaneous
1 46 (4.44%) Data Protection Act
2 38 (3.67%) Cloud Native
3 28 (2.71%) Data Structures
4 27 (2.61%) Enterprise Software
5 24 (2.32%) Virtual Team
6 21 (2.03%) Hedge funds
7 20 (1.93%) Self-Motivation
8 19 (1.84%) User Experience
9 17 (1.64%) Reference Data
10 13 (1.26%) Hybrid Cloud
10 13 (1.26%) Public Cloud
11 11 (1.06%) Clustering
11 11 (1.06%) Data Centre
11 11 (1.06%) Legacy Systems
11 11 (1.06%) Management Information System
12 10 (0.97%) Greenfield Project
12 10 (0.97%) Market Risk
13 8 (0.77%) Algorithms
13 8 (0.77%) FMCG
13 8 (0.77%) Legacy Applications
Operating Systems
1 54 (5.22%) Linux
2 30 (2.90%) Windows
3 25 (2.42%) Unix
4 13 (1.26%) Red Hat Enterprise Linux
5 7 (0.68%) Windows Server
6 6 (0.58%) CentOS
6 6 (0.58%) VMS
7 2 (0.19%) Debian
7 2 (0.19%) Ubuntu
Processes & Methodologies
1 361 (34.88%) Business Intelligence
2 355 (34.30%) Agile Software Development
3 332 (32.08%) DevOps
4 324 (31.30%) Analytics
5 307 (29.66%) Data Modelling
6 252 (24.35%) ETL
7 154 (14.88%) Data Pipeline
8 147 (14.20%) Data Engineering
9 140 (13.53%) Scrum
10 116 (11.21%) Migration
11 114 (11.01%) Data Integration
12 104 (10.05%) Data Analysis
13 101 (9.76%) Data Architecture
14 98 (9.47%) Data Science
15 96 (9.28%) Data Management
16 93 (8.99%) Visualisation
17 89 (8.60%) Data Ingestion
18 84 (8.12%) Stakeholder Management
19 83 (8.02%) Microservices
20 80 (7.73%) Data Analytics
Programming Languages
1 483 (46.67%) SQL
2 345 (33.33%) Python
3 113 (10.92%) Java
4 103 (9.95%) PowerShell
5 92 (8.89%) C#
6 71 (6.86%) Scala
7 62 (5.99%) T-SQL
8 55 (5.31%) Bash Shell
9 36 (3.48%) JavaScript
10 33 (3.19%) R
11 31 (3.00%) Data Analysis Expressions (DAX)
12 15 (1.45%) PL/SQL
13 9 (0.87%) COBOL
14 8 (0.77%) Shell Script
15 7 (0.68%) Perl
16 6 (0.58%) C
16 6 (0.58%) PHP
17 5 (0.48%) C++
17 5 (0.48%) Go
18 4 (0.39%) TypeScript
Qualifications
1 51 (4.93%) Degree
2 37 (3.57%) Security Cleared
3 26 (2.51%) SC Cleared
4 18 (1.74%) AWS Certification
5 17 (1.64%) Microsoft Certification
6 16 (1.55%) Computer Science Degree
7 15 (1.45%) BPSS Clearance
8 12 (1.16%) Master's Degree
9 8 (0.77%) (ISC)2 CCSP
9 8 (0.77%) Cisco Certification
9 8 (0.77%) CISSP
10 6 (0.58%) DV Cleared
11 5 (0.48%) MCSA
11 5 (0.48%) MCSE
12 4 (0.39%) PMI Certification
13 3 (0.29%) BC Cleared
13 3 (0.29%) TOGAF Certification
14 2 (0.19%) CBAP
14 2 (0.19%) CTC Cleared
14 2 (0.19%) PMP
Quality Assurance & Compliance
1 87 (8.41%) Data Quality
2 39 (3.77%) GDPR
3 33 (3.19%) QA
4 15 (1.45%) Sarbanes-Oxley
5 8 (0.77%) SLA
6 5 (0.48%) Accessibility
7 4 (0.39%) GxP
8 3 (0.29%) COBIT
8 3 (0.29%) NCSC
8 3 (0.29%) NIST
9 2 (0.19%) IFRS
9 2 (0.19%) ISO/IEC 27001
9 2 (0.19%) NIST 800
9 2 (0.19%) PCI DSS
9 2 (0.19%) PMO
10 1 (0.097%) Disclosure Scotland
10 1 (0.097%) GLBA
10 1 (0.097%) PSD2
10 1 (0.097%) Solvency II
System Software
1 54 (5.22%) Active Directory
2 36 (3.48%) Docker
3 16 (1.55%) HDFS
3 16 (1.55%) Virtual Machines
4 6 (0.58%) Oracle RAC
5 5 (0.48%) Virtual Desktop
5 5 (0.48%) VMware Infrastructure
6 4 (0.39%) Apache Flume
7 3 (0.29%) Apache ZooKeeper
Systems Management
1 89 (8.60%) Terraform
2 65 (6.28%) Kubernetes
3 19 (1.84%) Ansible
4 14 (1.35%) Opscode Chef
5 7 (0.68%) Grafana
5 7 (0.68%) Prometheus
6 6 (0.58%) Puppet
7 5 (0.48%) Active Directory Federation Services
7 5 (0.48%) Hadoop YARN
7 5 (0.48%) Microsoft Clustering
7 5 (0.48%) Oozie
8 3 (0.29%) FortiGate
8 3 (0.29%) Kubeflow
9 2 (0.19%) Control-M
9 2 (0.19%) Kibana
9 2 (0.19%) logstash
9 2 (0.19%) Single Sign-On
10 1 (0.097%) Data Guard
Vendors
1 411 (39.71%) Databricks
2 270 (26.09%) Microsoft
3 72 (6.96%) Oracle
4 54 (5.22%) SAP
5 39 (3.77%) Google
5 39 (3.77%) Salesforce.com
6 35 (3.38%) Cloudera
7 32 (3.09%) Informatica
8 29 (2.80%) BiZZdesign
9 20 (1.93%) Talend
10 18 (1.74%) MuleSoft
11 17 (1.64%) Red Hat
12 16 (1.55%) Teradata
13 14 (1.35%) Alteryx
14 13 (1.26%) Hortonworks
15 12 (1.16%) StreamSets
16 10 (0.97%) Splunk
17 9 (0.87%) AppDynamics
17 9 (0.87%) Workday
18 8 (0.77%) ServiceNow