Period
to 14 May 2021

The table below provides summary statistics for contract job vacancies with a requirement for knowledge and experience of Databricks products and/or services. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Databricks over the 6 months to 14 May 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

The figures below represent the IT contractor job market in general and are not representative of contractor rates within Databricks.

Databricks
UK
6 months to
14 May 2021
Same period 2020 Same period 2019
Rank 240 459 685
Rank change year-on-year +219 +226 +187
Contract jobs citing Databricks 617 191 166
As % of all contract jobs advertised in the UK 1.08% 0.38% 0.18%
As % of the Vendors category 2.61% 0.89% 0.43%
Number of daily rates quoted 392 134 88
10th Percentile £400 £385 £346
25th Percentile £450 £419 £414
Median daily rate (50th Percentile) £525 £500 £525
Median % change year-on-year +5.00% -4.76% -2.33%
75th Percentile £600 £638 £613
90th Percentile £686 £675 £690
UK excluding London median daily rate £513 £481 £450
% change year-on-year +6.49% +6.94% -10.00%
Number of hourly rates quoted 4 1 0
Median hourly rate £38.25 £27.43 -
Median % change year-on-year +39.47% - -
UK excluding London median hourly rate £26.00 £27.43 -
% change year-on-year -5.20% - -

Databricks is in the Vendor Products and Services category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for knowledge or experience of vendor products and services.

All Vendors
UK
Contract vacancies with a requirement for knowledge or experience of vendor products and services 23,610 21,373 38,199
As % of all contract IT jobs advertised in the UK 41.32% 42.38% 41.86%
Number of daily rates quoted 15,121 13,324 24,082
10th Percentile £281 £225 £263
25th Percentile £381 £356 £363
Median daily rate (50th Percentile) £475 £450 £460
Median % change year-on-year +5.56% -2.17% +2.22%
75th Percentile £575 £563 £563
90th Percentile £675 £652 £645
UK excluding London median daily rate £427 £430 £425
% change year-on-year -0.81% +1.18% +3.03%
Number of hourly rates quoted 724 874 1,242
10th Percentile £11.27 £11.88 £10.88
25th Percentile £14.50 £14.50 £13.00
Median hourly rate £22.00 £19.00 £18.00
Median % change year-on-year +15.79% +5.56% +5.11%
75th Percentile £45.00 £33.75 £36.63
90th Percentile £58.35 £52.21 £49.22
UK excluding London median hourly rate £18.50 £18.00 £17.00
% change year-on-year +2.78% +5.88% +7.26%

Databricks
Job Vacancy Trend

Job postings citing Databricks as a proportion of all IT jobs advertised.

Job vacancy trend for Databricks in the UK

Databricks
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Databricks.

Daily rate trend for Databricks in the UK

Databricks
Daily Rate Histogram

Daily rate distribution for jobs citing Databricks over the 6 months to 14 May 2021.

Daily rate histogram for Databricks in the UK

Databricks
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Databricks.

Hourly rate trend for Databricks in the UK

Databricks
Hourly Rate Histogram

Hourly rate distribution of jobs citing Databricks over the 6 months to 14 May 2021.

Hourly rate histogram for Databricks in the UK

Databricks
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Databricks within the UK over the 6 months to 14 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +192 481 £525 +4.22% 125
London +138 334 £525 -4.55% 55
Work from Home -67 224 £515 -0.72% 45
UK excluding London +73 119 £513 +6.49% 72
North of England +59 44 £550 +7.32% 21
South East +29 36 £525 +5.00% 25
Yorkshire +42 27 £550 +15.79% 11
Midlands +14 19 £450 -5.26% 16
North West +25 14 £475 -20.83% 9
West Midlands +6 13 £450 -5.26% 11
East of England +35 5 £282 -35.54% 8
Scotland - 5 £406 - 2
South West +39 4 £525 +2.44%
North East - 4 £628 - 1
East Midlands +15 3 £475 +5.56% 5
Wales -1 3 £506 +12.50%
Northern Ireland - 3 £675 -

For the 6 months to 14 May 2021, IT contractor jobs citing Databricks also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Databricks.

1 543 (88.01%) Azure
2 317 (51.38%) SQL
3 291 (47.16%) Python
4 279 (45.22%) Azure Data Factory
5 247 (40.03%) Data Lake
6 228 (36.95%) Analytics
7 223 (36.14%) Agile Software Development
8 222 (35.98%) DevOps
9 198 (32.09%) Azure Synapse Analytics
10 196 (31.77%) Microsoft
11 192 (31.12%) Data Warehouse
12 176 (28.53%) Data Modelling
13 172 (27.88%) Business Intelligence
14 163 (26.42%) Data Engineering
15 161 (26.09%) Power Platform
16 150 (24.31%) ETL
17 149 (24.15%) Social Skills
18 148 (23.99%) Power BI
19 134 (21.72%) Apache Spark
20 123 (19.94%) Azure SQL Database
21 115 (18.64%) Serverless
22 108 (17.50%) Big Data
23 105 (17.02%) Data Pipeline
24 101 (16.37%) Scrum
25 98 (15.88%) Finance
26 97 (15.72%) SQL Server
27 89 (14.42%) Azure Functions
27 89 (14.42%) PySpark
28 81 (13.13%) Azure Cosmos DB
29 80 (12.97%) AWS

Databricks
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 134 (21.72%) Apache Spark
2 60 (9.72%) Apache Airflow
3 59 (9.56%) Apache
4 20 (3.24%) SharePoint
5 5 (0.81%) Elasticsearch
6 4 (0.65%) SAS
7 3 (0.49%) Confluence
7 3 (0.49%) IIS
8 1 (0.16%) Apache Solr
8 1 (0.16%) Luigi
Applications
1 2 (0.32%) Microsoft PowerPoint
1 2 (0.32%) MS Visio
Business Applications
1 7 (1.13%) Dynamics CRM
2 5 (0.81%) SAP Oil and Gas
3 3 (0.49%) Aligne
4 1 (0.16%) Oracle EBS
Cloud Services
1 543 (88.01%) Azure
2 279 (45.22%) Azure Data Factory
3 198 (32.09%) Azure Synapse Analytics
4 161 (26.09%) Power Platform
5 115 (18.64%) Serverless
6 89 (14.42%) Azure Functions
7 81 (13.13%) Azure Cosmos DB
8 80 (12.97%) AWS
9 50 (8.10%) Azure Storage
10 36 (5.83%) GCP
11 32 (5.19%) GitHub
12 27 (4.38%) PaaS
13 26 (4.21%) Azure Logic Apps
13 26 (4.21%) Azure Stack
14 24 (3.89%) Azure Key Vault
15 21 (3.40%) AWS Lambda
16 19 (3.08%) Azure Machine Learning
17 16 (2.59%) Azure Active Directory
18 14 (2.27%) PowerApps
19 13 (2.11%) Azure Sentinel
Communications & Networking
1 5 (0.81%) Kerberos
1 5 (0.81%) SSL
2 3 (0.49%) TCP/IP
2 3 (0.49%) VPN
3 1 (0.16%) FTP
Database & Business Intelligence
1 247 (40.03%) Data Lake
2 192 (31.12%) Data Warehouse
3 148 (23.99%) Power BI
4 123 (19.94%) Azure SQL Database
5 108 (17.50%) Big Data
6 97 (15.72%) SQL Server
7 71 (11.51%) Azure SQL Data Warehouse
7 71 (11.51%) NoSQL
8 62 (10.05%) SQL Server Integration Services
9 58 (9.40%) SQL Server Analysis Services
10 43 (6.97%) SQL Server Reporting Services
10 43 (6.97%) Tableau
11 36 (5.83%) Microsoft Analysis Services
12 29 (4.70%) Apache Hive
13 25 (4.05%) Enterprise Data Warehouse
14 23 (3.73%) MongoDB
15 21 (3.40%) OLTP
15 21 (3.40%) Relational Database
16 20 (3.24%) OLAP
17 19 (3.08%) Hadoop
Development Applications
1 74 (11.99%) Git (software)
2 57 (9.24%) Jenkins
3 38 (6.16%) JIRA
4 22 (3.57%) PowerDesigner
5 15 (2.43%) Visual Studio Team System
6 12 (1.94%) kappa
7 11 (1.78%) GitLab
8 6 (0.97%) Maven
8 6 (0.97%) MLflow
8 6 (0.97%) TeamCity
9 5 (0.81%) RStudio
10 4 (0.65%) Cucumber
10 4 (0.65%) Liquibase
10 4 (0.65%) SpecFlow
11 3 (0.49%) Artifactory
11 3 (0.49%) Postman
11 3 (0.49%) Subversion
11 3 (0.49%) Visual Studio
11 3 (0.49%) VisualSVN
12 2 (0.32%) Sourcetree
General
1 149 (24.15%) Social Skills
2 98 (15.88%) Finance
3 52 (8.43%) Analytical Skills
4 41 (6.65%) Banking
5 23 (3.73%) Public Sector
6 20 (3.24%) Retail
7 19 (3.08%) Presentation Skills
8 18 (2.92%) Front Office
9 10 (1.62%) Investment Banking
10 8 (1.30%) Marketing
11 7 (1.13%) Back Office
11 7 (1.13%) Publishing
12 6 (0.97%) Documentation Skills
13 5 (0.81%) Games
13 5 (0.81%) Manufacturing
13 5 (0.81%) Retail Banking
14 3 (0.49%) Telecoms
15 1 (0.16%) Electronics
15 1 (0.16%) Financial Institution
15 1 (0.16%) Legal
Job Titles
1 270 (43.76%) Data Engineer
2 170 (27.55%) Azure Engineer
3 117 (18.96%) Architect
4 88 (14.26%) Data Architect
5 78 (12.64%) Azure Architect
6 54 (8.75%) Developer
7 46 (7.46%) Python Engineer
8 37 (6.00%) Analyst
9 36 (5.83%) Solutions Architect
10 20 (3.24%) Senior Data Engineer
11 19 (3.08%) Data Scientist
12 18 (2.92%) Azure Developer
12 18 (2.92%) Data Analyst
13 17 (2.76%) Consultant
14 15 (2.43%) Business Analyst
14 15 (2.43%) DevOps Engineer
15 14 (2.27%) Big Data Engineer
15 14 (2.27%) Scrum Master
16 12 (1.94%) Scala Engineer
17 11 (1.78%) Azure DevOps Engineer
Libraries, Frameworks & Software Standards
1 89 (14.42%) PySpark
2 76 (12.32%) Kafka
3 27 (4.38%) .NET
4 23 (3.73%) Velocity
5 20 (3.24%) Spark Streaming
6 19 (3.08%) JSON
7 12 (1.94%) Pandas
8 11 (1.78%) NumPy
9 10 (1.62%) XML
10 8 (1.30%) ADO
10 8 (1.30%) Apache Avro
11 7 (1.13%) AngularJS
11 7 (1.13%) J2EE
11 7 (1.13%) scikit-learn
12 6 (0.97%) Highcharts JS
12 6 (0.97%) Matplotlib
12 6 (0.97%) Redux
12 6 (0.97%) RESTful
12 6 (0.97%) YAML
13 5 (0.81%) Entity Framework
Miscellaneous
1 28 (4.54%) Greenfield Project
2 19 (3.08%) Algorithms
2 19 (3.08%) Cloud Native
3 18 (2.92%) NHS
4 15 (2.43%) Data Structures
5 10 (1.62%) iPad
5 10 (1.62%) Self-Motivation
6 9 (1.46%) Replication
7 8 (1.30%) Virtual Team
8 6 (0.97%) Management Information System
8 6 (0.97%) Public Cloud
9 5 (0.81%) Reinsurance
10 4 (0.65%) BYOD
11 3 (0.49%) Data Centre
11 3 (0.49%) Enterprise Software
11 3 (0.49%) Market Risk
11 3 (0.49%) Reference Data
11 3 (0.49%) User Experience
12 2 (0.32%) Hedge funds
13 1 (0.16%) FMCG
Operating Systems
1 16 (2.59%) Linux
2 7 (1.13%) Unix
3 2 (0.32%) Windows
4 1 (0.16%) Android
4 1 (0.16%) Apple iOS
4 1 (0.16%) Ubuntu
4 1 (0.16%) Windows Server
Processes & Methodologies
1 228 (36.95%) Analytics
2 223 (36.14%) Agile Software Development
3 222 (35.98%) DevOps
4 176 (28.53%) Data Modelling
5 172 (27.88%) Business Intelligence
6 163 (26.42%) Data Engineering
7 150 (24.31%) ETL
8 105 (17.02%) Data Pipeline
9 101 (16.37%) Scrum
10 67 (10.86%) Data Science
11 66 (10.70%) Data Architecture
12 59 (9.56%) Migration
13 55 (8.91%) Machine Learning
14 53 (8.59%) Data Integration
14 53 (8.59%) Data Management
15 50 (8.10%) Stakeholder Management
15 50 (8.10%) Visualisation
16 42 (6.81%) Artificial Intelligence
17 41 (6.65%) Problem-Solving
18 39 (6.32%) Data Ingestion
Programming Languages
1 317 (51.38%) SQL
2 291 (47.16%) Python
3 66 (10.70%) Scala
4 62 (10.05%) Java
5 47 (7.62%) T-SQL
6 38 (6.16%) R
7 37 (6.00%) C#
8 34 (5.51%) PowerShell
9 14 (2.27%) JavaScript
10 8 (1.30%) Bash Shell
11 7 (1.13%) TypeScript
12 6 (0.97%) C
12 6 (0.97%) Data Analysis Expressions (DAX)
13 5 (0.81%) PL/SQL
14 4 (0.65%) Groovy
15 3 (0.49%) Perl
15 3 (0.49%) U-SQL
16 2 (0.32%) VBA
17 1 (0.16%) COBOL
17 1 (0.16%) Go
Qualifications
1 24 (3.89%) Degree
1 24 (3.89%) Security Cleared
2 23 (3.73%) SC Cleared
3 11 (1.78%) ISEB
4 5 (0.81%) Computer Science Degree
4 5 (0.81%) DV Cleared
4 5 (0.81%) PhD
5 3 (0.49%) DBS Check
6 1 (0.16%) AWS Certification
6 1 (0.16%) BPSS Clearance
6 1 (0.16%) Master's Degree
6 1 (0.16%) MBCS
6 1 (0.16%) Microsoft Certification
6 1 (0.16%) TOGAF Certification
Quality Assurance & Compliance
1 52 (8.43%) Data Quality
2 24 (3.89%) QA
3 3 (0.49%) GDPR
4 1 (0.16%) PCI DSS
System Software
1 33 (5.35%) Docker
2 9 (1.46%) Active Directory
3 6 (0.97%) HDFS
4 5 (0.81%) Virtual Machines
Systems Management
1 59 (9.56%) Terraform
2 27 (4.38%) Kubernetes
3 15 (2.43%) Ansible
4 12 (1.94%) Oozie
5 7 (1.13%) Opscode Chef
6 4 (0.65%) Puppet
7 2 (0.32%) Kibana
7 2 (0.32%) Kubeflow
8 1 (0.16%) Hadoop YARN
8 1 (0.16%) Istio
8 1 (0.16%) Oracle RMAN
8 1 (0.16%) Single Sign-On
Vendors
1 196 (31.77%) Microsoft
2 27 (4.38%) BiZZdesign
3 18 (2.92%) SAP
4 13 (2.11%) MuleSoft
5 10 (1.62%) Alteryx
5 10 (1.62%) IBM
5 10 (1.62%) Oracle
6 9 (1.46%) Salesforce.com
7 8 (1.30%) Google
7 8 (1.30%) Talend
8 7 (1.13%) Atlassian
8 7 (1.13%) Cloudera
8 7 (1.13%) Splunk
9 6 (0.97%) Adobe
10 5 (0.81%) Confluent
10 5 (0.81%) Teradata
11 4 (0.65%) Cognizant
12 3 (0.49%) GoldenSource
12 3 (0.49%) Micro Focus
12 3 (0.49%) RedGate