Period
to 19 October 2021

The table below provides summary statistics for contract job vacancies with a requirement for knowledge and experience of Databricks products and/or services. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Databricks over the 6 months to 19 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

The figures below represent the IT contractor job market in general and are not representative of contractor rates within Databricks.

Databricks
UK
6 months to
19 Oct 2021
Same period 2020 Same period 2019
Rank 192 261 510
Rank change year-on-year +69 +249 +349
Contract jobs citing Databricks 1,158 306 338
As % of all contract jobs advertised in the UK 1.38% 0.98% 0.40%
As % of the Vendors category 3.41% 2.23% 0.94%
Number of daily rates quoted 766 196 217
10th Percentile £413 £364 £423
25th Percentile £475 £413 £463
Median daily rate (50th Percentile) £550 £525 £538
Median % change year-on-year +4.76% -2.33% +2.38%
75th Percentile £643 £600 £625
90th Percentile £713 £650 £725
UK excluding London median daily rate £513 £500 £500
% change year-on-year +2.50% - -
Number of hourly rates quoted 1 0 5
Median hourly rate £90.90 - £72.50
UK excluding London median hourly rate - - £72.50

Databricks is in the Vendor Products and Services category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for knowledge or experience of vendor products and services.

All Vendors
UK
Contract vacancies with a requirement for knowledge or experience of vendor products and services 34,000 13,705 35,923
As % of all contract IT jobs advertised in the UK 40.38% 43.96% 42.52%
Number of daily rates quoted 22,119 8,836 22,924
10th Percentile £278 £260 £237
25th Percentile £400 £363 £356
Median daily rate (50th Percentile) £500 £475 £450
Median % change year-on-year +5.26% +5.56% -
75th Percentile £600 £575 £550
90th Percentile £700 £668 £638
UK excluding London median daily rate £450 £431 £425
% change year-on-year +4.41% +1.41% +1.19%
Number of hourly rates quoted 933 398 1,338
10th Percentile £11.51 £11.16 £11.17
25th Percentile £14.00 £14.00 £14.00
Median hourly rate £19.50 £21.75 £19.11
Median % change year-on-year -10.34% +13.84% +12.38%
75th Percentile £44.50 £44.88 £41.84
90th Percentile £63.00 £54.30 £51.00
UK excluding London median hourly rate £18.00 £20.00 £17.90
% change year-on-year -10.00% +11.73% +8.48%

Databricks
Job Vacancy Trend

Job postings citing Databricks as a proportion of all IT jobs advertised.

Job vacancy trend for Databricks in the UK

Databricks
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Databricks.

Daily rate trend for Databricks in the UK

Databricks
Daily Rate Histogram

Daily rate distribution for jobs citing Databricks over the 6 months to 19 October 2021.

Daily rate histogram for Databricks in the UK

Databricks
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Databricks.

Hourly rate trend for Databricks in the UK

Databricks
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Databricks within the UK over the 6 months to 19 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +51 881 £550 - 151
London +32 584 £575 +4.55% 79
Work from Home -11 390 £540 +2.86% 35
UK excluding London -28 248 £513 +2.50% 77
North of England -25 87 £500 - 25
South East -37 86 £538 -14.00% 17
Yorkshire -1 54 £475 +5.56% 8
Midlands -61 31 £500 +36.05% 18
North West -58 24 £500 -9.09% 15
West Midlands -52 17 £495 +1.54% 12
Scotland -79 17 £513 +30.16% 3
East Midlands -26 13 £520 +41.50% 6
South West -42 13 £475 -5.00% 10
North East - 9 £620 - 2
Wales -23 8 £500 +11.11%
East of England -41 6 £282 -44.30% 2

For the 6 months to 19 October 2021, IT contractor jobs citing Databricks also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Databricks.

1 1,029 (88.86%) Azure
2 674 (58.20%) SQL
3 564 (48.70%) Azure Data Factory
4 553 (47.75%) Python
5 537 (46.37%) Data Lake
6 467 (40.33%) DevOps
7 457 (39.46%) Analytics
8 371 (32.04%) Microsoft
9 367 (31.69%) Agile Software Development
10 342 (29.53%) Business Intelligence
10 342 (29.53%) Azure Synapse Analytics
11 319 (27.55%) Power Platform
12 317 (27.37%) Data Warehouse
13 300 (25.91%) Power BI
14 295 (25.47%) Data Modelling
15 257 (22.19%) Social Skills
16 237 (20.47%) Azure SQL Database
17 232 (20.03%) ETL
18 220 (19.00%) Data Pipeline
19 219 (18.91%) Apache Spark
20 198 (17.10%) Data Engineering
20 198 (17.10%) Big Data
21 188 (16.23%) Serverless
22 187 (16.15%) SQL Server
23 180 (15.54%) AWS
24 178 (15.37%) Scrum
25 154 (13.30%) Scala
26 153 (13.21%) PySpark
27 151 (13.04%) Azure Functions
28 150 (12.95%) Kafka

Databricks
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 219 (18.91%) Apache Spark
2 91 (7.86%) Apache Airflow
3 67 (5.79%) Apache
4 28 (2.42%) Luigi
5 20 (1.73%) SharePoint
6 11 (0.95%) SAS
7 9 (0.78%) Confluence
8 5 (0.43%) BizTalk Server
9 3 (0.26%) Apache Pig
10 2 (0.17%) Cloud Foundry
10 2 (0.17%) Elasticsearch
10 2 (0.17%) Jupyter
11 1 (0.086%) Apache Solr
11 1 (0.086%) Apache Synapse
11 1 (0.086%) Camunda
11 1 (0.086%) Oracle SOA Suite
Applications
1 12 (1.04%) Microsoft Excel
2 3 (0.26%) Microsoft PowerPoint
3 2 (0.17%) SPSS
4 1 (0.086%) Microsoft Office
Business Applications
1 9 (0.78%) SAP Oil and Gas
2 8 (0.69%) Dynamics CRM
3 3 (0.26%) SAP S/4HANA
4 1 (0.086%) Adobe Campaign
4 1 (0.086%) Maximo
4 1 (0.086%) SAP CRM
4 1 (0.086%) SAP ERP
4 1 (0.086%) Sparx Enterprise Architect
Cloud Services
1 1,029 (88.86%) Azure
2 564 (48.70%) Azure Data Factory
3 342 (29.53%) Azure Synapse Analytics
4 319 (27.55%) Power Platform
5 188 (16.23%) Serverless
6 180 (15.54%) AWS
7 151 (13.04%) Azure Functions
8 133 (11.49%) Azure Cosmos DB
9 86 (7.43%) PaaS
10 73 (6.30%) Azure Storage
11 58 (5.01%) Azure Stack
12 52 (4.49%) GitHub
12 52 (4.49%) IaaS
13 49 (4.23%) Amazon S3
13 49 (4.23%) Azure Key Vault
14 48 (4.15%) Azure Logic Apps
14 48 (4.15%) Azure Machine Learning
15 45 (3.89%) GCP
16 41 (3.54%) AWS Lambda
17 36 (3.11%) Azure Active Directory
Communications & Networking
1 15 (1.30%) FTP
2 11 (0.95%) Network Security
3 6 (0.52%) Cisco ASA
4 4 (0.35%) Firewall
5 2 (0.17%) DHCP
5 2 (0.17%) DNS
5 2 (0.17%) Internet
6 1 (0.086%) AMQP
6 1 (0.086%) HTTP
6 1 (0.086%) SSH
Database & Business Intelligence
1 537 (46.37%) Data Lake
2 317 (27.37%) Data Warehouse
3 300 (25.91%) Power BI
4 237 (20.47%) Azure SQL Database
5 198 (17.10%) Big Data
6 187 (16.15%) SQL Server
7 117 (10.10%) Azure SQL Data Warehouse
8 99 (8.55%) SQL Server Analysis Services
8 99 (8.55%) SQL Server Integration Services
9 89 (7.69%) NoSQL
10 87 (7.51%) Hadoop
11 76 (6.56%) Delta Lake
12 72 (6.22%) Microsoft Analysis Services
13 66 (5.70%) Metadata
13 66 (5.70%) SQL Server Reporting Services
14 58 (5.01%) Relational Database
14 58 (5.01%) Tableau
15 43 (3.71%) PostgreSQL
16 39 (3.37%) MongoDB
17 34 (2.94%) OLAP
Development Applications
1 103 (8.89%) Git (software)
2 56 (4.84%) Jenkins
3 38 (3.28%) JIRA
4 29 (2.50%) GitLab
5 25 (2.16%) PowerDesigner
6 22 (1.90%) Maven
7 21 (1.81%) TeamCity
8 20 (1.73%) Gradle
9 18 (1.55%) Visual Studio
10 13 (1.12%) Visual Studio Team System
11 11 (0.95%) MLflow
11 11 (0.95%) Subversion
12 9 (0.78%) ER Studio
12 9 (0.78%) ERwin
13 8 (0.69%) Cucumber
14 7 (0.60%) kappa
14 7 (0.60%) RStudio
15 6 (0.52%) git-flow
16 5 (0.43%) FitNesse
16 5 (0.43%) SpecFlow
General
1 257 (22.19%) Social Skills
2 142 (12.26%) Finance
3 118 (10.19%) Analytical Skills
4 77 (6.65%) Banking
5 52 (4.49%) Presentation Skills
6 46 (3.97%) Investment Banking
7 28 (2.42%) Public Sector
7 28 (2.42%) Retail
8 21 (1.81%) Marketing
9 18 (1.55%) Front Office
10 14 (1.21%) Documentation Skills
11 10 (0.86%) Financial Institution
11 10 (0.86%) Legal
11 10 (0.86%) Publishing
12 8 (0.69%) Back Office
13 7 (0.60%) Influencing Skills
14 6 (0.52%) Law
15 5 (0.43%) Pharmaceutical
16 4 (0.35%) Games
16 4 (0.35%) Telecoms
Job Titles
1 502 (43.35%) Data Engineer
2 377 (32.56%) Azure Engineer
3 189 (16.32%) Architect
4 113 (9.76%) Azure Architect
5 105 (9.07%) Data Architect
6 104 (8.98%) DevOps Engineer
7 90 (7.77%) Developer
8 87 (7.51%) Solutions Architect
9 69 (5.96%) Azure DevOps Engineer
10 63 (5.44%) Senior Data Engineer
11 60 (5.18%) Python Engineer
12 58 (5.01%) Platform Engineer
13 42 (3.63%) Analyst
14 39 (3.37%) Azure Developer
15 33 (2.85%) Consultant
16 32 (2.76%) Cloud Architect
17 25 (2.16%) Data Scientist
18 23 (1.99%) Azure DevOps
18 23 (1.99%) Data Analyst
19 22 (1.90%) Business Analyst
Libraries, Frameworks & Software Standards
1 153 (13.21%) PySpark
2 150 (12.95%) Kafka
3 83 (7.17%) .NET
4 76 (6.56%) ARM Templates
5 54 (4.66%) JSON
6 37 (3.20%) Spark Streaming
7 36 (3.11%) RESTful
8 28 (2.42%) .NET Framework
8 28 (2.42%) REST
9 26 (2.25%) ASP.NET
10 25 (2.16%) YAML
11 22 (1.90%) Pandas
12 20 (1.73%) XML
13 19 (1.64%) NumPy
13 19 (1.64%) Velocity
14 17 (1.47%) .NET Core
15 15 (1.30%) AngularJS
15 15 (1.30%) Entity Framework
16 14 (1.21%) ADO
16 14 (1.21%) TensorFlow
Miscellaneous
1 46 (3.97%) Data Structures
2 39 (3.37%) Cloud Native
3 28 (2.42%) Public Cloud
4 21 (1.81%) Greenfield Project
4 21 (1.81%) Management Information System
5 20 (1.73%) Algorithms
6 18 (1.55%) Data Protection Act
6 18 (1.55%) Enterprise Software
7 15 (1.30%) Legacy Systems
8 14 (1.21%) Self-Motivation
9 13 (1.12%) Data Centre
9 13 (1.12%) NHS
9 13 (1.12%) Virtual Team
10 12 (1.04%) User Experience
11 7 (0.60%) Replication
12 6 (0.52%) Hedge funds
12 6 (0.52%) Linux Command Line
13 5 (0.43%) iPad
13 5 (0.43%) Linked Data
14 4 (0.35%) FMCG
Operating Systems
1 25 (2.16%) Linux
1 25 (2.16%) Windows
2 15 (1.30%) Unix
3 11 (0.95%) Windows Server
4 10 (0.86%) VMS
5 5 (0.43%) Red Hat Enterprise Linux
6 1 (0.086%) Android
6 1 (0.086%) Apple iOS
6 1 (0.086%) Ubuntu
Processes & Methodologies
1 467 (40.33%) DevOps
2 457 (39.46%) Analytics
3 367 (31.69%) Agile Software Development
4 342 (29.53%) Business Intelligence
5 295 (25.47%) Data Modelling
6 232 (20.03%) ETL
7 220 (19.00%) Data Pipeline
8 198 (17.10%) Data Engineering
9 178 (15.37%) Scrum
10 131 (11.31%) Data Science
11 103 (8.89%) Data Transformation
12 96 (8.29%) Migration
13 91 (7.86%) Machine Learning
13 91 (7.86%) Visualisation
14 85 (7.34%) Data Analytics
15 83 (7.17%) Data Ingestion
15 83 (7.17%) Infrastructure as Code
16 82 (7.08%) Problem-Solving
17 76 (6.56%) Stakeholder Management
18 75 (6.48%) Computer Science
Programming Languages
1 674 (58.20%) SQL
2 553 (47.75%) Python
3 154 (13.30%) Scala
4 131 (11.31%) PowerShell
5 113 (9.76%) C#
6 92 (7.94%) Java
7 68 (5.87%) T-SQL
8 52 (4.49%) Bash Shell
9 41 (3.54%) R
10 37 (3.20%) JavaScript
11 21 (1.81%) Data Analysis Expressions (DAX)
12 10 (0.86%) PL/SQL
13 8 (0.69%) C
13 8 (0.69%) Shell Script
13 8 (0.69%) TypeScript
14 7 (0.60%) U-SQL
15 6 (0.52%) C++
15 6 (0.52%) COBOL
16 3 (0.26%) Groovy
16 3 (0.26%) HiveQL
Qualifications
1 75 (6.48%) Degree
2 43 (3.71%) Security Cleared
3 38 (3.28%) SC Cleared
4 30 (2.59%) Computer Science Degree
5 16 (1.38%) BPSS Clearance
6 14 (1.21%) Numerate Degree
7 13 (1.12%) Master's Degree
8 9 (0.78%) Microsoft Certification
9 8 (0.69%) DV Cleared
9 8 (0.69%) ISEB
10 5 (0.43%) DBS Check
11 3 (0.26%) BC Cleared
11 3 (0.26%) TOGAF Certification
12 2 (0.17%) ISTQB
13 1 (0.086%) PhD
Quality Assurance & Compliance
1 72 (6.22%) Data Quality
2 26 (2.25%) QA
3 24 (2.07%) GDPR
4 9 (0.78%) Sarbanes-Oxley
5 5 (0.43%) SLA
6 4 (0.35%) SNOMED CT
7 3 (0.26%) IFRS
8 1 (0.086%) Disclosure Scotland
8 1 (0.086%) HL7
8 1 (0.086%) PCI DSS
8 1 (0.086%) PMO
8 1 (0.086%) Solvency II
System Software
1 64 (5.53%) Docker
2 31 (2.68%) Active Directory
3 13 (1.12%) HDFS
4 12 (1.04%) Virtual Machines
Systems Management
1 99 (8.55%) Kubernetes
2 91 (7.86%) Terraform
3 29 (2.50%) Ansible
4 12 (1.04%) Oozie
5 9 (0.78%) Puppet
6 8 (0.69%) Opscode Chef
7 7 (0.60%) Active Directory Federation Services
8 6 (0.52%) FortiGate
9 5 (0.43%) Kubeflow
10 2 (0.17%) Grafana
11 1 (0.086%) Control-M
11 1 (0.086%) Istio
11 1 (0.086%) Salt
Vendors
1 371 (32.04%) Microsoft
2 53 (4.58%) SAP
3 44 (3.80%) Salesforce.com
4 34 (2.94%) Oracle
5 29 (2.50%) BiZZdesign
6 26 (2.25%) Alteryx
7 22 (1.90%) Google
8 20 (1.73%) MuleSoft
9 16 (1.38%) Informatica
10 15 (1.30%) IBM
10 15 (1.30%) StreamSets
11 14 (1.21%) Cloudera
12 12 (1.04%) Atlassian
13 8 (0.69%) Hortonworks
14 6 (0.52%) CheckPoint
14 6 (0.52%) Cisco
15 5 (0.43%) New Relic
15 5 (0.43%) PagerDuty
15 5 (0.43%) Workday
16 4 (0.35%) Brio