Period
to 22 January 2020

The table below provides summary statistics for contract job vacancies with a requirement for knowledge and experience of Databricks products and/or services. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Databricks over the 6 months to 22 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

The figures below represent the IT contractor job market in general and are not representative of contractor rates within Databricks.

Databricks
UK
6 months to
22 Jan 2020
Same period 2019 Same period 2018
Rank 484 808 879
Rank change year-on-year +324 +71 -11
Contract jobs citing Databricks 279 71 12
As % of all contract IT jobs advertised in the UK 0.38% 0.071% 0.012%
As % of the Vendors category 0.88% 0.17% 0.029%
Number of daily rates quoted 183 36 11
UK median daily rate £525 £525 £513
Median daily rate % change year-on-year - +2.44% +12.02%
10th Percentile £413 £335 £425
90th Percentile £675 £738 £588
UK excluding London median daily rate £493 £425 -
% change year-on-year +15.88% - -
Number of hourly rates quoted 2 0 0
UK median hourly rate £72.50 - -
UK excluding London median hourly rate £72.50 - -

Databricks is in the Vendor Products and Services category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for knowledge or experience of vendor products and services.

All Vendors
UK
Contract vacancies with a requirement for knowledge or experience of vendor products and services 31,588 42,158 41,876
As % of all contract IT jobs advertised in the UK 43.48% 42.30% 42.04%
Number of daily rates quoted 19,588 26,088 26,406
UK median daily rate £450 £450 £438
Median daily rate % change year-on-year - +2.86% +2.94%
10th Percentile £224 £258 £231
90th Percentile £638 £638 £625
UK excluding London median daily rate £425 £425 £400
% change year-on-year - +6.25% +1.27%
Number of hourly rates quoted 1,352 1,543 1,376
UK median hourly rate £19.00 £17.50 £17.43
Median hourly rate % change year-on-year +8.57% +0.40% +2.53%
10th Percentile £11.85 £10.75 £10.50
90th Percentile £51.75 £48.50 £45.00
UK excluding London median hourly rate £18.00 £16.50 £16.50
% change year-on-year +9.09% - -

Databricks
Job Vacancy Trend

Job postings citing Databricks as a percentage of all IT jobs advertised.

Job vacancy trend for Databricks in the UK

Databricks
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Databricks.

Contractor daily rate trend for Databricks in the UK

Databricks
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Databricks over the 6 months to 22 January 2020.

Contractor daily rate histogram for Databricks in the UK

Databricks
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Databricks.

Contractor hourly rate trend for Databricks in the UK

Databricks
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Databricks within the UK over the 6 months to 22 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +307 265 £538 +2.38% 76
London +230 167 £550 +2.33% 35
UK excluding London +187 110 £493 +15.88% 46
South East +105 54 £500 +8.11% 23
North of England +57 16 £663 +92.73% 7
Yorkshire +50 13 £675 +100.00% 4
Midlands - 13 £588 - 6
South West - 12 £470 - 4
West Midlands - 12 £600 - 6
Wales - 11 £450 -
East of England +38 2 £438 -7.89% 1
Scotland - 2 £425 - 5
North East - 2 - -
North West +20 1 £525 +40.00% 3
East Midlands - 1 £450 -

For the 6 months to 22 January 2020, IT contractor jobs citing Databricks also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Databricks.

1 259 (92.83%) Azure
2 134 (48.03%) SQL
3 131 (46.95%) Python
4 129 (46.24%) Microsoft
5 126 (45.16%) Azure Data Factory
6 124 (44.44%) Data Warehouse
7 122 (43.73%) Data Lake
8 101 (36.20%) Business Intelligence
9 86 (30.82%) DevOps
10 85 (30.47%) Azure SQL Database
11 84 (30.11%) Agile Software Development
12 79 (28.32%) Analytics
13 74 (26.52%) ETL
14 72 (25.81%) Power BI
14 72 (25.81%) Power Platform
15 67 (24.01%) Big Data
16 61 (21.86%) Apache Spark
17 59 (21.15%) Scala
18 58 (20.79%) SQL Server Integration Services
19 53 (19.00%) SQL Server
20 51 (18.28%) Data Modelling
21 47 (16.85%) C#
21 47 (16.85%) SQL Server Analysis Services
21 47 (16.85%) Serverless
22 46 (16.49%) Azure SQL Data Warehouse
22 46 (16.49%) Data Engineering
23 44 (15.77%) Cosmos DB
24 43 (15.41%) PySpark
25 40 (14.34%) Migration
25 40 (14.34%) Machine Learning

Databricks
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 61 (21.86%) Apache Spark
2 19 (6.81%) Apache
3 6 (2.15%) Apache Airflow
4 3 (1.08%) Apache Pig
4 3 (1.08%) SharePoint
5 2 (0.72%) Pachyderm
6 1 (0.36%) Elasticsearch
6 1 (0.36%) Jupyter
Applications
1 4 (1.43%) Microsoft Excel
Business Applications
1 5 (1.79%) Dynamics CRM
2 1 (0.36%) NetSuite
2 1 (0.36%) SAP Oil and Gas
Cloud Services
1 259 (92.83%) Azure
2 126 (45.16%) Azure Data Factory
3 72 (25.81%) Power Platform
4 47 (16.85%) Serverless
5 27 (9.68%) Azure Functions
6 22 (7.89%) AWS
7 20 (7.17%) PaaS
8 17 (6.09%) Data Lake Analytics
9 14 (5.02%) IaaS
10 13 (4.66%) Azure Machine Learning
11 11 (3.94%) iPaaS
11 11 (3.94%) SaaS
12 9 (3.23%) GitHub
13 8 (2.87%) GCP
14 6 (2.15%) Dynamics 365
15 4 (1.43%) Amazon EMR
16 3 (1.08%) Azure Active Directory
16 3 (1.08%) Office 365
17 2 (0.72%) AWS CloudFormation
17 2 (0.72%) Azure Stack
Database & Business Intelligence
1 124 (44.44%) Data Warehouse
2 122 (43.73%) Data Lake
3 85 (30.47%) Azure SQL Database
4 72 (25.81%) Power BI
5 67 (24.01%) Big Data
6 58 (20.79%) SQL Server Integration Services
7 53 (19.00%) SQL Server
8 47 (16.85%) SQL Server Analysis Services
9 46 (16.49%) Azure SQL Data Warehouse
10 44 (15.77%) Cosmos DB
11 31 (11.11%) SQL Server Reporting Services
12 25 (8.96%) Hadoop
13 19 (6.81%) Relational Database
14 15 (5.38%) Data Mart
15 14 (5.02%) Microsoft Analysis Services
16 11 (3.94%) PowerPivot
17 10 (3.58%) HDInsight
18 9 (3.23%) PowerCenter
18 9 (3.23%) RDBMS
19 6 (2.15%) Snowflake Schema
Development Applications
1 29 (10.39%) Git (software)
2 28 (10.04%) Jenkins
2 28 (10.04%) Visual Studio Team System
3 10 (3.58%) JIRA
4 6 (2.15%) Visual Studio
5 4 (1.43%) Artifactory
5 4 (1.43%) tSQLt
6 3 (1.08%) Team Foundation Server
7 2 (0.72%) JMeter
7 2 (0.72%) PyCharm
7 2 (0.72%) Pylint
7 2 (0.72%) SpecFlow
7 2 (0.72%) TeamCity
8 1 (0.36%) Ant
8 1 (0.36%) Cucumber
8 1 (0.36%) ER Studio
8 1 (0.36%) ERwin
8 1 (0.36%) GoCD
8 1 (0.36%) PowerDesigner
General
1 39 (13.98%) Finance
2 14 (5.02%) Legal
3 12 (4.30%) Retail
4 10 (3.58%) Public Sector
5 6 (2.15%) Banking
5 6 (2.15%) Front Office
5 6 (2.15%) Publishing
6 2 (0.72%) Games
6 2 (0.72%) Local Government
6 2 (0.72%) Marketing
7 1 (0.36%) Back Office
7 1 (0.36%) Corporate Banking
7 1 (0.36%) Investment Banking
7 1 (0.36%) Law
7 1 (0.36%) Manufacturing
7 1 (0.36%) Pharmaceutical
7 1 (0.36%) Retail Banking
Job Titles
1 83 (29.75%) Data Engineer
2 59 (21.15%) Azure Engineer
3 57 (20.43%) Architect
4 50 (17.92%) Developer
5 41 (14.70%) Data Architect
6 35 (12.54%) Azure Developer
7 32 (11.47%) Azure Architect
8 19 (6.81%) DevOps Engineer
9 18 (6.45%) Business Intelligence Developer
10 15 (5.38%) Azure DevOps Engineer
11 14 (5.02%) Python Engineer
11 14 (5.02%) Senior Data Engineer
12 13 (4.66%) Azure Consultant
12 13 (4.66%) Consultant
13 11 (3.94%) Solutions Architect
14 10 (3.58%) Big Data Engineer
14 10 (3.58%) Data Scientist
14 10 (3.58%) Integration Architect
15 9 (3.23%) Azure Specialist
15 9 (3.23%) C# Developer
Libraries, Frameworks & Software Standards
1 43 (15.41%) PySpark
2 20 (7.17%) MDX
3 15 (5.38%) .NET
3 15 (5.38%) Kafka
4 14 (5.02%) TensorFlow
5 11 (3.94%) Keras
5 11 (3.94%) REST
5 11 (3.94%) scikit-learn
5 11 (3.94%) SOAP
6 10 (3.58%) MLlib
6 10 (3.58%) Web Services
7 8 (2.87%) HTML
7 8 (2.87%) HTML5
7 8 (2.87%) JSON
8 7 (2.51%) React
8 7 (2.51%) XML
9 6 (2.15%) Pandas
10 5 (1.79%) SparkR
11 4 (1.43%) NumPy
12 2 (0.72%) Natural Language Processing
Miscellaneous
1 35 (12.54%) Analytical Skills
2 15 (5.38%) Management Information System
3 12 (4.30%) Greenfield Project
4 9 (3.23%) Data Structures
5 8 (2.87%) Private Cloud
6 7 (2.51%) Algorithms
6 7 (2.51%) Public Cloud
7 6 (2.15%) User Experience
8 3 (1.08%) FMCG
8 3 (1.08%) Reference Data
9 2 (0.72%) Self-Motivation
10 1 (0.36%) Enterprise Software
10 1 (0.36%) Hybrid Cloud
10 1 (0.36%) Marketing Technology
10 1 (0.36%) NHS
10 1 (0.36%) Smart Meter
10 1 (0.36%) Virtual Team
Operating Systems
1 9 (3.23%) Windows
2 8 (2.87%) Linux
3 4 (1.43%) Red Hat Enterprise Linux
4 1 (0.36%) Unix
4 1 (0.36%) Windows 10
4 1 (0.36%) Windows Server
Processes & Methodologies
1 101 (36.20%) Business Intelligence
2 86 (30.82%) DevOps
3 84 (30.11%) Agile Software Development
4 79 (28.32%) Analytics
5 74 (26.52%) ETL
6 51 (18.28%) Data Modelling
7 46 (16.49%) Data Engineering
8 40 (14.34%) Machine Learning
8 40 (14.34%) Migration
9 35 (12.54%) Visualisation
10 34 (12.19%) Data Architecture
11 33 (11.83%) Continuous Integration
11 33 (11.83%) Data Science
12 31 (11.11%) Computer Science
13 29 (10.39%) Data Visualisation
13 29 (10.39%) Kimball Methodology
14 28 (10.04%) Data Governance
15 27 (9.68%) Problem-Solving
16 25 (8.96%) Data Migration
16 25 (8.96%) Master Data Management
Programming Languages
1 134 (48.03%) SQL
2 131 (46.95%) Python
3 59 (21.15%) Scala
4 47 (16.85%) C#
5 26 (9.32%) PowerShell
6 19 (6.81%) R
7 18 (6.45%) T-SQL
8 16 (5.73%) Java
9 15 (5.38%) JavaScript
10 13 (4.66%) Data Analysis Expressions (DAX)
11 11 (3.94%) U-SQL
12 6 (2.15%) PL/SQL
13 5 (1.79%) VB
14 4 (1.43%) Bash Shell
15 2 (0.72%) Go
15 2 (0.72%) Julia
16 1 (0.36%) ANSI SQL
16 1 (0.36%) C
16 1 (0.36%) Ruby
Qualifications
1 24 (8.60%) Degree
2 11 (3.94%) SC Cleared
2 11 (3.94%) Security Cleared
3 10 (3.58%) Master's Degree
4 7 (2.51%) Microsoft Certification
5 6 (2.15%) DBS Check
5 6 (2.15%) PhD
6 2 (0.72%) CISSP
7 1 (0.36%) (ISC)2 CCSP
7 1 (0.36%) CCSP
7 1 (0.36%) Cisco Certification
7 1 (0.36%) CompTIA Security+
7 1 (0.36%) Computer Science Degree
Quality Assurance & Compliance
1 14 (5.02%) Data Quality
2 9 (3.23%) GDPR
3 5 (1.79%) QA
4 1 (0.36%) COBIT
4 1 (0.36%) GLBA
4 1 (0.36%) HIPAA
4 1 (0.36%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
4 1 (0.36%) NIST
4 1 (0.36%) PCI DSS
System Software
1 33 (11.83%) Docker
2 3 (1.08%) Virtual Machines
3 2 (0.72%) Active Directory
3 2 (0.72%) VMware Infrastructure
4 1 (0.36%) Apache Flume
Systems Management
1 24 (8.60%) Terraform
2 19 (6.81%) Kubernetes
3 9 (3.23%) Ansible
4 2 (0.72%) Kubeflow
5 1 (0.36%) CASB
5 1 (0.36%) IBM Guardium
5 1 (0.36%) Microsoft Intune
5 1 (0.36%) Puppet
5 1 (0.36%) Single Sign-On
Vendors
1 129 (46.24%) Microsoft
2 12 (4.30%) Informatica
2 12 (4.30%) Tableau
3 10 (3.58%) StreamSets
4 9 (3.23%) Cloudera
4 9 (3.23%) Hortonworks
4 9 (3.23%) MapR
5 7 (2.51%) Google
6 6 (2.15%) Alteryx
6 6 (2.15%) Oracle
7 4 (1.43%) SAP
7 4 (1.43%) Talend
8 2 (0.72%) ServiceNow
8 2 (0.72%) VMware
9 1 (0.36%) Cognos
9 1 (0.36%) MuleSoft
9 1 (0.36%) SnapLogic
9 1 (0.36%) Sybase
9 1 (0.36%) Teradata
9 1 (0.36%) Twitter