Period
to 20 November 2019

The table below provides summary statistics for contract job vacancies with a requirement for knowledge and experience of Databricks products and/or services. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Databricks over the 6 months to 20 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

The figures below represent the IT contractor job market in general and are not representative of contractor rates within Databricks.

Databricks
UK
6 months to
20 Nov 2019
Same period 2018 Same period 2017
Rank 477 855 896
Rank change year-on-year +378 +41 +3
Contract jobs citing Databricks 351 47 1
As % of all contract IT jobs advertised in the UK 0.42% 0.045% 0.001%
As % of the Vendors category 0.97% 0.11% 0.002%
Number of daily rates quoted 224 21 0
UK median daily rate £544 £525 -
Median daily rate % change year-on-year +3.57% - -
UK excluding London median daily rate £500 £438 -
% change year-on-year +14.29% - -
Number of hourly rates quoted 6 0 0
UK median hourly rate £72.50 - -
UK excluding London median hourly rate £72.50 - -

Databricks is in the Vendor Products and Services category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for knowledge or experience of vendor products and services.

All Vendors
UK
Contract vacancies with a requirement for knowledge or experience of vendor products and services 36,307 44,013 43,677
As % of all contract IT jobs advertised in the UK 43.46% 42.30% 42.70%
Number of daily rates quoted 22,740 27,297 27,110
UK median daily rate £450 £450 £430
Median daily rate % change year-on-year - +4.65% +2.38%
10th Percentile £233 £250 £235
90th Percentile £638 £625 £625
UK excluding London median daily rate £425 £425 £400
% change year-on-year - +6.25% +3.23%
Number of hourly rates quoted 1,485 1,671 1,461
UK median hourly rate £19.47 £17.50 £17.38
Median hourly rate % change year-on-year +11.23% +0.72% +2.21%
10th Percentile £11.25 £10.75 £10.57
90th Percentile £52.05 £47.09 £45.50
UK excluding London median hourly rate £18.00 £16.81 £16.50
% change year-on-year +7.08% +1.88% -

Databricks
Job Vacancy Trend

Job postings citing Databricks as a percentage of all IT jobs advertised.

Job vacancy trend for Databricks in the UK

Databricks
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Databricks.

Contractor daily rate trend for Databricks in the UK

Databricks
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Databricks over the 6 months to 20 November 2019.

Contractor daily rate histogram for Databricks in the UK

Databricks
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Databricks.

Contractor hourly rate trend for Databricks in the UK

Databricks
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Databricks over the 6 months to 20 November 2019.

Contractor hourly rate histogram for Databricks in the UK

Databricks
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Databricks within the UK over the 6 months to 20 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +367 339 £550 +4.76% 67
London +251 199 £550 - 32
UK excluding London +207 150 £500 +14.29% 37
South East +102 65 £490 -2.00% 24
Midlands - 26 £600 - 4
North of England +54 24 £583 +57.97% 6
West Midlands - 24 £588 -
South West - 18 £488 - 3
North West +28 13 £488 +21.88% 4
Yorkshire +45 9 £700 +107.41% 2
East of England +38 7 £450 -5.26% 1
Scotland - 7 £475 -
Wales - 3 £450 - 2
East Midlands - 2 £625 - 4
North East - 2 - -

For the 6 months to 20 November 2019, IT contractor jobs citing Databricks also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Databricks.

1 328 (93.45%) Azure
2 176 (50.14%) Azure Data Factory
3 169 (48.15%) Data Warehouse
4 158 (45.01%) SQL
5 156 (44.44%) Python
6 152 (43.30%) Microsoft
7 150 (42.74%) Data Lake
8 139 (39.60%) Business Intelligence
9 116 (33.05%) DevOps
10 114 (32.48%) Agile Software Development
11 109 (31.05%) Power BI
11 109 (31.05%) Power Platform
12 102 (29.06%) Apache Spark
13 99 (28.21%) Big Data
14 95 (27.07%) Azure SQL Database
15 92 (26.21%) Analytics
16 79 (22.51%) SQL Server
17 75 (21.37%) ETL
18 73 (20.80%) C#
18 73 (20.80%) Azure SQL Data Warehouse
19 65 (18.52%) SQL Server Analysis Services
20 63 (17.95%) SQL Server Integration Services
21 62 (17.66%) Data Engineering
22 60 (17.09%) Data Science
23 59 (16.81%) PySpark
24 55 (15.67%) Data Modelling
25 54 (15.38%) PowerShell
25 54 (15.38%) Serverless
26 52 (14.81%) Data Integration
27 51 (14.53%) Cosmos DB

Databricks
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 102 (29.06%) Apache Spark
2 37 (10.54%) Apache
3 10 (2.85%) Pachyderm
4 3 (0.85%) Apache Pig
4 3 (0.85%) SharePoint
5 1 (0.28%) Apache Airflow
5 1 (0.28%) Confluence
5 1 (0.28%) Jupyter
Applications
1 4 (1.14%) Microsoft Excel
Business Applications
1 6 (1.71%) SAP Oil and Gas
2 5 (1.42%) Dynamics CRM
3 1 (0.28%) NetSuite
Cloud Services
1 328 (93.45%) Azure
2 176 (50.14%) Azure Data Factory
3 109 (31.05%) Power Platform
4 54 (15.38%) Serverless
5 46 (13.11%) AWS
6 28 (7.98%) Azure Functions
7 24 (6.84%) PaaS
8 19 (5.41%) IaaS
9 17 (4.84%) Data Lake Analytics
9 17 (4.84%) GCP
9 17 (4.84%) iPaaS
9 17 (4.84%) SaaS
10 14 (3.99%) Amazon EMR
11 13 (3.70%) GitHub
12 12 (3.42%) Azure Machine Learning
13 6 (1.71%) Dynamics 365
14 5 (1.42%) Boomi
15 4 (1.14%) Amazon S3
16 3 (0.85%) AtomSphere
16 3 (0.85%) Cloud Computing
Communications & Networking
1 2 (0.57%) Internet
1 2 (0.57%) Software-Defined Networking
Database & Business Intelligence
1 169 (48.15%) Data Warehouse
2 150 (42.74%) Data Lake
3 109 (31.05%) Power BI
4 99 (28.21%) Big Data
5 95 (27.07%) Azure SQL Database
6 79 (22.51%) SQL Server
7 73 (20.80%) Azure SQL Data Warehouse
8 65 (18.52%) SQL Server Analysis Services
9 63 (17.95%) SQL Server Integration Services
10 51 (14.53%) Cosmos DB
11 42 (11.97%) Hadoop
12 36 (10.26%) SQL Server Reporting Services
13 28 (7.98%) SQL Server 2014
13 28 (7.98%) SQL Server 2017
14 27 (7.69%) Microsoft Analysis Services
15 21 (5.98%) Data Mart
16 15 (4.27%) Relational Database
17 14 (3.99%) Apache Hive
18 13 (3.70%) HDInsight
19 12 (3.42%) SAP HANA
Development Applications
1 43 (12.25%) Visual Studio Team System
2 34 (9.69%) Git (software)
3 23 (6.55%) Jenkins
4 8 (2.28%) JIRA
5 4 (1.14%) Artifactory
5 4 (1.14%) Pylint
5 4 (1.14%) tSQLt
6 3 (0.85%) Cucumber
6 3 (0.85%) Team Foundation Server
6 3 (0.85%) TeamCity
7 2 (0.57%) ER Studio
7 2 (0.57%) ERwin
7 2 (0.57%) Gatling
7 2 (0.57%) JMeter
7 2 (0.57%) PowerDesigner
7 2 (0.57%) Selenium
7 2 (0.57%) Visual Studio
7 2 (0.57%) WebDriver
8 1 (0.28%) GoCD
General
1 42 (11.97%) Finance
2 24 (6.84%) Public Sector
3 18 (5.13%) Legal
4 9 (2.56%) Retail
5 7 (1.99%) Banking
5 7 (1.99%) Publishing
6 5 (1.42%) Front Office
7 4 (1.14%) Local Government
8 3 (0.85%) Investment Banking
9 2 (0.57%) Manufacturing
9 2 (0.57%) Marketing
10 1 (0.28%) Advertising
10 1 (0.28%) Back Office
10 1 (0.28%) Corporate Banking
10 1 (0.28%) Games
10 1 (0.28%) Pharmaceutical
10 1 (0.28%) Retail Banking
Job Titles
1 107 (30.48%) Data Engineer
2 84 (23.93%) Azure Engineer
3 67 (19.09%) Architect
4 53 (15.10%) Developer
5 45 (12.82%) Azure Architect
5 45 (12.82%) DevOps Engineer
6 39 (11.11%) Data Architect
7 36 (10.26%) Azure Developer
8 34 (9.69%) Azure DevOps
8 34 (9.69%) Azure DevOps Engineer
9 24 (6.84%) Python Engineer
10 18 (5.13%) Business Intelligence Developer
11 16 (4.56%) Big Data Engineer
11 16 (4.56%) Integration Architect
12 15 (4.27%) Senior Data Engineer
13 13 (3.70%) Consultant
13 13 (3.70%) Lead DevOps
14 12 (3.42%) Azure Consultant
14 12 (3.42%) Data Scientist
15 10 (2.85%) Data Consultant
Libraries, Frameworks & Software Standards
1 59 (16.81%) PySpark
2 26 (7.41%) .NET
3 25 (7.12%) Web Services
4 23 (6.55%) MDX
5 22 (6.27%) Kafka
6 17 (4.84%) JSON
6 17 (4.84%) REST
6 17 (4.84%) SOAP
7 16 (4.56%) XML
8 14 (3.99%) Pandas
9 8 (2.28%) .NET Framework
9 8 (2.28%) HTML
9 8 (2.28%) HTML5
9 8 (2.28%) TensorFlow
10 7 (1.99%) Apache Avro
10 7 (1.99%) React
10 7 (1.99%) SparkR
11 6 (1.71%) Keras
11 6 (1.71%) scikit-learn
12 4 (1.14%) MLlib
Miscellaneous
1 30 (8.55%) Analytical Skills
2 19 (5.41%) Management Information System
3 12 (3.42%) Greenfield Project
4 11 (3.13%) Private Cloud
5 10 (2.85%) Public Cloud
6 7 (1.99%) Algorithms
7 6 (1.71%) User Experience
8 5 (1.42%) Data Structures
9 3 (0.85%) Life Science
9 3 (0.85%) Reference Data
9 3 (0.85%) Smart Meter
10 2 (0.57%) Enterprise Cloud
10 2 (0.57%) FMCG
10 2 (0.57%) Internet of Things
10 2 (0.57%) NHS
10 2 (0.57%) Self-Motivation
11 1 (0.28%) Enterprise Software
11 1 (0.28%) Hybrid Cloud
11 1 (0.28%) Marketing Technology
11 1 (0.28%) Virtual Team
Operating Systems
1 8 (2.28%) Windows
2 7 (1.99%) Linux
3 4 (1.14%) Red Hat Enterprise Linux
4 2 (0.57%) Unix
Processes & Methodologies
1 139 (39.60%) Business Intelligence
2 116 (33.05%) DevOps
3 114 (32.48%) Agile Software Development
4 92 (26.21%) Analytics
5 75 (21.37%) ETL
6 62 (17.66%) Data Engineering
7 60 (17.09%) Data Science
8 55 (15.67%) Data Modelling
9 52 (14.81%) Data Integration
10 51 (14.53%) Machine Learning
11 50 (14.25%) Scrum
12 44 (12.54%) Test Automation
13 40 (11.40%) Migration
13 40 (11.40%) Visualisation
14 39 (11.11%) Continuous Delivery
15 36 (10.26%) Computer Science
16 35 (9.97%) Master Data Management
17 34 (9.69%) Kanban
18 32 (9.12%) Data Architecture
18 32 (9.12%) Kimball Methodology
Programming Languages
1 158 (45.01%) SQL
2 156 (44.44%) Python
3 73 (20.80%) C#
4 54 (15.38%) PowerShell
5 48 (13.68%) Scala
6 29 (8.26%) T-SQL
7 27 (7.69%) R
8 16 (4.56%) Data Analysis Expressions (DAX)
9 13 (3.70%) JavaScript
10 12 (3.42%) Java
11 11 (3.13%) U-SQL
12 10 (2.85%) Julia
13 7 (1.99%) Go
14 4 (1.14%) Bash Shell
15 1 (0.28%) C
15 1 (0.28%) PL/SQL
15 1 (0.28%) Ruby
Qualifications
1 29 (8.26%) Degree
2 22 (6.27%) SC Cleared
2 22 (6.27%) Security Cleared
3 10 (2.85%) Master's Degree
4 8 (2.28%) Microsoft Certification
5 6 (1.71%) DBS Check
5 6 (1.71%) PhD
6 4 (1.14%) DV Cleared
7 1 (0.28%) CISSP
7 1 (0.28%) Computer Science Degree
Quality Assurance & Compliance
1 24 (6.84%) Data Quality
2 8 (2.28%) GDPR
3 6 (1.71%) QA
4 1 (0.28%) COBIT
4 1 (0.28%) GLBA
4 1 (0.28%) HIPAA
4 1 (0.28%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
4 1 (0.28%) NIST
4 1 (0.28%) PCI DSS
System Software
1 41 (11.68%) Docker
2 7 (1.99%) Virtual Machines
3 3 (0.85%) HDFS
4 2 (0.57%) VMware Infrastructure
5 1 (0.28%) Apache Flume
Systems Management
1 30 (8.55%) Kubernetes
2 24 (6.84%) Terraform
3 10 (2.85%) Kubeflow
4 4 (1.14%) Ansible
5 2 (0.57%) Hadoop YARN
6 1 (0.28%) CASB
6 1 (0.28%) IBM Guardium
Vendors
1 152 (43.30%) Microsoft
2 28 (7.98%) Tableau
3 26 (7.41%) Google
4 22 (6.27%) Informatica
5 13 (3.70%) SAP
6 12 (3.42%) Talend
7 11 (3.13%) Oracle
8 10 (2.85%) Alteryx
8 10 (2.85%) StreamSets
9 6 (1.71%) Salesforce.com
10 5 (1.42%) Dell
10 5 (1.42%) Twitter
11 4 (1.14%) Cloudera
11 4 (1.14%) Hortonworks
11 4 (1.14%) MapR
12 3 (0.85%) Splunk
13 2 (0.57%) Cisco
13 2 (0.57%) MuleSoft
13 2 (0.57%) VMware
14 1 (0.28%) Teradata