Period
to 19 August 2019

The table below provides summary statistics for contract job vacancies with a requirement for knowledge and experience of Databricks products and/or services. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Databricks over the 6 months to 19 August 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

The figures below represent the IT contractor job market in general and are not representative of contractor rates within Databricks.

Databricks
UK
6 months to
19 Aug 2019
Same period 2018 Same period 2017
Rank 556 857 -
Rank change year-on-year +301 - -
Contract jobs citing Databricks 293 46 0
As % of all contract IT jobs advertised in the UK 0.33% 0.045% -
As % of the Vendors category 0.76% 0.11% -
Number of daily rates quoted 173 22 0
UK median daily rate £525 £575 -
Median daily rate % change year-on-year -8.70% - -
UK excluding London median daily rate £500 £500 -
Number of hourly rates quoted 5 0 0
UK median hourly rate £72.50 - -
UK excluding London median hourly rate £72.50 - -

Databricks is in the Vendor Products and Services category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for knowledge or experience of vendor products and services.

All Vendors
UK
Contract vacancies with a requirement for knowledge or experience of vendor products and services 38,603 42,720 42,168
As % of all contract IT jobs advertised in the UK 42.82% 41.79% 43.71%
Number of daily rates quoted 24,084 26,453 25,781
UK median daily rate £450 £450 £430
Median daily rate % change year-on-year - +4.65% +4.24%
10th Percentile £250 £250 £250
90th Percentile £638 £625 £610
UK excluding London median daily rate £425 £415 £400
% change year-on-year +2.41% +3.75% +3.23%
Number of hourly rates quoted 1,441 1,574 1,395
UK median hourly rate £19.50 £17.50 £17.25
Median hourly rate % change year-on-year +11.43% +1.45% -1.43%
10th Percentile £11.17 £11.01 £10.50
90th Percentile £51.00 £46.93 £47.50
UK excluding London median hourly rate £18.00 £16.50 £16.50
% change year-on-year +9.09% - -5.04%

Databricks
Job Vacancy Trend

Job postings citing Databricks as a percentage of all IT jobs advertised.

Job vacancy trend for Databricks in the UK

Databricks
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Databricks.

Contractor daily rate trend for Databricks in the UK

Databricks
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Databricks over the 6 months to 19 August 2019.

Contractor daily rate histogram for Databricks in the UK

Databricks
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Databricks.

Contractor hourly rate trend for Databricks in the UK

Databricks
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Databricks over the 6 months to 19 August 2019.

Contractor hourly rate histogram for Databricks in the UK

Databricks
Top 14 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Databricks within the UK over the 6 months to 19 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +286 282 £550 -4.35% 68
London +167 157 £550 -8.33% 28
UK excluding London +149 132 £500 - 45
South East +72 52 £485 -3.00% 20
Midlands - 33 £500 - 4
North of England - 22 £550 - 8
West Midlands - 17 £500 - 3
East Midlands - 16 £533 - 1
North West - 16 £450 - 5
East of England +29 12 £475 - 3
South West - 10 £575 - 5
Scotland - 6 £475 - 5
Yorkshire - 3 £588 - 2
Wales - 1 £580 -

For the 6 months to 19 August 2019, IT contractor jobs citing Databricks also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Databricks.

1 277 (94.54%) Microsoft Azure
2 151 (51.54%) SQL
2 151 (51.54%) Data Warehouse
3 139 (47.44%) Python
4 129 (44.03%) Azure Data Factory
5 118 (40.27%) Data Lake
6 111 (37.88%) Business Intelligence
7 108 (36.86%) Microsoft
8 103 (35.15%) Apache Spark
9 98 (33.45%) Agile Software Development
10 96 (32.76%) Big Data
11 86 (29.35%) DevOps
12 83 (28.33%) Analytics
13 81 (27.65%) Power BI
13 81 (27.65%) Power Platform
14 72 (24.57%) Azure SQL Data Warehouse
15 70 (23.89%) ETL
16 69 (23.55%) Azure SQL Database
17 66 (22.53%) C#
18 64 (21.84%) SQL Server
18 64 (21.84%) Data Science
19 57 (19.45%) Hadoop
20 51 (17.41%) Data Engineering
21 48 (16.38%) PySpark
22 47 (16.04%) SQL Server Analysis Services
22 47 (16.04%) Amazon AWS
23 46 (15.70%) Finance
24 45 (15.36%) Apache
25 43 (14.68%) PowerShell
26 40 (13.65%) Test Automation

Databricks
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 103 (35.15%) Apache Spark
2 45 (15.36%) Apache
3 12 (4.10%) Pachyderm
4 4 (1.37%) SharePoint
5 3 (1.02%) Elasticsearch
6 1 (0.34%) Apache Solr
6 1 (0.34%) ArcGIS
6 1 (0.34%) Confluence
Applications
1 2 (0.68%) Chatbot
2 1 (0.34%) Microsoft Excel
Business Applications
1 8 (2.73%) SAP Oil and Gas
Cloud Services
1 277 (94.54%) Microsoft Azure
2 129 (44.03%) Azure Data Factory
3 81 (27.65%) Power Platform
4 47 (16.04%) Amazon AWS
5 28 (9.56%) Serverless
6 21 (7.17%) Amazon EMR
7 17 (5.80%) Google Cloud Platform
8 14 (4.78%) Data Lake Analytics
9 13 (4.44%) Azure Functions
10 11 (3.75%) PaaS
11 10 (3.41%) IaaS
11 10 (3.41%) SaaS
12 9 (3.07%) Azure Machine Learning
12 9 (3.07%) iPaaS
13 7 (2.39%) Cloud Computing
14 5 (1.71%) Amazon S3
14 5 (1.71%) GitHub
15 4 (1.37%) Boomi
16 3 (1.02%) AtomSphere
17 2 (0.68%) Qubole
Communications & Networking
1 2 (0.68%) Internet
1 2 (0.68%) Software-Defined Networking
Database & Business Intelligence
1 151 (51.54%) Data Warehouse
2 118 (40.27%) Data Lake
3 96 (32.76%) Big Data
4 81 (27.65%) Power BI
5 72 (24.57%) Azure SQL Data Warehouse
6 69 (23.55%) Azure SQL Database
7 64 (21.84%) SQL Server
8 57 (19.45%) Hadoop
9 47 (16.04%) SQL Server Analysis Services
10 38 (12.97%) Cosmos DB
10 38 (12.97%) SQL Server Integration Services
11 26 (8.87%) SQL Server 2017
12 25 (8.53%) SQL Server 2014
13 24 (8.19%) Microsoft Analysis Services
14 23 (7.85%) Apache Hive
15 19 (6.48%) HDInsight
15 19 (6.48%) SQL Server Reporting Services
16 18 (6.14%) Spark SQL
17 16 (5.46%) NoSQL
18 15 (5.12%) SAP HANA
Development Applications
1 35 (11.95%) Visual Studio Team System
2 22 (7.51%) Git (software)
3 7 (2.39%) Jenkins
4 5 (1.71%) JIRA
5 4 (1.37%) Pylint
6 3 (1.02%) Cucumber
6 3 (1.02%) Team Foundation Server
6 3 (1.02%) TeamCity
7 2 (0.68%) ERwin
7 2 (0.68%) Gatling
7 2 (0.68%) JMeter
7 2 (0.68%) Selenium
7 2 (0.68%) Visual Studio
7 2 (0.68%) WebDriver
8 1 (0.34%) ER Studio
8 1 (0.34%) IntelliJ
8 1 (0.34%) PowerDesigner
8 1 (0.34%) PyCharm
8 1 (0.34%) Sonatype Nexus
8 1 (0.34%) Visual Studio Code
General
1 46 (15.70%) Finance
2 21 (7.17%) Public Sector
3 13 (4.44%) Front Office
4 4 (1.37%) Banking
4 4 (1.37%) Games
4 4 (1.37%) Legal
4 4 (1.37%) Local Government
5 3 (1.02%) Investment Banking
5 3 (1.02%) Manufacturing
5 3 (1.02%) Publishing
5 3 (1.02%) Retail
6 2 (0.68%) Marketing
7 1 (0.34%) Advertising
7 1 (0.34%) Pharmaceutical
Job Titles
1 113 (38.57%) Data Engineer
2 82 (27.99%) Azure Engineer
3 51 (17.41%) Architect
4 36 (12.29%) Azure Architect
5 35 (11.95%) DevOps Engineer
6 32 (10.92%) Developer
7 27 (9.22%) Big Data Engineer
8 25 (8.53%) Azure DevOps
8 25 (8.53%) Azure DevOps Engineer
9 24 (8.19%) Python Engineer
10 23 (7.85%) Data Architect
11 14 (4.78%) Technical Leader
12 13 (4.44%) Lead DevOps
13 11 (3.75%) Solutions Architect
14 10 (3.41%) Azure Developer
14 10 (3.41%) Lead DevOps Engineer
15 9 (3.07%) Integration Architect
16 8 (2.73%) Cloud Architect
17 7 (2.39%) Business Intelligence Developer
17 7 (2.39%) Consultant
Libraries, Frameworks & Software Standards
1 48 (16.38%) PySpark
2 20 (6.83%) Web Services
3 18 (6.14%) .NET
4 17 (5.80%) Kafka
5 15 (5.12%) Pandas
6 14 (4.78%) JSON
7 13 (4.44%) MDX
8 12 (4.10%) XML
9 10 (3.41%) Apache Avro
9 10 (3.41%) SparkR
10 9 (3.07%) .NET Framework
10 9 (3.07%) REST
10 9 (3.07%) SOAP
11 4 (1.37%) EDI
11 4 (1.37%) pytest
12 3 (1.02%) MLlib
12 3 (1.02%) Natural Language Processing
12 3 (1.02%) Velocity
13 2 (0.68%) Node.js
13 2 (0.68%) OpenCV
Miscellaneous
1 10 (3.41%) Greenfield Project
2 9 (3.07%) Analytical Skills
3 8 (2.73%) Management Information System
4 6 (2.05%) Algorithms
5 5 (1.71%) Private Cloud
6 4 (1.37%) Public Cloud
7 3 (1.02%) Cloud Native
7 3 (1.02%) Enterprise Software
7 3 (1.02%) Life Science
7 3 (1.02%) Smart Meter
7 3 (1.02%) Virtual Team
8 2 (0.68%) Data Structures
8 2 (0.68%) Enterprise Cloud
8 2 (0.68%) Internet of Things
8 2 (0.68%) NHS
9 1 (0.34%) Data Centre
9 1 (0.34%) Linux Command Line
9 1 (0.34%) RIA
9 1 (0.34%) Self-Motivation
Operating Systems
1 4 (1.37%) Unix
2 2 (0.68%) Windows
3 1 (0.34%) Linux
Processes & Methodologies
1 111 (37.88%) Business Intelligence
2 98 (33.45%) Agile Software Development
3 86 (29.35%) DevOps
4 83 (28.33%) Analytics
5 70 (23.89%) ETL
6 64 (21.84%) Data Science
7 51 (17.41%) Data Engineering
8 40 (13.65%) Scrum
8 40 (13.65%) Test Automation
9 39 (13.31%) Data Integration
9 39 (13.31%) Data Modelling
10 33 (11.26%) Machine Learning
11 32 (10.92%) Visualisation
12 31 (10.58%) Information Security
13 27 (9.22%) Continuous Delivery
13 27 (9.22%) Migration
14 26 (8.87%) Deployment Automation
15 23 (7.85%) Kimball Methodology
16 22 (7.51%) Kanban
17 21 (7.17%) Microservices
Programming Languages
1 151 (51.54%) SQL
2 139 (47.44%) Python
3 66 (22.53%) C#
4 43 (14.68%) PowerShell
5 40 (13.65%) Scala
6 21 (7.17%) R
7 17 (5.80%) Java
7 17 (5.80%) T-SQL
8 15 (5.12%) Data Analysis Expressions (DAX)
9 12 (4.10%) Julia
10 9 (3.07%) U-SQL
11 7 (2.39%) Go
12 5 (1.71%) JavaScript
13 2 (0.68%) VB.NET
14 1 (0.34%) C
Qualifications
1 15 (5.12%) SC Cleared
1 15 (5.12%) Security Cleared
2 12 (4.10%) Degree
3 5 (1.71%) Microsoft Certification
4 4 (1.37%) DV Cleared
5 3 (1.02%) DBS Check
6 1 (0.34%) CISSP
6 1 (0.34%) Master's Degree
6 1 (0.34%) TOGAF Certification
Quality Assurance & Compliance
1 17 (5.80%) Data Quality
2 5 (1.71%) GDPR
3 1 (0.34%) COBIT
3 1 (0.34%) GLBA
3 1 (0.34%) HIPAA
3 1 (0.34%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
3 1 (0.34%) NIST
3 1 (0.34%) PCI DSS
3 1 (0.34%) QA
System Software
1 31 (10.58%) Docker
2 11 (3.75%) HDFS
3 8 (2.73%) Virtual Machines
4 1 (0.34%) Active Directory
Systems Management
1 31 (10.58%) Kubernetes
2 12 (4.10%) Kubeflow
2 12 (4.10%) Terraform
3 3 (1.02%) Hadoop YARN
4 2 (0.68%) Ansible
5 1 (0.34%) CASB
5 1 (0.34%) IBM Guardium
5 1 (0.34%) Opscode Chef
5 1 (0.34%) Puppet
Vendors
1 108 (36.86%) Microsoft
2 33 (11.26%) Google
3 20 (6.83%) Tableau
4 17 (5.80%) Informatica
5 15 (5.12%) SAP
5 15 (5.12%) Talend
6 11 (3.75%) Alteryx
7 8 (2.73%) Oracle
8 5 (1.71%) Cloudera
8 5 (1.71%) Salesforce.com
9 4 (1.37%) Dell
9 4 (1.37%) Hortonworks
9 4 (1.37%) MapR
9 4 (1.37%) Twitter
10 3 (1.02%) Splunk
11 2 (0.68%) Cisco
12 1 (0.34%) Forcepoint
12 1 (0.34%) McAfee
12 1 (0.34%) Sybase
12 1 (0.34%) Symantec