Period
to 21 May 2019

The table below provides summary statistics for permanent job vacancies with a requirement for knowledge and experience of Databricks products and/or services. Included is a benchmarking guide to the salaries offered in vacancies that have cited Databricks over the 6 months to 21 May 2019 with a comparison to the same period in the previous 2 years.

The figures below represent the IT labour market in general and are not representative of salaries within Databricks.

Databricks
UK
6 months to
21 May 2019
Same period 2018 Same period 2017
Rank 796 1180 -
Rank change year-on-year +384 - -
Permanent jobs citing Databricks 304 26 0
As % of all permanent IT jobs advertised in the UK 0.21% 0.015% -
As % of the Vendors category 0.50% 0.034% -
Number of salaries quoted 207 17 0
UK median annual salary £77,500 £70,000 -
Median salary % change year-on-year +10.71% - -
UK excluding London median annual salary £55,500 - -

Databricks is in the Vendor Products and Services category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for knowledge or experience of vendor products and services.

All Vendors
UK
Permanent vacancies with a requirement for knowledge or experience of vendor products and services 61,085 75,439 74,666
As % of all permanent IT jobs advertised in the UK 42.37% 43.93% 44.22%
Number of salaries quoted 46,679 58,994 59,978
UK median annual salary £50,000 £47,500 £46,000
Median salary % change year-on-year +5.26% +3.26% +2.22%
10th Percentile £27,500 £27,000 £26,250
90th Percentile £81,800 £77,500 £75,000
UK excluding London median annual salary £45,000 £42,500 £41,500
% change year-on-year +5.88% +2.41% -1.19%

Databricks
Job Vacancy Trend

Job postings citing Databricks as a percentage of all IT jobs advertised.

Job vacancy trend for Databricks in the UK

Databricks
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Databricks.

Salary trend for Databricks in the UK

Databricks
Salary Histogram

The salary distribution of IT jobs citing Databricks over the 6 months to 21 May 2019.

Salary histogram for Databricks in the UK

Databricks
Top 11 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Databricks within the UK over the 6 months to 21 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +359 294 £78,750 +5.00% 16
London +295 231 £82,500 +10.00% 11
UK excluding London - 70 £55,500 - 5
South East - 31 £55,000 - 4
North of England - 21 £67,500 - 1
North West - 11 £85,000 - 1
Scotland - 9 £48,750 -
East Midlands - 9 £55,000 -
Midlands - 9 £55,000 -
North East - 6 £67,500 -
Yorkshire - 4 £48,750 -

For the 6 months to 21 May 2019, IT jobs citing Databricks also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Databricks.

1 229 (75.33%) Microsoft Azure
2 215 (70.72%) Agile Software Development
3 205 (67.43%) Analytics
4 196 (64.47%) Python
5 175 (57.57%) SQL
6 166 (54.61%) Big Data
7 165 (54.28%) Data Lake
8 158 (51.97%) Microsoft
9 155 (50.99%) Apache Spark
10 154 (50.66%) Data Warehouse
11 145 (47.70%) NoSQL
12 144 (47.37%) Hadoop
13 132 (43.42%) Business Intelligence
14 130 (42.76%) Azure Data Factory
15 125 (41.12%) Scrum
16 124 (40.79%) Kafka
17 116 (38.16%) DevOps
18 115 (37.83%) Azure SQL Database
19 114 (37.50%) Amazon AWS
20 107 (35.20%) Data Science
21 106 (34.87%) Kanban
22 105 (34.54%) ETL
23 104 (34.21%) Power Platform
23 104 (34.21%) Power BI
23 104 (34.21%) Data Analytics
24 102 (33.55%) Apache Hive
25 99 (32.57%) SQL Server
26 96 (31.58%) Apache Cassandra
26 96 (31.58%) SQL Server Analysis Services
27 95 (31.25%) Apache Pig

Databricks
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 155 (50.99%) Apache Spark
2 95 (31.25%) Apache Pig
3 82 (26.97%) Elasticsearch
4 56 (18.42%) Apache Solr
5 44 (14.47%) Apache
6 5 (1.64%) Jupyter
7 4 (1.32%) ArcGIS
7 4 (1.32%) SAS
8 3 (0.99%) Apache Airflow
9 1 (0.33%) SharePoint
Applications
1 4 (1.32%) SPSS
2 2 (0.66%) Chatbot
2 2 (0.66%) Spreadsheet
Business Applications
1 2 (0.66%) ReMetrica
1 2 (0.66%) SAP ERP
1 2 (0.66%) Towers Watson Igloo
Cloud Services
1 229 (75.33%) Microsoft Azure
2 130 (42.76%) Azure Data Factory
3 114 (37.50%) Amazon AWS
4 104 (34.21%) Power Platform
5 34 (11.18%) Serverless
6 32 (10.53%) Google Cloud Platform
7 29 (9.54%) Cortana Intelligence Suite
8 26 (8.55%) Azure Functions
9 19 (6.25%) PaaS
10 16 (5.26%) SaaS
11 14 (4.61%) Azure Active Directory
12 10 (3.29%) Amazon Kinesis
12 10 (3.29%) Amazon SageMaker
12 10 (3.29%) Azure Machine Learning
13 8 (2.63%) GitHub
13 8 (2.63%) npm
13 8 (2.63%) Office 365
14 6 (1.97%) Azure Stack
15 5 (1.64%) Amazon S3
15 5 (1.64%) Data Lake Analytics
Communications & Networking
1 16 (5.26%) Internet
2 8 (2.63%) Broadband
3 2 (0.66%) Firewall
Database & Business Intelligence
1 166 (54.61%) Big Data
2 165 (54.28%) Data Lake
3 154 (50.66%) Data Warehouse
4 145 (47.70%) NoSQL
5 144 (47.37%) Hadoop
6 115 (37.83%) Azure SQL Database
7 104 (34.21%) Power BI
8 102 (33.55%) Apache Hive
9 99 (32.57%) SQL Server
10 96 (31.58%) Apache Cassandra
10 96 (31.58%) SQL Server Analysis Services
11 92 (30.26%) Impala
12 82 (26.97%) Amazon Redshift
13 81 (26.64%) HBase
14 78 (25.66%) Couchbase
14 78 (25.66%) CouchDB
14 78 (25.66%) Flink
15 75 (24.67%) SQL Server Integration Services
16 63 (20.72%) SQL Server Reporting Services
17 59 (19.41%) Azure SQL Data Warehouse
Development Applications
1 26 (8.55%) Visual Studio
2 18 (5.92%) Visual Studio Team System
3 17 (5.59%) Jenkins
4 14 (4.61%) Git (software)
5 9 (2.96%) Octopus Deploy
5 9 (2.96%) TeamCity
6 8 (2.63%) Atlassian Bamboo
6 8 (2.63%) git-flow
6 8 (2.63%) Sinon.JS
6 8 (2.63%) webpack
7 5 (1.64%) Team Foundation Server
7 5 (1.64%) Vagrant
8 3 (0.99%) Artifactory
8 3 (0.99%) ER Studio
8 3 (0.99%) ERwin
8 3 (0.99%) GoCD
9 2 (0.66%) Maven
10 1 (0.33%) PowerDesigner
10 1 (0.33%) Subversion
General
1 57 (18.75%) Finance
2 23 (7.57%) Banking
3 17 (5.59%) Games
4 6 (1.97%) Marketing
5 5 (1.64%) Retail
6 2 (0.66%) Advertising
7 1 (0.33%) International Banking
7 1 (0.33%) Manufacturing
Job Titles
1 93 (30.59%) Data Engineer
2 81 (26.64%) Developer
3 49 (16.12%) Business Intelligence Developer
4 47 (15.46%) Big Data Engineer
5 42 (13.82%) Azure Developer
6 38 (12.50%) Architect
7 33 (10.86%) Data Architect
8 27 (8.88%) Azure Engineer
9 24 (7.89%) SQL BI Developer
9 24 (7.89%) SQL Developer
10 20 (6.58%) Database Developer
10 20 (6.58%) SQL Database Developer
11 19 (6.25%) Big Data Architect
11 19 (6.25%) Senior Data Engineer
12 18 (5.92%) Azure Specialist
12 18 (5.92%) Business Intelligence Lead
12 18 (5.92%) Business Intelligence Specialist
12 18 (5.92%) Lead Developer
13 15 (4.93%) Senior Business Intelligence Developer
13 15 (4.93%) Senior Developer
Libraries, Frameworks & Software Standards
1 124 (40.79%) Kafka
2 57 (18.75%) MDX
3 46 (15.13%) .NET
4 19 (6.25%) Apache NiFi
5 16 (5.26%) Natural Language Processing
5 16 (5.26%) SAML
6 13 (4.28%) JSON
7 12 (3.95%) REST
8 11 (3.62%) .NET Framework
9 10 (3.29%) GeoJSON
9 10 (3.29%) TensorFlow
10 8 (2.63%) Jest
10 8 (2.63%) React
11 7 (2.30%) MXNet
11 7 (2.30%) scikit-learn
11 7 (2.30%) Spark Streaming
12 6 (1.97%) ASP.NET Web API
12 6 (1.97%) PySpark
13 5 (1.64%) D3.js
14 4 (1.32%) Spring MVC
Miscellaneous
1 21 (6.91%) Analytical Skills
2 10 (3.29%) Augmented Reality
2 10 (3.29%) Cloud Native
3 6 (1.97%) Greenfield Project
3 6 (1.97%) Podcast
4 5 (1.64%) Algorithms
4 5 (1.64%) Reinsurance
4 5 (1.64%) Self-Motivation
5 4 (1.32%) Management Information System
6 3 (0.99%) Blog
6 3 (0.99%) Data Structures
6 3 (0.99%) Fintech
6 3 (0.99%) User Experience
7 2 (0.66%) Data Centre
7 2 (0.66%) FMCG
7 2 (0.66%) Hybrid Cloud
7 2 (0.66%) Life Science
7 2 (0.66%) PMI
7 2 (0.66%) Public Cloud
7 2 (0.66%) Virtual Team
Operating Systems
1 8 (2.63%) Windows
2 7 (2.30%) Linux
3 4 (1.32%) Windows 10
3 4 (1.32%) Windows Server
Processes & Methodologies
1 215 (70.72%) Agile Software Development
2 205 (67.43%) Analytics
3 132 (43.42%) Business Intelligence
4 125 (41.12%) Scrum
5 116 (38.16%) DevOps
6 107 (35.20%) Data Science
7 106 (34.87%) Kanban
8 105 (34.54%) ETL
9 104 (34.21%) Data Analytics
10 94 (30.92%) Data Modelling
11 81 (26.64%) MapReduce
12 55 (18.09%) Kimball Methodology
13 53 (17.43%) Data Architecture
14 51 (16.78%) Machine Learning
15 50 (16.45%) SDLC
16 43 (14.14%) Data Ingestion
16 43 (14.14%) Visualisation
17 42 (13.82%) Problem-Solving
18 40 (13.16%) Artificial Intelligence
19 35 (11.51%) Continuous Integration
Programming Languages
1 196 (64.47%) Python
2 175 (57.57%) SQL
3 92 (30.26%) Scala
4 89 (29.28%) Java
5 64 (21.05%) Data Analysis Expressions (DAX)
6 51 (16.78%) C#
7 31 (10.20%) R
8 26 (8.55%) T-SQL
9 23 (7.57%) JavaScript
10 19 (6.25%) PowerShell
11 10 (3.29%) U-SQL
12 8 (2.63%) VBA
13 2 (0.66%) Bash Shell
13 2 (0.66%) C++
13 2 (0.66%) Perl
13 2 (0.66%) PHP
13 2 (0.66%) Ruby
14 1 (0.33%) C
Qualifications
1 27 (8.88%) Microsoft Certification
2 6 (1.97%) Degree
3 4 (1.32%) (ISC)2 CCSP
3 4 (1.32%) CCSP
3 4 (1.32%) Cisco Certification
3 4 (1.32%) CISSP
3 4 (1.32%) CompTIA Security+
3 4 (1.32%) MCSA
3 4 (1.32%) MCSE
4 3 (0.99%) Master's Degree
4 3 (0.99%) PhD
4 3 (0.99%) Security Cleared
4 3 (0.99%) TOGAF Certification
5 2 (0.66%) CEH
5 2 (0.66%) Computer Science Degree
5 2 (0.66%) PMI Certification
Quality Assurance & Compliance
1 13 (4.28%) GDPR
2 12 (3.95%) Data Quality
3 1 (0.33%) QA
System Software
1 79 (25.99%) Apache Flume
2 13 (4.28%) Docker
3 10 (3.29%) Active Directory
4 9 (2.96%) HDFS
5 5 (1.64%) VirtualBox
6 4 (1.32%) Virtual Machines
Systems Management
1 78 (25.66%) Hadoop YARN
1 78 (25.66%) Oozie
2 53 (17.43%) Terraform
3 25 (8.22%) Opscode Chef
3 25 (8.22%) Puppet
4 18 (5.92%) Kubernetes
5 8 (2.63%) Docker Swarm
6 7 (2.30%) Ansible
7 4 (1.32%) Microsoft Intune
7 4 (1.32%) Single Sign-On
8 2 (0.66%) Ambari
8 2 (0.66%) Salt
9 1 (0.33%) Kibana
Vendors
1 158 (51.97%) Microsoft
2 85 (27.96%) Cloudera
2 85 (27.96%) Hortonworks
3 78 (25.66%) MapR
4 29 (9.54%) Informatica
5 23 (7.57%) Tableau
5 23 (7.57%) Talend
6 22 (7.24%) Oracle
7 20 (6.58%) Google
8 10 (3.29%) Dataiku
9 7 (2.30%) IBM
10 5 (1.64%) Netezza
11 4 (1.32%) Alteryx
11 4 (1.32%) Cognizant
12 2 (0.66%) Aspera
12 2 (0.66%) Jitterbit
12 2 (0.66%) MuleSoft
12 2 (0.66%) Signiant
12 2 (0.66%) SnapLogic
12 2 (0.66%) Tumblr