Period
to 30 September 2020

The table below provides summary statistics for permanent job vacancies with a requirement for knowledge and experience of Databricks products and/or services. Included is a benchmarking guide to the salaries offered in vacancies that have cited Databricks over the 6 months to 30 September 2020 with a comparison to the same period in the previous 2 years.

The figures below represent the IT labour market in general and are not representative of salaries within Databricks.

Databricks
UK
6 months to
30 Sep 2020
Same period 2019 Same period 2018
Rank 414 775 1080
Rank change year-on-year +361 +305 +130
Permanent jobs citing Databricks 274 319 94
As % of all permanent jobs advertised in the UK 0.57% 0.23% 0.057%
As % of the Vendors category 1.41% 0.53% 0.13%
Number of salaries quoted 230 251 47
Median annual salary £70,000 £70,000 £75,000
Median salary % change year-on-year - -6.67% +20.00%
10th Percentile £47,500 £47,500 £46,500
90th Percentile £92,500 £96,250 £95,000
UK excluding London median annual salary £60,000 £60,000 £47,500
% change year-on-year - +26.32% -

Databricks is in the Vendor Products and Services category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for knowledge or experience of vendor products and services.

All Vendors
UK
Permanent vacancies with a requirement for knowledge or experience of vendor products and services 19,409 59,650 70,686
As % of all permanent IT jobs advertised in the UK 40.28% 42.80% 43.02%
Number of salaries quoted 15,211 45,295 54,765
Median annual salary £53,500 £50,000 £50,000
Median salary % change year-on-year +7.00% - +5.26%
10th Percentile £31,250 £27,000 £27,000
90th Percentile £87,500 £82,500 £80,000
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Databricks
Job Vacancy Trend

Job postings citing Databricks as a proportion of all IT jobs advertised.

Job vacancy trend for Databricks in the UK

Databricks
Salary Trend

3-month moving average salary quoted in jobs citing Databricks.

Salary trend for Databricks in the UK

Databricks
Salary Histogram

Salary distribution for jobs citing Databricks over the 6 months to 30 September 2020.

Salary histogram for Databricks in the UK

Databricks
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Databricks within the UK over the 6 months to 30 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +346 259 £70,000 -6.67% 47
London +208 149 £75,000 -6.25% 26
UK excluding London +362 123 £60,000 - 24
North of England +238 72 £70,000 +3.70% 12
North West +169 59 £70,000 +1.82% 9
South East +212 20 £55,000 +0.46% 2
Work from Home +65 19 £56,250 -21.05% 6
Midlands +135 16 £50,000 -9.09% 5
West Midlands +123 14 £50,000 -35.48% 2
Yorkshire +146 12 £60,000 -33.33% 3
Scotland +102 9 £62,500 +21.36% 2
Northern Ireland - 6 £55,000 - 1
East Midlands +79 2 £50,000 -9.09% 2
North East +21 1 £47,500 -29.63%

For the 6 months to 30 September 2020, IT jobs citing Databricks also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Databricks.

1 250 (91.24%) Azure
2 205 (74.82%) Data Lake
3 166 (60.58%) SQL
4 159 (58.03%) Analytics
5 150 (54.74%) Python
6 137 (50.00%) Data Warehouse
7 122 (44.53%) Business Intelligence
8 113 (41.24%) Azure Data Factory
9 104 (37.96%) Microsoft
10 93 (33.94%) Big Data
11 83 (30.29%) Finance
12 81 (29.56%) Agile Software Development
13 77 (28.10%) Apache Spark
14 75 (27.37%) Power Platform
15 74 (27.01%) Azure SQL Database
16 72 (26.28%) Power BI
17 69 (25.18%) AWS
17 69 (25.18%) ETL
18 66 (24.09%) R
19 62 (22.63%) SQL Server
19 62 (22.63%) Machine Learning
20 61 (22.26%) Migration
21 58 (21.17%) Azure SQL Data Warehouse
22 57 (20.80%) Data Engineering
22 57 (20.80%) Data Analytics
23 56 (20.44%) DevOps
24 55 (20.07%) PaaS
25 53 (19.34%) NoSQL
25 53 (19.34%) Hadoop
26 51 (18.61%) Analytical Skills

Databricks
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 77 (28.10%) Apache Spark
2 32 (11.68%) Apache
3 12 (4.38%) SAS
4 9 (3.28%) Cloud Foundry
5 5 (1.82%) Apache Pig
5 5 (1.82%) Confluence
5 5 (1.82%) SharePoint
6 4 (1.46%) Apache Synapse
7 2 (0.73%) Apache Airflow
7 2 (0.73%) Elasticsearch
8 1 (0.36%) Apache Solr
8 1 (0.36%) Jupyter
8 1 (0.36%) Luigi
8 1 (0.36%) Oracle SOA Suite
Applications
1 4 (1.46%) Microsoft Excel
Cloud Services
1 250 (91.24%) Azure
2 113 (41.24%) Azure Data Factory
3 75 (27.37%) Power Platform
4 69 (25.18%) AWS
5 55 (20.07%) PaaS
6 40 (14.60%) GCP
7 38 (13.87%) SaaS
8 34 (12.41%) IaaS
9 18 (6.57%) Serverless
10 14 (5.11%) Azure Stack
10 14 (5.11%) Logic Apps
11 10 (3.65%) Amazon Kinesis
12 9 (3.28%) Amazon S3
12 9 (3.28%) Azure Functions
12 9 (3.28%) Data Lake Analytics
13 7 (2.55%) Amazon EMR
13 7 (2.55%) AWS Lambda
14 6 (2.19%) Amazon ElastiCache
14 6 (2.19%) PowerApps
15 4 (1.46%) Cortana Intelligence Suite
Communications & Networking
1 18 (6.57%) Skype
2 7 (2.55%) 5G
3 2 (0.73%) Internet
Database & Business Intelligence
1 205 (74.82%) Data Lake
2 137 (50.00%) Data Warehouse
3 93 (33.94%) Big Data
4 74 (27.01%) Azure SQL Database
5 72 (26.28%) Power BI
6 62 (22.63%) SQL Server
7 58 (21.17%) Azure SQL Data Warehouse
8 53 (19.34%) Hadoop
8 53 (19.34%) NoSQL
9 40 (14.60%) SQL Server Analysis Services
10 39 (14.23%) Cosmos DB
11 38 (13.87%) SQL Server Integration Services
12 26 (9.49%) HDInsight
13 25 (9.12%) Amazon Redshift
14 24 (8.76%) Microsoft Analysis Services
15 22 (8.03%) SQL Server Reporting Services
16 17 (6.20%) Impala
16 17 (6.20%) Snowflake Schema
17 16 (5.84%) BigQuery
17 16 (5.84%) Flink
Development Applications
1 12 (4.38%) Git (software)
2 8 (2.92%) GitLab
3 5 (1.82%) Artifactory
3 5 (1.82%) Jenkins
3 5 (1.82%) JIRA
4 3 (1.09%) Visual Studio
4 3 (1.09%) Visual Studio Team System
5 2 (0.73%) ER Studio
5 2 (0.73%) ERwin
5 2 (0.73%) JUnit
5 2 (0.73%) Selenium
5 2 (0.73%) SonarQube
5 2 (0.73%) Subversion
5 2 (0.73%) Team Foundation Server
6 1 (0.36%) Atlassian Bamboo
6 1 (0.36%) Bitbucket
6 1 (0.36%) GDB
6 1 (0.36%) GoCD
6 1 (0.36%) Sourcetree
6 1 (0.36%) Visual Studio Code
General
1 83 (30.29%) Finance
2 37 (13.50%) Banking
3 15 (5.47%) Marketing
4 14 (5.11%) Retail
5 9 (3.28%) Manufacturing
5 9 (3.28%) Telecoms
6 2 (0.73%) Advertising
6 2 (0.73%) Back Office
6 2 (0.73%) Front Office
6 2 (0.73%) Law
6 2 (0.73%) Public Sector
7 1 (0.36%) Automotive
7 1 (0.36%) Billing
7 1 (0.36%) Games
7 1 (0.36%) Legal
7 1 (0.36%) Pharmaceutical
Job Titles
1 105 (38.32%) Data Engineer
2 67 (24.45%) Architect
3 53 (19.34%) Azure Engineer
3 53 (19.34%) Developer
4 45 (16.42%) Azure Architect
4 45 (16.42%) Solutions Architect
5 36 (13.14%) Azure Developer
5 36 (13.14%) Cloud Architect
6 33 (12.04%) Business Intelligence Developer
7 31 (11.31%) Cloud Solutions Architect
7 31 (11.31%) Data Architect
8 19 (6.93%) Consultant
9 18 (6.57%) Data Consultant
10 16 (5.84%) Lead Developer
10 16 (5.84%) Senior Developer
11 15 (5.47%) Data Scientist
12 13 (4.74%) Business Intelligence Lead
13 12 (4.38%) Senior Business Intelligence Developer
14 10 (3.65%) Big Data Architect
14 10 (3.65%) Data Manager
Libraries, Frameworks & Software Standards
1 50 (18.25%) Kafka
2 26 (9.49%) .NET
3 20 (7.30%) PySpark
4 17 (6.20%) Natural Language Processing
4 17 (6.20%) RESTful
5 15 (5.47%) NumPy
5 15 (5.47%) Pandas
5 15 (5.47%) scikit-learn
6 13 (4.74%) XGBoost
7 11 (4.01%) MDX
8 8 (2.92%) AngularJS
8 8 (2.92%) TensorFlow
9 7 (2.55%) Keras
9 7 (2.55%) Matplotlib
9 7 (2.55%) PyTorch
9 7 (2.55%) Spring
10 6 (2.19%) NetworkX
10 6 (2.19%) SciPy
10 6 (2.19%) Shiny
10 6 (2.19%) SpaCy
Miscellaneous
1 51 (18.61%) Analytical Skills
2 27 (9.85%) Data Structures
3 22 (8.03%) Algorithms
4 12 (4.38%) Enterprise Software
4 12 (4.38%) Greenfield Project
5 8 (2.92%) Blog
6 7 (2.55%) FMCG
7 6 (2.19%) Clustering
7 6 (2.19%) Data Centre
7 6 (2.19%) Driving Licence
8 4 (1.46%) Management Information System
8 4 (1.46%) Virtual Team
9 3 (1.09%) Analytical Mindset
9 3 (1.09%) PMI
10 2 (0.73%) Cloud Native
10 2 (0.73%) Hybrid Cloud
10 2 (0.73%) Public Cloud
11 1 (0.36%) Foreign Exchange (FX)
11 1 (0.36%) Internet of Things
11 1 (0.36%) N-Tier
Operating Systems
1 8 (2.92%) Windows
2 6 (2.19%) Windows Server
3 3 (1.09%) Linux
Processes & Methodologies
1 159 (58.03%) Analytics
2 122 (44.53%) Business Intelligence
3 81 (29.56%) Agile Software Development
4 69 (25.18%) ETL
5 62 (22.63%) Machine Learning
6 61 (22.26%) Migration
7 57 (20.80%) Data Analytics
7 57 (20.80%) Data Engineering
8 56 (20.44%) DevOps
9 50 (18.25%) Data Science
10 45 (16.42%) SDLC
11 44 (16.06%) Data Modelling
11 44 (16.06%) Enterprise Architecture
12 39 (14.23%) Visualisation
13 27 (9.85%) TOGAF
14 26 (9.49%) Artificial Intelligence
15 25 (9.12%) Data Visualisation
16 23 (8.39%) Asset Management
17 20 (7.30%) Data Transformation
18 19 (6.93%) Decision-Making
Programming Languages
1 166 (60.58%) SQL
2 150 (54.74%) Python
3 66 (24.09%) R
4 37 (13.50%) Scala
5 25 (9.12%) Java
6 21 (7.66%) C#
7 20 (7.30%) Data Analysis Expressions (DAX)
8 18 (6.57%) T-SQL
9 17 (6.20%) JavaScript
10 8 (2.92%) U-SQL
11 6 (2.19%) MATLAB
11 6 (2.19%) PowerShell
12 2 (0.73%) Bash Shell
13 1 (0.36%) C++
13 1 (0.36%) VB.NET
Qualifications
1 26 (9.49%) Degree
2 8 (2.92%) Computer Science Degree
3 7 (2.55%) Master's Degree
4 4 (1.46%) Microsoft Certification
5 3 (1.09%) PhD
5 3 (1.09%) PMI Certification
6 2 (0.73%) Security Cleared
6 2 (0.73%) TOGAF Certification
7 1 (0.36%) Cisco Certification
7 1 (0.36%) SC Cleared
Quality Assurance & Compliance
1 10 (3.65%) Data Quality
2 2 (0.73%) QA
3 1 (0.36%) Dodd-Frank
3 1 (0.36%) EMIR
3 1 (0.36%) ISO/IEC 27001
3 1 (0.36%) MiFID
3 1 (0.36%) NIST
System Software
1 8 (2.92%) Active Directory
1 8 (2.92%) Docker
2 6 (2.19%) Hyper-V
2 6 (2.19%) Virtual Machines
3 2 (0.73%) Apache Flume
3 2 (0.73%) HDFS
Systems Management
1 17 (6.20%) Kubernetes
2 13 (4.74%) Terraform
3 6 (2.19%) SCVMM
4 2 (0.73%) Nagios
4 2 (0.73%) Opscode Chef
4 2 (0.73%) Puppet
5 1 (0.36%) Ansible
5 1 (0.36%) Kibana
5 1 (0.36%) Microsoft Intune
Vendors
1 104 (37.96%) Microsoft
2 39 (14.23%) Sparx
3 25 (9.12%) Tableau
4 11 (4.01%) Oracle
5 9 (3.28%) Google
6 6 (2.19%) Cloudera
6 6 (2.19%) PlateSpin
6 6 (2.19%) StreamSets
6 6 (2.19%) VirtaMove
7 4 (1.46%) Informatica
8 3 (1.09%) Guidewire
8 3 (1.09%) MuleSoft
9 2 (0.73%) Facebook
9 2 (0.73%) Splunk
9 2 (0.73%) Talend
10 1 (0.36%) Alteryx
10 1 (0.36%) Atlassian
10 1 (0.36%) MapR
10 1 (0.36%) Netezza
10 1 (0.36%) Teradata