Job Vacancy Trend Salary Trend Salary Histogram Skill Sets
Period
to 27 October 2021

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 27 October 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK > Work from Home
6 months to
27 Oct 2021		 Same period 2020 Same period 2019
Rank 148 150 81
Rank change year-on-year +2 -69 +56
Permanent jobs citing Big Data 641 122 280
As % of all permanent jobs with a WFH option 2.28% 1.85% 3.66%
As % of the Database & Business Intelligence category 8.08% 6.06% 12.69%
Number of salaries quoted 521 112 260
10th Percentile £45,000 £41,250 £36,250
25th Percentile £53,750 £45,000 £48,438
Median annual salary (50th Percentile) £72,500 £60,000 £70,000
Median % change year-on-year +20.83% -14.29% +12.00%
75th Percentile £90,000 £74,375 £87,500
90th Percentile £97,500 £94,625 £112,500
UK median annual salary £75,000 £65,000 £67,500
% change year-on-year +15.38% -3.70% +3.85%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Work from Home
Permanent vacancies with a requirement for database or business intelligence skills 7,936 2,014 2,207
As % of all permanent jobs with a WFH option 28.23% 30.55% 28.89%
Number of salaries quoted 5,978 1,862 2,001
10th Percentile £36,250 £35,000 £33,750
25th Percentile £45,000 £42,500 £40,250
Median annual salary (50th Percentile) £60,000 £53,500 £50,000
Median % change year-on-year +12.15% +7.00% -4.76%
75th Percentile £76,250 £68,750 £71,250
90th Percentile £92,500 £82,500 £85,000
UK median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Big Data
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Big Data as a proportion of all IT jobs advertised.

Big Data trend for jobs with a WFH option

Big Data
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Big Data.

Big Data salary trend for jobs with a WFH option

Big Data
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Big Data over the 6 months to 27 October 2021.

Big Data salary histogram for jobs with a WFH option

For the 6 months to 27 October 2021, Big Data job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent jobs with a WFH option and a requirement for Big Data.

1 314 (48.99%) AWS
2 288 (44.93%) Python
3 277 (43.21%) Azure
4 261 (40.72%) SQL
5 253 (39.47%) Analytics
6 203 (31.67%) Artificial Intelligence
7 192 (29.95%) GCP
8 191 (29.80%) Java
9 184 (28.71%) ETL
10 180 (28.08%) Business Intelligence
11 178 (27.77%) Agile Software Development
12 167 (26.05%) Docker
13 158 (24.65%) Kubernetes
14 156 (24.34%) DevOps
15 153 (23.87%) Data Modelling
16 149 (23.24%) Machine Learning
17 137 (21.37%) Data Warehouse
18 133 (20.75%) Software Engineering
19 131 (20.44%) Finance
20 125 (19.50%) Visualisation
21 123 (19.19%) Social Skills
22 121 (18.88%) Data Science
23 120 (18.72%) Hadoop
24 118 (18.41%) Apache Spark
25 106 (16.54%) Data Pipeline
26 103 (16.07%) Data Lake
27 98 (15.29%) Analytical Skills
28 91 (14.20%) C#
29 88 (13.73%) Problem-Solving
30 86 (13.42%) Degree

Big Data
Co-occurring IT Skills with a WFH Option by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (18.41%) Apache Spark
2 32 (4.99%) Apache
3 25 (3.90%) Apache Airflow
4 24 (3.74%) Elasticsearch
5 16 (2.50%) Apache Pig
6 14 (2.18%) Confluence
7 9 (1.40%) SAS
8 4 (0.62%) Oracle SOA Suite
9 3 (0.47%) Luigi
10 2 (0.31%) Apache Pulsar
10 2 (0.31%) Apache Solr
10 2 (0.31%) EPiServer
10 2 (0.31%) WordPress
11 1 (0.16%) CMS
11 1 (0.16%) IIS
11 1 (0.16%) nginx
11 1 (0.16%) OpenStack
11 1 (0.16%) Oracle Application Server
11 1 (0.16%) SharePoint
11 1 (0.16%) Umbraco
Applications
1 8 (1.25%) Figma
1 8 (1.25%) Sketch
2 5 (0.78%) InVision
2 5 (0.78%) SPSS
3 2 (0.31%) Microsoft Excel
3 2 (0.31%) Weka
4 1 (0.16%) Microsoft Office
4 1 (0.16%) Microsoft PowerPoint
Business Applications
1 9 (1.40%) Sentinel
2 4 (0.62%) Oracle BPM
3 3 (0.47%) Oracle EBS R12
3 3 (0.47%) Oracle ERP
4 2 (0.31%) Adobe Campaign
4 2 (0.31%) Dynamics CRM
4 2 (0.31%) WebTrends
5 1 (0.16%) Oracle EBS
Cloud Services
1 314 (48.99%) AWS
2 277 (43.21%) Azure
3 192 (29.95%) GCP
4 80 (12.48%) Power Platform
5 61 (9.52%) Azure Data Factory
6 54 (8.42%) Serverless
7 40 (6.24%) PaaS
8 39 (6.08%) IaaS
9 38 (5.93%) SaaS
10 32 (4.99%) AWS Lambda
11 27 (4.21%) Azure Synapse Analytics
12 26 (4.06%) Amazon S3
13 25 (3.90%) Cloud Computing
14 23 (3.59%) GitHub
14 23 (3.59%) Snowflake
15 20 (3.12%) Amazon EMR
15 20 (3.12%) Azure Sentinel
16 19 (2.96%) Amazon EC2
17 18 (2.81%) Azure Functions
18 16 (2.50%) Azure Logic Apps
Communications & Networking
1 13 (2.03%) Firewall
2 9 (1.40%) LAN
2 9 (1.40%) SSL
2 9 (1.40%) WAN
3 6 (0.94%) SMS
4 5 (0.78%) VLAN
5 4 (0.62%) DNS
5 4 (0.62%) Internet
5 4 (0.62%) Kerberos
6 3 (0.47%) 4G
6 3 (0.47%) BGP
6 3 (0.47%) Cisco ASA
6 3 (0.47%) OSPF
7 2 (0.31%) AMQP
7 2 (0.31%) FTP
7 2 (0.31%) Network Security
Database & Business Intelligence
1 137 (21.37%) Data Warehouse
2 120 (18.72%) Hadoop
3 103 (16.07%) Data Lake
4 84 (13.10%) NoSQL
5 82 (12.79%) PostgreSQL
6 79 (12.32%) Power BI
7 71 (11.08%) Relational Database
8 70 (10.92%) MySQL
9 61 (9.52%) Amazon Redshift
10 60 (9.36%) Apache Hive
11 54 (8.42%) Tableau
12 51 (7.96%) SQL Server
13 50 (7.80%) BigQuery
14 44 (6.86%) Redis
15 43 (6.71%) MongoDB
16 42 (6.55%) GIS
17 34 (5.30%) Looker
18 28 (4.37%) Apache Cassandra
18 28 (4.37%) Metadata
19 27 (4.21%) Flink
Development Applications
1 75 (11.70%) Git (software)
2 47 (7.33%) Jenkins
3 33 (5.15%) JIRA
4 29 (4.52%) Bitbucket
5 25 (3.90%) webpack
6 14 (2.18%) Atlassian Bamboo
7 12 (1.87%) Visual Studio
8 10 (1.56%) Gradle
8 10 (1.56%) Maven
9 9 (1.40%) SpecFlow
10 8 (1.25%) GitLab
10 8 (1.25%) Octopus Deploy
10 8 (1.25%) TeamCity
11 7 (1.09%) Babel
11 7 (1.09%) Mocha
11 7 (1.09%) NUnit
11 7 (1.09%) Selenium
12 5 (0.78%) Balsamiq
12 5 (0.78%) CircleCI
12 5 (0.78%) gulp
General
1 131 (20.44%) Finance
2 123 (19.19%) Social Skills
3 98 (15.29%) Analytical Skills
4 63 (9.83%) Retail
5 57 (8.89%) Banking
6 36 (5.62%) Marketing
7 22 (3.43%) Inclusion and Diversity
7 22 (3.43%) Telecoms
8 21 (3.28%) Presentation Skills
9 13 (2.03%) Financial Institution
10 12 (1.87%) Investment Banking
11 11 (1.72%) Advertising
11 11 (1.72%) Czech Language
12 9 (1.40%) Automotive
12 9 (1.40%) Electronics
12 9 (1.40%) Public Sector
13 8 (1.25%) Legal
13 8 (1.25%) Private Banking
14 7 (1.09%) Aerospace
14 7 (1.09%) Games
Job Titles
1 231 (36.04%) Developer
2 114 (17.78%) Senior Developer
3 110 (17.16%) Data Engineer
4 104 (16.22%) Architect
5 67 (10.45%) Java Developer
6 63 (9.83%) Data Architect
7 47 (7.33%) Software Engineer
8 46 (7.18%) Azure Engineer
9 42 (6.55%) Senior Java Developer
10 38 (5.93%) Solutions Architect
11 35 (5.46%) Cloud Architect
12 32 (4.99%) C# Developer
12 32 (4.99%) DevOps Engineer
13 29 (4.52%) Analyst
13 29 (4.52%) Front End Developer (Client-Side Developer)
14 28 (4.37%) Python Engineer
15 27 (4.21%) Consultant
16 25 (3.90%) Senior Architect
17 24 (3.74%) Big Data Engineer
18 23 (3.59%) Software Developer
Libraries, Frameworks & Software Standards
1 81 (12.64%) Kafka
2 78 (12.17%) .NET
3 69 (10.76%) React
4 61 (9.52%) Node.js
5 51 (7.96%) HTML
6 39 (6.08%) CSS
7 37 (5.77%) AngularJS
8 35 (5.46%) .NET Core
9 32 (4.99%) REST
10 29 (4.52%) Django
11 24 (3.74%) HTML5
11 24 (3.74%) Web Services
12 23 (3.59%) Vue.js
13 21 (3.28%) NumPy
14 19 (2.96%) D3.js
15 16 (2.50%) GraphQL
15 16 (2.50%) Jest
15 16 (2.50%) Torch
16 15 (2.34%) jQuery
16 15 (2.34%) JSON
Miscellaneous
1 48 (7.49%) Algorithms
2 45 (7.02%) User Experience
3 42 (6.55%) Cloud Native
3 42 (6.55%) Hybrid Cloud
4 22 (3.43%) Data Structures
5 20 (3.12%) Virtual Team
6 19 (2.96%) Self-Motivation
7 16 (2.50%) Mobile App
8 15 (2.34%) Hedge funds
8 15 (2.34%) Public Cloud
9 14 (2.18%) Reference Data
10 12 (1.87%) Management Information System
11 11 (1.72%) Life Science
11 11 (1.72%) Tandem
12 9 (1.40%) Enterprise Cloud
13 8 (1.25%) CMDB
13 8 (1.25%) Data Centre
13 8 (1.25%) Private Cloud
14 6 (0.94%) Enterprise Software
15 5 (0.78%) Greenfield Project
Operating Systems
1 52 (8.11%) Linux
2 11 (1.72%) Windows
3 10 (1.56%) Unix
4 7 (1.09%) CentOS
5 5 (0.78%) Red Hat Enterprise Linux
6 4 (0.62%) Windows Server
7 1 (0.16%) Ubuntu
Processes & Methodologies
1 253 (39.47%) Analytics
2 203 (31.67%) Artificial Intelligence
3 184 (28.71%) ETL
4 180 (28.08%) Business Intelligence
5 178 (27.77%) Agile Software Development
6 156 (24.34%) DevOps
7 153 (23.87%) Data Modelling
8 149 (23.24%) Machine Learning
9 133 (20.75%) Software Engineering
10 125 (19.50%) Visualisation
11 121 (18.88%) Data Science
12 106 (16.54%) Data Pipeline
13 88 (13.73%) Problem-Solving
14 84 (13.10%) Microservices
15 83 (12.95%) Data Analytics
16 75 (11.70%) Computer Science
17 72 (11.23%) Data Engineering
18 65 (10.14%) Data Visualisation
19 64 (9.98%) Data Management
20 62 (9.67%) Data Governance
Programming Languages
1 288 (44.93%) Python
2 261 (40.72%) SQL
3 191 (29.80%) Java
4 91 (14.20%) C#
5 76 (11.86%) JavaScript
6 64 (9.98%) Scala
7 56 (8.74%) TypeScript
8 47 (7.33%) Go
9 30 (4.68%) R
10 29 (4.52%) PowerShell
11 21 (3.28%) Ruby
12 20 (3.12%) C
13 12 (1.87%) C++
13 12 (1.87%) Cython
13 12 (1.87%) Java 8
14 11 (1.72%) Bash Shell
15 10 (1.56%) Perl
16 9 (1.40%) PHP
17 7 (1.09%) Clojure
17 7 (1.09%) VB
Qualifications
1 86 (13.42%) Degree
2 39 (6.08%) Computer Science Degree
3 31 (4.84%) Security Cleared
4 24 (3.74%) SC Cleared
5 14 (2.18%) PhD
6 8 (1.25%) Master's Degree
7 3 (0.47%) BC Cleared
7 3 (0.47%) CCIE
7 3 (0.47%) Cisco Certification
7 3 (0.47%) JNCIE
8 2 (0.31%) CFA
8 2 (0.31%) MCDBA
8 2 (0.31%) MCT
8 2 (0.31%) Microsoft Certification
8 2 (0.31%) TOGAF Certification
9 1 (0.16%) AWS Certification
9 1 (0.16%) BPSS Clearance
9 1 (0.16%) DV Cleared
9 1 (0.16%) OCP
9 1 (0.16%) Oracle Certification
Quality Assurance & Compliance
1 57 (8.89%) Data Quality
2 26 (4.06%) QA
3 9 (1.40%) Accessibility
4 5 (0.78%) Actionable Recommendations
5 4 (0.62%) PMO
6 3 (0.47%) GDPR
7 1 (0.16%) COBIT
7 1 (0.16%) GxP
7 1 (0.16%) ISO/IEC 27001
7 1 (0.16%) NIST
System Software
1 167 (26.05%) Docker
2 9 (1.40%) Active Directory
3 7 (1.09%) Virtual Machines
4 5 (0.78%) Apache ZooKeeper
4 5 (0.78%) HDFS
5 1 (0.16%) VMware Infrastructure
Systems Management
1 158 (24.65%) Kubernetes
2 55 (8.58%) Terraform
3 50 (7.80%) Ansible
4 14 (2.18%) Hadoop YARN
5 12 (1.87%) Oozie
5 12 (1.87%) Puppet
6 8 (1.25%) ITRS Geneos
7 6 (0.94%) Prometheus
8 5 (0.78%) MIIS
8 5 (0.78%) Opscode Chef
8 5 (0.78%) Single Sign-On
9 3 (0.47%) Grafana
9 3 (0.47%) HAProxy
9 3 (0.47%) Istio
9 3 (0.47%) Knative
10 2 (0.31%) Docker Swarm
10 2 (0.31%) Graphite
10 2 (0.31%) Kibana
10 2 (0.31%) Salt
11 1 (0.16%) Control-M
Vendors
1 68 (10.61%) Google
2 66 (10.30%) Microsoft
3 61 (9.52%) Databricks
4 56 (8.74%) Oracle
5 37 (5.77%) Informatica
6 24 (3.74%) Cloudera
7 20 (3.12%) StreamSets
8 17 (2.65%) Splunk
9 15 (2.34%) Adobe
9 15 (2.34%) Yahoo!
10 14 (2.18%) SAP
11 12 (1.87%) Hortonworks
12 10 (1.56%) Salesforce.com
13 9 (1.40%) MKS
14 8 (1.25%) Intel
14 8 (1.25%) ServiceNow
14 8 (1.25%) Talend
14 8 (1.25%) Teradata
15 7 (1.09%) Qubit
16 6 (0.94%) Red Hat