Period
to 27 October 2021

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 27 October 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK > Work from Home
6 months to
27 Oct 2021
Same period 2020 Same period 2019
Rank 148 150 81
Rank change year-on-year +2 -69 +56
Permanent jobs citing Big Data 641 122 280
As % of all permanent jobs with a WFH option 2.28% 1.85% 3.66%
As % of the Database & Business Intelligence category 8.08% 6.06% 12.69%
Number of salaries quoted 521 112 260
10th Percentile £45,000 £41,250 £36,250
25th Percentile £53,750 £45,000 £48,438
Median annual salary (50th Percentile) £72,500 £60,000 £70,000
Median % change year-on-year +20.83% -14.29% +12.00%
75th Percentile £90,000 £74,375 £87,500
90th Percentile £97,500 £94,625 £112,500
UK median annual salary £75,000 £65,000 £67,500
% change year-on-year +15.38% -3.70% +3.85%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Work from Home
Permanent vacancies with a requirement for database or business intelligence skills 7,936 2,014 2,207
As % of all permanent jobs with a WFH option 28.23% 30.55% 28.89%
Number of salaries quoted 5,978 1,862 2,001
10th Percentile £36,250 £35,000 £33,750
25th Percentile £45,000 £42,500 £40,250
Median annual salary (50th Percentile) £60,000 £53,500 £50,000
Median % change year-on-year +12.15% +7.00% -4.76%
75th Percentile £76,250 £68,750 £71,250
90th Percentile £92,500 £82,500 £85,000
UK median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Big Data
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Big Data as a proportion of all IT jobs advertised.

Big Data trend for jobs with a WFH option

Big Data
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Big Data.

Big Data salary trend for jobs with a WFH option

Big Data
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Big Data over the 6 months to 27 October 2021.

Big Data salary histogram for jobs with a WFH option

For the 6 months to 27 October 2021, Big Data job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent jobs with a WFH option and a requirement for Big Data.

1 314 (48.99%) AWS
2 288 (44.93%) Python
3 277 (43.21%) Azure
4 261 (40.72%) SQL
5 253 (39.47%) Analytics
6 203 (31.67%) Artificial Intelligence
7 192 (29.95%) GCP
8 191 (29.80%) Java
9 184 (28.71%) ETL
10 180 (28.08%) Business Intelligence
11 178 (27.77%) Agile Software Development
12 167 (26.05%) Docker
13 158 (24.65%) Kubernetes
14 156 (24.34%) DevOps
15 153 (23.87%) Data Modelling
16 149 (23.24%) Machine Learning
17 137 (21.37%) Data Warehouse
18 133 (20.75%) Software Engineering
19 131 (20.44%) Finance
20 125 (19.50%) Visualisation
21 123 (19.19%) Social Skills
22 121 (18.88%) Data Science
23 120 (18.72%) Hadoop
24 118 (18.41%) Apache Spark
25 106 (16.54%) Data Pipeline
26 103 (16.07%) Data Lake
27 98 (15.29%) Analytical Skills
28 91 (14.20%) C#
29 88 (13.73%) Problem-Solving
30 86 (13.42%) Degree

Big Data
Co-occurring IT Skills with a WFH Option by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (18.41%) Apache Spark
2 32 (4.99%) Apache
3 25 (3.90%) Apache Airflow
4 24 (3.74%) Elasticsearch
5 16 (2.50%) Apache Pig
6 14 (2.18%) Confluence
7 9 (1.40%) SAS
8 4 (0.62%) Oracle SOA Suite
9 3 (0.47%) Luigi
10 2 (0.31%) Apache Pulsar
10 2 (0.31%) Apache Solr
10 2 (0.31%) EPiServer
10 2 (0.31%) WordPress
11 1 (0.16%) CMS
11 1 (0.16%) IIS
11 1 (0.16%) nginx
11 1 (0.16%) OpenStack
11 1 (0.16%) Oracle Application Server
11 1 (0.16%) SharePoint
11 1 (0.16%) Umbraco
Applications
1 8 (1.25%) Figma
1 8 (1.25%) Sketch
2 5 (0.78%) InVision
2 5 (0.78%) SPSS
3 2 (0.31%) Microsoft Excel
3 2 (0.31%) Weka
4 1 (0.16%) Microsoft Office
4 1 (0.16%) Microsoft PowerPoint
Business Applications
1 9 (1.40%) Sentinel
2 4 (0.62%) Oracle BPM
3 3 (0.47%) Oracle EBS R12
3 3 (0.47%) Oracle ERP
4 2 (0.31%) Adobe Campaign
4 2 (0.31%) Dynamics CRM
4 2 (0.31%) WebTrends
5 1 (0.16%) Oracle EBS
Cloud Services
1 314 (48.99%) AWS
2 277 (43.21%) Azure
3 192 (29.95%) GCP
4 80 (12.48%) Power Platform
5 61 (9.52%) Azure Data Factory
6 54 (8.42%) Serverless
7 40 (6.24%) PaaS
8 39 (6.08%) IaaS
9 38 (5.93%) SaaS
10 32 (4.99%) AWS Lambda
11 27 (4.21%) Azure Synapse Analytics
12 26 (4.06%) Amazon S3
13 25 (3.90%) Cloud Computing
14 23 (3.59%) GitHub
14 23 (3.59%) Snowflake
15 20 (3.12%) Amazon EMR
15 20 (3.12%) Azure Sentinel
16 19 (2.96%) Amazon EC2
17 18 (2.81%) Azure Functions
18 16 (2.50%) Azure Logic Apps
Communications & Networking
1 13 (2.03%) Firewall
2 9 (1.40%) LAN
2 9 (1.40%) SSL
2 9 (1.40%) WAN
3 6 (0.94%) SMS
4 5 (0.78%) VLAN
5 4 (0.62%) DNS
5 4 (0.62%) Internet
5 4 (0.62%) Kerberos
6 3 (0.47%) 4G
6 3 (0.47%) BGP
6 3 (0.47%) Cisco ASA
6 3 (0.47%) OSPF
7 2 (0.31%) AMQP
7 2 (0.31%) FTP
7 2 (0.31%) Network Security
Database & Business Intelligence
1 137 (21.37%) Data Warehouse
2 120 (18.72%) Hadoop
3 103 (16.07%) Data Lake
4 84 (13.10%) NoSQL
5 82 (12.79%) PostgreSQL
6 79 (12.32%) Power BI
7 71 (11.08%) Relational Database
8 70 (10.92%) MySQL
9 61 (9.52%) Amazon Redshift
10 60 (9.36%) Apache Hive
11 54 (8.42%) Tableau
12 51 (7.96%) SQL Server
13 50 (7.80%) BigQuery
14 44 (6.86%) Redis
15 43 (6.71%) MongoDB
16 42 (6.55%) GIS
17 34 (5.30%) Looker
18 28 (4.37%) Apache Cassandra
18 28 (4.37%) Metadata
19 27 (4.21%) Flink
Development Applications
1 75 (11.70%) Git (software)
2 47 (7.33%) Jenkins
3 33 (5.15%) JIRA
4 29 (4.52%) Bitbucket
5 25 (3.90%) webpack
6 14 (2.18%) Atlassian Bamboo
7 12 (1.87%) Visual Studio
8 10 (1.56%) Gradle
8 10 (1.56%) Maven
9 9 (1.40%) SpecFlow
10 8 (1.25%) GitLab
10 8 (1.25%) Octopus Deploy
10 8 (1.25%) TeamCity
11 7 (1.09%) Babel
11 7 (1.09%) Mocha
11 7 (1.09%) NUnit
11 7 (1.09%) Selenium
12 5 (0.78%) Balsamiq
12 5 (0.78%) CircleCI
12 5 (0.78%) gulp
General
1 131 (20.44%) Finance
2 123 (19.19%) Social Skills
3 98 (15.29%) Analytical Skills
4 63 (9.83%) Retail
5 57 (8.89%) Banking
6 36 (5.62%) Marketing
7 22 (3.43%) Inclusion and Diversity
7 22 (3.43%) Telecoms
8 21 (3.28%) Presentation Skills
9 13 (2.03%) Financial Institution
10 12 (1.87%) Investment Banking
11 11 (1.72%) Advertising
11 11 (1.72%) Czech Language
12 9 (1.40%) Automotive
12 9 (1.40%) Electronics
12 9 (1.40%) Public Sector
13 8 (1.25%) Legal
13 8 (1.25%) Private Banking
14 7 (1.09%) Aerospace
14 7 (1.09%) Games
Job Titles
1 231 (36.04%) Developer
2 114 (17.78%) Senior Developer
3 110 (17.16%) Data Engineer
4 104 (16.22%) Architect
5 67 (10.45%) Java Developer
6 63 (9.83%) Data Architect
7 47 (7.33%) Software Engineer
8 46 (7.18%) Azure Engineer
9 42 (6.55%) Senior Java Developer
10 38 (5.93%) Solutions Architect
11 35 (5.46%) Cloud Architect
12 32 (4.99%) C# Developer
12 32 (4.99%) DevOps Engineer
13 29 (4.52%) Analyst
13 29 (4.52%) Front End Developer (Client-Side Developer)
14 28 (4.37%) Python Engineer
15 27 (4.21%) Consultant
16 25 (3.90%) Senior Architect
17 24 (3.74%) Big Data Engineer
18 23 (3.59%) Software Developer
Libraries, Frameworks & Software Standards
1 81 (12.64%) Kafka
2 78 (12.17%) .NET
3 69 (10.76%) React
4 61 (9.52%) Node.js
5 51 (7.96%) HTML
6 39 (6.08%) CSS
7 37 (5.77%) AngularJS
8 35 (5.46%) .NET Core
9 32 (4.99%) REST
10 29 (4.52%) Django
11 24 (3.74%) HTML5
11 24 (3.74%) Web Services
12 23 (3.59%) Vue.js
13 21 (3.28%) NumPy
14 19 (2.96%) D3.js
15 16 (2.50%) GraphQL
15 16 (2.50%) Jest
15 16 (2.50%) Torch
16 15 (2.34%) jQuery
16 15 (2.34%) JSON
Miscellaneous
1 48 (7.49%) Algorithms
2 45 (7.02%) User Experience
3 42 (6.55%) Cloud Native
3 42 (6.55%) Hybrid Cloud
4 22 (3.43%) Data Structures
5 20 (3.12%) Virtual Team
6 19 (2.96%) Self-Motivation
7 16 (2.50%) Mobile App
8 15 (2.34%) Hedge funds
8 15 (2.34%) Public Cloud
9 14 (2.18%) Reference Data
10 12 (1.87%) Management Information System
11 11 (1.72%) Life Science
11 11 (1.72%) Tandem
12 9 (1.40%) Enterprise Cloud
13 8 (1.25%) CMDB
13 8 (1.25%) Data Centre
13 8 (1.25%) Private Cloud
14 6 (0.94%) Enterprise Software
15 5 (0.78%) Greenfield Project
Operating Systems
1 52 (8.11%) Linux
2 11 (1.72%) Windows
3 10 (1.56%) Unix
4 7 (1.09%) CentOS
5 5 (0.78%) Red Hat Enterprise Linux
6 4 (0.62%) Windows Server
7 1 (0.16%) Ubuntu
Processes & Methodologies
1 253 (39.47%) Analytics
2 203 (31.67%) Artificial Intelligence
3 184 (28.71%) ETL
4 180 (28.08%) Business Intelligence
5 178 (27.77%) Agile Software Development
6 156 (24.34%) DevOps
7 153 (23.87%) Data Modelling
8 149 (23.24%) Machine Learning
9 133 (20.75%) Software Engineering
10 125 (19.50%) Visualisation
11 121 (18.88%) Data Science
12 106 (16.54%) Data Pipeline
13 88 (13.73%) Problem-Solving
14 84 (13.10%) Microservices
15 83 (12.95%) Data Analytics
16 75 (11.70%) Computer Science
17 72 (11.23%) Data Engineering
18 65 (10.14%) Data Visualisation
19 64 (9.98%) Data Management
20 62 (9.67%) Data Governance
Programming Languages
1 288 (44.93%) Python
2 261 (40.72%) SQL
3 191 (29.80%) Java
4 91 (14.20%) C#
5 76 (11.86%) JavaScript
6 64 (9.98%) Scala
7 56 (8.74%) TypeScript
8 47 (7.33%) Go
9 30 (4.68%) R
10 29 (4.52%) PowerShell
11 21 (3.28%) Ruby
12 20 (3.12%) C
13 12 (1.87%) C++
13 12 (1.87%) Cython
13 12 (1.87%) Java 8
14 11 (1.72%) Bash Shell
15 10 (1.56%) Perl
16 9 (1.40%) PHP
17 7 (1.09%) Clojure
17 7 (1.09%) VB
Qualifications
1 86 (13.42%) Degree
2 39 (6.08%) Computer Science Degree
3 31 (4.84%) Security Cleared
4 24 (3.74%) SC Cleared
5 14 (2.18%) PhD
6 8 (1.25%) Master's Degree
7 3 (0.47%) BC Cleared
7 3 (0.47%) CCIE
7 3 (0.47%) Cisco Certification
7 3 (0.47%) JNCIE
8 2 (0.31%) CFA
8 2 (0.31%) MCDBA
8 2 (0.31%) MCT
8 2 (0.31%) Microsoft Certification
8 2 (0.31%) TOGAF Certification
9 1 (0.16%) AWS Certification
9 1 (0.16%) BPSS Clearance
9 1 (0.16%) DV Cleared
9 1 (0.16%) OCP
9 1 (0.16%) Oracle Certification
Quality Assurance & Compliance
1 57 (8.89%) Data Quality
2 26 (4.06%) QA
3 9 (1.40%) Accessibility
4 5 (0.78%) Actionable Recommendations
5 4 (0.62%) PMO
6 3 (0.47%) GDPR
7 1 (0.16%) COBIT
7 1 (0.16%) GxP
7 1 (0.16%) ISO/IEC 27001
7 1 (0.16%) NIST
System Software
1 167 (26.05%) Docker
2 9 (1.40%) Active Directory
3 7 (1.09%) Virtual Machines
4 5 (0.78%) Apache ZooKeeper
4 5 (0.78%) HDFS
5 1 (0.16%) VMware Infrastructure
Systems Management
1 158 (24.65%) Kubernetes
2 55 (8.58%) Terraform
3 50 (7.80%) Ansible
4 14 (2.18%) Hadoop YARN
5 12 (1.87%) Oozie
5 12 (1.87%) Puppet
6 8 (1.25%) ITRS Geneos
7 6 (0.94%) Prometheus
8 5 (0.78%) MIIS
8 5 (0.78%) Opscode Chef
8 5 (0.78%) Single Sign-On
9 3 (0.47%) Grafana
9 3 (0.47%) HAProxy
9 3 (0.47%) Istio
9 3 (0.47%) Knative
10 2 (0.31%) Docker Swarm
10 2 (0.31%) Graphite
10 2 (0.31%) Kibana
10 2 (0.31%) Salt
11 1 (0.16%) Control-M
Vendors
1 68 (10.61%) Google
2 66 (10.30%) Microsoft
3 61 (9.52%) Databricks
4 56 (8.74%) Oracle
5 37 (5.77%) Informatica
6 24 (3.74%) Cloudera
7 20 (3.12%) StreamSets
8 17 (2.65%) Splunk
9 15 (2.34%) Adobe
9 15 (2.34%) Yahoo!
10 14 (2.18%) SAP
11 12 (1.87%) Hortonworks
12 10 (1.56%) Salesforce.com
13 9 (1.40%) MKS
14 8 (1.25%) Intel
14 8 (1.25%) ServiceNow
14 8 (1.25%) Talend
14 8 (1.25%) Teradata
15 7 (1.09%) Qubit
16 6 (0.94%) Red Hat