Period
to 28 July 2021

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 28 July 2021 with a comparison to the same period in the previous 2 years.

Big Data
UK > Work from Home
6 months to
28 Jul 2021
Same period 2020 Same period 2019
Rank 128 150 75
Rank change year-on-year +22 -75 +36
Permanent jobs citing Big Data 613 88 337
As % of all permanent jobs with a WFH option 2.68% 1.63% 4.15%
As % of the Database & Business Intelligence category 8.95% 5.50% 13.75%
Number of salaries quoted 498 80 306
10th Percentile £45,875 £41,125 £38,000
25th Percentile £53,750 £47,313 £53,750
Median annual salary (50th Percentile) £70,000 £66,250 £70,000
Median % change year-on-year +5.66% -5.36% +16.67%
75th Percentile £85,000 £91,250 £91,875
90th Percentile £93,750 £115,500 £112,500
UK median annual salary £70,000 £65,000 £67,500
% change year-on-year +7.69% -3.70% +3.85%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Work from Home
Permanent vacancies with a requirement for database or business intelligence skills 6,846 1,600 2,451
As % of all permanent jobs with a WFH option 29.98% 29.61% 30.16%
Number of salaries quoted 5,402 1,408 2,202
10th Percentile £35,000 £33,750 £33,625
25th Percentile £42,500 £42,500 £41,250
Median annual salary (50th Percentile) £55,000 £55,000 £55,000
75th Percentile £75,000 £71,250 £73,750
90th Percentile £90,000 £85,000 £85,000
UK median annual salary £55,000 £55,000 £51,786
% change year-on-year - +6.21% +3.57%

Big Data
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Big Data as a proportion of all IT jobs advertised.

Big Data trend for jobs with a WFH option

Big Data
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Big Data.

Big Data salary trend for jobs with a WFH option

Big Data
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Big Data over the 6 months to 28 July 2021.

Big Data salary histogram for jobs with a WFH option

For the 6 months to 28 July 2021, Big Data job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent jobs with a WFH option and a requirement for Big Data.

1 311 (50.73%) AWS
2 273 (44.54%) Azure
3 258 (42.09%) Python
4 250 (40.78%) Artificial Intelligence
5 247 (40.29%) SQL
6 235 (38.34%) Agile Software Development
7 206 (33.61%) GCP
8 192 (31.32%) Software Engineering
9 191 (31.16%) ETL
10 189 (30.83%) Machine Learning
11 187 (30.51%) Docker
12 182 (29.69%) Kubernetes
12 182 (29.69%) Analytics
13 168 (27.41%) DevOps
14 159 (25.94%) Java
15 145 (23.65%) Business Intelligence
16 136 (22.19%) Finance
17 128 (20.88%) Data Pipeline
18 118 (19.25%) Data Modelling
19 117 (19.09%) Data Science
20 114 (18.60%) C#
21 112 (18.27%) Apache Spark
22 111 (18.11%) .NET
22 111 (18.11%) Data Warehouse
23 108 (17.62%) Visualisation
24 102 (16.64%) Social Skills
25 100 (16.31%) PostgreSQL
26 98 (15.99%) JavaScript
27 95 (15.50%) Microservices
28 89 (14.52%) Hadoop

Big Data
Co-occurring IT Skills with a WFH Option by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 112 (18.27%) Apache Spark
2 34 (5.55%) Apache
2 34 (5.55%) Apache Airflow
3 17 (2.77%) Elasticsearch
4 8 (1.31%) Luigi
5 6 (0.98%) Apache Pig
6 4 (0.65%) Confluence
7 3 (0.49%) Apache Solr
8 2 (0.33%) EPiServer
8 2 (0.33%) Moodle
8 2 (0.33%) WordPress
9 1 (0.16%) Apache Pulsar
9 1 (0.16%) ArcGIS
9 1 (0.16%) Jupyter
9 1 (0.16%) Oracle Application Server
9 1 (0.16%) SAS
9 1 (0.16%) Tomcat
Applications
1 7 (1.14%) Figma
1 7 (1.14%) Sketch
2 3 (0.49%) Microsoft Excel
3 2 (0.33%) Microsoft Office
3 2 (0.33%) Microsoft PowerPoint
3 2 (0.33%) Weka
Business Applications
1 11 (1.79%) Sentinel
2 4 (0.65%) Oracle BPM
3 2 (0.33%) Adobe Campaign
3 2 (0.33%) Dynamics CRM
3 2 (0.33%) SAP S/4HANA
3 2 (0.33%) WebTrends
4 1 (0.16%) Oracle EBS
4 1 (0.16%) Oracle EBS R12
4 1 (0.16%) Oracle ERP
4 1 (0.16%) SAP CRM
4 1 (0.16%) SAP ERP
4 1 (0.16%) SAP Hybris
Cloud Services
1 311 (50.73%) AWS
2 273 (44.54%) Azure
3 206 (33.61%) GCP
4 70 (11.42%) Power Platform
5 57 (9.30%) SaaS
6 50 (8.16%) Azure Data Factory
7 39 (6.36%) Serverless
8 29 (4.73%) PaaS
8 29 (4.73%) Snowflake
9 26 (4.24%) AWS Lambda
10 24 (3.92%) Amazon S3
11 22 (3.59%) Amazon EMR
11 22 (3.59%) IaaS
12 21 (3.43%) Azure Sentinel
12 21 (3.43%) Cloud Computing
13 18 (2.94%) AWS CloudFormation
14 16 (2.61%) Amazon EC2
15 13 (2.12%) Azure Stack
15 13 (2.12%) CloudFront
16 11 (1.79%) Azure Functions
Communications & Networking
1 11 (1.79%) Firewall
2 9 (1.47%) LAN
2 9 (1.47%) WAN
3 6 (0.98%) Internet
3 6 (0.98%) SMS
3 6 (0.98%) SSL
4 4 (0.65%) FTP
5 3 (0.49%) DNS
5 3 (0.49%) VLAN
6 2 (0.33%) 4G
6 2 (0.33%) AMQP
6 2 (0.33%) BGP
6 2 (0.33%) Cisco ASA
6 2 (0.33%) OSPF
7 1 (0.16%) Network Security
Database & Business Intelligence
1 111 (18.11%) Data Warehouse
2 100 (16.31%) PostgreSQL
3 89 (14.52%) Hadoop
4 82 (13.38%) Data Lake
5 70 (11.42%) Amazon Redshift
6 69 (11.26%) Power BI
7 68 (11.09%) GIS
8 64 (10.44%) Redis
9 55 (8.97%) NoSQL
10 53 (8.65%) Tableau
11 48 (7.83%) BigQuery
12 42 (6.85%) Apache Hive
13 39 (6.36%) SQL Server
14 33 (5.38%) MySQL
14 33 (5.38%) Relational Database
15 28 (4.57%) Azure SQL Data Warehouse
15 28 (4.57%) MongoDB
16 26 (4.24%) Amazon RDS
16 26 (4.24%) Looker
17 23 (3.75%) Apache Cassandra
Development Applications
1 55 (8.97%) Git (software)
2 42 (6.85%) Jenkins
3 32 (5.22%) JIRA
4 18 (2.94%) webpack
5 15 (2.45%) Bitbucket
6 10 (1.63%) Atlassian Bamboo
7 9 (1.47%) gulp
8 8 (1.31%) Selenium
9 6 (0.98%) Gradle
9 6 (0.98%) Maven
9 6 (0.98%) Postman
9 6 (0.98%) Visual Studio
10 5 (0.82%) Team Foundation Server
11 4 (0.65%) Cucumber
11 4 (0.65%) Vagrant
12 3 (0.49%) REST Assured
12 3 (0.49%) TestNG
12 3 (0.49%) WebDriver
13 2 (0.33%) GitLab
13 2 (0.33%) Mocha
General
1 136 (22.19%) Finance
2 102 (16.64%) Social Skills
3 74 (12.07%) Analytical Skills
4 72 (11.75%) Retail
5 51 (8.32%) Banking
6 49 (7.99%) Telecoms
7 47 (7.67%) Marketing
8 21 (3.43%) Presentation Skills
9 17 (2.77%) Games
10 14 (2.28%) Czech Language
11 12 (1.96%) Advertising
11 12 (1.96%) Electronics
12 10 (1.63%) Automotive
13 9 (1.47%) Financial Institution
13 9 (1.47%) Manufacturing
13 9 (1.47%) Public Sector
14 7 (1.14%) Influencing Skills
15 6 (0.98%) Documentation Skills
15 6 (0.98%) Inclusion and Diversity
16 4 (0.65%) Legal
Job Titles
1 207 (33.77%) Developer
2 99 (16.15%) Data Engineer
3 91 (14.85%) Senior Developer
4 76 (12.40%) Architect
5 61 (9.95%) C# Developer
6 52 (8.48%) Java Developer
6 52 (8.48%) Software Engineer
7 46 (7.50%) Consultant
8 41 (6.69%) Data Architect
9 35 (5.71%) Senior Data Engineer
10 31 (5.06%) Azure Engineer
11 29 (4.73%) DevOps Engineer
12 28 (4.57%) Analyst
12 28 (4.57%) Python Engineer
13 26 (4.24%) Senior Architect
14 24 (3.92%) Senior C# Developer
14 24 (3.92%) Senior Java Developer
15 22 (3.59%) Big Data Engineer
15 22 (3.59%) Java Engineer
16 21 (3.43%) Front End Developer (Client-Side Developer)
Libraries, Frameworks & Software Standards
1 111 (18.11%) .NET
2 75 (12.23%) Kafka
3 73 (11.91%) React
4 60 (9.79%) Node.js
5 50 (8.16%) AngularJS
6 48 (7.83%) CSS
7 45 (7.34%) REST
8 44 (7.18%) Django
9 43 (7.01%) Vue.js
10 42 (6.85%) .NET Core
11 41 (6.69%) NumPy
12 37 (6.04%) HTML
13 31 (5.06%) Torch
14 28 (4.57%) Celery
15 27 (4.40%) Web Services
16 25 (4.08%) D3.js
17 23 (3.75%) GraphQL
18 22 (3.59%) Spring
18 22 (3.59%) Spring Boot
19 20 (3.26%) Apache Beam
Miscellaneous
1 61 (9.95%) User Experience
2 59 (9.62%) Hybrid Cloud
3 42 (6.85%) Algorithms
4 41 (6.69%) Cloud Native
4 41 (6.69%) Hedge funds
5 12 (1.96%) Data Structures
6 11 (1.79%) Mobile App
6 11 (1.79%) Tandem
7 10 (1.63%) Reference Data
7 10 (1.63%) Virtual Team
8 8 (1.31%) Data Centre
8 8 (1.31%) Enterprise Cloud
9 7 (1.14%) Greenfield Project
9 7 (1.14%) Private Cloud
10 5 (0.82%) Enterprise Software
10 5 (0.82%) Internet of Things
10 5 (0.82%) NHS
10 5 (0.82%) Public Cloud
11 4 (0.65%) CMDB
11 4 (0.65%) Management Information System
Operating Systems
1 43 (7.01%) Linux
2 7 (1.14%) Red Hat Enterprise Linux
3 4 (0.65%) Unix
4 3 (0.49%) Windows
5 2 (0.33%) CentOS
Processes & Methodologies
1 250 (40.78%) Artificial Intelligence
2 235 (38.34%) Agile Software Development
3 192 (31.32%) Software Engineering
4 191 (31.16%) ETL
5 189 (30.83%) Machine Learning
6 182 (29.69%) Analytics
7 168 (27.41%) DevOps
8 145 (23.65%) Business Intelligence
9 128 (20.88%) Data Pipeline
10 118 (19.25%) Data Modelling
11 117 (19.09%) Data Science
12 108 (17.62%) Visualisation
13 95 (15.50%) Microservices
14 70 (11.42%) Problem-Solving
15 66 (10.77%) Data Analytics
16 64 (10.44%) Data Ingestion
17 61 (9.95%) Data Engineering
18 60 (9.79%) Full Stack Development
19 58 (9.46%) Fintech
20 55 (8.97%) Mentoring
Programming Languages
1 258 (42.09%) Python
2 247 (40.29%) SQL
3 159 (25.94%) Java
4 114 (18.60%) C#
5 98 (15.99%) JavaScript
6 69 (11.26%) TypeScript
7 44 (7.18%) Go
8 43 (7.01%) Scala
9 34 (5.55%) C
10 30 (4.89%) Cython
11 24 (3.92%) C++
12 21 (3.43%) Ruby
13 18 (2.94%) Java 8
13 18 (2.94%) PowerShell
14 17 (2.77%) R
15 16 (2.61%) Java 11
16 13 (2.12%) PHP
17 12 (1.96%) Bash Shell
18 10 (1.63%) Clojure
19 7 (1.14%) Data Analysis Expressions (DAX)
Qualifications
1 53 (8.65%) Degree
2 27 (4.40%) PhD
3 23 (3.75%) Computer Science Degree
4 21 (3.43%) Security Cleared
5 9 (1.47%) SC Cleared
6 6 (0.98%) DV Cleared
7 3 (0.49%) BC Cleared
8 2 (0.33%) CCIE
8 2 (0.33%) CFA
8 2 (0.33%) Cisco Certification
8 2 (0.33%) JNCIE
8 2 (0.33%) Master's Degree
8 2 (0.33%) MCDBA
8 2 (0.33%) MCT
8 2 (0.33%) Microsoft Certification
8 2 (0.33%) SAP Certification
9 1 (0.16%) OCP
9 1 (0.16%) Oracle Certification
Quality Assurance & Compliance
1 29 (4.73%) Data Quality
2 21 (3.43%) QA
3 13 (2.12%) Accessibility
4 3 (0.49%) ISO/IEC 27001
5 2 (0.33%) COBIT
5 2 (0.33%) GDPR
5 2 (0.33%) NIST
5 2 (0.33%) PMO
6 1 (0.16%) GxP
System Software
1 187 (30.51%) Docker
2 10 (1.63%) Active Directory
3 9 (1.47%) Virtual Machines
4 7 (1.14%) HDFS
5 4 (0.65%) Apache Flume
5 4 (0.65%) Apache ZooKeeper
5 4 (0.65%) VirtualBox
6 1 (0.16%) VMware Infrastructure
Systems Management
1 182 (29.69%) Kubernetes
2 64 (10.44%) Ansible
3 38 (6.20%) Terraform
4 11 (1.79%) Hadoop YARN
4 11 (1.79%) Puppet
5 5 (0.82%) Docker Swarm
6 4 (0.65%) ITRS Geneos
6 4 (0.65%) Opscode Chef
7 3 (0.49%) Prometheus
8 1 (0.16%) Control-M
8 1 (0.16%) Failover Clustering
8 1 (0.16%) Grafana
8 1 (0.16%) Graphite
8 1 (0.16%) HAProxy
8 1 (0.16%) Istio
8 1 (0.16%) Oozie
8 1 (0.16%) Salt
8 1 (0.16%) SCCM
Vendors
1 72 (11.75%) Google
2 53 (8.65%) Databricks
3 51 (8.32%) Microsoft
4 38 (6.20%) Yahoo!
5 25 (4.08%) SAP
6 23 (3.75%) Oracle
7 17 (2.77%) Informatica
8 15 (2.45%) Cloudera
9 13 (2.12%) Qubit
10 10 (1.63%) Splunk
11 9 (1.47%) Adobe
11 9 (1.47%) Talend
12 8 (1.31%) MKS
12 8 (1.31%) Red Hat
13 7 (1.14%) Teradata
14 6 (0.98%) Salesforce.com
14 6 (0.98%) StreamSets
15 5 (0.82%) Hyperion
16 4 (0.65%) Apple
16 4 (0.65%) IBM