Period
to 12 July 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 12 July 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
12 Jul 2020
Same period 2019 Same period 2018
Rank 112 91 77
Rank change year-on-year -21 -14 +10
Permanent jobs citing Big Data 2,166 4,944 7,048
As % of all permanent jobs advertised in the UK 2.81% 3.36% 3.97%
As % of the Database & Business Intelligence category 10.39% 12.16% 13.04%
Number of salaries quoted 1,793 4,210 5,043
Median annual salary £67,500 £67,500 £65,000
Median salary % change year-on-year - +3.85% +4.00%
10th Percentile £40,000 £35,250 £37,500
90th Percentile £103,750 £105,000 £95,000
UK excluding London median annual salary £60,000 £52,350 £55,000
% change year-on-year +14.61% -4.82% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 20,855 40,664 54,060
As % of all permanent IT jobs advertised in the UK 27.03% 27.61% 30.48%
Number of salaries quoted 17,007 33,303 44,091
Median annual salary £55,000 £52,000 £50,000
Median salary % change year-on-year +5.77% +4.00% +5.26%
10th Percentile £32,500 £31,250 £31,250
90th Percentile £88,750 £85,000 £81,250
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

3-month moving average salary quoted in jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

Salary distribution for jobs citing Big Data over the 6 months to 12 July 2020.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 12 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -14 2,066 £67,500 -3.57% 197
London -28 1,139 £75,000 -3.23% 104
UK excluding London +3 1,016 £60,000 +14.61% 109
South East +53 393 £60,000 +9.09% 30
North of England +22 159 £62,500 +14.68% 17
South West -45 146 £57,500 +15.00% 13
Midlands +35 142 £55,000 +10.00% 20
Work from Home -40 131 £75,000 +7.14% 25
North West +26 102 £65,000 +18.18% 8
East of England +27 92 £70,000 +8.74% 13
West Midlands +55 85 £55,000 +15.79% 12
Scotland -25 68 £50,000 +25.00% 7
East Midlands -1 55 £75,000 +50.00% 8
Yorkshire +57 43 £55,000 +0.92% 7
Wales -13 16 £45,000 +23.29% 8
North East +3 14 £70,000 +35.09% 2
Northern Ireland +20 2 - - 1

For the 6 months to 12 July 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 970 (44.78%) Python
2 856 (39.52%) Agile Software Development
3 812 (37.49%) Analytics
4 784 (36.20%) SQL
5 724 (33.43%) AWS
6 713 (32.92%) Java
7 678 (31.30%) Hadoop
8 632 (29.18%) Apache Spark
9 559 (25.81%) Azure
10 548 (25.30%) Machine Learning
11 538 (24.84%) Data Science
12 497 (22.95%) DevOps
13 481 (22.21%) Finance
14 449 (20.73%) Degree
15 448 (20.68%) Business Intelligence
16 406 (18.74%) Kafka
17 404 (18.65%) Artificial Intelligence
18 359 (16.57%) Data Warehouse
19 356 (16.44%) ETL
19 356 (16.44%) Software Engineering
20 355 (16.39%) Scala
21 323 (14.91%) NoSQL
22 311 (14.36%) Docker
23 303 (13.99%) Data Modelling
24 301 (13.90%) JavaScript
25 299 (13.80%) Data Analytics
26 297 (13.71%) GCP
27 279 (12.88%) SQL Server
28 278 (12.83%) Analytical Skills
29 276 (12.74%) Computer Science

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 632 (29.18%) Apache Spark
2 123 (5.68%) Apache
3 118 (5.45%) Elasticsearch
4 69 (3.19%) Apache Airflow
5 44 (2.03%) SAS
6 34 (1.57%) Luigi
7 28 (1.29%) Jupyter
8 27 (1.25%) Confluence
9 25 (1.15%) Apache Solr
10 17 (0.78%) Apache Pig
10 17 (0.78%) Tomcat
11 14 (0.65%) CMS
12 13 (0.60%) Cloud Foundry
12 13 (0.60%) OpenStack
13 10 (0.46%) Mule
13 10 (0.46%) nginx
14 8 (0.37%) Moodle
14 8 (0.37%) Tornado
15 7 (0.32%) ArcGIS
15 7 (0.32%) JBoss
Applications
1 30 (1.39%) Microsoft Excel
2 11 (0.51%) SPSS
3 9 (0.42%) MS Visio
4 6 (0.28%) Microsoft Office
4 6 (0.28%) Microsoft Project
5 5 (0.23%) Microsoft PowerPoint
6 2 (0.092%) Gephi
Business Applications
1 9 (0.42%) Sparx Enterprise Architect
2 7 (0.32%) SAP IS-U
3 5 (0.23%) Oracle Subledger Accounting
3 5 (0.23%) SAP CRM
3 5 (0.23%) SAP ERP
3 5 (0.23%) SAP S/4HANA
4 4 (0.18%) Eikon
4 4 (0.18%) SAP BPC
5 3 (0.14%) NetSuite
6 2 (0.092%) R3 Corda
6 2 (0.092%) SAP IBP
7 1 (0.046%) Adobe Campaign
7 1 (0.046%) Distributed Ledger
7 1 (0.046%) Oracle BPM
7 1 (0.046%) Payment Gateway
7 1 (0.046%) SAP CO
7 1 (0.046%) SAP EWM
7 1 (0.046%) SAP FI/CO
7 1 (0.046%) SimCorp Dimension
7 1 (0.046%) Workday HCM
Cloud Services
1 724 (33.43%) AWS
2 559 (25.81%) Azure
3 297 (13.71%) GCP
4 241 (11.13%) Power Platform
5 122 (5.63%) SaaS
6 104 (4.80%) Amazon EMR
7 101 (4.66%) Amazon S3
8 89 (4.11%) Amazon EC2
9 76 (3.51%) Serverless
10 54 (2.49%) PaaS
11 49 (2.26%) Azure Data Factory
12 48 (2.22%) IaaS
13 45 (2.08%) Amazon Kinesis
14 43 (1.99%) Cloud Computing
15 41 (1.89%) AWS Lambda
16 27 (1.25%) GitHub
17 26 (1.20%) Amazon CloudWatch
18 25 (1.15%) Amazon SQS
18 25 (1.15%) Slack
19 16 (0.74%) Logic Apps
Communications & Networking
1 63 (2.91%) Internet
2 32 (1.48%) Firewall
3 18 (0.83%) HTTP
4 16 (0.74%) BGP
4 16 (0.74%) Skype
5 14 (0.65%) MPLS
6 13 (0.60%) DNS
7 12 (0.55%) Broadband
7 12 (0.55%) FTP
7 12 (0.55%) TCP/IP
7 12 (0.55%) WAN
8 11 (0.51%) SAN
8 11 (0.51%) SSL
9 7 (0.32%) Intrusion Detection
10 6 (0.28%) MQTT
11 5 (0.23%) 5G
11 5 (0.23%) SSH
12 4 (0.18%) OSPF
13 3 (0.14%) Network Security
13 3 (0.14%) VPN
Database & Business Intelligence
1 678 (31.30%) Hadoop
2 359 (16.57%) Data Warehouse
3 323 (14.91%) NoSQL
4 279 (12.88%) SQL Server
5 271 (12.51%) Data Lake
6 241 (11.13%) Power BI
7 229 (10.57%) Apache Hive
8 176 (8.13%) Relational Database
9 154 (7.11%) MongoDB
10 148 (6.83%) Amazon Redshift
11 144 (6.65%) Apache Cassandra
12 142 (6.56%) SQL Server Integration Services
13 134 (6.19%) HBase
14 127 (5.86%) PostgreSQL
15 110 (5.08%) SQL Server Reporting Services
16 102 (4.71%) MySQL
17 82 (3.79%) SQL Server Analysis Services
18 81 (3.74%) Impala
19 80 (3.69%) BigQuery
20 68 (3.14%) Neo4j
Development Applications
1 255 (11.77%) Git (software)
2 135 (6.23%) Jenkins
3 88 (4.06%) JIRA
4 33 (1.52%) JUnit
5 32 (1.48%) Atlassian Bamboo
6 28 (1.29%) Maven
7 25 (1.15%) Sonatype Nexus
8 23 (1.06%) Visual Studio Team System
9 21 (0.97%) GitLab
10 19 (0.88%) Bitbucket
11 17 (0.78%) Cucumber
11 17 (0.78%) Team Foundation Server
12 16 (0.74%) Subversion
13 15 (0.69%) ERwin
13 15 (0.69%) Octopus Deploy
13 15 (0.69%) TeamCity
14 14 (0.65%) Artifactory
14 14 (0.65%) Vagrant
15 12 (0.55%) GoCD
15 12 (0.55%) Selenium
General
1 481 (22.21%) Finance
2 128 (5.91%) Marketing
3 103 (4.76%) Retail
4 96 (4.43%) Banking
5 62 (2.86%) Public Sector
6 52 (2.40%) Telecoms
7 45 (2.08%) Legal
8 42 (1.94%) Manufacturing
9 34 (1.57%) Advertising
10 32 (1.48%) Front Office
11 31 (1.43%) Aerospace
12 30 (1.39%) Pharmaceutical
13 28 (1.29%) Law
14 24 (1.11%) Local Government
15 21 (0.97%) Games
16 18 (0.83%) Automotive
17 13 (0.60%) Electronics
18 8 (0.37%) Investment Banking
19 7 (0.32%) Retail Banking
20 6 (0.28%) Financial Institution
Job Titles
1 497 (22.95%) Developer
2 490 (22.62%) Data Engineer
3 296 (13.67%) Architect
4 170 (7.85%) Java Developer
5 161 (7.43%) Data Architect
6 144 (6.65%) Big Data Engineer
7 120 (5.54%) Solutions Architect
8 118 (5.45%) Data Scientist
9 116 (5.36%) Software Engineer
10 95 (4.39%) Analyst
11 94 (4.34%) Senior Developer
12 85 (3.92%) Senior Data Engineer
13 80 (3.69%) Python Engineer
14 75 (3.46%) AWS Engineer
15 71 (3.28%) Consultant
16 70 (3.23%) DevOps Engineer
17 66 (3.05%) Big Data Architect
18 64 (2.95%) Business Intelligence Developer
19 61 (2.82%) Cloud Architect
20 60 (2.77%) SQL Developer
Libraries, Frameworks & Software Standards
1 406 (18.74%) Kafka
2 176 (8.13%) .NET
3 142 (6.56%) HTML
4 110 (5.08%) CSS
5 107 (4.94%) Spring
6 104 (4.80%) AngularJS
7 99 (4.57%) Web Services
8 91 (4.20%) React
9 88 (4.06%) Natural Language Processing
10 80 (3.69%) Node.js
11 69 (3.19%) HTML5
11 69 (3.19%) REST
12 58 (2.68%) Spring Boot
13 57 (2.63%) TensorFlow
14 56 (2.59%) ASP.NET
15 51 (2.35%) RESTful
16 49 (2.26%) Spark Streaming
17 47 (2.17%) Pandas
18 46 (2.12%) Django
18 46 (2.12%) NumPy
Miscellaneous
1 278 (12.83%) Analytical Skills
2 167 (7.71%) Algorithms
3 106 (4.89%) Data Structures
4 90 (4.16%) Greenfield Project
5 86 (3.97%) User Experience
6 65 (3.00%) Management Information System
7 54 (2.49%) Cloud Native
8 51 (2.35%) Enterprise Software
9 47 (2.17%) Public Cloud
10 44 (2.03%) Internet of Things
11 37 (1.71%) Self-Motivation
12 36 (1.66%) Mobile App
13 33 (1.52%) Hedge funds
13 33 (1.52%) Hybrid Cloud
14 30 (1.39%) Virtual Team
15 29 (1.34%) Equities
16 24 (1.11%) PKI
17 21 (0.97%) Data Centre
18 18 (0.83%) Blog
19 17 (0.78%) Linux Command Line
Operating Systems
1 265 (12.23%) Linux
2 113 (5.22%) Unix
3 107 (4.94%) Windows
4 31 (1.43%) Red Hat Enterprise Linux
5 17 (0.78%) CentOS
6 10 (0.46%) Apple iOS
7 8 (0.37%) Android
7 8 (0.37%) Windows Server
8 7 (0.32%) Ubuntu
9 6 (0.28%) Debian
10 4 (0.18%) Fedora
11 2 (0.092%) Robot Operating System
11 2 (0.092%) Solaris
12 1 (0.046%) Mac OS
12 1 (0.046%) Oracle Linux
12 1 (0.046%) Windows Server 2012
Processes & Methodologies
1 856 (39.52%) Agile Software Development
2 812 (37.49%) Analytics
3 548 (25.30%) Machine Learning
4 538 (24.84%) Data Science
5 497 (22.95%) DevOps
6 448 (20.68%) Business Intelligence
7 404 (18.65%) Artificial Intelligence
8 356 (16.44%) ETL
8 356 (16.44%) Software Engineering
9 303 (13.99%) Data Modelling
10 299 (13.80%) Data Analytics
11 276 (12.74%) Computer Science
12 260 (12.00%) Microservices
13 238 (10.99%) Scrum
14 226 (10.43%) Data Engineering
15 192 (8.86%) Continuous Integration
16 184 (8.49%) Mathematics
17 173 (7.99%) Visualisation
18 152 (7.02%) Data Analysis
19 147 (6.79%) OO
Programming Languages
1 970 (44.78%) Python
2 784 (36.20%) SQL
3 713 (32.92%) Java
4 355 (16.39%) Scala
5 301 (13.90%) JavaScript
6 253 (11.68%) R
7 238 (10.99%) C#
8 183 (8.45%) C++
9 88 (4.06%) T-SQL
10 85 (3.92%) Bash Shell
11 81 (3.74%) C
12 80 (3.69%) PHP
13 65 (3.00%) Java 8
14 60 (2.77%) Go
15 57 (2.63%) PowerShell
16 51 (2.35%) PL/SQL
17 49 (2.26%) Perl
18 43 (1.99%) Shell Script
19 42 (1.94%) MATLAB
20 31 (1.43%) TypeScript
Qualifications
1 449 (20.73%) Degree
2 181 (8.36%) Security Cleared
3 160 (7.39%) Computer Science Degree
4 106 (4.89%) DV Cleared
5 85 (3.92%) SC Cleared
6 51 (2.35%) PhD
7 38 (1.75%) Master's Degree
8 24 (1.11%) Cisco Certification
9 22 (1.02%) Numerate Degree
10 19 (0.88%) CCNA
11 17 (0.78%) AWS Certification
11 17 (0.78%) CCNP
12 16 (0.74%) PMI Certification
13 13 (0.60%) Microsoft Certification
14 12 (0.55%) BPSS Clearance
14 12 (0.55%) JNCIP
14 12 (0.55%) JNCIS
15 11 (0.51%) JNCIA
16 7 (0.32%) CompTIA Security+
16 7 (0.32%) SANS
Quality Assurance & Compliance
1 90 (4.16%) QA
2 75 (3.46%) Data Quality
3 36 (1.66%) GDPR
4 23 (1.06%) NIST
5 17 (0.78%) ISO/IEC 27001
6 14 (0.65%) NCSC
6 14 (0.65%) NIST 800
7 12 (0.55%) Sarbanes-Oxley
8 4 (0.18%) PMO
9 3 (0.14%) PCI DSS
9 3 (0.14%) SLA
10 1 (0.046%) Actionable Recommendations
System Software
1 311 (14.36%) Docker
2 89 (4.11%) HDFS
3 35 (1.62%) Apache ZooKeeper
4 28 (1.29%) Apache Flume
5 27 (1.25%) VMware Infrastructure
6 26 (1.20%) Active Directory
7 20 (0.92%) VirtualBox
8 12 (0.55%) Hyper-V
9 8 (0.37%) Virtual Machines
10 6 (0.28%) VMware ESXi
11 5 (0.23%) vSphere
12 4 (0.18%) NFS
12 4 (0.18%) Samba
12 4 (0.18%) Varnish
12 4 (0.18%) Xen
13 2 (0.092%) vCloud
14 1 (0.046%) iptables
14 1 (0.046%) Oracle RAC
14 1 (0.046%) Virtual Servers
Systems Management
1 270 (12.47%) Kubernetes
2 155 (7.16%) Ansible
3 127 (5.86%) Terraform
4 82 (3.79%) Puppet
5 56 (2.59%) Opscode Chef
6 33 (1.52%) Kibana
7 29 (1.34%) Hadoop YARN
8 28 (1.29%) Oozie
9 23 (1.06%) Salt
10 21 (0.97%) Docker Swarm
11 15 (0.69%) Opsview
12 13 (0.60%) Netcool
13 12 (0.55%) Nagios
14 8 (0.37%) Grafana
15 7 (0.32%) logstash
15 7 (0.32%) Mesos
16 6 (0.28%) ZABBIX
17 5 (0.23%) Prometheus
18 4 (0.18%) OpenNMS
18 4 (0.18%) Single Sign-On
Vendors
1 266 (12.28%) Microsoft
2 186 (8.59%) Google
3 158 (7.29%) Oracle
4 132 (6.09%) Tableau
5 106 (4.89%) Informatica
6 103 (4.76%) Databricks
7 85 (3.92%) Talend
8 83 (3.83%) Cloudera
9 55 (2.54%) SAP
10 52 (2.40%) Splunk
11 51 (2.35%) Hortonworks
12 43 (1.99%) IBM
13 42 (1.94%) Sparx
14 38 (1.75%) VMware
15 30 (1.39%) Teradata
16 25 (1.15%) Red Hat
17 23 (1.06%) Ab Initio
18 22 (1.02%) Salesforce.com
19 20 (0.92%) Juniper
20 15 (0.69%) AppDynamics