Period
to 29 January 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 29 January 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
29 Jan 2020
Same period 2019 Same period 2018
Rank 99 87 93
Rank change year-on-year -12 +6 -5
Permanent jobs citing Big Data 3,844 5,387 5,764
As % of all permanent IT jobs advertised in the UK 3.07% 3.54% 3.32%
As % of the Database & Business Intelligence category 11.42% 12.37% 10.86%
Number of salaries quoted 3,046 4,286 4,740
UK median annual salary £70,000 £67,500 £62,500
Median salary % change year-on-year +3.70% +8.00% -
10th Percentile £37,560 £37,500 £36,750
90th Percentile £110,000 £97,500 £95,000
UK excluding London median annual salary £55,000 £55,000 £52,500
% change year-on-year - +4.76% -4.55%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 33,657 43,555 53,090
As % of all permanent IT jobs advertised in the UK 26.85% 28.65% 30.61%
Number of salaries quoted 27,644 35,814 44,148
UK median annual salary £52,500 £52,500 £48,500
Median salary % change year-on-year - +8.25% +2.11%
10th Percentile £32,500 £31,250 £30,000
90th Percentile £88,750 £85,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 29 January 2020.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 29 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -14 3,587 £70,000 - 640
London -9 2,171 £75,000 - 366
UK excluding London -14 1,629 £55,000 - 319
South East -22 482 £57,500 +4.55% 97
North of England +15 302 £54,671 +4.13% 66
South West -21 241 £50,000 -13.04% 33
Midlands -1 234 £60,000 - 34
Scotland +5 183 £47,600 +4.62% 31
North West -17 160 £51,250 -10.87% 37
East of England 0 154 £75,000 +15.38% 43
East Midlands +30 142 £72,500 +11.54% 12
Yorkshire +53 106 £55,000 +4.76% 19
West Midlands -21 87 £53,750 -2.27% 22
North East +21 37 £45,412 -7.96% 10
Wales +4 28 £41,250 -13.16% 15
Northern Ireland +5 6 £35,000 -17.65% 1

For the 6 months to 29 January 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 1,586 (41.26%) Agile Software Development
2 1,507 (39.20%) Python
3 1,393 (36.24%) Analytics
4 1,322 (34.39%) SQL
5 1,297 (33.74%) Java
6 1,191 (30.98%) AWS
7 1,094 (28.46%) Hadoop
8 1,040 (27.06%) Apache Spark
9 984 (25.60%) Machine Learning
10 944 (24.56%) Data Science
11 837 (21.77%) Azure
12 830 (21.59%) Finance
13 753 (19.59%) DevOps
14 721 (18.76%) Degree
15 708 (18.42%) Software Engineering
16 706 (18.37%) ETL
17 663 (17.25%) Artificial Intelligence
18 647 (16.83%) Business Intelligence
19 607 (15.79%) Data Warehouse
20 590 (15.35%) Scala
21 574 (14.93%) NoSQL
22 559 (14.54%) Analytical Skills
23 553 (14.39%) JavaScript
24 549 (14.28%) Linux
25 542 (14.10%) Microservices
26 535 (13.92%) Kafka
27 532 (13.84%) Docker
28 510 (13.27%) Git (software)
29 504 (13.11%) Data Modelling
30 503 (13.09%) Data Analytics

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,040 (27.06%) Apache Spark
2 224 (5.83%) Elasticsearch
3 173 (4.50%) Apache
4 85 (2.21%) Apache Airflow
5 48 (1.25%) SAS
6 42 (1.09%) Confluence
7 33 (0.86%) OpenStack
8 32 (0.83%) Apache Solr
9 28 (0.73%) Jupyter
10 25 (0.65%) Apache Pig
11 24 (0.62%) Luigi
12 21 (0.55%) Tornado
13 20 (0.52%) Cloud Foundry
14 18 (0.47%) IIS
15 16 (0.42%) ArcGIS
15 16 (0.42%) nginx
16 13 (0.34%) NServiceBus
17 12 (0.31%) Tomcat
18 11 (0.29%) SharePoint
19 9 (0.23%) WebLogic
Applications
1 66 (1.72%) Microsoft Excel
2 22 (0.57%) SPSS
3 20 (0.52%) Microsoft Office
4 9 (0.23%) MS Visio
5 8 (0.21%) Chatbot
5 8 (0.21%) Microsoft PowerPoint
6 5 (0.13%) Microsoft Project
7 4 (0.10%) Gephi
8 2 (0.052%) InVision
8 2 (0.052%) Sketch
9 1 (0.026%) Simulink
9 1 (0.026%) Spreadsheet
9 1 (0.026%) SPSS Modeler
9 1 (0.026%) Stata
Business Applications
1 30 (0.78%) Sparx Enterprise Architect
2 21 (0.55%) SAP S/4HANA
3 7 (0.18%) PolarLake
3 7 (0.18%) SAP HCM
4 6 (0.16%) Dynamics CRM
4 6 (0.16%) SAP Payroll
5 5 (0.13%) SAP MDG
6 4 (0.10%) Eagle PACE
6 4 (0.10%) Markit EDM
7 3 (0.078%) Adobe Campaign
7 3 (0.078%) NetSuite
8 2 (0.052%) Eikon
8 2 (0.052%) Oracle Financials
8 2 (0.052%) R3 Corda
8 2 (0.052%) SAP BPC
8 2 (0.052%) SAP MM
9 1 (0.026%) Oracle BPM
9 1 (0.026%) Oracle EBS
9 1 (0.026%) SAP HR
9 1 (0.026%) WebTrends
Cloud Services
1 1,191 (30.98%) AWS
2 837 (21.77%) Azure
3 479 (12.46%) GCP
4 197 (5.12%) Amazon S3
5 185 (4.81%) Power Platform
6 136 (3.54%) Amazon EMR
7 131 (3.41%) SaaS
7 131 (3.41%) Serverless
8 116 (3.02%) Cloud Computing
9 92 (2.39%) Amazon EC2
10 85 (2.21%) AWS Lambda
10 85 (2.21%) PaaS
11 83 (2.16%) Amazon Kinesis
12 61 (1.59%) Azure Data Factory
13 56 (1.46%) Amazon SQS
14 55 (1.43%) IaaS
15 51 (1.33%) OpenShift
16 49 (1.27%) GitHub
17 44 (1.14%) Amazon ECS
18 30 (0.78%) AWS Fargate
Communications & Networking
1 131 (3.41%) Internet
2 64 (1.66%) Firewall
3 46 (1.20%) DNS
4 42 (1.09%) TCP/IP
5 35 (0.91%) HTTP
6 27 (0.70%) DHCP
7 24 (0.62%) DMZ
8 21 (0.55%) HTTPS
9 20 (0.52%) VPN
10 16 (0.42%) Kerberos
11 14 (0.36%) SSL
12 11 (0.29%) SNA
13 10 (0.26%) SSH
14 8 (0.21%) MPLS
14 8 (0.21%) Network Security
14 8 (0.21%) SAN
14 8 (0.21%) Unified Communications
15 6 (0.16%) BGP
15 6 (0.16%) Wi-Fi
16 5 (0.13%) DSL
Database & Business Intelligence
1 1,094 (28.46%) Hadoop
2 607 (15.79%) Data Warehouse
3 574 (14.93%) NoSQL
4 485 (12.62%) Apache Hive
5 381 (9.91%) SQL Server
6 282 (7.34%) Relational Database
7 247 (6.43%) Data Lake
8 235 (6.11%) MongoDB
9 221 (5.75%) PostgreSQL
10 211 (5.49%) Amazon Redshift
11 185 (4.81%) Power BI
12 184 (4.79%) HBase
13 166 (4.32%) Impala
14 155 (4.03%) MySQL
15 140 (3.64%) Apache Cassandra
16 127 (3.30%) Amazon DynamoDB
17 119 (3.10%) SQL Server Integration Services
18 118 (3.07%) BigQuery
19 110 (2.86%) Data Mining
20 97 (2.52%) Flink
Development Applications
1 510 (13.27%) Git (software)
2 314 (8.17%) Jenkins
3 220 (5.72%) JIRA
4 71 (1.85%) Bitbucket
5 65 (1.69%) Visual Studio
6 57 (1.48%) Atlassian Bamboo
7 52 (1.35%) GitLab
8 38 (0.99%) TeamCity
9 36 (0.94%) Vagrant
10 33 (0.86%) ERwin
10 33 (0.86%) Subversion
11 32 (0.83%) JUnit
12 30 (0.78%) git-flow
13 29 (0.75%) Selenium
14 26 (0.68%) Visual Studio Team System
15 23 (0.60%) Maven
15 23 (0.60%) Octopus Deploy
16 22 (0.57%) NetBeans
17 20 (0.52%) Eclipse
18 17 (0.44%) webpack
General
1 830 (21.59%) Finance
2 195 (5.07%) Marketing
3 188 (4.89%) Banking
4 164 (4.27%) Retail
5 105 (2.73%) Public Sector
6 87 (2.26%) Front Office
6 87 (2.26%) Telecoms
7 75 (1.95%) Games
8 71 (1.85%) Legal
9 58 (1.51%) Advertising
10 54 (1.40%) Law
11 52 (1.35%) Manufacturing
12 45 (1.17%) Automotive
13 36 (0.94%) Pharmaceutical
14 30 (0.78%) Billing
15 24 (0.62%) Financial Institution
16 20 (0.52%) Aerospace
17 19 (0.49%) Investment Banking
17 19 (0.49%) Local Government
18 17 (0.44%) Electronics
Job Titles
1 1,049 (27.29%) Developer
2 629 (16.36%) Data Engineer
3 488 (12.70%) Java Developer
4 466 (12.12%) Architect
5 292 (7.60%) Software Engineer
6 264 (6.87%) Data Architect
7 230 (5.98%) Analyst
8 227 (5.91%) Senior Developer
9 219 (5.70%) Data Scientist
10 186 (4.84%) Consultant
11 175 (4.55%) Java Engineer
12 172 (4.47%) Big Data Engineer
13 157 (4.08%) Senior Data Engineer
14 148 (3.85%) Python Engineer
15 131 (3.41%) Java Software Engineer
16 129 (3.36%) Python Developer
17 124 (3.23%) Solutions Architect
18 113 (2.94%) DevOps Engineer
19 112 (2.91%) Data Analyst
20 102 (2.65%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 535 (13.92%) Kafka
2 302 (7.86%) Node.js
3 289 (7.52%) React
4 274 (7.13%) .NET
5 266 (6.92%) AngularJS
6 248 (6.45%) Web Services
7 236 (6.14%) HTML
8 207 (5.39%) RESTful
9 196 (5.10%) CSS
10 171 (4.45%) Spring
11 168 (4.37%) REST
12 138 (3.59%) Natural Language Processing
13 116 (3.02%) J2EE
14 105 (2.73%) TensorFlow
15 96 (2.50%) JSON
16 91 (2.37%) XML
17 85 (2.21%) HTML5
18 77 (2.00%) Middleware
19 69 (1.80%) ASP.NET
20 66 (1.72%) Elastic Stack
Miscellaneous
1 559 (14.54%) Analytical Skills
2 282 (7.34%) Algorithms
3 200 (5.20%) Data Structures
4 185 (4.81%) User Experience
5 172 (4.47%) Greenfield Project
6 144 (3.75%) Management Information System
7 91 (2.37%) Cloud Native
8 90 (2.34%) Internet of Things
9 88 (2.29%) Enterprise Software
10 81 (2.11%) Public Cloud
11 65 (1.69%) Data Centre
12 63 (1.64%) Mobile App
12 63 (1.64%) Robotics
13 60 (1.56%) Social Media
14 49 (1.27%) Linux Command Line
15 47 (1.22%) Self-Motivation
16 45 (1.17%) Fixed Income
16 45 (1.17%) Virtual Team
17 41 (1.07%) Reference Data
18 40 (1.04%) Equities
Operating Systems
1 549 (14.28%) Linux
2 182 (4.73%) Windows
3 175 (4.55%) Unix
4 39 (1.01%) Red Hat Enterprise Linux
5 36 (0.94%) CentOS
6 31 (0.81%) Android
6 31 (0.81%) Ubuntu
7 26 (0.68%) Apple iOS
8 24 (0.62%) Solaris
9 20 (0.52%) Windows Server
10 16 (0.42%) Windows 7
11 13 (0.34%) Fedora
12 10 (0.26%) Mac OS
13 8 (0.21%) Debian
13 8 (0.21%) Windows 10
14 5 (0.13%) Windows Server 2012
15 4 (0.10%) VME
16 2 (0.052%) Oracle Linux
17 1 (0.026%) Mac OS X
Processes & Methodologies
1 1,586 (41.26%) Agile Software Development
2 1,393 (36.24%) Analytics
3 984 (25.60%) Machine Learning
4 944 (24.56%) Data Science
5 753 (19.59%) DevOps
6 708 (18.42%) Software Engineering
7 706 (18.37%) ETL
8 663 (17.25%) Artificial Intelligence
9 647 (16.83%) Business Intelligence
10 542 (14.10%) Microservices
11 504 (13.11%) Data Modelling
12 503 (13.09%) Data Analytics
13 467 (12.15%) Computer Science
14 383 (9.96%) Problem-Solving
15 374 (9.73%) Visualisation
16 370 (9.63%) Data Engineering
17 328 (8.53%) Scrum
18 312 (8.12%) Project Management
19 282 (7.34%) Open Source
20 281 (7.31%) Mentoring
Programming Languages
1 1,507 (39.20%) Python
2 1,322 (34.39%) SQL
3 1,297 (33.74%) Java
4 590 (15.35%) Scala
5 553 (14.39%) JavaScript
6 432 (11.24%) C#
7 328 (8.53%) R
8 254 (6.61%) C++
9 233 (6.06%) C
10 164 (4.27%) Java 8
11 142 (3.69%) Bash Shell
12 110 (2.86%) PL/SQL
12 110 (2.86%) TypeScript
13 101 (2.63%) PHP
14 89 (2.32%) Shell Script
15 87 (2.26%) Go
16 76 (1.98%) T-SQL
17 68 (1.77%) ES6
18 65 (1.69%) Ruby
19 63 (1.64%) PowerShell
Qualifications
1 721 (18.76%) Degree
2 248 (6.45%) Security Cleared
3 226 (5.88%) Computer Science Degree
4 130 (3.38%) DV Cleared
5 123 (3.20%) SC Cleared
6 105 (2.73%) PhD
7 58 (1.51%) Microsoft Certification
8 50 (1.30%) Master's Degree
9 49 (1.27%) Numerate Degree
10 42 (1.09%) CISSP
11 36 (0.94%) Cisco Certification
12 35 (0.91%) CompTIA Security+
13 34 (0.88%) Network+ Certification
14 31 (0.81%) CCNA
15 27 (0.70%) SSCP
16 26 (0.68%) GIAC
16 26 (0.68%) Linux+ Certification
16 26 (0.68%) MCSE
16 26 (0.68%) PMI Certification
16 26 (0.68%) SANS
Quality Assurance & Compliance
1 251 (6.53%) QA
2 221 (5.75%) Data Quality
3 47 (1.22%) GDPR
4 35 (0.91%) SLA
5 30 (0.78%) ISO/IEC 27001
6 7 (0.18%) GMP
6 7 (0.18%) HIPAA
7 6 (0.16%) PCI DSS
7 6 (0.16%) PMO
8 5 (0.13%) Sarbanes-Oxley
9 4 (0.10%) PMBOK
10 3 (0.078%) MiFID
11 2 (0.052%) ISO 26262
12 1 (0.026%) Basel III
12 1 (0.026%) COBIT
12 1 (0.026%) Cyber Essentials
12 1 (0.026%) EMIR
12 1 (0.026%) IFRS
12 1 (0.026%) IFRS 9
12 1 (0.026%) SEPA
System Software
1 532 (13.84%) Docker
2 163 (4.24%) HDFS
3 60 (1.56%) Apache Flume
4 42 (1.09%) VirtualBox
4 42 (1.09%) VMware Infrastructure
5 38 (0.99%) Active Directory
6 37 (0.96%) NFS
7 35 (0.91%) Apache ZooKeeper
8 24 (0.62%) Firmware
9 15 (0.39%) VMware ESXi
10 13 (0.34%) Samba
10 13 (0.34%) Xen
11 9 (0.23%) Microsoft App-V
12 5 (0.13%) Virtual Machines
13 4 (0.10%) Hyper-V
14 3 (0.078%) Varnish
15 2 (0.052%) Oracle RAC
15 2 (0.052%) vCloud
15 2 (0.052%) vSphere
16 1 (0.026%) VMware Workstation
Systems Management
1 411 (10.69%) Kubernetes
2 293 (7.62%) Ansible
3 191 (4.97%) Terraform
4 129 (3.36%) Puppet
5 104 (2.71%) Oozie
6 78 (2.03%) Hadoop YARN
7 74 (1.93%) Opscode Chef
8 58 (1.51%) Docker Swarm
9 24 (0.62%) Kibana
9 24 (0.62%) Nagios
9 24 (0.62%) Salt
10 18 (0.47%) Ambari
11 16 (0.42%) ZABBIX
12 13 (0.34%) OpenNMS
12 13 (0.34%) Single Sign-On
12 13 (0.34%) vCenter Server
13 11 (0.29%) Consul
13 11 (0.29%) Mesos
13 11 (0.29%) SCCM
14 9 (0.23%) BMC PATROL
Vendors
1 397 (10.33%) Google
2 334 (8.69%) Microsoft
3 304 (7.91%) Oracle
4 180 (4.68%) Cloudera
5 177 (4.60%) Tableau
6 141 (3.67%) Informatica
7 140 (3.64%) Hortonworks
8 118 (3.07%) IBM
9 109 (2.84%) SAP
10 94 (2.45%) Databricks
11 87 (2.26%) Talend
12 73 (1.90%) Splunk
13 72 (1.87%) Teradata
14 67 (1.74%) Sage
15 63 (1.64%) VMware
16 49 (1.27%) Salesforce.com
17 44 (1.14%) Facebook
18 41 (1.07%) Red Hat
19 32 (0.83%) Adobe
20 28 (0.73%) ServiceNow