Period
to 21 October 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 October 2019 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
21 Oct 2019
Same period 2018 Same period 2017
Rank 92 79 98
Rank change year-on-year -13 +19 -2
Permanent jobs citing Big Data 4,477 6,261 5,632
As % of all permanent IT jobs advertised in the UK 3.27% 3.83% 3.23%
As % of the Database & Business Intelligence category 12.11% 12.98% 10.61%
Number of salaries quoted 3,586 4,312 4,544
UK median annual salary £67,500 £65,000 £62,500
Median salary % change year-on-year +3.85% +4.00% +2.46%
10th Percentile £37,500 £37,500 £36,250
90th Percentile £105,000 £95,000 £91,250
UK excluding London median annual salary £52,500 £55,000 £52,500
% change year-on-year -4.55% +4.76% -1.87%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 36,959 48,241 53,090
As % of all permanent IT jobs advertised in the UK 26.98% 29.49% 30.47%
Number of salaries quoted 30,358 39,375 43,610
UK median annual salary £52,500 £50,000 £48,000
Median salary % change year-on-year +5.00% +4.17% +1.05%
10th Percentile £31,250 £31,250 £30,000
90th Percentile £86,250 £82,500 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% +2.41%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 21 October 2019.

Salary histogram for Big Data in the UK

Big Data
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 21 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -16 4,100 £70,000 +7.69% 575
London -10 2,486 £77,500 +10.71% 310
UK excluding London -9 1,918 £52,500 -4.55% 303
South East -40 509 £59,500 +3.48% 81
South West +11 388 £50,000 -13.04% 50
North of England -7 309 £55,000 +10.00% 58
Scotland +14 266 £47,600 +4.62% 26
Midlands -5 214 £55,000 -12.00% 35
East of England -17 185 £65,000 +8.33% 45
North West -27 177 £54,500 +9.00% 40
East Midlands +27 144 £57,500 -23.33% 17
Yorkshire +32 92 £55,000 +4.76% 11
West Midlands -45 65 £50,000 -9.09% 18
North East +47 41 £54,500 +36.25% 7
Wales +21 37 £40,000 -23.08% 10
Northern Ireland -10 12 £36,250 -19.44% 2

For the 6 months to 21 October 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 1,864 (41.64%) Agile Software Development
2 1,790 (39.98%) Python
3 1,635 (36.52%) Analytics
4 1,524 (34.04%) SQL
5 1,495 (33.39%) Java
6 1,306 (29.17%) AWS
7 1,282 (28.64%) Hadoop
8 1,216 (27.16%) Apache Spark
9 1,140 (25.46%) Machine Learning
10 1,027 (22.94%) Data Science
11 985 (22.00%) Azure
12 871 (19.45%) DevOps
13 835 (18.65%) Finance
14 801 (17.89%) Software Engineering
15 796 (17.78%) Degree
16 792 (17.69%) Business Intelligence
17 752 (16.80%) ETL
18 732 (16.35%) Linux
19 707 (15.79%) Data Warehouse
20 668 (14.92%) Scala
21 654 (14.61%) Apache Hive
22 650 (14.52%) NoSQL
23 646 (14.43%) Artificial Intelligence
24 626 (13.98%) Docker
25 622 (13.89%) Kafka
26 595 (13.29%) Microservices
27 581 (12.98%) Git (software)
28 565 (12.62%) JavaScript
29 537 (11.99%) Data Modelling
30 531 (11.86%) GCP

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,216 (27.16%) Apache Spark
2 257 (5.74%) Elasticsearch
3 198 (4.42%) Apache
4 72 (1.61%) SAS
5 70 (1.56%) Apache Airflow
5 70 (1.56%) Apache Pig
6 56 (1.25%) OpenStack
7 45 (1.01%) Confluence
8 44 (0.98%) Apache Solr
9 29 (0.65%) Jupyter
10 24 (0.54%) NServiceBus
11 23 (0.51%) Tornado
12 21 (0.47%) nginx
13 19 (0.42%) CMS
14 15 (0.34%) SharePoint
15 14 (0.31%) Oracle SOA Suite
15 14 (0.31%) WebLogic
16 13 (0.29%) IIS
16 13 (0.29%) WildFly
17 12 (0.27%) JBoss
Applications
1 69 (1.54%) Microsoft Excel
2 21 (0.47%) Microsoft Office
3 13 (0.29%) SPSS
4 11 (0.25%) MS Visio
5 10 (0.22%) Microsoft PowerPoint
6 8 (0.18%) Microsoft Project
7 7 (0.16%) Chatbot
7 7 (0.16%) Gephi
8 5 (0.11%) GNU Octave
9 4 (0.089%) Spreadsheet
10 3 (0.067%) Stata
11 2 (0.045%) Sketch
12 1 (0.022%) Adobe Premiere
12 1 (0.022%) InVision
12 1 (0.022%) Mathematica
12 1 (0.022%) SPSS Modeler
Business Applications
1 43 (0.96%) Sparx Enterprise Architect
2 33 (0.74%) SAP S/4HANA
3 7 (0.16%) Dynamics CRM
3 7 (0.16%) PolarLake
4 4 (0.089%) Eagle PACE
4 4 (0.089%) Markit EDM
4 4 (0.089%) SAP ERP
4 4 (0.089%) SDL Web 8
5 3 (0.067%) Adobe Campaign
5 3 (0.067%) Dynamics NAV
5 3 (0.067%) Oracle BPM
5 3 (0.067%) SAP Business ByDesign
5 3 (0.067%) SAP HCM
5 3 (0.067%) SAP Payroll
6 2 (0.045%) nopCommerce
6 2 (0.045%) SAP BPC
7 1 (0.022%) FINCAD Analytics
7 1 (0.022%) Oracle Payables
7 1 (0.022%) SAP MDG
7 1 (0.022%) SAP POS DM
Cloud Services
1 1,306 (29.17%) AWS
2 985 (22.00%) Azure
3 531 (11.86%) GCP
4 256 (5.72%) Power Platform
5 200 (4.47%) Amazon S3
6 164 (3.66%) Serverless
7 149 (3.33%) Cloud Computing
8 128 (2.86%) Amazon EMR
9 121 (2.70%) SaaS
10 110 (2.46%) Amazon EC2
11 106 (2.37%) PaaS
12 94 (2.10%) Amazon SQS
13 86 (1.92%) GitHub
14 85 (1.90%) Azure Data Factory
15 80 (1.79%) AWS Lambda
16 75 (1.68%) OpenShift
17 67 (1.50%) Amazon ECS
18 57 (1.27%) Amazon Kinesis
18 57 (1.27%) IaaS
19 45 (1.01%) Azure Machine Learning
Communications & Networking
1 161 (3.60%) Internet
2 86 (1.92%) Firewall
3 74 (1.65%) TCP/IP
4 47 (1.05%) DNS
5 44 (0.98%) HTTPS
6 34 (0.76%) HTTP
7 28 (0.63%) DHCP
8 27 (0.60%) VPN
9 24 (0.54%) DMZ
10 19 (0.42%) Kerberos
11 18 (0.40%) SSL
12 13 (0.29%) SSH
13 9 (0.20%) Network Security
13 9 (0.20%) Unified Communications
14 7 (0.16%) Ethernet
14 7 (0.16%) MPLS
15 6 (0.13%) NAS
15 6 (0.13%) SAN
15 6 (0.13%) Wi-Fi
16 4 (0.089%) ATM
Database & Business Intelligence
1 1,282 (28.64%) Hadoop
2 707 (15.79%) Data Warehouse
3 654 (14.61%) Apache Hive
4 650 (14.52%) NoSQL
5 433 (9.67%) SQL Server
6 321 (7.17%) Data Lake
7 317 (7.08%) MongoDB
8 264 (5.90%) Relational Database
9 256 (5.72%) Power BI
10 239 (5.34%) HBase
11 229 (5.12%) Impala
12 214 (4.78%) PostgreSQL
13 197 (4.40%) MySQL
14 181 (4.04%) Apache Cassandra
15 166 (3.71%) Amazon Redshift
16 142 (3.17%) SQL Server Integration Services
17 122 (2.73%) BigQuery
18 112 (2.50%) Sqoop
19 109 (2.43%) SQL Server Analysis Services
20 108 (2.41%) Data Mining
Development Applications
1 581 (12.98%) Git (software)
2 414 (9.25%) Jenkins
3 247 (5.52%) JIRA
4 131 (2.93%) Bitbucket
5 94 (2.10%) git-flow
6 81 (1.81%) Visual Studio
7 78 (1.74%) Selenium
8 66 (1.47%) TeamCity
9 59 (1.32%) GitLab
10 57 (1.27%) Cucumber
11 49 (1.09%) Octopus Deploy
12 47 (1.05%) Atlassian Bamboo
13 43 (0.96%) Bitbucket Server
14 32 (0.71%) JUnit
15 31 (0.69%) NetBeans
16 30 (0.67%) Maven
17 29 (0.65%) Artifactory
17 29 (0.65%) Team Foundation Server
18 28 (0.63%) Subversion
19 26 (0.58%) Vagrant
General
1 835 (18.65%) Finance
2 253 (5.65%) Retail
3 237 (5.29%) Banking
4 205 (4.58%) Marketing
5 131 (2.93%) Telecoms
6 121 (2.70%) Public Sector
7 113 (2.52%) Games
8 91 (2.03%) Front Office
9 78 (1.74%) Law
10 72 (1.61%) Legal
11 59 (1.32%) Manufacturing
12 58 (1.30%) Pharmaceutical
13 52 (1.16%) Advertising
14 40 (0.89%) Investment Banking
15 39 (0.87%) Automotive
15 39 (0.87%) Financial Institution
16 32 (0.71%) Electronics
17 31 (0.69%) Billing
17 31 (0.69%) Publishing
18 24 (0.54%) Multimedia
Job Titles
1 1,217 (27.18%) Developer
2 764 (17.06%) Data Engineer
3 526 (11.75%) Java Developer
4 517 (11.55%) Architect
5 320 (7.15%) Software Engineer
6 295 (6.59%) Consultant
7 269 (6.01%) Data Architect
8 261 (5.83%) Data Scientist
9 256 (5.72%) Big Data Engineer
10 236 (5.27%) Senior Developer
11 210 (4.69%) Analyst
12 202 (4.51%) Senior Data Engineer
13 193 (4.31%) Python Engineer
14 168 (3.75%) Java Engineer
15 161 (3.60%) DevOps Engineer
16 149 (3.33%) AWS Engineer
17 147 (3.28%) Python Developer
18 136 (3.04%) Java Software Engineer
19 132 (2.95%) Solutions Architect
20 127 (2.84%) Big Data Developer
Libraries, Frameworks & Software Standards
1 622 (13.89%) Kafka
2 373 (8.33%) .NET
3 328 (7.33%) Web Services
4 306 (6.83%) Node.js
5 287 (6.41%) AngularJS
6 283 (6.32%) React
7 273 (6.10%) HTML
8 228 (5.09%) CSS
9 220 (4.91%) Spring
10 214 (4.78%) REST
11 207 (4.62%) RESTful
12 119 (2.66%) Pandas
13 116 (2.59%) ASP.NET
14 113 (2.52%) Natural Language Processing
15 99 (2.21%) Elastic Stack
16 98 (2.19%) J2EE
17 94 (2.10%) JSON
17 94 (2.10%) XML
18 87 (1.94%) TensorFlow
19 81 (1.81%) Middleware
Miscellaneous
1 526 (11.75%) Analytical Skills
2 330 (7.37%) Algorithms
3 205 (4.58%) Data Structures
4 183 (4.09%) Management Information System
5 176 (3.93%) Greenfield Project
6 168 (3.75%) User Experience
7 107 (2.39%) Internet of Things
8 96 (2.14%) Robotics
9 93 (2.08%) Mobile App
10 81 (1.81%) Enterprise Software
11 80 (1.79%) Data Centre
12 74 (1.65%) Linux Command Line
13 65 (1.45%) Cloud Native
13 65 (1.45%) Public Cloud
14 56 (1.25%) Social Media
15 55 (1.23%) Life Science
16 52 (1.16%) Fixed Income
17 50 (1.12%) Virtual Team
18 49 (1.09%) Equities
19 48 (1.07%) Analytical Mindset
Operating Systems
1 732 (16.35%) Linux
2 236 (5.27%) Unix
3 207 (4.62%) Windows
4 80 (1.79%) Android
5 69 (1.54%) Apple iOS
6 46 (1.03%) CentOS
7 43 (0.96%) Red Hat Enterprise Linux
8 36 (0.80%) Ubuntu
9 24 (0.54%) Solaris
9 24 (0.54%) Windows Server
10 11 (0.25%) Mac OS
11 10 (0.22%) Debian
11 10 (0.22%) Fedora
12 9 (0.20%) Windows 10
13 7 (0.16%) Windows 7
14 6 (0.13%) VME
14 6 (0.13%) Windows Server 2012
15 5 (0.11%) Oracle Linux
16 2 (0.045%) Mac OS X
16 2 (0.045%) Windows Server 2008
Processes & Methodologies
1 1,864 (41.64%) Agile Software Development
2 1,635 (36.52%) Analytics
3 1,140 (25.46%) Machine Learning
4 1,027 (22.94%) Data Science
5 871 (19.45%) DevOps
6 801 (17.89%) Software Engineering
7 792 (17.69%) Business Intelligence
8 752 (16.80%) ETL
9 646 (14.43%) Artificial Intelligence
10 595 (13.29%) Microservices
11 537 (11.99%) Data Modelling
12 530 (11.84%) Data Analytics
13 445 (9.94%) Problem-Solving
14 434 (9.69%) Computer Science
14 434 (9.69%) Scrum
15 401 (8.96%) Data Engineering
16 391 (8.73%) Visualisation
17 356 (7.95%) Mentoring
18 339 (7.57%) TDD
19 334 (7.46%) Open Source
Programming Languages
1 1,790 (39.98%) Python
2 1,524 (34.04%) SQL
3 1,495 (33.39%) Java
4 668 (14.92%) Scala
5 565 (12.62%) JavaScript
6 510 (11.39%) C#
7 456 (10.19%) R
8 308 (6.88%) C
9 265 (5.92%) C++
10 203 (4.53%) Bash Shell
11 162 (3.62%) Java 8
12 133 (2.97%) PL/SQL
13 109 (2.43%) Shell Script
14 107 (2.39%) PHP
15 101 (2.26%) Perl
16 92 (2.05%) Ruby
17 89 (1.99%) TypeScript
18 83 (1.85%) Go
19 78 (1.74%) PowerShell
20 65 (1.45%) T-SQL
Qualifications
1 796 (17.78%) Degree
2 247 (5.52%) Security Cleared
3 197 (4.40%) Computer Science Degree
4 136 (3.04%) DV Cleared
5 94 (2.10%) PhD
5 94 (2.10%) SC Cleared
6 84 (1.88%) Numerate Degree
7 79 (1.76%) Microsoft Certification
8 63 (1.41%) Master's Degree
9 62 (1.38%) CISSP
10 49 (1.09%) Cisco Certification
11 42 (0.94%) CCNA
12 41 (0.92%) CompTIA Security+
12 41 (0.92%) Network+ Certification
13 40 (0.89%) GIAC
13 40 (0.89%) SSCP
14 39 (0.87%) MCSE
14 39 (0.87%) SANS
15 37 (0.83%) Linux+ Certification
16 31 (0.69%) PMI Certification
Quality Assurance & Compliance
1 234 (5.23%) QA
2 201 (4.49%) Data Quality
3 58 (1.30%) GDPR
4 36 (0.80%) ISO/IEC 27001
5 31 (0.69%) SLA
6 17 (0.38%) PCI DSS
7 8 (0.18%) PMO
7 8 (0.18%) PSD2
8 7 (0.16%) HIPAA
9 4 (0.089%) COBIT
9 4 (0.089%) SEPA
10 3 (0.067%) GMP
10 3 (0.067%) GxP
10 3 (0.067%) MiFID
11 2 (0.045%) IFRS
11 2 (0.045%) IFRS 9
12 1 (0.022%) Basel III
12 1 (0.022%) Cyber Essentials
12 1 (0.022%) ISO 9001
12 1 (0.022%) Sarbanes-Oxley
System Software
1 626 (13.98%) Docker
2 169 (3.77%) HDFS
3 93 (2.08%) Apache Flume
4 47 (1.05%) Active Directory
4 47 (1.05%) Apache ZooKeeper
5 35 (0.78%) VMware Infrastructure
6 34 (0.76%) NFS
7 27 (0.60%) VirtualBox
8 24 (0.54%) Firmware
9 13 (0.29%) VMware ESXi
10 10 (0.22%) Samba
10 10 (0.22%) Xen
11 8 (0.18%) Oracle RAC
12 7 (0.16%) Virtual Machines
13 6 (0.13%) Hyper-V
14 5 (0.11%) vSphere
15 2 (0.045%) vCloud
16 1 (0.022%) Ceph
16 1 (0.022%) KVM
16 1 (0.022%) Virtual Servers
Systems Management
1 431 (9.63%) Kubernetes
2 334 (7.46%) Ansible
3 225 (5.03%) Terraform
4 148 (3.31%) Oozie
5 127 (2.84%) Hadoop YARN
6 121 (2.70%) Puppet
7 85 (1.90%) Opscode Chef
8 38 (0.85%) Docker Swarm
9 32 (0.71%) Kibana
10 29 (0.65%) Ambari
11 17 (0.38%) Consul
11 17 (0.38%) Salt
12 15 (0.34%) Nagios
13 14 (0.31%) logstash
14 13 (0.29%) Single Sign-On
14 13 (0.29%) ZABBIX
15 11 (0.25%) Packer
16 10 (0.22%) OpenNMS
16 10 (0.22%) vCenter Server
17 9 (0.20%) HP Quality Center
Vendors
1 443 (9.90%) Microsoft
2 420 (9.38%) Google
3 383 (8.55%) Oracle
4 233 (5.20%) Tableau
5 210 (4.69%) Cloudera
6 158 (3.53%) Informatica
7 157 (3.51%) Hortonworks
8 128 (2.86%) Splunk
9 127 (2.84%) SAP
10 123 (2.75%) Databricks
11 104 (2.32%) Teradata
12 93 (2.08%) IBM
13 72 (1.61%) Talend
14 62 (1.38%) Red Hat
15 56 (1.25%) Salesforce.com
15 56 (1.25%) VMware
16 41 (0.92%) Sparx
17 36 (0.80%) Atlassian
17 36 (0.80%) BiZZdesign
18 34 (0.76%) Sage