Period
to 20 July 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 20 July 2019 with a comparison to the same period in the previous 2 years.

Big Data
UK
6 months to
20 Jul 2019
Same period 2018 Same period 2017
Rank 90 76 85
Rank change year-on-year -14 +9 +14
Permanent jobs citing Big Data 4,893 6,960 5,920
As % of all permanent IT jobs advertised in the UK 3.35% 3.98% 3.34%
As % of the Database & Business Intelligence category 12.16% 13.07% 10.88%
Number of salaries quoted 3,887 4,755 4,844
UK median annual salary £65,000 £63,000 £62,500
Median salary % change year-on-year +3.17% +0.80% +4.17%
10th Percentile £35,250 £37,500 £35,000
90th Percentile £105,000 £95,000 £93,750
UK excluding London median annual salary £52,500 £55,000 £55,000
% change year-on-year -4.55% - +4.76%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 40,254 53,238 54,395
As % of all permanent IT jobs advertised in the UK 27.56% 30.41% 30.68%
Number of salaries quoted 33,030 43,421 45,609
UK median annual salary £52,000 £50,000 £47,500
Median salary % change year-on-year +4.00% +5.26% -
10th Percentile £31,250 £31,250 £29,750
90th Percentile £85,000 £81,250 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% +3.66%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data.

Salary trend for Big Data in the UK

Big Data
Salary Histogram

The salary distribution of IT jobs citing Big Data over the 6 months to 20 July 2019.

Salary histogram for Big Data in the UK

Big Data
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the UK over the 6 months to 20 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -20 4,471 £70,000 +7.69% 640
London -20 2,606 £77,500 +10.71% 356
UK excluding London +5 2,153 £52,500 -4.55% 327
South East -40 561 £55,000 -8.33% 81
South West +35 507 £50,000 -9.09% 55
North of England -42 335 £54,750 +9.50% 69
Midlands +25 264 £50,000 -9.09% 44
Scotland +25 257 £40,000 -20.00% 22
North West -28 215 £55,000 +10.00% 51
East of England -15 178 £60,000 - 37
East Midlands +58 153 £52,500 -23.64% 17
West Midlands -27 111 £44,500 -19.09% 27
Yorkshire -25 89 £54,500 -0.91% 15
Wales +21 50 £36,500 -22.34% 12
North East +22 32 £54,500 +28.24% 3
Northern Ireland -23 7 £40,000 +6.67% 8
Channel Islands - 1 £95,000 - 1

For the 6 months to 20 July 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Big Data.

1 2,156 (44.06%) Agile Software Development
2 1,998 (40.83%) Python
3 1,866 (38.14%) Analytics
4 1,805 (36.89%) Java
5 1,623 (33.17%) SQL
6 1,579 (32.27%) Hadoop
7 1,507 (30.80%) Apache Spark
8 1,352 (27.63%) Amazon AWS
9 1,230 (25.14%) Machine Learning
10 1,092 (22.32%) Data Science
11 1,008 (20.60%) DevOps
12 977 (19.97%) Microsoft Azure
13 942 (19.25%) Software Engineering
14 913 (18.66%) Finance
15 903 (18.45%) Business Intelligence
16 884 (18.07%) Kafka
17 878 (17.94%) Degree
18 875 (17.88%) Scala
19 774 (15.82%) Linux
20 768 (15.70%) Data Warehouse
21 765 (15.63%) Apache Hive
22 755 (15.43%) ETL
23 753 (15.39%) NoSQL
24 721 (14.74%) Artificial Intelligence
25 649 (13.26%) Docker
26 624 (12.75%) Analytical Skills
27 614 (12.55%) Data Modelling
28 585 (11.96%) JavaScript
28 585 (11.96%) C#
29 581 (11.87%) Data Analytics

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,507 (30.80%) Apache Spark
2 368 (7.52%) Elasticsearch
3 312 (6.38%) Apache
4 214 (4.37%) Apache Pig
5 109 (2.23%) SAS
6 89 (1.82%) Apache Solr
7 78 (1.59%) Confluence
8 48 (0.98%) OpenStack
9 44 (0.90%) Apache Airflow
10 29 (0.59%) Jupyter
10 29 (0.59%) NServiceBus
10 29 (0.59%) SharePoint
11 24 (0.49%) Adobe Experience Manager
12 22 (0.45%) Oracle SOA Suite
13 19 (0.39%) CMS
14 18 (0.37%) JBoss
15 16 (0.33%) IIS
16 15 (0.31%) Tornado
17 14 (0.29%) nginx
18 12 (0.25%) WildFly
Applications
1 61 (1.25%) Microsoft Excel
2 23 (0.47%) Microsoft PowerPoint
3 22 (0.45%) Microsoft Office
4 21 (0.43%) SPSS
5 14 (0.29%) GNU Octave
6 11 (0.22%) Microsoft Project
7 9 (0.18%) Chatbot
7 9 (0.18%) MS Visio
8 5 (0.10%) Gephi
8 5 (0.10%) Sketch
8 5 (0.10%) Spreadsheet
8 5 (0.10%) Weka
9 2 (0.041%) Stata
10 1 (0.020%) Adobe After Effects
10 1 (0.020%) Adobe Creative Suite
10 1 (0.020%) Adobe Illustrator
10 1 (0.020%) Adobe Premiere
10 1 (0.020%) Mathematica
10 1 (0.020%) OmniGraffle
10 1 (0.020%) Photoshop
Business Applications
1 40 (0.82%) SAP S/4HANA
2 35 (0.72%) Sparx Enterprise Architect
3 12 (0.25%) Dynamics NAV
4 10 (0.20%) Dynamics CRM
5 8 (0.16%) nopCommerce
6 6 (0.12%) Oracle BPM
7 5 (0.10%) SAP ERP
8 4 (0.082%) Distributed Ledger
8 4 (0.082%) SAP BPC
8 4 (0.082%) SDL Web 8
9 3 (0.061%) Adobe Campaign
9 3 (0.061%) SAP Business ByDesign
10 2 (0.041%) SAP Oil and Gas
10 2 (0.041%) SAP SD
11 1 (0.020%) Oracle CRM
11 1 (0.020%) Oracle EBS
11 1 (0.020%) SAP FI
11 1 (0.020%) SAP MM
11 1 (0.020%) SAP Payroll
11 1 (0.020%) WebTrends
Cloud Services
1 1,352 (27.63%) Amazon AWS
2 977 (19.97%) Microsoft Azure
3 579 (11.83%) Google Cloud Platform
4 362 (7.40%) Power Platform
5 220 (4.50%) Serverless
6 134 (2.74%) Amazon S3
7 123 (2.51%) PaaS
8 120 (2.45%) Cloud Computing
9 117 (2.39%) Amazon EC2
10 109 (2.23%) SaaS
11 100 (2.04%) AWS Lambda
12 98 (2.00%) Amazon EMR
13 96 (1.96%) GitHub
14 90 (1.84%) Azure Data Factory
15 80 (1.63%) Amazon SQS
16 72 (1.47%) Amazon Kinesis
17 69 (1.41%) OpenShift
18 62 (1.27%) Azure Machine Learning
19 54 (1.10%) AWS CloudFormation
20 47 (0.96%) IaaS
Communications & Networking
1 153 (3.13%) Internet
2 65 (1.33%) TCP/IP
3 50 (1.02%) Firewall
4 33 (0.67%) HTTP
5 30 (0.61%) HTTPS
6 19 (0.39%) SSH
6 19 (0.39%) VPN
7 13 (0.27%) Wi-Fi
8 11 (0.22%) Wireless
9 9 (0.18%) DNS
9 9 (0.18%) Network Security
10 8 (0.16%) SSL
11 6 (0.12%) Ethernet
11 6 (0.12%) Kerberos
12 5 (0.10%) 5G
12 5 (0.10%) AMQP
12 5 (0.10%) MPLS
12 5 (0.10%) NAS
12 5 (0.10%) SAN
13 4 (0.082%) Unified Communications
Database & Business Intelligence
1 1,579 (32.27%) Hadoop
2 768 (15.70%) Data Warehouse
3 765 (15.63%) Apache Hive
4 753 (15.39%) NoSQL
5 487 (9.95%) SQL Server
6 416 (8.50%) MongoDB
7 374 (7.64%) HBase
8 362 (7.40%) Data Lake
8 362 (7.40%) Power BI
9 334 (6.83%) Apache Cassandra
10 304 (6.21%) Impala
11 291 (5.95%) Relational Database
12 262 (5.35%) Amazon Redshift
13 237 (4.84%) MySQL
14 195 (3.99%) PostgreSQL
15 188 (3.84%) SQL Server Integration Services
16 148 (3.02%) QlikView
17 144 (2.94%) Sqoop
18 130 (2.66%) SQL Server Reporting Services
19 116 (2.37%) Data Mining
Development Applications
1 525 (10.73%) Git (software)
2 411 (8.40%) Jenkins
3 218 (4.46%) JIRA
4 111 (2.27%) Bitbucket
5 98 (2.00%) Selenium
6 92 (1.88%) Visual Studio
7 89 (1.82%) Maven
8 82 (1.68%) Cucumber
9 79 (1.61%) git-flow
10 62 (1.27%) TeamCity
11 60 (1.23%) Eclipse
12 56 (1.14%) Gradle
13 51 (1.04%) Eclipse RCP
14 48 (0.98%) Subversion
15 47 (0.96%) Octopus Deploy
16 46 (0.94%) Atlassian Bamboo
17 38 (0.78%) GitLab
17 38 (0.78%) Team Foundation Server
18 35 (0.72%) JUnit
19 34 (0.69%) Artifactory
General
1 913 (18.66%) Finance
2 269 (5.50%) Retail
3 266 (5.44%) Banking
4 206 (4.21%) Marketing
5 194 (3.96%) Law
6 149 (3.05%) Telecoms
7 108 (2.21%) Games
8 69 (1.41%) Automotive
9 60 (1.23%) Advertising
10 53 (1.08%) Manufacturing
11 52 (1.06%) Legal
12 51 (1.04%) Financial Institution
13 50 (1.02%) Publishing
14 48 (0.98%) Investment Banking
15 47 (0.96%) Front Office
16 43 (0.88%) Electronics
17 41 (0.84%) Pharmaceutical
18 21 (0.43%) Billing
19 20 (0.41%) Local Government
20 18 (0.37%) Back Office
Job Titles
1 1,337 (27.32%) Developer
2 813 (16.62%) Data Engineer
3 614 (12.55%) Architect
4 508 (10.38%) Java Developer
5 398 (8.13%) Big Data Engineer
6 356 (7.28%) Software Engineer
7 317 (6.48%) Data Architect
8 266 (5.44%) Consultant
9 260 (5.31%) Data Scientist
9 260 (5.31%) Senior Developer
10 223 (4.56%) Analyst
11 198 (4.05%) DevOps Engineer
11 198 (4.05%) Solutions Architect
12 190 (3.88%) Big Data Developer
13 186 (3.80%) Python Engineer
14 185 (3.78%) Senior Data Engineer
15 168 (3.43%) Java Engineer
16 150 (3.07%) Senior Software Engineer
17 141 (2.88%) AWS Engineer
17 141 (2.88%) Python Developer
Libraries, Frameworks & Software Standards
1 884 (18.07%) Kafka
2 404 (8.26%) .NET
3 374 (7.64%) Web Services
4 355 (7.26%) HTML
5 301 (6.15%) CSS
6 299 (6.11%) AngularJS
7 280 (5.72%) Spring
8 259 (5.29%) RESTful
9 254 (5.19%) Node.js
10 242 (4.95%) React
11 232 (4.74%) REST
12 156 (3.19%) Natural Language Processing
13 142 (2.90%) ASP.NET
14 141 (2.88%) JSON
15 130 (2.66%) Apache NiFi
16 125 (2.55%) Pandas
17 122 (2.49%) Elastic Stack
18 119 (2.43%) Middleware
19 98 (2.00%) XML
20 95 (1.94%) HTML5
Miscellaneous
1 624 (12.75%) Analytical Skills
2 394 (8.05%) Algorithms
3 229 (4.68%) Greenfield Project
4 185 (3.78%) User Experience
5 181 (3.70%) Data Structures
6 141 (2.88%) Management Information System
7 111 (2.27%) Internet of Things
8 107 (2.19%) Mobile App
9 101 (2.06%) Robotics
10 80 (1.63%) Enterprise Software
11 62 (1.27%) Linux Command Line
12 61 (1.25%) Self-Motivation
13 60 (1.23%) Public Cloud
13 60 (1.23%) Virtual Team
14 57 (1.16%) Social Media
15 52 (1.06%) Cloud Native
15 52 (1.06%) Credit Risk
16 49 (1.00%) Data Centre
17 44 (0.90%) Analytical Mindset
18 42 (0.86%) Life Science
Operating Systems
1 774 (15.82%) Linux
2 288 (5.89%) Unix
3 249 (5.09%) Windows
4 113 (2.31%) Android
5 80 (1.63%) Apple iOS
6 71 (1.45%) Red Hat Enterprise Linux
7 61 (1.25%) CentOS
8 57 (1.16%) Ubuntu
9 22 (0.45%) Windows Server
10 11 (0.22%) Debian
11 9 (0.18%) Fedora
12 6 (0.12%) Windows 10
13 5 (0.10%) AIX
13 5 (0.10%) Windows 7
14 4 (0.082%) Oracle Linux
15 3 (0.061%) Mac OS
15 3 (0.061%) Solaris
16 2 (0.041%) HPUX
16 2 (0.041%) Mac OS X
16 2 (0.041%) VME
Processes & Methodologies
1 2,156 (44.06%) Agile Software Development
2 1,866 (38.14%) Analytics
3 1,230 (25.14%) Machine Learning
4 1,092 (22.32%) Data Science
5 1,008 (20.60%) DevOps
6 942 (19.25%) Software Engineering
7 903 (18.45%) Business Intelligence
8 755 (15.43%) ETL
9 721 (14.74%) Artificial Intelligence
10 614 (12.55%) Data Modelling
11 581 (11.87%) Data Analytics
12 521 (10.65%) Scrum
13 511 (10.44%) Microservices
14 493 (10.08%) Visualisation
15 450 (9.20%) Computer Science
16 435 (8.89%) Data Engineering
17 416 (8.50%) Continuous Integration
18 407 (8.32%) Problem-Solving
19 399 (8.15%) Mathematics
20 386 (7.89%) TDD
Programming Languages
1 1,998 (40.83%) Python
2 1,805 (36.89%) Java
3 1,623 (33.17%) SQL
4 875 (17.88%) Scala
5 585 (11.96%) C#
5 585 (11.96%) JavaScript
6 463 (9.46%) R
7 325 (6.64%) C++
8 249 (5.09%) C
9 194 (3.96%) Bash Shell
10 158 (3.23%) Java 8
11 121 (2.47%) PHP
12 116 (2.37%) PL/SQL
13 106 (2.17%) Shell Script
14 93 (1.90%) PowerShell
15 87 (1.78%) Perl
16 86 (1.76%) Go
16 86 (1.76%) T-SQL
17 79 (1.61%) Ruby
18 66 (1.35%) Clojure
Qualifications
1 878 (17.94%) Degree
2 308 (6.29%) Security Cleared
3 206 (4.21%) Computer Science Degree
4 156 (3.19%) SC Cleared
5 155 (3.17%) DV Cleared
6 131 (2.68%) PhD
7 123 (2.51%) Numerate Degree
8 66 (1.35%) CISSP
9 48 (0.98%) Microsoft Certification
10 45 (0.92%) Master's Degree
11 44 (0.90%) Cisco Certification
12 42 (0.86%) GIAC
13 41 (0.84%) SANS
13 41 (0.84%) SSCP
14 33 (0.67%) CCNA
14 33 (0.67%) MCSE
15 31 (0.63%) CompTIA Security+
15 31 (0.63%) Linux+ Certification
15 31 (0.63%) Network+ Certification
16 28 (0.57%) CISM
Quality Assurance & Compliance
1 180 (3.68%) Data Quality
1 180 (3.68%) QA
2 86 (1.76%) GDPR
3 34 (0.69%) ISO/IEC 27001
4 20 (0.41%) PCI DSS
5 9 (0.18%) PSD2
6 7 (0.14%) MiFID
6 7 (0.14%) NIST
7 5 (0.10%) IFRS
7 5 (0.10%) SLA
8 4 (0.082%) COBIT
8 4 (0.082%) PMO
8 4 (0.082%) Solvency II
9 3 (0.061%) Dodd-Frank
9 3 (0.061%) NIST 800
10 2 (0.041%) Basel III
10 2 (0.041%) COREP
10 2 (0.041%) CRD IV
10 2 (0.041%) ISO 20022
10 2 (0.041%) SEPA
System Software
1 649 (13.26%) Docker
2 154 (3.15%) HDFS
3 149 (3.05%) Apache Flume
4 99 (2.02%) Apache ZooKeeper
5 26 (0.53%) VMware Infrastructure
6 24 (0.49%) Oracle RAC
7 21 (0.43%) Active Directory
8 16 (0.33%) VirtualBox
9 11 (0.22%) VMware ESXi
10 10 (0.20%) Xen
11 9 (0.18%) NFS
11 9 (0.18%) Samba
12 8 (0.16%) Hyper-V
13 7 (0.14%) Virtual Machines
14 6 (0.12%) vSphere
15 5 (0.10%) XenApp
16 2 (0.041%) Tivoli Workload Scheduler
16 2 (0.041%) Virtual Servers
17 1 (0.020%) Ceph
17 1 (0.020%) VMware Workstation
Systems Management
1 385 (7.87%) Kubernetes
2 341 (6.97%) Ansible
3 250 (5.11%) Terraform
4 203 (4.15%) Oozie
5 167 (3.41%) Hadoop YARN
6 143 (2.92%) Puppet
7 119 (2.43%) Opscode Chef
8 74 (1.51%) Ambari
9 37 (0.76%) Kibana
10 30 (0.61%) Nagios
11 27 (0.55%) Docker Swarm
12 26 (0.53%) Enterprise Manager Cloud Control
13 24 (0.49%) Mesos
14 21 (0.43%) Salt
15 18 (0.37%) logstash
16 16 (0.33%) Marathon
17 11 (0.22%) ZABBIX
18 9 (0.18%) Consul
18 9 (0.18%) OpenNMS
18 9 (0.18%) vCenter Server
Vendors
1 469 (9.59%) Microsoft
2 414 (8.46%) Oracle
3 381 (7.79%) Google
4 320 (6.54%) Tableau
5 301 (6.15%) Cloudera
6 207 (4.23%) Hortonworks
7 196 (4.01%) Informatica
8 166 (3.39%) Databricks
9 162 (3.31%) SAP
10 108 (2.21%) Teradata
11 105 (2.15%) IBM
12 94 (1.92%) Talend
13 88 (1.80%) Red Hat
14 78 (1.59%) Splunk
15 77 (1.57%) MapR
16 60 (1.23%) Salesforce.com
17 50 (1.02%) VMware
18 46 (0.94%) HP
19 40 (0.82%) Adobe
20 38 (0.78%) Sybase