Period
to 16 October 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 16 October 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
16 Oct 2018
Same period 2017 Same period 2016
Rank 75 97 98
Rank change year-on-year +22 +1 +24
Permanent jobs citing Big Data 5,947 5,259 5,365
As % of all permanent IT jobs advertised in England 3.88% 3.20% 2.99%
As % of the Database & Business Intelligence category 13.13% 10.53% 10.09%
Number of salaries quoted 4,067 4,256 4,405
England median annual salary £65,000 £62,500 £62,500
Median salary % change year-on-year +4.00% - +4.17%
10th Percentile £38,750 £37,500 £37,500
90th Percentile £97,500 £92,500 £100,000
UK median annual salary £65,000 £62,500 £60,000
% change year-on-year +4.00% +4.17% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 45,292 49,942 53,192
As % of all permanent IT jobs advertised in England 29.52% 30.35% 29.60%
Number of salaries quoted 37,121 41,490 45,813
England median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £83,750 £77,500 £76,250
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 16 October 2018.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 16 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +19 3,795 £70,000 +3.70% 397
South East +1 753 £57,500 - 101
South West +71 379 £57,500 +9.52% 63
North of England -36 378 £50,000 - 91
East of England +82 331 £60,000 +20.00% 37
North West -4 303 £50,000 - 55
Midlands +45 285 £62,500 +38.89% 39
West Midlands +47 151 £55,000 +29.41% 21
East Midlands +17 134 £75,000 +42.86% 18
Yorkshire -37 65 £55,000 +10.00% 18
North East -12 12 £41,250 +3.13% 18
Big Data
UK

For the 6 months to 16 October 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 2,533 (42.59%) Java
2 2,389 (40.17%) Agile Software Development
3 2,108 (35.45%) Python
4 1,940 (32.62%) Finance
5 1,855 (31.19%) Hadoop
6 1,852 (31.14%) SQL
7 1,761 (29.61%) Analytics
8 1,484 (24.95%) Apache Spark
9 1,301 (21.88%) Amazon AWS
10 1,235 (20.77%) Problem-Solving
11 1,187 (19.96%) Banking
12 1,185 (19.93%) Degree
13 1,183 (19.89%) Machine Learning
14 1,041 (17.50%) Analytical Skills
15 1,012 (17.02%) Data Science
16 983 (16.53%) JavaScript
17 941 (15.82%) Linux
18 923 (15.52%) Software Engineering
19 909 (15.29%) Microsoft Azure
20 902 (15.17%) Kafka
21 884 (14.86%) Risk Management
22 883 (14.85%) Investment Banking
23 879 (14.78%) NoSQL
24 853 (14.34%) Scala
25 837 (14.07%) Business Intelligence
26 825 (13.87%) Low Latency
27 808 (13.59%) Financial Institution
28 804 (13.52%) ETL
29 796 (13.38%) Strategic Thinking
30 795 (13.37%) C#

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,484 (24.95%) Apache Spark
2 349 (5.87%) Apache
3 340 (5.72%) Elasticsearch
4 210 (3.53%) Apache Pig
5 183 (3.08%) SAS
6 89 (1.50%) Apache Solr
7 73 (1.23%) Confluence
8 56 (0.94%) Tomcat
9 54 (0.91%) CMS
10 35 (0.59%) IIS
11 23 (0.39%) WebLogic
12 22 (0.37%) WildFly
13 21 (0.35%) OpenStack
14 19 (0.32%) JBoss
15 17 (0.29%) Adobe Experience Manager
15 17 (0.29%) Oracle SOA Suite
16 16 (0.27%) CloudStack
17 15 (0.25%) ArcGIS
18 13 (0.22%) Jupyter
18 13 (0.22%) NServiceBus
Applications
1 114 (1.92%) Microsoft Excel
2 64 (1.08%) Microsoft Office
3 42 (0.71%) GNU Octave
3 42 (0.71%) Microsoft PowerPoint
4 27 (0.45%) MS Visio
4 27 (0.45%) SPSS
5 19 (0.32%) Chatbot
6 9 (0.15%) Microsoft Project
7 8 (0.13%) RoboHelp
8 4 (0.067%) Adobe After Effects
8 4 (0.067%) Adobe Creative Suite
8 4 (0.067%) Adobe Illustrator
8 4 (0.067%) Adobe Premiere
8 4 (0.067%) InVision
8 4 (0.067%) Photoshop
8 4 (0.067%) Weka
9 3 (0.050%) Stata
10 2 (0.034%) EViews
10 2 (0.034%) PrintSoft PReS
11 1 (0.017%) Mingle
Business Applications
1 28 (0.47%) SAP S/4HANA
2 24 (0.40%) Dynamics CRM
3 18 (0.30%) Dynamics AX
4 17 (0.29%) Dynamics NAV
5 9 (0.15%) Oracle Receivables
6 7 (0.12%) Oracle Payables
7 6 (0.10%) Sentinel
8 5 (0.084%) Actimize
9 4 (0.067%) SAP ERP
10 3 (0.050%) Changepoint
11 2 (0.034%) Distributed Ledger
11 2 (0.034%) Oracle BPM
11 2 (0.034%) Oracle EBS
11 2 (0.034%) SAP Forecasting and Replenishment
11 2 (0.034%) SAP MDG
11 2 (0.034%) SAP MII
11 2 (0.034%) SAP PM
11 2 (0.034%) SAP Retail
11 2 (0.034%) Temenos T24
12 1 (0.017%) R3 Corda
Cloud Services
1 1,301 (21.88%) Amazon AWS
2 909 (15.29%) Microsoft Azure
3 303 (5.10%) Google Cloud Platform
4 201 (3.38%) SaaS
5 185 (3.11%) Cloud Computing
6 179 (3.01%) PaaS
7 159 (2.67%) Serverless
8 122 (2.05%) Amazon Kinesis
9 116 (1.95%) Amazon EMR
10 115 (1.93%) IaaS
11 77 (1.29%) AWS Lambda
11 77 (1.29%) Azure Data Factory
12 75 (1.26%) GitHub
13 69 (1.16%) Amazon EC2
14 67 (1.13%) Amazon S3
15 47 (0.79%) Cortana Intelligence Suite
16 39 (0.66%) Office 365
17 35 (0.59%) IBM Cloud
18 31 (0.52%) Azure Machine Learning
19 26 (0.44%) Data Lake Analytics
Communications & Networking
1 105 (1.77%) Firewall
2 104 (1.75%) Internet
3 88 (1.48%) HTTP
3 88 (1.48%) TCP/IP
4 66 (1.11%) SSL
5 50 (0.84%) DNS
6 33 (0.55%) WAN
7 30 (0.50%) LAN
8 29 (0.49%) Network Security
9 28 (0.47%) SAN
9 28 (0.47%) Wireless
10 24 (0.40%) DHCP
10 24 (0.40%) Kerberos
11 23 (0.39%) Software-Defined Networking
11 23 (0.39%) Sourcefire
12 22 (0.37%) WebEx
13 21 (0.35%) Unified Communications
14 18 (0.30%) SNMP
15 17 (0.29%) Ethernet
16 15 (0.25%) HTTPS
Database & Business Intelligence
1 1,855 (31.19%) Hadoop
2 879 (14.78%) NoSQL
3 744 (12.51%) Apache Hive
4 728 (12.24%) Data Warehouse
5 660 (11.10%) SQL Server
6 527 (8.86%) Relational Database
7 470 (7.90%) MongoDB
8 376 (6.32%) Apache Cassandra
9 356 (5.99%) Data Lake
10 343 (5.77%) Power BI
11 298 (5.01%) HBase
12 296 (4.98%) MySQL
13 264 (4.44%) SQL Server Integration Services
14 256 (4.30%) SQL Server Reporting Services
15 245 (4.12%) Amazon Redshift
16 240 (4.04%) Impala
17 217 (3.65%) RDBMS
18 208 (3.50%) PostgreSQL
19 149 (2.51%) DB2
20 135 (2.27%) SQL Server Analysis Services
Development Applications
1 451 (7.58%) Git (software)
2 289 (4.86%) Jenkins
3 268 (4.51%) JIRA
4 146 (2.46%) Selenium
5 130 (2.19%) Maven
6 126 (2.12%) JUnit
7 100 (1.68%) Visual Studio
8 99 (1.66%) Subversion
9 96 (1.61%) Atlassian Bamboo
10 84 (1.41%) Bitbucket
11 69 (1.16%) Gradle
12 61 (1.03%) Cucumber
13 59 (0.99%) TeamCity
14 45 (0.76%) git-flow
15 44 (0.74%) CodeSonar
15 44 (0.74%) Robot Framework
16 41 (0.69%) GitLab
17 40 (0.67%) Team Foundation Server
18 39 (0.66%) Eclipse
18 39 (0.66%) Mockito
General
1 1,940 (32.62%) Finance
2 1,187 (19.96%) Banking
3 883 (14.85%) Investment Banking
4 808 (13.59%) Financial Institution
5 393 (6.61%) Retail
6 341 (5.73%) Marketing
7 186 (3.13%) Telecoms
8 159 (2.67%) Front Office
9 152 (2.56%) Games
10 110 (1.85%) Electronics
11 106 (1.78%) Law
12 84 (1.41%) Advertising
13 74 (1.24%) Automotive
14 72 (1.21%) Manufacturing
15 65 (1.09%) Legal
16 64 (1.08%) Military
17 52 (0.87%) Publishing
18 46 (0.77%) Pharmaceutical
19 26 (0.44%) Multimedia
20 16 (0.27%) German Language
Job Titles
1 1,735 (29.17%) Developer
2 784 (13.18%) Architect
3 696 (11.70%) Data Engineer
4 615 (10.34%) Java Developer
5 467 (7.85%) Big Data Engineer
6 359 (6.04%) Software Engineer
7 352 (5.92%) Data Architect
8 303 (5.10%) Data Scientist
9 283 (4.76%) Analyst
10 282 (4.74%) Big Data Developer
11 269 (4.52%) Senior Developer
12 258 (4.34%) Consultant
13 229 (3.85%) Solutions Architect
14 179 (3.01%) Java Engineer
15 147 (2.47%) Big Data Architect
16 141 (2.37%) DevOps Engineer
17 138 (2.32%) Python Developer
18 131 (2.20%) Platform Engineer
19 130 (2.19%) Junior
20 128 (2.15%) Software Developer
Libraries, Frameworks & Software Standards
1 902 (15.17%) Kafka
2 573 (9.64%) .NET
3 554 (9.32%) AngularJS
4 480 (8.07%) HTML
5 457 (7.68%) Web Services
6 423 (7.11%) RESTful
7 386 (6.49%) Spring
8 337 (5.67%) React
9 331 (5.57%) REST
10 315 (5.30%) Node.js
11 288 (4.84%) CSS
12 236 (3.97%) HTML5
13 216 (3.63%) XML
14 168 (2.82%) RabbitMQ
15 160 (2.69%) JSON
16 159 (2.67%) Django
17 151 (2.54%) Natural Language Processing
18 142 (2.39%) Hibernate
19 133 (2.24%) Middleware
20 131 (2.20%) SOAP
Miscellaneous
1 1,041 (17.50%) Analytical Skills
2 774 (13.01%) Cyberthreat
3 769 (12.93%) Computer Science
4 506 (8.51%) Algorithms
5 308 (5.18%) Greenfield Project
6 289 (4.86%) Fintech
7 247 (4.15%) Data Structures
8 242 (4.07%) User Experience
9 235 (3.95%) Management Information System
10 234 (3.93%) Self-Motivation
11 153 (2.57%) Data Centre
12 148 (2.49%) Mobile App
13 141 (2.37%) Fixed Income
14 128 (2.15%) Equities
15 113 (1.90%) Public Cloud
16 99 (1.66%) Virtual Team
17 97 (1.63%) Enterprise Software
18 82 (1.38%) Derivative
19 78 (1.31%) Hedge funds
20 64 (1.08%) Robotics
Operating Systems
1 941 (15.82%) Linux
2 377 (6.34%) Windows
3 373 (6.27%) Unix
4 119 (2.00%) Android
5 85 (1.43%) Apple iOS
6 64 (1.08%) CentOS
7 60 (1.01%) Red Hat Enterprise Linux
8 58 (0.98%) Ubuntu
9 48 (0.81%) Windows Server
10 44 (0.74%) Mac OS X
11 30 (0.50%) Solaris
12 29 (0.49%) HPUX
13 28 (0.47%) AIX
14 17 (0.29%) Windows Server 2008
15 16 (0.27%) Windows Phone
16 13 (0.22%) Fedora
17 9 (0.15%) Windows 7
18 7 (0.12%) Windows Server 2012
19 6 (0.10%) Debian
19 6 (0.10%) Windows 10
Processes & Methodologies
1 2,389 (40.17%) Agile Software Development
2 1,761 (29.61%) Analytics
3 1,235 (20.77%) Problem-Solving
4 1,183 (19.89%) Machine Learning
5 1,012 (17.02%) Data Science
6 923 (15.52%) Software Engineering
7 884 (14.86%) Risk Management
8 837 (14.07%) Business Intelligence
9 825 (13.87%) Low Latency
10 804 (13.52%) ETL
11 796 (13.38%) Strategic Thinking
12 791 (13.30%) DevOps
13 781 (13.13%) Innovative Thinking
14 780 (13.12%) Investment Management
15 723 (12.16%) TDD
16 677 (11.38%) Artificial Intelligence
17 656 (11.03%) Data Modelling
18 636 (10.69%) Continuous Integration
19 601 (10.11%) Visualisation
20 586 (9.85%) Microservices
Programming Languages
1 2,533 (42.59%) Java
2 2,108 (35.45%) Python
3 1,852 (31.14%) SQL
4 983 (16.53%) JavaScript
5 853 (14.34%) Scala
6 795 (13.37%) C#
7 581 (9.77%) C++
8 514 (8.64%) R
9 328 (5.52%) Java 8
10 321 (5.40%) C
11 259 (4.36%) Bash Shell
12 244 (4.10%) PowerShell
13 202 (3.40%) Perl
14 187 (3.14%) T-SQL
15 165 (2.77%) PHP
16 152 (2.56%) Shell Script
17 132 (2.22%) Ruby
18 125 (2.10%) MATLAB
19 119 (2.00%) Go
20 76 (1.28%) Objective-C
Qualifications
1 1,185 (19.93%) Degree
2 372 (6.26%) Computer Science Degree
3 267 (4.49%) Security Cleared
4 236 (3.97%) PhD
5 160 (2.69%) DV Cleared
6 152 (2.56%) Master's Degree
7 111 (1.87%) CISSP
8 81 (1.36%) Microsoft Certification
9 80 (1.35%) Numerate Degree
10 76 (1.28%) Cisco Certification
11 75 (1.26%) SC Cleared
12 67 (1.13%) CCNA
13 64 (1.08%) MCSE
14 63 (1.06%) SSCP
15 60 (1.01%) GIAC
16 57 (0.96%) SANS
17 53 (0.89%) Linux+ Certification
17 53 (0.89%) Network+ Certification
18 52 (0.87%) CompTIA Security+
19 39 (0.66%) PMI Certification
Quality Assurance & Compliance
1 249 (4.19%) QA
2 229 (3.85%) Data Quality
3 95 (1.60%) GDPR
4 49 (0.82%) ISO/IEC 27001
5 26 (0.44%) PMO
6 22 (0.37%) MiFID
7 20 (0.34%) Solvency II
8 16 (0.27%) Dodd-Frank
8 16 (0.27%) FATCA
8 16 (0.27%) IFRS
8 16 (0.27%) IFRS 9
9 12 (0.20%) PCI DSS
10 9 (0.15%) Cyber Essentials
10 9 (0.15%) GPG13
11 8 (0.13%) COBIT
12 6 (0.10%) SLA
13 5 (0.084%) Actionable Recommendations
13 5 (0.084%) Sarbanes-Oxley
14 4 (0.067%) GxP
14 4 (0.067%) ISO 14001
System Software
1 543 (9.13%) Docker
2 254 (4.27%) HDFS
3 161 (2.71%) Apache Flume
4 75 (1.26%) VMware Infrastructure
5 67 (1.13%) vSphere
6 64 (1.08%) Active Directory
7 51 (0.86%) Virtual Machines
8 44 (0.74%) Apache ZooKeeper
9 34 (0.57%) VirtualBox
10 32 (0.54%) Virtual Desktop
11 27 (0.45%) Snort
11 27 (0.45%) VMware ESXi
12 19 (0.32%) Hyper-V
13 18 (0.30%) iptables
14 14 (0.24%) VMware NSX
15 13 (0.22%) Xen
16 9 (0.15%) NFS
17 8 (0.13%) Samba
18 7 (0.12%) LXC
19 6 (0.10%) Microsoft App-V
Systems Management
1 311 (5.23%) Kubernetes
2 281 (4.73%) Puppet
3 238 (4.00%) Ansible
4 150 (2.52%) Oozie
5 133 (2.24%) Terraform
6 130 (2.19%) Hadoop YARN
7 120 (2.02%) Opscode Chef
8 94 (1.58%) Kibana
9 76 (1.28%) Salt
10 62 (1.04%) Mesos
11 48 (0.81%) logstash
12 40 (0.67%) Docker Swarm
13 36 (0.61%) Grafana
14 28 (0.47%) Rancher
14 28 (0.47%) ZABBIX
15 27 (0.45%) Nagios
15 27 (0.45%) Prometheus
16 20 (0.34%) Suricata
17 15 (0.25%) SCOrch
17 15 (0.25%) Xymon
Vendors
1 660 (11.10%) Microsoft
2 440 (7.40%) Oracle
3 413 (6.94%) Tableau
4 368 (6.19%) Google
5 347 (5.83%) Cloudera
6 253 (4.25%) Hortonworks
7 190 (3.19%) SAP
8 175 (2.94%) Sybase
9 138 (2.32%) Informatica
10 130 (2.19%) Talend
11 122 (2.05%) VMware
12 116 (1.95%) IBM
13 100 (1.68%) MapR
14 79 (1.33%) Databricks
15 75 (1.26%) Splunk
16 74 (1.24%) Red Hat
17 68 (1.14%) Cisco
18 61 (1.03%) Atlassian
19 51 (0.86%) Adobe
20 49 (0.82%) Teradata