Period
to 24 April 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 24 April 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
24 Apr 2018
Same period 2017 Same period 2016
Rank 81 82 91
Rank change year-on-year +1 +9 +77
Permanent jobs citing Big Data 6,133 5,415 5,974
As % of all permanent IT jobs advertised in England 3.70% 3.38% 3.12%
As % of the Database & Business Intelligence category 12.04% 11.12% 9.95%
Number of salaries quoted 4,873 4,603 4,845
England median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% -
10th Percentile £38,750 £36,250 £37,500
90th Percentile £96,250 £96,250 £97,500
UK median annual salary £65,000 £62,500 £60,000
% change year-on-year +4.00% +4.17% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 50,933 48,686 60,038
As % of all permanent IT jobs advertised in England 30.69% 30.42% 31.40%
Number of salaries quoted 42,676 41,958 51,657
England median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,000 £29,750 £29,000
90th Percentile £80,000 £77,500 £75,000
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 24 April 2018.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 24 April 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +8 3,757 £70,000 - 541
South East 0 835 £58,500 +6.36% 109
North of England +30 522 £50,000 -9.09% 79
South West -9 392 £52,500 -4.55% 40
North West +5 354 £50,000 -9.09% 49
East of England +53 340 £60,000 +20.00% 31
Midlands -49 253 £55,000 - 44
West Midlands -12 142 £55,000 - 28
Yorkshire +34 138 £55,000 - 24
East Midlands -64 109 £62,500 +13.64% 16
North East -16 30 £39,750 +13.57% 6
Big Data
UK

For the 6 months to 24 April 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 2,446 (39.88%) Java
2 2,280 (37.18%) Python
3 2,243 (36.57%) Agile Software Development
4 2,140 (34.89%) Analytics
5 2,075 (33.83%) Hadoop
6 1,853 (30.21%) SQL
7 1,728 (28.18%) Apache Spark
8 1,517 (24.74%) Machine Learning
9 1,506 (24.56%) Amazon AWS
10 1,292 (21.07%) Data Science
11 1,280 (20.87%) Finance
12 1,124 (18.33%) Scala
13 1,068 (17.41%) Degree
14 1,023 (16.68%) Business Intelligence
15 955 (15.57%) Software Engineering
16 894 (14.58%) Microsoft Azure
17 890 (14.51%) DevOps
18 879 (14.33%) NoSQL
19 819 (13.35%) Linux
20 799 (13.03%) Kafka
21 791 (12.90%) TDD
22 783 (12.77%) Problem-Solving
23 776 (12.65%) Analytical Skills
24 769 (12.54%) JavaScript
25 765 (12.47%) Data Analytics
26 753 (12.28%) ETL
27 751 (12.25%) Computer Science
28 749 (12.21%) Apache Hive
29 744 (12.13%) Data Warehouse
30 688 (11.22%) C#

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,728 (28.18%) Apache Spark
2 399 (6.51%) Elasticsearch
3 294 (4.79%) Apache
4 260 (4.24%) SAS
5 215 (3.51%) Apache Pig
6 151 (2.46%) Apache Solr
7 63 (1.03%) Tomcat
8 54 (0.88%) Confluence
9 47 (0.77%) JBoss
10 44 (0.72%) OpenStack
11 42 (0.68%) IIS
12 23 (0.38%) Apache Airflow
13 22 (0.36%) SharePoint
14 21 (0.34%) Jetty
14 21 (0.34%) nginx
14 21 (0.34%) WebSphere
15 20 (0.33%) Luigi
15 20 (0.33%) Oracle SOA Suite
16 18 (0.29%) Oracle Service Bus
17 15 (0.24%) BizTalk Server
Applications
1 116 (1.89%) Microsoft Excel
2 57 (0.93%) SPSS
3 56 (0.91%) Microsoft Office
4 29 (0.47%) MS Visio
5 25 (0.41%) Microsoft PowerPoint
6 17 (0.28%) GNU Octave
7 16 (0.26%) Chatbot
8 13 (0.21%) Microsoft Project
9 11 (0.18%) Mathematica
9 11 (0.18%) Weka
10 6 (0.098%) OmniGraffle
11 4 (0.065%) InVision
11 4 (0.065%) Stata
11 4 (0.065%) UXPin
12 3 (0.049%) Spreadsheet
13 2 (0.033%) Adobe Illustrator
13 2 (0.033%) HipChat
13 2 (0.033%) Photoshop
14 1 (0.016%) AutoCAD
14 1 (0.016%) SOLIDWORKS
Business Applications
1 24 (0.39%) Dynamics CRM
2 9 (0.15%) SAP S/4HANA
3 8 (0.13%) Oracle Receivables
4 7 (0.11%) Cognos Business Intelligence
5 5 (0.082%) Distributed Ledger
5 5 (0.082%) Dynamics AX
5 5 (0.082%) Markit EDM
6 4 (0.065%) Cognos TM1
6 4 (0.065%) JDE OneWorld
6 4 (0.065%) Oracle BPM
6 4 (0.065%) SAP Forecasting and Replenishment
6 4 (0.065%) SAP MDG
6 4 (0.065%) SAP Retail
7 2 (0.033%) HFM
7 2 (0.033%) Hyperion Planning
7 2 (0.033%) Oracle AML
7 2 (0.033%) Oracle Procure-to-Pay
7 2 (0.033%) SAP CO
7 2 (0.033%) SAP FI
7 2 (0.033%) SAP FI/CO
Cloud Services
1 1,506 (24.56%) Amazon AWS
2 894 (14.58%) Microsoft Azure
3 223 (3.64%) SaaS
4 192 (3.13%) Google Cloud Platform
5 179 (2.92%) Serverless
6 159 (2.59%) IaaS
7 148 (2.41%) Amazon S3
8 143 (2.33%) GitHub
9 135 (2.20%) Azure Data Factory
10 134 (2.18%) Amazon EMR
11 133 (2.17%) Cloud Computing
12 119 (1.94%) Cortana Intelligence Suite
13 114 (1.86%) Amazon Kinesis
14 106 (1.73%) PaaS
15 83 (1.35%) AWS Lambda
16 64 (1.04%) Amazon EC2
17 46 (0.75%) IBM Cloud
18 44 (0.72%) AWS CloudFormation
18 44 (0.72%) Google Analytics
19 40 (0.65%) Bluemix
Communications & Networking
1 165 (2.69%) Wireless
2 120 (1.96%) Internet
3 79 (1.29%) HTTP
4 77 (1.26%) Firewall
5 51 (0.83%) Unified Communications
6 49 (0.80%) Wireless Security
7 47 (0.77%) DNS
8 44 (0.72%) TCP/IP
9 39 (0.64%) SAN
10 38 (0.62%) SSL
11 37 (0.60%) Kerberos
12 36 (0.59%) LAN
12 36 (0.59%) Network Security
12 36 (0.59%) WAN
13 30 (0.49%) SMS
14 25 (0.41%) DHCP
15 21 (0.34%) Sourcefire
16 18 (0.29%) SMTP
17 16 (0.26%) VPN
18 11 (0.18%) Cisco IOS
Database & Business Intelligence
1 2,075 (33.83%) Hadoop
2 879 (14.33%) NoSQL
3 749 (12.21%) Apache Hive
4 744 (12.13%) Data Warehouse
5 600 (9.78%) SQL Server
6 515 (8.40%) MongoDB
7 502 (8.19%) Apache Cassandra
8 468 (7.63%) HBase
9 440 (7.17%) Relational Database
10 435 (7.09%) Data Lake
11 364 (5.94%) Power BI
12 328 (5.35%) MySQL
13 282 (4.60%) Impala
14 262 (4.27%) SQL Server Integration Services
15 228 (3.72%) PostgreSQL
16 227 (3.70%) Amazon Redshift
17 224 (3.65%) RDBMS
18 197 (3.21%) SQL Server Analysis Services
19 196 (3.20%) SQL Server Reporting Services
20 193 (3.15%) Data Mining
Development Applications
1 412 (6.72%) Git (software)
2 335 (5.46%) Jenkins
2 335 (5.46%) JIRA
3 162 (2.64%) Atlassian Bamboo
4 154 (2.51%) JUnit
5 143 (2.33%) Bitbucket
6 125 (2.04%) Visual Studio
7 112 (1.83%) Calabash
8 110 (1.79%) Selenium
9 108 (1.76%) Gradle
10 99 (1.61%) TeamCity
11 86 (1.40%) Mockito
12 81 (1.32%) Subversion
13 80 (1.30%) Maven
14 70 (1.14%) Android Studio
15 62 (1.01%) Cucumber
16 51 (0.83%) Team Foundation Server
17 44 (0.72%) Eclipse
18 42 (0.68%) CocoaPods
19 37 (0.60%) SpecFlow
General
1 1,280 (20.87%) Finance
2 488 (7.96%) Banking
3 442 (7.21%) Marketing
4 412 (6.72%) Retail
5 308 (5.02%) Telecoms
6 228 (3.72%) Investment Banking
7 213 (3.47%) Electronics
8 188 (3.07%) Financial Institution
9 158 (2.58%) Manufacturing
10 154 (2.51%) Games
11 129 (2.10%) Advertising
12 127 (2.07%) Front Office
13 85 (1.39%) Publishing
14 83 (1.35%) Pharmaceutical
15 66 (1.08%) Law
16 64 (1.04%) Legal
17 37 (0.60%) Automotive
18 35 (0.57%) Military
19 18 (0.29%) Billing
20 17 (0.28%) Retail Banking
Job Titles
1 1,695 (27.64%) Developer
2 928 (15.13%) Architect
3 681 (11.10%) Data Engineer
4 613 (10.00%) Java Developer
5 458 (7.47%) Big Data Engineer
6 420 (6.85%) Data Scientist
7 416 (6.78%) Data Architect
8 398 (6.49%) Analyst
9 320 (5.22%) Senior Developer
10 303 (4.94%) Software Engineer
11 302 (4.92%) Consultant
12 282 (4.60%) Big Data Developer
13 232 (3.78%) Big Data Architect
14 215 (3.51%) Solutions Architect
15 214 (3.49%) DevOps Engineer
16 183 (2.98%) Technical Architect
17 163 (2.66%) Java Engineer
17 163 (2.66%) Senior Java Developer
17 163 (2.66%) Software Developer
18 142 (2.32%) Python Developer
Libraries, Frameworks & Software Standards
1 799 (13.03%) Kafka
2 485 (7.91%) .NET
3 435 (7.09%) Web Services
4 401 (6.54%) HTML
5 397 (6.47%) AngularJS
6 330 (5.38%) Spring
7 324 (5.28%) Node.js
8 296 (4.83%) CSS
9 285 (4.65%) REST
10 260 (4.24%) React
11 250 (4.08%) Natural Language Processing
12 228 (3.72%) RESTful
13 226 (3.68%) XML
14 163 (2.66%) JSON
15 153 (2.49%) HTML5
16 138 (2.25%) RabbitMQ
17 136 (2.22%) J2EE
18 130 (2.12%) TensorFlow
19 129 (2.10%) SOAP
20 122 (1.99%) Hibernate
Miscellaneous
1 776 (12.65%) Analytical Skills
2 751 (12.25%) Computer Science
3 527 (8.59%) Algorithms
4 390 (6.36%) User Experience
5 322 (5.25%) Greenfield Project
6 318 (5.19%) Fintech
7 196 (3.20%) Data Centre
8 174 (2.84%) Mobile App
9 170 (2.77%) Management Information System
10 140 (2.28%) Data Structures
11 134 (2.18%) Self-Motivation
12 132 (2.15%) Cyberthreat
13 108 (1.76%) Enterprise Software
14 88 (1.43%) Public Cloud
15 64 (1.04%) Virtual Team
16 62 (1.01%) Internet of Things
17 59 (0.96%) Equities
18 56 (0.91%) Fixed Income
19 54 (0.88%) Semantic Web
20 53 (0.86%) Hedge funds
Operating Systems
1 819 (13.35%) Linux
2 316 (5.15%) Unix
3 232 (3.78%) Windows
4 119 (1.94%) Android
5 94 (1.53%) Apple iOS
6 68 (1.11%) Red Hat Enterprise Linux
7 44 (0.72%) CentOS
8 43 (0.70%) Ubuntu
8 43 (0.70%) Windows Server
9 25 (0.41%) AIX
9 25 (0.41%) Solaris
10 23 (0.38%) Mac OS
11 22 (0.36%) HPUX
12 15 (0.24%) Mac OS X
13 11 (0.18%) Windows Server 2012
14 8 (0.13%) Debian
15 7 (0.11%) Windows 10
16 6 (0.098%) Oracle Linux
16 6 (0.098%) VMS
17 5 (0.082%) Windows 7
Processes & Methodologies
1 2,243 (36.57%) Agile Software Development
2 2,140 (34.89%) Analytics
3 1,517 (24.74%) Machine Learning
4 1,292 (21.07%) Data Science
5 1,023 (16.68%) Business Intelligence
6 955 (15.57%) Software Engineering
7 890 (14.51%) DevOps
8 791 (12.90%) TDD
9 783 (12.77%) Problem-Solving
10 765 (12.47%) Data Analytics
11 753 (12.28%) ETL
12 637 (10.39%) Artificial Intelligence
13 624 (10.17%) Visualisation
14 617 (10.06%) Scrum
15 580 (9.46%) Mathematics
16 570 (9.29%) Microservices
17 468 (7.63%) Data Modelling
18 464 (7.57%) Continuous Integration
19 457 (7.45%) Open Source
20 440 (7.17%) Test Automation
Programming Languages
1 2,446 (39.88%) Java
2 2,280 (37.18%) Python
3 1,853 (30.21%) SQL
4 1,124 (18.33%) Scala
5 769 (12.54%) JavaScript
6 688 (11.22%) C#
7 645 (10.52%) C++
8 633 (10.32%) R
9 239 (3.90%) C
10 217 (3.54%) Bash Shell
10 217 (3.54%) Java 8
11 212 (3.46%) Go
12 193 (3.15%) Ruby
13 176 (2.87%) MATLAB
14 161 (2.63%) Perl
15 152 (2.48%) PHP
16 138 (2.25%) T-SQL
17 128 (2.09%) Shell Script
18 71 (1.16%) U-SQL
19 69 (1.13%) PowerShell
Qualifications
1 1,068 (17.41%) Degree
2 336 (5.48%) PhD
3 266 (4.34%) Computer Science Degree
4 168 (2.74%) Security Cleared
5 109 (1.78%) Master's Degree
6 106 (1.73%) Numerate Degree
7 67 (1.09%) Cisco Certification
8 65 (1.06%) CISSP
9 60 (0.98%) CCNA
10 58 (0.95%) SC Cleared
11 57 (0.93%) DV Cleared
12 52 (0.85%) CCIE
13 51 (0.83%) ISEB
14 45 (0.73%) CCNP
15 44 (0.72%) TOGAF Certification
16 40 (0.65%) Microsoft Certification
17 38 (0.62%) CEH
18 33 (0.54%) SANS
19 24 (0.39%) CISM
20 23 (0.38%) CISA
Quality Assurance & Compliance
1 250 (4.08%) QA
2 216 (3.52%) Data Quality
3 123 (2.01%) GDPR
4 51 (0.83%) ISO/IEC 27001
5 38 (0.62%) GCP
6 28 (0.46%) PCI DSS
7 27 (0.44%) Sarbanes-Oxley
8 25 (0.41%) Solvency II
9 15 (0.24%) Dodd-Frank
9 15 (0.24%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
10 14 (0.23%) FATCA
10 14 (0.23%) GPG13
10 14 (0.23%) HMG Security Policy Framework
10 14 (0.23%) MiFID
11 13 (0.21%) IFRS
11 13 (0.21%) IFRS 9
12 11 (0.18%) SLA
13 8 (0.13%) PMO
14 5 (0.082%) Actionable Recommendations
14 5 (0.082%) Cyber Essentials
System Software
1 562 (9.16%) Docker
2 272 (4.44%) HDFS
3 207 (3.38%) Apache Flume
4 103 (1.68%) Virtual Machines
4 103 (1.68%) VMware Infrastructure
5 51 (0.83%) Active Directory
6 43 (0.70%) Apache ZooKeeper
7 33 (0.54%) Hyper-V
7 33 (0.54%) vSphere
8 28 (0.46%) VMware NSX
9 27 (0.44%) VMware ESXi
10 21 (0.34%) NFS
10 21 (0.34%) Snort
11 9 (0.15%) VirtualBox
12 5 (0.082%) BitLocker
13 4 (0.065%) KVM
13 4 (0.065%) Oracle RAC
14 2 (0.033%) Microsoft App-V
15 1 (0.016%) Cronacle
15 1 (0.016%) Firmware
Systems Management
1 294 (4.79%) Kubernetes
2 279 (4.55%) Ansible
3 222 (3.62%) Puppet
4 175 (2.85%) Hadoop YARN
5 154 (2.51%) Opscode Chef
6 149 (2.43%) Terraform
7 133 (2.17%) Oozie
8 79 (1.29%) Mesos
9 70 (1.14%) HockeyApp
9 70 (1.14%) Salt
10 38 (0.62%) Kibana
11 29 (0.47%) Ambari
12 25 (0.41%) logstash
13 23 (0.38%) Packer
14 21 (0.34%) Docker Swarm
14 21 (0.34%) Suricata
15 18 (0.29%) Consul
15 18 (0.29%) Tivoli Storage Manager
15 18 (0.29%) vCenter Server
16 17 (0.28%) Rancher
Vendors
1 632 (10.30%) Microsoft
2 561 (9.15%) Oracle
3 531 (8.66%) Tableau
4 443 (7.22%) Google
5 362 (5.90%) Cloudera
6 219 (3.57%) Hortonworks
7 183 (2.98%) SAP
8 182 (2.97%) Atlassian
9 157 (2.56%) VMware
10 151 (2.46%) IBM
11 124 (2.02%) Cisco
12 121 (1.97%) Talend
13 113 (1.84%) Informatica
14 107 (1.74%) Teradata
15 103 (1.68%) Splunk
16 92 (1.50%) Red Hat
17 75 (1.22%) MapR
17 75 (1.22%) Salesforce.com
18 68 (1.11%) F5
19 67 (1.09%) NetApp