Period
to 19 January 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 19 January 2018 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
19 Jan 2018
Same period 2017 Same period 2016
Rank 90 87 92
Rank change year-on-year -3 +5 +92
Permanent jobs citing Big Data 5,395 5,389 5,966
As % of all permanent IT jobs advertised in England 3.31% 3.23% 3.04%
As % of the Database & Business Intelligence category 10.84% 10.85% 9.58%
Number of salaries quoted 4,465 4,601 4,866
England median annual salary £65,000 £62,500 £61,750
Median salary % change year-on-year +4.00% +1.21% +7.39%
10th Percentile £37,500 £37,500 £37,500
90th Percentile £95,000 £95,000 £95,000
UK median annual salary £62,500 £62,500 £60,000
% change year-on-year - +4.17% +4.35%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 49,781 49,681 62,262
As % of all permanent IT jobs advertised in England 30.55% 29.76% 31.70%
Number of salaries quoted 41,644 42,884 53,146
England median annual salary £50,000 £47,500 £46,000
Median salary % change year-on-year +5.26% +3.26% +2.22%
10th Percentile £30,500 £29,750 £28,750
90th Percentile £77,500 £77,500 £75,000
UK median annual salary £48,000 £47,500 £45,000
% change year-on-year +1.05% +5.56% +1.12%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 19 January 2018.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 19 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +2 3,426 £70,000 - 567
South East -4 710 £55,000 +3.77% 113
North of England -16 439 £48,000 -8.57% 82
North West -19 309 £50,000 -4.76% 52
South West -35 306 £52,500 -4.55% 44
East of England +8 253 £59,000 +7.27% 48
Midlands -45 220 £50,000 -16.67% 49
West Midlands -5 126 £42,500 -29.17% 22
Yorkshire +4 104 £47,500 -13.64% 22
East Midlands -48 94 £62,500 - 27
North East -13 20 £36,750 -3.77% 8
Big Data
UK

For the 6 months to 19 January 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for Big Data.

1 2,197 (40.72%) Java
2 2,166 (40.15%) Agile Software Development
3 1,929 (35.76%) Python
4 1,851 (34.31%) Hadoop
5 1,841 (34.12%) Analytics
6 1,637 (30.34%) SQL
7 1,455 (26.97%) Apache Spark
8 1,197 (22.19%) Amazon AWS
9 1,189 (22.04%) Finance
10 1,125 (20.85%) Machine Learning
11 917 (17.00%) Scala
12 891 (16.52%) Business Intelligence
13 877 (16.26%) Degree
14 866 (16.05%) Software Engineering
15 825 (15.29%) NoSQL
16 810 (15.01%) DevOps
17 780 (14.46%) JavaScript
18 744 (13.79%) Linux
19 729 (13.51%) Data Analytics
20 723 (13.40%) TDD
21 692 (12.83%) Data Warehouse
22 674 (12.49%) Analytical Skills
23 662 (12.27%) Microsoft Azure
24 657 (12.18%) Computer Science
25 582 (10.79%) SQL Server
26 564 (10.45%) Scrum
27 559 (10.36%) ETL
28 547 (10.14%) R
29 542 (10.05%) C#
30 539 (9.99%) Docker

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,455 (26.97%) Apache Spark
2 387 (7.17%) Elasticsearch
3 302 (5.60%) Apache
4 215 (3.99%) SAS
5 190 (3.52%) Apache Pig
6 99 (1.84%) Apache Solr
7 85 (1.58%) Tomcat
8 78 (1.45%) Confluence
9 66 (1.22%) JBoss
10 57 (1.06%) OpenStack
11 51 (0.95%) WebSphere
12 42 (0.78%) WebLogic
13 37 (0.69%) Apache Airflow
14 28 (0.52%) Oracle SOA Suite
15 27 (0.50%) CMS
16 24 (0.44%) Moodle
17 20 (0.37%) nginx
18 19 (0.35%) Jetty
18 19 (0.35%) SharePoint
19 18 (0.33%) IIS
Applications
1 94 (1.74%) Microsoft Excel
2 64 (1.19%) SPSS
3 28 (0.52%) Microsoft Office
4 26 (0.48%) Microsoft PowerPoint
5 13 (0.24%) MS Visio
5 13 (0.24%) Weka
6 11 (0.20%) Chatbot
6 11 (0.20%) Microsoft Project
6 11 (0.20%) OmniGraffle
6 11 (0.20%) Photoshop
7 10 (0.19%) Adobe Illustrator
7 10 (0.19%) GNU Octave
8 9 (0.17%) Mathematica
9 4 (0.074%) Stata
10 2 (0.037%) HipChat
10 2 (0.037%) S-PLUS
11 1 (0.019%) InVision
11 1 (0.019%) Siemens NX
11 1 (0.019%) SOLIDWORKS
11 1 (0.019%) Spreadsheet
Business Applications
1 16 (0.30%) Dynamics CRM
2 12 (0.22%) Markit EDM
3 9 (0.17%) BusinessWorks
3 9 (0.17%) SAP S/4HANA
3 9 (0.17%) TIBCO BusinessEvents
4 6 (0.11%) Cognos Business Intelligence
4 6 (0.11%) Oracle EBS
5 5 (0.093%) Oracle Applications
5 5 (0.093%) Oracle ERP
5 5 (0.093%) SAP CO
5 5 (0.093%) SAP FI
5 5 (0.093%) SAP FI/CO
6 4 (0.074%) Dynamics AX
6 4 (0.074%) HFM
6 4 (0.074%) Oracle Receivables
6 4 (0.074%) Oracle TCA
7 3 (0.056%) Distributed Ledger
7 3 (0.056%) NetSuite
7 3 (0.056%) Payment Gateway
7 3 (0.056%) SAP Hybris
Cloud Services
1 1,197 (22.19%) Amazon AWS
2 662 (12.27%) Microsoft Azure
3 221 (4.10%) Google Cloud Platform
4 214 (3.97%) SaaS
5 135 (2.50%) Cloud Computing
6 127 (2.35%) GitHub
7 109 (2.02%) PaaS
8 103 (1.91%) IaaS
9 96 (1.78%) Serverless
10 81 (1.50%) Azure Data Factory
11 73 (1.35%) Amazon S3
12 67 (1.24%) AWS CloudFormation
13 64 (1.19%) Amazon Kinesis
14 62 (1.15%) Cortana Intelligence Suite
15 58 (1.08%) Amazon EC2
16 56 (1.04%) Amazon EMR
17 50 (0.93%) AWS Lambda
18 44 (0.82%) Google Analytics
19 43 (0.80%) Azure Machine Learning
20 30 (0.56%) Amazon CloudWatch
Communications & Networking
1 128 (2.37%) Internet
2 117 (2.17%) Wireless
3 106 (1.96%) HTTP
4 47 (0.87%) SSL
5 40 (0.74%) Firewall
6 37 (0.69%) TCP/IP
7 32 (0.59%) Kerberos
8 31 (0.57%) Network Security
9 27 (0.50%) Unified Communications
10 26 (0.48%) Wireless Security
11 25 (0.46%) DNS
12 19 (0.35%) WAN
13 16 (0.30%) SAN
14 15 (0.28%) LAN
15 12 (0.22%) SMS
16 10 (0.19%) SMTP
17 9 (0.17%) Ethernet
18 8 (0.15%) DHCP
19 6 (0.11%) GSM
19 6 (0.11%) Wi-Fi
Database & Business Intelligence
1 1,851 (34.31%) Hadoop
2 825 (15.29%) NoSQL
3 692 (12.83%) Data Warehouse
4 582 (10.79%) SQL Server
5 536 (9.94%) Apache Hive
6 518 (9.60%) MongoDB
7 496 (9.19%) Apache Cassandra
8 476 (8.82%) Relational Database
9 394 (7.30%) HBase
10 331 (6.14%) MySQL
11 270 (5.00%) RDBMS
12 255 (4.73%) Power BI
13 218 (4.04%) Data Lake
14 215 (3.99%) SQL Server Integration Services
15 191 (3.54%) Data Mining
16 183 (3.39%) PostgreSQL
17 154 (2.85%) SQL Server Analysis Services
18 153 (2.84%) SQL Server Reporting Services
19 137 (2.54%) Impala
20 134 (2.48%) Amazon Redshift
Development Applications
1 371 (6.88%) Git (software)
2 335 (6.21%) JIRA
3 314 (5.82%) Jenkins
4 157 (2.91%) Bitbucket
5 151 (2.80%) Selenium
6 150 (2.78%) Atlassian Bamboo
7 132 (2.45%) Maven
8 131 (2.43%) JUnit
9 92 (1.71%) Gradle
10 89 (1.65%) Cucumber
11 81 (1.50%) Calabash
12 71 (1.32%) Visual Studio
13 59 (1.09%) Team Foundation Server
14 57 (1.06%) TeamCity
15 54 (1.00%) Mockito
16 53 (0.98%) Android Studio
17 49 (0.91%) Subversion
18 47 (0.87%) Eclipse
19 42 (0.78%) WebDriver
20 37 (0.69%) gulp
General
1 1,189 (22.04%) Finance
2 482 (8.93%) Banking
3 389 (7.21%) Retail
4 367 (6.80%) Marketing
5 245 (4.54%) Telecoms
6 220 (4.08%) Investment Banking
7 186 (3.45%) Electronics
8 157 (2.91%) Manufacturing
9 151 (2.80%) Games
10 150 (2.78%) Front Office
11 109 (2.02%) Retail Banking
12 88 (1.63%) Advertising
13 81 (1.50%) Financial Institution
14 71 (1.32%) Publishing
15 70 (1.30%) Legal
16 61 (1.13%) Law
17 56 (1.04%) Pharmaceutical
18 37 (0.69%) Automotive
19 22 (0.41%) Military
20 19 (0.35%) Back Office
Job Titles
1 1,660 (30.77%) Developer
2 717 (13.29%) Architect
3 581 (10.77%) Java Developer
4 466 (8.64%) Data Engineer
5 358 (6.64%) Data Scientist
6 351 (6.51%) Big Data Engineer
7 332 (6.15%) Analyst
8 328 (6.08%) Senior Developer
9 320 (5.93%) Consultant
10 306 (5.67%) Software Engineer
11 280 (5.19%) Data Architect
12 234 (4.34%) Big Data Developer
13 205 (3.80%) Solutions Architect
14 179 (3.32%) Python Developer
15 176 (3.26%) DevOps Engineer
16 162 (3.00%) Software Developer
17 154 (2.85%) Senior Java Developer
18 150 (2.78%) Big Data Architect
19 137 (2.54%) Lead Developer
20 133 (2.47%) Java Engineer
Libraries, Frameworks & Software Standards
1 518 (9.60%) Kafka
2 460 (8.53%) HTML
3 437 (8.10%) AngularJS
4 423 (7.84%) .NET
5 404 (7.49%) Spring
6 383 (7.10%) Node.js
7 370 (6.86%) CSS
8 347 (6.43%) Web Services
9 288 (5.34%) React
10 285 (5.28%) REST
11 191 (3.54%) HTML5
12 175 (3.24%) Natural Language Processing
13 169 (3.13%) Hibernate
14 158 (2.93%) XML
15 155 (2.87%) JSON
16 154 (2.85%) RESTful
17 147 (2.72%) J2EE
18 128 (2.37%) jQuery
19 124 (2.30%) SOAP
20 120 (2.22%) ASP.NET
Miscellaneous
1 674 (12.49%) Analytical Skills
2 657 (12.18%) Computer Science
3 459 (8.51%) Algorithms
4 378 (7.01%) User Experience
5 320 (5.93%) Greenfield Project
6 271 (5.02%) Fintech
7 176 (3.26%) Enterprise Software
8 170 (3.15%) Mobile App
9 149 (2.76%) Data Centre
10 121 (2.24%) Data Structures
11 67 (1.24%) Management Information System
12 60 (1.11%) Internet of Things
13 58 (1.08%) Equities
14 57 (1.06%) Public Cloud
15 53 (0.98%) Hedge funds
16 49 (0.91%) Linux Command Line
17 46 (0.85%) Clustering
18 42 (0.78%) Life Science
19 38 (0.70%) N-Tier
20 37 (0.69%) Fixed Income
Operating Systems
1 744 (13.79%) Linux
2 284 (5.26%) Unix
3 229 (4.24%) Windows
4 109 (2.02%) Android
5 86 (1.59%) Apple iOS
6 52 (0.96%) CentOS
7 47 (0.87%) Ubuntu
8 41 (0.76%) Red Hat Enterprise Linux
9 22 (0.41%) Mac OS X
9 22 (0.41%) Solaris
10 17 (0.32%) AIX
10 17 (0.32%) Mac OS
11 15 (0.28%) Windows Server
12 7 (0.13%) HPUX
12 7 (0.13%) VMS
12 7 (0.13%) Windows Server 2012
13 6 (0.11%) Oracle Linux
14 5 (0.093%) CoreOS
15 3 (0.056%) Windows Server 2008
16 2 (0.037%) Windows 8
Processes & Methodologies
1 2,166 (40.15%) Agile Software Development
2 1,841 (34.12%) Analytics
3 1,125 (20.85%) Machine Learning
4 891 (16.52%) Business Intelligence
5 866 (16.05%) Software Engineering
6 810 (15.01%) DevOps
7 729 (13.51%) Data Analytics
8 723 (13.40%) TDD
9 564 (10.45%) Scrum
10 559 (10.36%) ETL
11 492 (9.12%) Visualisation
12 482 (8.93%) Mathematics
12 482 (8.93%) Microservices
13 477 (8.84%) Open Source
14 467 (8.66%) Continuous Integration
15 456 (8.45%) BDD
16 430 (7.97%) Test Automation
17 408 (7.56%) Data Modelling
18 342 (6.34%) Big Data Analytics
19 318 (5.89%) Data Visualisation
Programming Languages
1 2,197 (40.72%) Java
2 1,929 (35.76%) Python
3 1,637 (30.34%) SQL
4 917 (17.00%) Scala
5 780 (14.46%) JavaScript
6 547 (10.14%) R
7 542 (10.05%) C#
8 485 (8.99%) C++
9 222 (4.11%) C
10 221 (4.10%) Bash Shell
11 197 (3.65%) Ruby
12 186 (3.45%) Go
13 171 (3.17%) Perl
14 161 (2.98%) PHP
15 137 (2.54%) MATLAB
16 107 (1.98%) T-SQL
17 94 (1.74%) Shell Script
18 81 (1.50%) PL/SQL
19 63 (1.17%) PowerShell
20 50 (0.93%) Objective-C
Qualifications
1 877 (16.26%) Degree
2 264 (4.89%) PhD
3 230 (4.26%) Computer Science Degree
4 170 (3.15%) Security Cleared
5 95 (1.76%) Master's Degree
6 88 (1.63%) Numerate Degree
7 84 (1.56%) SC Cleared
8 76 (1.41%) DV Cleared
9 54 (1.00%) ISEB
10 50 (0.93%) CISSP
11 45 (0.83%) Cisco Certification
12 39 (0.72%) CCNA
13 31 (0.57%) CCIE
14 29 (0.54%) MBA
14 29 (0.54%) Microsoft Certification
15 25 (0.46%) CCNP
16 21 (0.39%) SANS
17 19 (0.35%) CEH
18 18 (0.33%) CCDP
18 18 (0.33%) GIAC
Quality Assurance & Compliance
1 250 (4.63%) QA
2 194 (3.60%) Data Quality
3 76 (1.41%) GDPR
4 49 (0.91%) GCP
5 37 (0.69%) ISO/IEC 27001
6 28 (0.52%) Sarbanes-Oxley
7 25 (0.46%) Solvency II
8 19 (0.35%) PCI DSS
9 16 (0.30%) PMO
10 13 (0.24%) GPG13
11 11 (0.20%) HMG Security Policy Framework
11 11 (0.20%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
11 11 (0.20%) SLA
12 10 (0.19%) Dodd-Frank
12 10 (0.19%) MiFID
13 7 (0.13%) FATCA
13 7 (0.13%) IFRS
13 7 (0.13%) IFRS 9
14 6 (0.11%) Actionable Recommendations
15 4 (0.074%) Cyber Essentials
System Software
1 539 (9.99%) Docker
2 194 (3.60%) HDFS
3 140 (2.59%) Apache Flume
4 59 (1.09%) VMware Infrastructure
5 43 (0.80%) Apache ZooKeeper
6 35 (0.65%) Active Directory
7 34 (0.63%) Virtual Machines
8 22 (0.41%) Hyper-V
9 12 (0.22%) Snort
9 12 (0.22%) vSphere
10 11 (0.20%) VMware NSX
11 9 (0.17%) Varnish
12 8 (0.15%) NFS
12 8 (0.15%) VMware ESXi
13 4 (0.074%) KVM
14 3 (0.056%) BitLocker
14 3 (0.056%) Oracle RAC
15 2 (0.037%) MapR-FS
15 2 (0.037%) Xen
16 1 (0.019%) iptables
Systems Management
1 221 (4.10%) Kubernetes
2 217 (4.02%) Puppet
3 197 (3.65%) Ansible
4 163 (3.02%) Opscode Chef
5 100 (1.85%) Hadoop YARN
6 98 (1.82%) Terraform
7 78 (1.45%) Oozie
8 76 (1.41%) Mesos
9 48 (0.89%) HockeyApp
10 35 (0.65%) Salt
11 31 (0.57%) Kibana
12 27 (0.50%) Ambari
13 25 (0.46%) ZABBIX
14 17 (0.32%) Marathon
15 16 (0.30%) Packer
16 15 (0.28%) Docker Swarm
17 13 (0.24%) Rancher
18 12 (0.22%) Suricata
19 11 (0.20%) logstash
19 11 (0.20%) Simian Army
Vendors
1 505 (9.36%) Oracle
2 461 (8.54%) Microsoft
3 425 (7.88%) Google
4 392 (7.27%) Tableau
5 256 (4.75%) Cloudera
6 181 (3.35%) SAP
7 156 (2.89%) Hortonworks
8 140 (2.59%) IBM
9 127 (2.35%) Splunk
10 124 (2.30%) Atlassian
11 114 (2.11%) Teradata
12 102 (1.89%) Informatica
13 96 (1.78%) Talend
14 94 (1.74%) Red Hat
15 92 (1.71%) VMware
16 64 (1.19%) MapR
17 60 (1.11%) Salesforce.com
17 60 (1.11%) Twitter
18 58 (1.08%) Cisco
18 58 (1.08%) Cognos