Period
to 18 December 2017

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 18 December 2017 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
18 Dec 2017
Same period 2016 Same period 2015
Rank 95 87 95
Rank change year-on-year -8 +8 +85
Permanent jobs citing Big Data 5482 5541 5961
As % of all permanent IT jobs advertised in England 3.27% 3.19% 2.95%
As % of the Database & Business Intelligence category 10.77% 10.74% 9.37%
Number of salaries quoted 4452 4677 4818
England median annual salary £62,500 £62,500 £60,000
Median salary % change year-on-year - +4.17% +4.35%
10th Percentile £37,500 £37,500 £36,250
90th Percentile £95,000 £100,000 £95,000
UK median annual salary £62,500 £62,500 £60,000
% change year-on-year - +4.17% +4.35%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 50901 51602 63650
As % of all permanent IT jobs advertised in England 30.33% 29.73% 31.54%
Number of salaries quoted 42382 44532 54300
England median annual salary £50,000 £47,500 £45,000
Median salary % change year-on-year +5.26% +5.56% -
10th Percentile £30,000 £29,750 £28,750
90th Percentile £77,500 £77,500 £75,000
UK median annual salary £47,500 £47,500 £45,000
% change year-on-year - +5.56% +2.27%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 18 December 2017.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 18 December 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +2 3482 £70,000 - 346
South East +12 766 £57,500 +8.49% 51
North of England -7 447 £50,000 -4.76% 47
North West -19 303 £50,000 -4.76% 39
South West -44 289 £52,500 -4.55% 21
East of England -27 242 £56,250 +2.27% 27
Midlands -23 223 £45,000 -25.00% 21
West Midlands +10 132 £42,500 -22.73% 10
Yorkshire +4 118 £47,500 -9.52% 7
East Midlands -59 91 £55,000 -12.00% 11
North East -6 20 £36,750 -13.53% 1
Big Data
UK

For the 6 months to 18 December 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for Big Data.

1 2296 (41.88%) Agile Software Development
2 2261 (41.24%) Java
3 1976 (36.05%) Hadoop
4 1941 (35.41%) Python
5 1879 (34.28%) Analytics
6 1635 (29.82%) SQL
7 1525 (27.82%) Apache Spark
8 1297 (23.66%) Finance
9 1150 (20.98%) Amazon AWS
10 1051 (19.17%) Machine Learning
11 988 (18.02%) Business Intelligence
12 909 (16.58%) Degree
13 900 (16.42%) Software Engineering
14 880 (16.05%) Scala
15 857 (15.63%) NoSQL
16 818 (14.92%) DevOps
17 747 (13.63%) Data Analytics
18 740 (13.50%) Linux
19 731 (13.33%) Data Warehouse
20 719 (13.12%) Analytical Skills
21 718 (13.10%) JavaScript
22 693 (12.64%) TDD
23 661 (12.06%) Microsoft Azure
24 653 (11.91%) Computer Science
25 639 (11.66%) SQL Server
26 592 (10.80%) Scrum
27 566 (10.32%) ETL
28 564 (10.29%) R
29 553 (10.09%) Docker
30 552 (10.07%) Open Source

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1525 (27.82%) Apache Spark
2 398 (7.26%) Elasticsearch
3 325 (5.93%) Apache
4 240 (4.38%) SAS
5 187 (3.41%) Apache Pig
6 108 (1.97%) Tomcat
7 104 (1.90%) Apache Solr
8 91 (1.66%) Confluence
9 86 (1.57%) JBoss
10 73 (1.33%) OpenStack
11 71 (1.30%) WebSphere
12 62 (1.13%) WebLogic
13 49 (0.89%) CMS
14 35 (0.64%) Apache Airflow
15 33 (0.60%) Moodle
16 28 (0.51%) Oracle SOA Suite
17 26 (0.47%) Jetty
18 25 (0.46%) Apache Geronimo
19 24 (0.44%) nginx
20 22 (0.40%) Cloud Foundry
Applications
1 104 (1.90%) Microsoft Excel
2 83 (1.51%) SPSS
3 30 (0.55%) Microsoft PowerPoint
4 24 (0.44%) Microsoft Office
5 16 (0.29%) Chatbot
6 13 (0.24%) MS Visio
7 11 (0.20%) OmniGraffle
7 11 (0.20%) Photoshop
8 10 (0.18%) Adobe Illustrator
8 10 (0.18%) Microsoft Project
9 8 (0.15%) GNU Octave
9 8 (0.15%) Mathematica
9 8 (0.15%) Weka
10 4 (0.073%) Spreadsheet
10 4 (0.073%) Stata
11 3 (0.055%) S-PLUS
12 2 (0.036%) HipChat
13 1 (0.018%) InVision
Business Applications
1 15 (0.27%) Markit EDM
2 12 (0.22%) Dynamics CRM
3 9 (0.16%) BusinessWorks
3 9 (0.16%) Cognos Business Intelligence
3 9 (0.16%) SAP CO
3 9 (0.16%) SAP FI
3 9 (0.16%) SAP FI/CO
3 9 (0.16%) TIBCO BusinessEvents
4 7 (0.13%) Oracle EBS
4 7 (0.13%) SAP S/4HANA
5 6 (0.11%) HFM
5 6 (0.11%) Oracle Applications
5 6 (0.11%) Oracle ERP
6 5 (0.091%) Dynamics AX
6 5 (0.091%) Oracle TCA
7 4 (0.073%) Oracle Receivables
8 3 (0.055%) Hyperion Enterprise
8 3 (0.055%) Hyperion Planning
8 3 (0.055%) NetSuite
8 3 (0.055%) Payment Gateway
Cloud Services
1 1150 (20.98%) Amazon AWS
2 661 (12.06%) Microsoft Azure
3 253 (4.62%) Google Cloud Platform
4 232 (4.23%) SaaS
5 162 (2.96%) Cloud Computing
6 125 (2.28%) GitHub
7 108 (1.97%) PaaS
8 84 (1.53%) IaaS
9 68 (1.24%) Serverless
10 62 (1.13%) AWS CloudFormation
11 60 (1.09%) Amazon S3
12 56 (1.02%) Amazon EC2
12 56 (1.02%) Azure Data Factory
13 54 (0.99%) Azure Machine Learning
14 52 (0.95%) Amazon Kinesis
15 51 (0.93%) Amazon EMR
16 40 (0.73%) Google Analytics
17 38 (0.69%) AWS Lambda
17 38 (0.69%) Cortana Intelligence Suite
18 31 (0.57%) Amazon CloudWatch
Communications & Networking
1 126 (2.30%) Internet
2 103 (1.88%) HTTP
3 82 (1.50%) Wireless
4 40 (0.73%) SSL
5 34 (0.62%) TCP/IP
6 33 (0.60%) Kerberos
7 30 (0.55%) Firewall
8 24 (0.44%) LDAP
9 23 (0.42%) Network Security
10 20 (0.36%) DNS
11 17 (0.31%) Unified Communications
12 14 (0.26%) Wireless Security
13 11 (0.20%) WAN
14 9 (0.16%) Ethernet
14 9 (0.16%) SMS
15 8 (0.15%) SAN
15 8 (0.15%) SMTP
15 8 (0.15%) Wi-Fi
16 7 (0.13%) LAN
17 6 (0.11%) GSM
Database & Business Intelligence
1 1976 (36.05%) Hadoop
2 857 (15.63%) NoSQL
3 731 (13.33%) Data Warehouse
4 639 (11.66%) SQL Server
5 540 (9.85%) Apache Cassandra
6 536 (9.78%) Apache Hive
7 525 (9.58%) Relational Database
8 503 (9.18%) MongoDB
9 366 (6.68%) HBase
10 348 (6.35%) MySQL
11 312 (5.69%) RDBMS
12 265 (4.83%) Power BI
13 246 (4.49%) SQL Server Integration Services
14 200 (3.65%) Data Lake
15 199 (3.63%) Data Mining
16 186 (3.39%) PostgreSQL
17 180 (3.28%) SQL Server Reporting Services
18 173 (3.16%) SQL Server Analysis Services
19 141 (2.57%) QlikView
20 138 (2.52%) Impala
Development Applications
1 381 (6.95%) Git (software)
2 323 (5.89%) JIRA
3 322 (5.87%) Jenkins
4 166 (3.03%) Selenium
5 142 (2.59%) Bitbucket
6 140 (2.55%) Maven
7 130 (2.37%) Atlassian Bamboo
8 124 (2.26%) JUnit
9 106 (1.93%) Cucumber
10 94 (1.71%) Talend Open Studio
11 78 (1.42%) Gradle
12 61 (1.11%) Team Foundation Server
13 60 (1.09%) Eclipse
14 59 (1.08%) Subversion
15 58 (1.06%) Calabash
15 58 (1.06%) Visual Studio
16 51 (0.93%) TeamCity
16 51 (0.93%) WebDriver
17 46 (0.84%) Mockito
18 40 (0.73%) Android Studio
General
1 1297 (23.66%) Finance
2 542 (9.89%) Banking
3 435 (7.94%) Marketing
4 418 (7.62%) Retail
5 278 (5.07%) Telecoms
6 263 (4.80%) Investment Banking
7 213 (3.89%) Electronics
8 197 (3.59%) Manufacturing
9 191 (3.48%) Front Office
10 155 (2.83%) Retail Banking
11 147 (2.68%) Games
12 91 (1.66%) Advertising
13 88 (1.61%) Legal
14 64 (1.17%) Law
14 64 (1.17%) Publishing
15 61 (1.11%) Financial Institution
16 48 (0.88%) Pharmaceutical
17 25 (0.46%) Automotive
17 25 (0.46%) Military
18 23 (0.42%) Back Office
Job Titles
1 1697 (30.96%) Developer
2 720 (13.13%) Architect
3 598 (10.91%) Java Developer
4 423 (7.72%) Data Engineer
5 376 (6.86%) Data Scientist
6 352 (6.42%) Software Engineer
7 343 (6.26%) Senior Developer
8 331 (6.04%) Consultant
9 324 (5.91%) Big Data Engineer
10 321 (5.86%) Analyst
11 272 (4.96%) Data Architect
12 242 (4.41%) Big Data Developer
13 213 (3.89%) Solutions Architect
14 201 (3.67%) Python Developer
15 166 (3.03%) Senior Java Developer
16 163 (2.97%) DevOps Engineer
17 161 (2.94%) Software Developer
18 150 (2.74%) Lead Developer
19 144 (2.63%) SQL Developer
20 143 (2.61%) Big Data Architect
Libraries, Frameworks & Software Standards
1 495 (9.03%) Kafka
2 467 (8.52%) Spring
3 433 (7.90%) .NET
4 431 (7.86%) HTML
5 427 (7.79%) AngularJS
6 374 (6.82%) Node.js
7 364 (6.64%) Web Services
8 358 (6.53%) CSS
9 292 (5.33%) React
10 281 (5.13%) REST
11 188 (3.43%) Hibernate
12 186 (3.39%) HTML5
13 175 (3.19%) Natural Language Processing
14 173 (3.16%) RESTful
15 170 (3.10%) JSON
16 165 (3.01%) XML
17 159 (2.90%) J2EE
18 139 (2.54%) jQuery
19 122 (2.23%) RabbitMQ
20 119 (2.17%) ASP.NET
Miscellaneous
1 719 (13.12%) Analytical Skills
2 653 (11.91%) Computer Science
3 443 (8.08%) Algorithms
4 355 (6.48%) Greenfield Project
5 353 (6.44%) User Experience
6 267 (4.87%) Fintech
7 212 (3.87%) Enterprise Software
8 159 (2.90%) Mobile App
9 119 (2.17%) Data Structures
10 113 (2.06%) Data Centre
11 76 (1.39%) Public Cloud
12 71 (1.30%) Management Information System
13 65 (1.19%) Internet of Things
14 53 (0.97%) Linux Command Line
15 49 (0.89%) Equities
15 49 (0.89%) Life Science
16 48 (0.88%) Hedge funds
17 41 (0.75%) Social Media
18 39 (0.71%) Clustering
19 37 (0.67%) Virtual Team
Operating Systems
1 740 (13.50%) Linux
2 278 (5.07%) Unix
3 255 (4.65%) Windows
4 109 (1.99%) Android
5 83 (1.51%) Apple iOS
6 66 (1.20%) CentOS
7 50 (0.91%) Ubuntu
8 42 (0.77%) Red Hat Enterprise Linux
9 21 (0.38%) Solaris
10 20 (0.36%) Mac OS X
11 17 (0.31%) AIX
12 16 (0.29%) Mac OS
13 13 (0.24%) Windows Server
14 7 (0.13%) HPUX
14 7 (0.13%) Windows Server 2012
15 6 (0.11%) Windows Server 2008
16 5 (0.091%) CoreOS
17 4 (0.073%) VMS
18 3 (0.055%) Debian
19 2 (0.036%) Mesosphere
Processes & Methodologies
1 2296 (41.88%) Agile Software Development
2 1879 (34.28%) Analytics
3 1051 (19.17%) Machine Learning
4 988 (18.02%) Business Intelligence
5 900 (16.42%) Software Engineering
6 818 (14.92%) DevOps
7 747 (13.63%) Data Analytics
8 693 (12.64%) TDD
9 592 (10.80%) Scrum
10 566 (10.32%) ETL
11 552 (10.07%) Open Source
12 521 (9.50%) Continuous Integration
13 489 (8.92%) Mathematics
14 483 (8.81%) BDD
15 468 (8.54%) Microservices
16 467 (8.52%) Visualisation
17 430 (7.84%) Test Automation
18 423 (7.72%) Data Modelling
19 371 (6.77%) OO
20 359 (6.55%) Big Data Analytics
Programming Languages
1 2261 (41.24%) Java
2 1941 (35.41%) Python
3 1635 (29.82%) SQL
4 880 (16.05%) Scala
5 718 (13.10%) JavaScript
6 564 (10.29%) R
7 488 (8.90%) C#
8 451 (8.23%) C++
9 248 (4.52%) C
10 217 (3.96%) Bash Shell
11 200 (3.65%) Ruby
12 186 (3.39%) Go
13 164 (2.99%) Perl
14 153 (2.79%) PHP
15 146 (2.66%) MATLAB
16 132 (2.41%) T-SQL
17 106 (1.93%) Shell Script
18 81 (1.48%) PL/SQL
19 71 (1.30%) PowerShell
20 46 (0.84%) ES6
Qualifications
1 909 (16.58%) Degree
2 251 (4.58%) PhD
3 244 (4.45%) Computer Science Degree
4 216 (3.94%) Security Cleared
5 111 (2.02%) SC Cleared
6 100 (1.82%) Master's Degree
6 100 (1.82%) Numerate Degree
7 96 (1.75%) DV Cleared
8 52 (0.95%) ISEB
9 44 (0.80%) CISSP
10 35 (0.64%) Cisco Certification
11 31 (0.57%) CCNA
12 28 (0.51%) MBA
13 22 (0.40%) Microsoft Certification
14 20 (0.36%) CCIE
14 20 (0.36%) PMI Certification
15 18 (0.33%) CCNP
15 18 (0.33%) ISTQB
16 17 (0.31%) PMP
17 15 (0.27%) CEH
Quality Assurance & Compliance
1 238 (4.34%) QA
2 217 (3.96%) Data Quality
3 53 (0.97%) GCP
4 49 (0.89%) GDPR
5 33 (0.60%) ISO/IEC 27001
6 23 (0.42%) Sarbanes-Oxley
7 21 (0.38%) Solvency II
8 13 (0.24%) GPG13
8 13 (0.24%) MiFID
8 13 (0.24%) PCI DSS
8 13 (0.24%) PMO
9 11 (0.20%) Dodd-Frank
9 11 (0.20%) SLA
10 8 (0.15%) Actionable Recommendations
11 6 (0.11%) COBIT
11 6 (0.11%) EMIR
12 5 (0.091%) HMG Security Policy Framework
12 5 (0.091%) IFRS
12 5 (0.091%) IFRS 9
13 4 (0.073%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 553 (10.09%) Docker
2 195 (3.56%) HDFS
3 144 (2.63%) Apache Flume
4 47 (0.86%) Apache ZooKeeper
5 40 (0.73%) VMware Infrastructure
6 34 (0.62%) Active Directory
7 26 (0.47%) Virtual Machines
8 14 (0.26%) Hyper-V
9 13 (0.24%) KVM
10 12 (0.22%) Snort
11 10 (0.18%) vSphere
12 9 (0.16%) Varnish
13 4 (0.073%) VMware NSX
13 4 (0.073%) Xen
14 3 (0.055%) Oracle RAC
15 2 (0.036%) MapR-FS
15 2 (0.036%) OpenAM
16 1 (0.018%) Cygwin
16 1 (0.018%) iptables
16 1 (0.018%) VMware ESXi
Systems Management
1 216 (3.94%) Kubernetes
2 214 (3.90%) Puppet
3 206 (3.76%) Ansible
4 187 (3.41%) Opscode Chef
5 92 (1.68%) Mesos
6 88 (1.61%) Terraform
7 85 (1.55%) Hadoop YARN
7 85 (1.55%) Oozie
8 37 (0.67%) Salt
9 36 (0.66%) Kibana
10 34 (0.62%) HockeyApp
11 28 (0.51%) Ambari
12 26 (0.47%) ZABBIX
13 20 (0.36%) Marathon
14 18 (0.33%) Packer
15 17 (0.31%) logstash
16 12 (0.22%) Suricata
17 11 (0.20%) Rancher
18 9 (0.16%) Docker Swarm
18 9 (0.16%) ITRS Geneos
Vendors
1 493 (8.99%) Oracle
2 459 (8.37%) Microsoft
3 398 (7.26%) Google
4 383 (6.99%) Tableau
5 264 (4.82%) Cloudera
6 221 (4.03%) SAP
7 162 (2.96%) Hortonworks
8 132 (2.41%) Splunk
9 110 (2.01%) Informatica
10 108 (1.97%) IBM
11 104 (1.90%) Red Hat
11 104 (1.90%) Teradata
12 96 (1.75%) Atlassian
13 94 (1.71%) Talend
14 73 (1.33%) VMware
15 71 (1.30%) Cognos
16 62 (1.13%) Salesforce.com
17 60 (1.09%) MapR
18 54 (0.99%) Twitter
19 43 (0.78%) HP