Period
to 19 September 2017

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 19 September 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
19 Sep 2017
Same period 2016 Same period 2015
Rank 198 207 238
Rank change year-on-year +9 +31 +65
Permanent jobs citing Hadoop 2998 3078 2942
As % of all permanent IT jobs advertised in England 1.80% 1.68% 1.43%
As % of the Database & Business Intelligence category 5.92% 5.64% 4.49%
Number of salaries quoted 2232 2469 2438
England median annual salary £62,500 £62,500 £65,000
Median salary % change year-on-year - -3.85% +8.33%
10th Percentile £37,500 £38,750 £40,000
90th Percentile £100,000 £96,300 £95,000
UK median annual salary £62,500 £60,000 £65,000
% change year-on-year +4.17% -7.69% +8.33%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 50677 54533 65551
As % of all permanent IT jobs advertised in England 30.47% 29.80% 31.81%
Number of salaries quoted 42173 47060 56007
England median annual salary £48,500 £47,500 £45,000
Median salary % change year-on-year +2.11% +5.56% -
10th Percentile £30,000 £28,750 £27,750
90th Percentile £77,500 £76,250 £73,750
UK median annual salary £47,500 £47,500 £45,000
% change year-on-year - +5.56% +2.27%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 19 September 2017.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 19 September 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +10 1919 £67,500 -3.57% 153
South East +34 373 £55,000 +1.85% 19
North of England +31 340 £54,000 +8.00% 30
North West +99 254 £55,000 +10.00% 20
South West -80 139 £41,000 -18.00% 11
East of England +34 135 £52,500 -0.94% 15
Midlands +2 79 £49,250 -10.45% 2
Yorkshire -48 72 £50,000 - 8
West Midlands -7 55 £48,500 -19.17% 1
East Midlands +24 24 £50,000 +17.65% 1
North East +15 14 £40,000 -31.31% 2
Hadoop
UK

For the 6 months to 19 September 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for Hadoop.

1 1933 (64.48%) Big Data
2 1638 (54.64%) Java
3 1413 (47.13%) Apache Spark
4 1365 (45.53%) Agile Software Development
5 1309 (43.66%) Python
6 1066 (35.56%) SQL
7 886 (29.55%) Analytics
8 761 (25.38%) Finance
9 748 (24.95%) NoSQL
10 688 (22.95%) Amazon AWS
11 676 (22.55%) Scala
12 628 (20.95%) Business Intelligence
13 599 (19.98%) Apache Cassandra
14 577 (19.25%) Apache Hive
15 568 (18.95%) Linux
16 557 (18.58%) MongoDB
17 553 (18.45%) Machine Learning
18 542 (18.08%) Software Engineering
19 488 (16.28%) Degree
20 469 (15.64%) Relational Database
21 462 (15.41%) R
22 458 (15.28%) Analytical Skills
23 457 (15.24%) Kafka
24 448 (14.94%) Open Source
25 441 (14.71%) SQL Server
26 435 (14.51%) Scrum
27 431 (14.38%) DevOps
28 423 (14.11%) Microsoft Azure
29 421 (14.04%) Oracle
30 409 (13.64%) Spring

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1413 (47.13%) Apache Spark
2 320 (10.67%) Apache
3 289 (9.64%) Elasticsearch
4 251 (8.37%) SAS
5 186 (6.20%) Apache Pig
6 175 (5.84%) Tomcat
7 157 (5.24%) Apache Solr
8 103 (3.44%) JBoss
9 92 (3.07%) OpenStack
10 83 (2.77%) WebLogic
11 71 (2.37%) Jetty
12 60 (2.00%) WebSphere
13 46 (1.53%) IIS
14 45 (1.50%) Confluence
15 32 (1.07%) nginx
16 27 (0.90%) Apache Airflow
17 23 (0.77%) WebSphere Application Server
18 20 (0.67%) Cloud Foundry
19 15 (0.50%) Oracle SOA Suite
20 14 (0.47%) SharePoint
Applications
1 75 (2.50%) SPSS
2 64 (2.13%) Microsoft Excel
3 19 (0.63%) Spreadsheet
4 17 (0.57%) Microsoft Office
5 16 (0.53%) Microsoft PowerPoint
6 7 (0.23%) MS Visio
7 5 (0.17%) HipChat
8 4 (0.13%) Stata
9 3 (0.10%) CPLEX
9 3 (0.10%) GIMP
9 3 (0.10%) Microsoft Project
9 3 (0.10%) Pipeline Pilot
9 3 (0.10%) S-PLUS
10 2 (0.067%) Weka
11 1 (0.033%) LaTeX
11 1 (0.033%) SPSS Modeler
Business Applications
1 11 (0.37%) SAP InfiniteInsight
2 8 (0.27%) SAP ERP
3 4 (0.13%) BusinessWorks
3 4 (0.13%) SAP HR
4 3 (0.10%) Oracle Applications
5 2 (0.067%) Dynamics CRM
5 2 (0.067%) HFM
5 2 (0.067%) Hyperion Enterprise
5 2 (0.067%) Payment Gateway
5 2 (0.067%) SAP Hybris
6 1 (0.033%) Adobe Campaign
6 1 (0.033%) Cognos Business Intelligence
6 1 (0.033%) Dynamics AX
6 1 (0.033%) FastStats PeopleStage
6 1 (0.033%) Oracle AML
6 1 (0.033%) Unica
Cloud Services
1 688 (22.95%) Amazon AWS
2 423 (14.11%) Microsoft Azure
3 233 (7.77%) Google Cloud Platform
4 105 (3.50%) GitHub
5 96 (3.20%) Cloud Computing
6 75 (2.50%) SaaS
7 49 (1.63%) Amazon EMR
8 41 (1.37%) Amazon S3
9 36 (1.20%) Amazon EC2
10 31 (1.03%) PaaS
11 30 (1.00%) IaaS
12 28 (0.93%) AWS CloudFormation
13 23 (0.77%) Amazon Kinesis
14 20 (0.67%) Azure Machine Learning
15 17 (0.57%) OpenShift
16 16 (0.53%) Google Analytics
17 15 (0.50%) Office 365
18 14 (0.47%) Amazon CloudWatch
18 14 (0.47%) Azure Data Factory
19 8 (0.27%) AWS Lambda
Communications & Networking
1 58 (1.93%) Internet
2 43 (1.43%) Kerberos
3 32 (1.07%) Firewall
4 30 (1.00%) TCP/IP
5 23 (0.77%) SAN
6 22 (0.73%) SSL
7 20 (0.67%) LDAP
7 20 (0.67%) Network Security
8 16 (0.53%) HTTP
9 13 (0.43%) AMQP
10 12 (0.40%) SMPP
11 10 (0.33%) NAS
12 9 (0.30%) DNS
13 8 (0.27%) VLAN
14 6 (0.20%) IPsec
14 6 (0.20%) LAN
14 6 (0.20%) VPN
15 5 (0.17%) Intranet
15 5 (0.17%) Wireshark
16 4 (0.13%) WAN
Database & Business Intelligence
1 1933 (64.48%) Big Data
2 748 (24.95%) NoSQL
3 599 (19.98%) Apache Cassandra
4 577 (19.25%) Apache Hive
5 557 (18.58%) MongoDB
6 469 (15.64%) Relational Database
7 441 (14.71%) SQL Server
8 338 (11.27%) Data Warehouse
9 323 (10.77%) MySQL
10 316 (10.54%) HBase
11 281 (9.37%) RDBMS
12 234 (7.81%) Redis
13 202 (6.74%) SQL Server Integration Services
14 178 (5.94%) PostgreSQL
15 156 (5.20%) SQL Server Reporting Services
16 144 (4.80%) QlikView
17 134 (4.47%) Data Mining
18 131 (4.37%) Impala
19 113 (3.77%) SQL Server Analysis Services
20 102 (3.40%) Amazon Redshift
Development Applications
1 257 (8.57%) Git (software)
2 249 (8.31%) Jenkins
3 147 (4.90%) JIRA
4 133 (4.44%) Maven
5 118 (3.94%) JUnit
6 72 (2.40%) Atlassian Bamboo
7 61 (2.03%) Eclipse
8 59 (1.97%) Bitbucket
9 57 (1.90%) Selenium
10 56 (1.87%) Talend Open Studio
11 50 (1.67%) Team Foundation Server
12 45 (1.50%) Cucumber
12 45 (1.50%) TeamCity
13 41 (1.37%) Subversion
13 41 (1.37%) Vagrant
14 35 (1.17%) Mockito
15 33 (1.10%) Gradle
16 30 (1.00%) Visual Studio
17 29 (0.97%) JBehave
18 28 (0.93%) IntelliJ
General
1 761 (25.38%) Finance
2 368 (12.27%) Banking
3 289 (9.64%) Retail
4 250 (8.34%) Marketing
5 203 (6.77%) Investment Banking
6 178 (5.94%) Front Office
7 151 (5.04%) Telecoms
8 137 (4.57%) Manufacturing
9 134 (4.47%) Electronics
10 120 (4.00%) Retail Banking
11 65 (2.17%) Games
12 34 (1.13%) Legal
13 30 (1.00%) Advertising
14 22 (0.73%) Aerospace
15 21 (0.70%) Financial Institution
16 18 (0.60%) Pharmaceutical
17 16 (0.53%) Law
18 11 (0.37%) Automotive
19 10 (0.33%) Military
20 9 (0.30%) Spanish Language
Job Titles
1 935 (31.19%) Developer
2 486 (16.21%) Java Developer
3 324 (10.81%) Architect
4 309 (10.31%) Data Engineer
5 298 (9.94%) Data Scientist
6 264 (8.81%) Software Engineer
7 199 (6.64%) Big Data Engineer
8 174 (5.80%) Senior Developer
9 155 (5.17%) Big Data Developer
10 154 (5.14%) Data Architect
11 139 (4.64%) Analyst
12 137 (4.57%) Hadoop Engineer
13 119 (3.97%) Java Engineer
14 113 (3.77%) Senior Java Developer
15 112 (3.74%) Consultant
16 99 (3.30%) Data Manager
17 97 (3.24%) Big Data Architect
18 96 (3.20%) Python Developer
19 92 (3.07%) Hadoop Developer
20 88 (2.94%) Scala Developer
Libraries, Frameworks & Software Standards
1 457 (15.24%) Kafka
2 409 (13.64%) Spring
3 324 (10.81%) Web Services
4 266 (8.87%) AngularJS
5 228 (7.61%) .NET
6 207 (6.90%) HTML
7 202 (6.74%) Hibernate
8 190 (6.34%) Node.js
9 156 (5.20%) REST
10 144 (4.80%) React
11 143 (4.77%) CSS
12 137 (4.57%) RESTful
13 133 (4.44%) RabbitMQ
14 127 (4.24%) XML
15 100 (3.34%) HTML5
16 92 (3.07%) JSON
17 86 (2.87%) Apache Camel
18 85 (2.84%) J2EE
19 84 (2.80%) Lucene
19 84 (2.80%) Natural Language Processing
Miscellaneous
1 458 (15.28%) Analytical Skills
2 306 (10.21%) Computer Science
3 203 (6.77%) Algorithms
4 193 (6.44%) Greenfield Project
5 97 (3.24%) Data Structures
6 70 (2.33%) Public Cloud
7 59 (1.97%) Fintech
7 59 (1.97%) Management Information System
8 57 (1.90%) Foreign Exchange (FX)
9 51 (1.70%) Clustering
10 49 (1.63%) Data Centre
11 47 (1.57%) Enterprise Software
11 47 (1.57%) User Experience
12 36 (1.20%) Virtual Team
13 32 (1.07%) Mobile App
14 30 (1.00%) Derivative
15 27 (0.90%) Blog
16 26 (0.87%) Linux Command Line
17 24 (0.80%) Equities
18 22 (0.73%) Data Protection Act
Operating Systems
1 568 (18.95%) Linux
2 223 (7.44%) Windows
3 177 (5.90%) Unix
4 44 (1.47%) Windows Server
5 41 (1.37%) Red Hat Enterprise Linux
6 36 (1.20%) CentOS
7 33 (1.10%) Apple iOS
8 32 (1.07%) Android
9 25 (0.83%) Ubuntu
10 10 (0.33%) AIX
11 9 (0.30%) Solaris
12 8 (0.27%) Mac OS
13 5 (0.17%) Mac OS X
13 5 (0.17%) VMS
14 3 (0.10%) Kali Linux
14 3 (0.10%) Windows Server 2012
15 2 (0.067%) Mesosphere
15 2 (0.067%) SUSE Linux Enterprise Server
15 2 (0.067%) Windows Server 2003
15 2 (0.067%) Windows Server 2008
Processes & Methodologies
1 1365 (45.53%) Agile Software Development
2 886 (29.55%) Analytics
3 628 (20.95%) Business Intelligence
4 553 (18.45%) Machine Learning
5 542 (18.08%) Software Engineering
6 448 (14.94%) Open Source
7 435 (14.51%) Scrum
8 431 (14.38%) DevOps
9 394 (13.14%) ETL
10 377 (12.58%) TDD
11 337 (11.24%) Continuous Integration
12 315 (10.51%) Visualisation
13 314 (10.47%) BDD
14 304 (10.14%) MapReduce
15 302 (10.07%) OO
16 294 (9.81%) Data Analytics
17 249 (8.31%) Test Automation
18 243 (8.11%) SDLC
19 228 (7.61%) Data Modelling
20 204 (6.80%) Multithreading
Programming Languages
1 1638 (54.64%) Java
2 1309 (43.66%) Python
3 1066 (35.56%) SQL
4 676 (22.55%) Scala
5 462 (15.41%) R
6 357 (11.91%) JavaScript
7 306 (10.21%) C++
8 282 (9.41%) C#
9 152 (5.07%) Bash Shell
10 149 (4.97%) Perl
11 144 (4.80%) C
12 138 (4.60%) Go
13 123 (4.10%) Ruby
14 112 (3.74%) Shell Script
15 88 (2.94%) PHP
15 88 (2.94%) T-SQL
16 80 (2.67%) MATLAB
17 49 (1.63%) VBA
18 46 (1.53%) Groovy
19 41 (1.37%) PowerShell
Qualifications
1 488 (16.28%) Degree
2 218 (7.27%) Security Cleared
3 133 (4.44%) PhD
4 115 (3.84%) Computer Science Degree
5 105 (3.50%) SC Cleared
6 81 (2.70%) DV Cleared
7 75 (2.50%) Master's Degree
8 31 (1.03%) Numerate Degree
9 29 (0.97%) Microsoft Certification
10 20 (0.67%) MCITP
10 20 (0.67%) MCTS
11 17 (0.57%) ISEB
12 12 (0.40%) Postgraduate
13 7 (0.23%) CISSP
14 6 (0.20%) MBA
15 5 (0.17%) ISSEP
16 4 (0.13%) ISTQB
17 3 (0.10%) CTC Cleared
17 3 (0.10%) PMI Certification
17 3 (0.10%) PMP
Quality Assurance & Compliance
1 127 (4.24%) Data Quality
2 122 (4.07%) QA
3 28 (0.93%) GCP
4 26 (0.87%) GDPR
5 20 (0.67%) PCI DSS
6 14 (0.47%) SLA
7 12 (0.40%) Sarbanes-Oxley
8 10 (0.33%) ISO/IEC 27001
9 6 (0.20%) Solvency II
10 5 (0.17%) NIST 800
11 4 (0.13%) Actionable Recommendations
11 4 (0.13%) Government Security Classifications
12 1 (0.033%) GPG13
12 1 (0.033%) HMG Security Policy Framework
12 1 (0.033%) ISO 22301
12 1 (0.033%) ISO 9001
12 1 (0.033%) MiFID
System Software
1 297 (9.91%) Docker
2 187 (6.24%) HDFS
3 141 (4.70%) Apache Flume
4 43 (1.43%) VMware Infrastructure
5 38 (1.27%) Active Directory
6 32 (1.07%) Apache ZooKeeper
7 24 (0.80%) Virtual Machines
8 14 (0.47%) Varnish
8 14 (0.47%) vSphere
9 11 (0.37%) VMware ESXi
10 7 (0.23%) Hyper-V
11 6 (0.20%) vCloud
12 4 (0.13%) Tivoli Workload Scheduler
13 3 (0.10%) Oracle RAC
14 2 (0.067%) Cronacle
14 2 (0.067%) etcd
14 2 (0.067%) flannel
14 2 (0.067%) ProxySG
15 1 (0.033%) Cygwin
15 1 (0.033%) VirtualBox
Systems Management
1 233 (7.77%) Puppet
2 220 (7.34%) Opscode Chef
3 212 (7.07%) Ansible
4 113 (3.77%) Kubernetes
5 91 (3.04%) Oozie
6 86 (2.87%) Mesos
7 65 (2.17%) Kibana
8 61 (2.03%) logstash
9 43 (1.43%) Hadoop YARN
10 37 (1.23%) Salt
11 34 (1.13%) Terraform
12 32 (1.07%) ZABBIX
13 22 (0.73%) Ambari
13 22 (0.73%) Nagios
14 17 (0.57%) HAProxy
15 12 (0.40%) Cobbler
16 8 (0.27%) Failover Clustering
16 8 (0.27%) ITRS Geneos
17 7 (0.23%) Graphite
17 7 (0.23%) Graylog
Vendors
1 421 (14.04%) Oracle
2 297 (9.91%) Tableau
3 231 (7.71%) Google
4 219 (7.30%) Cloudera
5 218 (7.27%) Microsoft
5 218 (7.27%) SAP
6 140 (4.67%) Hortonworks
7 78 (2.60%) IBM
7 78 (2.60%) Teradata
8 68 (2.27%) Splunk
9 65 (2.17%) Informatica
10 60 (2.00%) MapR
11 58 (1.93%) Red Hat
12 56 (1.87%) Talend
13 47 (1.57%) Cognos
14 46 (1.53%) VMware
15 44 (1.47%) MicroStrategy
16 34 (1.13%) Vertica
17 32 (1.07%) SaltStack
17 32 (1.07%) TIBCO