Period
to 22 November 2017

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 22 November 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
22 Nov 2017
Same period 2016 Same period 2015
Rank 194 203 221
Rank change year-on-year +9 +18 +97
Permanent jobs citing Hadoop 3053 3041 3172
As % of all permanent IT jobs advertised in England 1.80% 1.69% 1.56%
As % of the Database & Business Intelligence category 5.98% 5.72% 4.95%
Number of salaries quoted 2303 2521 2583
England median annual salary £62,500 £62,500 £65,000
Median salary % change year-on-year - -3.85% +8.33%
10th Percentile £37,500 £40,000 £41,250
90th Percentile £97,900 £96,250 £94,800
UK median annual salary £62,500 £62,500 £65,000
% change year-on-year - -3.85% +8.33%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 51055 53155 64083
As % of all permanent IT jobs advertised in England 30.17% 29.61% 31.57%
Number of salaries quoted 42434 45910 54439
England median annual salary £50,000 £47,500 £45,000
Median salary % change year-on-year +5.26% +5.56% -
10th Percentile £30,000 £29,000 £28,500
90th Percentile £77,500 £77,500 £75,000
UK median annual salary £47,500 £47,500 £45,000
% change year-on-year - +5.56% +2.27%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 22 November 2017.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 22 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +11 2017 £67,500 -3.57% 165
South East -1 343 £55,000 +1.85% 24
North of England -1 275 £52,500 +5.00% 28
North West +37 208 £54,000 -1.82% 19
South West -62 179 £41,000 -18.00% 11
East of England +54 145 £55,000 +4.76% 13
Midlands +25 86 £42,500 -29.17% 5
Yorkshire -18 60 £50,000 - 9
West Midlands -16 44 £47,500 -22.45% 3
East Midlands +53 42 £42,500 -29.17% 2
North East -7 7 £57,500 +27.78%
Hadoop
UK

For the 6 months to 22 November 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for Hadoop.

1 1945 (63.71%) Big Data
2 1636 (53.59%) Java
3 1548 (50.70%) Apache Spark
4 1428 (46.77%) Python
5 1307 (42.81%) Agile Software Development
6 1129 (36.98%) SQL
7 995 (32.59%) Analytics
8 779 (25.52%) Finance
9 748 (24.50%) Scala
10 717 (23.49%) Amazon AWS
11 696 (22.80%) NoSQL
12 612 (20.05%) Business Intelligence
13 595 (19.49%) Machine Learning
14 594 (19.46%) Apache Hive
15 566 (18.54%) Software Engineering
16 554 (18.15%) Linux
17 552 (18.08%) Apache Cassandra
18 532 (17.43%) Degree
19 531 (17.39%) MongoDB
20 499 (16.34%) Kafka
21 487 (15.95%) Analytical Skills
22 458 (15.00%) R
23 453 (14.84%) SQL Server
24 449 (14.71%) DevOps
25 441 (14.44%) Relational Database
26 440 (14.41%) Open Source
27 429 (14.05%) Oracle
28 428 (14.02%) Microsoft Azure
29 409 (13.40%) ETL
30 381 (12.48%) Data Warehouse

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1548 (50.70%) Apache Spark
2 364 (11.92%) Apache
3 324 (10.61%) Elasticsearch
4 254 (8.32%) SAS
5 185 (6.06%) Apache Pig
6 132 (4.32%) Tomcat
7 126 (4.13%) Apache Solr
8 84 (2.75%) OpenStack
9 78 (2.55%) JBoss
10 63 (2.06%) Jetty
11 61 (2.00%) WebLogic
12 46 (1.51%) Confluence
13 43 (1.41%) WebSphere
14 39 (1.28%) IIS
15 35 (1.15%) Apache Airflow
16 32 (1.05%) nginx
17 23 (0.75%) Cloud Foundry
18 21 (0.69%) SharePoint
19 19 (0.62%) CloudStack
20 13 (0.43%) Oracle SOA Suite
Applications
1 83 (2.72%) SPSS
2 77 (2.52%) Microsoft Excel
3 27 (0.88%) Microsoft Office
4 17 (0.56%) Microsoft PowerPoint
5 11 (0.36%) Spreadsheet
6 10 (0.33%) MS Visio
7 6 (0.20%) HipChat
8 5 (0.16%) Mathematica
8 5 (0.16%) Microsoft Project
9 4 (0.13%) CPLEX
9 4 (0.13%) Stata
10 3 (0.098%) Chatbot
10 3 (0.098%) GNU Octave
10 3 (0.098%) Pipeline Pilot
10 3 (0.098%) S-PLUS
11 2 (0.066%) Weka
12 1 (0.033%) LaTeX
Business Applications
1 16 (0.52%) SAP InfiniteInsight
2 15 (0.49%) SAP ERP
3 7 (0.23%) Dynamics CRM
4 4 (0.13%) BusinessWorks
4 4 (0.13%) SAP HR
5 2 (0.066%) Adobe Campaign
5 2 (0.066%) HFM
5 2 (0.066%) Hyperion Enterprise
5 2 (0.066%) Oracle AML
5 2 (0.066%) Payment Gateway
6 1 (0.033%) Capstone
6 1 (0.033%) Dynamics AX
6 1 (0.033%) FastStats PeopleStage
6 1 (0.033%) SAP Hybris
6 1 (0.033%) Summit
6 1 (0.033%) Unica
Cloud Services
1 717 (23.49%) Amazon AWS
2 428 (14.02%) Microsoft Azure
3 208 (6.81%) Google Cloud Platform
4 101 (3.31%) GitHub
5 94 (3.08%) Cloud Computing
6 76 (2.49%) SaaS
7 62 (2.03%) Amazon EMR
8 49 (1.60%) Amazon S3
9 43 (1.41%) AWS CloudFormation
10 40 (1.31%) IaaS
11 39 (1.28%) Amazon EC2
12 37 (1.21%) PaaS
13 36 (1.18%) Amazon Kinesis
14 28 (0.92%) Azure Machine Learning
15 23 (0.75%) Amazon CloudWatch
16 14 (0.46%) Azure Data Factory
16 14 (0.46%) Google Analytics
17 12 (0.39%) AWS Lambda
17 12 (0.39%) Serverless
18 10 (0.33%) OpenShift
Communications & Networking
1 56 (1.83%) TCP/IP
2 53 (1.74%) Internet
3 48 (1.57%) Firewall
4 43 (1.41%) Kerberos
5 32 (1.05%) SSL
6 21 (0.69%) Network Security
6 21 (0.69%) SAN
7 20 (0.66%) HTTP
8 18 (0.59%) VPN
9 17 (0.56%) LDAP
10 16 (0.52%) DNS
10 16 (0.52%) SMPP
11 13 (0.43%) VLAN
12 12 (0.39%) AMQP
13 8 (0.26%) ICMP
14 7 (0.23%) IPsec
14 7 (0.23%) NAS
15 6 (0.20%) Ethernet
16 4 (0.13%) WebEx
17 3 (0.098%) Wireshark
Database & Business Intelligence
1 1945 (63.71%) Big Data
2 696 (22.80%) NoSQL
3 594 (19.46%) Apache Hive
4 552 (18.08%) Apache Cassandra
5 531 (17.39%) MongoDB
6 453 (14.84%) SQL Server
7 441 (14.44%) Relational Database
8 381 (12.48%) Data Warehouse
9 340 (11.14%) HBase
10 282 (9.24%) MySQL
10 282 (9.24%) RDBMS
11 191 (6.26%) Redis
12 173 (5.67%) PostgreSQL
13 165 (5.40%) SQL Server Integration Services
14 149 (4.88%) QlikView
15 147 (4.81%) Data Mining
16 144 (4.72%) Impala
17 129 (4.23%) SQL Server Reporting Services
18 123 (4.03%) Power BI
19 113 (3.70%) Data Lake
Development Applications
1 291 (9.53%) Jenkins
2 282 (9.24%) Git (software)
3 177 (5.80%) JIRA
4 136 (4.45%) Maven
5 106 (3.47%) JUnit
6 94 (3.08%) Atlassian Bamboo
7 83 (2.72%) Bitbucket
8 72 (2.36%) Selenium
9 51 (1.67%) Cucumber
10 49 (1.60%) Eclipse
10 49 (1.60%) Team Foundation Server
11 47 (1.54%) Talend Open Studio
12 46 (1.51%) Subversion
13 42 (1.38%) TeamCity
14 41 (1.34%) Vagrant
15 30 (0.98%) IntelliJ
16 27 (0.88%) Gradle
17 26 (0.85%) JBehave
18 25 (0.82%) Mockito
19 23 (0.75%) SQL Server Management Studio (SSMS)
General
1 779 (25.52%) Finance
2 361 (11.82%) Banking
3 254 (8.32%) Marketing
4 197 (6.45%) Retail
5 193 (6.32%) Investment Banking
6 172 (5.63%) Front Office
7 152 (4.98%) Telecoms
8 134 (4.39%) Manufacturing
9 122 (4.00%) Electronics
10 114 (3.73%) Retail Banking
11 73 (2.39%) Games
12 47 (1.54%) Advertising
13 30 (0.98%) Pharmaceutical
14 26 (0.85%) Financial Institution
15 24 (0.79%) Legal
16 20 (0.66%) Aerospace
17 17 (0.56%) Law
18 16 (0.52%) Publishing
19 15 (0.49%) Automotive
20 12 (0.39%) Military
Job Titles
1 915 (29.97%) Developer
2 478 (15.66%) Java Developer
3 356 (11.66%) Data Engineer
4 325 (10.65%) Data Scientist
5 288 (9.43%) Software Engineer
6 273 (8.94%) Architect
7 240 (7.86%) Big Data Engineer
8 172 (5.63%) Senior Developer
9 159 (5.21%) Big Data Developer
10 150 (4.91%) Data Architect
11 131 (4.29%) Hadoop Engineer
12 129 (4.23%) Analyst
13 121 (3.96%) Java Engineer
14 112 (3.67%) Consultant
15 111 (3.64%) Senior Java Developer
16 109 (3.57%) Data Manager
17 103 (3.37%) Python Developer
18 95 (3.11%) Scala Developer
19 93 (3.05%) DevOps Engineer
20 90 (2.95%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 499 (16.34%) Kafka
2 366 (11.99%) Spring
3 276 (9.04%) AngularJS
4 271 (8.88%) Web Services
5 193 (6.32%) HTML
6 192 (6.29%) Node.js
7 191 (6.26%) Hibernate
8 167 (5.47%) CSS
9 162 (5.31%) REST
10 159 (5.21%) .NET
11 140 (4.59%) RabbitMQ
12 136 (4.45%) RESTful
13 120 (3.93%) React
14 106 (3.47%) Natural Language Processing
15 91 (2.98%) HTML5
16 87 (2.85%) XML
17 86 (2.82%) Apache Camel
18 81 (2.65%) Elastic Stack
19 78 (2.55%) ActiveMQ
20 74 (2.42%) LAMP
Miscellaneous
1 487 (15.95%) Analytical Skills
2 346 (11.33%) Computer Science
3 227 (7.44%) Algorithms
4 161 (5.27%) Greenfield Project
5 93 (3.05%) Data Structures
6 81 (2.65%) Fintech
7 60 (1.97%) Public Cloud
8 55 (1.80%) Clustering
9 52 (1.70%) Data Centre
10 45 (1.47%) Management Information System
11 44 (1.44%) Mobile App
11 44 (1.44%) User Experience
12 39 (1.28%) Enterprise Software
13 28 (0.92%) Foreign Exchange (FX)
14 27 (0.88%) Virtual Team
15 26 (0.85%) Life Science
15 26 (0.85%) Private Cloud
16 25 (0.82%) Derivative
16 25 (0.82%) Market Risk
17 21 (0.69%) Blog
Operating Systems
1 554 (18.15%) Linux
2 210 (6.88%) Windows
3 188 (6.16%) Unix
4 39 (1.28%) Ubuntu
5 35 (1.15%) Android
5 35 (1.15%) Apple iOS
5 35 (1.15%) CentOS
6 25 (0.82%) Red Hat Enterprise Linux
7 24 (0.79%) Windows Server
8 11 (0.36%) Mac OS X
9 10 (0.33%) Mac OS
10 8 (0.26%) AIX
11 4 (0.13%) CoreOS
11 4 (0.13%) Solaris
12 3 (0.098%) Kali Linux
12 3 (0.098%) VMS
12 3 (0.098%) Windows Server 2012
13 2 (0.066%) Mesosphere
13 2 (0.066%) Windows Server 2008
Processes & Methodologies
1 1307 (42.81%) Agile Software Development
2 995 (32.59%) Analytics
3 612 (20.05%) Business Intelligence
4 595 (19.49%) Machine Learning
5 566 (18.54%) Software Engineering
6 449 (14.71%) DevOps
7 440 (14.41%) Open Source
8 409 (13.40%) ETL
9 374 (12.25%) Scrum
10 373 (12.22%) Continuous Integration
11 352 (11.53%) Visualisation
12 340 (11.14%) TDD
13 339 (11.10%) Data Analytics
14 297 (9.73%) Test Automation
15 295 (9.66%) BDD
16 279 (9.14%) MapReduce
17 278 (9.11%) OO
18 262 (8.58%) Data Modelling
19 239 (7.83%) Mathematics
20 232 (7.60%) SDLC
Programming Languages
1 1636 (53.59%) Java
2 1428 (46.77%) Python
3 1129 (36.98%) SQL
4 748 (24.50%) Scala
5 458 (15.00%) R
6 380 (12.45%) JavaScript
7 276 (9.04%) C++
8 272 (8.91%) C#
9 189 (6.19%) Bash Shell
10 167 (5.47%) C
11 154 (5.04%) Ruby
12 140 (4.59%) Go
13 136 (4.45%) Perl
14 98 (3.21%) Shell Script
15 88 (2.88%) MATLAB
16 87 (2.85%) PHP
17 69 (2.26%) T-SQL
18 60 (1.97%) PowerShell
19 48 (1.57%) VBA
20 36 (1.18%) Groovy
Qualifications
1 532 (17.43%) Degree
2 248 (8.12%) Security Cleared
3 153 (5.01%) Computer Science Degree
4 125 (4.09%) PhD
5 120 (3.93%) SC Cleared
6 97 (3.18%) DV Cleared
7 63 (2.06%) Master's Degree
8 49 (1.60%) Numerate Degree
9 25 (0.82%) Microsoft Certification
10 23 (0.75%) ISEB
11 21 (0.69%) CISSP
12 20 (0.66%) MBA
13 13 (0.43%) Postgraduate
14 11 (0.36%) MCITP
14 11 (0.36%) MCTS
15 9 (0.29%) Cisco Certification
16 8 (0.26%) CEH
16 8 (0.26%) GCIH
16 8 (0.26%) OSCP
17 7 (0.23%) Network+ Certification
Quality Assurance & Compliance
1 137 (4.49%) Data Quality
2 97 (3.18%) QA
3 29 (0.95%) GCP
4 22 (0.72%) GDPR
5 20 (0.66%) ISO/IEC 27001
6 17 (0.56%) Solvency II
7 16 (0.52%) Sarbanes-Oxley
7 16 (0.52%) SLA
8 12 (0.39%) PCI DSS
9 9 (0.29%) GPG13
10 5 (0.16%) NIST 800
11 4 (0.13%) Government Security Classifications
12 3 (0.098%) Actionable Recommendations
13 2 (0.066%) MiFID
14 1 (0.033%) HMG Security Policy Framework
14 1 (0.033%) ISO 22301
14 1 (0.033%) ISO 9001
System Software
1 354 (11.60%) Docker
2 200 (6.55%) HDFS
3 158 (5.18%) Apache Flume
4 45 (1.47%) VMware Infrastructure
5 38 (1.24%) Apache ZooKeeper
6 19 (0.62%) Active Directory
7 18 (0.59%) Varnish
8 15 (0.49%) Virtual Machines
9 14 (0.46%) vSphere
10 11 (0.36%) VMware ESXi
11 10 (0.33%) Hyper-V
12 8 (0.26%) Snort
13 7 (0.23%) vCloud
14 3 (0.098%) Tivoli Workload Scheduler
14 3 (0.098%) VirtualBox
15 2 (0.066%) MapR-FS
16 1 (0.033%) Cronacle
16 1 (0.033%) Cygwin
16 1 (0.033%) GridGain
16 1 (0.033%) Oracle RAC
Systems Management
1 222 (7.27%) Puppet
2 202 (6.62%) Ansible
3 199 (6.52%) Opscode Chef
4 125 (4.09%) Kubernetes
5 93 (3.05%) Oozie
6 92 (3.01%) Mesos
7 73 (2.39%) Hadoop YARN
8 59 (1.93%) Terraform
9 41 (1.34%) Kibana
9 41 (1.34%) Salt
10 40 (1.31%) logstash
11 39 (1.28%) ZABBIX
12 26 (0.85%) Ambari
13 23 (0.75%) HAProxy
14 19 (0.62%) Nagios
15 17 (0.56%) Cobbler
16 14 (0.46%) Graphite
17 11 (0.36%) Graylog
18 9 (0.29%) ITRS Geneos
19 8 (0.26%) QRadar
Vendors
1 429 (14.05%) Oracle
2 310 (10.15%) Tableau
3 249 (8.16%) Cloudera
4 220 (7.21%) SAP
5 219 (7.17%) Google
6 216 (7.08%) Microsoft
7 140 (4.59%) Hortonworks
8 111 (3.64%) Teradata
9 85 (2.78%) IBM
10 83 (2.72%) Informatica
11 65 (2.13%) Splunk
12 62 (2.03%) MapR
13 55 (1.80%) Cognos
14 47 (1.54%) Talend
15 45 (1.47%) VMware
16 41 (1.34%) MicroStrategy
17 38 (1.24%) Red Hat
18 32 (1.05%) HP
18 32 (1.05%) Netezza
19 31 (1.02%) SaltStack