Period
to 23 November 2017

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 23 November 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
23 Nov 2017
Same period 2016 Same period 2015
Rank 194 202 220
Rank change year-on-year +8 +18 +99
Permanent jobs citing Hadoop 3040 3041 3211
As % of all permanent IT jobs advertised in England 1.80% 1.70% 1.57%
As % of the Database & Business Intelligence category 5.97% 5.74% 4.97%
Number of salaries quoted 2292 2521 2618
England median annual salary £62,500 £62,500 £65,000
Median salary % change year-on-year - -3.85% +8.33%
10th Percentile £37,500 £40,000 £41,250
90th Percentile £97,950 £96,250 £95,000
UK median annual salary £62,500 £62,500 £65,000
% change year-on-year - -3.85% +8.33%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 50929 53003 64619
As % of all permanent IT jobs advertised in England 30.17% 29.59% 31.59%
Number of salaries quoted 42324 45756 54927
England median annual salary £50,000 £47,500 £45,000
Median salary % change year-on-year +5.26% +5.56% -
10th Percentile £30,000 £29,000 £28,500
90th Percentile £77,500 £77,500 £75,000
UK median annual salary £47,500 £47,500 £45,000
% change year-on-year - +5.56% +2.27%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 23 November 2017.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 23 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +11 2009 £67,500 -3.57% 184
South East 0 343 £55,000 +1.85% 23
North of England +12 272 £52,500 +5.00% 28
North West +40 207 £54,000 -1.82% 19
South West -66 179 £41,000 -18.00% 13
East of England +50 145 £55,000 +4.76% 12
Midlands +20 85 £42,500 -29.17% 5
Yorkshire -13 58 £50,000 - 9
West Midlands -3 44 £47,500 -22.45% 3
East Midlands +46 41 £42,500 -29.17% 2
North East -4 7 £57,500 +27.78%
Hadoop
UK

For the 6 months to 23 November 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the England region with a requirement for Hadoop.

1 1947 (64.05%) Big Data
2 1630 (53.62%) Java
3 1546 (50.86%) Apache Spark
4 1421 (46.74%) Python
5 1299 (42.73%) Agile Software Development
6 1122 (36.91%) SQL
7 991 (32.60%) Analytics
8 772 (25.39%) Finance
9 744 (24.47%) Scala
10 716 (23.55%) Amazon AWS
11 692 (22.76%) NoSQL
12 609 (20.03%) Business Intelligence
13 595 (19.57%) Apache Hive
14 592 (19.47%) Machine Learning
15 566 (18.62%) Software Engineering
16 551 (18.13%) Linux
16 551 (18.13%) Apache Cassandra
17 529 (17.40%) Degree
18 524 (17.24%) MongoDB
19 500 (16.45%) Kafka
20 487 (16.02%) Analytical Skills
21 451 (14.84%) SQL Server
22 449 (14.77%) R
22 449 (14.77%) DevOps
23 442 (14.54%) Relational Database
24 439 (14.44%) Open Source
25 428 (14.08%) Microsoft Azure
25 428 (14.08%) Oracle
26 408 (13.42%) ETL
27 380 (12.50%) Data Warehouse

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1546 (50.86%) Apache Spark
2 363 (11.94%) Apache
3 322 (10.59%) Elasticsearch
4 251 (8.26%) SAS
5 184 (6.05%) Apache Pig
6 129 (4.24%) Tomcat
7 127 (4.18%) Apache Solr
8 84 (2.76%) OpenStack
9 77 (2.53%) JBoss
10 61 (2.01%) Jetty
11 59 (1.94%) WebLogic
12 46 (1.51%) Confluence
13 43 (1.41%) WebSphere
14 39 (1.28%) IIS
15 36 (1.18%) Apache Airflow
16 32 (1.05%) nginx
17 23 (0.76%) Cloud Foundry
18 21 (0.69%) SharePoint
19 19 (0.63%) CloudStack
20 13 (0.43%) Oracle SOA Suite
Applications
1 83 (2.73%) SPSS
2 76 (2.50%) Microsoft Excel
3 27 (0.89%) Microsoft Office
4 17 (0.56%) Microsoft PowerPoint
5 11 (0.36%) Spreadsheet
6 10 (0.33%) MS Visio
7 6 (0.20%) HipChat
8 5 (0.16%) Mathematica
8 5 (0.16%) Microsoft Project
9 4 (0.13%) CPLEX
9 4 (0.13%) Stata
10 3 (0.099%) Chatbot
10 3 (0.099%) GNU Octave
10 3 (0.099%) Pipeline Pilot
10 3 (0.099%) S-PLUS
11 2 (0.066%) Weka
12 1 (0.033%) LaTeX
Business Applications
1 16 (0.53%) SAP InfiniteInsight
2 15 (0.49%) SAP ERP
3 8 (0.26%) Dynamics CRM
4 4 (0.13%) BusinessWorks
4 4 (0.13%) SAP HR
5 2 (0.066%) Adobe Campaign
5 2 (0.066%) Oracle AML
5 2 (0.066%) Payment Gateway
6 1 (0.033%) Capstone
6 1 (0.033%) Dynamics AX
6 1 (0.033%) FastStats PeopleStage
6 1 (0.033%) HFM
6 1 (0.033%) Hyperion Enterprise
6 1 (0.033%) SAP Hybris
6 1 (0.033%) Summit
6 1 (0.033%) Unica
Cloud Services
1 716 (23.55%) Amazon AWS
2 428 (14.08%) Microsoft Azure
3 208 (6.84%) Google Cloud Platform
4 101 (3.32%) GitHub
5 94 (3.09%) Cloud Computing
6 75 (2.47%) SaaS
7 62 (2.04%) Amazon EMR
8 49 (1.61%) Amazon S3
9 43 (1.41%) AWS CloudFormation
10 40 (1.32%) IaaS
11 39 (1.28%) Amazon EC2
12 37 (1.22%) PaaS
13 36 (1.18%) Amazon Kinesis
14 28 (0.92%) Azure Machine Learning
15 23 (0.76%) Amazon CloudWatch
16 14 (0.46%) Azure Data Factory
16 14 (0.46%) Google Analytics
17 12 (0.39%) AWS Lambda
17 12 (0.39%) Serverless
18 10 (0.33%) OpenShift
Communications & Networking
1 55 (1.81%) TCP/IP
2 51 (1.68%) Internet
3 48 (1.58%) Firewall
4 43 (1.41%) Kerberos
5 32 (1.05%) SSL
6 21 (0.69%) Network Security
6 21 (0.69%) SAN
7 20 (0.66%) HTTP
8 18 (0.59%) VPN
9 17 (0.56%) LDAP
10 16 (0.53%) DNS
11 15 (0.49%) SMPP
12 13 (0.43%) VLAN
13 12 (0.39%) AMQP
14 8 (0.26%) ICMP
15 7 (0.23%) IPsec
15 7 (0.23%) NAS
16 6 (0.20%) Ethernet
17 4 (0.13%) WebEx
18 3 (0.099%) Wireshark
Database & Business Intelligence
1 1947 (64.05%) Big Data
2 692 (22.76%) NoSQL
3 595 (19.57%) Apache Hive
4 551 (18.13%) Apache Cassandra
5 524 (17.24%) MongoDB
6 451 (14.84%) SQL Server
7 442 (14.54%) Relational Database
8 380 (12.50%) Data Warehouse
9 340 (11.18%) HBase
10 282 (9.28%) RDBMS
11 279 (9.18%) MySQL
12 187 (6.15%) Redis
13 170 (5.59%) PostgreSQL
14 164 (5.39%) SQL Server Integration Services
15 149 (4.90%) QlikView
16 147 (4.84%) Data Mining
17 143 (4.70%) Impala
18 130 (4.28%) SQL Server Reporting Services
19 122 (4.01%) Power BI
20 113 (3.72%) Data Lake
Development Applications
1 290 (9.54%) Jenkins
2 279 (9.18%) Git (software)
3 175 (5.76%) JIRA
4 136 (4.47%) Maven
5 104 (3.42%) JUnit
6 94 (3.09%) Atlassian Bamboo
7 83 (2.73%) Bitbucket
8 72 (2.37%) Selenium
9 51 (1.68%) Cucumber
10 49 (1.61%) Eclipse
11 48 (1.58%) Team Foundation Server
12 46 (1.51%) Subversion
12 46 (1.51%) Talend Open Studio
13 42 (1.38%) TeamCity
14 41 (1.35%) Vagrant
15 30 (0.99%) IntelliJ
16 27 (0.89%) Gradle
17 26 (0.86%) JBehave
18 25 (0.82%) Mockito
19 24 (0.79%) SQL Server Management Studio (SSMS)
General
1 772 (25.39%) Finance
2 360 (11.84%) Banking
3 254 (8.36%) Marketing
4 198 (6.51%) Retail
5 192 (6.32%) Investment Banking
6 172 (5.66%) Front Office
7 152 (5.00%) Telecoms
8 134 (4.41%) Manufacturing
9 122 (4.01%) Electronics
10 114 (3.75%) Retail Banking
11 73 (2.40%) Games
12 47 (1.55%) Advertising
13 30 (0.99%) Pharmaceutical
14 25 (0.82%) Financial Institution
15 24 (0.79%) Legal
16 20 (0.66%) Aerospace
17 18 (0.59%) Publishing
18 17 (0.56%) Law
19 15 (0.49%) Automotive
20 12 (0.39%) Military
Job Titles
1 909 (29.90%) Developer
2 476 (15.66%) Java Developer
3 353 (11.61%) Data Engineer
4 323 (10.63%) Data Scientist
5 290 (9.54%) Software Engineer
6 274 (9.01%) Architect
7 240 (7.89%) Big Data Engineer
8 170 (5.59%) Senior Developer
9 159 (5.23%) Big Data Developer
10 152 (5.00%) Data Architect
11 129 (4.24%) Analyst
11 129 (4.24%) Hadoop Engineer
12 123 (4.05%) Java Engineer
13 111 (3.65%) Consultant
14 109 (3.59%) Senior Java Developer
15 108 (3.55%) Data Manager
16 103 (3.39%) Python Developer
17 95 (3.13%) Scala Developer
18 93 (3.06%) DevOps Engineer
19 91 (2.99%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 500 (16.45%) Kafka
2 365 (12.01%) Spring
3 275 (9.05%) AngularJS
4 268 (8.82%) Web Services
5 193 (6.35%) HTML
6 191 (6.28%) Node.js
7 189 (6.22%) Hibernate
8 167 (5.49%) CSS
9 161 (5.30%) REST
10 157 (5.16%) .NET
11 139 (4.57%) RabbitMQ
12 136 (4.47%) RESTful
13 119 (3.91%) React
14 105 (3.45%) Natural Language Processing
15 91 (2.99%) HTML5
16 86 (2.83%) Apache Camel
17 85 (2.80%) XML
18 81 (2.66%) Elastic Stack
19 78 (2.57%) ActiveMQ
20 73 (2.40%) LAMP
Miscellaneous
1 487 (16.02%) Analytical Skills
2 346 (11.38%) Computer Science
3 225 (7.40%) Algorithms
4 159 (5.23%) Greenfield Project
5 92 (3.03%) Data Structures
6 81 (2.66%) Fintech
7 60 (1.97%) Public Cloud
8 55 (1.81%) Clustering
9 52 (1.71%) Data Centre
10 46 (1.51%) Mobile App
11 44 (1.45%) Management Information System
11 44 (1.45%) User Experience
12 40 (1.32%) Enterprise Software
13 29 (0.95%) Foreign Exchange (FX)
14 27 (0.89%) Virtual Team
15 26 (0.86%) Derivative
15 26 (0.86%) Life Science
15 26 (0.86%) Market Risk
15 26 (0.86%) Private Cloud
16 21 (0.69%) Blog
Operating Systems
1 551 (18.13%) Linux
2 210 (6.91%) Windows
3 187 (6.15%) Unix
4 39 (1.28%) Ubuntu
5 35 (1.15%) Android
5 35 (1.15%) Apple iOS
5 35 (1.15%) CentOS
6 25 (0.82%) Red Hat Enterprise Linux
7 24 (0.79%) Windows Server
8 12 (0.39%) Mac OS X
9 10 (0.33%) Mac OS
10 8 (0.26%) AIX
11 4 (0.13%) CoreOS
11 4 (0.13%) Solaris
12 3 (0.099%) Kali Linux
12 3 (0.099%) VMS
12 3 (0.099%) Windows Server 2012
13 2 (0.066%) Mesosphere
13 2 (0.066%) Windows Server 2008
Processes & Methodologies
1 1299 (42.73%) Agile Software Development
2 991 (32.60%) Analytics
3 609 (20.03%) Business Intelligence
4 592 (19.47%) Machine Learning
5 566 (18.62%) Software Engineering
6 449 (14.77%) DevOps
7 439 (14.44%) Open Source
8 408 (13.42%) ETL
9 372 (12.24%) Continuous Integration
10 370 (12.17%) Scrum
11 351 (11.55%) Visualisation
12 339 (11.15%) TDD
13 334 (10.99%) Data Analytics
14 295 (9.70%) BDD
14 295 (9.70%) Test Automation
15 280 (9.21%) MapReduce
16 277 (9.11%) OO
17 263 (8.65%) Data Modelling
18 239 (7.86%) Mathematics
19 229 (7.53%) SDLC
Programming Languages
1 1630 (53.62%) Java
2 1421 (46.74%) Python
3 1122 (36.91%) SQL
4 744 (24.47%) Scala
5 449 (14.77%) R
6 378 (12.43%) JavaScript
7 275 (9.05%) C++
8 269 (8.85%) C#
9 188 (6.18%) Bash Shell
10 166 (5.46%) C
11 154 (5.07%) Ruby
12 139 (4.57%) Go
13 136 (4.47%) Perl
14 99 (3.26%) Shell Script
15 87 (2.86%) MATLAB
16 86 (2.83%) PHP
17 71 (2.34%) T-SQL
18 61 (2.01%) PowerShell
19 47 (1.55%) VBA
20 37 (1.22%) Groovy
Qualifications
1 529 (17.40%) Degree
2 248 (8.16%) Security Cleared
3 153 (5.03%) Computer Science Degree
4 124 (4.08%) PhD
5 120 (3.95%) SC Cleared
6 98 (3.22%) DV Cleared
7 63 (2.07%) Master's Degree
8 49 (1.61%) Numerate Degree
9 25 (0.82%) Microsoft Certification
10 21 (0.69%) CISSP
10 21 (0.69%) ISEB
11 20 (0.66%) MBA
12 13 (0.43%) Postgraduate
13 11 (0.36%) MCITP
13 11 (0.36%) MCTS
14 9 (0.30%) Cisco Certification
15 8 (0.26%) CEH
15 8 (0.26%) GCIH
15 8 (0.26%) OSCP
16 7 (0.23%) SANS
Quality Assurance & Compliance
1 136 (4.47%) Data Quality
2 93 (3.06%) QA
3 29 (0.95%) GCP
4 23 (0.76%) GDPR
5 20 (0.66%) ISO/IEC 27001
6 17 (0.56%) Solvency II
7 16 (0.53%) Sarbanes-Oxley
7 16 (0.53%) SLA
8 12 (0.39%) PCI DSS
9 9 (0.30%) GPG13
10 5 (0.16%) NIST 800
11 4 (0.13%) Government Security Classifications
12 3 (0.099%) Actionable Recommendations
13 2 (0.066%) MiFID
14 1 (0.033%) HMG Security Policy Framework
14 1 (0.033%) ISO 22301
14 1 (0.033%) ISO 9001
System Software
1 352 (11.58%) Docker
2 200 (6.58%) HDFS
3 158 (5.20%) Apache Flume
4 45 (1.48%) VMware Infrastructure
5 38 (1.25%) Apache ZooKeeper
6 19 (0.63%) Active Directory
7 18 (0.59%) Varnish
8 15 (0.49%) Virtual Machines
9 14 (0.46%) vSphere
10 11 (0.36%) VMware ESXi
11 10 (0.33%) Hyper-V
12 8 (0.26%) Snort
13 7 (0.23%) vCloud
14 3 (0.099%) Tivoli Workload Scheduler
14 3 (0.099%) VirtualBox
15 2 (0.066%) MapR-FS
16 1 (0.033%) Cronacle
16 1 (0.033%) Cygwin
16 1 (0.033%) GridGain
16 1 (0.033%) Oracle RAC
Systems Management
1 222 (7.30%) Puppet
2 202 (6.64%) Ansible
3 199 (6.55%) Opscode Chef
4 125 (4.11%) Kubernetes
5 93 (3.06%) Oozie
6 91 (2.99%) Mesos
7 73 (2.40%) Hadoop YARN
8 59 (1.94%) Terraform
9 41 (1.35%) Kibana
9 41 (1.35%) Salt
10 40 (1.32%) logstash
11 39 (1.28%) ZABBIX
12 26 (0.86%) Ambari
13 23 (0.76%) HAProxy
14 19 (0.63%) Nagios
15 17 (0.56%) Cobbler
16 14 (0.46%) Graphite
17 11 (0.36%) Graylog
18 9 (0.30%) ITRS Geneos
19 8 (0.26%) QRadar
Vendors
1 428 (14.08%) Oracle
2 309 (10.16%) Tableau
3 250 (8.22%) Cloudera
4 220 (7.24%) SAP
5 219 (7.20%) Google
6 216 (7.11%) Microsoft
7 140 (4.61%) Hortonworks
8 112 (3.68%) Teradata
9 85 (2.80%) IBM
10 83 (2.73%) Informatica
11 65 (2.14%) Splunk
12 62 (2.04%) MapR
13 55 (1.81%) Cognos
14 46 (1.51%) Talend
15 45 (1.48%) VMware
16 41 (1.35%) MicroStrategy
17 38 (1.25%) Red Hat
18 32 (1.05%) HP
18 32 (1.05%) Netezza
19 31 (1.02%) SaltStack