Period
to 17 August 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 17 August 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
17 Aug 2017
Same period 2016 Same period 2015
Rank 196 203 252
Rank change year-on-year +7 +49 +48
Permanent jobs citing Hadoop 3200 3349 2807
As % of all permanent IT jobs advertised in the UK 1.82% 1.69% 1.29%
As % of the Database & Business Intelligence category 5.92% 5.64% 4.07%
Number of salaries quoted 2401 2611 2314
UK median annual salary £62,500 £60,000 £62,500
Median salary % change year-on-year +4.17% -4.00% +4.17%
10th Percentile £36,250 £38,750 £40,000
90th Percentile £100,000 £96,250 £95,000
UK excluding London median annual salary £52,500 £51,500 £50,000
% change year-on-year +1.94% +3.00% -

Hadoop is in the database and business intelligence skills category. The next table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database and business intelligence skills.

Database & Business Intelligence Skills
UK
Permanent job vacancies with a requirement for database and business intelligence skills 54094 59421 69023
As % of all permanent IT job vacancies advertised in the UK 30.73% 30.01% 31.77%
Number of salaries quoted 45031 50734 58228
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +2.27%
10th Percentile £30,000 £28,750 £27,500
90th Percentile £77,500 £75,000 £72,500
UK excluding London median annual salary £42,500 £41,000 £40,000
% change year-on-year +3.66% +2.50% -

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 17 August 2017.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 17 August 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +1 3018 £62,500 - 222
London +2 1880 £67,500 -3.57% 152
UK excluding London +6 1266 £52,500 +1.94% 82
South East +42 403 £55,000 +0.92% 19
North of England +57 358 £55,000 +10.00% 27
North West +116 259 £60,000 +26.32% 15
East of England +39 145 £55,000 - 11
South West -58 144 £41,000 -18.00% 8
Scotland +4 103 £45,000 -16.28% 8
Yorkshire -40 81 £50,000 - 11
Midlands -32 72 £50,000 -9.09% 5
West Midlands -17 52 £53,750 -10.42% 3
Wales +27 37 £35,000 -22.22% 2
East Midlands +12 20 £50,000 +25.00% 2
North East +26 18 £45,000 -32.08% 1
Northern Ireland -11 6 £35,000 +2.94% 2

For the 6 months to 17 August 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Hadoop.

1 2097 (65.53%) Big Data
2 1704 (53.25%) Java
3 1465 (45.78%) Apache Spark
4 1414 (44.19%) Agile Software Development
5 1394 (43.56%) Python
6 1130 (35.31%) SQL
7 949 (29.66%) Analytics
8 812 (25.38%) NoSQL
9 742 (23.19%) Finance
10 715 (22.34%) Amazon AWS
11 690 (21.56%) Scala
12 652 (20.38%) Business Intelligence
13 645 (20.16%) Apache Hive
14 629 (19.66%) Machine Learning
15 620 (19.38%) MongoDB
16 602 (18.81%) Apache Cassandra
17 569 (17.78%) Linux
18 554 (17.31%) Software Engineering
19 534 (16.69%) Analytical Skills
20 533 (16.66%) R
21 523 (16.34%) Degree
22 491 (15.34%) Open Source
23 489 (15.28%) Scrum
24 484 (15.13%) SQL Server
25 479 (14.97%) Relational Database
26 478 (14.94%) Oracle
27 463 (14.47%) Kafka
28 454 (14.19%) DevOps
29 439 (13.72%) Spring
30 432 (13.50%) Microsoft Azure

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1465 (45.78%) Apache Spark
2 318 (9.94%) SAS
3 314 (9.81%) Apache
4 311 (9.72%) Elasticsearch
5 227 (7.09%) Apache Pig
6 196 (6.13%) Tomcat
7 160 (5.00%) Apache Solr
8 133 (4.16%) JBoss
9 102 (3.19%) OpenStack
9 102 (3.19%) WebLogic
10 88 (2.75%) Jetty
11 75 (2.34%) WebSphere
12 52 (1.63%) IIS
13 40 (1.25%) Confluence
14 26 (0.81%) nginx
14 26 (0.81%) Oracle SOA Suite
15 23 (0.72%) Cloud Foundry
15 23 (0.72%) WebSphere Application Server
16 21 (0.66%) Apache Airflow
17 20 (0.63%) GlassFish
Applications
1 82 (2.56%) SPSS
2 72 (2.25%) Microsoft Excel
3 22 (0.69%) Spreadsheet
4 20 (0.63%) Microsoft Office
5 19 (0.59%) Microsoft PowerPoint
6 11 (0.34%) MS Visio
7 7 (0.22%) Pipeline Pilot
8 6 (0.19%) Stata
9 5 (0.16%) S-PLUS
10 4 (0.13%) Microsoft Project
10 4 (0.13%) Weka
11 3 (0.094%) GIMP
11 3 (0.094%) SPSS Modeler
12 2 (0.063%) Gephi
13 1 (0.031%) HipChat
13 1 (0.031%) LaTeX
Business Applications
1 8 (0.25%) Oracle BPM
1 8 (0.25%) SAP GRC
2 7 (0.22%) SAP InfiniteInsight
3 4 (0.13%) BusinessWorks
3 4 (0.13%) SAP ERP
3 4 (0.13%) SAP HR
4 3 (0.094%) Oracle Applications
5 2 (0.063%) HFM
5 2 (0.063%) Hyperion Enterprise
5 2 (0.063%) SAP Hybris
6 1 (0.031%) Adobe Campaign
6 1 (0.031%) Cognos Business Intelligence
6 1 (0.031%) Dynamics AX
6 1 (0.031%) FastStats PeopleStage
6 1 (0.031%) Oracle AML
6 1 (0.031%) Unica
Cloud Services
1 715 (22.34%) Amazon AWS
2 432 (13.50%) Microsoft Azure
3 236 (7.38%) Google Cloud Platform
4 103 (3.22%) Cloud Computing
5 99 (3.09%) SaaS
6 93 (2.91%) GitHub
7 53 (1.66%) Amazon EMR
8 47 (1.47%) PaaS
9 40 (1.25%) Amazon S3
10 38 (1.19%) Amazon EC2
11 36 (1.13%) IaaS
12 21 (0.66%) Amazon Kinesis
12 21 (0.66%) OpenShift
13 19 (0.59%) Office 365
14 18 (0.56%) Azure Machine Learning
15 16 (0.50%) Google Analytics
16 12 (0.38%) Azure Data Factory
17 8 (0.25%) AWS CloudFormation
17 8 (0.25%) AWS Lambda
18 7 (0.22%) Cortana Intelligence Suite
Communications & Networking
1 61 (1.91%) Internet
2 43 (1.34%) Kerberos
3 36 (1.13%) Firewall
4 31 (0.97%) TCP/IP
5 23 (0.72%) DNS
6 19 (0.59%) SSL
7 18 (0.56%) AMQP
7 18 (0.56%) LDAP
8 17 (0.53%) HTTP
8 17 (0.53%) SAN
9 14 (0.44%) Network Security
10 12 (0.38%) NAS
10 12 (0.38%) SMPP
11 10 (0.31%) Intranet
11 10 (0.31%) SNMP
11 10 (0.31%) VPN
12 9 (0.28%) LAN
13 8 (0.25%) VLAN
14 7 (0.22%) WAN
15 6 (0.19%) Wireshark
Database & Business Intelligence
1 2097 (65.53%) Big Data
2 812 (25.38%) NoSQL
3 645 (20.16%) Apache Hive
4 620 (19.38%) MongoDB
5 602 (18.81%) Apache Cassandra
6 484 (15.13%) SQL Server
7 479 (14.97%) Relational Database
8 367 (11.47%) HBase
9 348 (10.88%) Data Warehouse
10 343 (10.72%) MySQL
11 261 (8.16%) RDBMS
12 234 (7.31%) Redis
13 228 (7.13%) SQL Server Integration Services
14 209 (6.53%) PostgreSQL
15 171 (5.34%) Data Mining
15 171 (5.34%) SQL Server Reporting Services
16 145 (4.53%) QlikView
17 133 (4.16%) Impala
18 123 (3.84%) SQL Server Analysis Services
19 111 (3.47%) Amazon Redshift
Development Applications
1 263 (8.22%) Git (software)
2 236 (7.38%) Jenkins
3 128 (4.00%) JIRA
4 119 (3.72%) Maven
5 107 (3.34%) JUnit
6 70 (2.19%) Atlassian Bamboo
7 63 (1.97%) Talend Open Studio
8 61 (1.91%) Eclipse
9 56 (1.75%) Selenium
10 50 (1.56%) Subversion
10 50 (1.56%) Team Foundation Server
11 48 (1.50%) Cucumber
12 46 (1.44%) TeamCity
13 45 (1.41%) Bitbucket
14 44 (1.38%) Vagrant
15 39 (1.22%) Mockito
16 30 (0.94%) Gradle
17 29 (0.91%) JBehave
18 28 (0.88%) Hudson
18 28 (0.88%) Visual Studio
General
1 742 (23.19%) Finance
2 334 (10.44%) Banking
3 276 (8.63%) Retail
4 251 (7.84%) Marketing
5 167 (5.22%) Investment Banking
6 163 (5.09%) Telecoms
7 147 (4.59%) Front Office
8 131 (4.09%) Electronics
9 127 (3.97%) Manufacturing
10 95 (2.97%) Retail Banking
11 78 (2.44%) Games
12 38 (1.19%) Legal
13 25 (0.78%) Advertising
14 22 (0.69%) Aerospace
15 18 (0.56%) Pharmaceutical
16 15 (0.47%) Financial Institution
16 15 (0.47%) Law
17 12 (0.38%) Military
18 9 (0.28%) Publishing
18 9 (0.28%) Spanish Language
Job Titles
1 993 (31.03%) Developer
2 542 (16.94%) Java Developer
3 381 (11.91%) Architect
4 366 (11.44%) Data Scientist
5 324 (10.13%) Data Engineer
6 262 (8.19%) Software Engineer
7 209 (6.53%) Big Data Engineer
8 198 (6.19%) Senior Developer
9 188 (5.88%) Data Architect
10 163 (5.09%) Big Data Developer
11 156 (4.88%) Hadoop Engineer
12 155 (4.84%) Analyst
13 149 (4.66%) Java Engineer
14 127 (3.97%) Senior Java Developer
15 118 (3.69%) Big Data Architect
16 108 (3.38%) Consultant
17 104 (3.25%) Software Developer
18 103 (3.22%) Hadoop Developer
19 97 (3.03%) Python Developer
20 96 (3.00%) Data Manager
Libraries, Frameworks & Software Standards
1 463 (14.47%) Kafka
2 439 (13.72%) Spring
3 343 (10.72%) Web Services
4 270 (8.44%) .NET
5 267 (8.34%) AngularJS
6 232 (7.25%) HTML
7 212 (6.63%) Node.js
8 205 (6.41%) Hibernate
9 170 (5.31%) REST
10 158 (4.94%) React
10 158 (4.94%) XML
11 156 (4.88%) CSS
12 146 (4.56%) RESTful
13 143 (4.47%) RabbitMQ
14 112 (3.50%) HTML5
15 109 (3.41%) JSON
16 102 (3.19%) Natural Language Processing
17 95 (2.97%) J2EE
18 93 (2.91%) Apache Camel
19 92 (2.88%) Lucene
Miscellaneous
1 534 (16.69%) Analytical Skills
2 334 (10.44%) Computer Science
3 224 (7.00%) Algorithms
4 194 (6.06%) Greenfield Project
5 99 (3.09%) Data Structures
6 70 (2.19%) Public Cloud
7 66 (2.06%) Fintech
7 66 (2.06%) Foreign Exchange (FX)
8 63 (1.97%) Management Information System
9 59 (1.84%) Enterprise Software
10 52 (1.63%) User Experience
11 48 (1.50%) Clustering
12 41 (1.28%) Data Centre
12 41 (1.28%) Virtual Team
13 35 (1.09%) Mobile App
14 27 (0.84%) Linux Command Line
15 26 (0.81%) Derivative
16 23 (0.72%) Blog
16 23 (0.72%) Equities
16 23 (0.72%) Social Network
Operating Systems
1 569 (17.78%) Linux
2 211 (6.59%) Windows
3 193 (6.03%) Unix
4 51 (1.59%) Red Hat Enterprise Linux
5 45 (1.41%) Windows Server
6 43 (1.34%) Android
7 40 (1.25%) Apple iOS
8 32 (1.00%) CentOS
9 15 (0.47%) Ubuntu
10 10 (0.31%) Solaris
11 9 (0.28%) AIX
12 8 (0.25%) Mac OS
13 6 (0.19%) VMS
13 6 (0.19%) Windows Server 2003
14 4 (0.13%) Mac OS X
15 3 (0.094%) CoreOS
15 3 (0.094%) Kali Linux
16 2 (0.063%) Mesosphere
16 2 (0.063%) MVS
16 2 (0.063%) SUSE Linux Enterprise Server
Processes & Methodologies
1 1414 (44.19%) Agile Software Development
2 949 (29.66%) Analytics
3 652 (20.38%) Business Intelligence
4 629 (19.66%) Machine Learning
5 554 (17.31%) Software Engineering
6 491 (15.34%) Open Source
7 489 (15.28%) Scrum
8 454 (14.19%) DevOps
9 429 (13.41%) ETL
10 396 (12.38%) TDD
11 383 (11.97%) Visualisation
12 331 (10.34%) Continuous Integration
13 330 (10.31%) MapReduce
14 299 (9.34%) Data Analytics
15 298 (9.31%) BDD
16 283 (8.84%) OO
17 247 (7.72%) Data Modelling
17 247 (7.72%) Test Automation
18 235 (7.34%) SDLC
18 235 (7.34%) Statistics
Programming Languages
1 1704 (53.25%) Java
2 1394 (43.56%) Python
3 1130 (35.31%) SQL
4 690 (21.56%) Scala
5 533 (16.66%) R
6 422 (13.19%) JavaScript
7 322 (10.06%) C++
8 309 (9.66%) C#
9 162 (5.06%) Bash Shell
9 162 (5.06%) Perl
10 152 (4.75%) C
11 143 (4.47%) Go
12 131 (4.09%) Ruby
13 110 (3.44%) Shell Script
14 106 (3.31%) T-SQL
15 97 (3.03%) PHP
16 92 (2.88%) MATLAB
17 47 (1.47%) VBA
18 45 (1.41%) PL/SQL
19 36 (1.13%) PowerShell
Qualifications
1 523 (16.34%) Degree
2 231 (7.22%) Security Cleared
3 145 (4.53%) PhD
4 118 (3.69%) Computer Science Degree
5 107 (3.34%) SC Cleared
6 90 (2.81%) Master's Degree
7 74 (2.31%) DV Cleared
8 39 (1.22%) Numerate Degree
9 24 (0.75%) Microsoft Certification
10 20 (0.63%) MCITP
11 19 (0.59%) MCTS
12 18 (0.56%) CITP
13 13 (0.41%) Postgraduate
14 10 (0.31%) ISEB
15 8 (0.25%) CISSP
15 8 (0.25%) ISTQB
16 6 (0.19%) PMI Certification
16 6 (0.19%) PMP
17 5 (0.16%) ISSEP
18 4 (0.13%) BPSS Clearance
Quality Assurance & Compliance
1 139 (4.34%) Data Quality
2 126 (3.94%) QA
3 29 (0.91%) GCP
4 24 (0.75%) GDPR
5 19 (0.59%) PCI DSS
6 12 (0.38%) Sarbanes-Oxley
7 11 (0.34%) SLA
8 8 (0.25%) ISO/IEC 27001
9 5 (0.16%) NIST 800
10 4 (0.13%) Actionable Recommendations
10 4 (0.13%) Government Security Classifications
11 1 (0.031%) ISO 22301
11 1 (0.031%) ISO 9001
11 1 (0.031%) MiFID
11 1 (0.031%) PMO
System Software
1 306 (9.56%) Docker
2 212 (6.63%) HDFS
3 131 (4.09%) Apache Flume
4 43 (1.34%) Active Directory
5 39 (1.22%) VMware Infrastructure
6 33 (1.03%) Apache ZooKeeper
7 26 (0.81%) Virtual Machines
8 14 (0.44%) Varnish
9 13 (0.41%) vSphere
10 10 (0.31%) VMware ESXi
11 6 (0.19%) Hyper-V
12 5 (0.16%) vCloud
13 4 (0.13%) Oracle RAC
13 4 (0.13%) Tivoli Workload Scheduler
13 4 (0.13%) VirtualBox
14 2 (0.063%) Cronacle
14 2 (0.063%) etcd
14 2 (0.063%) flannel
14 2 (0.063%) ProxySG
15 1 (0.031%) KVM
Systems Management
1 267 (8.34%) Puppet
2 250 (7.81%) Ansible
2 250 (7.81%) Opscode Chef
3 123 (3.84%) Kubernetes
4 93 (2.91%) Oozie
5 89 (2.78%) Mesos
6 84 (2.63%) Kibana
7 72 (2.25%) logstash
8 52 (1.63%) Hadoop YARN
9 50 (1.56%) Salt
10 34 (1.06%) Terraform
11 29 (0.91%) ZABBIX
12 26 (0.81%) Nagios
13 21 (0.66%) Ambari
14 15 (0.47%) Cobbler
14 15 (0.47%) HAProxy
15 10 (0.31%) Failover Clustering
15 10 (0.31%) Red Hat Satellite
16 8 (0.25%) Packer
16 8 (0.25%) Tivoli
Vendors
1 478 (14.94%) Oracle
2 323 (10.09%) Tableau
3 245 (7.66%) Microsoft
4 235 (7.34%) Cloudera
5 228 (7.13%) SAP
6 224 (7.00%) Google
7 149 (4.66%) Hortonworks
8 82 (2.56%) Teradata
9 79 (2.47%) Informatica
9 79 (2.47%) Splunk
10 76 (2.38%) IBM
11 65 (2.03%) MapR
12 63 (1.97%) Talend
13 61 (1.91%) Red Hat
14 51 (1.59%) Cognos
15 50 (1.56%) VMware
16 41 (1.28%) MicroStrategy
17 38 (1.19%) TIBCO
18 35 (1.09%) Vertica
19 33 (1.03%) SaltStack