Period
to 26 September 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 26 September 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
26 Sep 2017
Same period 2016 Same period 2015
Rank 200 205 239
Rank change year-on-year +5 +34 +65
Permanent jobs citing Hadoop 3182 3201 3066
As % of all permanent IT jobs advertised in the UK 1.79% 1.66% 1.40%
As % of the Database & Business Intelligence category 5.86% 5.58% 4.41%
Number of salaries quoted 2355 2536 2515
UK median annual salary £60,000 £60,000 £65,000
Median salary % change year-on-year - -7.69% +8.33%
10th Percentile £36,350 £38,500 £40,000
90th Percentile £97,800 £96,250 £93,750
UK excluding London median annual salary £51,500 £51,500 £50,000
% change year-on-year - +3.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 54291 57344 69496
As % of all permanent IT jobs advertised in the UK 30.60% 29.75% 31.72%
Number of salaries quoted 44668 48856 58726
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +1.12%
10th Percentile £30,000 £28,750 £27,500
90th Percentile £77,500 £76,000 £73,750
UK excluding London median annual salary £42,500 £41,500 £40,000
% change year-on-year +2.41% +3.75% -

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 26 September 2017.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 26 September 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +5 3011 £62,500 - 108
London +17 1937 £67,500 -3.57% 70
UK excluding London 0 1190 £51,500 - 41
South East +19 370 £55,000 +1.85% 7
North of England +28 336 £54,000 +8.00% 19
North West +94 254 £55,000 +10.00% 12
South West -81 141 £41,000 -18.00% 6
East of England +40 138 £52,223 -1.47% 3
Scotland -25 96 £52,500 -4.55% 1
Midlands -2 78 £48,500 -11.82% 3
Yorkshire -48 69 £50,000 - 6
West Midlands -10 54 £48,500 -19.17% 3
Wales +7 29 £35,687 -20.70% 1
East Midlands +42 24 £50,000 +17.65%
North East +11 13 £55,000 -5.55% 1
Northern Ireland -18 5 £46,000 +35.29% 1

For the 6 months to 26 September 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Hadoop.

1 2033 (63.89%) Big Data
2 1732 (54.43%) Java
3 1483 (46.61%) Apache Spark
4 1436 (45.13%) Agile Software Development
5 1378 (43.31%) Python
6 1141 (35.86%) SQL
7 971 (30.52%) Analytics
8 821 (25.80%) Finance
9 796 (25.02%) NoSQL
10 723 (22.72%) Scala
11 719 (22.60%) Amazon AWS
12 663 (20.84%) Business Intelligence
13 609 (19.14%) MongoDB
14 603 (18.95%) Apache Cassandra
15 600 (18.86%) Apache Hive
16 595 (18.70%) Software Engineering
16 595 (18.70%) Linux
17 590 (18.54%) Machine Learning
18 509 (16.00%) Degree
19 495 (15.56%) R
20 493 (15.49%) Relational Database
21 491 (15.43%) Analytical Skills
22 476 (14.96%) Open Source
23 475 (14.93%) Kafka
24 466 (14.64%) Oracle
25 463 (14.55%) SQL Server
25 463 (14.55%) DevOps
26 447 (14.05%) Scrum
27 446 (14.02%) Microsoft Azure
28 427 (13.42%) Spring

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1483 (46.61%) Apache Spark
2 346 (10.87%) Apache
3 306 (9.62%) Elasticsearch
4 281 (8.83%) SAS
5 193 (6.07%) Apache Pig
6 184 (5.78%) Tomcat
7 155 (4.87%) Apache Solr
8 111 (3.49%) JBoss
9 96 (3.02%) WebLogic
10 93 (2.92%) OpenStack
11 82 (2.58%) Jetty
12 69 (2.17%) WebSphere
13 51 (1.60%) IIS
14 44 (1.38%) Confluence
15 32 (1.01%) nginx
16 29 (0.91%) Apache Airflow
17 24 (0.75%) Oracle SOA Suite
18 22 (0.69%) WebSphere Application Server
19 21 (0.66%) Cloud Foundry
20 18 (0.57%) SharePoint
Applications
1 75 (2.36%) SPSS
2 68 (2.14%) Microsoft Excel
3 18 (0.57%) Spreadsheet
4 17 (0.53%) Microsoft Office
5 16 (0.50%) Microsoft PowerPoint
6 7 (0.22%) MS Visio
7 5 (0.16%) HipChat
8 4 (0.13%) Microsoft Project
8 4 (0.13%) Stata
9 3 (0.094%) CPLEX
9 3 (0.094%) GIMP
9 3 (0.094%) Pipeline Pilot
9 3 (0.094%) S-PLUS
10 2 (0.063%) Weka
11 1 (0.031%) LaTeX
11 1 (0.031%) SPSS Modeler
Business Applications
1 12 (0.38%) SAP InfiniteInsight
2 9 (0.28%) SAP ERP
3 8 (0.25%) Oracle BPM
3 8 (0.25%) SAP GRC
4 4 (0.13%) BusinessWorks
4 4 (0.13%) SAP HR
5 3 (0.094%) Oracle Applications
6 2 (0.063%) Adobe Campaign
6 2 (0.063%) Dynamics CRM
6 2 (0.063%) HFM
6 2 (0.063%) Hyperion Enterprise
6 2 (0.063%) Payment Gateway
7 1 (0.031%) Cognos Business Intelligence
7 1 (0.031%) Dynamics AX
7 1 (0.031%) FastStats PeopleStage
7 1 (0.031%) Oracle AML
7 1 (0.031%) SAP Hybris
7 1 (0.031%) Unica
Cloud Services
1 719 (22.60%) Amazon AWS
2 446 (14.02%) Microsoft Azure
3 234 (7.35%) Google Cloud Platform
4 109 (3.43%) GitHub
5 104 (3.27%) Cloud Computing
6 89 (2.80%) SaaS
7 53 (1.67%) Amazon EMR
8 41 (1.29%) Amazon EC2
8 41 (1.29%) Amazon S3
8 41 (1.29%) PaaS
9 36 (1.13%) AWS CloudFormation
10 32 (1.01%) IaaS
11 27 (0.85%) Amazon Kinesis
12 23 (0.72%) Azure Machine Learning
13 19 (0.60%) Amazon CloudWatch
14 17 (0.53%) Google Analytics
15 15 (0.47%) OpenShift
16 14 (0.44%) Azure Data Factory
17 12 (0.38%) Office 365
18 11 (0.35%) AWS Lambda
Communications & Networking
1 62 (1.95%) Internet
2 42 (1.32%) Kerberos
3 39 (1.23%) Firewall
4 37 (1.16%) TCP/IP
5 25 (0.79%) SAN
6 23 (0.72%) AMQP
7 22 (0.69%) SSL
8 20 (0.63%) DNS
8 20 (0.63%) Network Security
9 19 (0.60%) LDAP
10 17 (0.53%) HTTP
11 13 (0.41%) SMPP
11 13 (0.41%) VPN
12 12 (0.38%) NAS
13 9 (0.28%) SNMP
14 8 (0.25%) VLAN
15 6 (0.19%) IPsec
15 6 (0.19%) LAN
16 5 (0.16%) Intranet
16 5 (0.16%) Wireshark
Database & Business Intelligence
1 2033 (63.89%) Big Data
2 796 (25.02%) NoSQL
3 609 (19.14%) MongoDB
4 603 (18.95%) Apache Cassandra
5 600 (18.86%) Apache Hive
6 493 (15.49%) Relational Database
7 463 (14.55%) SQL Server
8 370 (11.63%) Data Warehouse
9 343 (10.78%) HBase
10 331 (10.40%) MySQL
11 294 (9.24%) RDBMS
12 247 (7.76%) Redis
13 197 (6.19%) PostgreSQL
14 196 (6.16%) SQL Server Integration Services
15 156 (4.90%) QlikView
16 154 (4.84%) SQL Server Reporting Services
17 139 (4.37%) Data Mining
18 134 (4.21%) Impala
19 112 (3.52%) Amazon Redshift
20 111 (3.49%) Data Lake
Development Applications
1 272 (8.55%) Jenkins
2 271 (8.52%) Git (software)
3 163 (5.12%) JIRA
4 136 (4.27%) Maven
5 119 (3.74%) JUnit
6 80 (2.51%) Atlassian Bamboo
7 75 (2.36%) Bitbucket
8 70 (2.20%) Selenium
9 60 (1.89%) Eclipse
10 57 (1.79%) Team Foundation Server
11 55 (1.73%) Cucumber
11 55 (1.73%) Talend Open Studio
12 51 (1.60%) Vagrant
13 44 (1.38%) TeamCity
14 40 (1.26%) Subversion
15 33 (1.04%) Gradle
16 32 (1.01%) Mockito
17 29 (0.91%) IntelliJ
17 29 (0.91%) Visual Studio
18 28 (0.88%) JBehave
General
1 821 (25.80%) Finance
2 373 (11.72%) Banking
3 299 (9.40%) Retail
4 268 (8.42%) Marketing
5 205 (6.44%) Investment Banking
6 176 (5.53%) Front Office
7 148 (4.65%) Telecoms
8 140 (4.40%) Manufacturing
9 132 (4.15%) Electronics
10 121 (3.80%) Retail Banking
11 76 (2.39%) Games
12 35 (1.10%) Legal
13 32 (1.01%) Advertising
14 23 (0.72%) Aerospace
15 22 (0.69%) Financial Institution
16 20 (0.63%) Pharmaceutical
17 16 (0.50%) Law
18 12 (0.38%) Automotive
19 9 (0.28%) Military
19 9 (0.28%) Spanish Language
Job Titles
1 988 (31.05%) Developer
2 521 (16.37%) Java Developer
3 346 (10.87%) Architect
4 325 (10.21%) Data Scientist
5 315 (9.90%) Data Engineer
6 291 (9.15%) Software Engineer
7 207 (6.51%) Big Data Engineer
8 184 (5.78%) Senior Developer
9 168 (5.28%) Big Data Developer
10 164 (5.15%) Data Architect
11 150 (4.71%) Analyst
12 137 (4.31%) Hadoop Engineer
13 130 (4.09%) Java Engineer
14 123 (3.87%) Senior Java Developer
15 117 (3.68%) Consultant
16 101 (3.17%) Data Manager
17 95 (2.99%) Big Data Architect
17 95 (2.99%) Python Developer
17 95 (2.99%) Software Developer
18 92 (2.89%) Scala Developer
Libraries, Frameworks & Software Standards
1 475 (14.93%) Kafka
2 427 (13.42%) Spring
3 318 (9.99%) Web Services
4 281 (8.83%) AngularJS
5 237 (7.45%) .NET
6 228 (7.17%) Hibernate
7 227 (7.13%) HTML
8 206 (6.47%) Node.js
9 158 (4.97%) CSS
10 155 (4.87%) RESTful
11 151 (4.75%) React
11 151 (4.75%) REST
12 144 (4.53%) XML
13 142 (4.46%) RabbitMQ
14 120 (3.77%) HTML5
15 105 (3.30%) JSON
16 95 (2.99%) Natural Language Processing
17 84 (2.64%) Apache Camel
18 83 (2.61%) J2EE
18 83 (2.61%) Lucene
Miscellaneous
1 491 (15.43%) Analytical Skills
2 324 (10.18%) Computer Science
3 213 (6.69%) Algorithms
4 204 (6.41%) Greenfield Project
5 103 (3.24%) Data Structures
6 70 (2.20%) Public Cloud
7 62 (1.95%) Fintech
8 57 (1.79%) Management Information System
9 55 (1.73%) Foreign Exchange (FX)
10 53 (1.67%) Data Centre
10 53 (1.67%) Enterprise Software
11 52 (1.63%) User Experience
12 50 (1.57%) Clustering
13 37 (1.16%) Virtual Team
14 34 (1.07%) Mobile App
15 30 (0.94%) Derivative
16 27 (0.85%) Blog
17 26 (0.82%) Linux Command Line
18 23 (0.72%) Equities
18 23 (0.72%) PKI
Operating Systems
1 595 (18.70%) Linux
2 228 (7.17%) Windows
3 180 (5.66%) Unix
4 43 (1.35%) Windows Server
5 38 (1.19%) CentOS
5 38 (1.19%) Red Hat Enterprise Linux
6 33 (1.04%) Apple iOS
7 32 (1.01%) Android
8 30 (0.94%) Ubuntu
9 10 (0.31%) AIX
10 9 (0.28%) Solaris
11 7 (0.22%) Mac OS
12 5 (0.16%) Mac OS X
13 3 (0.094%) Kali Linux
13 3 (0.094%) VMS
13 3 (0.094%) Windows Server 2003
13 3 (0.094%) Windows Server 2012
14 2 (0.063%) Mesosphere
14 2 (0.063%) Windows Server 2008
15 1 (0.031%) SUSE
Processes & Methodologies
1 1436 (45.13%) Agile Software Development
2 971 (30.52%) Analytics
3 663 (20.84%) Business Intelligence
4 595 (18.70%) Software Engineering
5 590 (18.54%) Machine Learning
6 476 (14.96%) Open Source
7 463 (14.55%) DevOps
8 447 (14.05%) Scrum
9 421 (13.23%) ETL
10 402 (12.63%) TDD
11 365 (11.47%) Continuous Integration
12 357 (11.22%) Visualisation
13 333 (10.47%) BDD
14 326 (10.25%) Data Analytics
15 321 (10.09%) MapReduce
16 305 (9.59%) OO
17 270 (8.49%) Test Automation
18 265 (8.33%) SDLC
19 238 (7.48%) Data Modelling
20 231 (7.26%) Microservices
Programming Languages
1 1732 (54.43%) Java
2 1378 (43.31%) Python
3 1141 (35.86%) SQL
4 723 (22.72%) Scala
5 495 (15.56%) R
6 412 (12.95%) JavaScript
7 313 (9.84%) C++
8 289 (9.08%) C#
9 166 (5.22%) Bash Shell
10 153 (4.81%) Perl
11 150 (4.71%) C
11 150 (4.71%) Go
12 142 (4.46%) Ruby
13 115 (3.61%) Shell Script
14 91 (2.86%) PHP
15 90 (2.83%) MATLAB
16 85 (2.67%) T-SQL
17 50 (1.57%) VBA
18 46 (1.45%) Groovy
19 44 (1.38%) PowerShell
Qualifications
1 509 (16.00%) Degree
2 237 (7.45%) Security Cleared
3 145 (4.56%) PhD
4 121 (3.80%) Computer Science Degree
5 111 (3.49%) SC Cleared
6 84 (2.64%) DV Cleared
7 75 (2.36%) Master's Degree
8 38 (1.19%) Numerate Degree
9 33 (1.04%) Microsoft Certification
10 23 (0.72%) MCITP
11 20 (0.63%) MCTS
12 18 (0.57%) ISEB
13 17 (0.53%) CITP
14 12 (0.38%) Postgraduate
15 7 (0.22%) CISSP
16 6 (0.19%) MBA
17 5 (0.16%) ISSEP
18 3 (0.094%) CTC Cleared
18 3 (0.094%) ISTQB
18 3 (0.094%) MCDBA
Quality Assurance & Compliance
1 146 (4.59%) Data Quality
2 126 (3.96%) QA
3 28 (0.88%) GDPR
4 27 (0.85%) GCP
5 20 (0.63%) PCI DSS
6 17 (0.53%) SLA
7 11 (0.35%) ISO/IEC 27001
8 10 (0.31%) Sarbanes-Oxley
9 8 (0.25%) Solvency II
10 5 (0.16%) NIST 800
11 4 (0.13%) Actionable Recommendations
11 4 (0.13%) Government Security Classifications
12 1 (0.031%) GPG13
12 1 (0.031%) HMG Security Policy Framework
12 1 (0.031%) ISO 22301
12 1 (0.031%) ISO 9001
12 1 (0.031%) MiFID
12 1 (0.031%) PMO
System Software
1 329 (10.34%) Docker
2 192 (6.03%) HDFS
3 149 (4.68%) Apache Flume
4 40 (1.26%) VMware Infrastructure
5 38 (1.19%) Active Directory
6 33 (1.04%) Apache ZooKeeper
7 21 (0.66%) Virtual Machines
8 14 (0.44%) Varnish
9 11 (0.35%) VMware ESXi
9 11 (0.35%) vSphere
10 7 (0.22%) Hyper-V
11 6 (0.19%) vCloud
12 4 (0.13%) Tivoli Workload Scheduler
13 3 (0.094%) Oracle RAC
14 2 (0.063%) Cronacle
14 2 (0.063%) etcd
14 2 (0.063%) flannel
14 2 (0.063%) ProxySG
15 1 (0.031%) Cygwin
15 1 (0.031%) KVM
Systems Management
1 250 (7.86%) Puppet
2 231 (7.26%) Opscode Chef
3 227 (7.13%) Ansible
4 115 (3.61%) Kubernetes
5 93 (2.92%) Oozie
6 84 (2.64%) Mesos
7 62 (1.95%) Kibana
8 58 (1.82%) logstash
9 47 (1.48%) Hadoop YARN
10 45 (1.41%) Terraform
11 38 (1.19%) ZABBIX
12 36 (1.13%) Salt
13 32 (1.01%) Ambari
14 23 (0.72%) Cobbler
15 18 (0.57%) Nagios
16 17 (0.53%) HAProxy
17 8 (0.25%) ITRS Geneos
18 7 (0.22%) Failover Clustering
18 7 (0.22%) Graphite
19 6 (0.19%) Graylog
Vendors
1 466 (14.64%) Oracle
2 319 (10.03%) Tableau
3 235 (7.39%) Cloudera
3 235 (7.39%) Google
4 232 (7.29%) Microsoft
5 231 (7.26%) SAP
6 145 (4.56%) Hortonworks
7 93 (2.92%) IBM
8 87 (2.73%) Teradata
9 80 (2.51%) Informatica
10 73 (2.29%) Splunk
11 61 (1.92%) MapR
12 57 (1.79%) Red Hat
13 55 (1.73%) Talend
14 49 (1.54%) VMware
15 46 (1.45%) Cognos
16 45 (1.41%) MicroStrategy
17 42 (1.32%) TIBCO
18 36 (1.13%) Vertica
19 29 (0.91%) SaltStack