Period
to 22 October 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 22 October 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
22 Oct 2017
Same period 2016 Same period 2015
Rank 200 206 236
Rank change year-on-year +6 +30 +72
Permanent jobs citing Hadoop 3133 3139 3123
As % of all permanent IT jobs advertised in the UK 1.80% 1.65% 1.43%
As % of the Database & Business Intelligence category 5.89% 5.59% 4.52%
Number of salaries quoted 2321 2515 2524
UK median annual salary £60,000 £60,000 £65,000
Median salary % change year-on-year - -7.69% +8.33%
10th Percentile £36,500 £38,750 £40,500
90th Percentile £97,500 £96,250 £93,750
UK excluding London median annual salary £50,000 £51,500 £50,000
% change year-on-year -2.91% +3.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 53154 56190 69051
As % of all permanent IT jobs advertised in the UK 30.50% 29.63% 31.58%
Number of salaries quoted 43667 47838 58226
UK median annual salary £48,000 £47,500 £45,000
Median salary % change year-on-year +1.05% +5.56% -
10th Percentile £30,000 £28,750 £28,000
90th Percentile £77,500 £76,250 £73,750
UK excluding London median annual salary £42,500 £41,500 £40,000
% change year-on-year +2.41% +3.75% -

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 22 October 2017.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 22 October 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +6 2978 £62,500 - 156
London +22 1941 £67,500 -3.57% 106
UK excluding London -2 1144 £50,000 -2.91% 53
South East +16 346 £55,000 +4.76% 19
North of England +22 305 £53,500 +7.00% 14
North West +73 235 £55,000 +7.32% 7
South West -75 151 £41,000 -18.00% 6
East of England +42 140 £55,000 +4.76% 9
Scotland -36 89 £53,750 - 3
Midlands +7 86 £43,500 -27.50% 2
Yorkshire -44 58 £50,000 - 6
West Midlands -28 49 £47,500 -20.83%
East Midlands +56 37 £42,500 -15.00% 2
Wales +6 29 £42,500 -8.60%
North East +10 12 £55,250 +22.78% 1
Northern Ireland -29 2 £57,000 +67.65%

For the 6 months to 22 October 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Hadoop.

1 1983 (63.29%) Big Data
2 1690 (53.94%) Java
3 1515 (48.36%) Apache Spark
4 1432 (45.71%) Python
5 1384 (44.17%) Agile Software Development
6 1166 (37.22%) SQL
7 1016 (32.43%) Analytics
8 832 (26.56%) Finance
9 767 (24.48%) NoSQL
10 742 (23.68%) Scala
11 708 (22.60%) Amazon AWS
12 652 (20.81%) Business Intelligence
13 586 (18.70%) Apache Hive
13 586 (18.70%) Machine Learning
14 581 (18.54%) Software Engineering
15 579 (18.48%) Apache Cassandra
16 577 (18.42%) MongoDB
17 571 (18.23%) Linux
18 502 (16.02%) Degree
19 500 (15.96%) R
20 499 (15.93%) Analytical Skills
21 489 (15.61%) Relational Database
22 476 (15.19%) Kafka
22 476 (15.19%) Open Source
23 466 (14.87%) DevOps
24 453 (14.46%) Oracle
24 453 (14.46%) SQL Server
25 443 (14.14%) Microsoft Azure
26 422 (13.47%) ETL
27 416 (13.28%) Scrum

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1515 (48.36%) Apache Spark
2 350 (11.17%) Apache
3 297 (9.48%) Elasticsearch
4 274 (8.75%) SAS
5 195 (6.22%) Apache Pig
6 168 (5.36%) Tomcat
7 130 (4.15%) Apache Solr
8 101 (3.22%) JBoss
9 88 (2.81%) WebLogic
10 82 (2.62%) OpenStack
11 79 (2.52%) Jetty
12 62 (1.98%) WebSphere
13 46 (1.47%) IIS
14 42 (1.34%) Confluence
15 31 (0.99%) nginx
16 29 (0.93%) SharePoint
17 28 (0.89%) Apache Airflow
18 21 (0.67%) Cloud Foundry
19 20 (0.64%) Oracle SOA Suite
20 18 (0.57%) WebSphere Application Server
Applications
1 76 (2.43%) SPSS
2 71 (2.27%) Microsoft Excel
3 25 (0.80%) Microsoft Office
4 15 (0.48%) Microsoft PowerPoint
4 15 (0.48%) Spreadsheet
5 7 (0.22%) MS Visio
6 5 (0.16%) HipChat
6 5 (0.16%) Stata
7 4 (0.13%) Microsoft Project
7 4 (0.13%) S-PLUS
8 3 (0.096%) CPLEX
8 3 (0.096%) GIMP
8 3 (0.096%) Pipeline Pilot
9 2 (0.064%) GNU Octave
9 2 (0.064%) Weka
10 1 (0.032%) Chatbot
10 1 (0.032%) LaTeX
10 1 (0.032%) Mathematica
Business Applications
1 13 (0.41%) SAP InfiniteInsight
2 11 (0.35%) SAP ERP
3 5 (0.16%) Dynamics CRM
4 4 (0.13%) BusinessWorks
4 4 (0.13%) Oracle BPM
4 4 (0.13%) SAP GRC
4 4 (0.13%) SAP HR
5 2 (0.064%) Adobe Campaign
5 2 (0.064%) HFM
5 2 (0.064%) Hyperion Enterprise
5 2 (0.064%) Payment Gateway
6 1 (0.032%) Capstone
6 1 (0.032%) Cognos Business Intelligence
6 1 (0.032%) Dynamics AX
6 1 (0.032%) FastStats PeopleStage
6 1 (0.032%) Oracle AML
6 1 (0.032%) Oracle Applications
6 1 (0.032%) SAP Hybris
6 1 (0.032%) Unica
Cloud Services
1 708 (22.60%) Amazon AWS
2 443 (14.14%) Microsoft Azure
3 225 (7.18%) Google Cloud Platform
4 103 (3.29%) Cloud Computing
5 98 (3.13%) SaaS
6 96 (3.06%) GitHub
7 60 (1.92%) Amazon EMR
8 51 (1.63%) PaaS
9 42 (1.34%) Amazon S3
10 41 (1.31%) IaaS
11 39 (1.24%) Amazon EC2
12 36 (1.15%) AWS CloudFormation
13 29 (0.93%) Amazon Kinesis
14 26 (0.83%) Azure Machine Learning
15 19 (0.61%) Amazon CloudWatch
16 16 (0.51%) Google Analytics
17 13 (0.41%) Serverless
18 12 (0.38%) AWS Lambda
19 11 (0.35%) Azure Data Factory
19 11 (0.35%) OpenShift
Communications & Networking
1 60 (1.92%) Internet
2 47 (1.50%) TCP/IP
3 46 (1.47%) Firewall
4 40 (1.28%) Kerberos
5 29 (0.93%) SSL
6 26 (0.83%) SAN
7 24 (0.77%) AMQP
8 22 (0.70%) DNS
9 19 (0.61%) Network Security
10 18 (0.57%) LDAP
10 18 (0.57%) VPN
11 17 (0.54%) HTTP
12 16 (0.51%) SMPP
13 12 (0.38%) NAS
14 11 (0.35%) VLAN
15 8 (0.26%) SNMP
16 7 (0.22%) IPsec
17 6 (0.19%) Ethernet
18 5 (0.16%) ICMP
18 5 (0.16%) Wireshark
Database & Business Intelligence
1 1983 (63.29%) Big Data
2 767 (24.48%) NoSQL
3 586 (18.70%) Apache Hive
4 579 (18.48%) Apache Cassandra
5 577 (18.42%) MongoDB
6 489 (15.61%) Relational Database
7 453 (14.46%) SQL Server
8 381 (12.16%) Data Warehouse
9 336 (10.72%) HBase
10 301 (9.61%) MySQL
11 297 (9.48%) RDBMS
12 227 (7.25%) Redis
13 190 (6.06%) PostgreSQL
14 182 (5.81%) SQL Server Integration Services
15 156 (4.98%) QlikView
16 149 (4.76%) Data Mining
17 144 (4.60%) SQL Server Reporting Services
18 134 (4.28%) Impala
19 110 (3.51%) Amazon Redshift
20 107 (3.42%) Data Lake
Development Applications
1 281 (8.97%) Jenkins
2 273 (8.71%) Git (software)
3 169 (5.39%) JIRA
4 141 (4.50%) Maven
5 115 (3.67%) JUnit
6 85 (2.71%) Atlassian Bamboo
7 77 (2.46%) Bitbucket
8 76 (2.43%) Selenium
9 56 (1.79%) Cucumber
10 54 (1.72%) Vagrant
11 53 (1.69%) Team Foundation Server
12 51 (1.63%) Eclipse
13 49 (1.56%) Talend Open Studio
14 39 (1.24%) TeamCity
15 32 (1.02%) Subversion
16 28 (0.89%) Gradle
16 28 (0.89%) Mockito
17 27 (0.86%) IntelliJ
18 26 (0.83%) JBehave
18 26 (0.83%) Visual Studio
General
1 832 (26.56%) Finance
2 369 (11.78%) Banking
3 264 (8.43%) Marketing
4 202 (6.45%) Retail
5 198 (6.32%) Investment Banking
6 175 (5.59%) Front Office
7 146 (4.66%) Telecoms
8 134 (4.28%) Manufacturing
9 125 (3.99%) Electronics
10 120 (3.83%) Retail Banking
11 77 (2.46%) Games
12 34 (1.09%) Advertising
13 27 (0.86%) Financial Institution
14 25 (0.80%) Aerospace
14 25 (0.80%) Legal
15 23 (0.73%) Pharmaceutical
16 18 (0.57%) Law
17 13 (0.41%) Automotive
18 10 (0.32%) Publishing
18 10 (0.32%) Spanish Language
Job Titles
1 967 (30.86%) Developer
2 508 (16.21%) Java Developer
3 336 (10.72%) Data Scientist
4 322 (10.28%) Data Engineer
5 298 (9.51%) Architect
6 287 (9.16%) Software Engineer
7 214 (6.83%) Big Data Engineer
8 174 (5.55%) Senior Developer
9 170 (5.43%) Big Data Developer
10 151 (4.82%) Data Architect
11 141 (4.50%) Analyst
12 124 (3.96%) Java Engineer
13 122 (3.89%) Hadoop Engineer
14 116 (3.70%) Senior Java Developer
15 115 (3.67%) Consultant
16 108 (3.45%) Data Manager
17 93 (2.97%) Python Developer
18 90 (2.87%) Hadoop Developer
18 90 (2.87%) Scala Developer
19 86 (2.74%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 476 (15.19%) Kafka
2 400 (12.77%) Spring
3 286 (9.13%) Web Services
4 271 (8.65%) AngularJS
5 220 (7.02%) HTML
6 213 (6.80%) Hibernate
7 206 (6.58%) .NET
8 205 (6.54%) Node.js
9 168 (5.36%) CSS
10 147 (4.69%) RESTful
11 143 (4.56%) RabbitMQ
12 142 (4.53%) REST
13 133 (4.25%) React
14 119 (3.80%) XML
15 113 (3.61%) HTML5
16 98 (3.13%) Natural Language Processing
17 84 (2.68%) JSON
18 81 (2.59%) Apache Camel
19 80 (2.55%) ActiveMQ
20 73 (2.33%) jQuery
Miscellaneous
1 499 (15.93%) Analytical Skills
2 316 (10.09%) Computer Science
3 211 (6.73%) Algorithms
4 188 (6.00%) Greenfield Project
5 105 (3.35%) Data Structures
6 73 (2.33%) Fintech
7 65 (2.07%) Public Cloud
8 56 (1.79%) Data Centre
9 54 (1.72%) Management Information System
10 50 (1.60%) Clustering
11 49 (1.56%) Foreign Exchange (FX)
11 49 (1.56%) User Experience
12 44 (1.40%) Enterprise Software
13 31 (0.99%) Mobile App
14 30 (0.96%) Derivative
15 28 (0.89%) Blog
15 28 (0.89%) Virtual Team
16 22 (0.70%) Data Protection Act
16 22 (0.70%) Life Science
16 22 (0.70%) PKI
Operating Systems
1 571 (18.23%) Linux
2 219 (6.99%) Windows
3 175 (5.59%) Unix
4 39 (1.24%) CentOS
5 36 (1.15%) Ubuntu
5 36 (1.15%) Windows Server
6 32 (1.02%) Red Hat Enterprise Linux
7 30 (0.96%) Apple iOS
8 29 (0.93%) Android
9 10 (0.32%) AIX
10 8 (0.26%) Solaris
11 7 (0.22%) Mac OS X
12 5 (0.16%) Mac OS
13 3 (0.096%) Kali Linux
13 3 (0.096%) VMS
13 3 (0.096%) Windows Server 2012
14 2 (0.064%) CoreOS
14 2 (0.064%) Mesosphere
14 2 (0.064%) Windows Server 2008
15 1 (0.032%) SUSE Linux Enterprise Server
Processes & Methodologies
1 1384 (44.17%) Agile Software Development
2 1016 (32.43%) Analytics
3 652 (20.81%) Business Intelligence
4 586 (18.70%) Machine Learning
5 581 (18.54%) Software Engineering
6 476 (15.19%) Open Source
7 466 (14.87%) DevOps
8 422 (13.47%) ETL
9 416 (13.28%) Scrum
10 378 (12.07%) Continuous Integration
11 377 (12.03%) TDD
12 350 (11.17%) Data Analytics
13 347 (11.08%) Visualisation
14 317 (10.12%) MapReduce
15 313 (9.99%) BDD
16 297 (9.48%) OO
17 286 (9.13%) Test Automation
18 262 (8.36%) Data Modelling
19 256 (8.17%) SDLC
20 223 (7.12%) Mathematics
Programming Languages
1 1690 (53.94%) Java
2 1432 (45.71%) Python
3 1166 (37.22%) SQL
4 742 (23.68%) Scala
5 500 (15.96%) R
6 414 (13.21%) JavaScript
7 312 (9.96%) C++
8 284 (9.06%) C#
9 177 (5.65%) Bash Shell
10 158 (5.04%) C
11 156 (4.98%) Go
12 150 (4.79%) Ruby
13 149 (4.76%) Perl
14 103 (3.29%) Shell Script
15 93 (2.97%) MATLAB
16 86 (2.74%) PHP
17 69 (2.20%) T-SQL
18 52 (1.66%) PowerShell
19 48 (1.53%) VBA
20 40 (1.28%) Groovy
Qualifications
1 502 (16.02%) Degree
2 243 (7.76%) Security Cleared
3 139 (4.44%) PhD
4 126 (4.02%) Computer Science Degree
5 115 (3.67%) SC Cleared
6 89 (2.84%) DV Cleared
7 64 (2.04%) Master's Degree
8 39 (1.24%) Numerate Degree
9 32 (1.02%) Microsoft Certification
10 22 (0.70%) MCITP
11 20 (0.64%) ISEB
12 19 (0.61%) MCTS
13 15 (0.48%) MBA
14 13 (0.41%) Postgraduate
15 9 (0.29%) CISSP
15 9 (0.29%) CITP
16 5 (0.16%) AWS Certification
16 5 (0.16%) Cisco Certification
16 5 (0.16%) ISSEP
17 4 (0.13%) CTC Cleared
Quality Assurance & Compliance
1 155 (4.95%) Data Quality
2 116 (3.70%) QA
3 30 (0.96%) GDPR
4 25 (0.80%) GCP
5 20 (0.64%) PCI DSS
6 17 (0.54%) SLA
7 13 (0.41%) Sarbanes-Oxley
7 13 (0.41%) Solvency II
8 12 (0.38%) ISO/IEC 27001
9 5 (0.16%) NIST 800
10 4 (0.13%) Government Security Classifications
11 3 (0.096%) Actionable Recommendations
12 1 (0.032%) GPG13
12 1 (0.032%) HMG Security Policy Framework
12 1 (0.032%) ISO 22301
12 1 (0.032%) ISO 9001
12 1 (0.032%) MiFID
12 1 (0.032%) PMO
System Software
1 346 (11.04%) Docker
2 193 (6.16%) HDFS
3 158 (5.04%) Apache Flume
4 42 (1.34%) VMware Infrastructure
5 36 (1.15%) Active Directory
6 30 (0.96%) Apache ZooKeeper
7 17 (0.54%) Virtual Machines
8 14 (0.45%) Varnish
9 12 (0.38%) vSphere
10 11 (0.35%) VMware ESXi
11 7 (0.22%) Hyper-V
11 7 (0.22%) vCloud
12 4 (0.13%) Tivoli Workload Scheduler
13 2 (0.064%) ProxySG
13 2 (0.064%) VirtualBox
14 1 (0.032%) Cronacle
14 1 (0.032%) Cygwin
14 1 (0.032%) MapR-FS
14 1 (0.032%) Oracle RAC
Systems Management
1 241 (7.69%) Puppet
2 219 (6.99%) Ansible
3 215 (6.86%) Opscode Chef
4 118 (3.77%) Kubernetes
5 86 (2.74%) Oozie
6 85 (2.71%) Mesos
7 52 (1.66%) Terraform
8 51 (1.63%) Hadoop YARN
9 44 (1.40%) Kibana
10 43 (1.37%) logstash
11 36 (1.15%) ZABBIX
12 35 (1.12%) Salt
13 29 (0.93%) Ambari
14 27 (0.86%) Cobbler
15 20 (0.64%) Nagios
16 18 (0.57%) HAProxy
17 9 (0.29%) ITRS Geneos
18 7 (0.22%) Graphite
18 7 (0.22%) Graylog
19 6 (0.19%) Oracle ZFS
Vendors
1 453 (14.46%) Oracle
2 322 (10.28%) Tableau
3 250 (7.98%) Cloudera
4 227 (7.25%) Google
4 227 (7.25%) SAP
5 222 (7.09%) Microsoft
6 142 (4.53%) Hortonworks
7 97 (3.10%) Teradata
8 96 (3.06%) IBM
9 83 (2.65%) Informatica
10 71 (2.27%) Splunk
11 63 (2.01%) MapR
12 53 (1.69%) Cognos
13 50 (1.60%) Red Hat
14 49 (1.56%) Talend
15 48 (1.53%) VMware
16 47 (1.50%) MicroStrategy
17 41 (1.31%) TIBCO
18 34 (1.09%) Vertica
19 32 (1.02%) HP