Period
to 23 November 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 23 November 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
23 Nov 2017
Same period 2016 Same period 2015
Rank 197 198 228
Rank change year-on-year +1 +30 +95
Permanent jobs citing Hadoop 3202 3239 3326
As % of all permanent IT jobs advertised in the UK 1.78% 1.71% 1.53%
As % of the Database & Business Intelligence category 5.88% 5.76% 4.85%
Number of salaries quoted 2390 2649 2685
UK median annual salary £62,500 £62,500 £65,000
Median salary % change year-on-year - -3.85% +8.33%
10th Percentile £37,500 £39,900 £41,250
90th Percentile £97,500 £96,250 £95,000
UK excluding London median annual salary £50,000 £52,500 £50,000
% change year-on-year -4.76% +5.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 54470 56272 68544
As % of all permanent IT jobs advertised in the UK 30.24% 29.65% 31.52%
Number of salaries quoted 44832 48097 57738
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +2.27%
10th Percentile £30,000 £29,000 £28,250
90th Percentile £77,500 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £40,000
% change year-on-year - +6.25% -

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 23 November 2017.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 23 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +8 3040 £62,500 - 274
London +11 2009 £67,500 -3.57% 191
UK excluding London -10 1152 £50,000 -4.76% 89
South East 0 343 £55,000 +1.85% 24
North of England +12 272 £52,500 +5.00% 27
North West +40 207 £54,000 -1.82% 19
South West -66 179 £41,000 -18.00% 16
East of England +50 145 £55,000 +4.76% 13
Scotland -27 97 £55,000 +10.00% 5
Midlands +20 85 £42,500 -29.17% 4
Yorkshire -13 58 £50,000 - 8
West Midlands -3 44 £47,500 -22.45% 2
East Midlands +46 41 £42,500 -29.17% 2
Wales 0 34 £42,500 -15.00%
North East -4 7 £57,500 +27.78%
Northern Ireland -34 1 - - 1

For the 6 months to 23 November 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Hadoop.

1 2032 (63.46%) Big Data
2 1714 (53.53%) Java
3 1613 (50.37%) Apache Spark
4 1499 (46.81%) Python
5 1378 (43.04%) Agile Software Development
6 1195 (37.32%) SQL
7 1042 (32.54%) Analytics
8 817 (25.52%) Finance
9 780 (24.36%) Scala
10 750 (23.42%) NoSQL
11 733 (22.89%) Amazon AWS
12 627 (19.58%) Business Intelligence
13 622 (19.43%) Apache Hive
14 618 (19.30%) Machine Learning
15 612 (19.11%) Software Engineering
16 569 (17.77%) MongoDB
17 566 (17.68%) Linux
18 559 (17.46%) Apache Cassandra
19 553 (17.27%) Degree
20 523 (16.33%) Kafka
21 513 (16.02%) Analytical Skills
22 487 (15.21%) R
23 483 (15.08%) DevOps
24 466 (14.55%) SQL Server
25 461 (14.40%) Open Source
26 459 (14.33%) Relational Database
27 447 (13.96%) Oracle
28 441 (13.77%) Microsoft Azure
29 431 (13.46%) ETL
30 429 (13.40%) JavaScript

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1613 (50.37%) Apache Spark
2 373 (11.65%) Apache
3 330 (10.31%) Elasticsearch
4 270 (8.43%) SAS
5 196 (6.12%) Apache Pig
6 145 (4.53%) Tomcat
7 130 (4.06%) Apache Solr
8 94 (2.94%) JBoss
9 84 (2.62%) OpenStack
10 77 (2.40%) Jetty
11 76 (2.37%) WebLogic
12 59 (1.84%) WebSphere
13 46 (1.44%) Confluence
14 43 (1.34%) IIS
15 36 (1.12%) Apache Airflow
16 32 (1.00%) nginx
17 30 (0.94%) SharePoint
18 24 (0.75%) Cloud Foundry
19 19 (0.59%) CloudStack
20 14 (0.44%) Oracle SOA Suite
Applications
1 84 (2.62%) SPSS
2 76 (2.37%) Microsoft Excel
3 28 (0.87%) Microsoft Office
4 17 (0.53%) Microsoft PowerPoint
5 11 (0.34%) Spreadsheet
6 10 (0.31%) MS Visio
7 6 (0.19%) HipChat
7 6 (0.19%) Microsoft Project
8 5 (0.16%) Mathematica
9 4 (0.12%) CPLEX
9 4 (0.12%) Stata
10 3 (0.094%) Chatbot
10 3 (0.094%) GNU Octave
10 3 (0.094%) Pipeline Pilot
10 3 (0.094%) S-PLUS
11 2 (0.062%) Weka
12 1 (0.031%) LaTeX
Business Applications
1 16 (0.50%) SAP InfiniteInsight
2 15 (0.47%) SAP ERP
3 8 (0.25%) Dynamics CRM
4 4 (0.12%) BusinessWorks
4 4 (0.12%) SAP HR
5 2 (0.062%) Adobe Campaign
5 2 (0.062%) Oracle AML
5 2 (0.062%) Payment Gateway
6 1 (0.031%) Capstone
6 1 (0.031%) Dynamics AX
6 1 (0.031%) FastStats PeopleStage
6 1 (0.031%) HFM
6 1 (0.031%) Hyperion Enterprise
6 1 (0.031%) SAP Hybris
6 1 (0.031%) Summit
6 1 (0.031%) Unica
Cloud Services
1 733 (22.89%) Amazon AWS
2 441 (13.77%) Microsoft Azure
3 212 (6.62%) Google Cloud Platform
4 103 (3.22%) Cloud Computing
5 102 (3.19%) GitHub
6 96 (3.00%) SaaS
7 64 (2.00%) Amazon EMR
8 59 (1.84%) PaaS
9 49 (1.53%) Amazon S3
10 46 (1.44%) IaaS
11 43 (1.34%) AWS CloudFormation
12 39 (1.22%) Amazon EC2
13 36 (1.12%) Amazon Kinesis
14 28 (0.87%) Azure Machine Learning
15 23 (0.72%) Amazon CloudWatch
16 16 (0.50%) Google Analytics
17 14 (0.44%) Azure Data Factory
18 12 (0.37%) AWS Lambda
18 12 (0.37%) Serverless
19 10 (0.31%) OpenShift
Communications & Networking
1 57 (1.78%) TCP/IP
2 52 (1.62%) Firewall
3 51 (1.59%) Internet
4 43 (1.34%) Kerberos
5 32 (1.00%) SSL
6 28 (0.87%) AMQP
7 22 (0.69%) HTTP
7 22 (0.69%) SAN
8 21 (0.66%) DNS
8 21 (0.66%) Network Security
8 21 (0.66%) VPN
9 17 (0.53%) LDAP
10 15 (0.47%) SMPP
11 13 (0.41%) VLAN
12 8 (0.25%) ICMP
12 8 (0.25%) NAS
13 7 (0.22%) IPsec
14 6 (0.19%) Ethernet
15 5 (0.16%) SNMP
16 4 (0.12%) WebEx
Database & Business Intelligence
1 2032 (63.46%) Big Data
2 750 (23.42%) NoSQL
3 622 (19.43%) Apache Hive
4 569 (17.77%) MongoDB
5 559 (17.46%) Apache Cassandra
6 466 (14.55%) SQL Server
7 459 (14.33%) Relational Database
8 398 (12.43%) Data Warehouse
9 347 (10.84%) HBase
10 290 (9.06%) MySQL
10 290 (9.06%) RDBMS
11 206 (6.43%) Redis
12 181 (5.65%) PostgreSQL
13 167 (5.22%) SQL Server Integration Services
14 160 (5.00%) QlikView
15 151 (4.72%) Data Mining
16 144 (4.50%) Impala
17 134 (4.18%) SQL Server Reporting Services
18 123 (3.84%) Power BI
19 114 (3.56%) Data Lake
Development Applications
1 296 (9.24%) Jenkins
2 288 (8.99%) Git (software)
3 178 (5.56%) JIRA
4 138 (4.31%) Maven
5 104 (3.25%) JUnit
6 96 (3.00%) Atlassian Bamboo
7 88 (2.75%) Selenium
8 86 (2.69%) Bitbucket
9 68 (2.12%) Cucumber
10 57 (1.78%) Vagrant
11 51 (1.59%) Team Foundation Server
12 49 (1.53%) Eclipse
12 49 (1.53%) Talend Open Studio
13 46 (1.44%) Subversion
14 42 (1.31%) TeamCity
15 31 (0.97%) FitNesse
16 30 (0.94%) IntelliJ
17 27 (0.84%) Gradle
18 26 (0.81%) JBehave
19 25 (0.78%) Mockito
General
1 817 (25.52%) Finance
2 366 (11.43%) Banking
3 265 (8.28%) Marketing
4 201 (6.28%) Retail
5 192 (6.00%) Investment Banking
6 172 (5.37%) Front Office
7 153 (4.78%) Telecoms
8 135 (4.22%) Manufacturing
9 123 (3.84%) Electronics
10 114 (3.56%) Retail Banking
11 83 (2.59%) Games
12 47 (1.47%) Advertising
13 30 (0.94%) Pharmaceutical
14 25 (0.78%) Financial Institution
15 24 (0.75%) Legal
16 20 (0.62%) Aerospace
17 18 (0.56%) Publishing
18 17 (0.53%) Law
19 15 (0.47%) Automotive
20 12 (0.37%) Military
Job Titles
1 978 (30.54%) Developer
2 522 (16.30%) Java Developer
3 361 (11.27%) Data Engineer
4 333 (10.40%) Data Scientist
5 305 (9.53%) Software Engineer
6 280 (8.74%) Architect
7 245 (7.65%) Big Data Engineer
8 188 (5.87%) Senior Developer
9 171 (5.34%) Big Data Developer
10 155 (4.84%) Data Architect
11 145 (4.53%) Analyst
12 130 (4.06%) Hadoop Engineer
13 129 (4.03%) Java Engineer
14 121 (3.78%) Senior Java Developer
15 114 (3.56%) Consultant
16 111 (3.47%) Data Manager
17 104 (3.25%) Python Developer
18 97 (3.03%) Scala Developer
19 96 (3.00%) DevOps Engineer
20 93 (2.90%) Lead Developer
Libraries, Frameworks & Software Standards
1 523 (16.33%) Kafka
2 404 (12.62%) Spring
3 290 (9.06%) AngularJS
4 269 (8.40%) Web Services
5 220 (6.87%) HTML
6 214 (6.68%) Node.js
7 213 (6.65%) Hibernate
8 186 (5.81%) CSS
9 170 (5.31%) REST
10 163 (5.09%) .NET
11 155 (4.84%) RabbitMQ
12 137 (4.28%) RESTful
13 125 (3.90%) React
14 116 (3.62%) HTML5
15 108 (3.37%) Natural Language Processing
16 90 (2.81%) XML
17 87 (2.72%) Apache Camel
18 84 (2.62%) Elastic Stack
19 82 (2.56%) JMS
20 79 (2.47%) ActiveMQ
Miscellaneous
1 513 (16.02%) Analytical Skills
2 362 (11.31%) Computer Science
3 230 (7.18%) Algorithms
4 175 (5.47%) Greenfield Project
5 95 (2.97%) Data Structures
6 84 (2.62%) Fintech
7 60 (1.87%) Public Cloud
8 58 (1.81%) Data Centre
9 55 (1.72%) Clustering
10 50 (1.56%) User Experience
11 46 (1.44%) Mobile App
12 44 (1.37%) Management Information System
13 42 (1.31%) Enterprise Software
14 29 (0.91%) Foreign Exchange (FX)
15 28 (0.87%) Virtual Team
16 26 (0.81%) Derivative
16 26 (0.81%) Life Science
16 26 (0.81%) Market Risk
16 26 (0.81%) Private Cloud
17 22 (0.69%) PKI
Operating Systems
1 566 (17.68%) Linux
2 212 (6.62%) Windows
3 193 (6.03%) Unix
4 41 (1.28%) Ubuntu
5 37 (1.16%) CentOS
6 35 (1.09%) Android
6 35 (1.09%) Apple iOS
7 26 (0.81%) Red Hat Enterprise Linux
8 25 (0.78%) Windows Server
9 12 (0.37%) Mac OS X
10 10 (0.31%) Mac OS
11 8 (0.25%) AIX
12 4 (0.12%) CoreOS
12 4 (0.12%) Solaris
13 3 (0.094%) Kali Linux
13 3 (0.094%) VMS
13 3 (0.094%) Windows Server 2012
14 2 (0.062%) Mesosphere
14 2 (0.062%) Windows Server 2008
15 1 (0.031%) Windows Server 2003
Processes & Methodologies
1 1378 (43.04%) Agile Software Development
2 1042 (32.54%) Analytics
3 627 (19.58%) Business Intelligence
4 618 (19.30%) Machine Learning
5 612 (19.11%) Software Engineering
6 483 (15.08%) DevOps
7 461 (14.40%) Open Source
8 431 (13.46%) ETL
9 399 (12.46%) Scrum
10 384 (11.99%) Continuous Integration
11 370 (11.56%) Visualisation
12 366 (11.43%) TDD
13 351 (10.96%) Data Analytics
14 325 (10.15%) Test Automation
15 321 (10.02%) BDD
16 299 (9.34%) MapReduce
17 281 (8.78%) Data Modelling
17 281 (8.78%) OO
18 249 (7.78%) Mathematics
19 244 (7.62%) SDLC
Programming Languages
1 1714 (53.53%) Java
2 1499 (46.81%) Python
3 1195 (37.32%) SQL
4 780 (24.36%) Scala
5 487 (15.21%) R
6 429 (13.40%) JavaScript
7 281 (8.78%) C++
8 278 (8.68%) C#
9 206 (6.43%) Bash Shell
10 188 (5.87%) Ruby
11 170 (5.31%) C
12 156 (4.87%) Go
13 138 (4.31%) Perl
14 99 (3.09%) Shell Script
15 94 (2.94%) MATLAB
16 89 (2.78%) PHP
17 71 (2.22%) T-SQL
18 64 (2.00%) PowerShell
19 47 (1.47%) VBA
20 38 (1.19%) Groovy
Qualifications
1 553 (17.27%) Degree
2 256 (8.00%) Security Cleared
3 155 (4.84%) Computer Science Degree
4 134 (4.18%) PhD
5 123 (3.84%) SC Cleared
6 98 (3.06%) DV Cleared
7 66 (2.06%) Master's Degree
8 53 (1.66%) Numerate Degree
9 28 (0.87%) Microsoft Certification
10 21 (0.66%) CISSP
10 21 (0.66%) ISEB
11 20 (0.62%) MBA
12 14 (0.44%) MCITP
13 13 (0.41%) Postgraduate
14 11 (0.34%) MCTS
15 9 (0.28%) Cisco Certification
16 8 (0.25%) CEH
16 8 (0.25%) GCIH
16 8 (0.25%) OSCP
17 7 (0.22%) SANS
Quality Assurance & Compliance
1 144 (4.50%) Data Quality
2 110 (3.44%) QA
3 29 (0.91%) GCP
4 24 (0.75%) GDPR
5 21 (0.66%) ISO/IEC 27001
6 17 (0.53%) SLA
6 17 (0.53%) Solvency II
7 16 (0.50%) Sarbanes-Oxley
8 12 (0.37%) PCI DSS
9 9 (0.28%) GPG13
10 5 (0.16%) Actionable Recommendations
10 5 (0.16%) NIST 800
11 4 (0.12%) Government Security Classifications
12 2 (0.062%) MiFID
13 1 (0.031%) HMG Security Policy Framework
13 1 (0.031%) ISO 22301
13 1 (0.031%) ISO 9001
13 1 (0.031%) PMO
System Software
1 378 (11.81%) Docker
2 202 (6.31%) HDFS
3 160 (5.00%) Apache Flume
4 45 (1.41%) VMware Infrastructure
5 38 (1.19%) Apache ZooKeeper
6 21 (0.66%) Active Directory
7 18 (0.56%) Varnish
8 16 (0.50%) Virtual Machines
9 14 (0.44%) vSphere
10 11 (0.34%) VMware ESXi
11 10 (0.31%) Hyper-V
12 8 (0.25%) Snort
13 7 (0.22%) vCloud
14 3 (0.094%) Tivoli Workload Scheduler
14 3 (0.094%) VirtualBox
15 2 (0.062%) MapR-FS
16 1 (0.031%) Cronacle
16 1 (0.031%) Cygwin
16 1 (0.031%) GridGain
16 1 (0.031%) Oracle RAC
Systems Management
1 245 (7.65%) Puppet
2 226 (7.06%) Ansible
3 215 (6.71%) Opscode Chef
4 129 (4.03%) Kubernetes
5 94 (2.94%) Oozie
6 91 (2.84%) Mesos
7 75 (2.34%) Hadoop YARN
8 63 (1.97%) Terraform
9 42 (1.31%) ZABBIX
10 41 (1.28%) Kibana
10 41 (1.28%) Salt
11 40 (1.25%) logstash
12 33 (1.03%) Cobbler
13 29 (0.91%) Ambari
14 23 (0.72%) HAProxy
15 19 (0.59%) Nagios
16 14 (0.44%) Graphite
17 11 (0.34%) Graylog
18 9 (0.28%) ITRS Geneos
19 8 (0.25%) QRadar
Vendors
1 447 (13.96%) Oracle
2 324 (10.12%) Tableau
3 254 (7.93%) Cloudera
4 229 (7.15%) Google
5 223 (6.96%) Microsoft
6 221 (6.90%) SAP
7 142 (4.43%) Hortonworks
8 114 (3.56%) Teradata
9 104 (3.25%) IBM
10 94 (2.94%) Informatica
11 68 (2.12%) Splunk
12 62 (1.94%) MapR
13 55 (1.72%) Cognos
14 49 (1.53%) Talend
14 49 (1.53%) VMware
15 41 (1.28%) MicroStrategy
16 39 (1.22%) Red Hat
17 34 (1.06%) TIBCO
18 32 (1.00%) HP
18 32 (1.00%) Netezza