Period
to 21 January 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 January 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
21 Jan 2018
Same period 2017 Same period 2016
Rank 191 194 213
Rank change year-on-year +3 +19 +115
Permanent jobs citing Hadoop 3,021 3,107 3,392
As % of all permanent IT jobs advertised in the UK 1.76% 1.77% 1.63%
As % of the Database & Business Intelligence category 5.75% 5.91% 5.15%
Number of salaries quoted 2,332 2,570 2,759
UK median annual salary £65,000 £62,500 £65,000
Median salary % change year-on-year +4.00% -3.85% +8.33%
10th Percentile £39,275 £40,000 £41,250
90th Percentile £100,000 £95,000 £96,250
UK excluding London median annual salary £51,500 £52,500 £52,500
% change year-on-year -1.90% - +5.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 52,535 52,599 65,902
As % of all permanent IT jobs advertised in the UK 30.56% 29.89% 31.64%
Number of salaries quoted 43,576 45,027 55,694
UK median annual salary £48,000 £47,500 £45,000
Median salary % change year-on-year +1.05% +5.56% +1.12%
10th Percentile £30,000 £29,375 £28,750
90th Percentile £77,500 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £40,500
% change year-on-year - +4.94% +1.25%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 21 January 2018.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 21 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +1 2,839 £65,000 +4.00% 487
London +10 1,890 £70,000 - 332
UK excluding London -27 1,089 £51,500 -1.90% 175
South East -33 295 £59,000 +7.27% 59
North of England -18 234 £52,500 +5.00% 48
North West +4 186 £52,500 -4.55% 28
South West -61 182 £42,000 -16.00% 12
East of England +86 161 £60,000 +14.29% 16
Scotland -18 119 £50,000 +11.11% 14
Midlands +9 76 £42,500 -29.17% 20
East Midlands +52 46 £42,500 -19.05% 12
Yorkshire -22 37 £50,000 - 16
West Midlands -39 30 £42,500 -29.17% 8
Wales -1 23 £51,250 +2.50% 6
North East -22 11 £46,500 +3.33% 4
Northern Ireland -26 3 £85,000 +150.00%

For the 6 months to 21 January 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Hadoop.

1 1,920 (63.56%) Big Data
2 1,586 (52.50%) Java
3 1,580 (52.30%) Apache Spark
4 1,424 (47.14%) Python
5 1,169 (38.70%) Agile Software Development
6 1,146 (37.93%) SQL
7 1,033 (34.19%) Analytics
8 839 (27.77%) Scala
9 698 (23.10%) NoSQL
10 697 (23.07%) Amazon AWS
11 689 (22.81%) Finance
12 655 (21.68%) Apache Hive
13 649 (21.48%) Machine Learning
14 596 (19.73%) Software Engineering
15 564 (18.67%) Kafka
16 561 (18.57%) Linux
17 559 (18.50%) MongoDB
18 534 (17.68%) Business Intelligence
19 512 (16.95%) Degree
20 508 (16.82%) Apache Cassandra
21 468 (15.49%) DevOps
22 465 (15.39%) Analytical Skills
23 461 (15.26%) R
24 440 (14.56%) ETL
25 435 (14.40%) SQL Server
26 422 (13.97%) HBase
27 421 (13.94%) Oracle
28 415 (13.74%) Data Warehouse
29 414 (13.70%) JavaScript
30 407 (13.47%) Docker

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,580 (52.30%) Apache Spark
2 323 (10.69%) Apache
3 280 (9.27%) Elasticsearch
4 237 (7.85%) SAS
5 214 (7.08%) Apache Pig
6 125 (4.14%) Apache Solr
7 115 (3.81%) Tomcat
8 73 (2.42%) JBoss
9 71 (2.35%) OpenStack
10 61 (2.02%) Jetty
11 60 (1.99%) WebLogic
12 49 (1.62%) WebSphere
13 34 (1.13%) Apache Airflow
14 32 (1.06%) Confluence
15 29 (0.96%) nginx
16 26 (0.86%) IIS
17 23 (0.76%) SharePoint
18 19 (0.63%) Cloud Foundry
19 15 (0.50%) CloudStack
20 8 (0.26%) BizTalk Server
Applications
1 65 (2.15%) Microsoft Excel
2 63 (2.09%) SPSS
3 17 (0.56%) Microsoft Office
4 11 (0.36%) Microsoft PowerPoint
5 7 (0.23%) GNU Octave
5 7 (0.23%) MS Visio
5 7 (0.23%) Weka
6 6 (0.20%) HipChat
6 6 (0.20%) Mathematica
6 6 (0.20%) Microsoft Project
7 5 (0.17%) Chatbot
8 4 (0.13%) CPLEX
8 4 (0.13%) Stata
9 2 (0.066%) S-PLUS
Business Applications
1 14 (0.46%) SAP ERP
1 14 (0.46%) SAP InfiniteInsight
2 10 (0.33%) Dynamics CRM
3 3 (0.099%) Oracle 11i
3 3 (0.099%) Oracle AML
3 3 (0.099%) Oracle Assets
3 3 (0.099%) Oracle EBS
3 3 (0.099%) Oracle EBS R12
3 3 (0.099%) Oracle General Ledger
3 3 (0.099%) Oracle iProcurement
3 3 (0.099%) Oracle Payables
3 3 (0.099%) Oracle Receivables
4 2 (0.066%) Adobe Campaign
4 2 (0.066%) Payment Gateway
5 1 (0.033%) Capstone
5 1 (0.033%) FastStats PeopleStage
5 1 (0.033%) HFM
5 1 (0.033%) Hyperion Enterprise
5 1 (0.033%) Summit
5 1 (0.033%) WebTrends
Cloud Services
1 697 (23.07%) Amazon AWS
2 401 (13.27%) Microsoft Azure
3 142 (4.70%) Google Cloud Platform
4 94 (3.11%) GitHub
5 86 (2.85%) SaaS
6 68 (2.25%) Cloud Computing
7 59 (1.95%) Amazon S3
8 57 (1.89%) Amazon EMR
9 48 (1.59%) Amazon Kinesis
10 46 (1.52%) PaaS
11 41 (1.36%) AWS CloudFormation
12 36 (1.19%) IaaS
13 31 (1.03%) Azure Machine Learning
14 27 (0.89%) Azure Data Factory
15 26 (0.86%) Amazon EC2
16 25 (0.83%) Amazon CloudWatch
17 16 (0.53%) Google Analytics
18 13 (0.43%) AWS Lambda
19 12 (0.40%) Serverless
20 11 (0.36%) Adobe Analytics
Communications & Networking
1 62 (2.05%) Internet
2 56 (1.85%) TCP/IP
3 49 (1.62%) Firewall
4 44 (1.46%) Kerberos
5 41 (1.36%) SSL
6 37 (1.22%) HTTP
7 26 (0.86%) AMQP
8 23 (0.76%) DNS
8 23 (0.76%) Network Security
9 21 (0.70%) VPN
10 16 (0.53%) SAN
11 13 (0.43%) SMPP
12 12 (0.40%) VLAN
13 9 (0.30%) ICMP
14 7 (0.23%) IPsec
15 3 (0.099%) BitTorrent
16 2 (0.066%) Ethernet
16 2 (0.066%) HTTPS
16 2 (0.066%) Intrusion Detection
16 2 (0.066%) MPLS
Database & Business Intelligence
1 1,920 (63.56%) Big Data
2 698 (23.10%) NoSQL
3 655 (21.68%) Apache Hive
4 559 (18.50%) MongoDB
5 508 (16.82%) Apache Cassandra
6 435 (14.40%) SQL Server
7 422 (13.97%) HBase
8 415 (13.74%) Data Warehouse
9 395 (13.08%) Relational Database
10 295 (9.76%) MySQL
11 250 (8.28%) RDBMS
12 181 (5.99%) PostgreSQL
13 169 (5.59%) Redis
14 167 (5.53%) Data Mining
15 147 (4.87%) Impala
16 146 (4.83%) QlikView
17 138 (4.57%) Power BI
18 136 (4.50%) Data Lake
19 135 (4.47%) SQL Server Integration Services
20 110 (3.64%) SQL Server Reporting Services
Development Applications
1 287 (9.50%) Jenkins
2 253 (8.37%) Git (software)
3 175 (5.79%) JIRA
4 126 (4.17%) Maven
5 95 (3.14%) JUnit
6 93 (3.08%) Selenium
7 80 (2.65%) Atlassian Bamboo
8 75 (2.48%) Cucumber
9 74 (2.45%) Bitbucket
10 63 (2.09%) Vagrant
11 46 (1.52%) Team Foundation Server
12 39 (1.29%) TeamCity
13 37 (1.22%) Subversion
14 32 (1.06%) FitNesse
15 27 (0.89%) Gradle
16 26 (0.86%) Eclipse
17 20 (0.66%) Artifactory
18 19 (0.63%) IntelliJ
18 19 (0.63%) Visual Studio
19 18 (0.60%) TestNG
General
1 689 (22.81%) Finance
2 270 (8.94%) Banking
3 218 (7.22%) Marketing
4 194 (6.42%) Retail
5 140 (4.63%) Investment Banking
6 134 (4.44%) Telecoms
7 109 (3.61%) Front Office
8 84 (2.78%) Manufacturing
9 70 (2.32%) Electronics
10 65 (2.15%) Games
11 63 (2.09%) Retail Banking
12 53 (1.75%) Advertising
13 37 (1.22%) Publishing
14 34 (1.13%) Automotive
15 27 (0.89%) Financial Institution
15 27 (0.89%) Law
16 25 (0.83%) Pharmaceutical
17 13 (0.43%) Legal
18 7 (0.23%) Aerospace
19 5 (0.17%) Corporate Banking
Job Titles
1 874 (28.93%) Developer
2 463 (15.33%) Java Developer
3 431 (14.27%) Data Engineer
4 309 (10.23%) Data Scientist
5 307 (10.16%) Architect
6 286 (9.47%) Big Data Engineer
7 241 (7.98%) Software Engineer
8 183 (6.06%) Data Architect
9 174 (5.76%) Senior Developer
10 152 (5.03%) Big Data Developer
11 146 (4.83%) Analyst
12 140 (4.63%) Java Engineer
13 119 (3.94%) Consultant
13 119 (3.94%) Hadoop Engineer
14 110 (3.64%) Senior Java Developer
15 101 (3.34%) Big Data Architect
16 85 (2.81%) Lead Developer
17 84 (2.78%) Scala Developer
18 83 (2.75%) DevOps Engineer
19 79 (2.62%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 564 (18.67%) Kafka
2 336 (11.12%) Spring
3 282 (9.33%) AngularJS
4 233 (7.71%) HTML
5 230 (7.61%) Web Services
6 201 (6.65%) Hibernate
7 188 (6.22%) Node.js
7 188 (6.22%) REST
8 171 (5.66%) CSS
9 140 (4.63%) .NET
9 140 (4.63%) RabbitMQ
10 118 (3.91%) HTML5
11 103 (3.41%) React
12 93 (3.08%) XML
13 91 (3.01%) Natural Language Processing
13 91 (3.01%) RESTful
14 78 (2.58%) Elastic Stack
15 76 (2.52%) Java EE
16 75 (2.48%) J2EE
17 73 (2.42%) LAMP
Miscellaneous
1 465 (15.39%) Analytical Skills
2 370 (12.25%) Computer Science
3 258 (8.54%) Algorithms
4 157 (5.20%) Greenfield Project
5 77 (2.55%) Data Structures
5 77 (2.55%) Fintech
6 68 (2.25%) Data Centre
7 60 (1.99%) Enterprise Software
8 55 (1.82%) User Experience
9 49 (1.62%) Clustering
10 47 (1.56%) Mobile App
11 41 (1.36%) Management Information System
12 33 (1.09%) Social Media
13 30 (0.99%) Public Cloud
14 29 (0.96%) Derivative
15 27 (0.89%) Market Risk
16 26 (0.86%) Life Science
17 22 (0.73%) Linux Command Line
18 20 (0.66%) PKI
19 18 (0.60%) Client/Server
Operating Systems
1 561 (18.57%) Linux
2 185 (6.12%) Unix
3 167 (5.53%) Windows
4 36 (1.19%) Ubuntu
5 28 (0.93%) CentOS
5 28 (0.93%) Red Hat Enterprise Linux
6 27 (0.89%) Android
6 27 (0.89%) Apple iOS
7 19 (0.63%) Windows Server
8 17 (0.56%) Mac OS
9 14 (0.46%) Mac OS X
10 9 (0.30%) CoreOS
11 8 (0.26%) AIX
12 6 (0.20%) Oracle Linux
13 4 (0.13%) Windows Server 2012
14 2 (0.066%) Mesosphere
14 2 (0.066%) Windows 7
14 2 (0.066%) Windows 8
14 2 (0.066%) Windows Server 2008
15 1 (0.033%) Solaris
Processes & Methodologies
1 1,169 (38.70%) Agile Software Development
2 1,033 (34.19%) Analytics
3 649 (21.48%) Machine Learning
4 596 (19.73%) Software Engineering
5 534 (17.68%) Business Intelligence
6 468 (15.49%) DevOps
7 440 (14.56%) ETL
8 387 (12.81%) Visualisation
9 343 (11.35%) Data Analytics
10 337 (11.16%) TDD
11 334 (11.06%) Open Source
12 323 (10.69%) Continuous Integration
13 317 (10.49%) Scrum
14 303 (10.03%) Test Automation
15 299 (9.90%) Data Modelling
16 293 (9.70%) Mathematics
17 275 (9.10%) MapReduce
18 250 (8.28%) BDD
19 228 (7.55%) OO
20 221 (7.32%) Data Visualisation
Programming Languages
1 1,586 (52.50%) Java
2 1,424 (47.14%) Python
3 1,146 (37.93%) SQL
4 839 (27.77%) Scala
5 461 (15.26%) R
6 414 (13.70%) JavaScript
7 286 (9.47%) C#
8 234 (7.75%) C++
9 208 (6.89%) Bash Shell
10 180 (5.96%) Ruby
11 135 (4.47%) C
12 122 (4.04%) Go
13 119 (3.94%) Perl
14 100 (3.31%) PHP
15 81 (2.68%) MATLAB
16 73 (2.42%) Shell Script
17 66 (2.18%) T-SQL
18 62 (2.05%) PowerShell
19 46 (1.52%) Groovy
20 39 (1.29%) PL/SQL
Qualifications
1 512 (16.95%) Degree
2 193 (6.39%) Security Cleared
3 139 (4.60%) Computer Science Degree
4 128 (4.24%) PhD
5 98 (3.24%) SC Cleared
6 74 (2.45%) DV Cleared
7 66 (2.18%) Master's Degree
8 60 (1.99%) Numerate Degree
9 27 (0.89%) Microsoft Certification
10 26 (0.86%) CISSP
11 25 (0.83%) MBA
12 21 (0.70%) ISEB
13 14 (0.46%) ISTQB
14 12 (0.40%) CEH
14 12 (0.40%) GCIH
14 12 (0.40%) OSCP
15 11 (0.36%) Cisco Certification
15 11 (0.36%) MCSE
16 9 (0.30%) CCNA
16 9 (0.30%) SSCP
Quality Assurance & Compliance
1 125 (4.14%) QA
2 112 (3.71%) Data Quality
3 30 (0.99%) GCP
4 20 (0.66%) ISO/IEC 27001
5 19 (0.63%) Solvency II
6 17 (0.56%) GDPR
7 16 (0.53%) Sarbanes-Oxley
7 16 (0.53%) SLA
8 13 (0.43%) GPG13
9 4 (0.13%) PCI DSS
10 3 (0.099%) Actionable Recommendations
10 3 (0.099%) PMO
11 2 (0.066%) HIPAA
11 2 (0.066%) MiFID
12 1 (0.033%) Dodd-Frank
12 1 (0.033%) EMIR
12 1 (0.033%) FATCA
12 1 (0.033%) HMG Security Policy Framework
System Software
1 407 (13.47%) Docker
2 226 (7.48%) HDFS
3 160 (5.30%) Apache Flume
4 52 (1.72%) VMware Infrastructure
5 40 (1.32%) Apache ZooKeeper
6 18 (0.60%) vSphere
7 14 (0.46%) Hyper-V
8 12 (0.40%) Snort
8 12 (0.40%) Varnish
8 12 (0.40%) Virtual Machines
9 10 (0.33%) Active Directory
10 7 (0.23%) vCloud
11 6 (0.20%) VirtualBox
12 2 (0.066%) MapR-FS
12 2 (0.066%) VMware ESXi
13 1 (0.033%) Cygwin
13 1 (0.033%) GridGain
13 1 (0.033%) Oracle RAC
13 1 (0.033%) Xen
Systems Management
1 245 (8.11%) Puppet
2 214 (7.08%) Ansible
3 173 (5.73%) Opscode Chef
4 140 (4.63%) Kubernetes
5 123 (4.07%) Hadoop YARN
6 88 (2.91%) Oozie
7 82 (2.71%) Terraform
8 77 (2.55%) Mesos
9 43 (1.42%) ZABBIX
10 34 (1.13%) Cobbler
10 34 (1.13%) Salt
11 30 (0.99%) Kibana
12 27 (0.89%) Ambari
13 25 (0.83%) logstash
14 20 (0.66%) Nagios
15 19 (0.63%) HAProxy
16 14 (0.46%) Graphite
17 12 (0.40%) Suricata
18 10 (0.33%) Graylog
18 10 (0.33%) Simian Army
Vendors
1 421 (13.94%) Oracle
2 329 (10.89%) Tableau
3 279 (9.24%) Cloudera
4 232 (7.68%) Microsoft
5 216 (7.15%) Google
6 167 (5.53%) Hortonworks
7 135 (4.47%) SAP
8 130 (4.30%) Teradata
9 94 (3.11%) Informatica
10 93 (3.08%) IBM
11 65 (2.15%) MapR
12 57 (1.89%) VMware
13 53 (1.75%) Talend
14 49 (1.62%) Splunk
15 39 (1.29%) Alteryx
15 39 (1.29%) Cognos
16 37 (1.22%) MicroStrategy
17 36 (1.19%) Netezza
18 33 (1.09%) Red Hat
19 32 (1.06%) SaltStack