Period
to 17 June 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 17 June 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
17 Jun 2018
Same period 2017 Same period 2016
Rank 182 196 201
Rank change year-on-year +14 +5 +85
Permanent jobs citing Hadoop 3,269 3,060 3,473
As % of all permanent IT jobs advertised in the UK 1.90% 1.78% 1.73%
As % of the Database & Business Intelligence category 6.21% 5.78% 5.65%
Number of salaries quoted 2,432 2,401 2,708
UK median annual salary £65,000 £65,000 £62,500
Median salary % change year-on-year - +4.00% -
10th Percentile £39,500 £35,000 £38,750
90th Percentile £98,750 £100,750 £100,000
UK excluding London median annual salary £55,000 £54,000 £52,500
% change year-on-year +1.85% +2.86% +5.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 52,626 52,984 61,472
As % of all permanent IT jobs advertised in the UK 30.63% 30.82% 30.61%
Number of salaries quoted 43,167 44,808 52,298
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,500 £28,750
90th Percentile £80,000 £77,500 £75,000
UK excluding London median annual salary £45,000 £42,500 £41,500
% change year-on-year +5.88% +2.41% +3.75%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 17 June 2018.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 17 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +14 3,044 £67,500 +3.85% 372
London +22 1,936 £72,500 +3.57% 218
UK excluding London +2 1,289 £55,000 +1.85% 181
South East -10 376 £57,500 - 47
North of England -39 274 £52,500 -4.55% 47
East of England +67 196 £65,000 +18.18% 15
North West -49 174 £53,750 -10.42% 36
Scotland +14 162 £50,000 +25.00% 24
South West -30 148 £50,000 +11.11% 21
Midlands +47 121 £55,000 - 24
Yorkshire +38 87 £51,500 -4.19% 9
East Midlands +63 74 £50,000 -4.76% 12
West Midlands 0 47 £60,000 +9.09% 12
North East -30 13 £35,000 -22.22% 2
Wales -8 12 £48,700 +39.14% 2
Northern Ireland +2 2 - - 1

For the 6 months to 17 June 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 2,051 (62.74%) Big Data
2 1,806 (55.25%) Apache Spark
3 1,635 (50.02%) Java
4 1,583 (48.42%) Python
5 1,369 (41.88%) SQL
6 1,229 (37.60%) Agile Software Development
7 1,218 (37.26%) Analytics
8 973 (29.76%) Scala
9 845 (25.85%) Amazon AWS
10 839 (25.67%) Apache Hive
11 819 (25.05%) Kafka
12 779 (23.83%) NoSQL
13 762 (23.31%) Machine Learning
14 760 (23.25%) Data Science
15 657 (20.10%) ETL
16 620 (18.97%) Linux
17 574 (17.56%) Finance
18 553 (16.92%) Software Engineering
19 539 (16.49%) R
20 507 (15.51%) Oracle
21 505 (15.45%) Business Intelligence
22 499 (15.26%) DevOps
23 488 (14.93%) Docker
24 487 (14.90%) MongoDB
25 477 (14.59%) Microsoft Azure
25 477 (14.59%) Analytical Skills
26 476 (14.56%) Apache Cassandra
27 469 (14.35%) Degree
28 463 (14.16%) HBase
29 448 (13.70%) Cloudera

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,806 (55.25%) Apache Spark
2 335 (10.25%) Apache
3 288 (8.81%) Elasticsearch
4 230 (7.04%) SAS
5 217 (6.64%) Apache Pig
6 144 (4.41%) Apache Solr
7 122 (3.73%) Tomcat
8 72 (2.20%) JBoss
9 71 (2.17%) Jetty
10 51 (1.56%) WebLogic
11 45 (1.38%) Confluence
12 29 (0.89%) OpenStack
13 28 (0.86%) WebSphere
14 23 (0.70%) nginx
15 18 (0.55%) IIS
16 12 (0.37%) Oracle SOA Suite
17 9 (0.28%) Apache Airflow
17 9 (0.28%) Cloud Foundry
17 9 (0.28%) CMS
17 9 (0.28%) Jupyter
Applications
1 42 (1.28%) Microsoft Excel
2 35 (1.07%) MS Visio
3 29 (0.89%) SPSS
4 18 (0.55%) Microsoft Office
5 15 (0.46%) Microsoft PowerPoint
6 13 (0.40%) Chatbot
7 10 (0.31%) Microsoft Project
8 9 (0.28%) GNU Octave
9 5 (0.15%) Stata
9 5 (0.15%) Weka
10 4 (0.12%) Mathematica
11 1 (0.031%) CPLEX
11 1 (0.031%) Mingle
11 1 (0.031%) SPSS Modeler
Business Applications
1 6 (0.18%) Dynamics CRM
2 4 (0.12%) Actimize
2 4 (0.12%) Oracle 11i
2 4 (0.12%) Oracle Assets
2 4 (0.12%) Oracle EBS
2 4 (0.12%) Oracle EBS R12
2 4 (0.12%) Oracle General Ledger
2 4 (0.12%) Oracle iProcurement
2 4 (0.12%) Oracle Payables
2 4 (0.12%) Oracle Receivables
2 4 (0.12%) SAP ERP
2 4 (0.12%) SAP InfiniteInsight
3 3 (0.092%) Distributed Ledger
4 2 (0.061%) Dynamics AX
4 2 (0.061%) Dynamics NAV
4 2 (0.061%) Oracle Procure-to-Pay
4 2 (0.061%) SAP S/4HANA
5 1 (0.031%) Oracle BPM
5 1 (0.031%) WebTrends
Cloud Services
1 845 (25.85%) Amazon AWS
2 477 (14.59%) Microsoft Azure
3 184 (5.63%) Google Cloud Platform
4 129 (3.95%) Amazon EMR
5 125 (3.82%) Amazon S3
6 100 (3.06%) SaaS
7 87 (2.66%) GitHub
8 86 (2.63%) Amazon Kinesis
9 59 (1.80%) Cloud Computing
10 58 (1.77%) Serverless
11 48 (1.47%) AWS Lambda
11 48 (1.47%) PaaS
12 44 (1.35%) Amazon EC2
13 42 (1.28%) IaaS
14 40 (1.22%) Adobe Analytics
15 36 (1.10%) Azure Data Factory
15 36 (1.10%) IBM Cloud
16 27 (0.83%) Google Analytics
17 19 (0.58%) OpenShift
18 18 (0.55%) Bluemix
Communications & Networking
1 75 (2.29%) TCP/IP
2 57 (1.74%) HTTP
3 51 (1.56%) Kerberos
4 49 (1.50%) Firewall
5 43 (1.32%) SSL
6 34 (1.04%) Internet
7 24 (0.73%) DNS
8 21 (0.64%) SMPP
9 19 (0.58%) Network Security
9 19 (0.58%) Sourcefire
10 16 (0.49%) SMS
10 16 (0.49%) VPN
11 15 (0.46%) SSH
12 13 (0.40%) LAN
12 13 (0.40%) SAN
12 13 (0.40%) WAN
13 11 (0.34%) FIX Connectivity
14 9 (0.28%) SMTP
15 5 (0.15%) AMQP
15 5 (0.15%) NAS
Database & Business Intelligence
1 2,051 (62.74%) Big Data
2 839 (25.67%) Apache Hive
3 779 (23.83%) NoSQL
4 487 (14.90%) MongoDB
5 476 (14.56%) Apache Cassandra
6 463 (14.16%) HBase
7 432 (13.22%) Data Warehouse
8 387 (11.84%) SQL Server
9 332 (10.16%) MySQL
10 319 (9.76%) Impala
11 289 (8.84%) Relational Database
12 234 (7.16%) Data Lake
12 234 (7.16%) PostgreSQL
13 216 (6.61%) Sqoop
14 172 (5.26%) Amazon Redshift
15 171 (5.23%) SQL Server Integration Services
16 163 (4.99%) Redis
17 156 (4.77%) Data Mining
18 152 (4.65%) Power BI
19 144 (4.41%) RDBMS
Development Applications
1 338 (10.34%) Jenkins
2 247 (7.56%) Git (software)
3 178 (5.45%) JIRA
4 168 (5.14%) Maven
5 109 (3.33%) JUnit
6 104 (3.18%) TeamCity
7 100 (3.06%) Selenium
8 98 (3.00%) Cucumber
9 87 (2.66%) Atlassian Bamboo
10 65 (1.99%) Vagrant
11 57 (1.74%) Gradle
12 41 (1.25%) Octopus Deploy
13 36 (1.10%) TestNG
14 34 (1.04%) Bitbucket
15 32 (0.98%) Mockito
15 32 (0.98%) Visual Studio
16 29 (0.89%) FitNesse
16 29 (0.89%) JMeter
17 28 (0.86%) Eclipse
17 28 (0.86%) Subversion
General
1 574 (17.56%) Finance
2 268 (8.20%) Banking
3 227 (6.94%) Retail
4 192 (5.87%) Marketing
5 140 (4.28%) Investment Banking
6 108 (3.30%) Telecoms
7 97 (2.97%) Games
8 90 (2.75%) Front Office
9 70 (2.14%) Advertising
10 58 (1.77%) Law
11 55 (1.68%) Financial Institution
12 53 (1.62%) Manufacturing
13 48 (1.47%) Electronics
14 30 (0.92%) Publishing
15 28 (0.86%) Pharmaceutical
16 21 (0.64%) Automotive
17 10 (0.31%) Military
18 9 (0.28%) Legal
19 6 (0.18%) Retail Banking
20 5 (0.15%) Billing
Job Titles
1 782 (23.92%) Developer
2 648 (19.82%) Data Engineer
3 429 (13.12%) Architect
4 399 (12.21%) Java Developer
5 392 (11.99%) Data Scientist
6 373 (11.41%) Big Data Engineer
7 279 (8.53%) Data Architect
8 177 (5.41%) Analyst
9 174 (5.32%) Java Engineer
10 171 (5.23%) Big Data Developer
11 170 (5.20%) Big Data Architect
12 169 (5.17%) Hadoop Engineer
13 166 (5.08%) Software Engineer
14 132 (4.04%) Consultant
15 131 (4.01%) Senior Data Scientist
16 93 (2.84%) DevOps Engineer
17 91 (2.78%) Senior Data Engineer
17 91 (2.78%) Senior Developer
18 87 (2.66%) Java Software Engineer
19 86 (2.63%) Scala Developer
Libraries, Frameworks & Software Standards
1 819 (25.05%) Kafka
2 327 (10.00%) Spring
3 256 (7.83%) HTML
4 234 (7.16%) .NET
5 224 (6.85%) AngularJS
5 224 (6.85%) Hibernate
6 214 (6.55%) Web Services
7 170 (5.20%) REST
8 149 (4.56%) Node.js
9 139 (4.25%) TensorFlow
10 120 (3.67%) RabbitMQ
11 117 (3.58%) HTML5
12 112 (3.43%) Pandas
12 112 (3.43%) XML
13 107 (3.27%) Natural Language Processing
14 97 (2.97%) JSON
15 94 (2.88%) Java EE
15 94 (2.88%) Spark Streaming
16 88 (2.69%) CSS
17 85 (2.60%) MLlib
Miscellaneous
1 477 (14.59%) Analytical Skills
2 372 (11.38%) Computer Science
3 311 (9.51%) Algorithms
4 181 (5.54%) Fintech
5 156 (4.77%) Data Structures
6 124 (3.79%) User Experience
7 120 (3.67%) Greenfield Project
8 96 (2.94%) Enterprise Software
9 93 (2.84%) Management Information System
10 75 (2.29%) Self-Motivation
11 58 (1.77%) Linux Command Line
12 43 (1.32%) Equities
13 42 (1.28%) Cyberthreat
14 39 (1.19%) Data Centre
14 39 (1.19%) Mobile App
15 37 (1.13%) Fixed Income
15 37 (1.13%) Public Cloud
16 35 (1.07%) Virtual Team
17 34 (1.04%) Foreign Exchange (FX)
18 33 (1.01%) Hedge funds
Operating Systems
1 620 (18.97%) Linux
2 191 (5.84%) Unix
3 145 (4.44%) Windows
4 70 (2.14%) Red Hat Enterprise Linux
5 41 (1.25%) CentOS
6 34 (1.04%) Android
7 33 (1.01%) Apple iOS
8 28 (0.86%) Ubuntu
9 26 (0.80%) Windows Server
10 21 (0.64%) Mac OS X
11 16 (0.49%) Debian
12 14 (0.43%) Mac OS
13 11 (0.34%) Windows Server 2012
14 10 (0.31%) CoreOS
15 6 (0.18%) Oracle Linux
15 6 (0.18%) SUSE
16 5 (0.15%) Amazon Linux
16 5 (0.15%) Windows 7
16 5 (0.15%) Windows 8
17 4 (0.12%) Fedora
Processes & Methodologies
1 1,229 (37.60%) Agile Software Development
2 1,218 (37.26%) Analytics
3 762 (23.31%) Machine Learning
4 760 (23.25%) Data Science
5 657 (20.10%) ETL
6 553 (16.92%) Software Engineering
7 505 (15.45%) Business Intelligence
8 499 (15.26%) DevOps
9 445 (13.61%) Visualisation
10 436 (13.34%) TDD
11 412 (12.60%) Problem-Solving
12 385 (11.78%) Scrum
13 373 (11.41%) Data Analytics
14 363 (11.10%) Continuous Integration
15 334 (10.22%) Data Modelling
16 315 (9.64%) Open Source
17 306 (9.36%) MapReduce
18 285 (8.72%) Artificial Intelligence
19 281 (8.60%) Data Visualisation
19 281 (8.60%) Mathematics
Programming Languages
1 1,635 (50.02%) Java
2 1,583 (48.42%) Python
3 1,369 (41.88%) SQL
4 973 (29.76%) Scala
5 539 (16.49%) R
6 406 (12.42%) JavaScript
7 311 (9.51%) C#
8 231 (7.07%) Bash Shell
9 204 (6.24%) C++
10 173 (5.29%) Java 8
11 153 (4.68%) C
12 150 (4.59%) Perl
13 140 (4.28%) Ruby
14 126 (3.85%) PHP
15 108 (3.30%) Shell Script
16 97 (2.97%) MATLAB
17 94 (2.88%) Go
18 91 (2.78%) T-SQL
19 87 (2.66%) PowerShell
20 62 (1.90%) PL/SQL
Qualifications
1 469 (14.35%) Degree
2 158 (4.83%) Security Cleared
3 130 (3.98%) Computer Science Degree
4 128 (3.92%) PhD
5 81 (2.48%) DV Cleared
6 54 (1.65%) Master's Degree
6 54 (1.65%) Numerate Degree
7 48 (1.47%) CISSP
8 35 (1.07%) SC Cleared
9 34 (1.04%) Microsoft Certification
10 28 (0.86%) MCSE
11 23 (0.70%) Cisco Certification
12 21 (0.64%) ISTQB
12 21 (0.64%) SANS
13 20 (0.61%) CCNA
13 20 (0.61%) GIAC
13 20 (0.61%) Linux+ Certification
13 20 (0.61%) Network+ Certification
13 20 (0.61%) SSCP
13 20 (0.61%) TOGAF Certification
Quality Assurance & Compliance
1 129 (3.95%) QA
2 119 (3.64%) Data Quality
3 41 (1.25%) GCP
4 23 (0.70%) GDPR
5 13 (0.40%) ISO/IEC 27001
5 13 (0.40%) PCI DSS
6 10 (0.31%) MiFID
6 10 (0.31%) SLA
7 8 (0.24%) GPG13
7 8 (0.24%) Solvency II
8 6 (0.18%) HIPAA
8 6 (0.18%) PMO
9 5 (0.15%) Actionable Recommendations
10 4 (0.12%) EMIR
11 2 (0.061%) Dodd-Frank
11 2 (0.061%) FATCA
12 1 (0.031%) COBIT
12 1 (0.031%) Sarbanes-Oxley
12 1 (0.031%) Val IT
System Software
1 488 (14.93%) Docker
2 432 (13.22%) HDFS
3 255 (7.80%) Apache Flume
4 52 (1.59%) Active Directory
5 40 (1.22%) VMware Infrastructure
6 37 (1.13%) Apache ZooKeeper
7 31 (0.95%) VirtualBox
8 27 (0.83%) Virtual Machines
9 22 (0.67%) vSphere
10 19 (0.58%) Snort
11 13 (0.40%) Hyper-V
12 8 (0.24%) KVM
12 8 (0.24%) Xen
13 5 (0.15%) Virtual Desktop
14 4 (0.12%) Varnish
15 3 (0.092%) Oracle RAC
15 3 (0.092%) VMware ESXi
16 2 (0.061%) vCloud
17 1 (0.031%) Cronacle
17 1 (0.031%) Samba
Systems Management
1 303 (9.27%) Puppet
2 291 (8.90%) Ansible
3 175 (5.35%) Kubernetes
4 162 (4.96%) Hadoop YARN
5 157 (4.80%) Opscode Chef
6 147 (4.50%) Oozie
7 98 (3.00%) Terraform
8 72 (2.20%) Mesos
9 44 (1.35%) Salt
10 41 (1.25%) Kibana
11 38 (1.16%) Docker Swarm
12 31 (0.95%) Ambari
13 29 (0.89%) Cobbler
14 28 (0.86%) Nagios
15 22 (0.67%) logstash
16 21 (0.64%) Prometheus
17 19 (0.58%) Suricata
18 13 (0.40%) Consul
19 12 (0.37%) ITRS Geneos
20 10 (0.31%) HAProxy
Vendors
1 507 (15.51%) Oracle
2 448 (13.70%) Cloudera
3 410 (12.54%) Tableau
4 304 (9.30%) Microsoft
5 283 (8.66%) Hortonworks
6 282 (8.63%) Google
7 207 (6.33%) Talend
8 191 (5.84%) Informatica
9 118 (3.61%) WorldPay
10 112 (3.43%) SAP
11 109 (3.33%) IBM
12 97 (2.97%) Teradata
13 77 (2.36%) MapR
14 63 (1.93%) Splunk
14 63 (1.93%) Sybase
15 58 (1.77%) Alteryx
16 55 (1.68%) Atlassian
16 55 (1.68%) Red Hat
17 54 (1.65%) VMware
18 46 (1.41%) Adobe