Period
to 21 October 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 October 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
21 Oct 2018
Same period 2017 Same period 2016
Rank 197 199 210
Rank change year-on-year +2 +11 +29
Permanent jobs citing Hadoop 2,958 3,127 3,159
As % of all permanent IT jobs advertised in the UK 1.81% 1.79% 1.65%
As % of the Database & Business Intelligence category 6.13% 5.89% 5.58%
Number of salaries quoted 2,188 2,316 2,533
UK median annual salary £67,500 £60,000 £60,000
Median salary % change year-on-year +12.50% - -7.69%
10th Percentile £39,168 £36,519 £38,750
90th Percentile £100,000 £97,500 £96,250
UK excluding London median annual salary £58,000 £50,000 £51,500
% change year-on-year +16.00% -2.91% +3.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 48,219 53,081 56,612
As % of all permanent IT jobs advertised in the UK 29.48% 30.47% 29.63%
Number of salaries quoted 39,353 43,602 48,193
UK median annual salary £50,000 £48,000 £47,500
Median salary % change year-on-year +4.17% +1.05% +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £82,500 £77,500 £76,250
UK excluding London median annual salary £45,000 £42,500 £41,500
% change year-on-year +5.88% +2.41% +3.75%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 21 October 2018.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 21 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +11 2,782 £70,000 +12.00% 339
London -7 1,677 £75,000 +11.11% 187
UK excluding London +28 1,236 £58,000 +16.00% 176
South East +27 392 £60,000 +9.09% 45
North of England +3 237 £55,000 +2.56% 44
South West +30 185 £52,500 +28.05% 30
North West -33 164 £55,000 - 19
East of England +28 147 £66,000 +20.00% 15
Midlands +73 135 £65,000 +49.43% 18
Scotland +37 134 £50,000 -6.98% 14
East Midlands +42 83 £75,000 +76.47% 12
Yorkshire +43 70 £52,500 +5.00% 19
West Midlands +34 52 £60,000 +26.32% 6
Wales -21 7 £35,000 -17.65% 5
North East -16 5 £100,000 +81.00% 6
Northern Ireland +12 1 - - 5

For the 6 months to 21 October 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 1,900 (64.23%) Big Data
2 1,643 (55.54%) Apache Spark
3 1,517 (51.28%) Python
4 1,500 (50.71%) Java
5 1,239 (41.89%) Agile Software Development
6 1,208 (40.84%) SQL
7 970 (32.79%) Analytics
8 865 (29.24%) Apache Hive
9 828 (27.99%) Amazon AWS
10 793 (26.81%) Kafka
11 771 (26.06%) NoSQL
12 752 (25.42%) Scala
13 728 (24.61%) Data Science
14 683 (23.09%) Machine Learning
15 669 (22.62%) Finance
16 585 (19.78%) ETL
17 530 (17.92%) Microsoft Azure
18 515 (17.41%) Linux
19 494 (16.70%) Software Engineering
20 487 (16.46%) Degree
21 477 (16.13%) DevOps
22 460 (15.55%) JavaScript
23 440 (14.87%) R
24 429 (14.50%) Data Warehouse
25 426 (14.40%) Oracle
26 421 (14.23%) Business Intelligence
27 412 (13.93%) Data Modelling
28 392 (13.25%) Apache
29 391 (13.22%) Docker
30 383 (12.95%) Apache Cassandra

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,643 (55.54%) Apache Spark
2 392 (13.25%) Apache
3 315 (10.65%) Elasticsearch
4 235 (7.94%) Apache Pig
5 154 (5.21%) SAS
6 98 (3.31%) Apache Solr
7 54 (1.83%) Tomcat
8 38 (1.28%) Confluence
9 36 (1.22%) JBoss
10 21 (0.71%) CMS
10 21 (0.71%) WebSphere
11 19 (0.64%) Jetty
11 19 (0.64%) nginx
12 18 (0.61%) Jupyter
13 17 (0.57%) GlassFish
14 16 (0.54%) WebLogic
15 15 (0.51%) Cloud Foundry
15 15 (0.51%) IIS
15 15 (0.51%) Oracle SOA Suite
16 13 (0.44%) Apache Airflow
Applications
1 28 (0.95%) Microsoft Excel
2 25 (0.85%) SPSS
3 19 (0.64%) MS Visio
4 18 (0.61%) Microsoft Office
5 17 (0.57%) Chatbot
6 10 (0.34%) Microsoft PowerPoint
6 10 (0.34%) Microsoft Project
7 6 (0.20%) Stata
8 5 (0.17%) GNU Octave
8 5 (0.17%) Weka
9 1 (0.034%) CPLEX
9 1 (0.034%) Mingle
9 1 (0.034%) SPSS Modeler
Business Applications
1 13 (0.44%) Dynamics AX
1 13 (0.44%) Dynamics CRM
1 13 (0.44%) Dynamics NAV
2 5 (0.17%) Actimize
3 2 (0.068%) Oracle EBS
3 2 (0.068%) SAP ERP
3 2 (0.068%) SAP InfiniteInsight
4 1 (0.034%) Exstream
4 1 (0.034%) Magento
Cloud Services
1 828 (27.99%) Amazon AWS
2 530 (17.92%) Microsoft Azure
3 227 (7.67%) Google Cloud Platform
4 131 (4.43%) Amazon EMR
5 97 (3.28%) SaaS
6 83 (2.81%) Cloud Computing
6 83 (2.81%) PaaS
7 62 (2.10%) Amazon EC2
8 58 (1.96%) Amazon S3
8 58 (1.96%) GitHub
9 55 (1.86%) Serverless
10 53 (1.79%) Amazon Kinesis
10 53 (1.79%) IaaS
11 44 (1.49%) AWS CloudFormation
12 35 (1.18%) IBM Cloud
13 33 (1.12%) Google Analytics
14 32 (1.08%) AWS Lambda
15 30 (1.01%) Azure Data Factory
15 30 (1.01%) Cortana Intelligence Suite
16 22 (0.74%) Azure Machine Learning
Communications & Networking
1 75 (2.54%) TCP/IP
2 67 (2.27%) Firewall
3 64 (2.16%) HTTP
4 60 (2.03%) SSL
5 34 (1.15%) Internet
6 30 (1.01%) Kerberos
7 19 (0.64%) Software-Defined Networking
8 18 (0.61%) DNS
8 18 (0.61%) SAN
8 18 (0.61%) WAN
9 17 (0.57%) LAN
9 17 (0.57%) Sourcefire
10 11 (0.37%) SSH
11 10 (0.34%) FIX Connectivity
12 9 (0.30%) Network Security
13 6 (0.20%) AMQP
13 6 (0.20%) SMPP
13 6 (0.20%) SMS
14 5 (0.17%) DAB
14 5 (0.17%) VPN
Database & Business Intelligence
1 1,900 (64.23%) Big Data
2 865 (29.24%) Apache Hive
3 771 (26.06%) NoSQL
4 429 (14.50%) Data Warehouse
5 383 (12.95%) Apache Cassandra
6 380 (12.85%) HBase
7 360 (12.17%) SQL Server
8 354 (11.97%) MongoDB
9 279 (9.43%) MySQL
10 254 (8.59%) Impala
11 239 (8.08%) Relational Database
12 220 (7.44%) Data Lake
13 197 (6.66%) Amazon Redshift
14 187 (6.32%) PostgreSQL
14 187 (6.32%) Power BI
15 166 (5.61%) SQL Server Integration Services
15 166 (5.61%) SQL Server Reporting Services
16 136 (4.60%) Sqoop
17 132 (4.46%) Flink
18 122 (4.12%) RDBMS
Development Applications
1 318 (10.75%) Git (software)
2 258 (8.72%) Jenkins
3 163 (5.51%) JIRA
4 121 (4.09%) Maven
5 103 (3.48%) Selenium
6 91 (3.08%) Atlassian Bamboo
7 86 (2.91%) JUnit
8 68 (2.30%) Bitbucket
9 60 (2.03%) TeamCity
9 60 (2.03%) Visual Studio
10 49 (1.66%) Cucumber
11 45 (1.52%) git-flow
12 44 (1.49%) CodeSonar
12 44 (1.49%) Robot Framework
13 43 (1.45%) Subversion
14 41 (1.39%) Gradle
15 32 (1.08%) gulp
16 30 (1.01%) Vagrant
17 29 (0.98%) JMeter
18 28 (0.95%) Mockito
General
1 669 (22.62%) Finance
2 321 (10.85%) Banking
3 229 (7.74%) Retail
4 202 (6.83%) Marketing
5 164 (5.54%) Investment Banking
6 136 (4.60%) Telecoms
7 99 (3.35%) Games
8 91 (3.08%) Front Office
9 84 (2.84%) Law
10 61 (2.06%) Financial Institution
11 57 (1.93%) Manufacturing
12 55 (1.86%) Advertising
13 37 (1.25%) Electronics
14 31 (1.05%) Automotive
15 27 (0.91%) Military
16 25 (0.85%) Corporate Banking
17 18 (0.61%) Pharmaceutical
18 15 (0.51%) Publishing
19 13 (0.44%) Retail Banking
20 7 (0.24%) German Language
Job Titles
1 708 (23.94%) Developer
2 553 (18.70%) Data Engineer
3 432 (14.60%) Architect
4 351 (11.87%) Big Data Engineer
5 317 (10.72%) Data Scientist
6 275 (9.30%) Java Developer
7 256 (8.65%) Data Architect
8 199 (6.73%) Software Engineer
9 157 (5.31%) Big Data Developer
10 143 (4.83%) Hadoop Engineer
11 141 (4.77%) Consultant
12 140 (4.73%) Java Engineer
13 128 (4.33%) Analyst
13 128 (4.33%) Senior Data Scientist
14 120 (4.06%) Senior Developer
15 107 (3.62%) Big Data Architect
15 107 (3.62%) Hadoop Developer
16 99 (3.35%) Solutions Architect
17 95 (3.21%) Senior Data Engineer
18 85 (2.87%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 793 (26.81%) Kafka
2 270 (9.13%) .NET
3 267 (9.03%) Spring
4 251 (8.49%) AngularJS
5 238 (8.05%) Web Services
6 224 (7.57%) Node.js
7 222 (7.51%) HTML
8 172 (5.81%) REST
9 146 (4.94%) Hibernate
10 138 (4.67%) TensorFlow
11 135 (4.56%) RabbitMQ
12 134 (4.53%) RESTful
13 129 (4.36%) Natural Language Processing
14 112 (3.79%) HTML5
14 112 (3.79%) React
15 105 (3.55%) JSON
16 95 (3.21%) SOAP
17 94 (3.18%) Spark Streaming
18 93 (3.14%) CSS
19 90 (3.04%) XML
Miscellaneous
1 376 (12.71%) Computer Science
2 359 (12.14%) Analytical Skills
3 308 (10.41%) Algorithms
4 147 (4.97%) Data Structures
5 127 (4.29%) Fintech
6 114 (3.85%) Greenfield Project
7 106 (3.58%) Management Information System
8 100 (3.38%) Enterprise Software
9 90 (3.04%) Self-Motivation
10 74 (2.50%) User Experience
11 61 (2.06%) Equities
12 40 (1.35%) Cyberthreat
12 40 (1.35%) Robotics
13 39 (1.32%) Public Cloud
14 37 (1.25%) Mobile App
14 37 (1.25%) Virtual Team
15 36 (1.22%) Linux Command Line
15 36 (1.22%) Tandem
16 33 (1.12%) Fixed Income
16 33 (1.12%) Social Network
Operating Systems
1 515 (17.41%) Linux
2 229 (7.74%) Unix
3 136 (4.60%) Windows
4 65 (2.20%) Android
5 62 (2.10%) Apple iOS
6 44 (1.49%) Mac OS X
6 44 (1.49%) Red Hat Enterprise Linux
7 26 (0.88%) CentOS
8 23 (0.78%) Ubuntu
9 18 (0.61%) Windows Server
10 11 (0.37%) Debian
11 8 (0.27%) VMS
12 6 (0.20%) Solaris
13 5 (0.17%) SUSE
14 4 (0.14%) HPUX
14 4 (0.14%) Mac OS
14 4 (0.14%) zOS
15 3 (0.10%) AIX
15 3 (0.10%) CoreOS
15 3 (0.10%) DC/OS
Processes & Methodologies
1 1,239 (41.89%) Agile Software Development
2 970 (32.79%) Analytics
3 728 (24.61%) Data Science
4 683 (23.09%) Machine Learning
5 585 (19.78%) ETL
6 494 (16.70%) Software Engineering
7 477 (16.13%) DevOps
8 421 (14.23%) Business Intelligence
9 412 (13.93%) Data Modelling
10 370 (12.51%) Visualisation
11 360 (12.17%) Scrum
12 357 (12.07%) Problem-Solving
13 337 (11.39%) Artificial Intelligence
13 337 (11.39%) Open Source
14 312 (10.55%) Data Analytics
15 296 (10.01%) TDD
16 288 (9.74%) Continuous Integration
17 282 (9.53%) Data Engineering
18 268 (9.06%) Microservices
19 250 (8.45%) Test Automation
Programming Languages
1 1,517 (51.28%) Python
2 1,500 (50.71%) Java
3 1,208 (40.84%) SQL
4 752 (25.42%) Scala
5 460 (15.55%) JavaScript
6 440 (14.87%) R
7 335 (11.33%) C#
8 264 (8.92%) C++
9 180 (6.09%) Bash Shell
10 147 (4.97%) C
11 141 (4.77%) PHP
12 133 (4.50%) Java 8
13 126 (4.26%) PowerShell
14 89 (3.01%) Shell Script
15 83 (2.81%) Perl
16 82 (2.77%) T-SQL
17 78 (2.64%) Ruby
18 69 (2.33%) Go
19 58 (1.96%) Objective-C
20 54 (1.83%) PL/SQL
Qualifications
1 487 (16.46%) Degree
2 197 (6.66%) Security Cleared
3 170 (5.75%) Computer Science Degree
4 116 (3.92%) DV Cleared
5 88 (2.97%) PhD
6 71 (2.40%) CISSP
7 59 (1.99%) Microsoft Certification
8 56 (1.89%) Master's Degree
9 54 (1.83%) MCSE
10 53 (1.79%) Numerate Degree
11 50 (1.69%) SC Cleared
12 47 (1.59%) SANS
13 46 (1.56%) CCNA
13 46 (1.56%) Cisco Certification
13 46 (1.56%) GIAC
13 46 (1.56%) Linux+ Certification
13 46 (1.56%) Network+ Certification
13 46 (1.56%) SSCP
14 45 (1.52%) CompTIA Security+
15 18 (0.61%) GCIH
Quality Assurance & Compliance
1 142 (4.80%) QA
2 101 (3.41%) Data Quality
3 32 (1.08%) GDPR
4 19 (0.64%) ISO/IEC 27001
5 17 (0.57%) MiFID
5 17 (0.57%) PMO
6 10 (0.34%) PCI DSS
7 7 (0.24%) GPG13
7 7 (0.24%) SLA
8 4 (0.14%) Actionable Recommendations
8 4 (0.14%) GxP
9 3 (0.10%) COBIT
9 3 (0.10%) Solvency II
10 2 (0.068%) PA-DSS
11 1 (0.034%) HIPAA
System Software
1 391 (13.22%) Docker
2 336 (11.36%) HDFS
3 171 (5.78%) Apache Flume
4 50 (1.69%) Active Directory
5 49 (1.66%) Apache ZooKeeper
6 44 (1.49%) vSphere
7 33 (1.12%) Virtual Machines
8 26 (0.88%) VirtualBox
9 21 (0.71%) VMware Infrastructure
10 19 (0.64%) Virtual Desktop
11 17 (0.57%) Snort
12 10 (0.34%) Hyper-V
13 5 (0.17%) Oracle RAC
14 4 (0.14%) Xen
15 3 (0.10%) KVM
15 3 (0.10%) NFS
16 2 (0.068%) GFS2
16 2 (0.068%) Samba
16 2 (0.068%) Virtual Servers
16 2 (0.068%) XenApp
Systems Management
1 245 (8.28%) Puppet
2 192 (6.49%) Ansible
3 168 (5.68%) Oozie
4 164 (5.54%) Kubernetes
5 147 (4.97%) Hadoop YARN
6 93 (3.14%) Terraform
7 91 (3.08%) Kibana
8 87 (2.94%) Opscode Chef
9 54 (1.83%) Salt
10 43 (1.45%) logstash
11 42 (1.42%) Mesos
12 39 (1.32%) Prometheus
13 31 (1.05%) Grafana
14 27 (0.91%) Docker Swarm
15 23 (0.78%) Ambari
16 17 (0.57%) Suricata
17 15 (0.51%) ITRS Geneos
18 10 (0.34%) Nagios
19 9 (0.30%) QRadar
20 5 (0.17%) Rundeck
Vendors
1 426 (14.40%) Oracle
2 367 (12.41%) Cloudera
3 353 (11.93%) Tableau
4 316 (10.68%) Microsoft
5 273 (9.23%) Hortonworks
6 272 (9.20%) Google
7 157 (5.31%) Informatica
8 142 (4.80%) SAP
9 136 (4.60%) Talend
10 120 (4.06%) MapR
11 96 (3.25%) IBM
12 75 (2.54%) Databricks
13 65 (2.20%) Teradata
14 63 (2.13%) Splunk
15 44 (1.49%) TIBCO
16 42 (1.42%) WorldPay
17 38 (1.28%) Red Hat
18 37 (1.25%) Sybase
19 36 (1.22%) Ab Initio
20 35 (1.18%) Atlassian