Period
to 15 August 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 15 August 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
15 Aug 2018
Same period 2017 Same period 2016
Rank 182 201 202
Rank change year-on-year +19 +1 +65
Permanent jobs citing Hadoop 3,196 3,215 3,353
As % of all permanent IT jobs advertised in the UK 1.88% 1.82% 1.69%
As % of the Database & Business Intelligence category 6.26% 5.92% 5.63%
Number of salaries quoted 2,375 2,411 2,613
UK median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% -4.00%
10th Percentile £38,750 £36,153 £38,750
90th Percentile £97,500 £100,000 £96,250
UK excluding London median annual salary £55,000 £52,500 £51,500
% change year-on-year +4.76% +1.94% +3.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 51,068 54,306 59,588
As % of all permanent IT jobs advertised in the UK 30.11% 30.68% 30.03%
Number of salaries quoted 41,622 45,195 50,873
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,750 £28,750
90th Percentile £82,500 £77,500 £75,000
UK excluding London median annual salary £45,000 £42,500 £41,000
% change year-on-year +5.88% +3.66% +2.50%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 15 August 2018.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 15 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +23 3,003 £67,500 +8.00% 404
London +9 1,864 £73,500 +7.69% 231
UK excluding London +17 1,289 £55,000 +4.76% 199
South East -7 400 £57,500 +4.55% 58
North of England -12 288 £55,000 - 50
North West -19 196 £55,000 -8.33% 31
East of England +21 163 £66,000 +20.00% 21
South West -3 162 £47,500 +15.85% 20
Scotland +17 138 £50,000 +14.29% 21
Midlands +76 129 £56,250 +12.50% 23
Yorkshire +31 86 £52,500 +5.00% 17
East Midlands +67 75 £53,250 +6.50% 12
West Midlands +35 54 £60,000 +11.63% 11
Wales -26 9 £37,500 +7.14% 2
North East -31 6 £55,500 +23.33% 2
Northern Ireland -1 2 - - 4

For the 6 months to 15 August 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 2,003 (62.67%) Big Data
2 1,742 (54.51%) Apache Spark
3 1,597 (49.97%) Java
4 1,593 (49.84%) Python
5 1,344 (42.05%) SQL
6 1,256 (39.30%) Agile Software Development
7 1,105 (34.57%) Analytics
8 872 (27.28%) Amazon AWS
9 869 (27.19%) Scala
10 855 (26.75%) Apache Hive
11 817 (25.56%) Kafka
12 788 (24.66%) NoSQL
13 763 (23.87%) Data Science
14 747 (23.37%) Machine Learning
15 640 (20.03%) ETL
16 609 (19.06%) Finance
17 591 (18.49%) Linux
18 511 (15.99%) Software Engineering
19 509 (15.93%) DevOps
20 504 (15.77%) Microsoft Azure
21 503 (15.74%) Oracle
22 484 (15.14%) R
23 476 (14.89%) Business Intelligence
24 472 (14.77%) Docker
25 466 (14.58%) JavaScript
26 458 (14.33%) Degree
27 435 (13.61%) HDFS
27 435 (13.61%) Analytical Skills
28 425 (13.30%) Data Warehouse
29 415 (12.98%) MongoDB

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,742 (54.51%) Apache Spark
2 355 (11.11%) Apache
3 286 (8.95%) Elasticsearch
4 231 (7.23%) Apache Pig
5 179 (5.60%) SAS
6 108 (3.38%) Apache Solr
7 97 (3.04%) Tomcat
8 58 (1.81%) JBoss
9 50 (1.56%) Jetty
10 40 (1.25%) WebLogic
11 36 (1.13%) Confluence
12 24 (0.75%) WebSphere
13 19 (0.59%) CMS
14 18 (0.56%) IIS
14 18 (0.56%) OpenStack
15 17 (0.53%) Jupyter
16 12 (0.38%) nginx
17 11 (0.34%) Cloud Foundry
17 11 (0.34%) Oracle SOA Suite
18 10 (0.31%) Apache Airflow
Applications
1 42 (1.31%) Microsoft Excel
2 40 (1.25%) MS Visio
3 29 (0.91%) SPSS
4 20 (0.63%) Chatbot
5 17 (0.53%) Microsoft Office
6 15 (0.47%) Microsoft PowerPoint
7 12 (0.38%) Microsoft Project
8 7 (0.22%) GNU Octave
9 3 (0.094%) Stata
9 3 (0.094%) Weka
10 2 (0.063%) Mathematica
11 1 (0.031%) CPLEX
11 1 (0.031%) Mingle
11 1 (0.031%) SPSS Modeler
Business Applications
1 13 (0.41%) Dynamics AX
1 13 (0.41%) Dynamics CRM
1 13 (0.41%) Dynamics NAV
2 5 (0.16%) Actimize
3 4 (0.13%) SAP ERP
3 4 (0.13%) SAP InfiniteInsight
4 3 (0.094%) Distributed Ledger
5 2 (0.063%) Oracle Procure-to-Pay
5 2 (0.063%) SAP S/4HANA
6 1 (0.031%) Exstream
6 1 (0.031%) Oracle EBS
Cloud Services
1 872 (27.28%) Amazon AWS
2 504 (15.77%) Microsoft Azure
3 209 (6.54%) Google Cloud Platform
4 136 (4.26%) Amazon EMR
5 116 (3.63%) Amazon S3
6 113 (3.54%) SaaS
7 80 (2.50%) PaaS
8 71 (2.22%) Amazon Kinesis
9 68 (2.13%) Cloud Computing
10 59 (1.85%) IaaS
10 59 (1.85%) Serverless
11 54 (1.69%) Amazon EC2
12 45 (1.41%) AWS Lambda
13 43 (1.35%) GitHub
14 42 (1.31%) IBM Cloud
15 36 (1.13%) AWS CloudFormation
16 33 (1.03%) Adobe Analytics
17 32 (1.00%) Azure Data Factory
18 23 (0.72%) Google Analytics
19 17 (0.53%) Azure Machine Learning
Communications & Networking
1 87 (2.72%) TCP/IP
2 64 (2.00%) Firewall
3 59 (1.85%) HTTP
4 58 (1.81%) SSL
5 47 (1.47%) Kerberos
6 25 (0.78%) Sourcefire
7 22 (0.69%) Internet
8 19 (0.59%) LAN
8 19 (0.59%) WAN
9 17 (0.53%) DNS
10 16 (0.50%) SMS
11 15 (0.47%) Software-Defined Networking
12 14 (0.44%) FIX Connectivity
13 13 (0.41%) SMPP
13 13 (0.41%) VPN
14 12 (0.38%) Network Security
14 12 (0.38%) SSH
15 11 (0.34%) SAN
16 6 (0.19%) NAS
17 5 (0.16%) SMTP
Database & Business Intelligence
1 2,003 (62.67%) Big Data
2 855 (26.75%) Apache Hive
3 788 (24.66%) NoSQL
4 425 (13.30%) Data Warehouse
5 415 (12.98%) MongoDB
6 399 (12.48%) Apache Cassandra
7 398 (12.45%) SQL Server
8 384 (12.02%) HBase
9 335 (10.48%) MySQL
10 300 (9.39%) Impala
11 243 (7.60%) Relational Database
12 221 (6.91%) PostgreSQL
13 218 (6.82%) Data Lake
14 194 (6.07%) Sqoop
15 186 (5.82%) SQL Server Integration Services
16 174 (5.44%) Amazon Redshift
17 167 (5.23%) SQL Server Reporting Services
18 158 (4.94%) Power BI
19 134 (4.19%) Redis
20 127 (3.97%) SQL Server Analysis Services
Development Applications
1 295 (9.23%) Jenkins
2 260 (8.14%) Git (software)
3 175 (5.48%) JIRA
4 153 (4.79%) Maven
5 119 (3.72%) Selenium
6 114 (3.57%) JUnit
7 100 (3.13%) Atlassian Bamboo
8 95 (2.97%) TeamCity
9 79 (2.47%) Cucumber
10 60 (1.88%) Bitbucket
11 57 (1.78%) Vagrant
12 50 (1.56%) Gradle
13 49 (1.53%) Visual Studio
14 44 (1.38%) git-flow
15 39 (1.22%) CodeSonar
15 39 (1.22%) Mockito
15 39 (1.22%) Robot Framework
16 37 (1.16%) JMeter
17 35 (1.10%) Subversion
18 33 (1.03%) Eclipse
General
1 609 (19.06%) Finance
2 311 (9.73%) Banking
3 227 (7.10%) Retail
4 199 (6.23%) Marketing
5 157 (4.91%) Investment Banking
6 123 (3.85%) Games
7 114 (3.57%) Telecoms
8 98 (3.07%) Front Office
9 75 (2.35%) Law
10 67 (2.10%) Advertising
11 66 (2.07%) Financial Institution
12 59 (1.85%) Manufacturing
13 45 (1.41%) Electronics
14 34 (1.06%) Pharmaceutical
15 20 (0.63%) Automotive
16 17 (0.53%) Corporate Banking
16 17 (0.53%) Military
17 15 (0.47%) Publishing
18 10 (0.31%) Legal
19 7 (0.22%) Retail Banking
Job Titles
1 746 (23.34%) Developer
2 613 (19.18%) Data Engineer
3 419 (13.11%) Architect
4 370 (11.58%) Big Data Engineer
5 360 (11.26%) Data Scientist
6 344 (10.76%) Java Developer
7 259 (8.10%) Data Architect
8 190 (5.94%) Software Engineer
9 171 (5.35%) Analyst
10 169 (5.29%) Java Engineer
11 163 (5.10%) Hadoop Engineer
12 153 (4.79%) Big Data Developer
13 138 (4.32%) Consultant
14 136 (4.26%) Big Data Architect
15 130 (4.07%) Senior Data Scientist
16 97 (3.04%) Senior Developer
17 96 (3.00%) Senior Data Engineer
18 93 (2.91%) Solutions Architect
19 90 (2.82%) Java Software Engineer
20 85 (2.66%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 817 (25.56%) Kafka
2 322 (10.08%) Spring
3 283 (8.85%) .NET
4 238 (7.45%) HTML
5 236 (7.38%) Web Services
6 233 (7.29%) AngularJS
7 208 (6.51%) Hibernate
8 191 (5.98%) Node.js
9 182 (5.69%) REST
10 160 (5.01%) TensorFlow
11 127 (3.97%) RabbitMQ
12 123 (3.85%) Natural Language Processing
13 121 (3.79%) RESTful
14 113 (3.54%) HTML5
15 109 (3.41%) Java EE
16 105 (3.29%) JSON
17 102 (3.19%) SOAP
18 100 (3.13%) Pandas
19 97 (3.04%) XML
20 94 (2.94%) scikit-learn
Miscellaneous
1 435 (13.61%) Analytical Skills
2 366 (11.45%) Computer Science
3 308 (9.64%) Algorithms
4 197 (6.16%) Fintech
5 178 (5.57%) Data Structures
6 136 (4.26%) Greenfield Project
7 118 (3.69%) Management Information System
8 112 (3.50%) User Experience
9 104 (3.25%) Enterprise Software
10 83 (2.60%) Self-Motivation
11 60 (1.88%) Equities
12 48 (1.50%) Linux Command Line
13 47 (1.47%) Cyberthreat
14 46 (1.44%) Virtual Team
15 44 (1.38%) Mobile App
16 43 (1.35%) Public Cloud
17 42 (1.31%) Fixed Income
18 38 (1.19%) Robotics
19 37 (1.16%) Tandem
20 35 (1.10%) Data Centre
Operating Systems
1 591 (18.49%) Linux
2 228 (7.13%) Unix
3 146 (4.57%) Windows
4 55 (1.72%) Android
4 55 (1.72%) Apple iOS
5 50 (1.56%) Red Hat Enterprise Linux
6 39 (1.22%) Mac OS X
7 27 (0.84%) CentOS
8 24 (0.75%) Ubuntu
9 21 (0.66%) Windows Server
10 16 (0.50%) Debian
11 10 (0.31%) Windows Server 2012
12 8 (0.25%) Mac OS
12 8 (0.25%) SUSE
13 6 (0.19%) CoreOS
14 5 (0.16%) Fedora
14 5 (0.16%) Solaris
15 4 (0.13%) Amazon Linux
16 3 (0.094%) Windows 10
16 3 (0.094%) Windows Server 2008
Processes & Methodologies
1 1,256 (39.30%) Agile Software Development
2 1,105 (34.57%) Analytics
3 763 (23.87%) Data Science
4 747 (23.37%) Machine Learning
5 640 (20.03%) ETL
6 511 (15.99%) Software Engineering
7 509 (15.93%) DevOps
8 476 (14.89%) Business Intelligence
9 400 (12.52%) Problem-Solving
10 397 (12.42%) Visualisation
11 393 (12.30%) Scrum
12 364 (11.39%) TDD
13 357 (11.17%) Continuous Integration
14 343 (10.73%) Data Analytics
15 331 (10.36%) Data Modelling
16 328 (10.26%) Open Source
17 325 (10.17%) Artificial Intelligence
18 268 (8.39%) Data Engineering
19 260 (8.14%) MapReduce
20 253 (7.92%) Microservices
Programming Languages
1 1,597 (49.97%) Java
2 1,593 (49.84%) Python
3 1,344 (42.05%) SQL
4 869 (27.19%) Scala
5 484 (15.14%) R
6 466 (14.58%) JavaScript
7 327 (10.23%) C#
8 247 (7.73%) C++
9 237 (7.42%) Bash Shell
10 175 (5.48%) C
11 166 (5.19%) Java 8
12 148 (4.63%) Perl
13 146 (4.57%) PHP
14 126 (3.94%) Ruby
15 125 (3.91%) PowerShell
16 103 (3.22%) Shell Script
17 102 (3.19%) T-SQL
18 90 (2.82%) Go
19 77 (2.41%) MATLAB
20 57 (1.78%) PL/SQL
Qualifications
1 458 (14.33%) Degree
2 175 (5.48%) Security Cleared
3 148 (4.63%) Computer Science Degree
4 104 (3.25%) PhD
5 101 (3.16%) DV Cleared
6 71 (2.22%) CISSP
7 54 (1.69%) Microsoft Certification
8 50 (1.56%) Numerate Degree
9 49 (1.53%) MCSE
10 44 (1.38%) Cisco Certification
10 44 (1.38%) Master's Degree
11 42 (1.31%) SANS
12 41 (1.28%) CCNA
12 41 (1.28%) GIAC
12 41 (1.28%) Linux+ Certification
12 41 (1.28%) Network+ Certification
12 41 (1.28%) SSCP
13 40 (1.25%) CompTIA Security+
14 31 (0.97%) SC Cleared
15 26 (0.81%) GCIH
Quality Assurance & Compliance
1 137 (4.29%) QA
2 100 (3.13%) Data Quality
3 42 (1.31%) GCP
4 26 (0.81%) GDPR
5 17 (0.53%) PCI DSS
6 14 (0.44%) MiFID
7 12 (0.38%) ISO/IEC 27001
8 11 (0.34%) SLA
9 10 (0.31%) PMO
10 9 (0.28%) GPG13
11 4 (0.13%) Actionable Recommendations
11 4 (0.13%) COBIT
12 3 (0.094%) Solvency II
13 2 (0.063%) PA-DSS
14 1 (0.031%) EMIR
14 1 (0.031%) GxP
14 1 (0.031%) HIPAA
System Software
1 472 (14.77%) Docker
2 435 (13.61%) HDFS
3 221 (6.91%) Apache Flume
4 55 (1.72%) Active Directory
5 42 (1.31%) vSphere
6 34 (1.06%) VirtualBox
7 33 (1.03%) Apache ZooKeeper
8 28 (0.88%) Virtual Machines
8 28 (0.88%) VMware Infrastructure
9 25 (0.78%) Snort
10 15 (0.47%) Virtual Desktop
11 12 (0.38%) Hyper-V
12 4 (0.13%) Xen
13 3 (0.094%) Oracle RAC
13 3 (0.094%) Varnish
14 2 (0.063%) GFS2
14 2 (0.063%) KVM
14 2 (0.063%) vCloud
14 2 (0.063%) Virtual Servers
15 1 (0.031%) GridGain
Systems Management
1 271 (8.48%) Puppet
2 246 (7.70%) Ansible
3 180 (5.63%) Kubernetes
4 170 (5.32%) Oozie
5 130 (4.07%) Hadoop YARN
6 127 (3.97%) Opscode Chef
7 98 (3.07%) Terraform
8 68 (2.13%) Kibana
9 56 (1.75%) Mesos
10 53 (1.66%) Salt
11 35 (1.10%) Docker Swarm
12 32 (1.00%) logstash
13 29 (0.91%) Prometheus
14 26 (0.81%) Ambari
15 25 (0.78%) Suricata
16 21 (0.66%) Cobbler
17 20 (0.63%) ITRS Geneos
17 20 (0.63%) Nagios
18 18 (0.56%) Grafana
19 10 (0.31%) QRadar
Vendors
1 503 (15.74%) Oracle
2 406 (12.70%) Cloudera
3 355 (11.11%) Tableau
4 334 (10.45%) Microsoft
5 284 (8.89%) Hortonworks
6 262 (8.20%) Google
7 183 (5.73%) Informatica
8 161 (5.04%) Talend
9 120 (3.75%) WorldPay
10 118 (3.69%) SAP
11 96 (3.00%) IBM
12 89 (2.78%) MapR
13 72 (2.25%) Teradata
14 70 (2.19%) Splunk
15 65 (2.03%) Sybase
16 55 (1.72%) Atlassian
17 45 (1.41%) Red Hat
18 42 (1.31%) Alteryx
19 39 (1.22%) Databricks
20 36 (1.13%) ServiceNow