Period
to 20 November 2018

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 20 November 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
20 Nov 2018
Same period 2017 Same period 2016
Rank 193 200 205
Rank change year-on-year +7 +5 +25
Permanent jobs citing Hadoop 2,946 3,191 3,165
As % of all permanent IT jobs advertised in the UK 1.81% 1.77% 1.69%
As % of the Database & Business Intelligence category 6.20% 5.86% 5.71%
Number of salaries quoted 2,195 2,384 2,588
UK median annual salary £70,000 £62,500 £60,000
Median salary % change year-on-year +12.00% +4.17% -7.69%
10th Percentile £40,000 £37,500 £40,000
90th Percentile £100,000 £97,500 £96,250
UK excluding London median annual salary £60,000 £50,000 £52,500
% change year-on-year +20.00% -4.76% +5.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 47,487 54,413 55,467
As % of all permanent IT jobs advertised in the UK 29.11% 30.24% 29.65%
Number of salaries quoted 39,061 44,798 47,411
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £30,000 £29,000
90th Percentile £83,750 £77,500 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +6.25%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 20 November 2018.

Salary histogram for Hadoop in the UK

Hadoop
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 20 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +8 2,784 £70,000 +12.00% 421
London -10 1,653 £75,000 +11.11% 239
UK excluding London +44 1,251 £60,000 +20.00% 203
South East +35 389 £60,000 +9.09% 62
North of England 0 253 £60,000 +14.29% 45
South West +25 202 £53,252 +29.88% 36
North West -8 176 £60,000 +11.11% 20
East of England +26 141 £67,500 +22.73% 15
Midlands +79 137 £65,000 +52.94% 24
Scotland +32 121 £50,000 -9.09% 15
East Midlands +58 87 £75,000 +76.47% 12
Yorkshire +43 74 £57,000 +14.00% 18
West Midlands +39 50 £58,750 +23.68% 12
Wales -13 8 £35,000 -17.65% 2
North East +2 7 £100,000 +76.99% 7
Northern Ireland +1 1 - - 4
Channel Islands - 1 £37,500 -

For the 6 months to 20 November 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 1,920 (65.17%) Big Data
2 1,650 (56.01%) Apache Spark
3 1,579 (53.60%) Python
4 1,504 (51.05%) Java
5 1,283 (43.55%) Agile Software Development
6 1,159 (39.34%) SQL
7 931 (31.60%) Analytics
8 919 (31.19%) Amazon AWS
9 877 (29.77%) Apache Hive
10 861 (29.23%) Kafka
11 824 (27.97%) NoSQL
12 761 (25.83%) Scala
13 755 (25.63%) Data Science
14 713 (24.20%) Machine Learning
15 672 (22.81%) Finance
16 576 (19.55%) Microsoft Azure
17 557 (18.91%) ETL
18 552 (18.74%) Software Engineering
19 529 (17.96%) DevOps
20 526 (17.85%) Degree
21 516 (17.52%) Linux
22 465 (15.78%) Data Modelling
23 457 (15.51%) JavaScript
24 432 (14.66%) Business Intelligence
25 429 (14.56%) Apache
26 423 (14.36%) R
27 422 (14.32%) Oracle
28 418 (14.19%) Data Warehouse
29 417 (14.15%) Apache Cassandra
30 407 (13.82%) HBase

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,650 (56.01%) Apache Spark
2 429 (14.56%) Apache
3 328 (11.13%) Elasticsearch
4 240 (8.15%) Apache Pig
5 165 (5.60%) SAS
6 107 (3.63%) Apache Solr
7 55 (1.87%) Tomcat
8 41 (1.39%) JBoss
9 33 (1.12%) Confluence
10 24 (0.81%) WebSphere
11 22 (0.75%) GlassFish
12 20 (0.68%) SharePoint
13 19 (0.64%) nginx
14 18 (0.61%) CMS
14 18 (0.61%) Jetty
15 17 (0.58%) Apache Airflow
15 17 (0.58%) Jupyter
16 16 (0.54%) Oracle SOA Suite
16 16 (0.54%) WebLogic
17 14 (0.48%) MS Exchange
Applications
1 31 (1.05%) SPSS
2 23 (0.78%) Microsoft Excel
3 21 (0.71%) Chatbot
4 16 (0.54%) Microsoft Office
5 13 (0.44%) MS Visio
6 8 (0.27%) Stata
6 8 (0.27%) Weka
7 7 (0.24%) Microsoft PowerPoint
8 4 (0.14%) GNU Octave
8 4 (0.14%) Microsoft Project
9 1 (0.034%) CPLEX
Business Applications
1 13 (0.44%) Dynamics AX
1 13 (0.44%) Dynamics CRM
1 13 (0.44%) Dynamics NAV
2 2 (0.068%) Actimize
2 2 (0.068%) Oracle EBS
3 1 (0.034%) Exstream
3 1 (0.034%) Magento
3 1 (0.034%) SAP ERP
3 1 (0.034%) SAP InfiniteInsight
Cloud Services
1 919 (31.19%) Amazon AWS
2 576 (19.55%) Microsoft Azure
3 260 (8.83%) Google Cloud Platform
4 140 (4.75%) Amazon EMR
5 106 (3.60%) Cloud Computing
6 92 (3.12%) SaaS
7 82 (2.78%) PaaS
8 79 (2.68%) Amazon EC2
9 64 (2.17%) Serverless
10 61 (2.07%) GitHub
11 58 (1.97%) Amazon S3
12 53 (1.80%) IaaS
13 50 (1.70%) AWS CloudFormation
14 45 (1.53%) AWS Lambda
15 43 (1.46%) Amazon Kinesis
16 34 (1.15%) Google Analytics
17 33 (1.12%) Azure Data Factory
18 28 (0.95%) Cortana Intelligence Suite
19 26 (0.88%) IBM Cloud
20 21 (0.71%) Amazon SageMaker
Communications & Networking
1 59 (2.00%) Internet
2 58 (1.97%) HTTP
3 57 (1.93%) Firewall
3 57 (1.93%) TCP/IP
4 49 (1.66%) SSL
5 25 (0.85%) Kerberos
6 21 (0.71%) SAN
7 17 (0.58%) DNS
7 17 (0.58%) Software-Defined Networking
8 13 (0.44%) WAN
9 12 (0.41%) LAN
10 10 (0.34%) Sourcefire
11 8 (0.27%) SSH
12 6 (0.20%) AMQP
12 6 (0.20%) FIX Connectivity
12 6 (0.20%) NAS
12 6 (0.20%) VPN
13 5 (0.17%) DAB
13 5 (0.17%) Network Security
14 4 (0.14%) SMS
Database & Business Intelligence
1 1,920 (65.17%) Big Data
2 877 (29.77%) Apache Hive
3 824 (27.97%) NoSQL
4 418 (14.19%) Data Warehouse
5 417 (14.15%) Apache Cassandra
6 407 (13.82%) HBase
7 367 (12.46%) SQL Server
8 356 (12.08%) MongoDB
9 289 (9.81%) MySQL
10 254 (8.62%) Relational Database
11 246 (8.35%) Impala
12 229 (7.77%) Amazon Redshift
13 226 (7.67%) Data Lake
14 212 (7.20%) PostgreSQL
15 199 (6.75%) Power BI
16 156 (5.30%) Flink
17 155 (5.26%) SQL Server Reporting Services
18 151 (5.13%) SQL Server Integration Services
19 132 (4.48%) RDBMS
20 114 (3.87%) QlikView
Development Applications
1 292 (9.91%) Git (software)
2 228 (7.74%) Jenkins
3 163 (5.53%) JIRA
4 116 (3.94%) Maven
5 109 (3.70%) Selenium
6 79 (2.68%) Atlassian Bamboo
7 70 (2.38%) JUnit
8 61 (2.07%) Visual Studio
9 58 (1.97%) Bitbucket
10 49 (1.66%) TeamCity
11 45 (1.53%) Cucumber
12 41 (1.39%) Gradle
12 41 (1.39%) JMeter
13 40 (1.36%) Subversion
14 37 (1.26%) CodeSonar
14 37 (1.26%) git-flow
14 37 (1.26%) Robot Framework
15 32 (1.09%) gulp
16 30 (1.02%) EasyMock
16 30 (1.02%) SoapUI
General
1 672 (22.81%) Finance
2 293 (9.95%) Banking
3 235 (7.98%) Retail
4 190 (6.45%) Marketing
5 163 (5.53%) Telecoms
6 127 (4.31%) Investment Banking
7 124 (4.21%) Law
8 99 (3.36%) Games
9 58 (1.97%) Military
10 57 (1.93%) Front Office
11 54 (1.83%) Advertising
12 50 (1.70%) Manufacturing
13 42 (1.43%) Financial Institution
14 35 (1.19%) Automotive
15 32 (1.09%) Electronics
16 25 (0.85%) Corporate Banking
17 20 (0.68%) Pharmaceutical
18 15 (0.51%) Retail Banking
19 10 (0.34%) Publishing
20 9 (0.31%) Billing
Job Titles
1 667 (22.64%) Developer
2 572 (19.42%) Data Engineer
3 429 (14.56%) Architect
4 358 (12.15%) Big Data Engineer
5 306 (10.39%) Data Scientist
6 251 (8.52%) Java Developer
7 248 (8.42%) Data Architect
8 220 (7.47%) Software Engineer
9 155 (5.26%) Consultant
10 142 (4.82%) Big Data Developer
11 134 (4.55%) Hadoop Engineer
12 131 (4.45%) Java Engineer
13 128 (4.34%) Senior Data Scientist
14 122 (4.14%) Analyst
15 116 (3.94%) Senior Developer
16 108 (3.67%) Senior Data Engineer
17 101 (3.43%) Solutions Architect
18 94 (3.19%) Big Data Architect
19 93 (3.16%) Hadoop Developer
20 83 (2.82%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 861 (29.23%) Kafka
2 269 (9.13%) Web Services
3 266 (9.03%) Spring
4 256 (8.69%) AngularJS
5 243 (8.25%) .NET
6 234 (7.94%) HTML
7 228 (7.74%) Node.js
8 167 (5.67%) REST
9 153 (5.19%) Hibernate
10 142 (4.82%) RESTful
11 140 (4.75%) Natural Language Processing
12 138 (4.68%) TensorFlow
13 129 (4.38%) RabbitMQ
14 120 (4.07%) React
15 118 (4.01%) HTML5
16 109 (3.70%) Spark Streaming
17 103 (3.50%) JSON
18 100 (3.39%) SOAP
19 99 (3.36%) CSS
20 86 (2.92%) XML
Miscellaneous
1 388 (13.17%) Computer Science
2 341 (11.58%) Analytical Skills
3 317 (10.76%) Algorithms
4 130 (4.41%) Data Structures
5 119 (4.04%) Fintech
6 117 (3.97%) Greenfield Project
7 94 (3.19%) Management Information System
8 93 (3.16%) Enterprise Software
9 83 (2.82%) Self-Motivation
10 68 (2.31%) User Experience
11 47 (1.60%) Social Network
12 46 (1.56%) Public Cloud
13 41 (1.39%) Robotics
14 40 (1.36%) Equities
15 38 (1.29%) Mobile App
16 37 (1.26%) Cloud Native
16 37 (1.26%) Virtual Team
17 35 (1.19%) Tandem
18 34 (1.15%) Derivative
19 31 (1.05%) Linux Command Line
Operating Systems
1 516 (17.52%) Linux
2 241 (8.18%) Unix
3 137 (4.65%) Windows
4 66 (2.24%) Android
5 58 (1.97%) Apple iOS
6 47 (1.60%) Red Hat Enterprise Linux
7 37 (1.26%) Mac OS X
8 29 (0.98%) CentOS
9 23 (0.78%) Windows Server
10 18 (0.61%) Ubuntu
11 9 (0.31%) VMS
12 8 (0.27%) Solaris
13 6 (0.20%) Debian
13 6 (0.20%) SUSE
14 5 (0.17%) HPUX
14 5 (0.17%) Oracle Linux
14 5 (0.17%) zOS
15 4 (0.14%) AIX
16 3 (0.10%) CoreOS
17 2 (0.068%) Mac OS
Processes & Methodologies
1 1,283 (43.55%) Agile Software Development
2 931 (31.60%) Analytics
3 755 (25.63%) Data Science
4 713 (24.20%) Machine Learning
5 557 (18.91%) ETL
6 552 (18.74%) Software Engineering
7 529 (17.96%) DevOps
8 465 (15.78%) Data Modelling
9 432 (14.66%) Business Intelligence
10 374 (12.70%) Scrum
11 369 (12.53%) Artificial Intelligence
11 369 (12.53%) Visualisation
12 362 (12.29%) Open Source
13 327 (11.10%) Data Analytics
13 327 (11.10%) Data Engineering
14 313 (10.62%) Problem-Solving
15 294 (9.98%) TDD
16 280 (9.50%) Mathematics
17 261 (8.86%) Continuous Integration
18 259 (8.79%) Microservices
Programming Languages
1 1,579 (53.60%) Python
2 1,504 (51.05%) Java
3 1,159 (39.34%) SQL
4 761 (25.83%) Scala
5 457 (15.51%) JavaScript
6 423 (14.36%) R
7 338 (11.47%) C#
8 260 (8.83%) C++
9 165 (5.60%) Bash Shell
10 139 (4.72%) PHP
11 133 (4.51%) C
12 127 (4.31%) Java 8
13 117 (3.97%) PowerShell
14 92 (3.12%) Ruby
15 85 (2.89%) Shell Script
16 84 (2.85%) Perl
17 75 (2.55%) T-SQL
18 72 (2.44%) Go
19 53 (1.80%) Objective-C
20 48 (1.63%) PL/SQL
Qualifications
1 526 (17.85%) Degree
2 194 (6.59%) Security Cleared
3 177 (6.01%) Computer Science Degree
4 105 (3.56%) DV Cleared
5 83 (2.82%) PhD
6 68 (2.31%) Numerate Degree
7 57 (1.93%) Master's Degree
8 56 (1.90%) SC Cleared
9 55 (1.87%) CISSP
10 48 (1.63%) Microsoft Certification
11 44 (1.49%) MCSE
12 38 (1.29%) SANS
13 37 (1.26%) CCNA
13 37 (1.26%) Cisco Certification
13 37 (1.26%) CompTIA Security+
13 37 (1.26%) GIAC
13 37 (1.26%) Linux+ Certification
13 37 (1.26%) Network+ Certification
13 37 (1.26%) SSCP
14 14 (0.48%) AWS Certification
Quality Assurance & Compliance
1 143 (4.85%) QA
2 107 (3.63%) Data Quality
3 38 (1.29%) GDPR
4 19 (0.64%) ISO/IEC 27001
5 18 (0.61%) MiFID
5 18 (0.61%) PMO
6 8 (0.27%) PCI DSS
7 5 (0.17%) SLA
8 4 (0.14%) GxP
9 3 (0.10%) COBIT
9 3 (0.10%) GPG13
9 3 (0.10%) IFRS
9 3 (0.10%) PA-DSS
9 3 (0.10%) Solvency II
10 2 (0.068%) Actionable Recommendations
11 1 (0.034%) EMIR
System Software
1 369 (12.53%) Docker
2 297 (10.08%) HDFS
3 163 (5.53%) Apache Flume
4 64 (2.17%) Apache ZooKeeper
5 45 (1.53%) Active Directory
6 37 (1.26%) vSphere
7 29 (0.98%) Virtual Machines
8 22 (0.75%) VirtualBox
9 18 (0.61%) VMware Infrastructure
10 17 (0.58%) Virtual Desktop
11 10 (0.34%) Snort
12 9 (0.31%) Hyper-V
13 8 (0.27%) Oracle RAC
14 5 (0.17%) GFS2
15 4 (0.14%) Xen
16 3 (0.10%) KVM
16 3 (0.10%) NFS
16 3 (0.10%) XenApp
17 2 (0.068%) Virtual Servers
18 1 (0.034%) VMware NSX
Systems Management
1 234 (7.94%) Puppet
2 193 (6.55%) Ansible
3 174 (5.91%) Oozie
4 165 (5.60%) Hadoop YARN
5 156 (5.30%) Kubernetes
6 100 (3.39%) Terraform
7 92 (3.12%) Kibana
8 91 (3.09%) Opscode Chef
9 52 (1.77%) logstash
10 48 (1.63%) Salt
11 44 (1.49%) Mesos
12 37 (1.26%) Prometheus
13 33 (1.12%) Grafana
14 25 (0.85%) Ambari
15 22 (0.75%) Docker Swarm
16 13 (0.44%) ITRS Geneos
17 12 (0.41%) Nagios
18 10 (0.34%) Suricata
19 5 (0.17%) QRadar
19 5 (0.17%) Rundeck
Vendors
1 422 (14.32%) Oracle
2 371 (12.59%) Tableau
3 364 (12.36%) Cloudera
4 314 (10.66%) Microsoft
5 295 (10.01%) Google
6 272 (9.23%) Hortonworks
7 140 (4.75%) SAP
8 139 (4.72%) Informatica
9 135 (4.58%) MapR
10 105 (3.56%) Talend
11 89 (3.02%) Databricks
11 89 (3.02%) IBM
12 73 (2.48%) Teradata
13 72 (2.44%) Splunk
14 42 (1.43%) Red Hat
15 41 (1.39%) TIBCO
16 39 (1.32%) Ab Initio
17 37 (1.26%) WorldPay
18 36 (1.22%) CA Agile Central
18 36 (1.22%) ServiceNow