Period
to 17 October 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 17 October 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
17 Oct 2018
Same period 2017 Same period 2016
Rank 190 199 214
Rank change year-on-year +9 +15 +22
Permanent jobs citing Hadoop 2,806 2,990 2,975
As % of all permanent IT jobs advertised in England 1.83% 1.82% 1.64%
As % of the Database & Business Intelligence category 6.21% 6.00% 5.55%
Number of salaries quoted 2,051 2,223 2,406
England median annual salary £70,000 £62,500 £62,500
Median salary % change year-on-year +12.00% - -3.85%
10th Percentile £39,241 £37,500 £38,875
90th Percentile £100,000 £97,500 £96,250
UK median annual salary £67,500 £60,000 £60,000
% change year-on-year +12.50% - -7.69%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 45,196 49,843 53,633
As % of all permanent IT jobs advertised in England 29.50% 30.34% 29.63%
Number of salaries quoted 37,027 41,387 46,178
England median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £83,750 £77,500 £76,250
UK median annual salary £50,000 £48,000 £47,500
% change year-on-year +4.17% +1.05% +5.56%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 17 October 2018.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 17 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -3 1,703 £75,000 +11.11% 215
South East +12 388 £60,000 +9.09% 44
North of England -14 239 £55,000 +2.56% 48
South West +32 185 £52,500 +28.05% 38
North West -39 164 £55,000 - 23
East of England +39 147 £66,000 +20.00% 16
Midlands +71 135 £65,000 +44.44% 21
East Midlands +44 83 £75,000 +76.47% 14
Yorkshire +33 71 £52,500 +5.00% 18
West Midlands +26 52 £60,000 +26.32% 7
North East -14 6 £100,000 +81.82% 7
Hadoop
UK

For the 6 months to 17 October 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,849 (65.89%) Big Data
2 1,593 (56.77%) Apache Spark
3 1,420 (50.61%) Python
4 1,417 (50.50%) Java
5 1,160 (41.34%) Agile Software Development
6 1,104 (39.34%) SQL
7 930 (33.14%) Analytics
8 837 (29.83%) Apache Hive
9 783 (27.90%) Amazon AWS
9 783 (27.90%) Kafka
10 742 (26.44%) Scala
11 700 (24.95%) Data Science
12 699 (24.91%) NoSQL
13 663 (23.63%) Machine Learning
14 596 (21.24%) Finance
15 561 (19.99%) ETL
16 510 (18.18%) Linux
17 498 (17.75%) Microsoft Azure
18 481 (17.14%) Software Engineering
19 467 (16.64%) Degree
19 467 (16.64%) DevOps
20 416 (14.83%) Data Warehouse
21 414 (14.75%) R
22 402 (14.33%) JavaScript
23 401 (14.29%) Business Intelligence
24 399 (14.22%) Data Modelling
25 389 (13.86%) Apache
26 378 (13.47%) Apache Cassandra
27 364 (12.97%) Cloudera
27 364 (12.97%) Visualisation

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,593 (56.77%) Apache Spark
2 389 (13.86%) Apache
3 317 (11.30%) Elasticsearch
4 216 (7.70%) Apache Pig
5 134 (4.78%) SAS
6 98 (3.49%) Apache Solr
7 51 (1.82%) Tomcat
8 38 (1.35%) Confluence
9 31 (1.10%) JBoss
10 21 (0.75%) CMS
11 19 (0.68%) nginx
12 18 (0.64%) Jupyter
13 17 (0.61%) WebSphere
14 16 (0.57%) GlassFish
15 15 (0.53%) Cloud Foundry
15 15 (0.53%) IIS
15 15 (0.53%) Jetty
15 15 (0.53%) Oracle SOA Suite
16 12 (0.43%) Apache Airflow
16 12 (0.43%) WebLogic
Applications
1 24 (0.86%) Microsoft Excel
2 23 (0.82%) SPSS
3 17 (0.61%) Chatbot
3 17 (0.61%) MS Visio
4 14 (0.50%) Microsoft Office
5 7 (0.25%) Microsoft PowerPoint
6 6 (0.21%) Microsoft Project
7 5 (0.18%) GNU Octave
8 4 (0.14%) Stata
8 4 (0.14%) Weka
9 1 (0.036%) CPLEX
9 1 (0.036%) Mingle
9 1 (0.036%) SPSS Modeler
Business Applications
1 13 (0.46%) Dynamics AX
1 13 (0.46%) Dynamics CRM
1 13 (0.46%) Dynamics NAV
2 5 (0.18%) Actimize
3 2 (0.071%) Oracle EBS
3 2 (0.071%) SAP ERP
3 2 (0.071%) SAP InfiniteInsight
4 1 (0.036%) Exstream
4 1 (0.036%) Magento
Cloud Services
1 783 (27.90%) Amazon AWS
2 498 (17.75%) Microsoft Azure
3 218 (7.77%) Google Cloud Platform
4 119 (4.24%) Amazon EMR
5 96 (3.42%) SaaS
6 82 (2.92%) Cloud Computing
6 82 (2.92%) PaaS
7 55 (1.96%) Amazon EC2
8 54 (1.92%) GitHub
9 53 (1.89%) Amazon S3
9 53 (1.89%) IaaS
10 52 (1.85%) Amazon Kinesis
11 51 (1.82%) Serverless
12 43 (1.53%) AWS CloudFormation
13 36 (1.28%) IBM Cloud
14 30 (1.07%) Cortana Intelligence Suite
15 29 (1.03%) Azure Data Factory
15 29 (1.03%) Google Analytics
16 28 (1.00%) AWS Lambda
17 21 (0.75%) Azure Machine Learning
Communications & Networking
1 75 (2.67%) TCP/IP
2 67 (2.39%) Firewall
3 64 (2.28%) HTTP
4 61 (2.17%) SSL
5 32 (1.14%) Kerberos
6 31 (1.10%) Internet
7 19 (0.68%) DNS
7 19 (0.68%) Software-Defined Networking
7 19 (0.68%) Sourcefire
8 18 (0.64%) SAN
8 18 (0.64%) WAN
9 17 (0.61%) LAN
10 11 (0.39%) Network Security
10 11 (0.39%) SSH
11 10 (0.36%) FIX Connectivity
12 6 (0.21%) SMPP
12 6 (0.21%) SMS
12 6 (0.21%) VPN
13 5 (0.18%) DAB
13 5 (0.18%) NAS
Database & Business Intelligence
1 1,849 (65.89%) Big Data
2 837 (29.83%) Apache Hive
3 699 (24.91%) NoSQL
4 416 (14.83%) Data Warehouse
5 378 (13.47%) Apache Cassandra
6 361 (12.87%) HBase
7 346 (12.33%) SQL Server
8 341 (12.15%) MongoDB
9 254 (9.05%) Impala
10 231 (8.23%) Relational Database
11 227 (8.09%) MySQL
12 212 (7.56%) Data Lake
13 181 (6.45%) Amazon Redshift
14 175 (6.24%) Power BI
15 161 (5.74%) SQL Server Integration Services
16 158 (5.63%) SQL Server Reporting Services
17 137 (4.88%) PostgreSQL
18 130 (4.63%) Flink
19 127 (4.53%) Sqoop
20 116 (4.13%) RDBMS
Development Applications
1 308 (10.98%) Git (software)
2 252 (8.98%) Jenkins
3 162 (5.77%) JIRA
4 95 (3.39%) Selenium
5 90 (3.21%) Atlassian Bamboo
6 84 (2.99%) JUnit
7 66 (2.35%) Bitbucket
8 62 (2.21%) Maven
9 61 (2.17%) TeamCity
10 60 (2.14%) Visual Studio
11 47 (1.67%) Cucumber
12 45 (1.60%) git-flow
13 44 (1.57%) CodeSonar
13 44 (1.57%) Robot Framework
14 40 (1.43%) Gradle
15 39 (1.39%) Subversion
16 32 (1.14%) gulp
17 31 (1.10%) Vagrant
18 28 (1.00%) Mockito
19 25 (0.89%) JMeter
General
1 596 (21.24%) Finance
2 309 (11.01%) Banking
3 220 (7.84%) Retail
4 196 (6.99%) Marketing
5 164 (5.84%) Investment Banking
6 130 (4.63%) Telecoms
7 100 (3.56%) Games
8 91 (3.24%) Front Office
9 78 (2.78%) Law
10 55 (1.96%) Advertising
10 55 (1.96%) Financial Institution
11 54 (1.92%) Manufacturing
12 37 (1.32%) Electronics
13 31 (1.10%) Automotive
14 27 (0.96%) Military
15 25 (0.89%) Corporate Banking
16 19 (0.68%) Pharmaceutical
17 15 (0.53%) Publishing
18 11 (0.39%) Retail Banking
19 7 (0.25%) German Language
Job Titles
1 659 (23.49%) Developer
2 551 (19.64%) Data Engineer
3 430 (15.32%) Architect
4 352 (12.54%) Big Data Engineer
5 308 (10.98%) Data Scientist
6 254 (9.05%) Data Architect
7 243 (8.66%) Java Developer
8 194 (6.91%) Software Engineer
9 143 (5.10%) Big Data Developer
10 142 (5.06%) Hadoop Engineer
11 138 (4.92%) Java Engineer
12 126 (4.49%) Senior Data Scientist
13 119 (4.24%) Analyst
14 112 (3.99%) Senior Developer
15 108 (3.85%) Big Data Architect
16 102 (3.64%) Hadoop Developer
17 101 (3.60%) Consultant
18 100 (3.56%) Solutions Architect
19 95 (3.39%) Senior Data Engineer
20 82 (2.92%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 783 (27.90%) Kafka
2 270 (9.62%) .NET
3 224 (7.98%) Node.js
4 221 (7.88%) Web Services
5 206 (7.34%) Spring
6 198 (7.06%) AngularJS
7 165 (5.88%) HTML
8 159 (5.67%) REST
9 142 (5.06%) TensorFlow
10 133 (4.74%) RabbitMQ
11 130 (4.63%) RESTful
12 124 (4.42%) Natural Language Processing
13 109 (3.88%) React
14 106 (3.78%) HTML5
15 102 (3.64%) JSON
16 93 (3.31%) CSS
16 93 (3.31%) Spark Streaming
17 90 (3.21%) XML
18 89 (3.17%) SOAP
19 88 (3.14%) Java EE
Miscellaneous
1 361 (12.87%) Computer Science
2 341 (12.15%) Analytical Skills
3 289 (10.30%) Algorithms
4 136 (4.85%) Data Structures
5 135 (4.81%) Fintech
6 114 (4.06%) Greenfield Project
7 107 (3.81%) Management Information System
8 86 (3.06%) Self-Motivation
9 75 (2.67%) User Experience
10 62 (2.21%) Equities
11 42 (1.50%) Enterprise Software
12 41 (1.46%) Cyberthreat
13 38 (1.35%) Mobile App
13 38 (1.35%) Tandem
14 37 (1.32%) Robotics
15 36 (1.28%) Linux Command Line
15 36 (1.28%) Virtual Team
16 35 (1.25%) Public Cloud
17 33 (1.18%) Fixed Income
18 32 (1.14%) Social Network
Operating Systems
1 510 (18.18%) Linux
2 211 (7.52%) Unix
3 134 (4.78%) Windows
4 63 (2.25%) Android
5 61 (2.17%) Apple iOS
6 44 (1.57%) Mac OS X
7 41 (1.46%) Red Hat Enterprise Linux
8 24 (0.86%) CentOS
9 23 (0.82%) Ubuntu
10 18 (0.64%) Windows Server
11 11 (0.39%) Debian
12 7 (0.25%) VMS
13 5 (0.18%) Solaris
13 5 (0.18%) SUSE
14 4 (0.14%) CoreOS
14 4 (0.14%) HPUX
14 4 (0.14%) Mac OS
15 3 (0.11%) AIX
15 3 (0.11%) Fedora
15 3 (0.11%) zOS
Processes & Methodologies
1 1,160 (41.34%) Agile Software Development
2 930 (33.14%) Analytics
3 700 (24.95%) Data Science
4 663 (23.63%) Machine Learning
5 561 (19.99%) ETL
6 481 (17.14%) Software Engineering
7 467 (16.64%) DevOps
8 401 (14.29%) Business Intelligence
9 399 (14.22%) Data Modelling
10 364 (12.97%) Visualisation
11 357 (12.72%) Scrum
12 350 (12.47%) Problem-Solving
13 321 (11.44%) Artificial Intelligence
14 316 (11.26%) Open Source
15 299 (10.66%) Data Analytics
16 283 (10.09%) Continuous Integration
16 283 (10.09%) TDD
17 281 (10.01%) Data Engineering
18 255 (9.09%) Microservices
19 242 (8.62%) Test Automation
Programming Languages
1 1,420 (50.61%) Python
2 1,417 (50.50%) Java
3 1,104 (39.34%) SQL
4 742 (26.44%) Scala
5 414 (14.75%) R
6 402 (14.33%) JavaScript
7 338 (12.05%) C#
8 257 (9.16%) C++
9 173 (6.17%) Bash Shell
10 149 (5.31%) C
11 133 (4.74%) Java 8
12 125 (4.45%) PowerShell
13 87 (3.10%) PHP
13 87 (3.10%) Shell Script
14 85 (3.03%) Perl
15 78 (2.78%) T-SQL
16 73 (2.60%) Ruby
17 69 (2.46%) Go
18 58 (2.07%) Objective-C
19 53 (1.89%) PL/SQL
Qualifications
1 467 (16.64%) Degree
2 198 (7.06%) Security Cleared
3 168 (5.99%) Computer Science Degree
4 119 (4.24%) DV Cleared
5 85 (3.03%) PhD
6 71 (2.53%) CISSP
7 57 (2.03%) Master's Degree
8 56 (2.00%) Microsoft Certification
9 53 (1.89%) MCSE
10 49 (1.75%) Numerate Degree
11 47 (1.67%) SC Cleared
12 46 (1.64%) Cisco Certification
12 46 (1.64%) SANS
13 45 (1.60%) CCNA
13 45 (1.60%) GIAC
13 45 (1.60%) Linux+ Certification
13 45 (1.60%) Network+ Certification
13 45 (1.60%) SSCP
14 43 (1.53%) CompTIA Security+
15 20 (0.71%) GCIH
Quality Assurance & Compliance
1 132 (4.70%) QA
2 87 (3.10%) Data Quality
3 28 (1.00%) GDPR
4 18 (0.64%) PMO
5 17 (0.61%) ISO/IEC 27001
5 17 (0.61%) MiFID
6 11 (0.39%) PCI DSS
7 9 (0.32%) GPG13
8 8 (0.29%) SLA
9 4 (0.14%) Actionable Recommendations
9 4 (0.14%) GxP
10 3 (0.11%) COBIT
10 3 (0.11%) Solvency II
11 2 (0.071%) PA-DSS
12 1 (0.036%) HIPAA
System Software
1 334 (11.90%) Docker
2 328 (11.69%) HDFS
3 168 (5.99%) Apache Flume
4 53 (1.89%) Active Directory
5 47 (1.67%) Apache ZooKeeper
6 44 (1.57%) vSphere
7 34 (1.21%) Virtual Machines
8 29 (1.03%) VirtualBox
9 23 (0.82%) VMware Infrastructure
10 19 (0.68%) Snort
10 19 (0.68%) Virtual Desktop
11 11 (0.39%) Hyper-V
12 4 (0.14%) Oracle RAC
12 4 (0.14%) Xen
13 3 (0.11%) KVM
14 2 (0.071%) GFS2
14 2 (0.071%) NFS
14 2 (0.071%) Virtual Servers
14 2 (0.071%) XenApp
15 1 (0.036%) SRDF
Systems Management
1 188 (6.70%) Puppet
2 164 (5.84%) Kubernetes
3 158 (5.63%) Oozie
4 148 (5.27%) Hadoop YARN
5 136 (4.85%) Ansible
6 92 (3.28%) Kibana
7 91 (3.24%) Terraform
8 85 (3.03%) Opscode Chef
9 53 (1.89%) Salt
10 43 (1.53%) logstash
11 42 (1.50%) Mesos
12 39 (1.39%) Prometheus
13 31 (1.10%) Grafana
14 29 (1.03%) Docker Swarm
15 23 (0.82%) Ambari
16 19 (0.68%) Suricata
17 15 (0.53%) ITRS Geneos
18 11 (0.39%) QRadar
19 10 (0.36%) Nagios
20 6 (0.21%) ZABBIX
Vendors
1 364 (12.97%) Cloudera
1 364 (12.97%) Oracle
2 347 (12.37%) Tableau
3 303 (10.80%) Microsoft
4 274 (9.76%) Hortonworks
5 262 (9.34%) Google
6 143 (5.10%) Informatica
7 138 (4.92%) SAP
8 134 (4.78%) Talend
9 117 (4.17%) MapR
10 88 (3.14%) IBM
11 76 (2.71%) Databricks
12 60 (2.14%) Splunk
13 57 (2.03%) Teradata
14 52 (1.85%) WorldPay
15 38 (1.35%) Atlassian
15 38 (1.35%) ServiceNow
15 38 (1.35%) Sybase
16 36 (1.28%) Red Hat
17 35 (1.25%) TIBCO