Period
to 21 August 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 August 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
21 Aug 2018
Same period 2017 Same period 2016
Rank 184 203 201
Rank change year-on-year +19 -2 +57
Permanent jobs citing Hadoop 2,991 3,033 3,184
As % of all permanent IT jobs advertised in England 1.90% 1.83% 1.72%
As % of the Database & Business Intelligence category 6.31% 6.00% 5.71%
Number of salaries quoted 2,207 2,274 2,511
England median annual salary £67,500 £62,500 £62,500
Median salary % change year-on-year +8.00% - -3.85%
10th Percentile £38,750 £37,500 £38,750
90th Percentile £97,500 £100,000 £97,500
UK median annual salary £65,000 £62,500 £60,000
% change year-on-year +4.00% +4.17% -4.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 47,382 50,517 55,794
As % of all permanent IT jobs advertised in England 30.03% 30.50% 30.05%
Number of salaries quoted 38,751 42,377 48,239
England median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £30,000 £28,750
90th Percentile £82,500 £77,500 £75,000
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 21 August 2018.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 21 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +10 1,855 £72,500 +7.41% 209
South East -4 400 £57,500 +4.55% 60
North of England -13 280 £55,000 - 43
North West -28 193 £55,000 -8.33% 27
East of England +37 163 £66,000 +20.00% 19
South West +18 163 £47,500 +13.10% 21
Midlands +67 133 £60,000 +20.00% 23
Yorkshire +37 81 £52,500 +5.00% 14
East Midlands +58 78 £62,500 +25.00% 10
West Midlands +34 55 £60,000 +14.29% 13
North East -29 6 £55,500 +23.33% 2
Hadoop
UK

For the 6 months to 21 August 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,935 (64.69%) Big Data
2 1,678 (56.10%) Apache Spark
3 1,485 (49.65%) Python
4 1,479 (49.45%) Java
5 1,216 (40.66%) SQL
6 1,165 (38.95%) Agile Software Development
7 1,031 (34.47%) Analytics
8 837 (27.98%) Scala
9 831 (27.78%) Apache Hive
10 829 (27.72%) Amazon AWS
11 783 (26.18%) Kafka
12 725 (24.24%) Data Science
13 709 (23.70%) Machine Learning
14 695 (23.24%) NoSQL
15 599 (20.03%) ETL
16 568 (18.99%) Linux
17 536 (17.92%) Finance
18 486 (16.25%) DevOps
19 484 (16.18%) Software Engineering
20 467 (15.61%) Microsoft Azure
21 450 (15.05%) Business Intelligence
22 449 (15.01%) R
23 443 (14.81%) Degree
24 422 (14.11%) Oracle
25 416 (13.91%) Data Warehouse
26 411 (13.74%) HDFS
27 408 (13.64%) Analytical Skills
28 396 (13.24%) JavaScript
29 388 (12.97%) Scrum
29 388 (12.97%) Docker

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,678 (56.10%) Apache Spark
2 347 (11.60%) Apache
3 283 (9.46%) Elasticsearch
4 216 (7.22%) Apache Pig
5 152 (5.08%) SAS
6 105 (3.51%) Apache Solr
7 85 (2.84%) Tomcat
8 51 (1.71%) JBoss
9 42 (1.40%) Jetty
10 35 (1.17%) Confluence
11 31 (1.04%) WebLogic
12 20 (0.67%) WebSphere
13 19 (0.64%) CMS
14 18 (0.60%) OpenStack
15 17 (0.57%) IIS
16 16 (0.53%) Jupyter
17 13 (0.43%) Cloud Foundry
17 13 (0.43%) nginx
18 12 (0.40%) Apache Airflow
18 12 (0.40%) Oracle SOA Suite
Applications
1 34 (1.14%) Microsoft Excel
2 32 (1.07%) MS Visio
3 29 (0.97%) SPSS
4 20 (0.67%) Chatbot
5 11 (0.37%) Microsoft Office
6 9 (0.30%) Microsoft PowerPoint
7 7 (0.23%) GNU Octave
8 6 (0.20%) Microsoft Project
9 3 (0.10%) Stata
9 3 (0.10%) Weka
10 2 (0.067%) CPLEX
10 2 (0.067%) Mathematica
11 1 (0.033%) Mingle
11 1 (0.033%) SPSS Modeler
Business Applications
1 13 (0.43%) Dynamics AX
1 13 (0.43%) Dynamics CRM
1 13 (0.43%) Dynamics NAV
2 5 (0.17%) Actimize
3 4 (0.13%) SAP ERP
3 4 (0.13%) SAP InfiniteInsight
4 3 (0.10%) Distributed Ledger
5 2 (0.067%) Oracle Procure-to-Pay
5 2 (0.067%) SAP S/4HANA
6 1 (0.033%) Exstream
6 1 (0.033%) Oracle EBS
Cloud Services
1 829 (27.72%) Amazon AWS
2 467 (15.61%) Microsoft Azure
3 207 (6.92%) Google Cloud Platform
4 131 (4.38%) Amazon EMR
5 110 (3.68%) SaaS
6 109 (3.64%) Amazon S3
7 79 (2.64%) PaaS
8 72 (2.41%) Amazon Kinesis
9 67 (2.24%) Cloud Computing
10 57 (1.91%) Serverless
11 56 (1.87%) IaaS
12 51 (1.71%) Amazon EC2
13 45 (1.50%) IBM Cloud
14 42 (1.40%) AWS Lambda
15 36 (1.20%) AWS CloudFormation
16 32 (1.07%) Adobe Analytics
16 32 (1.07%) GitHub
17 29 (0.97%) Azure Data Factory
18 24 (0.80%) Google Analytics
19 15 (0.50%) Azure Machine Learning
Communications & Networking
1 85 (2.84%) TCP/IP
2 64 (2.14%) Firewall
3 58 (1.94%) HTTP
3 58 (1.94%) SSL
4 44 (1.47%) Kerberos
5 25 (0.84%) Sourcefire
6 20 (0.67%) Internet
6 20 (0.67%) LAN
6 20 (0.67%) WAN
7 16 (0.53%) SMS
8 15 (0.50%) DNS
8 15 (0.50%) Software-Defined Networking
9 14 (0.47%) FIX Connectivity
10 13 (0.43%) SMPP
11 12 (0.40%) Network Security
11 12 (0.40%) SSH
11 12 (0.40%) VPN
12 10 (0.33%) SAN
13 5 (0.17%) NAS
14 4 (0.13%) HTTPS
Database & Business Intelligence
1 1,935 (64.69%) Big Data
2 831 (27.78%) Apache Hive
3 695 (23.24%) NoSQL
4 416 (13.91%) Data Warehouse
5 386 (12.91%) MongoDB
6 385 (12.87%) Apache Cassandra
7 377 (12.60%) SQL Server
8 376 (12.57%) HBase
9 291 (9.73%) Impala
10 267 (8.93%) MySQL
11 234 (7.82%) Relational Database
12 203 (6.79%) Data Lake
13 175 (5.85%) Sqoop
14 173 (5.78%) SQL Server Integration Services
15 167 (5.58%) Amazon Redshift
16 159 (5.32%) SQL Server Reporting Services
17 151 (5.05%) PostgreSQL
17 151 (5.05%) Power BI
18 124 (4.15%) RDBMS
19 123 (4.11%) Redis
Development Applications
1 274 (9.16%) Jenkins
2 250 (8.36%) Git (software)
3 174 (5.82%) JIRA
4 109 (3.64%) JUnit
4 109 (3.64%) Selenium
5 97 (3.24%) Atlassian Bamboo
6 89 (2.98%) TeamCity
7 81 (2.71%) Maven
8 63 (2.11%) Cucumber
9 62 (2.07%) Bitbucket
10 50 (1.67%) Gradle
11 49 (1.64%) Visual Studio
12 48 (1.60%) Vagrant
13 45 (1.50%) git-flow
14 40 (1.34%) CodeSonar
14 40 (1.34%) Robot Framework
15 36 (1.20%) Mockito
16 33 (1.10%) JMeter
17 32 (1.07%) Subversion
18 31 (1.04%) Octopus Deploy
General
1 536 (17.92%) Finance
2 302 (10.10%) Banking
3 216 (7.22%) Retail
4 192 (6.42%) Marketing
5 158 (5.28%) Investment Banking
6 119 (3.98%) Games
7 117 (3.91%) Telecoms
8 95 (3.18%) Front Office
9 67 (2.24%) Law
10 64 (2.14%) Financial Institution
11 60 (2.01%) Advertising
12 55 (1.84%) Manufacturing
13 43 (1.44%) Electronics
14 35 (1.17%) Pharmaceutical
15 23 (0.77%) Automotive
16 18 (0.60%) Corporate Banking
17 17 (0.57%) Military
18 16 (0.53%) Publishing
19 9 (0.30%) Legal
20 8 (0.27%) Retail Banking
Job Titles
1 686 (22.94%) Developer
2 600 (20.06%) Data Engineer
3 411 (13.74%) Architect
4 363 (12.14%) Big Data Engineer
5 347 (11.60%) Data Scientist
6 285 (9.53%) Java Developer
7 254 (8.49%) Data Architect
8 184 (6.15%) Software Engineer
9 164 (5.48%) Java Engineer
10 153 (5.12%) Analyst
11 151 (5.05%) Hadoop Engineer
12 147 (4.91%) Big Data Developer
13 130 (4.35%) Senior Data Scientist
14 129 (4.31%) Big Data Architect
15 101 (3.38%) Consultant
15 101 (3.38%) Senior Developer
16 94 (3.14%) Solutions Architect
17 92 (3.08%) Senior Data Engineer
18 86 (2.88%) Hadoop Developer
19 84 (2.81%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 783 (26.18%) Kafka
2 284 (9.50%) .NET
3 241 (8.06%) Spring
4 222 (7.42%) Web Services
5 191 (6.39%) Node.js
6 177 (5.92%) REST
7 172 (5.75%) AngularJS
8 168 (5.62%) HTML
9 156 (5.22%) TensorFlow
10 125 (4.18%) Hibernate
10 125 (4.18%) RabbitMQ
11 119 (3.98%) RESTful
12 116 (3.88%) Natural Language Processing
13 108 (3.61%) Java EE
14 103 (3.44%) HTML5
14 103 (3.44%) JSON
15 99 (3.31%) Pandas
16 94 (3.14%) SOAP
17 91 (3.04%) scikit-learn
18 88 (2.94%) XML
Miscellaneous
1 408 (13.64%) Analytical Skills
2 357 (11.94%) Computer Science
3 289 (9.66%) Algorithms
4 190 (6.35%) Fintech
5 166 (5.55%) Data Structures
6 133 (4.45%) Greenfield Project
7 121 (4.05%) Management Information System
8 105 (3.51%) User Experience
9 83 (2.77%) Self-Motivation
10 62 (2.07%) Equities
11 49 (1.64%) Linux Command Line
12 48 (1.60%) Virtual Team
13 46 (1.54%) Cyberthreat
14 42 (1.40%) Fixed Income
15 41 (1.37%) Mobile App
15 41 (1.37%) Robotics
16 40 (1.34%) Tandem
17 39 (1.30%) Enterprise Software
17 39 (1.30%) Public Cloud
18 33 (1.10%) Data Centre
Operating Systems
1 568 (18.99%) Linux
2 222 (7.42%) Unix
3 141 (4.71%) Windows
4 55 (1.84%) Apple iOS
5 54 (1.81%) Android
6 47 (1.57%) Red Hat Enterprise Linux
7 40 (1.34%) Mac OS X
8 24 (0.80%) CentOS
8 24 (0.80%) Ubuntu
9 19 (0.64%) Windows Server
10 16 (0.53%) Debian
11 8 (0.27%) SUSE
12 7 (0.23%) Mac OS
12 7 (0.23%) Windows Server 2012
13 6 (0.20%) CoreOS
14 5 (0.17%) Fedora
14 5 (0.17%) Solaris
15 3 (0.10%) AIX
15 3 (0.10%) HPUX
15 3 (0.10%) Windows 10
Processes & Methodologies
1 1,165 (38.95%) Agile Software Development
2 1,031 (34.47%) Analytics
3 725 (24.24%) Data Science
4 709 (23.70%) Machine Learning
5 599 (20.03%) ETL
6 486 (16.25%) DevOps
7 484 (16.18%) Software Engineering
8 450 (15.05%) Business Intelligence
9 388 (12.97%) Scrum
10 386 (12.91%) Problem-Solving
11 381 (12.74%) Visualisation
12 332 (11.10%) Continuous Integration
13 328 (10.97%) TDD
14 322 (10.77%) Data Analytics
14 322 (10.77%) Data Modelling
15 308 (10.30%) Open Source
16 307 (10.26%) Artificial Intelligence
17 264 (8.83%) Data Engineering
18 244 (8.16%) Microservices
19 239 (7.99%) MapReduce
Programming Languages
1 1,485 (49.65%) Python
2 1,479 (49.45%) Java
3 1,216 (40.66%) SQL
4 837 (27.98%) Scala
5 449 (15.01%) R
6 396 (13.24%) JavaScript
7 319 (10.67%) C#
8 241 (8.06%) C++
9 224 (7.49%) Bash Shell
10 167 (5.58%) C
11 162 (5.42%) Java 8
12 145 (4.85%) Perl
13 125 (4.18%) PowerShell
14 110 (3.68%) Ruby
15 102 (3.41%) Shell Script
16 98 (3.28%) T-SQL
17 85 (2.84%) Go
18 79 (2.64%) PHP
19 74 (2.47%) MATLAB
20 59 (1.97%) PL/SQL
Qualifications
1 443 (14.81%) Degree
2 171 (5.72%) Security Cleared
3 152 (5.08%) Computer Science Degree
4 101 (3.38%) DV Cleared
5 96 (3.21%) PhD
6 71 (2.37%) CISSP
7 53 (1.77%) Microsoft Certification
8 50 (1.67%) MCSE
9 49 (1.64%) Numerate Degree
10 47 (1.57%) Master's Degree
11 45 (1.50%) Cisco Certification
12 43 (1.44%) SANS
13 42 (1.40%) CCNA
13 42 (1.40%) GIAC
13 42 (1.40%) Linux+ Certification
13 42 (1.40%) Network+ Certification
13 42 (1.40%) SSCP
14 40 (1.34%) CompTIA Security+
15 28 (0.94%) SC Cleared
16 26 (0.87%) GCIH
Quality Assurance & Compliance
1 128 (4.28%) QA
2 83 (2.77%) Data Quality
3 42 (1.40%) GCP
4 26 (0.87%) GDPR
5 17 (0.57%) PCI DSS
6 15 (0.50%) MiFID
7 11 (0.37%) SLA
8 10 (0.33%) ISO/IEC 27001
8 10 (0.33%) PMO
9 9 (0.30%) GPG13
10 4 (0.13%) Actionable Recommendations
10 4 (0.13%) COBIT
11 3 (0.10%) Solvency II
12 2 (0.067%) PA-DSS
13 1 (0.033%) EMIR
13 1 (0.033%) GxP
13 1 (0.033%) HIPAA
System Software
1 411 (13.74%) HDFS
2 388 (12.97%) Docker
3 209 (6.99%) Apache Flume
4 53 (1.77%) Active Directory
5 43 (1.44%) vSphere
6 35 (1.17%) Apache ZooKeeper
7 33 (1.10%) VirtualBox
8 28 (0.94%) VMware Infrastructure
9 26 (0.87%) Virtual Machines
10 25 (0.84%) Snort
11 15 (0.50%) Virtual Desktop
12 12 (0.40%) Hyper-V
13 4 (0.13%) Xen
14 3 (0.10%) Oracle RAC
14 3 (0.10%) Varnish
15 2 (0.067%) GFS2
15 2 (0.067%) KVM
15 2 (0.067%) vCloud
15 2 (0.067%) Virtual Servers
16 1 (0.033%) GridGain
Systems Management
1 194 (6.49%) Puppet
2 174 (5.82%) Ansible
3 172 (5.75%) Kubernetes
4 161 (5.38%) Oozie
5 128 (4.28%) Hadoop YARN
6 111 (3.71%) Opscode Chef
7 93 (3.11%) Terraform
8 71 (2.37%) Kibana
9 55 (1.84%) Mesos
10 52 (1.74%) Salt
11 34 (1.14%) Docker Swarm
11 34 (1.14%) logstash
12 29 (0.97%) Prometheus
13 25 (0.84%) Ambari
13 25 (0.84%) Suricata
14 20 (0.67%) ITRS Geneos
15 19 (0.64%) Grafana
16 18 (0.60%) Nagios
17 14 (0.47%) Cobbler
18 11 (0.37%) QRadar
Vendors
1 422 (14.11%) Oracle
2 388 (12.97%) Cloudera
3 358 (11.97%) Tableau
4 317 (10.60%) Microsoft
5 273 (9.13%) Hortonworks
6 251 (8.39%) Google
7 164 (5.48%) Informatica
8 156 (5.22%) Talend
9 114 (3.81%) WorldPay
10 113 (3.78%) SAP
11 94 (3.14%) MapR
12 84 (2.81%) IBM
13 65 (2.17%) Splunk
14 60 (2.01%) Teradata
15 58 (1.94%) Sybase
16 53 (1.77%) Atlassian
17 43 (1.44%) Red Hat
18 42 (1.40%) Alteryx
19 41 (1.37%) Databricks
20 39 (1.30%) ServiceNow