Period
to 25 February 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 25 February 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
25 Feb 2018
Same period 2017 Same period 2016
Rank 187 195 205
Rank change year-on-year +8 +10 +99
Permanent jobs citing Hadoop 2,980 2,956 3,393
As % of all permanent IT jobs advertised in England 1.83% 1.80% 1.71%
As % of the Database & Business Intelligence category 5.97% 6.00% 5.39%
Number of salaries quoted 2,344 2,450 2,784
England median annual salary £65,000 £65,000 £65,000
10th Percentile £39,500 £40,000 £41,250
90th Percentile £100,000 £96,250 £100,000
UK median annual salary £65,000 £65,000 £65,000

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 49,920 49,302 62,976
As % of all permanent IT jobs advertised in England 30.63% 29.94% 31.78%
Number of salaries quoted 42,049 42,426 53,785
England median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £30,500 £30,000 £28,750
90th Percentile £79,550 £77,500 £75,000
UK median annual salary £49,000 £47,500 £45,500
% change year-on-year +3.16% +4.40% +1.11%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 25 February 2018.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 25 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +5 1,950 £70,000 -3.45% 278
South East -6 333 £60,000 +9.09% 66
North of England -21 248 £52,500 - 61
South West -58 181 £42,000 -16.00% 19
North West -21 178 £52,500 -6.67% 28
East of England +83 175 £60,000 +9.09% 16
Midlands +1 94 £45,000 -25.00% 22
East Midlands +51 66 £45,000 -14.29% 12
Yorkshire +2 56 £50,750 +1.50% 32
West Midlands -48 28 £60,000 - 10
North East -23 14 £46,500 +3.33% 1
Hadoop
UK

For the 6 months to 25 February 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,954 (65.57%) Big Data
2 1,654 (55.50%) Apache Spark
3 1,519 (50.97%) Java
4 1,422 (47.72%) Python
5 1,126 (37.79%) Analytics
6 1,124 (37.72%) SQL
7 1,096 (36.78%) Agile Software Development
8 899 (30.17%) Scala
9 764 (25.64%) Amazon AWS
10 703 (23.59%) Apache Hive
11 692 (23.22%) Data Science
12 672 (22.55%) Machine Learning
13 628 (21.07%) NoSQL
14 625 (20.97%) Kafka
15 610 (20.47%) Linux
16 602 (20.20%) Finance
17 556 (18.66%) Software Engineering
18 541 (18.15%) Business Intelligence
19 505 (16.95%) Degree
20 497 (16.68%) DevOps
21 491 (16.48%) MongoDB
22 490 (16.44%) ETL
23 478 (16.04%) Apache Cassandra
24 470 (15.77%) R
25 463 (15.54%) Analytical Skills
26 460 (15.44%) HBase
27 431 (14.46%) Data Warehouse
28 415 (13.93%) SQL Server
29 404 (13.56%) Visualisation
30 402 (13.49%) Oracle

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,654 (55.50%) Apache Spark
2 331 (11.11%) Apache
3 283 (9.50%) Elasticsearch
4 218 (7.32%) SAS
5 211 (7.08%) Apache Pig
6 134 (4.50%) Apache Solr
7 79 (2.65%) Tomcat
8 60 (2.01%) OpenStack
9 46 (1.54%) JBoss
10 42 (1.41%) Jetty
11 39 (1.31%) Confluence
12 32 (1.07%) WebLogic
13 28 (0.94%) nginx
14 26 (0.87%) WebSphere
15 24 (0.81%) Apache Airflow
16 19 (0.64%) IIS
17 18 (0.60%) Cloud Foundry
18 16 (0.54%) SharePoint
19 14 (0.47%) CloudStack
20 13 (0.44%) BizTalk Server
Applications
1 62 (2.08%) Microsoft Excel
2 60 (2.01%) SPSS
3 17 (0.57%) Microsoft Office
4 14 (0.47%) Microsoft PowerPoint
5 12 (0.40%) MS Visio
6 9 (0.30%) Chatbot
6 9 (0.30%) GNU Octave
7 7 (0.23%) Mathematica
7 7 (0.23%) Weka
8 5 (0.17%) Stata
9 4 (0.13%) CPLEX
9 4 (0.13%) HipChat
10 2 (0.067%) Microsoft Project
11 1 (0.034%) S-PLUS
Business Applications
1 12 (0.40%) Dynamics CRM
1 12 (0.40%) SAP ERP
1 12 (0.40%) SAP InfiniteInsight
2 4 (0.13%) Oracle 11i
2 4 (0.13%) Oracle Assets
2 4 (0.13%) Oracle EBS
2 4 (0.13%) Oracle EBS R12
2 4 (0.13%) Oracle General Ledger
2 4 (0.13%) Oracle iProcurement
2 4 (0.13%) Oracle Payables
2 4 (0.13%) Oracle Receivables
3 2 (0.067%) Oracle AML
3 2 (0.067%) Payment Gateway
4 1 (0.034%) Adobe Campaign
4 1 (0.034%) Capstone
4 1 (0.034%) Cognos Business Intelligence
4 1 (0.034%) Distributed Ledger
4 1 (0.034%) Oracle BPM
4 1 (0.034%) Summit
4 1 (0.034%) WebTrends
Cloud Services
1 764 (25.64%) Amazon AWS
2 399 (13.39%) Microsoft Azure
3 128 (4.30%) Google Cloud Platform
4 115 (3.86%) GitHub
5 79 (2.65%) SaaS
6 77 (2.58%) Amazon EMR
7 71 (2.38%) Amazon S3
8 64 (2.15%) Amazon Kinesis
9 57 (1.91%) Cloud Computing
10 43 (1.44%) AWS CloudFormation
11 32 (1.07%) Amazon EC2
12 31 (1.04%) IaaS
13 28 (0.94%) AWS Lambda
13 28 (0.94%) Serverless
14 27 (0.91%) PaaS
15 26 (0.87%) Azure Data Factory
16 25 (0.84%) Amazon CloudWatch
16 25 (0.84%) Azure Machine Learning
17 16 (0.54%) Datadog
18 15 (0.50%) OpenShift
Communications & Networking
1 63 (2.11%) Internet
2 62 (2.08%) TCP/IP
3 52 (1.74%) Firewall
4 47 (1.58%) Kerberos
5 37 (1.24%) SSL
6 35 (1.17%) HTTP
7 27 (0.91%) DNS
8 24 (0.81%) Network Security
9 22 (0.74%) VPN
10 16 (0.54%) SMPP
11 12 (0.40%) VLAN
12 11 (0.37%) SAN
13 9 (0.30%) ICMP
14 7 (0.23%) SMTP
15 4 (0.13%) AMQP
15 4 (0.13%) GSM
15 4 (0.13%) LTE
15 4 (0.13%) SSH
15 4 (0.13%) UMTS
16 3 (0.10%) IPsec
Database & Business Intelligence
1 1,954 (65.57%) Big Data
2 703 (23.59%) Apache Hive
3 628 (21.07%) NoSQL
4 491 (16.48%) MongoDB
5 478 (16.04%) Apache Cassandra
6 460 (15.44%) HBase
7 431 (14.46%) Data Warehouse
8 415 (13.93%) SQL Server
9 344 (11.54%) Relational Database
10 269 (9.03%) MySQL
11 221 (7.42%) Impala
12 194 (6.51%) RDBMS
13 191 (6.41%) Data Lake
14 162 (5.44%) Data Mining
15 159 (5.34%) PostgreSQL
16 151 (5.07%) Power BI
17 150 (5.03%) QlikView
18 139 (4.66%) Redis
19 133 (4.46%) Sqoop
20 128 (4.30%) SQL Server Integration Services
Development Applications
1 313 (10.50%) Jenkins
2 245 (8.22%) Git (software)
3 191 (6.41%) JIRA
4 103 (3.46%) Maven
5 92 (3.09%) JUnit
6 79 (2.65%) Atlassian Bamboo
7 69 (2.32%) Bitbucket
8 67 (2.25%) Selenium
9 56 (1.88%) TeamCity
10 44 (1.48%) Cucumber
11 36 (1.21%) Subversion
12 35 (1.17%) Team Foundation Server
13 34 (1.14%) Vagrant
14 33 (1.11%) Gradle
15 31 (1.04%) Sonatype Nexus
16 27 (0.91%) Eclipse
17 23 (0.77%) TestNG
18 22 (0.74%) Artifactory
19 21 (0.70%) GitLab
20 19 (0.64%) JMeter
General
1 602 (20.20%) Finance
2 222 (7.45%) Banking
3 217 (7.28%) Marketing
4 204 (6.85%) Retail
5 133 (4.46%) Telecoms
6 100 (3.36%) Investment Banking
7 76 (2.55%) Front Office
8 70 (2.35%) Manufacturing
9 63 (2.11%) Advertising
9 63 (2.11%) Games
10 62 (2.08%) Electronics
11 46 (1.54%) Publishing
12 37 (1.24%) Law
13 34 (1.14%) Automotive
14 31 (1.04%) Financial Institution
15 27 (0.91%) Pharmaceutical
16 26 (0.87%) Retail Banking
17 10 (0.34%) Legal
18 6 (0.20%) Aerospace
18 6 (0.20%) Back Office
Job Titles
1 779 (26.14%) Developer
2 486 (16.31%) Data Engineer
3 378 (12.68%) Java Developer
4 368 (12.35%) Architect
5 327 (10.97%) Data Scientist
6 308 (10.34%) Big Data Engineer
7 234 (7.85%) Data Architect
8 202 (6.78%) Software Engineer
9 158 (5.30%) Big Data Developer
10 151 (5.07%) Senior Developer
11 146 (4.90%) Java Engineer
12 134 (4.50%) Big Data Architect
13 133 (4.46%) Analyst
14 127 (4.26%) Hadoop Engineer
15 122 (4.09%) Consultant
16 103 (3.46%) Senior Data Scientist
17 96 (3.22%) Senior Java Developer
18 88 (2.95%) DevOps Engineer
19 79 (2.65%) Java Software Engineer
19 79 (2.65%) Scala Developer
Libraries, Frameworks & Software Standards
1 625 (20.97%) Kafka
2 242 (8.12%) Spring
3 232 (7.79%) Web Services
4 226 (7.58%) AngularJS
5 186 (6.24%) HTML
6 158 (5.30%) Hibernate
7 155 (5.20%) REST
8 151 (5.07%) Node.js
9 144 (4.83%) CSS
10 135 (4.53%) .NET
11 115 (3.86%) RabbitMQ
12 93 (3.12%) Natural Language Processing
13 91 (3.05%) XML
14 89 (2.99%) React
15 87 (2.92%) HTML5
16 85 (2.85%) Spark Streaming
17 83 (2.79%) Pandas
18 82 (2.75%) Elastic Stack
19 79 (2.65%) Java EE
20 72 (2.42%) TensorFlow
Miscellaneous
1 463 (15.54%) Analytical Skills
2 359 (12.05%) Computer Science
3 273 (9.16%) Algorithms
4 136 (4.56%) Greenfield Project
5 111 (3.72%) Fintech
6 86 (2.89%) Data Structures
7 64 (2.15%) User Experience
8 55 (1.85%) Data Centre
9 51 (1.71%) Management Information System
10 48 (1.61%) Mobile App
11 47 (1.58%) Clustering
12 45 (1.51%) Enterprise Software
13 32 (1.07%) Public Cloud
14 31 (1.04%) Linux Command Line
15 30 (1.01%) Social Media
16 28 (0.94%) Life Science
17 23 (0.77%) Derivative
18 22 (0.74%) Market Risk
18 22 (0.74%) Private Cloud
19 16 (0.54%) Virtual Team
Operating Systems
1 610 (20.47%) Linux
2 198 (6.64%) Unix
3 152 (5.10%) Windows
4 46 (1.54%) Red Hat Enterprise Linux
5 36 (1.21%) Ubuntu
6 32 (1.07%) CentOS
7 29 (0.97%) Android
8 27 (0.91%) Apple iOS
9 20 (0.67%) Mac OS
10 16 (0.54%) Windows Server
11 14 (0.47%) Mac OS X
12 8 (0.27%) CoreOS
13 6 (0.20%) Oracle Linux
14 5 (0.17%) Windows Server 2012
15 4 (0.13%) Windows 7
15 4 (0.13%) Windows 8
16 2 (0.067%) Amazon Linux
16 2 (0.067%) Mesosphere
16 2 (0.067%) SUSE
17 1 (0.034%) Debian
Processes & Methodologies
1 1,126 (37.79%) Analytics
2 1,096 (36.78%) Agile Software Development
3 692 (23.22%) Data Science
4 672 (22.55%) Machine Learning
5 556 (18.66%) Software Engineering
6 541 (18.15%) Business Intelligence
7 497 (16.68%) DevOps
8 490 (16.44%) ETL
9 404 (13.56%) Visualisation
10 368 (12.35%) Data Analytics
11 336 (11.28%) TDD
12 335 (11.24%) Open Source
13 324 (10.87%) Data Modelling
14 317 (10.64%) Continuous Integration
15 315 (10.57%) Scrum
16 298 (10.00%) Mathematics
17 269 (9.03%) MapReduce
18 251 (8.42%) Test Automation
19 248 (8.32%) Data Visualisation
20 224 (7.52%) Mentoring
Programming Languages
1 1,519 (50.97%) Java
2 1,422 (47.72%) Python
3 1,124 (37.72%) SQL
4 899 (30.17%) Scala
5 470 (15.77%) R
6 325 (10.91%) JavaScript
7 290 (9.73%) C#
8 229 (7.68%) C++
9 183 (6.14%) Bash Shell
10 144 (4.83%) Ruby
11 142 (4.77%) C
12 121 (4.06%) Go
13 117 (3.93%) Perl
14 83 (2.79%) MATLAB
14 83 (2.79%) Shell Script
15 82 (2.75%) PHP
16 68 (2.28%) T-SQL
17 63 (2.11%) PowerShell
18 41 (1.38%) PL/SQL
19 35 (1.17%) Groovy
Qualifications
1 505 (16.95%) Degree
2 181 (6.07%) Security Cleared
3 142 (4.77%) Computer Science Degree
4 122 (4.09%) PhD
5 84 (2.82%) SC Cleared
6 79 (2.65%) DV Cleared
7 63 (2.11%) Master's Degree
8 55 (1.85%) Numerate Degree
9 28 (0.94%) CISSP
10 26 (0.87%) MBA
11 23 (0.77%) Microsoft Certification
12 21 (0.70%) ISTQB
13 18 (0.60%) ISEB
14 15 (0.50%) AWS Certification
15 14 (0.47%) ISTQB Foundation Certification
16 13 (0.44%) MCSE
17 12 (0.40%) CEH
17 12 (0.40%) GCIH
17 12 (0.40%) OSCP
18 11 (0.37%) Cisco Certification
Quality Assurance & Compliance
1 121 (4.06%) Data Quality
2 104 (3.49%) QA
3 36 (1.21%) GCP
4 23 (0.77%) Solvency II
5 19 (0.64%) GDPR
5 19 (0.64%) ISO/IEC 27001
6 17 (0.57%) Sarbanes-Oxley
7 16 (0.54%) SLA
8 13 (0.44%) GPG13
9 5 (0.17%) HIPAA
10 3 (0.10%) MiFID
10 3 (0.10%) PMO
11 2 (0.067%) EMIR
12 1 (0.034%) Dodd-Frank
12 1 (0.034%) FATCA
12 1 (0.034%) HMG Security Policy Framework
12 1 (0.034%) Val IT
System Software
1 386 (12.95%) Docker
2 280 (9.40%) HDFS
3 193 (6.48%) Apache Flume
4 52 (1.74%) Apache ZooKeeper
5 47 (1.58%) VMware Infrastructure
6 16 (0.54%) Virtual Machines
7 15 (0.50%) Hyper-V
8 14 (0.47%) vSphere
9 12 (0.40%) Active Directory
9 12 (0.40%) Snort
10 10 (0.34%) Varnish
11 6 (0.20%) KVM
12 5 (0.17%) VirtualBox
13 4 (0.13%) Xen
14 3 (0.10%) vCloud
14 3 (0.10%) VMware ESXi
15 2 (0.067%) MapR-FS
16 1 (0.034%) GridGain
16 1 (0.034%) Oracle RAC
Systems Management
1 219 (7.35%) Puppet
2 194 (6.51%) Ansible
3 165 (5.54%) Kubernetes
3 165 (5.54%) Opscode Chef
4 150 (5.03%) Hadoop YARN
5 107 (3.59%) Oozie
6 88 (2.95%) Mesos
6 88 (2.95%) Terraform
7 41 (1.38%) Salt
8 39 (1.31%) ZABBIX
9 35 (1.17%) Ambari
10 28 (0.94%) Kibana
11 26 (0.87%) logstash
12 22 (0.74%) Nagios
13 16 (0.54%) HAProxy
14 15 (0.50%) Graphite
15 12 (0.40%) Suricata
16 11 (0.37%) Docker Swarm
16 11 (0.37%) Prometheus
17 10 (0.34%) Simian Army
Vendors
1 402 (13.49%) Oracle
2 365 (12.25%) Tableau
3 344 (11.54%) Cloudera
4 228 (7.65%) Microsoft
5 214 (7.18%) Google
6 199 (6.68%) Hortonworks
7 139 (4.66%) Teradata
8 124 (4.16%) SAP
9 104 (3.49%) Informatica
10 91 (3.05%) Talend
11 73 (2.45%) MapR
12 69 (2.32%) IBM
13 56 (1.88%) VMware
14 48 (1.61%) Red Hat
15 47 (1.58%) Alteryx
16 42 (1.41%) Netezza
17 41 (1.38%) Splunk
18 39 (1.31%) Cognos
19 33 (1.11%) Atlassian
19 33 (1.11%) MicroStrategy