Period
to 11 December 2017

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 11 December 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
11 Dec 2017
Same period 2016 Same period 2015
Rank 195 199 220
Rank change year-on-year +4 +21 +105
Permanent jobs citing Hadoop 3238 3206 3347
As % of all permanent IT jobs advertised in the UK 1.80% 1.73% 1.55%
As % of the Database & Business Intelligence category 5.95% 5.82% 4.93%
Number of salaries quoted 2440 2619 2722
UK median annual salary £62,500 £62,500 £65,000
Median salary % change year-on-year - -3.85% +8.33%
10th Percentile £37,500 £40,000 £40,775
90th Percentile £97,550 £95,000 £95,000
UK excluding London median annual salary £50,000 £52,500 £52,500
% change year-on-year -4.76% - +5.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 54432 55054 67827
As % of all permanent IT jobs advertised in the UK 30.30% 29.78% 31.45%
Number of salaries quoted 44882 47077 57376
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% +2.27%
10th Percentile £30,000 £29,000 £28,500
90th Percentile £77,500 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £40,000
% change year-on-year - +6.25% -

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 11 December 2017.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 11 December 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +11 3071 £62,500 - 235
London +14 2046 £70,000 -3.45% 161
UK excluding London -12 1152 £50,000 -4.76% 86
South East +4 337 £55,000 +1.85% 23
North of England +3 268 £52,500 +5.00% 26
North West +43 206 £54,750 -0.45% 19
South West -63 187 £41,000 -18.00% 10
East of England +58 150 £57,500 +9.52% 12
Scotland -29 103 £52,500 +5.00% 11
Midlands +8 78 £42,500 -29.17% 4
Yorkshire -26 55 £50,000 - 6
East Midlands +49 43 £42,500 -19.05% 1
West Midlands -16 35 £43,000 -31.20% 3
Wales 0 31 £45,000 -10.00%
North East -13 7 £52,000 +15.56% 1
Northern Ireland -38 2 £85,000 +150.00% 1

For the 6 months to 11 December 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads with a requirement for Hadoop.

1 2068 (63.87%) Big Data
2 1732 (53.49%) Java
3 1660 (51.27%) Apache Spark
4 1536 (47.44%) Python
5 1325 (40.92%) Agile Software Development
6 1186 (36.63%) SQL
7 1062 (32.80%) Analytics
8 817 (25.23%) Finance
9 802 (24.77%) Scala
10 747 (23.07%) NoSQL
11 737 (22.76%) Amazon AWS
12 650 (20.07%) Machine Learning
13 648 (20.01%) Apache Hive
14 631 (19.49%) Software Engineering
15 609 (18.81%) Business Intelligence
16 581 (17.94%) MongoDB
17 572 (17.67%) Linux
18 555 (17.14%) Apache Cassandra
19 542 (16.74%) Kafka
20 541 (16.71%) Degree
21 523 (16.15%) Analytical Skills
22 508 (15.69%) DevOps
23 490 (15.13%) R
24 471 (14.55%) SQL Server
25 460 (14.21%) Relational Database
26 451 (13.93%) Oracle
27 450 (13.90%) ETL
28 448 (13.84%) Microsoft Azure
29 423 (13.06%) Open Source
30 420 (12.97%) JavaScript

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1660 (51.27%) Apache Spark
2 358 (11.06%) Apache
3 331 (10.22%) Elasticsearch
4 271 (8.37%) SAS
5 213 (6.58%) Apache Pig
6 137 (4.23%) Tomcat
7 127 (3.92%) Apache Solr
8 91 (2.81%) JBoss
9 76 (2.35%) OpenStack
10 73 (2.25%) Jetty
10 73 (2.25%) WebLogic
11 58 (1.79%) WebSphere
12 39 (1.20%) Apache Airflow
12 39 (1.20%) Confluence
13 34 (1.05%) IIS
14 30 (0.93%) nginx
15 25 (0.77%) SharePoint
16 23 (0.71%) Cloud Foundry
17 18 (0.56%) CloudStack
18 12 (0.37%) Oracle SOA Suite
Applications
1 85 (2.63%) SPSS
2 76 (2.35%) Microsoft Excel
3 26 (0.80%) Microsoft Office
4 16 (0.49%) Microsoft PowerPoint
5 9 (0.28%) MS Visio
5 9 (0.28%) Spreadsheet
6 6 (0.19%) HipChat
6 6 (0.19%) Microsoft Project
7 5 (0.15%) GNU Octave
7 5 (0.15%) Mathematica
8 4 (0.12%) Chatbot
8 4 (0.12%) CPLEX
8 4 (0.12%) Stata
8 4 (0.12%) Weka
9 3 (0.093%) S-PLUS
10 2 (0.062%) Pipeline Pilot
11 1 (0.031%) LaTeX
Business Applications
1 16 (0.49%) SAP InfiniteInsight
2 15 (0.46%) SAP ERP
3 8 (0.25%) Dynamics CRM
4 3 (0.093%) Oracle AML
5 2 (0.062%) Adobe Campaign
5 2 (0.062%) BusinessWorks
5 2 (0.062%) Payment Gateway
5 2 (0.062%) SAP HR
6 1 (0.031%) Capstone
6 1 (0.031%) Cognos Business Intelligence
6 1 (0.031%) Dynamics AX
6 1 (0.031%) FastStats PeopleStage
6 1 (0.031%) HFM
6 1 (0.031%) Hyperion Enterprise
6 1 (0.031%) SAP Hybris
6 1 (0.031%) Summit
6 1 (0.031%) Unica
Cloud Services
1 737 (22.76%) Amazon AWS
2 448 (13.84%) Microsoft Azure
3 206 (6.36%) Google Cloud Platform
4 98 (3.03%) Cloud Computing
4 98 (3.03%) GitHub
4 98 (3.03%) SaaS
5 59 (1.82%) Amazon EMR
5 59 (1.82%) PaaS
6 51 (1.58%) Amazon S3
7 42 (1.30%) Amazon Kinesis
7 42 (1.30%) AWS CloudFormation
7 42 (1.30%) IaaS
8 34 (1.05%) Amazon EC2
9 29 (0.90%) Azure Machine Learning
10 24 (0.74%) Amazon CloudWatch
11 19 (0.59%) Azure Data Factory
12 14 (0.43%) Google Analytics
13 13 (0.40%) AWS Lambda
13 13 (0.40%) Serverless
14 10 (0.31%) Datadog
Communications & Networking
1 59 (1.82%) TCP/IP
2 54 (1.67%) Internet
3 51 (1.58%) Firewall
4 44 (1.36%) Kerberos
5 36 (1.11%) SSL
6 31 (0.96%) AMQP
7 27 (0.83%) HTTP
8 22 (0.68%) DNS
9 21 (0.65%) VPN
10 18 (0.56%) SAN
11 17 (0.53%) Network Security
12 16 (0.49%) LDAP
13 14 (0.43%) SMPP
14 13 (0.40%) VLAN
15 9 (0.28%) ICMP
16 7 (0.22%) IPsec
17 4 (0.12%) NAS
18 3 (0.093%) Ethernet
19 2 (0.062%) HTTPS
19 2 (0.062%) SNMP
Database & Business Intelligence
1 2068 (63.87%) Big Data
2 747 (23.07%) NoSQL
3 648 (20.01%) Apache Hive
4 581 (17.94%) MongoDB
5 555 (17.14%) Apache Cassandra
6 471 (14.55%) SQL Server
7 460 (14.21%) Relational Database
8 415 (12.82%) Data Warehouse
9 373 (11.52%) HBase
10 295 (9.11%) MySQL
10 295 (9.11%) RDBMS
11 190 (5.87%) Redis
12 186 (5.74%) PostgreSQL
13 155 (4.79%) Data Mining
14 154 (4.76%) QlikView
15 150 (4.63%) Impala
16 148 (4.57%) SQL Server Integration Services
17 130 (4.01%) Power BI
18 121 (3.74%) SQL Server Reporting Services
19 120 (3.71%) Data Lake
Development Applications
1 289 (8.93%) Jenkins
2 279 (8.62%) Git (software)
3 186 (5.74%) JIRA
4 132 (4.08%) Maven
5 97 (3.00%) JUnit
6 95 (2.93%) Selenium
7 93 (2.87%) Atlassian Bamboo
8 89 (2.75%) Bitbucket
9 75 (2.32%) Cucumber
10 63 (1.95%) Vagrant
11 51 (1.58%) Team Foundation Server
12 50 (1.54%) Eclipse
13 45 (1.39%) Subversion
13 45 (1.39%) Talend Open Studio
14 41 (1.27%) TeamCity
15 34 (1.05%) FitNesse
16 30 (0.93%) IntelliJ
17 26 (0.80%) Gradle
18 24 (0.74%) SQL Server Management Studio (SSMS)
19 23 (0.71%) SonarQube
General
1 817 (25.23%) Finance
2 363 (11.21%) Banking
3 270 (8.34%) Marketing
4 211 (6.52%) Retail
5 195 (6.02%) Investment Banking
6 175 (5.40%) Front Office
7 169 (5.22%) Telecoms
8 137 (4.23%) Manufacturing
9 124 (3.83%) Electronics
10 116 (3.58%) Retail Banking
11 78 (2.41%) Games
12 46 (1.42%) Advertising
13 31 (0.96%) Pharmaceutical
14 24 (0.74%) Law
15 23 (0.71%) Financial Institution
15 23 (0.71%) Legal
15 23 (0.71%) Publishing
16 20 (0.62%) Automotive
17 19 (0.59%) Aerospace
18 10 (0.31%) Military
Job Titles
1 968 (29.89%) Developer
2 505 (15.60%) Java Developer
3 396 (12.23%) Data Engineer
4 342 (10.56%) Data Scientist
5 302 (9.33%) Software Engineer
6 293 (9.05%) Architect
7 264 (8.15%) Big Data Engineer
8 191 (5.90%) Senior Developer
9 174 (5.37%) Big Data Developer
10 163 (5.03%) Data Architect
11 145 (4.48%) Analyst
12 140 (4.32%) Java Engineer
13 131 (4.05%) Hadoop Engineer
14 120 (3.71%) Senior Java Developer
15 115 (3.55%) Consultant
16 102 (3.15%) Python Developer
17 97 (3.00%) Data Manager
17 97 (3.00%) DevOps Engineer
18 92 (2.84%) Lead Developer
18 92 (2.84%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 542 (16.74%) Kafka
2 392 (12.11%) Spring
3 283 (8.74%) AngularJS
4 256 (7.91%) Web Services
5 223 (6.89%) HTML
6 209 (6.45%) Node.js
7 208 (6.42%) Hibernate
8 184 (5.68%) CSS
9 176 (5.44%) REST
10 158 (4.88%) .NET
10 158 (4.88%) RabbitMQ
11 126 (3.89%) RESTful
12 118 (3.64%) React
13 115 (3.55%) HTML5
14 111 (3.43%) Natural Language Processing
15 92 (2.84%) XML
16 88 (2.72%) Elastic Stack
17 86 (2.66%) Apache Camel
18 83 (2.56%) JMS
19 77 (2.38%) J2EE
Miscellaneous
1 523 (16.15%) Analytical Skills
2 363 (11.21%) Computer Science
3 239 (7.38%) Algorithms
4 169 (5.22%) Greenfield Project
5 85 (2.63%) Data Structures
6 80 (2.47%) Fintech
7 62 (1.91%) Data Centre
8 59 (1.82%) Clustering
9 54 (1.67%) Public Cloud
10 50 (1.54%) User Experience
11 46 (1.42%) Enterprise Software
11 46 (1.42%) Mobile App
12 41 (1.27%) Management Information System
13 29 (0.90%) Derivative
14 27 (0.83%) Market Risk
14 27 (0.83%) Social Media
15 26 (0.80%) Foreign Exchange (FX)
15 26 (0.80%) Life Science
16 24 (0.74%) Virtual Team
17 23 (0.71%) PKI
Operating Systems
1 572 (17.67%) Linux
2 206 (6.36%) Windows
3 205 (6.33%) Unix
4 42 (1.30%) Ubuntu
5 34 (1.05%) Android
5 34 (1.05%) Apple iOS
6 31 (0.96%) CentOS
7 23 (0.71%) Red Hat Enterprise Linux
8 20 (0.62%) Windows Server
9 14 (0.43%) Mac OS
10 13 (0.40%) Mac OS X
11 8 (0.25%) AIX
12 4 (0.12%) CoreOS
12 4 (0.12%) Solaris
13 3 (0.093%) VMS
13 3 (0.093%) Windows Server 2012
14 2 (0.062%) Mesosphere
14 2 (0.062%) Windows Server 2008
15 1 (0.031%) Kali Linux
15 1 (0.031%) Windows Server 2003
Processes & Methodologies
1 1325 (40.92%) Agile Software Development
2 1062 (32.80%) Analytics
3 650 (20.07%) Machine Learning
4 631 (19.49%) Software Engineering
5 609 (18.81%) Business Intelligence
6 508 (15.69%) DevOps
7 450 (13.90%) ETL
8 423 (13.06%) Open Source
9 386 (11.92%) Scrum
10 377 (11.64%) Visualisation
11 371 (11.46%) Data Analytics
12 355 (10.96%) Continuous Integration
13 350 (10.81%) TDD
14 333 (10.28%) Test Automation
15 322 (9.94%) BDD
16 290 (8.96%) MapReduce
17 280 (8.65%) OO
18 278 (8.59%) Data Modelling
19 276 (8.52%) Mathematics
20 244 (7.54%) SDLC
Programming Languages
1 1732 (53.49%) Java
2 1536 (47.44%) Python
3 1186 (36.63%) SQL
4 802 (24.77%) Scala
5 490 (15.13%) R
6 420 (12.97%) JavaScript
7 276 (8.52%) C#
8 275 (8.49%) C++
9 219 (6.76%) Bash Shell
10 199 (6.15%) Ruby
11 164 (5.06%) C
12 148 (4.57%) Go
13 130 (4.01%) Perl
14 98 (3.03%) Shell Script
15 93 (2.87%) MATLAB
16 87 (2.69%) PHP
17 73 (2.25%) T-SQL
18 67 (2.07%) PowerShell
19 47 (1.45%) VBA
20 40 (1.24%) Groovy
Qualifications
1 541 (16.71%) Degree
2 252 (7.78%) Security Cleared
3 154 (4.76%) Computer Science Degree
4 136 (4.20%) PhD
5 125 (3.86%) SC Cleared
6 93 (2.87%) DV Cleared
7 65 (2.01%) Master's Degree
8 62 (1.91%) Numerate Degree
9 27 (0.83%) Microsoft Certification
10 23 (0.71%) CISSP
11 22 (0.68%) MBA
12 21 (0.65%) ISEB
13 11 (0.34%) CEH
13 11 (0.34%) Cisco Certification
13 11 (0.34%) GCIH
13 11 (0.34%) OSCP
14 10 (0.31%) MCITP
15 9 (0.28%) GIAC
15 9 (0.28%) Linux+ Certification
15 9 (0.28%) Network+ Certification
Quality Assurance & Compliance
1 142 (4.39%) Data Quality
2 114 (3.52%) QA
3 33 (1.02%) GCP
4 21 (0.65%) GDPR
5 19 (0.59%) ISO/IEC 27001
6 17 (0.53%) Solvency II
7 16 (0.49%) Sarbanes-Oxley
7 16 (0.49%) SLA
8 12 (0.37%) GPG13
9 8 (0.25%) PCI DSS
10 6 (0.19%) Actionable Recommendations
11 2 (0.062%) Government Security Classifications
11 2 (0.062%) NIST 800
12 1 (0.031%) HMG Security Policy Framework
12 1 (0.031%) MiFID
12 1 (0.031%) PMO
System Software
1 400 (12.35%) Docker
2 215 (6.64%) HDFS
3 163 (5.03%) Apache Flume
4 48 (1.48%) VMware Infrastructure
5 38 (1.17%) Apache ZooKeeper
6 18 (0.56%) Virtual Machines
7 17 (0.53%) vSphere
8 16 (0.49%) Varnish
9 15 (0.46%) Active Directory
10 13 (0.40%) Hyper-V
11 11 (0.34%) Snort
12 7 (0.22%) vCloud
13 5 (0.15%) VMware ESXi
14 3 (0.093%) Tivoli Workload Scheduler
14 3 (0.093%) VirtualBox
15 2 (0.062%) MapR-FS
16 1 (0.031%) Cronacle
16 1 (0.031%) Cygwin
16 1 (0.031%) GridGain
16 1 (0.031%) Oracle RAC
Systems Management
1 246 (7.60%) Puppet
2 232 (7.16%) Ansible
3 213 (6.58%) Opscode Chef
4 144 (4.45%) Kubernetes
5 97 (3.00%) Hadoop YARN
6 95 (2.93%) Mesos
7 94 (2.90%) Oozie
8 74 (2.29%) Terraform
9 42 (1.30%) ZABBIX
10 39 (1.20%) Salt
11 37 (1.14%) Cobbler
12 35 (1.08%) Kibana
13 33 (1.02%) logstash
14 30 (0.93%) Ambari
15 21 (0.65%) HAProxy
15 21 (0.65%) Nagios
16 15 (0.46%) Graphite
17 11 (0.34%) Graylog
17 11 (0.34%) Suricata
18 9 (0.28%) ITRS Geneos
Vendors
1 451 (13.93%) Oracle
2 318 (9.82%) Tableau
3 281 (8.68%) Cloudera
4 230 (7.10%) Google
5 218 (6.73%) Microsoft
6 207 (6.39%) SAP
7 155 (4.79%) Hortonworks
8 120 (3.71%) Teradata
9 96 (2.96%) IBM
10 95 (2.93%) Informatica
11 64 (1.98%) Splunk
12 60 (1.85%) MapR
13 52 (1.61%) Cognos
14 51 (1.58%) VMware
15 45 (1.39%) Talend
16 36 (1.11%) TIBCO
17 35 (1.08%) Red Hat
18 34 (1.05%) MicroStrategy
19 31 (0.96%) SaltStack
20 30 (0.93%) HP