Period
to 25 June 2018

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 25 June 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > UK excluding London
6 months to
25 Jun 2018
Same period 2017 Same period 2016
Rank 263 251 304
Rank change year-on-year -12 +53 +206
Permanent jobs citing Hadoop 1,297 1,295 1,212
As % of all permanent IT jobs advertised in the UK excluding London 1.30% 1.31% 1.06%
As % of the Database & Business Intelligence category 4.32% 4.18% 3.46%
Number of salaries quoted 1,007 958 821
UK excluding London median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +5.00%
10th Percentile £36,250 £31,425 £32,500
90th Percentile £81,250 £77,875 £75,000
UK median annual salary £65,000 £65,000 £62,500
% change year-on-year - +4.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 30,055 31,013 35,034
As % of all permanent IT jobs advertised in the UK excluding London 30.16% 31.25% 30.66%
Number of salaries quoted 25,227 26,182 29,495
UK excluding London median annual salary £45,000 £42,500 £41,000
Median salary % change year-on-year +5.88% +3.66% +2.50%
10th Percentile £27,750 £27,000 £26,250
90th Percentile £65,000 £62,500 £62,500
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Hadoop
Job Vacancy Trend in the UK excluding London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Hadoop in the UK excluding London

Hadoop
Salary Trend in the UK excluding London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the UK excluding London.

Salary trend for Hadoop in the UK excluding London

Hadoop
Salary Histogram in the UK excluding London

The salary distribution of IT jobs citing Hadoop in the UK excluding London over the 6 months to 25 June 2018.

Salary histogram for Hadoop in the UK excluding London

Hadoop
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK excluding London region over the 6 months to 25 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East -9 383 £57,500 +2.68% 69
North of England -19 278 £52,500 -4.55% 51
East of England +54 186 £65,000 +18.18% 17
North West -47 175 £55,000 -8.33% 32
Scotland +8 161 £50,000 +25.00% 20
South West -32 151 £50,000 +17.65% 25
Midlands +48 125 £55,000 - 16
Yorkshire +48 90 £51,500 -1.90% 16
East Midlands +55 75 £50,000 -2.44% 9
West Midlands +11 50 £60,000 +9.09% 7
Wales +2 13 £47,400 +35.43% 6
North East -25 13 £35,000 -22.22% 3
Northern Ireland +4 2 - - 1
Hadoop
UK

For the 6 months to 25 June 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Hadoop.

1 723 (55.74%) Big Data
2 671 (51.73%) Java
3 580 (44.72%) Apache Spark
4 576 (44.41%) Agile Software Development
5 571 (44.02%) Python
6 569 (43.87%) SQL
7 416 (32.07%) Analytics
8 316 (24.36%) Apache Hive
9 284 (21.90%) Amazon AWS
10 282 (21.74%) NoSQL
11 276 (21.28%) JavaScript
12 267 (20.59%) Data Science
13 259 (19.97%) Machine Learning
14 258 (19.89%) Scala
15 253 (19.51%) Kafka
15 253 (19.51%) Linux
16 249 (19.20%) Business Intelligence
17 247 (19.04%) Software Engineering
18 246 (18.97%) Docker
19 225 (17.35%) Finance
20 219 (16.89%) Microsoft Azure
21 213 (16.42%) Oracle
22 204 (15.73%) Scrum
23 200 (15.42%) DevOps
24 198 (15.27%) MongoDB
24 198 (15.27%) HTML
25 192 (14.80%) Data Warehouse
26 191 (14.73%) Spring
27 188 (14.49%) TDD
27 188 (14.49%) R

Hadoop
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 580 (44.72%) Apache Spark
2 118 (9.10%) Apache Pig
3 102 (7.86%) SAS
4 80 (6.17%) Elasticsearch
5 72 (5.55%) Apache
6 54 (4.16%) Tomcat
7 53 (4.09%) JBoss
8 43 (3.32%) WebLogic
9 37 (2.85%) Jetty
10 32 (2.47%) Apache Solr
11 17 (1.31%) Confluence
12 13 (1.00%) WebSphere
13 12 (0.93%) Oracle SOA Suite
14 7 (0.54%) BizTalk Server
15 6 (0.46%) CMS
15 6 (0.46%) WildFly
16 4 (0.31%) Apache Geronimo
16 4 (0.31%) GlassFish
16 4 (0.31%) OpenStack
17 3 (0.23%) SharePoint
Applications
1 14 (1.08%) Microsoft Excel
2 13 (1.00%) MS Visio
3 11 (0.85%) Microsoft Office
4 10 (0.77%) Microsoft PowerPoint
5 7 (0.54%) Chatbot
5 7 (0.54%) Microsoft Project
6 4 (0.31%) GNU Octave
6 4 (0.31%) Weka
7 3 (0.23%) SPSS
Business Applications
1 4 (0.31%) Dynamics CRM
1 4 (0.31%) Oracle 11i
1 4 (0.31%) Oracle Assets
1 4 (0.31%) Oracle EBS
1 4 (0.31%) Oracle EBS R12
1 4 (0.31%) Oracle General Ledger
1 4 (0.31%) Oracle iProcurement
1 4 (0.31%) Oracle Payables
1 4 (0.31%) Oracle Receivables
Cloud Services
1 284 (21.90%) Amazon AWS
2 219 (16.89%) Microsoft Azure
3 68 (5.24%) Google Cloud Platform
4 57 (4.39%) Amazon Kinesis
5 54 (4.16%) Amazon EMR
6 53 (4.09%) Amazon S3
7 43 (3.32%) SaaS
8 31 (2.39%) Azure Data Factory
9 30 (2.31%) PaaS
10 25 (1.93%) GitHub
11 22 (1.70%) Cloud Computing
12 20 (1.54%) IaaS
13 16 (1.23%) Adobe Analytics
14 14 (1.08%) Amazon EC2
14 14 (1.08%) Serverless
15 11 (0.85%) Google Analytics
16 9 (0.69%) IBM Cloud
17 7 (0.54%) AWS Lambda
18 6 (0.46%) AWS CloudFormation
19 3 (0.23%) Cortana Intelligence Suite
Communications & Networking
1 28 (2.16%) Firewall
1 28 (2.16%) HTTP
2 22 (1.70%) TCP/IP
3 19 (1.46%) SSL
4 16 (1.23%) SMS
5 12 (0.93%) SSH
6 11 (0.85%) Internet
7 8 (0.62%) Kerberos
7 8 (0.62%) Network Security
8 6 (0.46%) Software-Defined Networking
8 6 (0.46%) VPN
9 5 (0.39%) AMQP
9 5 (0.39%) NAS
9 5 (0.39%) SAN
10 3 (0.23%) Ethernet
10 3 (0.23%) Intrusion Detection
10 3 (0.23%) MPLS
10 3 (0.23%) VLAN
11 2 (0.15%) DNS
11 2 (0.15%) IPsec
Database & Business Intelligence
1 723 (55.74%) Big Data
2 316 (24.36%) Apache Hive
3 282 (21.74%) NoSQL
4 198 (15.27%) MongoDB
5 192 (14.80%) Data Warehouse
6 172 (13.26%) SQL Server
7 150 (11.57%) MySQL
8 143 (11.03%) Impala
8 143 (11.03%) PostgreSQL
9 142 (10.95%) HBase
10 127 (9.79%) Apache Cassandra
11 110 (8.48%) Relational Database
12 101 (7.79%) Sqoop
13 87 (6.71%) Power BI
14 85 (6.55%) Amazon Redshift
15 67 (5.17%) SQL Server Integration Services
16 66 (5.09%) Redis
17 60 (4.63%) Data Lake
18 59 (4.55%) Data Mining
19 57 (4.39%) SQL Server Reporting Services
Development Applications
1 127 (9.79%) Jenkins
2 116 (8.94%) Git (software)
3 92 (7.09%) Maven
4 74 (5.71%) JIRA
5 70 (5.40%) Selenium
6 60 (4.63%) TeamCity
7 48 (3.70%) Cucumber
8 40 (3.08%) JUnit
9 32 (2.47%) Atlassian Bamboo
10 28 (2.16%) Bitbucket
11 24 (1.85%) Octopus Deploy
11 24 (1.85%) Vagrant
12 23 (1.77%) FitNesse
13 21 (1.62%) git-flow
14 20 (1.54%) Visual Studio
15 18 (1.39%) Subversion
16 16 (1.23%) Eclipse
17 15 (1.16%) CodeSonar
17 15 (1.16%) Robot Framework
18 14 (1.08%) Team Foundation Server
General
1 225 (17.35%) Finance
2 105 (8.10%) Retail
3 100 (7.71%) Marketing
4 57 (4.39%) Banking
5 46 (3.55%) Telecoms
6 41 (3.16%) Electronics
7 34 (2.62%) Advertising
8 30 (2.31%) Law
9 29 (2.24%) Manufacturing
10 20 (1.54%) Investment Banking
11 17 (1.31%) Financial Institution
12 16 (1.23%) Automotive
13 13 (1.00%) Games
14 12 (0.93%) Publishing
15 5 (0.39%) Billing
16 3 (0.23%) Back Office
16 3 (0.23%) Pharmaceutical
17 2 (0.15%) General Ledger
17 2 (0.15%) Legal
17 2 (0.15%) Military
Job Titles
1 275 (21.20%) Developer
2 200 (15.42%) Data Engineer
3 187 (14.42%) Architect
4 175 (13.49%) Java Developer
5 135 (10.41%) Data Scientist
6 119 (9.18%) Big Data Engineer
7 107 (8.25%) Data Architect
8 89 (6.86%) Software Engineer
9 88 (6.78%) Java Engineer
10 84 (6.48%) Analyst
11 83 (6.40%) Hadoop Engineer
12 76 (5.86%) Consultant
13 55 (4.24%) Big Data Architect
14 53 (4.09%) Senior Data Engineer
15 51 (3.93%) Java Software Engineer
16 49 (3.78%) Technical Architect
17 41 (3.16%) Solutions Architect
18 39 (3.01%) Senior Hadoop Engineer
19 35 (2.70%) Senior Developer
20 33 (2.54%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 253 (19.51%) Kafka
2 198 (15.27%) HTML
3 191 (14.73%) Spring
4 178 (13.72%) AngularJS
5 142 (10.95%) Hibernate
6 133 (10.25%) .NET
7 96 (7.40%) HTML5
8 88 (6.78%) REST
9 81 (6.25%) Node.js
10 76 (5.86%) TensorFlow
11 67 (5.17%) Web Services
12 61 (4.70%) CSS
13 57 (4.39%) MLlib
14 53 (4.09%) Java EE
15 51 (3.93%) J2EE
16 49 (3.78%) Keras
17 47 (3.62%) SOAP
17 47 (3.62%) XML
18 45 (3.47%) RabbitMQ
18 45 (3.47%) React
Miscellaneous
1 178 (13.72%) Analytical Skills
2 113 (8.71%) Computer Science
3 112 (8.64%) Algorithms
4 85 (6.55%) Enterprise Software
5 69 (5.32%) User Experience
6 52 (4.01%) Data Structures
7 49 (3.78%) Greenfield Project
8 37 (2.85%) Self-Motivation
9 36 (2.78%) Management Information System
10 24 (1.85%) Driving Licence
11 20 (1.54%) Data Centre
11 20 (1.54%) Mobile App
12 19 (1.46%) Clustering
13 15 (1.16%) Virtual Team
14 12 (0.93%) Fintech
15 11 (0.85%) Linux Command Line
15 11 (0.85%) Public Cloud
16 10 (0.77%) Private Cloud
17 9 (0.69%) Hybrid Cloud
17 9 (0.69%) Replication
Operating Systems
1 253 (19.51%) Linux
2 92 (7.09%) Windows
3 60 (4.63%) Unix
4 44 (3.39%) Red Hat Enterprise Linux
5 26 (2.00%) Android
6 22 (1.70%) Apple iOS
7 17 (1.31%) Mac OS X
7 17 (1.31%) Ubuntu
8 16 (1.23%) Debian
9 15 (1.16%) CentOS
9 15 (1.16%) Windows Server
10 13 (1.00%) Mac OS
11 11 (0.85%) Windows Server 2012
12 5 (0.39%) Fedora
13 4 (0.31%) Oracle Linux
13 4 (0.31%) SUSE
14 3 (0.23%) Windows 10
15 2 (0.15%) AIX
15 2 (0.15%) VMS
16 1 (0.077%) HPUX
Processes & Methodologies
1 576 (44.41%) Agile Software Development
2 416 (32.07%) Analytics
3 267 (20.59%) Data Science
4 259 (19.97%) Machine Learning
5 249 (19.20%) Business Intelligence
6 247 (19.04%) Software Engineering
7 204 (15.73%) Scrum
8 200 (15.42%) DevOps
9 188 (14.49%) TDD
10 185 (14.26%) Continuous Integration
11 182 (14.03%) ETL
12 175 (13.49%) Visualisation
13 158 (12.18%) SDLC
14 157 (12.10%) MapReduce
15 147 (11.33%) Problem-Solving
16 130 (10.02%) Open Source
17 129 (9.95%) Data Analytics
18 123 (9.48%) Data Modelling
19 118 (9.10%) Data Analysis
20 112 (8.64%) Data Visualisation
Programming Languages
1 671 (51.73%) Java
2 571 (44.02%) Python
3 569 (43.87%) SQL
4 276 (21.28%) JavaScript
5 258 (19.89%) Scala
6 188 (14.49%) R
7 157 (12.10%) C#
8 120 (9.25%) C++
9 85 (6.55%) PHP
10 82 (6.32%) Bash Shell
10 82 (6.32%) C
11 64 (4.93%) Ruby
12 61 (4.70%) Shell Script
13 60 (4.63%) Go
14 41 (3.16%) PowerShell
15 37 (2.85%) Perl
16 36 (2.78%) HiveQL
17 29 (2.24%) PL/SQL
18 28 (2.16%) Java 8
18 28 (2.16%) T-SQL
Qualifications
1 164 (12.64%) Degree
2 89 (6.86%) Security Cleared
3 52 (4.01%) DV Cleared
4 41 (3.16%) Computer Science Degree
5 28 (2.16%) PhD
6 21 (1.62%) SC Cleared
7 17 (1.31%) Cisco Certification
8 16 (1.23%) CISSP
8 16 (1.23%) Microsoft Certification
9 15 (1.16%) SANS
10 14 (1.08%) CCNA
10 14 (1.08%) CompTIA Security+
10 14 (1.08%) GIAC
10 14 (1.08%) Linux+ Certification
10 14 (1.08%) MCSE
10 14 (1.08%) Network+ Certification
10 14 (1.08%) SSCP
11 11 (0.85%) ISTQB
12 10 (0.77%) Numerate Degree
13 7 (0.54%) AWS Certification
Quality Assurance & Compliance
1 77 (5.94%) QA
2 34 (2.62%) Data Quality
3 19 (1.46%) GCP
4 13 (1.00%) GDPR
5 4 (0.31%) PMO
6 2 (0.15%) SLA
7 1 (0.077%) COBIT
7 1 (0.077%) Dodd-Frank
7 1 (0.077%) EMIR
7 1 (0.077%) FATCA
7 1 (0.077%) MiFID
7 1 (0.077%) Solvency II
System Software
1 246 (18.97%) Docker
2 184 (14.19%) HDFS
3 100 (7.71%) Apache Flume
4 21 (1.62%) Virtual Machines
5 17 (1.31%) vSphere
6 12 (0.93%) Apache ZooKeeper
7 9 (0.69%) Active Directory
8 8 (0.62%) VMware Infrastructure
9 6 (0.46%) Virtual Desktop
10 4 (0.31%) Hyper-V
11 2 (0.15%) vCloud
12 1 (0.077%) Samba
12 1 (0.077%) VirtualBox
Systems Management
1 159 (12.26%) Puppet
2 153 (11.80%) Ansible
3 76 (5.86%) Opscode Chef
4 75 (5.78%) Hadoop YARN
5 61 (4.70%) Kubernetes
6 55 (4.24%) Oozie
7 24 (1.85%) Cobbler
8 22 (1.70%) Terraform
9 16 (1.23%) Salt
10 15 (1.16%) Kibana
11 7 (0.54%) Ambari
12 6 (0.46%) Systems Management Server (SMS)
13 5 (0.39%) logstash
13 5 (0.39%) Marathon
13 5 (0.39%) Single Sign-On
14 4 (0.31%) Docker Swarm
14 4 (0.31%) Mesos
14 4 (0.31%) Prometheus
15 3 (0.23%) Oracle RMAN
15 3 (0.23%) Red Hat Spacewalk
Vendors
1 213 (16.42%) Oracle
2 153 (11.80%) Microsoft
3 148 (11.41%) Cloudera
4 147 (11.33%) Tableau
5 88 (6.78%) Google
6 75 (5.78%) Hortonworks
7 64 (4.93%) SAP
8 59 (4.55%) Talend
9 43 (3.32%) Informatica
10 40 (3.08%) Teradata
11 35 (2.70%) Alteryx
12 32 (2.47%) Atlassian
12 32 (2.47%) Red Hat
13 24 (1.85%) MicroStrategy
14 22 (1.70%) MapR
15 21 (1.62%) IBM
16 19 (1.46%) Adobe
17 18 (1.39%) Capita
18 13 (1.00%) Splunk
18 13 (1.00%) VMware