Period
to 24 January 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 24 January 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
24 Jan 2019
Same period 2018 Same period 2017
Rank 184 196 198
Rank change year-on-year +12 +2 +16
Permanent jobs citing Hadoop 2,787 3,063 3,137
As % of all permanent IT jobs advertised in the UK 1.84% 1.76% 1.77%
As % of the Database & Business Intelligence category 6.41% 5.76% 5.92%
Number of salaries quoted 2,072 2,374 2,598
UK median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% -3.85%
10th Percentile £42,000 £39,500 £40,000
90th Percentile £100,000 £100,000 £95,000
UK excluding London median annual salary £60,000 £51,945 £52,500
% change year-on-year +15.51% -1.06% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 43,456 53,206 53,001
As % of all permanent IT jobs advertised in the UK 28.64% 30.54% 29.92%
Number of salaries quoted 35,725 44,172 45,405
UK median annual salary £52,500 £48,000 £47,500
Median salary % change year-on-year +9.38% +1.05% +5.56%
10th Percentile £31,250 £30,000 £29,250
90th Percentile £85,000 £77,500 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +3.66%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 24 January 2019.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 24 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +16 2,639 £70,000 +7.69% 428
London -8 1,608 £75,000 +7.14% 235
UK excluding London +39 1,141 £60,000 +15.51% 208
South East +51 342 £61,250 +3.81% 69
North of England +34 228 £60,000 +14.29% 37
South West +11 181 £55,000 +30.95% 44
Midlands +90 146 £62,500 +47.06% 27
North West -13 131 £65,000 +22.35% 19
East of England -3 122 £67,500 +12.50% 16
Scotland +8 118 £55,000 +10.00% 13
East Midlands +64 87 £70,000 +64.71% 14
Yorkshire +63 82 £50,500 +1.00% 15
West Midlands +63 59 £47,500 +11.76% 13
North East +21 19 £60,000 +29.03% 3
Wales -6 3 £24,000 -54.37%
Channel Islands - 1 £37,500 -

For the 6 months to 24 January 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 1,818 (65.23%) Big Data
2 1,590 (57.05%) Python
3 1,583 (56.80%) Apache Spark
4 1,450 (52.03%) Java
5 1,282 (46.00%) Agile Software Development
6 1,077 (38.64%) SQL
7 937 (33.62%) Amazon AWS
8 906 (32.51%) NoSQL
9 905 (32.47%) Kafka
10 870 (31.22%) Analytics
11 834 (29.92%) Apache Hive
12 761 (27.31%) Scala
13 741 (26.59%) Machine Learning
14 692 (24.83%) Data Science
15 631 (22.64%) Finance
16 598 (21.46%) Software Engineering
17 595 (21.35%) Microsoft Azure
18 575 (20.63%) DevOps
19 542 (19.45%) Data Modelling
20 535 (19.20%) ETL
21 488 (17.51%) Linux
22 486 (17.44%) HBase
23 468 (16.79%) Degree
24 463 (16.61%) Apache Cassandra
25 429 (15.39%) Apache
26 424 (15.21%) Business Intelligence
27 418 (15.00%) Oracle
28 400 (14.35%) Data Warehouse
28 400 (14.35%) Data Engineering
29 397 (14.24%) Cloudera

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,583 (56.80%) Apache Spark
2 429 (15.39%) Apache
3 325 (11.66%) Elasticsearch
4 230 (8.25%) Apache Pig
5 191 (6.85%) SAS
6 106 (3.80%) Apache Solr
7 57 (2.05%) Tomcat
8 44 (1.58%) JBoss
9 32 (1.15%) Confluence
9 32 (1.15%) GlassFish
10 30 (1.08%) SharePoint
11 25 (0.90%) Apache Airflow
11 25 (0.90%) WebSphere
12 19 (0.68%) CMS
13 18 (0.65%) Jetty
13 18 (0.65%) nginx
14 15 (0.54%) IIS
14 15 (0.54%) WebLogic
15 14 (0.50%) MS Exchange
15 14 (0.50%) Oracle SOA Suite
Applications
1 29 (1.04%) SPSS
2 21 (0.75%) Microsoft Office
3 16 (0.57%) Microsoft Excel
4 13 (0.47%) Weka
5 12 (0.43%) Chatbot
6 10 (0.36%) MS Visio
7 9 (0.32%) Stata
8 7 (0.25%) Microsoft PowerPoint
9 4 (0.14%) GNU Octave
9 4 (0.14%) Maple
10 2 (0.072%) S-PLUS
11 1 (0.036%) CPLEX
11 1 (0.036%) InVision
11 1 (0.036%) Microsoft Project
11 1 (0.036%) Photoshop
Business Applications
1 2 (0.072%) Dynamics CRM
1 2 (0.072%) Oracle EBS
1 2 (0.072%) SAP ERP
1 2 (0.072%) SAP InfiniteInsight
2 1 (0.036%) Dynamics AX
2 1 (0.036%) Dynamics NAV
2 1 (0.036%) Magento
Cloud Services
1 937 (33.62%) Amazon AWS
2 595 (21.35%) Microsoft Azure
3 334 (11.98%) Google Cloud Platform
4 140 (5.02%) Amazon EMR
5 115 (4.13%) Cloud Computing
6 109 (3.91%) GitHub
7 86 (3.09%) Amazon EC2
8 73 (2.62%) Serverless
9 67 (2.40%) SaaS
10 64 (2.30%) PaaS
11 61 (2.19%) Amazon S3
12 54 (1.94%) AWS Lambda
13 37 (1.33%) IaaS
14 34 (1.22%) AWS CloudFormation
15 29 (1.04%) Google Analytics
16 28 (1.00%) Azure Data Factory
17 25 (0.90%) Cortana Intelligence Suite
18 24 (0.86%) Amazon Kinesis
19 23 (0.83%) Amazon SQS
20 20 (0.72%) Office 365
Communications & Networking
1 68 (2.44%) Internet
2 41 (1.47%) HTTP
3 40 (1.44%) Firewall
4 37 (1.33%) TCP/IP
5 30 (1.08%) SSL
6 21 (0.75%) Kerberos
7 19 (0.68%) SAN
8 15 (0.54%) DNS
9 8 (0.29%) Software-Defined Networking
10 7 (0.25%) MQTT
10 7 (0.25%) VoIP
10 7 (0.25%) VPN
10 7 (0.25%) WAN
11 6 (0.22%) LAN
11 6 (0.22%) Sourcefire
12 5 (0.18%) FCoE
12 5 (0.18%) NAS
12 5 (0.18%) Network Security
13 4 (0.14%) PABX
13 4 (0.14%) SNMP
Database & Business Intelligence
1 1,818 (65.23%) Big Data
2 906 (32.51%) NoSQL
3 834 (29.92%) Apache Hive
4 486 (17.44%) HBase
5 463 (16.61%) Apache Cassandra
6 400 (14.35%) Data Warehouse
7 370 (13.28%) MongoDB
8 343 (12.31%) SQL Server
9 263 (9.44%) Amazon Redshift
9 263 (9.44%) Impala
10 249 (8.93%) MySQL
11 231 (8.29%) Relational Database
12 230 (8.25%) PostgreSQL
13 213 (7.64%) Data Lake
14 195 (7.00%) Flink
15 190 (6.82%) Power BI
16 136 (4.88%) SQL Server Integration Services
16 136 (4.88%) Sqoop
17 129 (4.63%) RDBMS
18 110 (3.95%) Redis
Development Applications
1 258 (9.26%) Git (software)
2 203 (7.28%) Jenkins
3 170 (6.10%) JIRA
4 127 (4.56%) Maven
5 85 (3.05%) Selenium
6 67 (2.40%) Visual Studio
7 55 (1.97%) Atlassian Bamboo
8 47 (1.69%) Gradle
9 45 (1.61%) Bitbucket
9 45 (1.61%) JUnit
10 42 (1.51%) JMeter
11 41 (1.47%) Team Foundation Server
12 33 (1.18%) EasyMock
13 32 (1.15%) TeamCity
14 31 (1.11%) SoapUI
14 31 (1.11%) Subversion
15 29 (1.04%) Ant
15 29 (1.04%) Cucumber
16 26 (0.93%) Visual Studio Team System
17 22 (0.79%) ERwin
General
1 631 (22.64%) Finance
2 250 (8.97%) Banking
3 219 (7.86%) Retail
4 182 (6.53%) Law
5 180 (6.46%) Telecoms
6 156 (5.60%) Marketing
7 148 (5.31%) Military
8 75 (2.69%) Investment Banking
9 62 (2.22%) Games
10 40 (1.44%) Manufacturing
11 33 (1.18%) Advertising
12 29 (1.04%) Automotive
12 29 (1.04%) Front Office
13 24 (0.86%) Electronics
14 23 (0.83%) Financial Institution
15 19 (0.68%) Retail Banking
16 16 (0.57%) Corporate Banking
17 14 (0.50%) Pharmaceutical
18 8 (0.29%) Billing
18 8 (0.29%) Publishing
Job Titles
1 660 (23.68%) Data Engineer
2 592 (21.24%) Developer
3 417 (14.96%) Architect
4 377 (13.53%) Big Data Engineer
5 278 (9.97%) Data Architect
6 258 (9.26%) Java Developer
7 244 (8.75%) Data Scientist
8 232 (8.32%) Software Engineer
9 150 (5.38%) Hadoop Engineer
10 132 (4.74%) Consultant
11 128 (4.59%) Senior Data Engineer
11 128 (4.59%) Senior Developer
12 125 (4.49%) Java Engineer
13 115 (4.13%) Big Data Developer
13 115 (4.13%) Python Engineer
14 111 (3.98%) Analyst
15 106 (3.80%) Big Data Architect
16 105 (3.77%) Senior Data Scientist
17 81 (2.91%) Java Software Engineer
18 75 (2.69%) Solutions Architect
Libraries, Frameworks & Software Standards
1 905 (32.47%) Kafka
2 257 (9.22%) Spring
3 249 (8.93%) Web Services
4 200 (7.18%) HTML
5 194 (6.96%) AngularJS
6 183 (6.57%) .NET
7 172 (6.17%) Node.js
8 160 (5.74%) REST
9 156 (5.60%) Spark Streaming
10 154 (5.53%) Hibernate
11 129 (4.63%) Natural Language Processing
12 122 (4.38%) React
12 122 (4.38%) RESTful
13 105 (3.77%) TensorFlow
14 100 (3.59%) RabbitMQ
15 97 (3.48%) CSS
16 95 (3.41%) HTML5
17 93 (3.34%) JSON
18 85 (3.05%) Apache NiFi
19 84 (3.01%) SOAP
Miscellaneous
1 269 (9.65%) Algorithms
2 265 (9.51%) Analytical Skills
3 135 (4.84%) Data Structures
4 110 (3.95%) Fintech
5 87 (3.12%) Greenfield Project
6 69 (2.48%) Enterprise Software
7 62 (2.22%) Self-Motivation
8 58 (2.08%) Management Information System
8 58 (2.08%) User Experience
9 52 (1.87%) Social Network
10 38 (1.36%) Social Media
10 38 (1.36%) Virtual Team
11 37 (1.33%) Public Cloud
12 36 (1.29%) Video on Demand
13 33 (1.18%) Clustering
14 31 (1.11%) Linux Command Line
15 28 (1.00%) Cloud Native
16 26 (0.93%) Equities
16 26 (0.93%) Robotics
17 25 (0.90%) Derivative
Operating Systems
1 488 (17.51%) Linux
2 242 (8.68%) Unix
3 154 (5.53%) Windows
4 63 (2.26%) Android
5 55 (1.97%) Apple iOS
6 50 (1.79%) Red Hat Enterprise Linux
7 38 (1.36%) CentOS
8 32 (1.15%) Windows Server
9 22 (0.79%) Ubuntu
10 20 (0.72%) Mac OS X
11 9 (0.32%) Windows 7
11 9 (0.32%) Windows 8
12 8 (0.29%) VMS
12 8 (0.29%) Windows Server 2008
13 6 (0.22%) Oracle Linux
13 6 (0.22%) Solaris
14 4 (0.14%) HPUX
14 4 (0.14%) Windows Mobile
14 4 (0.14%) zOS
15 3 (0.11%) SUSE
Processes & Methodologies
1 1,282 (46.00%) Agile Software Development
2 870 (31.22%) Analytics
3 741 (26.59%) Machine Learning
4 692 (24.83%) Data Science
5 598 (21.46%) Software Engineering
6 575 (20.63%) DevOps
7 542 (19.45%) Data Modelling
8 535 (19.20%) ETL
9 424 (15.21%) Business Intelligence
10 400 (14.35%) Data Engineering
11 375 (13.46%) Scrum
12 367 (13.17%) Visualisation
13 360 (12.92%) Artificial Intelligence
14 337 (12.09%) Open Source
15 330 (11.84%) Computer Science
16 329 (11.80%) Data Analytics
17 292 (10.48%) TDD
18 265 (9.51%) Data Analysis
19 260 (9.33%) Mathematics
20 241 (8.65%) MapReduce
Programming Languages
1 1,590 (57.05%) Python
2 1,450 (52.03%) Java
3 1,077 (38.64%) SQL
4 761 (27.31%) Scala
5 339 (12.16%) R
6 334 (11.98%) JavaScript
7 281 (10.08%) C#
8 218 (7.82%) C++
9 131 (4.70%) C
10 130 (4.66%) Java 8
11 126 (4.52%) Bash Shell
12 116 (4.16%) PHP
13 85 (3.05%) Ruby
14 80 (2.87%) Perl
15 79 (2.83%) PowerShell
15 79 (2.83%) T-SQL
16 78 (2.80%) Shell Script
17 53 (1.90%) PL/SQL
18 49 (1.76%) Go
19 43 (1.54%) Objective-C
Qualifications
1 468 (16.79%) Degree
2 182 (6.53%) Computer Science Degree
3 163 (5.85%) Security Cleared
4 84 (3.01%) DV Cleared
5 76 (2.73%) Numerate Degree
6 57 (2.05%) PhD
6 57 (2.05%) SC Cleared
7 51 (1.83%) Master's Degree
8 39 (1.40%) CISSP
9 23 (0.83%) Microsoft Certification
10 21 (0.75%) CCNA
10 21 (0.75%) Cisco Certification
10 21 (0.75%) CompTIA Security+
10 21 (0.75%) GIAC
10 21 (0.75%) Linux+ Certification
10 21 (0.75%) MCSE
10 21 (0.75%) Network+ Certification
10 21 (0.75%) SANS
10 21 (0.75%) SSCP
11 17 (0.61%) BPSS Clearance
Quality Assurance & Compliance
1 128 (4.59%) QA
2 126 (4.52%) Data Quality
3 61 (2.19%) GDPR
4 28 (1.00%) ISO/IEC 27001
5 17 (0.61%) MiFID
6 13 (0.47%) PMO
6 13 (0.47%) SLA
7 10 (0.36%) IFRS
8 9 (0.32%) PCI DSS
9 6 (0.22%) GxP
9 6 (0.22%) Solvency II
10 4 (0.14%) PA-DSS
11 3 (0.11%) Basel III
11 3 (0.11%) COBIT
11 3 (0.11%) GPG13
12 2 (0.072%) COREP
12 2 (0.072%) CRD IV
12 2 (0.072%) EMIR
System Software
1 304 (10.91%) Docker
2 266 (9.54%) HDFS
3 183 (6.57%) Apache Flume
4 102 (3.66%) Apache ZooKeeper
5 36 (1.29%) Active Directory
6 20 (0.72%) vSphere
7 19 (0.68%) Virtual Machines
8 15 (0.54%) VirtualBox
9 9 (0.32%) Hyper-V
10 8 (0.29%) VMware Infrastructure
11 7 (0.25%) Oracle RAC
11 7 (0.25%) Virtual Desktop
12 6 (0.22%) Snort
13 5 (0.18%) NFS
13 5 (0.18%) Samba
14 4 (0.14%) VMware ESXi
14 4 (0.14%) VMware NSX
15 3 (0.11%) GFS2
15 3 (0.11%) XenApp
16 1 (0.036%) SRDF
Systems Management
1 206 (7.39%) Oozie
2 191 (6.85%) Hadoop YARN
3 178 (6.39%) Ansible
4 176 (6.32%) Puppet
5 141 (5.06%) Kubernetes
6 108 (3.88%) Terraform
7 80 (2.87%) Opscode Chef
8 68 (2.44%) Kibana
9 42 (1.51%) Mesos
10 39 (1.40%) logstash
11 35 (1.26%) Ambari
12 30 (1.08%) Salt
13 27 (0.97%) Prometheus
14 22 (0.79%) Nagios
15 20 (0.72%) Grafana
16 15 (0.54%) Docker Swarm
17 7 (0.25%) Oracle ZFS
18 6 (0.22%) QRadar
18 6 (0.22%) Suricata
19 5 (0.18%) ITRS Geneos
Vendors
1 418 (15.00%) Oracle
2 397 (14.24%) Cloudera
3 388 (13.92%) Tableau
4 300 (10.76%) Google
5 291 (10.44%) Microsoft
6 278 (9.97%) Hortonworks
7 135 (4.84%) SAP
8 131 (4.70%) MapR
9 121 (4.34%) Informatica
10 107 (3.84%) Databricks
11 98 (3.52%) IBM
12 88 (3.16%) Talend
13 79 (2.83%) Teradata
14 63 (2.26%) Splunk
15 59 (2.12%) Red Hat
16 51 (1.83%) CA Agile Central
17 43 (1.54%) TIBCO
18 41 (1.47%) WorldPay
19 38 (1.36%) Alteryx
20 37 (1.33%) Ab Initio