Period
to 5 August 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 5 August 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
5 Aug 2020
Same period 2019 Same period 2018
Rank 234 202 185
Rank change year-on-year -32 -17 +22
Permanent jobs citing Hadoop 949 2,482 3,240
As % of all permanent jobs advertised in the UK 1.44% 1.74% 1.89%
As % of the Database & Business Intelligence category 5.26% 6.34% 6.25%
Number of salaries quoted 676 1,953 2,520
Median annual salary £72,500 £70,000 £65,000
Median salary % change year-on-year +3.57% +7.69% +4.00%
10th Percentile £45,000 £45,000 £38,700
90th Percentile £111,875 £107,500 £97,500
UK excluding London median annual salary £63,750 £56,500 £55,000
% change year-on-year +12.83% +2.73% +4.76%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 18,043 39,161 51,879
As % of all permanent IT jobs advertised in the UK 27.31% 27.39% 30.26%
Number of salaries quoted 14,674 32,142 42,275
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +5.26%
10th Percentile £32,500 £31,250 £31,250
90th Percentile £88,750 £85,000 £82,500
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 5 August 2020.

Salary histogram for Hadoop in the UK

Hadoop
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 5 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -35 870 £73,000 +4.29% 120
London -36 576 £75,000 -6.25% 69
UK excluding London +15 369 £63,750 +12.83% 71
South East +51 124 £67,500 +17.39% 12
Midlands +33 60 £70,000 +16.67% 18
South West -52 49 £55,000 - 3
Scotland +59 47 £55,000 - 20
Work from Home +10 46 £75,000 +25.00% 22
North of England +85 42 £55,000 +4.76% 14
East Midlands +19 41 £75,000 +27.66% 16
North West +83 25 £55,000 -4.35% 5
Wales +59 24 £45,000 +15.38%
East of England +78 22 £70,000 - 4
West Midlands +53 19 £53,750 -10.42% 2
Yorkshire +74 11 £60,000 +20.00% 8
North East +21 6 £57,500 +5.50% 1
Northern Ireland +22 1 - -

For the 6 months to 5 August 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 591 (62.28%) Apache Spark
2 577 (60.80%) Big Data
3 566 (59.64%) Python
4 485 (51.11%) Java
5 381 (40.15%) AWS
6 376 (39.62%) SQL
7 366 (38.57%) Analytics
8 361 (38.04%) Agile Software Development
9 309 (32.56%) Azure
10 305 (32.14%) Kafka
11 259 (27.29%) Finance
12 254 (26.77%) Data Science
13 253 (26.66%) NoSQL
14 235 (24.76%) Apache Hive
15 230 (24.24%) Machine Learning
15 230 (24.24%) Scala
16 227 (23.92%) DevOps
17 223 (23.50%) Degree
18 215 (22.66%) Software Engineering
19 181 (19.07%) R
20 179 (18.86%) MongoDB
20 179 (18.86%) ETL
21 175 (18.44%) Data Analytics
22 162 (17.07%) Apache Cassandra
23 160 (16.86%) Linux
24 157 (16.54%) SQL Server
25 153 (16.12%) Docker
26 150 (15.81%) JavaScript
27 148 (15.60%) GCP
28 146 (15.38%) Business Intelligence

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 591 (62.28%) Apache Spark
2 115 (12.12%) Apache
3 68 (7.17%) Elasticsearch
4 65 (6.85%) SAS
5 30 (3.16%) Apache Airflow
6 25 (2.63%) Jupyter
7 23 (2.42%) Confluence
8 21 (2.21%) Apache Solr
9 20 (2.11%) Tomcat
10 19 (2.00%) Luigi
11 18 (1.90%) Apache Pig
12 14 (1.48%) CMS
13 11 (1.16%) Cloud Foundry
14 9 (0.95%) Mule
15 8 (0.84%) Oracle Coherence
15 8 (0.84%) SharePoint
16 7 (0.74%) JBoss
17 6 (0.63%) OpenStack
17 6 (0.63%) Tornado
18 5 (0.53%) IBM Domino
Applications
1 13 (1.37%) Microsoft Excel
2 3 (0.32%) Microsoft Office
3 2 (0.21%) Microsoft PowerPoint
3 2 (0.21%) MS Visio
3 2 (0.21%) SPSS
4 1 (0.11%) Chatbot
4 1 (0.11%) Gephi
Business Applications
1 6 (0.63%) SAP ERP
2 5 (0.53%) SAP CRM
2 5 (0.53%) SAP IS-U
3 4 (0.42%) Eikon
4 1 (0.11%) ENOVIA
4 1 (0.11%) SAP BPC
4 1 (0.11%) SAP Hybris
4 1 (0.11%) SAP InfiniteInsight
Cloud Services
1 381 (40.15%) AWS
2 309 (32.56%) Azure
3 148 (15.60%) GCP
4 94 (9.91%) Power Platform
5 62 (6.53%) Amazon EMR
6 38 (4.00%) Amazon S3
7 35 (3.69%) Azure Data Factory
8 33 (3.48%) Amazon EC2
9 32 (3.37%) SaaS
10 22 (2.32%) PaaS
11 20 (2.11%) Amazon Kinesis
11 20 (2.11%) Serverless
12 17 (1.79%) IaaS
13 15 (1.58%) Cloud Computing
14 14 (1.48%) IBM Cloud
15 13 (1.37%) Logic Apps
16 12 (1.26%) Amazon SQS
17 11 (1.16%) Azure Machine Learning
18 9 (0.95%) AWS Lambda
19 7 (0.74%) Cortana Intelligence Suite
Communications & Networking
1 23 (2.42%) HTTP
2 12 (1.26%) FTP
3 11 (1.16%) Kerberos
3 11 (1.16%) TCP/IP
4 7 (0.74%) SSH
4 7 (0.74%) SSL
5 6 (0.63%) DSL
6 5 (0.53%) 5G
6 5 (0.53%) Firewall
7 4 (0.42%) Internet
8 3 (0.32%) Modbus
8 3 (0.32%) MQTT
8 3 (0.32%) Network Security
8 3 (0.32%) Profibus
8 3 (0.32%) RS-232
8 3 (0.32%) RS-485
9 2 (0.21%) HTTPS
10 1 (0.11%) DHCP
10 1 (0.11%) DNS
10 1 (0.11%) Intrusion Detection
Database & Business Intelligence
1 577 (60.80%) Big Data
2 253 (26.66%) NoSQL
3 235 (24.76%) Apache Hive
4 179 (18.86%) MongoDB
5 162 (17.07%) Apache Cassandra
6 157 (16.54%) SQL Server
7 133 (14.01%) HBase
8 131 (13.80%) Data Warehouse
9 104 (10.96%) Amazon Redshift
10 94 (9.91%) Power BI
11 77 (8.11%) Data Lake
11 77 (8.11%) Impala
12 71 (7.48%) PostgreSQL
13 66 (6.95%) Data Mining
14 65 (6.85%) Relational Database
15 54 (5.69%) Flink
16 51 (5.37%) MySQL
17 39 (4.11%) SQL Server Reporting Services
18 38 (4.00%) BusinessObjects
18 38 (4.00%) Neo4j
Development Applications
1 111 (11.70%) Git (software)
2 92 (9.69%) Jenkins
3 39 (4.11%) Atlassian Bamboo
4 32 (3.37%) JIRA
5 24 (2.53%) JUnit
5 24 (2.53%) Maven
6 22 (2.32%) Bitbucket
7 21 (2.21%) Cucumber
8 18 (1.90%) Artifactory
9 17 (1.79%) Vagrant
10 15 (1.58%) Sonatype Nexus
10 15 (1.58%) TeamCity
11 7 (0.74%) GoCD
12 6 (0.63%) ER Studio
12 6 (0.63%) ERwin
12 6 (0.63%) GitLab
12 6 (0.63%) Octopus Deploy
12 6 (0.63%) PowerDesigner
12 6 (0.63%) RStudio
13 5 (0.53%) Ant
General
1 259 (27.29%) Finance
2 97 (10.22%) Banking
3 59 (6.22%) Retail
4 45 (4.74%) Marketing
5 39 (4.11%) Front Office
6 29 (3.06%) Investment Banking
6 29 (3.06%) Manufacturing
7 22 (2.32%) Telecoms
8 19 (2.00%) Public Sector
9 13 (1.37%) Aerospace
10 12 (1.26%) Advertising
11 11 (1.16%) Games
12 7 (0.74%) Financial Institution
13 5 (0.53%) Military
13 5 (0.53%) Pharmaceutical
13 5 (0.53%) Retail Banking
14 4 (0.42%) Electronics
15 3 (0.32%) Automotive
15 3 (0.32%) Legal
16 2 (0.21%) Publishing
Job Titles
1 259 (27.29%) Data Engineer
2 224 (23.60%) Developer
3 113 (11.91%) Architect
4 100 (10.54%) Java Developer
5 85 (8.96%) Data Scientist
6 81 (8.54%) Data Architect
7 79 (8.32%) Big Data Engineer
8 63 (6.64%) Software Engineer
9 49 (5.16%) Senior Developer
10 42 (4.43%) Python Engineer
11 41 (4.32%) Consultant
11 41 (4.32%) Senior Data Engineer
12 39 (4.11%) Senior Data Scientist
13 38 (4.00%) AWS Engineer
14 32 (3.37%) Big Data Architect
14 32 (3.37%) Hadoop Engineer
15 29 (3.06%) DevOps Engineer
16 26 (2.74%) Platform Engineer
16 26 (2.74%) Solutions Architect
17 23 (2.42%) Scala Developer
Libraries, Frameworks & Software Standards
1 305 (32.14%) Kafka
2 89 (9.38%) Spring
3 76 (8.01%) React
4 69 (7.27%) AngularJS
5 66 (6.95%) Node.js
5 66 (6.95%) Web Services
6 61 (6.43%) .NET
7 59 (6.22%) Natural Language Processing
8 58 (6.11%) HTML
9 49 (5.16%) REST
10 47 (4.95%) Spring Boot
11 45 (4.74%) TensorFlow
12 44 (4.64%) Spark Streaming
13 42 (4.43%) scikit-learn
14 38 (4.00%) JMS
15 36 (3.79%) NumPy
16 33 (3.48%) Pandas
17 30 (3.16%) HTML5
18 26 (2.74%) RabbitMQ
18 26 (2.74%) XML
Miscellaneous
1 97 (10.22%) Analytical Skills
2 79 (8.32%) Algorithms
3 40 (4.21%) Hedge funds
4 38 (4.00%) Greenfield Project
5 33 (3.48%) Data Structures
5 33 (3.48%) Management Information System
6 30 (3.16%) Equities
6 30 (3.16%) Self-Motivation
7 25 (2.63%) Hybrid Cloud
8 23 (2.42%) Blog
8 23 (2.42%) Enterprise Software
9 20 (2.11%) Cloud Native
10 16 (1.69%) Virtual Team
11 15 (1.58%) Acoustics
11 15 (1.58%) Market Risk
11 15 (1.58%) User Experience
12 14 (1.48%) Data Centre
12 14 (1.48%) Linux Command Line
13 11 (1.16%) FMCG
13 11 (1.16%) Mobile App
Operating Systems
1 160 (16.86%) Linux
2 89 (9.38%) Unix
3 34 (3.58%) Windows
4 20 (2.11%) Red Hat Enterprise Linux
5 10 (1.05%) CentOS
6 6 (0.63%) Android
6 6 (0.63%) Apple iOS
7 2 (0.21%) Windows Server
8 1 (0.11%) Debian
8 1 (0.11%) Ubuntu
Processes & Methodologies
1 366 (38.57%) Analytics
2 361 (38.04%) Agile Software Development
3 254 (26.77%) Data Science
4 230 (24.24%) Machine Learning
5 227 (23.92%) DevOps
6 215 (22.66%) Software Engineering
7 179 (18.86%) ETL
8 175 (18.44%) Data Analytics
9 146 (15.38%) Business Intelligence
9 146 (15.38%) Computer Science
10 141 (14.86%) Microservices
11 140 (14.75%) Data Modelling
12 129 (13.59%) Artificial Intelligence
13 107 (11.28%) Visualisation
14 105 (11.06%) Scrum
15 104 (10.96%) TDD
16 96 (10.12%) Mathematics
17 87 (9.17%) Mentoring
18 84 (8.85%) Data Engineering
19 83 (8.75%) Data Analysis
Programming Languages
1 566 (59.64%) Python
2 485 (51.11%) Java
3 376 (39.62%) SQL
4 230 (24.24%) Scala
5 181 (19.07%) R
6 150 (15.81%) JavaScript
7 100 (10.54%) C#
8 83 (8.75%) C++
9 58 (6.11%) Bash Shell
10 48 (5.06%) Java 8
11 33 (3.48%) Go
12 31 (3.27%) PL/SQL
13 30 (3.16%) C
13 30 (3.16%) Shell Script
14 27 (2.85%) HiveQL
15 25 (2.63%) Ruby
16 21 (2.21%) PHP
16 21 (2.21%) PowerShell
17 15 (1.58%) Perl
18 14 (1.48%) Kotlin
Qualifications
1 223 (23.50%) Degree
2 109 (11.49%) Computer Science Degree
3 68 (7.17%) Security Cleared
4 44 (4.64%) DV Cleared
5 42 (4.43%) SC Cleared
6 27 (2.85%) Master's Degree
7 23 (2.42%) PhD
8 16 (1.69%) BPSS Clearance
9 13 (1.37%) Numerate Degree
10 8 (0.84%) TOGAF Certification
11 7 (0.74%) Microsoft Certification
12 5 (0.53%) AWS Certification
13 4 (0.42%) PMI Certification
14 3 (0.32%) MBA
15 2 (0.21%) ISTQB
16 1 (0.11%) HND
Quality Assurance & Compliance
1 37 (3.90%) Data Quality
2 14 (1.48%) QA
3 11 (1.16%) GDPR
3 11 (1.16%) Sarbanes-Oxley
4 7 (0.74%) SLA
5 6 (0.63%) ISO/IEC 27001
6 1 (0.11%) Actionable Recommendations
6 1 (0.11%) Basel III
6 1 (0.11%) COREP
6 1 (0.11%) CRD IV
6 1 (0.11%) IFRS
6 1 (0.11%) IFRS 9
System Software
1 153 (16.12%) Docker
2 87 (9.17%) HDFS
3 52 (5.48%) Apache ZooKeeper
4 27 (2.85%) VMware Infrastructure
5 17 (1.79%) VirtualBox
6 11 (1.16%) Apache Flume
7 10 (1.05%) Hyper-V
8 7 (0.74%) Active Directory
9 6 (0.63%) Samba
10 4 (0.42%) Varnish
11 3 (0.32%) Microsoft Virtual Server
11 3 (0.32%) Virtual Servers
11 3 (0.32%) vSphere
12 1 (0.11%) Virtual Machines
Systems Management
1 127 (13.38%) Kubernetes
2 102 (10.75%) Ansible
3 42 (4.43%) Terraform
4 32 (3.37%) Puppet
5 30 (3.16%) Hadoop YARN
6 18 (1.90%) Kibana
7 17 (1.79%) Docker Swarm
8 14 (1.48%) Opscode Chef
9 12 (1.26%) Oozie
9 12 (1.26%) Salt
10 8 (0.84%) Ambari
10 8 (0.84%) SCCM
10 8 (0.84%) vRealize Orchestrator
11 6 (0.63%) logstash
12 5 (0.53%) Prometheus
13 4 (0.42%) Nagios
13 4 (0.42%) Single Sign-On
14 3 (0.32%) Cobbler
14 3 (0.32%) Mesos
14 3 (0.32%) ZABBIX
Vendors
1 114 (12.01%) Oracle
2 104 (10.96%) Tableau
3 94 (9.91%) Cloudera
4 88 (9.27%) Google
5 74 (7.80%) Microsoft
6 50 (5.27%) Databricks
7 49 (5.16%) Splunk
8 48 (5.06%) Teradata
9 46 (4.85%) Informatica
10 45 (4.74%) Talend
11 34 (3.58%) Hortonworks
12 31 (3.27%) IBM
13 28 (2.95%) VMware
14 17 (1.79%) Atlassian
15 16 (1.69%) Netezza
16 13 (1.37%) Alteryx
17 12 (1.26%) SAP
18 10 (1.05%) Cognos
19 8 (0.84%) Sybase
20 7 (0.74%) Ab Initio