Period
to 25 May 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 25 May 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
25 May 2020
Same period 2019 Same period 2018
Rank 241 190 182
Rank change year-on-year -51 -8 +21
Permanent jobs citing Hadoop 1,268 2,669 3,389
As % of all permanent jobs advertised in the UK 1.37% 1.84% 1.95%
As % of the Database & Business Intelligence category 5.11% 6.55% 6.35%
Number of salaries quoted 952 2,078 2,647
Median annual salary £70,000 £70,000 £65,000
Median salary % change year-on-year - +7.69% -
10th Percentile £45,000 £45,000 £40,000
90th Percentile £110,000 £106,250 £100,000
UK excluding London median annual salary £61,000 £55,000 £55,000
% change year-on-year +10.91% - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 24,806 40,755 53,406
As % of all permanent IT jobs advertised in the UK 26.90% 28.09% 30.71%
Number of salaries quoted 20,178 33,269 43,825
Median annual salary £53,869 £52,095 £50,000
Median salary % change year-on-year +3.41% +4.19% +5.26%
10th Percentile £32,500 £31,250 £31,250
90th Percentile £90,000 £85,000 £80,000
UK excluding London median annual salary £47,125 £45,000 £44,500
% change year-on-year +4.72% +1.12% +5.95%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 25 May 2020.

Salary histogram for Hadoop in the UK

Hadoop
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 25 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -47 1,181 £72,500 +3.57% 95
London -67 754 £75,000 -0.66% 65
UK excluding London -19 499 £61,000 +10.91% 44
South East +24 187 £62,000 +6.90% 14
Midlands +34 105 £70,000 +21.74%
North of England +21 58 £50,000 -3.85% 7
Work from Home -16 54 £80,000 +20.30% 15
South West -61 54 £57,500 +4.55% 5
West Midlands +45 53 £62,000 +3.33%
Scotland +26 53 £52,500 -4.55% 5
East Midlands +2 52 £75,000 +30.43%
North West +37 31 £47,500 -17.39% 5
East of England +49 25 £75,000 +15.38% 4
Yorkshire +47 20 £52,500 +6.41% 2
Wales - 16 £45,000 - 9
North East +10 7 £57,500 +16.55%
Northern Ireland +19 1 - -
Channel Islands -3 1 - -

For the 6 months to 25 May 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 823 (64.91%) Apache Spark
2 778 (61.36%) Big Data
3 736 (58.04%) Python
4 629 (49.61%) Java
5 540 (42.59%) SQL
6 517 (40.77%) Agile Software Development
7 501 (39.51%) Analytics
8 490 (38.64%) AWS
9 383 (30.21%) NoSQL
10 381 (30.05%) Kafka
11 374 (29.50%) Azure
12 360 (28.39%) Data Science
13 338 (26.66%) Scala
14 332 (26.18%) Machine Learning
15 321 (25.32%) Finance
16 292 (23.03%) Apache Hive
17 278 (21.92%) Software Engineering
18 272 (21.45%) DevOps
19 254 (20.03%) Degree
20 237 (18.69%) Docker
21 224 (17.67%) MongoDB
22 221 (17.43%) GCP
23 216 (17.03%) Data Analytics
23 216 (17.03%) ETL
24 208 (16.40%) R
25 204 (16.09%) Linux
26 203 (16.01%) Data Warehouse
27 201 (15.85%) Artificial Intelligence
27 201 (15.85%) Microservices
28 196 (15.46%) Kubernetes

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 823 (64.91%) Apache Spark
2 127 (10.02%) Apache
3 109 (8.60%) Elasticsearch
4 74 (5.84%) SAS
5 46 (3.63%) Apache Airflow
6 34 (2.68%) Apache Solr
7 32 (2.52%) Jupyter
8 28 (2.21%) Luigi
9 22 (1.74%) Apache Pig
10 18 (1.42%) Confluence
11 17 (1.34%) Tomcat
12 12 (0.95%) CMS
13 10 (0.79%) Mule
13 10 (0.79%) SharePoint
14 8 (0.63%) JBoss
14 8 (0.63%) Oracle Coherence
15 7 (0.55%) Cloud Foundry
16 6 (0.47%) OpenStack
16 6 (0.47%) Oracle SOA Suite
16 6 (0.47%) Tornado
Applications
1 24 (1.89%) Microsoft Excel
2 11 (0.87%) SPSS
3 4 (0.32%) Microsoft Office
3 4 (0.32%) Microsoft PowerPoint
4 2 (0.16%) Chatbot
4 2 (0.16%) MS Visio
5 1 (0.079%) Gephi
Business Applications
1 7 (0.55%) SAP ERP
2 6 (0.47%) SAP BPC
3 5 (0.39%) SAP CRM
3 5 (0.39%) SAP IS-U
4 3 (0.24%) Sparx Enterprise Architect
5 2 (0.16%) SAP InfiniteInsight
5 2 (0.16%) SAP S/4HANA
6 1 (0.079%) Adobe Campaign
6 1 (0.079%) ENOVIA
6 1 (0.079%) SAP CO
6 1 (0.079%) SAP FI
6 1 (0.079%) SAP FI/CO
Cloud Services
1 490 (38.64%) AWS
2 374 (29.50%) Azure
3 221 (17.43%) GCP
4 95 (7.49%) Amazon EMR
5 91 (7.18%) Power Platform
6 55 (4.34%) Amazon S3
7 45 (3.55%) Azure Data Factory
8 38 (3.00%) Amazon EC2
9 34 (2.68%) Serverless
10 28 (2.21%) Amazon Kinesis
10 28 (2.21%) PaaS
10 28 (2.21%) SaaS
11 27 (2.13%) IBM Cloud
12 26 (2.05%) OpenShift
13 23 (1.81%) Cloud Computing
14 20 (1.58%) Azure Machine Learning
14 20 (1.58%) GitHub
15 15 (1.18%) IaaS
16 14 (1.10%) Amazon SageMaker
17 10 (0.79%) AWS Lambda
Communications & Networking
1 24 (1.89%) HTTP
2 13 (1.03%) TCP/IP
3 12 (0.95%) SSL
4 11 (0.87%) FTP
5 9 (0.71%) ZigBee
6 7 (0.55%) DNS
7 6 (0.47%) Kerberos
8 5 (0.39%) Firewall
9 4 (0.32%) DSL
9 4 (0.32%) Reverse Proxy
10 3 (0.24%) 5G
10 3 (0.24%) Network Security
10 3 (0.24%) SSH
11 2 (0.16%) 4G
11 2 (0.16%) LTE
11 2 (0.16%) Modbus
11 2 (0.16%) MQTT
11 2 (0.16%) Profibus
11 2 (0.16%) RS-232
11 2 (0.16%) RS-485
Database & Business Intelligence
1 778 (61.36%) Big Data
2 383 (30.21%) NoSQL
3 292 (23.03%) Apache Hive
4 224 (17.67%) MongoDB
5 203 (16.01%) Data Warehouse
6 192 (15.14%) Apache Cassandra
7 167 (13.17%) HBase
8 157 (12.38%) SQL Server
9 135 (10.65%) Amazon Redshift
10 124 (9.78%) PostgreSQL
11 118 (9.31%) Relational Database
12 92 (7.26%) Neo4j
13 91 (7.18%) Impala
13 91 (7.18%) Power BI
14 85 (6.70%) Data Lake
15 69 (5.44%) MySQL
16 63 (4.97%) Data Mining
17 57 (4.50%) Flink
18 49 (3.86%) BigQuery
19 45 (3.55%) Sqoop
Development Applications
1 151 (11.91%) Git (software)
2 142 (11.20%) Jenkins
3 59 (4.65%) Atlassian Bamboo
4 43 (3.39%) JIRA
5 42 (3.31%) Maven
6 38 (3.00%) Vagrant
7 32 (2.52%) Bitbucket
8 30 (2.37%) Artifactory
9 29 (2.29%) JUnit
10 23 (1.81%) TeamCity
11 15 (1.18%) Cucumber
12 11 (0.87%) Octopus Deploy
12 11 (0.87%) Sonatype Nexus
13 10 (0.79%) Visual Studio Team System
14 8 (0.63%) git-flow
14 8 (0.63%) GitLab
14 8 (0.63%) Subversion
15 7 (0.55%) Moq
15 7 (0.55%) Selenium
15 7 (0.55%) Visual Studio
General
1 321 (25.32%) Finance
2 109 (8.60%) Banking
3 87 (6.86%) Retail
4 62 (4.89%) Marketing
5 50 (3.94%) Public Sector
6 42 (3.31%) Front Office
7 41 (3.23%) Manufacturing
8 35 (2.76%) Telecoms
9 27 (2.13%) Investment Banking
10 23 (1.81%) Automotive
11 16 (1.26%) Games
12 14 (1.10%) Aerospace
12 14 (1.10%) Legal
13 9 (0.71%) Financial Institution
14 5 (0.39%) Advertising
14 5 (0.39%) Military
14 5 (0.39%) Retail Banking
15 4 (0.32%) Billing
15 4 (0.32%) Electronics
16 3 (0.24%) Pharmaceutical
Job Titles
1 340 (26.81%) Data Engineer
2 287 (22.63%) Developer
3 157 (12.38%) Java Developer
4 144 (11.36%) Architect
5 104 (8.20%) Data Scientist
6 102 (8.04%) Big Data Engineer
6 102 (8.04%) Data Architect
7 78 (6.15%) Senior Developer
8 76 (5.99%) Software Engineer
9 54 (4.26%) Python Engineer
10 52 (4.10%) Consultant
11 47 (3.71%) Senior Java Developer
12 45 (3.55%) Big Data Architect
12 45 (3.55%) Senior Data Scientist
13 38 (3.00%) Senior Data Engineer
14 35 (2.76%) Software Developer
15 33 (2.60%) AWS Engineer
15 33 (2.60%) DevOps Engineer
16 32 (2.52%) Solutions Architect
17 31 (2.44%) Analyst
Libraries, Frameworks & Software Standards
1 381 (30.05%) Kafka
2 102 (8.04%) React
3 94 (7.41%) Spring
4 89 (7.02%) Node.js
5 85 (6.70%) Natural Language Processing
6 82 (6.47%) AngularJS
7 76 (5.99%) .NET
8 72 (5.68%) Web Services
9 71 (5.60%) Spark Streaming
10 67 (5.28%) TensorFlow
11 65 (5.13%) HTML
12 55 (4.34%) REST
12 55 (4.34%) Spring Boot
13 48 (3.79%) scikit-learn
14 37 (2.92%) HTML5
15 30 (2.37%) CSS
15 30 (2.37%) RabbitMQ
16 29 (2.29%) Pandas
17 28 (2.21%) JMS
17 28 (2.21%) NumPy
Miscellaneous
1 131 (10.33%) Analytical Skills
2 94 (7.41%) Algorithms
3 74 (5.84%) Greenfield Project
4 53 (4.18%) Data Structures
5 37 (2.92%) Hedge funds
5 37 (2.92%) Management Information System
6 34 (2.68%) Blog
7 29 (2.29%) Public Cloud
8 28 (2.21%) Acoustics
8 28 (2.21%) Enterprise Software
8 28 (2.21%) Self-Motivation
9 23 (1.81%) Cloud Native
10 21 (1.66%) Equities
10 21 (1.66%) Hybrid Cloud
11 19 (1.50%) Linux Command Line
12 16 (1.26%) Mobile App
12 16 (1.26%) User Experience
12 16 (1.26%) Virtual Team
13 15 (1.18%) Social Media
14 14 (1.10%) Derivative
Operating Systems
1 204 (16.09%) Linux
2 103 (8.12%) Unix
3 39 (3.08%) Windows
4 20 (1.58%) Red Hat Enterprise Linux
5 7 (0.55%) CentOS
6 5 (0.39%) Android
6 5 (0.39%) Apple iOS
7 3 (0.24%) Windows Server
8 2 (0.16%) Debian
8 2 (0.16%) Ubuntu
9 1 (0.079%) Solaris
9 1 (0.079%) zOS
Processes & Methodologies
1 517 (40.77%) Agile Software Development
2 501 (39.51%) Analytics
3 360 (28.39%) Data Science
4 332 (26.18%) Machine Learning
5 278 (21.92%) Software Engineering
6 272 (21.45%) DevOps
7 216 (17.03%) Data Analytics
7 216 (17.03%) ETL
8 201 (15.85%) Artificial Intelligence
8 201 (15.85%) Microservices
9 183 (14.43%) Data Modelling
10 164 (12.93%) Business Intelligence
11 161 (12.70%) Data Engineering
12 158 (12.46%) Computer Science
13 141 (11.12%) TDD
14 128 (10.09%) Visualisation
15 117 (9.23%) Continuous Integration
16 115 (9.07%) Scrum
17 110 (8.68%) Fintech
18 108 (8.52%) Mentoring
Programming Languages
1 736 (58.04%) Python
2 629 (49.61%) Java
3 540 (42.59%) SQL
4 338 (26.66%) Scala
5 208 (16.40%) R
6 173 (13.64%) JavaScript
7 147 (11.59%) C#
8 121 (9.54%) C++
9 81 (6.39%) Bash Shell
10 47 (3.71%) Java 8
11 44 (3.47%) Go
12 39 (3.08%) C
12 39 (3.08%) PL/SQL
13 31 (2.44%) Perl
14 30 (2.37%) MATLAB
15 28 (2.21%) PHP
15 28 (2.21%) Shell Script
16 25 (1.97%) PowerShell
17 21 (1.66%) Kotlin
17 21 (1.66%) Ruby
Qualifications
1 254 (20.03%) Degree
2 110 (8.68%) Computer Science Degree
3 94 (7.41%) Security Cleared
4 66 (5.21%) SC Cleared
5 53 (4.18%) DV Cleared
6 29 (2.29%) PhD
7 21 (1.66%) Master's Degree
8 16 (1.26%) Numerate Degree
9 14 (1.10%) AWS Certification
10 8 (0.63%) TOGAF Certification
11 7 (0.55%) Microsoft Certification
12 6 (0.47%) MBA
13 5 (0.39%) Postgraduate
14 4 (0.32%) PMI Certification
15 3 (0.24%) BPSS Clearance
15 3 (0.24%) ISTQB
16 2 (0.16%) ACCA
16 2 (0.16%) CIMA
17 1 (0.079%) CCNP
17 1 (0.079%) CSPO
Quality Assurance & Compliance
1 57 (4.50%) Data Quality
2 30 (2.37%) QA
3 9 (0.71%) GDPR
4 7 (0.55%) ISO/IEC 27001
5 5 (0.39%) Sarbanes-Oxley
6 4 (0.32%) SLA
7 1 (0.079%) Actionable Recommendations
System Software
1 237 (18.69%) Docker
2 95 (7.49%) HDFS
3 76 (5.99%) Apache ZooKeeper
4 36 (2.84%) VirtualBox
5 28 (2.21%) Apache Flume
6 18 (1.42%) VMware Infrastructure
7 5 (0.39%) Active Directory
8 4 (0.32%) Hyper-V
8 4 (0.32%) Samba
9 3 (0.24%) vSphere
10 2 (0.16%) Microsoft Virtual Server
10 2 (0.16%) Virtual Servers
11 1 (0.079%) Alluxio
11 1 (0.079%) Ceph
11 1 (0.079%) etcd
11 1 (0.079%) Gluster
11 1 (0.079%) VMware NSX
Systems Management
1 196 (15.46%) Kubernetes
2 164 (12.93%) Ansible
3 84 (6.62%) Terraform
4 62 (4.89%) Puppet
5 44 (3.47%) Docker Swarm
6 34 (2.68%) Salt
7 30 (2.37%) Hadoop YARN
8 28 (2.21%) Oozie
8 28 (2.21%) Opscode Chef
9 17 (1.34%) Kibana
10 7 (0.55%) logstash
11 6 (0.47%) Ambari
11 6 (0.47%) Nagios
11 6 (0.47%) SCCM
12 5 (0.39%) Prometheus
12 5 (0.39%) vRealize Orchestrator
13 4 (0.32%) Mesos
13 4 (0.32%) Single Sign-On
13 4 (0.32%) ZABBIX
14 2 (0.16%) HAProxy
Vendors
1 163 (12.85%) Oracle
2 147 (11.59%) Google
3 135 (10.65%) Cloudera
4 110 (8.68%) Tableau
5 88 (6.94%) Microsoft
6 65 (5.13%) Informatica
7 63 (4.97%) Hortonworks
8 59 (4.65%) Databricks
9 53 (4.18%) Talend
10 52 (4.10%) IBM
11 51 (4.02%) Splunk
12 46 (3.63%) Teradata
13 21 (1.66%) Atlassian
13 21 (1.66%) VMware
14 20 (1.58%) SAP
15 19 (1.50%) InterSystems
16 18 (1.42%) Netezza
17 16 (1.26%) Alteryx
18 14 (1.10%) Sybase
19 13 (1.03%) Cognos