Period
to 16 January 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 16 January 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
16 Jan 2021
Same period 2020 Same period 2019
Rank 273 249 188
Rank change year-on-year -24 -61 +12
Permanent jobs citing Hadoop 697 1,653 2,805
As % of all permanent jobs advertised in the UK 1.12% 1.31% 1.86%
As % of the Database & Business Intelligence category 4.07% 4.84% 6.44%
Number of salaries quoted 611 1,392 2,252
Median annual salary £67,500 £70,000 £70,000
Median salary % change year-on-year -3.57% - +7.69%
10th Percentile £42,500 £45,000 £42,258
90th Percentile £107,500 £107,500 £100,000
UK excluding London median annual salary £55,000 £57,500 £60,000
% change year-on-year -4.35% -4.17% +14.29%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 17,119 34,140 43,584
As % of all permanent IT jobs advertised in the UK 27.50% 27.07% 28.85%
Number of salaries quoted 14,338 28,288 36,180
Median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +9.38%
10th Percentile £33,750 £32,000 £31,250
90th Percentile £87,500 £87,500 £85,000
UK excluding London median annual salary £49,000 £45,000 £45,000
% change year-on-year +8.89% - +5.88%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 16 January 2021.

Salary histogram for Hadoop in the UK

Hadoop
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 16 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -31 624 £70,000 - 142
London +10 432 £77,500 +3.33% 79
UK excluding London -21 246 £55,000 -4.35% 68
Work from Home -50 103 £72,500 +20.83% 32
South East +48 50 £50,000 - 12
North of England +17 43 £55,000 +0.30% 24
Midlands -13 43 £57,500 -17.86% 15
Scotland +29 42 £62,500 +25.00% 4
South West +15 37 £67,500 +28.57% 4
East Midlands 0 23 £55,500 -23.45% 8
Yorkshire -5 23 £55,000 - 15
West Midlands +29 20 £57,500 -5.74% 7
North West +64 19 £55,000 +0.94% 9
Wales - 16 £45,000 - 3
East of England +76 13 £65,000 -13.33% 5
Northern Ireland - 2 £63,750 - 1
North East +10 1 £42,000 -23.18%

For the 6 months to 16 January 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 446 (63.99%) Big Data
2 408 (58.54%) Python
3 392 (56.24%) Apache Spark
4 373 (53.52%) Java
5 346 (49.64%) AWS
6 327 (46.92%) SQL
7 288 (41.32%) Azure
8 258 (37.02%) Analytics
9 254 (36.44%) Kafka
10 242 (34.72%) Agile Software Development
11 215 (30.85%) ETL
12 193 (27.69%) Apache Hive
13 183 (26.26%) NoSQL
14 182 (26.11%) Data Science
15 169 (24.25%) Finance
16 156 (22.38%) Scala
17 154 (22.09%) GCP
18 150 (21.52%) DevOps
19 148 (21.23%) Software Engineering
20 138 (19.80%) Kubernetes
20 138 (19.80%) Machine Learning
21 136 (19.51%) Oracle
22 131 (18.79%) Docker
23 122 (17.50%) Cloudera
24 117 (16.79%) Apache Cassandra
24 117 (16.79%) Data Engineering
25 116 (16.64%) Data Warehouse
26 113 (16.21%) Git (software)
27 112 (16.07%) Business Intelligence
27 112 (16.07%) Data Lake

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 392 (56.24%) Apache Spark
2 89 (12.77%) Apache
2 89 (12.77%) SAS
3 61 (8.75%) Elasticsearch
4 43 (6.17%) Apache Airflow
5 19 (2.73%) Confluence
5 19 (2.73%) Luigi
6 16 (2.30%) Apache Pig
7 13 (1.87%) Tornado
8 12 (1.72%) Apache Synapse
9 10 (1.43%) Tomcat
10 6 (0.86%) Apache Solr
10 6 (0.86%) Jupyter
11 5 (0.72%) IIS
11 5 (0.72%) Oracle Workflow
12 2 (0.29%) Oracle SOA Suite
12 2 (0.29%) WebLogic
13 1 (0.14%) BizTalk Server
13 1 (0.14%) CMS
13 1 (0.14%) WebSphere
Applications
1 4 (0.57%) SPSS
2 2 (0.29%) Microsoft Excel
3 1 (0.14%) Chatbot
3 1 (0.14%) Microsoft Office
Business Applications
1 3 (0.43%) Distributed Ledger
1 3 (0.43%) Oracle Cash Management
2 2 (0.29%) Oracle EBS
3 1 (0.14%) Dynamics CRM
3 1 (0.14%) SAP APO
3 1 (0.14%) SAP FI-CA
3 1 (0.14%) SAP PSCD
Cloud Services
1 346 (49.64%) AWS
2 288 (41.32%) Azure
3 154 (22.09%) GCP
4 82 (11.76%) Power Platform
5 34 (4.88%) Amazon EMR
6 31 (4.45%) Amazon Kinesis
7 29 (4.16%) Azure Data Factory
8 25 (3.59%) SaaS
9 22 (3.16%) Amazon S3
10 21 (3.01%) IaaS
11 18 (2.58%) PaaS
12 17 (2.44%) Serverless
13 15 (2.15%) AWS Lambda
14 13 (1.87%) OpenShift
15 12 (1.72%) Cloud Computing
16 11 (1.58%) Amazon SageMaker
17 10 (1.43%) Amazon EC2
17 10 (1.43%) Logic Apps
18 7 (1.00%) Amazon SQS
18 7 (1.00%) AWS CloudFormation
Communications & Networking
1 20 (2.87%) HTTP
2 17 (2.44%) Firewall
3 9 (1.29%) SSH
3 9 (1.29%) TCP/IP
4 8 (1.15%) NetScaler
5 6 (0.86%) Fibre Channel
5 6 (0.86%) Internet
5 6 (0.86%) LAN
5 6 (0.86%) SAN
5 6 (0.86%) WAN
6 5 (0.72%) 5G
6 5 (0.72%) DMZ
6 5 (0.72%) DNS
6 5 (0.72%) Kerberos
6 5 (0.72%) VPN
7 4 (0.57%) 802.11
7 4 (0.57%) SNMP
7 4 (0.57%) Software-Defined Networking
7 4 (0.57%) SSL
7 4 (0.57%) Wireless
Database & Business Intelligence
1 446 (63.99%) Big Data
2 193 (27.69%) Apache Hive
3 183 (26.26%) NoSQL
4 117 (16.79%) Apache Cassandra
5 116 (16.64%) Data Warehouse
6 112 (16.07%) Data Lake
7 99 (14.20%) MongoDB
8 96 (13.77%) Amazon Redshift
9 90 (12.91%) SQL Server
10 82 (11.76%) Power BI
11 79 (11.33%) HBase
11 79 (11.33%) Impala
12 69 (9.90%) Oracle Database
13 66 (9.47%) Pentaho
13 66 (9.47%) PostgreSQL
14 63 (9.04%) Relational Database
15 57 (8.18%) Tableau
16 46 (6.60%) BusinessObjects
17 39 (5.60%) SQL Server Integration Services
18 32 (4.59%) Amazon Athena
Development Applications
1 113 (16.21%) Git (software)
2 98 (14.06%) Jenkins
3 52 (7.46%) Maven
4 37 (5.31%) Bitbucket
5 32 (4.59%) JIRA
6 27 (3.87%) Artifactory
7 22 (3.16%) Cucumber
8 18 (2.58%) Atlassian Bamboo
9 15 (2.15%) Selenium
10 13 (1.87%) TeamCity
11 11 (1.58%) JUnit
12 8 (1.15%) JMeter
12 8 (1.15%) WebDriver
13 7 (1.00%) REST Assured
13 7 (1.00%) Team Foundation Server
13 7 (1.00%) Visual Studio
14 6 (0.86%) Sonatype Nexus
14 6 (0.86%) Vagrant
15 5 (0.72%) ERwin
15 5 (0.72%) Gradle
General
1 169 (24.25%) Finance
2 60 (8.61%) Banking
3 38 (5.45%) Retail
4 35 (5.02%) Telecoms
5 23 (3.30%) Public Sector
6 22 (3.16%) Marketing
7 21 (3.01%) Advertising
7 21 (3.01%) Games
8 18 (2.58%) Front Office
9 16 (2.30%) Law
10 12 (1.72%) Investment Banking
11 11 (1.58%) Manufacturing
12 7 (1.00%) Legal
13 5 (0.72%) Electronics
14 4 (0.57%) Military
14 4 (0.57%) Pharmaceutical
15 3 (0.43%) Automotive
16 2 (0.29%) Back Office
16 2 (0.29%) Financial Institution
17 1 (0.14%) Dutch Language
Job Titles
1 240 (34.43%) Data Engineer
2 147 (21.09%) Developer
3 84 (12.05%) Architect
4 76 (10.90%) Big Data Engineer
5 71 (10.19%) Java Developer
6 64 (9.18%) Java Engineer
7 53 (7.60%) Data Architect
8 50 (7.17%) Data Scientist
9 46 (6.60%) Software Engineer
10 35 (5.02%) Consultant
11 32 (4.59%) Senior Developer
12 28 (4.02%) Senior Data Engineer
13 26 (3.73%) Senior Data Scientist
14 25 (3.59%) Java Software Engineer
15 24 (3.44%) AWS Engineer
15 24 (3.44%) Data Consultant
16 21 (3.01%) Java Architect
16 21 (3.01%) Python Engineer
17 20 (2.87%) Big Data Developer
18 19 (2.73%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 254 (36.44%) Kafka
2 65 (9.33%) Spring
3 58 (8.32%) Web Services
4 47 (6.74%) Node.js
5 41 (5.88%) React
6 39 (5.60%) Spring Boot
7 35 (5.02%) RESTful
8 33 (4.73%) HTML
8 33 (4.73%) REST
9 31 (4.45%) JMS
10 30 (4.30%) TensorFlow
11 29 (4.16%) AngularJS
12 28 (4.02%) CSS
13 27 (3.87%) JSON
13 27 (3.87%) Natural Language Processing
13 27 (3.87%) RabbitMQ
14 26 (3.73%) ActiveMQ
15 25 (3.59%) .NET
16 24 (3.44%) Apache NiFi
17 23 (3.30%) PySpark
Miscellaneous
1 69 (9.90%) Algorithms
2 51 (7.32%) Analytical Skills
3 26 (3.73%) Self-Motivation
4 22 (3.16%) Cloud Native
4 22 (3.16%) Data Centre
4 22 (3.16%) Data Structures
5 21 (3.01%) Management Information System
6 15 (2.15%) Public Cloud
7 14 (2.01%) Credit Risk
8 13 (1.87%) Derivative
9 12 (1.72%) Market Risk
9 12 (1.72%) Video on Demand
10 11 (1.58%) Enterprise Software
10 11 (1.58%) Hybrid Cloud
11 9 (1.29%) Blog
11 9 (1.29%) PKI
12 8 (1.15%) Equities
12 8 (1.15%) Linux Command Line
12 8 (1.15%) Private Cloud
13 7 (1.00%) Greenfield Project
Operating Systems
1 87 (12.48%) Linux
2 65 (9.33%) Unix
3 33 (4.73%) Windows
4 32 (4.59%) CentOS
5 18 (2.58%) Red Hat Enterprise Linux
6 15 (2.15%) Windows Server
7 6 (0.86%) Ubuntu
8 5 (0.72%) Oracle Linux
8 5 (0.72%) Windows Server 2016
9 1 (0.14%) Android
9 1 (0.14%) Apple iOS
Processes & Methodologies
1 258 (37.02%) Analytics
2 242 (34.72%) Agile Software Development
3 215 (30.85%) ETL
4 182 (26.11%) Data Science
5 150 (21.52%) DevOps
6 148 (21.23%) Software Engineering
7 138 (19.80%) Machine Learning
8 117 (16.79%) Data Engineering
9 112 (16.07%) Business Intelligence
10 107 (15.35%) Visualisation
11 99 (14.20%) Microservices
12 96 (13.77%) Computer Science
12 96 (13.77%) Scrum
13 95 (13.63%) Data Analytics
14 84 (12.05%) Artificial Intelligence
15 74 (10.62%) Requirements Gathering
16 73 (10.47%) Data Visualisation
17 68 (9.76%) Data Modelling
18 65 (9.33%) Mentoring
19 64 (9.18%) Mathematics
Programming Languages
1 408 (58.54%) Python
2 373 (53.52%) Java
3 327 (46.92%) SQL
4 156 (22.38%) Scala
5 111 (15.93%) JavaScript
6 69 (9.90%) R
7 66 (9.47%) PL/SQL
8 53 (7.60%) C#
8 53 (7.60%) Shell Script
9 43 (6.17%) Bash Shell
10 40 (5.74%) HiveQL
11 32 (4.59%) C++
12 28 (4.02%) Java 8
13 18 (2.58%) Kotlin
14 17 (2.44%) PHP
15 16 (2.30%) Go
16 13 (1.87%) C
16 13 (1.87%) Perl
17 12 (1.72%) TypeScript
18 8 (1.15%) PowerShell
Qualifications
1 103 (14.78%) Degree
2 45 (6.46%) Computer Science Degree
3 27 (3.87%) BPSS Clearance
3 27 (3.87%) PhD
4 18 (2.58%) Security Cleared
5 9 (1.29%) Master's Degree
6 8 (1.15%) RHCE
6 8 (1.15%) SC Cleared
7 6 (0.86%) Numerate Degree
8 5 (0.72%) AWS Certification
9 3 (0.43%) DV Cleared
9 3 (0.43%) MCDBA
9 3 (0.43%) MCT
9 3 (0.43%) Microsoft Certification
9 3 (0.43%) TOGAF Certification
10 2 (0.29%) HND
11 1 (0.14%) ISEB
11 1 (0.14%) ISTQB
11 1 (0.14%) ISTQB Foundation Certification
11 1 (0.14%) Sun Certification
Quality Assurance & Compliance
1 31 (4.45%) Data Quality
2 28 (4.02%) QA
3 7 (1.00%) GDPR
4 6 (0.86%) SLA
5 3 (0.43%) ISO 20022
5 3 (0.43%) PSD2
5 3 (0.43%) TARGET2
6 2 (0.29%) ISO/IEC 27001
7 1 (0.14%) Basel III
7 1 (0.14%) COREP
7 1 (0.14%) CRD IV
7 1 (0.14%) IFRS
7 1 (0.14%) IFRS 9
7 1 (0.14%) ISO 26262
7 1 (0.14%) ISO 9001
7 1 (0.14%) PMO
7 1 (0.14%) Sarbanes-Oxley
System Software
1 131 (18.79%) Docker
2 88 (12.63%) HDFS
3 29 (4.16%) Apache ZooKeeper
4 21 (3.01%) Active Directory
5 20 (2.87%) VMware Infrastructure
6 8 (1.15%) vSphere
6 8 (1.15%) XenApp
6 8 (1.15%) XenDesktop
7 6 (0.86%) Apache Flume
8 5 (0.72%) Hyper-V
8 5 (0.72%) VirtualBox
9 1 (0.14%) NFS
9 1 (0.14%) Oracle RAC
9 1 (0.14%) oVirt
9 1 (0.14%) Tivoli Workload Scheduler
Systems Management
1 138 (19.80%) Kubernetes
2 84 (12.05%) Ansible
3 64 (9.18%) Terraform
4 33 (4.73%) Puppet
5 25 (3.59%) Hadoop YARN
6 21 (3.01%) Opscode Chef
7 15 (2.15%) Oozie
8 11 (1.58%) Nagios
9 7 (1.00%) Graphite
9 7 (1.00%) Opsview
10 5 (0.72%) Docker Swarm
10 5 (0.72%) Prometheus
11 3 (0.43%) ZABBIX
12 2 (0.29%) Ambari
12 2 (0.29%) Control-M
12 2 (0.29%) HP Fortify
12 2 (0.29%) Kibana
12 2 (0.29%) Single Sign-On
13 1 (0.14%) Failover Clustering
13 1 (0.14%) Grafana
Vendors
1 136 (19.51%) Oracle
2 122 (17.50%) Cloudera
3 84 (12.05%) Talend
4 80 (11.48%) Databricks
5 72 (10.33%) Informatica
6 64 (9.18%) Google
7 54 (7.75%) Microsoft
8 29 (4.16%) Teradata
9 27 (3.87%) VMware
10 25 (3.59%) Red Hat
11 12 (1.72%) Splunk
12 11 (1.58%) Ab Initio
12 11 (1.58%) Hortonworks
13 9 (1.29%) IBM
14 8 (1.15%) F5
15 7 (1.00%) Yahoo!
16 6 (0.86%) MuleSoft
16 6 (0.86%) NVIDIA
16 6 (0.86%) SAP
17 5 (0.72%) LogicMonitor