Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 15 April 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 15 April 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
15 Apr 2021		 Same period 2020 Same period 2019
Rank 281 243 189
Rank change year-on-year -38 -54 +1
Permanent jobs citing Hadoop 897 1,495 2,774
As % of all permanent jobs advertised in the UK 1.07% 1.33% 1.86%
As % of the Database & Business Intelligence category 4.06% 4.93% 6.55%
Number of salaries quoted 675 1,124 2,145
10th Percentile £46,250 £46,250 £42,500
25th Percentile £52,500 £53,750 £52,500
Median annual salary (50th Percentile) £70,000 £70,000 £70,000
75th Percentile £92,500 £85,000 £87,500
90th Percentile £110,000 £105,000 £105,000
UK excluding London median annual salary £60,000 £60,000 £57,500
% change year-on-year - +4.35% +5.70%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 22,114 30,327 42,334
As % of all permanent IT jobs advertised in the UK 26.44% 26.98% 28.44%
Number of salaries quoted 17,820 25,018 35,026
10th Percentile £33,750 £32,500 £31,250
25th Percentile £41,250 £40,000 £37,500
Median annual salary (50th Percentile) £55,000 £52,500 £52,500
Median % change year-on-year +4.76% - +5.00%
75th Percentile £73,750 £72,500 £70,000
90th Percentile £88,750 £87,500 £85,000
UK excluding London median annual salary £49,000 £45,000 £45,000
% change year-on-year +8.89% - +5.88%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 15 April 2021.

Salary histogram for Hadoop in the UK

Hadoop
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 15 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -33 839 £72,500 +3.57% 162
London -6 568 £78,750 +8.62% 103
UK excluding London -69 296 £60,000 - 70
Work from Home -29 184 £75,000 +3.45% 28
South East -25 70 £62,500 +3.31% 14
South West +17 64 £75,000 +30.43% 7
North of England +16 57 £56,250 +3.24% 14
Midlands -64 44 £57,500 -17.86% 13
North West +31 31 £60,000 +26.32% 12
Scotland -18 27 £62,250 +14.22% 9
Yorkshire -4 26 £55,000 +0.60% 2
West Midlands -19 23 £60,000 - 10
East Midlands -30 21 £55,500 -26.00% 3
East of England +34 20 £65,000 -13.33% 9
Wales +37 11 £50,000 -16.67% 3
Northern Ireland +1 2 £63,750 - 1
Isle of Man - 1 £37,500 -

For the 6 months to 15 April 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 578 (64.44%) Big Data
2 566 (63.10%) Apache Spark
3 551 (61.43%) Python
4 465 (51.84%) AWS
5 445 (49.61%) SQL
6 433 (48.27%) Java
7 363 (40.47%) Azure
8 351 (39.13%) Kafka
9 338 (37.68%) Agile Software Development
10 310 (34.56%) Analytics
11 284 (31.66%) ETL
12 282 (31.44%) NoSQL
13 272 (30.32%) GCP
14 267 (29.77%) Kubernetes
15 259 (28.87%) Docker
16 245 (27.31%) Software Engineering
17 230 (25.64%) Data Science
18 218 (24.30%) Apache Hive
19 216 (24.08%) Data Engineering
20 181 (20.18%) DevOps
21 172 (19.18%) Scala
22 167 (18.62%) Finance
23 150 (16.72%) Artificial Intelligence
23 150 (16.72%) Business Intelligence
24 149 (16.61%) Ansible
25 146 (16.28%) Amazon Redshift
26 145 (16.16%) Google
27 144 (16.05%) Terraform
28 142 (15.83%) Data Warehouse
29 139 (15.50%) Machine Learning

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 566 (63.10%) Apache Spark
2 79 (8.81%) Apache
3 78 (8.70%) Apache Airflow
4 72 (8.03%) Elasticsearch
5 65 (7.25%) SAS
6 45 (5.02%) Luigi
7 32 (3.57%) Apache Pig
8 19 (2.12%) Confluence
9 12 (1.34%) IIS
9 12 (1.34%) Oracle Workflow
10 10 (1.11%) Apache Synapse
11 9 (1.00%) OpenStack
12 8 (0.89%) Oracle SOA Suite
13 7 (0.78%) Cloud Foundry
13 7 (0.78%) CloudStack
13 7 (0.78%) nginx
13 7 (0.78%) Tornado
13 7 (0.78%) WebLogic
14 6 (0.67%) Apache Solr
14 6 (0.67%) Jupyter
Applications
1 8 (0.89%) SPSS
2 6 (0.67%) Microsoft Office
3 3 (0.33%) Chatbot
3 3 (0.33%) Microsoft Excel
4 2 (0.22%) Microsoft PowerPoint
5 1 (0.11%) Microsoft Project
5 1 (0.11%) MS Visio
Business Applications
1 4 (0.45%) Oracle EBS
2 2 (0.22%) Dynamics CRM
3 1 (0.11%) SAP APO
3 1 (0.11%) SAP Hybris
Cloud Services
1 465 (51.84%) AWS
2 363 (40.47%) Azure
3 272 (30.32%) GCP
4 79 (8.81%) Power Platform
5 75 (8.36%) Amazon EMR
6 53 (5.91%) Serverless
7 47 (5.24%) IBM Cloud
8 43 (4.79%) Amazon Kinesis
9 36 (4.01%) SaaS
10 35 (3.90%) Azure Data Factory
11 28 (3.12%) Amazon S3
11 28 (3.12%) Cloud Functions
12 26 (2.90%) AWS Lambda
13 22 (2.45%) Amazon EC2
14 19 (2.12%) PaaS
15 18 (2.01%) Google Compute Engine
16 17 (1.90%) Google App Engine
16 17 (1.90%) Google Container Engine
17 15 (1.67%) AWS CloudFormation
18 14 (1.56%) Cloud Computing
Communications & Networking
1 19 (2.12%) Firewall
2 16 (1.78%) HTTP
3 14 (1.56%) Internet
4 13 (1.45%) FTP
5 11 (1.23%) TCP/IP
6 7 (0.78%) VLAN
6 7 (0.78%) Wireless
7 6 (0.67%) DNS
7 6 (0.67%) Fibre Channel
7 6 (0.67%) LAN
7 6 (0.67%) SAN
7 6 (0.67%) WAN
8 5 (0.56%) DMZ
8 5 (0.56%) VPN
9 4 (0.45%) 802.11
9 4 (0.45%) SNMP
9 4 (0.45%) Software-Defined Networking
9 4 (0.45%) SSH
10 3 (0.33%) Kerberos
10 3 (0.33%) Reverse Proxy
Database & Business Intelligence
1 578 (64.44%) Big Data
2 282 (31.44%) NoSQL
3 218 (24.30%) Apache Hive
4 146 (16.28%) Amazon Redshift
5 142 (15.83%) Data Warehouse
6 136 (15.16%) MongoDB
7 124 (13.82%) Data Lake
8 118 (13.15%) Apache Cassandra
9 114 (12.71%) SQL Server
10 86 (9.59%) Relational Database
11 82 (9.14%) HBase
12 80 (8.92%) PostgreSQL
13 79 (8.81%) Power BI
13 79 (8.81%) Tableau
14 74 (8.25%) Amazon Athena
15 67 (7.47%) MySQL
16 56 (6.24%) SQL Server Integration Services
17 53 (5.91%) Data Mining
18 51 (5.69%) Impala
19 50 (5.57%) Neo4j
Development Applications
1 136 (15.16%) Jenkins
2 76 (8.47%) Git (software)
3 67 (7.47%) Atlassian Bamboo
4 51 (5.69%) Maven
4 51 (5.69%) Vagrant
5 30 (3.34%) JIRA
6 26 (2.90%) Bitbucket
7 21 (2.34%) Gradle
7 21 (2.34%) JMeter
8 17 (1.90%) SonarQube
9 16 (1.78%) Artifactory
10 14 (1.56%) Postman
11 13 (1.45%) Cucumber
11 13 (1.45%) TeamCity
12 12 (1.34%) ERwin
12 12 (1.34%) Selenium
12 12 (1.34%) Team Foundation Server
13 11 (1.23%) Cypress.io
13 11 (1.23%) JUnit
14 10 (1.11%) Visual Studio
General
1 167 (18.62%) Finance
2 79 (8.81%) Banking
3 41 (4.57%) Retail
4 32 (3.57%) Telecoms
5 29 (3.23%) Games
5 29 (3.23%) Marketing
6 25 (2.79%) Law
7 23 (2.56%) Public Sector
8 21 (2.34%) Advertising
9 15 (1.67%) Investment Banking
10 14 (1.56%) Front Office
11 13 (1.45%) Legal
11 13 (1.45%) Manufacturing
12 11 (1.23%) Retail Banking
13 7 (0.78%) Electronics
14 6 (0.67%) Pharmaceutical
15 4 (0.45%) Automotive
15 4 (0.45%) Financial Institution
16 3 (0.33%) Military
17 2 (0.22%) Back Office
Job Titles
1 320 (35.67%) Data Engineer
2 192 (21.40%) Developer
3 103 (11.48%) Big Data Engineer
4 101 (11.26%) Architect
5 83 (9.25%) Java Developer
6 77 (8.58%) Data Architect
7 66 (7.36%) Java Engineer
8 62 (6.91%) Software Engineer
9 50 (5.57%) Senior Data Engineer
10 49 (5.46%) AWS Engineer
11 47 (5.24%) Platform Engineer
12 46 (5.13%) Data Scientist
13 45 (5.02%) Python Developer
14 43 (4.79%) Senior Developer
15 41 (4.57%) Full Stack Developer
16 39 (4.35%) Consultant
16 39 (4.35%) JavaScript Developer
17 37 (4.12%) Java Software Engineer
18 32 (3.57%) DevOps Engineer
19 26 (2.90%) Big Data Software Engineer
Libraries, Frameworks & Software Standards
1 351 (39.13%) Kafka
2 88 (9.81%) Node.js
3 83 (9.25%) React
4 75 (8.36%) AngularJS
5 71 (7.92%) Web Services
6 70 (7.80%) Spark Streaming
7 69 (7.69%) REST
8 59 (6.58%) Spring
9 56 (6.24%) Spring Boot
10 42 (4.68%) Vue.js
11 39 (4.35%) KnockoutJS
12 32 (3.57%) RabbitMQ
13 31 (3.46%) TensorFlow
14 29 (3.23%) HTML
14 29 (3.23%) RESTful
15 27 (3.01%) ActiveMQ
16 26 (2.90%) Apache NiFi
16 26 (2.90%) CSS
16 26 (2.90%) JSON
17 25 (2.79%) Natural Language Processing
Miscellaneous
1 98 (10.93%) Analytical Skills
2 35 (3.90%) Algorithms
3 34 (3.79%) Hybrid Cloud
4 32 (3.57%) Self-Motivation
5 30 (3.34%) Data Structures
6 19 (2.12%) Hedge funds
7 18 (2.01%) Virtual Team
8 17 (1.90%) Equities
9 16 (1.78%) Private Cloud
10 15 (1.67%) Public Cloud
11 14 (1.56%) Video on Demand
12 13 (1.45%) Cloud Native
12 13 (1.45%) Greenfield Project
13 12 (1.34%) Cyberattack
14 11 (1.23%) Data Centre
14 11 (1.23%) Management Information System
15 10 (1.11%) Credit Risk
15 10 (1.11%) Market Risk
16 9 (1.00%) Derivative
17 7 (0.78%) Replication
Operating Systems
1 109 (12.15%) Linux
2 64 (7.13%) Unix
3 28 (3.12%) Red Hat Enterprise Linux
4 23 (2.56%) CentOS
4 23 (2.56%) Windows
5 6 (0.67%) Ubuntu
6 5 (0.56%) Oracle Linux
6 5 (0.56%) Windows Server
6 5 (0.56%) Windows Server 2016
7 1 (0.11%) AIX
7 1 (0.11%) Android
7 1 (0.11%) Apple iOS
7 1 (0.11%) CoreOS
7 1 (0.11%) Solaris
Processes & Methodologies
1 338 (37.68%) Agile Software Development
2 310 (34.56%) Analytics
3 284 (31.66%) ETL
4 245 (27.31%) Software Engineering
5 230 (25.64%) Data Science
6 216 (24.08%) Data Engineering
7 181 (20.18%) DevOps
8 150 (16.72%) Artificial Intelligence
8 150 (16.72%) Business Intelligence
9 139 (15.50%) Machine Learning
10 138 (15.38%) Microservices
11 118 (13.15%) Visualisation
12 104 (11.59%) Open Source
13 102 (11.37%) Computer Science
13 102 (11.37%) Data Architecture
14 100 (11.15%) Continuous Integration
14 100 (11.15%) Data Modelling
15 92 (10.26%) Data Analytics
16 89 (9.92%) Fintech
17 88 (9.81%) Configuration Management
Programming Languages
1 551 (61.43%) Python
2 445 (49.61%) SQL
3 433 (48.27%) Java
4 172 (19.18%) Scala
5 111 (12.37%) JavaScript
6 99 (11.04%) C#
7 68 (7.58%) R
8 53 (5.91%) Bash Shell
9 41 (4.57%) C++
10 35 (3.90%) PL/SQL
11 34 (3.79%) Java 8
12 33 (3.68%) TypeScript
13 28 (3.12%) Perl
14 25 (2.79%) HiveQL
14 25 (2.79%) PHP
15 23 (2.56%) Shell Script
16 22 (2.45%) C
17 21 (2.34%) Go
18 18 (2.01%) Kotlin
19 17 (1.90%) ES6
Qualifications
1 111 (12.37%) Degree
2 51 (5.69%) Computer Science Degree
3 41 (4.57%) Security Cleared
4 26 (2.90%) PhD
5 22 (2.45%) SC Cleared
6 18 (2.01%) DV Cleared
7 9 (1.00%) BPSS Clearance
8 4 (0.45%) TOGAF Certification
9 2 (0.22%) DBS Check
9 2 (0.22%) Numerate Degree
10 1 (0.11%) AWS Certification
10 1 (0.11%) HND
10 1 (0.11%) Master's Degree
Quality Assurance & Compliance
1 41 (4.57%) QA
2 32 (3.57%) Data Quality
3 5 (0.56%) SLA
4 4 (0.45%) ISO/IEC 27001
5 3 (0.33%) GDPR
6 1 (0.11%) ISO 9001
System Software
1 259 (28.87%) Docker
2 76 (8.47%) HDFS
3 49 (5.46%) VirtualBox
4 29 (3.23%) Apache ZooKeeper
5 13 (1.45%) Apache Flume
6 9 (1.00%) VMware Infrastructure
7 7 (0.78%) Active Directory
7 7 (0.78%) Oracle RAC
8 2 (0.22%) Firmware
9 1 (0.11%) NFS
9 1 (0.11%) oVirt
Systems Management
1 267 (29.77%) Kubernetes
2 149 (16.61%) Ansible
3 144 (16.05%) Terraform
4 49 (5.46%) Docker Swarm
5 48 (5.35%) Puppet
6 37 (4.12%) Opscode Chef
7 20 (2.23%) Hadoop YARN
8 13 (1.45%) Oozie
9 12 (1.34%) Prometheus
10 11 (1.23%) Nagios
11 7 (0.78%) Data Guard
11 7 (0.78%) Graphite
11 7 (0.78%) ITRS Geneos
11 7 (0.78%) Opsview
12 6 (0.67%) Oracle RMAN
13 2 (0.22%) Control-M
13 2 (0.22%) Kibana
13 2 (0.22%) logstash
13 2 (0.22%) SCCM
13 2 (0.22%) ZABBIX
Vendors
1 145 (16.16%) Google
2 139 (15.50%) Cloudera
3 121 (13.49%) Oracle
4 111 (12.37%) Talend
5 98 (10.93%) Informatica
6 74 (8.25%) Databricks
6 74 (8.25%) Microsoft
7 58 (6.47%) Hortonworks
8 56 (6.24%) IBM
9 44 (4.91%) Teradata
10 21 (2.34%) Red Hat
11 18 (2.01%) SAP
12 17 (1.90%) Splunk
13 15 (1.67%) VMware
14 13 (1.45%) Salesforce.com
15 8 (0.89%) Alteryx
15 8 (0.89%) AppDynamics
16 6 (0.67%) Ab Initio
16 6 (0.67%) Facebook
16 6 (0.67%) Yahoo!
181 Hadoop job vacancies Nationwide