Period
to 5 August 2020

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 5 August 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > UK excluding London
6 months to
5 Aug 2020
Same period 2019 Same period 2018
Rank 267 282 252
Rank change year-on-year +15 -30 +20
Permanent jobs citing Hadoop 369 957 1,302
As % of all permanent jobs advertised in the UK excluding London 1.01% 1.16% 1.34%
As % of the Database & Business Intelligence category 3.71% 4.34% 4.55%
Number of salaries quoted 250 724 1,077
Median annual salary £63,750 £56,500 £55,000
Median salary % change year-on-year +12.83% +2.73% +4.76%
10th Percentile £40,225 £38,000 £36,250
90th Percentile £85,000 £78,000 £81,250
UK median annual salary £72,500 £70,000 £65,000
% change year-on-year +3.57% +7.69% +4.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 9,939 22,051 28,629
As % of all permanent IT jobs advertised in the UK excluding London 27.11% 26.80% 29.44%
Number of salaries quoted 8,162 17,936 23,947
Median annual salary £47,500 £45,000 £45,000
Median salary % change year-on-year +5.56% - +5.88%
10th Percentile £31,250 £29,000 £28,000
90th Percentile £70,000 £67,500 £65,000
UK median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Hadoop
Job Vacancy Trend in the UK excluding London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Hadoop in the UK excluding London

Hadoop
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Hadoop in the UK excluding London.

Salary trend for Hadoop in the UK excluding London

Hadoop
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Hadoop in the UK excluding London over the 6 months to 5 August 2020.

Salary histogram for Hadoop in the UK excluding London

Hadoop
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK excluding London region over the 6 months to 5 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East +51 124 £67,500 +17.39% 11
Midlands +33 60 £70,000 +16.67% 17
South West -52 49 £55,000 - 3
Scotland +59 47 £55,000 - 20
North of England +85 42 £55,000 +4.76% 14
East Midlands +19 41 £75,000 +27.66% 16
North West +83 25 £55,000 -4.35% 5
Wales +59 24 £45,000 +15.38%
East of England +78 22 £70,000 - 4
West Midlands +53 19 £53,750 -10.42% 1
Yorkshire +74 11 £60,000 +20.00% 8
North East +21 6 £57,500 +5.50% 1
Northern Ireland +22 1 - -
Hadoop
UK

For the 6 months to 5 August 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Hadoop.

1 236 (63.96%) Apache Spark
2 231 (62.60%) Big Data
3 185 (50.14%) Python
4 170 (46.07%) Java
5 127 (34.42%) Analytics
5 127 (34.42%) AWS
6 125 (33.88%) Agile Software Development
7 123 (33.33%) SQL
8 114 (30.89%) Azure
9 112 (30.35%) Kafka
10 103 (27.91%) Finance
11 97 (26.29%) DevOps
12 90 (24.39%) NoSQL
13 85 (23.04%) Software Engineering
14 84 (22.76%) Degree
14 84 (22.76%) Scala
15 81 (21.95%) MongoDB
16 80 (21.68%) Business Intelligence
17 78 (21.14%) Machine Learning
18 76 (20.60%) SQL Server
19 73 (19.78%) Docker
20 72 (19.51%) Linux
21 71 (19.24%) R
22 67 (18.16%) ETL
23 66 (17.89%) JavaScript
24 65 (17.62%) Apache Hive
24 65 (17.62%) Data Analytics
25 64 (17.34%) Data Warehouse
26 63 (17.07%) Data Science
27 58 (15.72%) Data Modelling

Hadoop
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 236 (63.96%) Apache Spark
2 52 (14.09%) Apache
3 32 (8.67%) Elasticsearch
4 26 (7.05%) SAS
5 11 (2.98%) Apache Pig
6 10 (2.71%) Apache Airflow
6 10 (2.71%) CMS
6 10 (2.71%) Luigi
7 9 (2.44%) Apache Solr
7 9 (2.44%) Mule
8 8 (2.17%) Jupyter
8 8 (2.17%) Oracle Coherence
9 7 (1.90%) Cloud Foundry
9 7 (1.90%) SharePoint
10 6 (1.63%) OpenStack
11 5 (1.36%) JBoss
11 5 (1.36%) Tomcat
12 4 (1.08%) nginx
13 3 (0.81%) Confluence
13 3 (0.81%) Pachyderm
Applications
1 7 (1.90%) Microsoft Excel
2 2 (0.54%) Microsoft Office
2 2 (0.54%) Microsoft PowerPoint
2 2 (0.54%) MS Visio
3 1 (0.27%) Chatbot
3 1 (0.27%) SPSS
Business Applications
1 5 (1.36%) SAP CRM
1 5 (1.36%) SAP ERP
1 5 (1.36%) SAP IS-U
2 4 (1.08%) Eikon
3 1 (0.27%) ENOVIA
Cloud Services
1 127 (34.42%) AWS
2 114 (30.89%) Azure
3 40 (10.84%) Power Platform
4 28 (7.59%) GCP
5 23 (6.23%) Amazon EC2
6 22 (5.96%) Amazon EMR
7 13 (3.52%) Azure Data Factory
8 12 (3.25%) Amazon Kinesis
9 10 (2.71%) Amazon S3
9 10 (2.71%) Logic Apps
9 10 (2.71%) PaaS
9 10 (2.71%) SaaS
10 8 (2.17%) Serverless
11 7 (1.90%) Cortana Intelligence Suite
12 6 (1.63%) Cloud Computing
13 5 (1.36%) AWS Lambda
13 5 (1.36%) GitHub
14 4 (1.08%) Amazon ECS
14 4 (1.08%) Amazon EKS
14 4 (1.08%) IBM Cloud
Communications & Networking
1 9 (2.44%) FTP
2 5 (1.36%) SSL
2 5 (1.36%) TCP/IP
3 3 (0.81%) Modbus
3 3 (0.81%) MQTT
3 3 (0.81%) Profibus
3 3 (0.81%) RS-232
3 3 (0.81%) RS-485
4 2 (0.54%) HTTP
4 2 (0.54%) Network Security
4 2 (0.54%) SSH
5 1 (0.27%) Firewall
5 1 (0.27%) Multicast
Database & Business Intelligence
1 231 (62.60%) Big Data
2 90 (24.39%) NoSQL
3 81 (21.95%) MongoDB
4 76 (20.60%) SQL Server
5 65 (17.62%) Apache Hive
6 64 (17.34%) Data Warehouse
7 56 (15.18%) Apache Cassandra
8 49 (13.28%) HBase
9 40 (10.84%) Power BI
10 39 (10.57%) Amazon Redshift
10 39 (10.57%) Data Lake
11 36 (9.76%) Impala
12 32 (8.67%) PostgreSQL
13 29 (7.86%) SQL Server Reporting Services
14 26 (7.05%) MySQL
15 25 (6.78%) SQL Server Integration Services
16 21 (5.69%) Relational Database
17 17 (4.61%) Azure SQL Data Warehouse
18 16 (4.34%) Cosmos DB
18 16 (4.34%) SQL Server 2016
Development Applications
1 34 (9.21%) Jenkins
2 19 (5.15%) Git (software)
3 18 (4.88%) Cucumber
4 13 (3.52%) JUnit
5 8 (2.17%) JIRA
6 6 (1.63%) ER Studio
6 6 (1.63%) ERwin
6 6 (1.63%) PowerDesigner
7 5 (1.36%) Atlassian Bamboo
8 4 (1.08%) Artifactory
8 4 (1.08%) TeamCity
8 4 (1.08%) Vagrant
8 4 (1.08%) Visual Studio
9 3 (0.81%) Moq
9 3 (0.81%) Sonatype Nexus
9 3 (0.81%) Subversion
10 2 (0.54%) Bitbucket
10 2 (0.54%) GitLab
10 2 (0.54%) Maven
11 1 (0.27%) Gradle
General
1 103 (27.91%) Finance
2 31 (8.40%) Banking
3 18 (4.88%) Marketing
4 13 (3.52%) Aerospace
4 13 (3.52%) Investment Banking
5 11 (2.98%) Manufacturing
6 10 (2.71%) Retail
7 8 (2.17%) Public Sector
8 5 (1.36%) Military
9 4 (1.08%) Electronics
10 2 (0.54%) Advertising
10 2 (0.54%) Legal
10 2 (0.54%) Pharmaceutical
10 2 (0.54%) Private Banking
10 2 (0.54%) Retail Banking
10 2 (0.54%) Telecoms
11 1 (0.27%) Financial Institution
11 1 (0.27%) Games
11 1 (0.27%) Publishing
Job Titles
1 97 (26.29%) Developer
2 76 (20.60%) Data Engineer
3 55 (14.91%) Architect
4 40 (10.84%) Software Engineer
5 36 (9.76%) Data Architect
6 33 (8.94%) Java Developer
7 26 (7.05%) Big Data Engineer
7 26 (7.05%) Senior Developer
8 20 (5.42%) Consultant
9 18 (4.88%) Data Scientist
10 16 (4.34%) DevOps Engineer
11 14 (3.79%) Big Data Architect
12 13 (3.52%) Big Data Software Engineer
12 13 (3.52%) Solutions Architect
13 12 (3.25%) Administrator
13 12 (3.25%) Big Data Developer
13 12 (3.25%) Python Engineer
13 12 (3.25%) Senior Java Developer
14 11 (2.98%) Analyst
14 11 (2.98%) Enterprise Data Architect
Libraries, Frameworks & Software Standards
1 112 (30.35%) Kafka
2 43 (11.65%) Spring
3 38 (10.30%) Node.js
4 31 (8.40%) HTML
4 31 (8.40%) Spring Boot
5 26 (7.05%) .NET
6 22 (5.96%) AngularJS
7 20 (5.42%) React
8 17 (4.61%) REST
9 16 (4.34%) Spark Streaming
10 14 (3.79%) Ajax
10 14 (3.79%) Apache NiFi
10 14 (3.79%) CSS
11 12 (3.25%) Web Services
12 11 (2.98%) Enzyme
12 11 (2.98%) Jest
12 11 (2.98%) RabbitMQ
13 10 (2.71%) JSON
14 9 (2.44%) JMS
14 9 (2.44%) JSP
Miscellaneous
1 51 (13.82%) Analytical Skills
2 14 (3.79%) Management Information System
3 12 (3.25%) Greenfield Project
4 11 (2.98%) Algorithms
4 11 (2.98%) Data Structures
5 10 (2.71%) Blog
5 10 (2.71%) Data Centre
6 9 (2.44%) Enterprise Software
7 8 (2.17%) Public Cloud
7 8 (2.17%) Reinsurance
8 7 (1.90%) Credit Risk
8 7 (1.90%) User Experience
9 5 (1.36%) Analytical Mindset
9 5 (1.36%) Self-Motivation
10 4 (1.08%) Acoustics
10 4 (1.08%) Cloud Native
10 4 (1.08%) Driving Licence
10 4 (1.08%) Replication
11 3 (0.81%) Virtual Team
12 2 (0.54%) Linux Command Line
Operating Systems
1 72 (19.51%) Linux
2 36 (9.76%) Unix
3 21 (5.69%) Windows
4 8 (2.17%) Red Hat Enterprise Linux
5 3 (0.81%) Android
5 3 (0.81%) Apple iOS
5 3 (0.81%) CentOS
6 1 (0.27%) Debian
6 1 (0.27%) Ubuntu
Processes & Methodologies
1 127 (34.42%) Analytics
2 125 (33.88%) Agile Software Development
3 97 (26.29%) DevOps
4 85 (23.04%) Software Engineering
5 80 (21.68%) Business Intelligence
6 78 (21.14%) Machine Learning
7 67 (18.16%) ETL
8 65 (17.62%) Data Analytics
9 63 (17.07%) Data Science
10 58 (15.72%) Data Modelling
11 49 (13.28%) Microservices
12 47 (12.74%) Scrum
13 44 (11.92%) Visualisation
14 43 (11.65%) Computer Science
14 43 (11.65%) TDD
15 39 (10.57%) Data Analysis
16 36 (9.76%) Data Visualisation
16 36 (9.76%) OO
17 31 (8.40%) Artificial Intelligence
18 30 (8.13%) Data Integration
Programming Languages
1 185 (50.14%) Python
2 170 (46.07%) Java
3 123 (33.33%) SQL
4 84 (22.76%) Scala
5 71 (19.24%) R
6 66 (17.89%) JavaScript
7 44 (11.92%) C++
8 43 (11.65%) C#
9 26 (7.05%) Java 8
10 20 (5.42%) Bash Shell
11 17 (4.61%) C
12 16 (4.34%) Ruby
13 14 (3.79%) Perl
14 12 (3.25%) Go
15 10 (2.71%) Shell Script
16 9 (2.44%) HiveQL
16 9 (2.44%) Korn
16 9 (2.44%) PowerShell
17 7 (1.90%) PL/SQL
18 5 (1.36%) MATLAB
Qualifications
1 84 (22.76%) Degree
2 53 (14.36%) Security Cleared
3 36 (9.76%) Computer Science Degree
4 32 (8.67%) DV Cleared
4 32 (8.67%) SC Cleared
5 16 (4.34%) Master's Degree
6 10 (2.71%) Numerate Degree
7 8 (2.17%) TOGAF Certification
8 4 (1.08%) PhD
9 3 (0.81%) AWS Certification
10 1 (0.27%) BPSS Clearance
10 1 (0.27%) HND
Quality Assurance & Compliance
1 11 (2.98%) Data Quality
1 11 (2.98%) Sarbanes-Oxley
2 6 (1.63%) ISO/IEC 27001
3 2 (0.54%) QA
4 1 (0.27%) Basel III
4 1 (0.27%) COREP
4 1 (0.27%) CRD IV
4 1 (0.27%) IFRS
4 1 (0.27%) IFRS 9
4 1 (0.27%) SLA
System Software
1 73 (19.78%) Docker
2 42 (11.38%) HDFS
3 12 (3.25%) Apache ZooKeeper
3 12 (3.25%) VMware Infrastructure
4 4 (1.08%) Hyper-V
4 4 (1.08%) Varnish
4 4 (1.08%) VirtualBox
5 3 (0.81%) Apache Flume
5 3 (0.81%) Microsoft Virtual Server
5 3 (0.81%) Virtual Servers
5 3 (0.81%) vSphere
6 1 (0.27%) Active Directory
Systems Management
1 56 (15.18%) Ansible
2 38 (10.30%) Kubernetes
3 17 (4.61%) Puppet
4 14 (3.79%) Kibana
4 14 (3.79%) Terraform
5 8 (2.17%) SCCM
6 7 (1.90%) Hadoop YARN
6 7 (1.90%) Opscode Chef
7 6 (1.63%) logstash
7 6 (1.63%) Salt
8 4 (1.08%) Docker Swarm
9 3 (0.81%) Mesos
10 2 (0.54%) Fluentd
10 2 (0.54%) Single Sign-On
11 1 (0.27%) Ambari
11 1 (0.27%) Oozie
11 1 (0.27%) Prometheus
11 1 (0.27%) SELinux
11 1 (0.27%) ZABBIX
Vendors
1 58 (15.72%) Oracle
2 43 (11.65%) Microsoft
3 42 (11.38%) Teradata
4 34 (9.21%) Cloudera
5 27 (7.32%) Google
5 27 (7.32%) Splunk
6 24 (6.50%) Informatica
7 23 (6.23%) Tableau
8 21 (5.69%) Databricks
9 16 (4.34%) Atlassian
10 14 (3.79%) Hortonworks
11 13 (3.52%) IBM
11 13 (3.52%) VMware
12 12 (3.25%) Talend
13 11 (2.98%) Netezza
14 10 (2.71%) Cognos
15 7 (1.90%) Ab Initio
15 7 (1.90%) SAP
16 4 (1.08%) MapR
17 3 (0.81%) Alteryx