Job Vacancy Trend Salary Trend Salary Histogram Job Locations Skill Sets
Period
to 13 April 2021

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 13 April 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > UK excluding London
6 months to
13 Apr 2021		 Same period 2020 Same period 2019
Rank 379 305 270
Rank change year-on-year -74 -35 -11
Permanent jobs citing Hadoop 292 605 1,045
As % of all permanent jobs advertised in the UK excluding London 0.63% 0.95% 1.24%
As % of the Database & Business Intelligence category 2.48% 3.60% 4.47%
Number of salaries quoted 240 454 771
10th Percentile £42,500 £41,625 £35,000
25th Percentile £48,750 £47,888 £45,000
Median annual salary (50th Percentile) £60,000 £60,000 £57,500
Median % change year-on-year - +4.35% +6.09%
75th Percentile £77,500 £78,750 £72,500
90th Percentile £95,000 £88,750 £80,250
UK median annual salary £70,000 £70,000 £70,000

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 11,789 16,805 23,396
As % of all permanent IT jobs advertised in the UK excluding London 25.54% 26.44% 27.86%
Number of salaries quoted 9,787 13,945 19,202
10th Percentile £31,250 £30,000 £28,500
25th Percentile £37,500 £36,250 £34,500
Median annual salary (50th Percentile) £48,500 £45,000 £45,000
Median % change year-on-year +7.78% - +5.88%
75th Percentile £60,000 £57,961 £57,500
90th Percentile £72,500 £70,000 £68,750
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +5.00%

Hadoop
Job Vacancy Trend in the UK excluding London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Hadoop in the UK excluding London

Hadoop
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Hadoop in the UK excluding London.

Salary trend for Hadoop in the UK excluding London

Hadoop
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Hadoop in the UK excluding London over the 6 months to 13 April 2021.

Salary histogram for Hadoop in the UK excluding London

Hadoop
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK excluding London region over the 6 months to 13 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
South East -33 69 £65,000 +8.33% 15
South West +20 62 £75,000 +30.43% 7
North of England +16 57 £55,000 +0.77% 16
Midlands -54 44 £57,500 -17.86% 11
North West +34 32 £58,750 +23.68% 13
Scotland -22 26 £62,500 +14.68% 10
Yorkshire -11 25 £55,000 +0.60% 3
West Midlands -18 23 £60,000 - 8
East Midlands -38 21 £55,500 -26.00% 3
East of England +39 20 £65,000 -13.33% 9
Wales +35 11 £50,000 -16.67% 5
Northern Ireland +4 2 £63,750 - 2
Isle of Man - 1 £37,500 -
Hadoop
UK

For the 6 months to 13 April 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Hadoop.

1 187 (64.04%) Python
1 187 (64.04%) Apache Spark
2 148 (50.68%) SQL
3 147 (50.34%) Big Data
4 136 (46.58%) Kafka
5 130 (44.52%) Azure
6 117 (40.07%) AWS
7 113 (38.70%) Java
8 100 (34.25%) NoSQL
9 97 (33.22%) Apache Hive
10 90 (30.82%) Analytics
11 80 (27.40%) ETL
11 80 (27.40%) Agile Software Development
12 76 (26.03%) Software Engineering
13 74 (25.34%) DevOps
14 72 (24.66%) Docker
15 61 (20.89%) JavaScript
15 61 (20.89%) Kubernetes
15 61 (20.89%) Terraform
16 60 (20.55%) Business Intelligence
17 58 (19.86%) Data Engineering
18 54 (18.49%) Scala
18 54 (18.49%) Data Science
19 53 (18.15%) Data Warehouse
20 51 (17.47%) SQL Server
21 50 (17.12%) Data Modelling
21 50 (17.12%) Data Lake
22 48 (16.44%) GCP
22 48 (16.44%) C#
23 47 (16.10%) MongoDB

Hadoop
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 187 (64.04%) Apache Spark
2 44 (15.07%) Apache
3 24 (8.22%) Elasticsearch
4 21 (7.19%) Apache Airflow
5 20 (6.85%) SAS
6 15 (5.14%) Luigi
7 9 (3.08%) Apache Synapse
8 8 (2.74%) Confluence
9 5 (1.71%) Apache Solr
10 4 (1.37%) Oracle Workflow
11 3 (1.03%) Cloud Foundry
11 3 (1.03%) CloudStack
11 3 (1.03%) IIS
11 3 (1.03%) nginx
11 3 (1.03%) OpenStack
12 2 (0.68%) Apache Pig
12 2 (0.68%) BizTalk Server
13 1 (0.34%) JBoss
13 1 (0.34%) Jetty
13 1 (0.34%) WebSphere
Applications
1 3 (1.03%) Chatbot
Business Applications
1 2 (0.68%) Dynamics CRM
Cloud Services
1 130 (44.52%) Azure
2 117 (40.07%) AWS
3 48 (16.44%) GCP
4 40 (13.70%) Power Platform
5 14 (4.79%) Azure Data Factory
6 13 (4.45%) Amazon Kinesis
7 10 (3.42%) Serverless
8 8 (2.74%) Logic Apps
9 7 (2.40%) Amazon S3
10 6 (2.05%) Amazon EMR
10 6 (2.05%) AWS Lambda
10 6 (2.05%) SaaS
11 5 (1.71%) Amazon EC2
12 4 (1.37%) AWS CloudFormation
13 3 (1.03%) Amazon EKS
13 3 (1.03%) Datadog
13 3 (1.03%) Matillion
13 3 (1.03%) npm
13 3 (1.03%) OpenShift
13 3 (1.03%) Pulumi
Communications & Networking
1 3 (1.03%) Firewall
1 3 (1.03%) TCP/IP
1 3 (1.03%) VLAN
2 2 (0.68%) Kerberos
3 1 (0.34%) AMQP
3 1 (0.34%) HTTP
3 1 (0.34%) Skype
Database & Business Intelligence
1 147 (50.34%) Big Data
2 100 (34.25%) NoSQL
3 97 (33.22%) Apache Hive
4 53 (18.15%) Data Warehouse
5 51 (17.47%) SQL Server
6 50 (17.12%) Data Lake
7 47 (16.10%) MongoDB
8 43 (14.73%) Apache Cassandra
9 40 (13.70%) HBase
9 40 (13.70%) Power BI
10 39 (13.36%) SQL Server Integration Services
11 36 (12.33%) SQL Server Reporting Services
12 33 (11.30%) PostgreSQL
13 29 (9.93%) Amazon Redshift
14 25 (8.56%) Relational Database
15 24 (8.22%) MySQL
16 20 (6.85%) Impala
17 18 (6.16%) Flink
17 18 (6.16%) Tableau
18 17 (5.82%) Amazon Athena
Development Applications
1 37 (12.67%) Jenkins
2 25 (8.56%) Git (software)
3 23 (7.88%) Maven
4 14 (4.79%) Bitbucket
5 10 (3.42%) JIRA
6 9 (3.08%) Team Foundation Server
6 9 (3.08%) Visual Studio
7 8 (2.74%) Artifactory
7 8 (2.74%) Gradle
8 7 (2.40%) Cucumber
9 5 (1.71%) SonarQube
10 3 (1.03%) GitLab
10 3 (1.03%) TeamCity
11 2 (0.68%) IntelliJ
11 2 (0.68%) Selenium
12 1 (0.34%) Subversion
12 1 (0.34%) Vagrant
General
1 41 (14.04%) Finance
2 18 (6.16%) Banking
3 17 (5.82%) Retail
4 16 (5.48%) Public Sector
5 14 (4.79%) Telecoms
6 8 (2.74%) Retail Banking
7 6 (2.05%) Games
7 6 (2.05%) Law
8 4 (1.37%) Legal
8 4 (1.37%) Marketing
9 3 (1.03%) Military
9 3 (1.03%) Pharmaceutical
10 1 (0.34%) Automotive
10 1 (0.34%) Electronics
Job Titles
1 112 (38.36%) Data Engineer
2 64 (21.92%) Developer
3 38 (13.01%) Big Data Engineer
4 36 (12.33%) Python Developer
5 35 (11.99%) Full Stack Developer
6 34 (11.64%) JavaScript Developer
7 28 (9.59%) Architect
8 26 (8.90%) Java Engineer
9 20 (6.85%) Data Architect
10 18 (6.16%) Senior Data Engineer
11 16 (5.48%) AWS Engineer
11 16 (5.48%) Software Engineer
12 15 (5.14%) Analyst
13 14 (4.79%) Senior Developer
14 13 (4.45%) DevOps Engineer
15 11 (3.77%) Java Developer
15 11 (3.77%) Python Engineer
15 11 (3.77%) Senior Java Engineer
16 8 (2.74%) Java Software Engineer
16 8 (2.74%) Solutions Architect
Libraries, Frameworks & Software Standards
1 136 (46.58%) Kafka
2 47 (16.10%) Node.js
3 45 (15.41%) React
4 39 (13.36%) AngularJS
5 37 (12.67%) REST
6 35 (11.99%) Vue.js
7 34 (11.64%) KnockoutJS
8 30 (10.27%) Web Services
9 17 (5.82%) Spring
10 15 (5.14%) Spring Boot
11 12 (4.11%) Apache NiFi
11 12 (4.11%) RabbitMQ
12 10 (3.42%) Spark Streaming
13 9 (3.08%) TensorFlow
14 8 (2.74%) .NET
15 6 (2.05%) ActiveMQ
15 6 (2.05%) Apache Beam
15 6 (2.05%) Esper
15 6 (2.05%) Samza
16 5 (1.71%) scikit-learn
Miscellaneous
1 26 (8.90%) Analytical Skills
2 14 (4.79%) Data Structures
2 14 (4.79%) Video on Demand
3 7 (2.40%) Algorithms
3 7 (2.40%) Management Information System
4 5 (1.71%) PKI
4 5 (1.71%) Self-Motivation
5 4 (1.37%) Data Centre
6 3 (1.03%) Analytical Mindset
6 3 (1.03%) Cloud Native
6 3 (1.03%) Cyberattack
6 3 (1.03%) Enterprise Software
6 3 (1.03%) Hybrid Cloud
6 3 (1.03%) Private Cloud
7 2 (0.68%) Cybercrime
7 2 (0.68%) Driving Licence
7 2 (0.68%) NHS
7 2 (0.68%) Public Cloud
7 2 (0.68%) Virtual Team
7 2 (0.68%) Wiki
Operating Systems
1 38 (13.01%) Linux
2 13 (4.45%) Red Hat Enterprise Linux
3 10 (3.42%) Unix
4 8 (2.74%) Windows
5 6 (2.05%) CentOS
6 1 (0.34%) AIX
6 1 (0.34%) Android
6 1 (0.34%) Apple iOS
6 1 (0.34%) Solaris
Processes & Methodologies
1 90 (30.82%) Analytics
2 80 (27.40%) Agile Software Development
2 80 (27.40%) ETL
3 76 (26.03%) Software Engineering
4 74 (25.34%) DevOps
5 60 (20.55%) Business Intelligence
6 58 (19.86%) Data Engineering
7 54 (18.49%) Data Science
8 50 (17.12%) Data Modelling
9 44 (15.07%) Fintech
10 42 (14.38%) Machine Learning
11 34 (11.64%) Data Architecture
12 33 (11.30%) Visualisation
13 26 (8.90%) Data Visualisation
14 25 (8.56%) Data Integration
15 24 (8.22%) Data Management
16 23 (7.88%) Workflow
17 22 (7.53%) Data Analytics
17 22 (7.53%) OO
18 21 (7.19%) Configuration Management
Programming Languages
1 187 (64.04%) Python
2 148 (50.68%) SQL
3 113 (38.70%) Java
4 61 (20.89%) JavaScript
5 54 (18.49%) Scala
6 48 (16.44%) C#
7 24 (8.22%) R
8 23 (7.88%) C++
9 22 (7.53%) Bash Shell
10 11 (3.77%) Go
10 11 (3.77%) T-SQL
11 10 (3.42%) PL/SQL
12 7 (2.40%) HiveQL
12 7 (2.40%) Perl
13 6 (2.05%) Shell Script
14 5 (1.71%) C
15 4 (1.37%) Data Analysis Expressions (DAX)
15 4 (1.37%) PowerShell
16 3 (1.03%) Julia
17 2 (0.68%) TypeScript
Qualifications
1 22 (7.53%) Security Cleared
2 19 (6.51%) Degree
3 13 (4.45%) SC Cleared
4 11 (3.77%) DV Cleared
5 8 (2.74%) PhD
6 4 (1.37%) Computer Science Degree
7 2 (0.68%) DBS Check
7 2 (0.68%) Numerate Degree
Quality Assurance & Compliance
1 10 (3.42%) Data Quality
2 4 (1.37%) QA
2 4 (1.37%) SLA
3 1 (0.34%) ISO/IEC 27001
System Software
1 72 (24.66%) Docker
2 32 (10.96%) HDFS
3 14 (4.79%) Apache ZooKeeper
4 7 (2.40%) Active Directory
4 7 (2.40%) Apache Flume
5 2 (0.68%) Firmware
6 1 (0.34%) Oracle RAC
6 1 (0.34%) VMware Infrastructure
Systems Management
1 61 (20.89%) Kubernetes
1 61 (20.89%) Terraform
2 35 (11.99%) Ansible
3 16 (5.48%) Hadoop YARN
4 14 (4.79%) Puppet
5 12 (4.11%) Opscode Chef
6 7 (2.40%) Graphite
6 7 (2.40%) Nagios
6 7 (2.40%) Opsview
7 6 (2.05%) Oozie
8 4 (1.37%) Prometheus
9 2 (0.68%) SCCM
10 1 (0.34%) Cobbler
10 1 (0.34%) Data Guard
10 1 (0.34%) Failover Clustering
10 1 (0.34%) Grafana
10 1 (0.34%) Kibana
10 1 (0.34%) logstash
10 1 (0.34%) Microsoft Clustering
Vendors
1 44 (15.07%) Microsoft
2 30 (10.27%) Cloudera
2 30 (10.27%) Oracle
3 29 (9.93%) Talend
4 28 (9.59%) Google
5 24 (8.22%) Databricks
6 22 (7.53%) Teradata
7 21 (7.19%) Informatica
8 7 (2.40%) VMware
9 6 (2.05%) IBM
9 6 (2.05%) Red Hat
9 6 (2.05%) Yahoo!
10 4 (1.37%) Ab Initio
10 4 (1.37%) ESRI
10 4 (1.37%) Splunk
11 3 (1.03%) RapidMiner
11 3 (1.03%) Salesforce.com
12 2 (0.68%) Cognos
12 2 (0.68%) Pega
12 2 (0.68%) SAP