Period
to 27 January 2021

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 27 January 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > UK excluding London
6 months to
27 Jan 2021
Same period 2020 Same period 2019
Rank 351 309 248
Rank change year-on-year -42 -61 +41
Permanent jobs citing Hadoop 261 655 1,131
As % of all permanent jobs advertised in the UK excluding London 0.71% 0.93% 1.35%
As % of the Database & Business Intelligence category 2.62% 3.55% 4.77%
Number of salaries quoted 249 560 909
Median annual salary £57,500 £57,500 £60,000
Median salary % change year-on-year - -4.17% +14.29%
10th Percentile £39,750 £37,560 £37,500
90th Percentile £82,500 £85,000 £85,000
UK median annual salary £67,500 £70,000 £70,000
% change year-on-year -3.57% - +7.69%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 9,973 18,426 23,697
As % of all permanent IT jobs advertised in the UK excluding London 26.99% 26.18% 28.28%
Number of salaries quoted 8,363 15,283 19,642
Median annual salary £49,000 £45,000 £45,000
Median salary % change year-on-year +8.89% - +5.88%
10th Percentile £31,897 £29,750 £28,569
90th Percentile £71,250 £68,750 £70,000
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +9.38%

Hadoop
Job Vacancy Trend in the UK excluding London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Hadoop in the UK excluding London

Hadoop
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Hadoop in the UK excluding London.

Salary trend for Hadoop in the UK excluding London

Hadoop
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Hadoop in the UK excluding London over the 6 months to 27 January 2021.

Salary histogram for Hadoop in the UK excluding London

Hadoop
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK excluding London region over the 6 months to 27 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East +27 53 £50,000 - 15
North of England +20 47 £55,000 +0.30% 25
Midlands -10 47 £57,500 -17.86% 20
Scotland +21 43 £62,500 +20.71% 2
South West +17 40 £72,500 +38.10% 6
Yorkshire +7 25 £55,000 - 13
East Midlands +3 24 £55,500 -23.45% 7
West Midlands +11 23 £60,000 -3.23% 13
North West +51 21 £55,000 +0.94% 12
East of England +67 15 £87,500 +16.67% 4
Wales - 14 £45,000 - 2
Northern Ireland - 2 £63,750 -
North East +5 1 £42,000 -23.18%
Hadoop
UK

For the 6 months to 27 January 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Hadoop.

1 140 (53.64%) Python
1 140 (53.64%) Apache Spark
2 135 (51.72%) Big Data
3 110 (42.15%) SQL
4 104 (39.85%) Java
4 104 (39.85%) Azure
5 103 (39.46%) Kafka
6 98 (37.55%) AWS
7 83 (31.80%) Analytics
8 76 (29.12%) DevOps
9 74 (28.35%) Apache Hive
10 72 (27.59%) NoSQL
11 66 (25.29%) Agile Software Development
12 65 (24.90%) Docker
13 59 (22.61%) ETL
14 56 (21.46%) Finance
15 53 (20.31%) Data Warehouse
16 51 (19.54%) Software Engineering
16 51 (19.54%) Jenkins
17 50 (19.16%) Scala
17 50 (19.16%) SQL Server
17 50 (19.16%) Data Lake
17 50 (19.16%) Data Science
18 49 (18.77%) JavaScript
18 49 (18.77%) Ansible
18 49 (18.77%) Kubernetes
19 48 (18.39%) HBase
20 47 (18.01%) Apache Cassandra
20 47 (18.01%) Apache
21 45 (17.24%) Linux

Hadoop
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 140 (53.64%) Apache Spark
2 47 (18.01%) Apache
3 21 (8.05%) Elasticsearch
4 20 (7.66%) SAS
5 16 (6.13%) Apache Airflow
6 13 (4.98%) Luigi
7 11 (4.21%) Confluence
8 10 (3.83%) Apache Synapse
9 9 (3.45%) Tomcat
10 6 (2.30%) Apache Solr
11 2 (0.77%) Apache Pig
11 2 (0.77%) Jupyter
11 2 (0.77%) WebLogic
12 1 (0.38%) BizTalk Server
12 1 (0.38%) Cloud Foundry
12 1 (0.38%) CloudStack
12 1 (0.38%) IIS
12 1 (0.38%) JBoss
12 1 (0.38%) OpenStack
12 1 (0.38%) WebSphere
Applications
1 1 (0.38%) Chatbot
1 1 (0.38%) Microsoft Office
Business Applications
1 1 (0.38%) Dynamics CRM
1 1 (0.38%) SAP FI-CA
1 1 (0.38%) SAP PSCD
Cloud Services
1 104 (39.85%) Azure
2 98 (37.55%) AWS
3 39 (14.94%) GCP
4 18 (6.90%) Power Platform
5 11 (4.21%) Amazon Kinesis
5 11 (4.21%) Azure Data Factory
6 9 (3.45%) Amazon EMR
6 9 (3.45%) OpenShift
7 8 (3.07%) Logic Apps
7 8 (3.07%) SaaS
8 6 (2.30%) Amazon EC2
8 6 (2.30%) Serverless
9 5 (1.92%) Amazon S3
9 5 (1.92%) AWS Lambda
10 4 (1.53%) Cloud Computing
11 3 (1.15%) AWS CloudFormation
12 2 (0.77%) PaaS
13 1 (0.38%) Amazon SQS
13 1 (0.38%) Datadog
13 1 (0.38%) GitHub
Communications & Networking
1 8 (3.07%) NetScaler
2 3 (1.15%) Firewall
3 2 (0.77%) Kerberos
3 2 (0.77%) SSL
4 1 (0.38%) 3G
4 1 (0.38%) 4G
4 1 (0.38%) 5G
4 1 (0.38%) AMQP
4 1 (0.38%) HTTP
4 1 (0.38%) Multicast
4 1 (0.38%) TCP/IP
4 1 (0.38%) VLAN
4 1 (0.38%) Wi-Fi
Database & Business Intelligence
1 135 (51.72%) Big Data
2 74 (28.35%) Apache Hive
3 72 (27.59%) NoSQL
4 53 (20.31%) Data Warehouse
5 50 (19.16%) Data Lake
5 50 (19.16%) SQL Server
6 48 (18.39%) HBase
7 47 (18.01%) Apache Cassandra
8 37 (14.18%) Amazon Redshift
9 34 (13.03%) MongoDB
10 30 (11.49%) SQL Server Integration Services
11 28 (10.73%) PostgreSQL
12 26 (9.96%) SQL Server Reporting Services
13 25 (9.58%) Relational Database
14 21 (8.05%) Impala
14 21 (8.05%) Oracle Database
15 19 (7.28%) MySQL
16 18 (6.90%) Power BI
17 16 (6.13%) Pentaho
18 15 (5.75%) Amazon Athena
Development Applications
1 51 (19.54%) Jenkins
2 42 (16.09%) Git (software)
3 24 (9.20%) Maven
4 22 (8.43%) Bitbucket
5 17 (6.51%) Artifactory
5 17 (6.51%) JIRA
6 7 (2.68%) Cucumber
7 6 (2.30%) Team Foundation Server
7 6 (2.30%) Visual Studio
8 4 (1.53%) Gradle
9 3 (1.15%) SonarQube
9 3 (1.15%) Sonatype Nexus
9 3 (1.15%) TeamCity
10 2 (0.77%) CA Release Automation
10 2 (0.77%) CircleCI
10 2 (0.77%) PowerBuilder
10 2 (0.77%) Subversion
11 1 (0.38%) Oracle Forms
11 1 (0.38%) Selenium
11 1 (0.38%) Toad
General
1 56 (21.46%) Finance
2 20 (7.66%) Public Sector
3 14 (5.36%) Telecoms
4 12 (4.60%) Retail
5 11 (4.21%) Advertising
5 11 (4.21%) Marketing
6 6 (2.30%) Banking
7 4 (1.53%) Games
7 4 (1.53%) Military
8 3 (1.15%) Automotive
8 3 (1.15%) Legal
8 3 (1.15%) Pharmaceutical
9 2 (0.77%) Electronics
10 1 (0.38%) Dutch Language
10 1 (0.38%) Financial Institution
10 1 (0.38%) French Language
10 1 (0.38%) German Language
10 1 (0.38%) Italian Language
10 1 (0.38%) Law
10 1 (0.38%) Spanish Language
Job Titles
1 85 (32.57%) Data Engineer
2 49 (18.77%) Developer
3 31 (11.88%) Architect
3 31 (11.88%) Big Data Engineer
4 26 (9.96%) Java Engineer
5 16 (6.13%) Data Architect
6 15 (5.75%) Linux Engineer
6 15 (5.75%) Senior Developer
6 15 (5.75%) Software Engineer
7 12 (4.60%) DevOps Engineer
7 12 (4.60%) ETL Developer
7 12 (4.60%) Python Developer
8 11 (4.21%) Full Stack Developer
8 11 (4.21%) Java Developer
9 10 (3.83%) Consultant
9 10 (3.83%) JavaScript Developer
9 10 (3.83%) Senior Java Engineer
10 9 (3.45%) Data Consultant
10 9 (3.45%) Graduate
10 9 (3.45%) Junior
Libraries, Frameworks & Software Standards
1 103 (39.46%) Kafka
2 30 (11.49%) Web Services
3 24 (9.20%) Node.js
4 23 (8.81%) REST
5 22 (8.43%) React
6 19 (7.28%) AngularJS
7 17 (6.51%) Spring
8 16 (6.13%) HTML
9 15 (5.75%) Apache NiFi
10 14 (5.36%) CSS
11 13 (4.98%) .NET
11 13 (4.98%) JMS
12 10 (3.83%) KnockoutJS
12 10 (3.83%) Vue.js
13 9 (3.45%) RabbitMQ
13 9 (3.45%) XML
14 8 (3.07%) RESTful
14 8 (3.07%) Spark Streaming
14 8 (3.07%) Spring Boot
15 7 (2.68%) Esper
Miscellaneous
1 14 (5.36%) Analytical Skills
1 14 (5.36%) Data Centre
1 14 (5.36%) Video on Demand
2 13 (4.98%) Algorithms
3 9 (3.45%) PKI
4 7 (2.68%) Management Information System
4 7 (2.68%) Self-Motivation
5 6 (2.30%) Cloud Native
5 6 (2.30%) Enterprise Software
6 5 (1.92%) Data Structures
7 4 (1.53%) Driving Licence
7 4 (1.53%) Replication
8 3 (1.15%) Blog
8 3 (1.15%) Cyberattack
8 3 (1.15%) Distributed Denial-of-Service
8 3 (1.15%) Hybrid Cloud
8 3 (1.15%) NHS
8 3 (1.15%) User Experience
9 2 (0.77%) Analytical Mindset
9 2 (0.77%) Public Cloud
Operating Systems
1 45 (17.24%) Linux
2 17 (6.51%) Windows
3 15 (5.75%) CentOS
3 15 (5.75%) Red Hat Enterprise Linux
3 15 (5.75%) Unix
4 10 (3.83%) Windows Server
Processes & Methodologies
1 83 (31.80%) Analytics
2 76 (29.12%) DevOps
3 66 (25.29%) Agile Software Development
4 59 (22.61%) ETL
5 51 (19.54%) Software Engineering
6 50 (19.16%) Data Science
7 42 (16.09%) Data Engineering
8 41 (15.71%) Business Intelligence
9 37 (14.18%) Data Modelling
10 32 (12.26%) Machine Learning
11 29 (11.11%) Microservices
12 28 (10.73%) Scrum
13 25 (9.58%) Computer Science
14 23 (8.81%) OO
14 23 (8.81%) Visualisation
15 22 (8.43%) Data Integration
16 21 (8.05%) Continuous Integration
17 19 (7.28%) Project Delivery
18 18 (6.90%) Data Architecture
18 18 (6.90%) SDLC
Programming Languages
1 140 (53.64%) Python
2 110 (42.15%) SQL
3 104 (39.85%) Java
4 50 (19.16%) Scala
5 49 (18.77%) JavaScript
6 25 (9.58%) C#
7 17 (6.51%) Bash Shell
7 17 (6.51%) C++
7 17 (6.51%) R
8 16 (6.13%) PL/SQL
9 12 (4.60%) Go
10 9 (3.45%) Shell Script
11 8 (3.07%) Perl
12 7 (2.68%) T-SQL
13 5 (1.92%) PowerShell
14 3 (1.15%) Julia
14 3 (1.15%) VBScript
15 2 (0.77%) Java 8
15 2 (0.77%) Ruby
15 2 (0.77%) TypeScript
Qualifications
1 20 (7.66%) Degree
2 14 (5.36%) Security Cleared
3 11 (4.21%) Computer Science Degree
4 8 (3.07%) RHCE
5 6 (2.30%) SC Cleared
6 4 (1.53%) PhD
7 3 (1.15%) DV Cleared
7 3 (1.15%) MCDBA
7 3 (1.15%) MCT
7 3 (1.15%) Microsoft Certification
7 3 (1.15%) Numerate Degree
8 2 (0.77%) AWS Certification
9 1 (0.38%) DBS Check
9 1 (0.38%) HND
9 1 (0.38%) ISEB
9 1 (0.38%) ISTQB
9 1 (0.38%) ISTQB Foundation Certification
9 1 (0.38%) Sun Certification
Quality Assurance & Compliance
1 14 (5.36%) Data Quality
2 7 (2.68%) SLA
3 4 (1.53%) QA
4 1 (0.38%) Basel III
4 1 (0.38%) COREP
4 1 (0.38%) CRD IV
4 1 (0.38%) GDPR
4 1 (0.38%) ISO 26262
4 1 (0.38%) ISO/IEC 27001
System Software
1 65 (24.90%) Docker
2 33 (12.64%) HDFS
3 18 (6.90%) Apache ZooKeeper
4 15 (5.75%) Active Directory
5 9 (3.45%) VMware Infrastructure
6 8 (3.07%) vSphere
6 8 (3.07%) XenApp
6 8 (3.07%) XenDesktop
7 1 (0.38%) Oracle RAC
7 1 (0.38%) Tivoli Workload Scheduler
Systems Management
1 49 (18.77%) Ansible
1 49 (18.77%) Kubernetes
2 38 (14.56%) Terraform
3 21 (8.05%) Puppet
4 18 (6.90%) Hadoop YARN
5 12 (4.60%) Opscode Chef
6 7 (2.68%) Graphite
6 7 (2.68%) Nagios
6 7 (2.68%) Opsview
7 6 (2.30%) Oozie
8 3 (1.15%) Prometheus
9 2 (0.77%) Kibana
10 1 (0.38%) Cobbler
10 1 (0.38%) Data Guard
10 1 (0.38%) Failover Clustering
10 1 (0.38%) Grafana
10 1 (0.38%) Mesos
10 1 (0.38%) Microsoft Clustering
10 1 (0.38%) SCCM
10 1 (0.38%) Tivoli
Vendors
1 36 (13.79%) Cloudera
2 33 (12.64%) Oracle
3 31 (11.88%) Microsoft
4 24 (9.20%) Teradata
5 22 (8.43%) Talend
6 18 (6.90%) Databricks
7 16 (6.13%) Google
7 16 (6.13%) Informatica
7 16 (6.13%) Red Hat
7 16 (6.13%) VMware
8 8 (3.07%) F5
9 7 (2.68%) Ab Initio
9 7 (2.68%) Yahoo!
10 6 (2.30%) Splunk
11 3 (1.15%) Solace
12 1 (0.38%) Atlassian
12 1 (0.38%) MuleSoft
12 1 (0.38%) RapidMiner
12 1 (0.38%) Salesforce.com
12 1 (0.38%) TIBCO