Period
to 25 October 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 25 October 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
25 Oct 2020
Same period 2019 Same period 2018
Rank 239 230 194
Rank change year-on-year -9 -36 +9
Permanent jobs citing Hadoop 655 2,001 2,976
As % of all permanent jobs advertised in the UK 1.34% 1.47% 1.81%
As % of the Database & Business Intelligence category 4.71% 5.41% 6.11%
Number of salaries quoted 514 1,594 2,314
Median annual salary £70,000 £70,000 £67,500
Median salary % change year-on-year - +3.70% +12.50%
10th Percentile £42,500 £43,541 £40,000
90th Percentile £110,000 £105,000 £100,000
UK excluding London median annual salary £60,000 £55,000 £60,000
% change year-on-year +9.09% -8.33% +20.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 13,921 36,975 48,696
As % of all permanent IT jobs advertised in the UK 28.50% 27.16% 29.61%
Number of salaries quoted 11,738 30,377 39,701
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +4.17%
10th Percentile £33,750 £31,250 £31,250
90th Percentile £87,875 £86,250 £82,500
UK excluding London median annual salary £48,000 £45,000 £45,000
% change year-on-year +6.67% - +5.88%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

3-month moving average salary quoted in jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

Salary distribution for jobs citing Hadoop over the 6 months to 25 October 2020.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 25 October 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -10 586 £72,500 +3.57% 145
London -3 397 £77,500 - 85
UK excluding London +11 256 £60,000 +9.09% 75
South East +87 62 £65,000 +30.00% 18
Work from Home -20 62 £70,000 +31.16% 18
Midlands +66 53 £68,750 +14.58% 11
East Midlands +62 40 £70,000 +16.67% 5
Scotland +52 40 £62,500 +25.00% 12
South West -13 31 £62,500 +16.39% 7
Wales +75 28 £45,000 +15.38%
North of England +57 25 £53,750 -4.25% 16
East of England +114 17 £70,000 - 8
North West +95 13 £53,750 -10.42% 13
West Midlands +74 13 £57,500 +4.55% 6
Yorkshire +55 11 £55,000 - 3
North East +12 1 £42,000 -7.51%

For the 6 months to 25 October 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 419 (63.97%) Big Data
2 363 (55.42%) Python
3 358 (54.66%) Apache Spark
4 324 (49.47%) Java
5 316 (48.24%) AWS
6 271 (41.37%) SQL
7 251 (38.32%) Azure
8 239 (36.49%) Analytics
9 238 (36.34%) Agile Software Development
10 221 (33.74%) Kafka
11 197 (30.08%) Finance
12 189 (28.85%) Apache Hive
13 173 (26.41%) ETL
14 167 (25.50%) DevOps
15 154 (23.51%) Data Science
16 153 (23.36%) Degree
17 145 (22.14%) Scala
18 143 (21.83%) NoSQL
19 136 (20.76%) Software Engineering
20 132 (20.15%) Machine Learning
21 120 (18.32%) Kubernetes
22 117 (17.86%) Git (software)
23 116 (17.71%) Computer Science
24 113 (17.25%) Oracle
24 113 (17.25%) JavaScript
25 109 (16.64%) Cloudera
26 104 (15.88%) GCP
26 104 (15.88%) Apache Cassandra
27 102 (15.57%) Docker
27 102 (15.57%) Data Analytics

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 358 (54.66%) Apache Spark
2 81 (12.37%) SAS
3 80 (12.21%) Apache
4 53 (8.09%) Elasticsearch
5 26 (3.97%) Apache Airflow
6 20 (3.05%) Tomcat
7 16 (2.44%) Confluence
8 11 (1.68%) Luigi
9 9 (1.37%) Jupyter
10 8 (1.22%) Apache Pig
11 7 (1.07%) Cloud Foundry
11 7 (1.07%) CMS
12 6 (0.92%) OpenStack
13 5 (0.76%) Apache Synapse
13 5 (0.76%) Tornado
14 4 (0.61%) nginx
15 3 (0.46%) Apache Solr
15 3 (0.46%) Pachyderm
16 2 (0.31%) Mule
17 1 (0.15%) GlassFish
Applications
1 4 (0.61%) Microsoft Excel
2 2 (0.31%) Microsoft Office
2 2 (0.31%) Microsoft PowerPoint
2 2 (0.31%) MS Visio
Business Applications
1 4 (0.61%) Eikon
2 3 (0.46%) Distributed Ledger
2 3 (0.46%) Oracle Cash Management
3 1 (0.15%) Dynamics CRM
3 1 (0.15%) SAP FI-CA
3 1 (0.15%) SAP Hybris
3 1 (0.15%) SAP PSCD
Cloud Services
1 316 (48.24%) AWS
2 251 (38.32%) Azure
3 104 (15.88%) GCP
4 79 (12.06%) Power Platform
5 34 (5.19%) Amazon EMR
5 34 (5.19%) Amazon S3
6 30 (4.58%) SaaS
7 25 (3.82%) Amazon EC2
8 22 (3.36%) Serverless
9 19 (2.90%) Amazon Kinesis
9 19 (2.90%) AWS Lambda
10 17 (2.60%) PaaS
11 15 (2.29%) IaaS
12 14 (2.14%) OpenShift
13 13 (1.98%) Amazon SQS
13 13 (1.98%) Azure Data Factory
13 13 (1.98%) Logic Apps
14 8 (1.22%) AWS CloudFormation
15 7 (1.07%) Amazon ECS
15 7 (1.07%) Office 365
Communications & Networking
1 20 (3.05%) HTTP
2 11 (1.68%) TCP/IP
3 9 (1.37%) Kerberos
4 8 (1.22%) 5G
4 8 (1.22%) Firewall
4 8 (1.22%) NetScaler
4 8 (1.22%) SSH
5 7 (1.07%) Internet
6 6 (0.92%) FTP
6 6 (0.92%) SSL
7 4 (0.61%) DSL
8 3 (0.46%) HTTPS
8 3 (0.46%) Wireless
9 2 (0.31%) Modbus
9 2 (0.31%) MQTT
9 2 (0.31%) Network Security
9 2 (0.31%) Profibus
9 2 (0.31%) RS-232
9 2 (0.31%) RS-485
10 1 (0.15%) 4G
Database & Business Intelligence
1 419 (63.97%) Big Data
2 189 (28.85%) Apache Hive
3 143 (21.83%) NoSQL
4 104 (15.88%) Apache Cassandra
5 100 (15.27%) Data Warehouse
6 90 (13.74%) SQL Server
7 89 (13.59%) MongoDB
8 85 (12.98%) Impala
9 82 (12.52%) Data Lake
10 80 (12.21%) Amazon Redshift
11 79 (12.06%) Power BI
12 73 (11.15%) HBase
13 72 (10.99%) Tableau
14 61 (9.31%) Oracle Database
15 60 (9.16%) PostgreSQL
16 59 (9.01%) Relational Database
17 57 (8.70%) Pentaho
18 45 (6.87%) BusinessObjects
19 43 (6.56%) MySQL
20 38 (5.80%) Flink
Development Applications
1 117 (17.86%) Git (software)
2 90 (13.74%) Jenkins
3 32 (4.89%) JIRA
4 31 (4.73%) Bitbucket
4 31 (4.73%) Maven
5 25 (3.82%) Cucumber
6 23 (3.51%) Artifactory
7 19 (2.90%) TeamCity
8 14 (2.14%) Atlassian Bamboo
9 12 (1.83%) Sonatype Nexus
10 9 (1.37%) JUnit
11 8 (1.22%) ER Studio
11 8 (1.22%) ERwin
11 8 (1.22%) Selenium
12 6 (0.92%) PowerDesigner
13 4 (0.61%) CA Release Automation
13 4 (0.61%) Gradle
13 4 (0.61%) Octopus Deploy
13 4 (0.61%) RStudio
14 3 (0.46%) GoCD
General
1 197 (30.08%) Finance
2 70 (10.69%) Banking
3 32 (4.89%) Front Office
4 23 (3.51%) Advertising
5 19 (2.90%) Marketing
5 19 (2.90%) Retail
6 18 (2.75%) Investment Banking
7 17 (2.60%) Telecoms
8 12 (1.83%) Manufacturing
9 9 (1.37%) Games
10 7 (1.07%) Financial Institution
10 7 (1.07%) Law
11 6 (0.92%) Pharmaceutical
11 6 (0.92%) Public Sector
12 3 (0.46%) Electronics
12 3 (0.46%) Legal
13 2 (0.31%) Automotive
13 2 (0.31%) Private Banking
13 2 (0.31%) Retail Banking
14 1 (0.15%) Online Betting
Job Titles
1 196 (29.92%) Data Engineer
2 157 (23.97%) Developer
3 87 (13.28%) Architect
4 71 (10.84%) Java Developer
5 56 (8.55%) Data Architect
6 47 (7.18%) Data Scientist
7 46 (7.02%) Big Data Engineer
8 42 (6.41%) Senior Data Engineer
9 37 (5.65%) Software Engineer
10 31 (4.73%) Senior Developer
11 30 (4.58%) Python Engineer
12 29 (4.43%) AWS Engineer
12 29 (4.43%) Java Engineer
13 28 (4.27%) Senior Data Scientist
14 23 (3.51%) Big Data Developer
15 22 (3.36%) Consultant
15 22 (3.36%) Hadoop Engineer
16 21 (3.21%) Administrator
16 21 (3.21%) DevOps Engineer
16 21 (3.21%) Kubernetes Engineer
Libraries, Frameworks & Software Standards
1 221 (33.74%) Kafka
2 67 (10.23%) Spring
3 48 (7.33%) React
4 40 (6.11%) Web Services
5 38 (5.80%) AngularJS
5 38 (5.80%) Natural Language Processing
6 37 (5.65%) HTML
6 37 (5.65%) JMS
7 33 (5.04%) Node.js
8 30 (4.58%) .NET
8 30 (4.58%) REST
8 30 (4.58%) RESTful
8 30 (4.58%) scikit-learn
9 29 (4.43%) Spring Boot
9 29 (4.43%) TensorFlow
10 27 (4.12%) CSS
11 26 (3.97%) NumPy
12 25 (3.82%) Pandas
12 25 (3.82%) PySpark
13 24 (3.66%) JSON
Miscellaneous
1 72 (10.99%) Analytical Skills
2 71 (10.84%) Algorithms
3 31 (4.73%) Management Information System
4 30 (4.58%) Self-Motivation
5 25 (3.82%) Data Centre
6 22 (3.36%) Hedge funds
7 19 (2.90%) Cloud Native
7 19 (2.90%) Equities
8 17 (2.60%) Data Structures
9 15 (2.29%) Hybrid Cloud
10 13 (1.98%) Credit Risk
11 10 (1.53%) Market Risk
12 9 (1.37%) Blog
12 9 (1.37%) Enterprise Software
13 8 (1.22%) Fixed Income
13 8 (1.22%) Linux Command Line
13 8 (1.22%) Mobile App
13 8 (1.22%) User Experience
14 7 (1.07%) FMCG
14 7 (1.07%) Replication
Operating Systems
1 95 (14.50%) Linux
2 78 (11.91%) Unix
3 33 (5.04%) Windows
4 21 (3.21%) CentOS
5 14 (2.14%) Red Hat Enterprise Linux
6 10 (1.53%) Windows Server
7 2 (0.31%) Android
7 2 (0.31%) Apple iOS
Processes & Methodologies
1 239 (36.49%) Analytics
2 238 (36.34%) Agile Software Development
3 173 (26.41%) ETL
4 167 (25.50%) DevOps
5 154 (23.51%) Data Science
6 136 (20.76%) Software Engineering
7 132 (20.15%) Machine Learning
8 116 (17.71%) Computer Science
9 102 (15.57%) Data Analytics
10 99 (15.11%) Scrum
11 97 (14.81%) Microservices
12 94 (14.35%) Visualisation
13 88 (13.44%) Business Intelligence
14 80 (12.21%) Mathematics
15 78 (11.91%) Mentoring
16 77 (11.76%) Data Modelling
17 75 (11.45%) Artificial Intelligence
18 72 (10.99%) Requirements Gathering
19 68 (10.38%) Data Engineering
20 66 (10.08%) Data Visualisation
Programming Languages
1 363 (55.42%) Python
2 324 (49.47%) Java
3 271 (41.37%) SQL
4 145 (22.14%) Scala
5 113 (17.25%) JavaScript
6 86 (13.13%) R
7 60 (9.16%) Shell Script
8 59 (9.01%) PL/SQL
9 41 (6.26%) HiveQL
10 39 (5.95%) C#
11 36 (5.50%) Java 8
12 34 (5.19%) Bash Shell
13 28 (4.27%) C++
14 18 (2.75%) Kotlin
15 14 (2.14%) Go
15 14 (2.14%) PowerShell
16 13 (1.98%) PHP
17 12 (1.83%) C
18 9 (1.37%) Ruby
18 9 (1.37%) TypeScript
Qualifications
1 153 (23.36%) Degree
2 84 (12.82%) Computer Science Degree
3 30 (4.58%) BPSS Clearance
4 24 (3.66%) Master's Degree
5 17 (2.60%) PhD
6 16 (2.44%) Security Cleared
7 11 (1.68%) DV Cleared
8 10 (1.53%) SC Cleared
9 8 (1.22%) Numerate Degree
9 8 (1.22%) RHCE
10 6 (0.92%) AWS Certification
11 3 (0.46%) MCDBA
11 3 (0.46%) MCT
11 3 (0.46%) Microsoft Certification
11 3 (0.46%) TOGAF Certification
12 2 (0.31%) HND
13 1 (0.15%) ISEB
13 1 (0.15%) ISTQB
13 1 (0.15%) ISTQB Foundation Certification
13 1 (0.15%) Sun Certification
Quality Assurance & Compliance
1 27 (4.12%) Data Quality
2 13 (1.98%) QA
3 10 (1.53%) GDPR
3 10 (1.53%) SLA
4 7 (1.07%) ISO/IEC 27001
5 6 (0.92%) Sarbanes-Oxley
6 3 (0.46%) ISO 20022
6 3 (0.46%) PSD2
6 3 (0.46%) TARGET2
7 1 (0.15%) Basel III
7 1 (0.15%) COREP
7 1 (0.15%) CRD IV
7 1 (0.15%) IFRS
7 1 (0.15%) IFRS 9
7 1 (0.15%) ISO 26262
7 1 (0.15%) ISO 9001
7 1 (0.15%) PMO
System Software
1 102 (15.57%) Docker
2 88 (13.44%) HDFS
3 34 (5.19%) Apache ZooKeeper
4 33 (5.04%) VMware Infrastructure
5 19 (2.90%) Active Directory
6 10 (1.53%) Hyper-V
6 10 (1.53%) vSphere
7 8 (1.22%) XenApp
7 8 (1.22%) XenDesktop
8 7 (1.07%) Apache Flume
9 4 (0.61%) Samba
9 4 (0.61%) Varnish
10 2 (0.31%) Microsoft Virtual Server
10 2 (0.31%) Virtual Servers
11 1 (0.15%) Tivoli Workload Scheduler
11 1 (0.15%) Virtual Machines
11 1 (0.15%) VirtualBox
Systems Management
1 120 (18.32%) Kubernetes
2 75 (11.45%) Ansible
3 46 (7.02%) Terraform
4 29 (4.43%) Hadoop YARN
5 23 (3.51%) Puppet
6 8 (1.22%) Kibana
6 8 (1.22%) SCCM
7 6 (0.92%) Ambari
7 6 (0.92%) Oozie
7 6 (0.92%) Opscode Chef
8 5 (0.76%) vRealize Orchestrator
9 4 (0.61%) Prometheus
10 3 (0.46%) Cobbler
10 3 (0.46%) Nagios
10 3 (0.46%) Red Hat Satellite
10 3 (0.46%) Single Sign-On
10 3 (0.46%) ZABBIX
11 2 (0.31%) Fluentd
11 2 (0.31%) HP Fortify
12 1 (0.15%) Docker Swarm
Vendors
1 113 (17.25%) Oracle
2 109 (16.64%) Cloudera
3 62 (9.47%) Databricks
4 59 (9.01%) Talend
5 58 (8.85%) Informatica
6 46 (7.02%) Google
7 40 (6.11%) Teradata
8 36 (5.50%) VMware
9 31 (4.73%) Microsoft
10 22 (3.36%) Splunk
11 15 (2.29%) Red Hat
12 14 (2.14%) Ab Initio
13 12 (1.83%) Hortonworks
14 9 (1.37%) IBM
15 8 (1.22%) F5
16 7 (1.07%) LogicMonitor
17 6 (0.92%) Netezza
18 5 (0.76%) MapR
18 5 (0.76%) MuleSoft
19 4 (0.61%) Palantir