Period
to 15 January 2021

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 15 January 2021 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
15 Jan 2021
Same period 2020 Same period 2019
Rank 282 247 186
Rank change year-on-year -35 -61 +17
Permanent jobs citing Hadoop 623 1,567 2,661
As % of all permanent jobs advertised in England 1.11% 1.34% 1.89%
As % of the Database & Business Intelligence category 4.00% 4.96% 6.58%
Number of salaries quoted 543 1,339 2,126
Median annual salary £70,000 £70,000 £70,000
10th Percentile £45,450 £45,330 £42,125
90th Percentile £110,000 £108,750 £102,500
UK median annual salary £67,500 £70,000 £70,000
% change year-on-year -3.57% - +7.69%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 15,565 31,623 40,440
As % of all permanent IT jobs advertised in England 27.62% 27.06% 28.78%
Number of salaries quoted 13,172 26,441 33,837
Median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +5.00%
10th Percentile £34,000 £32,000 £31,375
90th Percentile £88,750 £90,000 £85,000
UK median annual salary £55,000 £52,500 £52,500
% change year-on-year +4.76% - +9.38%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 15 January 2021.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 15 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +8 430 £76,500 +2.00% 83
South East +44 50 £50,000 - 12
Midlands -5 44 £57,500 -17.86% 15
North of England +19 43 £55,000 +0.60% 24
South West +12 37 £67,500 +28.57% 6
East Midlands +1 24 £55,500 -23.45% 8
Yorkshire +11 23 £55,000 - 15
West Midlands +40 20 £57,500 -5.74% 7
North West +63 19 £55,000 +0.94% 9
East of England +80 13 £65,000 -13.33% 5
North East +11 1 £42,000 -23.18%
Hadoop
UK

For the 6 months to 15 January 2021, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 405 (65.01%) Big Data
2 377 (60.51%) Python
3 342 (54.90%) Java
4 341 (54.74%) Apache Spark
5 318 (51.04%) AWS
6 306 (49.12%) SQL
7 257 (41.25%) Azure
8 241 (38.68%) Analytics
9 229 (36.76%) Kafka
9 229 (36.76%) Agile Software Development
10 200 (32.10%) ETL
11 183 (29.37%) Apache Hive
12 166 (26.65%) NoSQL
13 164 (26.32%) Data Science
14 154 (24.72%) Finance
15 141 (22.63%) Scala
16 134 (21.51%) Software Engineering
17 133 (21.35%) GCP
18 131 (21.03%) DevOps
19 124 (19.90%) Machine Learning
20 122 (19.58%) Kubernetes
21 121 (19.42%) Oracle
22 119 (19.10%) Docker
23 114 (18.30%) Cloudera
24 110 (17.66%) Data Engineering
25 106 (17.01%) Git (software)
25 106 (17.01%) Apache Cassandra
26 104 (16.69%) Data Lake
27 100 (16.05%) Data Warehouse
27 100 (16.05%) Business Intelligence

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 341 (54.74%) Apache Spark
2 89 (14.29%) SAS
3 79 (12.68%) Apache
4 46 (7.38%) Elasticsearch
5 37 (5.94%) Apache Airflow
6 17 (2.73%) Confluence
7 16 (2.57%) Apache Pig
7 16 (2.57%) Luigi
8 13 (2.09%) Tornado
9 12 (1.93%) Apache Synapse
10 6 (0.96%) Jupyter
11 5 (0.80%) IIS
11 5 (0.80%) Oracle Workflow
12 2 (0.32%) Oracle SOA Suite
12 2 (0.32%) Tomcat
12 2 (0.32%) WebLogic
13 1 (0.16%) GlassFish
13 1 (0.16%) Jetty
13 1 (0.16%) Mule
13 1 (0.16%) WebSphere
Applications
1 4 (0.64%) SPSS
2 2 (0.32%) Microsoft Excel
3 1 (0.16%) Chatbot
3 1 (0.16%) Microsoft Office
Business Applications
1 3 (0.48%) Distributed Ledger
1 3 (0.48%) Oracle Cash Management
2 2 (0.32%) Oracle EBS
3 1 (0.16%) Dynamics CRM
3 1 (0.16%) SAP APO
3 1 (0.16%) SAP FI-CA
3 1 (0.16%) SAP PSCD
Cloud Services
1 318 (51.04%) AWS
2 257 (41.25%) Azure
3 133 (21.35%) GCP
4 78 (12.52%) Power Platform
5 31 (4.98%) Amazon EMR
5 31 (4.98%) Amazon Kinesis
6 29 (4.65%) Azure Data Factory
7 20 (3.21%) Amazon S3
7 20 (3.21%) IaaS
7 20 (3.21%) SaaS
8 16 (2.57%) Serverless
9 15 (2.41%) PaaS
10 14 (2.25%) AWS Lambda
11 11 (1.77%) Amazon SageMaker
12 10 (1.61%) Logic Apps
13 9 (1.44%) Amazon EC2
14 7 (1.12%) Amazon SQS
14 7 (1.12%) AWS CloudFormation
15 6 (0.96%) Amazon ElastiCache
15 6 (0.96%) Cloud Computing
Communications & Networking
1 20 (3.21%) HTTP
2 13 (2.09%) Firewall
3 9 (1.44%) SSH
3 9 (1.44%) TCP/IP
4 6 (0.96%) Internet
5 5 (0.80%) 5G
6 4 (0.64%) 802.11
6 4 (0.64%) DNS
6 4 (0.64%) Fibre Channel
6 4 (0.64%) FTP
6 4 (0.64%) Kerberos
6 4 (0.64%) LAN
6 4 (0.64%) SAN
6 4 (0.64%) SNMP
6 4 (0.64%) WAN
6 4 (0.64%) Wireless
7 3 (0.48%) DMZ
7 3 (0.48%) Network Security
7 3 (0.48%) Reverse Proxy
7 3 (0.48%) VPN
Database & Business Intelligence
1 405 (65.01%) Big Data
2 183 (29.37%) Apache Hive
3 166 (26.65%) NoSQL
4 106 (17.01%) Apache Cassandra
5 104 (16.69%) Data Lake
6 100 (16.05%) Data Warehouse
7 92 (14.77%) Amazon Redshift
8 90 (14.45%) MongoDB
9 84 (13.48%) SQL Server
10 78 (12.52%) Power BI
11 72 (11.56%) HBase
11 72 (11.56%) Impala
12 68 (10.91%) Oracle Database
13 65 (10.43%) Pentaho
14 59 (9.47%) PostgreSQL
15 56 (8.99%) Relational Database
16 52 (8.35%) Tableau
17 46 (7.38%) BusinessObjects
18 35 (5.62%) SQL Server Integration Services
19 32 (5.14%) Amazon Athena
Development Applications
1 106 (17.01%) Git (software)
2 87 (13.96%) Jenkins
3 52 (8.35%) Maven
4 37 (5.94%) Bitbucket
5 30 (4.82%) JIRA
6 25 (4.01%) Artifactory
7 22 (3.53%) Cucumber
8 18 (2.89%) Atlassian Bamboo
9 15 (2.41%) Selenium
10 11 (1.77%) JUnit
10 11 (1.77%) TeamCity
11 8 (1.28%) JMeter
11 8 (1.28%) WebDriver
12 7 (1.12%) REST Assured
12 7 (1.12%) Team Foundation Server
12 7 (1.12%) Visual Studio
13 6 (0.96%) Vagrant
14 5 (0.80%) Gradle
15 4 (0.64%) Sonatype Nexus
16 3 (0.48%) CircleCI
General
1 154 (24.72%) Finance
2 57 (9.15%) Banking
3 36 (5.78%) Retail
4 35 (5.62%) Telecoms
5 21 (3.37%) Games
5 21 (3.37%) Public Sector
6 20 (3.21%) Marketing
7 18 (2.89%) Front Office
8 16 (2.57%) Law
9 11 (1.77%) Manufacturing
10 10 (1.61%) Advertising
10 10 (1.61%) Investment Banking
11 7 (1.12%) Legal
12 5 (0.80%) Electronics
13 4 (0.64%) Military
14 3 (0.48%) Automotive
14 3 (0.48%) Pharmaceutical
15 2 (0.32%) Back Office
16 1 (0.16%) Dutch Language
16 1 (0.16%) French Language
Job Titles
1 225 (36.12%) Data Engineer
2 136 (21.83%) Developer
3 66 (10.59%) Big Data Engineer
3 66 (10.59%) Java Developer
4 64 (10.27%) Architect
4 64 (10.27%) Java Engineer
5 50 (8.03%) Data Scientist
6 42 (6.74%) Data Architect
7 41 (6.58%) Software Engineer
8 32 (5.14%) Consultant
9 29 (4.65%) Senior Developer
10 28 (4.49%) Senior Data Engineer
11 26 (4.17%) Senior Data Scientist
12 25 (4.01%) Java Software Engineer
13 24 (3.85%) AWS Engineer
14 22 (3.53%) Data Consultant
15 20 (3.21%) Big Data Developer
16 19 (3.05%) Python Engineer
17 18 (2.89%) DevOps Engineer
18 17 (2.73%) Java Architect
Libraries, Frameworks & Software Standards
1 229 (36.76%) Kafka
2 58 (9.31%) Spring
3 54 (8.67%) Web Services
4 45 (7.22%) Node.js
5 41 (6.58%) React
6 39 (6.26%) Spring Boot
7 34 (5.46%) RESTful
8 30 (4.82%) TensorFlow
9 29 (4.65%) AngularJS
10 27 (4.33%) Natural Language Processing
10 27 (4.33%) RabbitMQ
11 26 (4.17%) ActiveMQ
11 26 (4.17%) HTML
11 26 (4.17%) JSON
11 26 (4.17%) REST
12 24 (3.85%) Apache NiFi
13 23 (3.69%) PySpark
13 23 (3.69%) scikit-learn
14 22 (3.53%) JMS
15 21 (3.37%) CSS
Miscellaneous
1 60 (9.63%) Algorithms
2 46 (7.38%) Analytical Skills
3 26 (4.17%) Self-Motivation
4 21 (3.37%) Management Information System
5 20 (3.21%) Cloud Native
5 20 (3.21%) Data Structures
6 15 (2.41%) Credit Risk
7 12 (1.93%) Data Centre
7 12 (1.93%) Market Risk
7 12 (1.93%) Public Cloud
7 12 (1.93%) Video on Demand
8 11 (1.77%) Derivative
9 9 (1.44%) Blog
9 9 (1.44%) Enterprise Software
9 9 (1.44%) Hybrid Cloud
10 8 (1.28%) Equities
10 8 (1.28%) Private Cloud
11 7 (1.12%) Greenfield Project
11 7 (1.12%) Hedge funds
11 7 (1.12%) PKI
Operating Systems
1 67 (10.75%) Linux
2 57 (9.15%) Unix
3 22 (3.53%) CentOS
3 22 (3.53%) Windows
4 17 (2.73%) Red Hat Enterprise Linux
5 5 (0.80%) Windows Server
5 5 (0.80%) Windows Server 2016
6 4 (0.64%) Ubuntu
7 3 (0.48%) Oracle Linux
8 1 (0.16%) Android
8 1 (0.16%) Apple iOS
Processes & Methodologies
1 241 (38.68%) Analytics
2 229 (36.76%) Agile Software Development
3 200 (32.10%) ETL
4 164 (26.32%) Data Science
5 134 (21.51%) Software Engineering
6 131 (21.03%) DevOps
7 124 (19.90%) Machine Learning
8 110 (17.66%) Data Engineering
9 100 (16.05%) Business Intelligence
10 95 (15.25%) Scrum
11 93 (14.93%) Computer Science
12 91 (14.61%) Visualisation
13 88 (14.13%) Microservices
14 87 (13.96%) Data Analytics
15 80 (12.84%) Artificial Intelligence
16 73 (11.72%) Requirements Gathering
17 64 (10.27%) Data Visualisation
18 63 (10.11%) Mentoring
19 61 (9.79%) Mathematics
19 61 (9.79%) Open Source
Programming Languages
1 377 (60.51%) Python
2 342 (54.90%) Java
3 306 (49.12%) SQL
4 141 (22.63%) Scala
5 98 (15.73%) JavaScript
6 65 (10.43%) PL/SQL
7 57 (9.15%) R
8 49 (7.87%) C#
9 46 (7.38%) Shell Script
10 43 (6.90%) Bash Shell
11 40 (6.42%) HiveQL
12 30 (4.82%) C++
13 26 (4.17%) Java 8
14 18 (2.89%) Kotlin
15 17 (2.73%) PHP
16 14 (2.25%) Go
17 13 (2.09%) C
17 13 (2.09%) Perl
18 10 (1.61%) TypeScript
19 8 (1.28%) T-SQL
Qualifications
1 95 (15.25%) Degree
2 42 (6.74%) Computer Science Degree
3 27 (4.33%) BPSS Clearance
3 27 (4.33%) PhD
4 18 (2.89%) Security Cleared
5 9 (1.44%) Master's Degree
6 8 (1.28%) SC Cleared
7 4 (0.64%) Numerate Degree
8 3 (0.48%) DV Cleared
8 3 (0.48%) TOGAF Certification
9 2 (0.32%) AWS Certification
9 2 (0.32%) HND
10 1 (0.16%) ISEB
10 1 (0.16%) ISTQB
10 1 (0.16%) ISTQB Foundation Certification
10 1 (0.16%) Sun Certification
Quality Assurance & Compliance
1 25 (4.01%) QA
2 22 (3.53%) Data Quality
3 7 (1.12%) GDPR
4 6 (0.96%) SLA
5 3 (0.48%) ISO 20022
5 3 (0.48%) PSD2
5 3 (0.48%) TARGET2
6 2 (0.32%) ISO/IEC 27001
6 2 (0.32%) Sarbanes-Oxley
7 1 (0.16%) Basel III
7 1 (0.16%) COREP
7 1 (0.16%) CRD IV
7 1 (0.16%) IFRS
7 1 (0.16%) IFRS 9
7 1 (0.16%) ISO 26262
7 1 (0.16%) ISO 9001
7 1 (0.16%) PMO
System Software
1 119 (19.10%) Docker
2 84 (13.48%) HDFS
3 28 (4.49%) Apache ZooKeeper
4 13 (2.09%) Active Directory
5 12 (1.93%) VMware Infrastructure
6 6 (0.96%) Apache Flume
7 5 (0.80%) Hyper-V
7 5 (0.80%) VirtualBox
8 1 (0.16%) NFS
8 1 (0.16%) Oracle RAC
8 1 (0.16%) oVirt
8 1 (0.16%) Tivoli Workload Scheduler
Systems Management
1 122 (19.58%) Kubernetes
2 73 (11.72%) Ansible
3 63 (10.11%) Terraform
4 24 (3.85%) Hadoop YARN
5 21 (3.37%) Puppet
6 17 (2.73%) Opscode Chef
7 14 (2.25%) Oozie
8 11 (1.77%) Nagios
9 7 (1.12%) Graphite
9 7 (1.12%) Opsview
10 5 (0.80%) Docker Swarm
10 5 (0.80%) Prometheus
11 3 (0.48%) Single Sign-On
11 3 (0.48%) ZABBIX
12 2 (0.32%) Ambari
12 2 (0.32%) HP Fortify
12 2 (0.32%) Kibana
13 1 (0.16%) Failover Clustering
13 1 (0.16%) Grafana
13 1 (0.16%) Mesos
Vendors
1 121 (19.42%) Oracle
2 114 (18.30%) Cloudera
3 82 (13.16%) Talend
4 80 (12.84%) Databricks
5 66 (10.59%) Informatica
6 58 (9.31%) Google
7 54 (8.67%) Microsoft
8 28 (4.49%) Teradata
9 19 (3.05%) VMware
10 14 (2.25%) Red Hat
11 11 (1.77%) Hortonworks
12 9 (1.44%) Ab Initio
12 9 (1.44%) IBM
13 7 (1.12%) Yahoo!
14 6 (0.96%) MuleSoft
14 6 (0.96%) NVIDIA
14 6 (0.96%) SAP
14 6 (0.96%) Splunk
15 5 (0.80%) Intel
15 5 (0.80%) LogicMonitor