Period
to 9 April 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 9 April 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
9 Apr 2020
Same period 2019 Same period 2018
Rank 238 184 183
Rank change year-on-year -54 -1 +19
Permanent jobs citing Hadoop 1,447 2,658 3,116
As % of all permanent jobs advertised in England 1.36% 1.92% 1.88%
As % of the Database & Business Intelligence category 5.12% 6.83% 6.11%
Number of salaries quoted 1,169 2,091 2,496
Median annual salary £70,000 £70,000 £67,500
Median salary % change year-on-year - +3.70% +3.85%
10th Percentile £46,250 £43,750 £40,000
90th Percentile £102,500 £106,250 £100,000
UK median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 28,265 38,945 50,981
As % of all permanent IT jobs advertised in England 26.61% 28.19% 30.73%
Number of salaries quoted 23,286 32,211 42,746
Median annual salary £54,500 £52,500 £50,000
Median salary % change year-on-year +3.81% +5.00% +5.26%
10th Percentile £32,500 £31,250 £31,000
90th Percentile £90,000 £86,250 £80,000
UK median annual salary £52,500 £52,500 £50,000
% change year-on-year - +5.00% +5.26%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 9 April 2020.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 9 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -65 899 £72,500 -6.45% 131
South East -9 199 £60,000 - 24
Midlands +40 149 £70,000 +32.08% 14
North of England -24 92 £54,578 -0.77% 15
East Midlands +41 80 £75,000 +38.25% 4
West Midlands +48 69 £60,000 +14.29% 10
South West -50 68 £57,500 - 9
Yorkshire +40 44 £54,671 +9.34% 2
East of England +15 40 £75,000 +5.26% 12
North West -11 38 £47,500 -26.92% 13
North East -1 10 £54,835 +11.14%
Hadoop
UK

For the 6 months to 9 April 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 957 (66.14%) Apache Spark
2 930 (64.27%) Big Data
3 865 (59.78%) Python
4 716 (49.48%) Java
5 649 (44.85%) Agile Software Development
6 626 (43.26%) SQL
7 604 (41.74%) Analytics
8 594 (41.05%) AWS
9 457 (31.58%) Azure
10 430 (29.72%) Data Science
11 422 (29.16%) NoSQL
12 413 (28.54%) Scala
13 391 (27.02%) Machine Learning
14 379 (26.19%) Kafka
15 365 (25.22%) Apache Hive
16 318 (21.98%) Finance
17 312 (21.56%) DevOps
18 311 (21.49%) Software Engineering
19 279 (19.28%) GCP
20 274 (18.94%) Degree
21 273 (18.87%) ETL
22 268 (18.52%) Docker
23 253 (17.48%) Linux
24 252 (17.42%) Data Analytics
25 246 (17.00%) Data Modelling
26 241 (16.66%) Artificial Intelligence
27 236 (16.31%) MongoDB
28 225 (15.55%) Data Warehouse
29 224 (15.48%) R
30 220 (15.20%) JavaScript

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 957 (66.14%) Apache Spark
2 137 (9.47%) Elasticsearch
3 130 (8.98%) Apache
4 84 (5.81%) SAS
5 51 (3.52%) Apache Airflow
6 43 (2.97%) Apache Solr
7 33 (2.28%) Luigi
8 30 (2.07%) Jupyter
9 28 (1.94%) Apache Pig
9 28 (1.94%) Confluence
10 26 (1.80%) Tomcat
11 11 (0.76%) JBoss
12 9 (0.62%) IIS
13 7 (0.48%) Oracle SOA Suite
14 6 (0.41%) IPython
14 6 (0.41%) Oracle Coherence
14 6 (0.41%) Tornado
15 5 (0.35%) CMS
16 4 (0.28%) GemFire
16 4 (0.28%) nginx
Applications
1 25 (1.73%) Microsoft Excel
2 11 (0.76%) SPSS
3 5 (0.35%) Microsoft Office
4 4 (0.28%) Microsoft PowerPoint
5 1 (0.069%) Gephi
5 1 (0.069%) Simulink
Business Applications
1 7 (0.48%) SAP ERP
2 6 (0.41%) SAP BPC
2 6 (0.41%) Sparx Enterprise Architect
3 5 (0.35%) SAP CRM
3 5 (0.35%) SAP IS-U
4 2 (0.14%) Eikon
4 2 (0.14%) SAP InfiniteInsight
4 2 (0.14%) SAP S/4HANA
5 1 (0.069%) Adobe Campaign
5 1 (0.069%) Data Workbench
5 1 (0.069%) ENOVIA
5 1 (0.069%) NetSuite
5 1 (0.069%) SAP CO
5 1 (0.069%) SAP FI
5 1 (0.069%) SAP FI/CO
5 1 (0.069%) WebTrends
Cloud Services
1 594 (41.05%) AWS
2 457 (31.58%) Azure
3 279 (19.28%) GCP
4 118 (8.15%) Amazon EMR
5 84 (5.81%) Power Platform
6 82 (5.67%) Amazon S3
7 52 (3.59%) Serverless
8 45 (3.11%) Azure Data Factory
9 40 (2.76%) Amazon EC2
9 40 (2.76%) Amazon Kinesis
10 36 (2.49%) SaaS
11 31 (2.14%) PaaS
12 29 (2.00%) IBM Cloud
13 27 (1.87%) Azure Machine Learning
14 25 (1.73%) Amazon SageMaker
14 25 (1.73%) AWS Lambda
15 24 (1.66%) OpenShift
16 23 (1.59%) GitHub
17 22 (1.52%) Cloud Computing
18 14 (0.97%) IaaS
Communications & Networking
1 27 (1.87%) HTTP
1 27 (1.87%) TCP/IP
2 21 (1.45%) SSL
3 18 (1.24%) DNS
4 17 (1.17%) Firewall
5 9 (0.62%) Kerberos
5 9 (0.62%) ZigBee
6 7 (0.48%) SSH
7 6 (0.41%) 5G
8 5 (0.35%) 3G
8 5 (0.35%) 4G
8 5 (0.35%) Wi-Fi
9 4 (0.28%) FTP
9 4 (0.28%) Reverse Proxy
9 4 (0.28%) VPN
10 3 (0.21%) Network Security
11 2 (0.14%) ATM
11 2 (0.14%) HTTPS
11 2 (0.14%) LTE
11 2 (0.14%) WLAN
Database & Business Intelligence
1 930 (64.27%) Big Data
2 422 (29.16%) NoSQL
3 365 (25.22%) Apache Hive
4 236 (16.31%) MongoDB
5 225 (15.55%) Data Warehouse
6 213 (14.72%) HBase
7 189 (13.06%) Apache Cassandra
8 171 (11.82%) Amazon Redshift
9 162 (11.20%) SQL Server
10 150 (10.37%) Relational Database
11 144 (9.95%) PostgreSQL
12 120 (8.29%) Impala
13 114 (7.88%) Neo4j
14 95 (6.57%) Data Lake
15 84 (5.81%) Power BI
16 70 (4.84%) Flink
17 69 (4.77%) Data Mining
18 68 (4.70%) BigQuery
19 65 (4.49%) MySQL
20 59 (4.08%) Amazon Athena
Development Applications
1 187 (12.92%) Git (software)
2 162 (11.20%) Jenkins
3 73 (5.04%) Atlassian Bamboo
3 73 (5.04%) JIRA
4 61 (4.22%) Maven
5 44 (3.04%) Vagrant
6 39 (2.70%) Artifactory
7 37 (2.56%) Bitbucket
8 27 (1.87%) TeamCity
9 19 (1.31%) Visual Studio Team System
10 17 (1.17%) JUnit
11 16 (1.11%) Ant
11 16 (1.11%) Octopus Deploy
12 12 (0.83%) Subversion
13 11 (0.76%) SonarQube
13 11 (0.76%) Team Foundation Server
14 10 (0.69%) Cucumber
15 9 (0.62%) MSBuild
15 9 (0.62%) Selenium
15 9 (0.62%) Zephyr
General
1 318 (21.98%) Finance
2 104 (7.19%) Retail
3 99 (6.84%) Banking
4 79 (5.46%) Marketing
5 63 (4.35%) Public Sector
6 43 (2.97%) Manufacturing
6 43 (2.97%) Telecoms
7 41 (2.83%) Front Office
8 32 (2.21%) Automotive
9 17 (1.17%) Legal
10 16 (1.11%) Games
11 15 (1.04%) Aerospace
12 14 (0.97%) Investment Banking
13 7 (0.48%) Electronics
14 6 (0.41%) Advertising
14 6 (0.41%) Billing
15 5 (0.35%) Financial Institution
15 5 (0.35%) Military
16 4 (0.28%) Online Betting
17 3 (0.21%) Publishing
Job Titles
1 397 (27.44%) Data Engineer
2 309 (21.35%) Developer
3 176 (12.16%) Architect
3 176 (12.16%) Java Developer
4 129 (8.91%) Data Architect
5 124 (8.57%) Data Scientist
6 114 (7.88%) Big Data Engineer
7 90 (6.22%) Software Engineer
8 84 (5.81%) Senior Developer
9 59 (4.08%) Senior Java Developer
10 58 (4.01%) Senior Data Scientist
11 52 (3.59%) Big Data Architect
12 51 (3.52%) Python Engineer
13 49 (3.39%) Consultant
14 48 (3.32%) Analyst
14 48 (3.32%) Java Engineer
14 48 (3.32%) Senior Data Engineer
15 44 (3.04%) DevOps Engineer
15 44 (3.04%) Solutions Architect
16 39 (2.70%) Software Developer
Libraries, Frameworks & Software Standards
1 379 (26.19%) Kafka
2 129 (8.91%) React
3 110 (7.60%) Node.js
4 104 (7.19%) AngularJS
5 102 (7.05%) Natural Language Processing
6 95 (6.57%) Web Services
7 89 (6.15%) TensorFlow
8 82 (5.67%) Spring
9 79 (5.46%) Spark Streaming
10 70 (4.84%) HTML
11 68 (4.70%) scikit-learn
12 67 (4.63%) .NET
13 65 (4.49%) REST
14 50 (3.46%) HTML5
15 38 (2.63%) CSS
16 37 (2.56%) Spring Boot
17 36 (2.49%) RESTful
18 33 (2.28%) Elastic Stack
19 32 (2.21%) JSON
19 32 (2.21%) Pandas
Miscellaneous
1 184 (12.72%) Analytical Skills
2 127 (8.78%) Algorithms
3 71 (4.91%) Data Structures
4 70 (4.84%) Greenfield Project
5 48 (3.32%) Management Information System
6 39 (2.70%) Public Cloud
7 36 (2.49%) Blog
8 35 (2.42%) Self-Motivation
9 30 (2.07%) Acoustics
10 27 (1.87%) Linux Command Line
11 25 (1.73%) Enterprise Software
11 25 (1.73%) User Experience
12 24 (1.66%) Cloud Native
13 21 (1.45%) Hedge funds
13 21 (1.45%) Mobile App
14 20 (1.38%) Virtual Team
15 19 (1.31%) Social Media
16 14 (0.97%) Hybrid Cloud
17 13 (0.90%) Market Risk
18 12 (0.83%) Reference Data
Operating Systems
1 253 (17.48%) Linux
2 122 (8.43%) Unix
3 49 (3.39%) Windows
4 17 (1.17%) Red Hat Enterprise Linux
5 14 (0.97%) Windows Server
6 12 (0.83%) CentOS
7 7 (0.48%) Android
8 6 (0.41%) Debian
9 5 (0.35%) Apple iOS
10 4 (0.28%) Ubuntu
11 2 (0.14%) VME
11 2 (0.14%) zOS
12 1 (0.069%) Solaris
Processes & Methodologies
1 649 (44.85%) Agile Software Development
2 604 (41.74%) Analytics
3 430 (29.72%) Data Science
4 391 (27.02%) Machine Learning
5 312 (21.56%) DevOps
6 311 (21.49%) Software Engineering
7 273 (18.87%) ETL
8 252 (17.42%) Data Analytics
9 246 (17.00%) Data Modelling
10 241 (16.66%) Artificial Intelligence
11 214 (14.79%) Data Engineering
12 210 (14.51%) Business Intelligence
13 207 (14.31%) Microservices
14 190 (13.13%) Computer Science
15 182 (12.58%) Visualisation
16 160 (11.06%) TDD
17 136 (9.40%) Continuous Integration
18 133 (9.19%) Fintech
19 129 (8.91%) Open Source
20 123 (8.50%) Problem-Solving
Programming Languages
1 865 (59.78%) Python
2 716 (49.48%) Java
3 626 (43.26%) SQL
4 413 (28.54%) Scala
5 224 (15.48%) R
6 220 (15.20%) JavaScript
7 149 (10.30%) C#
8 145 (10.02%) C++
9 105 (7.26%) Bash Shell
10 73 (5.04%) C
11 45 (3.11%) PL/SQL
12 39 (2.70%) MATLAB
12 39 (2.70%) PHP
13 36 (2.49%) Perl
14 33 (2.28%) PowerShell
15 32 (2.21%) T-SQL
16 31 (2.14%) Java 8
17 30 (2.07%) Go
18 29 (2.00%) Shell Script
19 28 (1.94%) Ruby
Qualifications
1 274 (18.94%) Degree
2 113 (7.81%) Security Cleared
3 108 (7.46%) Computer Science Degree
4 76 (5.25%) SC Cleared
5 65 (4.49%) DV Cleared
6 33 (2.28%) PhD
7 25 (1.73%) Numerate Degree
8 16 (1.11%) AWS Certification
9 13 (0.90%) Master's Degree
10 9 (0.62%) Postgraduate
11 7 (0.48%) MBA
11 7 (0.48%) Microsoft Certification
12 6 (0.41%) TOGAF Certification
13 4 (0.28%) PMI Certification
14 3 (0.21%) ISTQB
15 2 (0.14%) ACCA
15 2 (0.14%) CIMA
16 1 (0.069%) CCNP
16 1 (0.069%) Cisco Certification
16 1 (0.069%) CISSP
Quality Assurance & Compliance
1 80 (5.53%) Data Quality
2 45 (3.11%) QA
3 21 (1.45%) GDPR
4 10 (0.69%) ISO/IEC 27001
5 5 (0.35%) Sarbanes-Oxley
6 3 (0.21%) ISO 26262
7 1 (0.069%) Actionable Recommendations
7 1 (0.069%) SLA
System Software
1 268 (18.52%) Docker
2 119 (8.22%) HDFS
3 77 (5.32%) Apache ZooKeeper
4 42 (2.90%) VirtualBox
5 32 (2.21%) Apache Flume
6 8 (0.55%) Active Directory
6 8 (0.55%) VMware Infrastructure
7 5 (0.35%) Hyper-V
8 4 (0.28%) Virtual Machines
9 2 (0.14%) Varnish
10 1 (0.069%) Alluxio
10 1 (0.069%) Ceph
10 1 (0.069%) etcd
10 1 (0.069%) Gluster
10 1 (0.069%) Samba
10 1 (0.069%) VMware NSX
10 1 (0.069%) vSphere
Systems Management
1 198 (13.68%) Ansible
2 196 (13.55%) Kubernetes
3 116 (8.02%) Terraform
4 96 (6.63%) Puppet
5 52 (3.59%) Oozie
6 51 (3.52%) Opscode Chef
7 50 (3.46%) Docker Swarm
8 43 (2.97%) Hadoop YARN
9 40 (2.76%) Salt
10 11 (0.76%) Kibana
11 9 (0.62%) Ambari
12 8 (0.55%) Single Sign-On
13 7 (0.48%) logstash
14 6 (0.41%) Mesos
15 5 (0.35%) SELinux
16 3 (0.21%) Consul
16 3 (0.21%) Nagios
17 2 (0.14%) Prometheus
17 2 (0.14%) Rancher
17 2 (0.14%) vRealize Orchestrator
Vendors
1 190 (13.13%) Google
2 188 (12.99%) Oracle
3 165 (11.40%) Cloudera
4 130 (8.98%) Tableau
5 103 (7.12%) Microsoft
6 82 (5.67%) Hortonworks
7 66 (4.56%) Informatica
8 60 (4.15%) Databricks
9 58 (4.01%) Talend
10 54 (3.73%) IBM
11 49 (3.39%) Splunk
12 44 (3.04%) Teradata
13 39 (2.70%) Atlassian
14 26 (1.80%) SAP
15 19 (1.31%) Dataiku
15 19 (1.31%) InterSystems
16 18 (1.24%) Alteryx
16 18 (1.24%) Netezza
17 13 (0.90%) EXASOL
17 13 (0.90%) VMware