Period
to 6 July 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 6 July 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
6 Jul 2020
Same period 2019 Same period 2018
Rank 234 196 189
Rank change year-on-year -38 -7 +14
Permanent jobs citing Hadoop 1,044 2,498 3,156
As % of all permanent jobs advertised in England 1.43% 1.83% 1.89%
As % of the Database & Business Intelligence category 5.30% 6.65% 6.18%
Number of salaries quoted 784 1,964 2,448
Median annual salary £72,500 £70,000 £66,000
Median salary % change year-on-year +3.57% +6.06% +1.54%
10th Percentile £47,500 £45,000 £39,597
90th Percentile £106,250 £107,500 £98,750
UK median annual salary £72,500 £70,000 £65,000
% change year-on-year +3.57% +7.69% +4.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 19,682 37,570 51,061
As % of all permanent IT jobs advertised in England 27.01% 27.57% 30.57%
Number of salaries quoted 16,210 31,098 42,025
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +5.26%
10th Percentile £32,500 £31,250 £31,250
90th Percentile £90,000 £86,250 £82,500
UK median annual salary £55,000 £52,000 £50,000
% change year-on-year +5.77% +4.00% +5.26%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 6 July 2020.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 6 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -48 667 £75,000 -3.23% 70
South East +42 166 £65,000 +15.04% 10
Midlands +27 78 £70,000 +16.67% 10
South West -38 61 £57,500 +4.55% 2
North of England +64 47 £55,000 +5.77% 6
East Midlands +19 44 £75,000 +25.00% 7
West Midlands +58 34 £55,000 -8.33% 3
East of England +80 28 £70,000 +7.69% 3
North West +63 27 £50,000 -9.09% 3
Yorkshire +71 14 £55,000 +10.73% 3
North East +27 6 £57,500 +16.55%
Hadoop
UK

For the 6 months to 6 July 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 666 (63.79%) Apache Spark
2 657 (62.93%) Big Data
3 630 (60.34%) Python
4 528 (50.57%) Java
5 450 (43.10%) AWS
6 444 (42.53%) Analytics
7 443 (42.43%) SQL
8 431 (41.28%) Agile Software Development
9 341 (32.66%) Kafka
10 319 (30.56%) Azure
11 308 (29.50%) Data Science
12 293 (28.07%) NoSQL
13 280 (26.82%) Scala
14 267 (25.57%) Finance
15 253 (24.23%) Machine Learning
16 249 (23.85%) Degree
17 246 (23.56%) Apache Hive
18 239 (22.89%) DevOps
19 234 (22.41%) Software Engineering
20 203 (19.44%) Data Analytics
21 202 (19.35%) Docker
21 202 (19.35%) ETL
22 188 (18.01%) GCP
23 186 (17.82%) MongoDB
24 184 (17.62%) R
25 173 (16.57%) Data Warehouse
26 168 (16.09%) Linux
26 168 (16.09%) Artificial Intelligence
27 164 (15.71%) Apache Cassandra
28 158 (15.13%) Kubernetes

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 666 (63.79%) Apache Spark
2 128 (12.26%) Apache
3 85 (8.14%) Elasticsearch
4 66 (6.32%) SAS
5 52 (4.98%) Apache Airflow
6 33 (3.16%) Luigi
7 29 (2.78%) Jupyter
8 27 (2.59%) Apache Solr
9 23 (2.20%) Tomcat
10 21 (2.01%) Confluence
11 20 (1.92%) Apache Pig
12 13 (1.25%) CMS
13 11 (1.05%) Cloud Foundry
14 8 (0.77%) JBoss
14 8 (0.77%) Oracle Coherence
15 6 (0.57%) Oracle SOA Suite
15 6 (0.57%) Tornado
16 5 (0.48%) IBM Domino
16 5 (0.48%) nginx
17 4 (0.38%) GemFire
Applications
1 22 (2.11%) Microsoft Excel
2 10 (0.96%) SPSS
3 3 (0.29%) Microsoft Office
3 3 (0.29%) Microsoft PowerPoint
4 2 (0.19%) MS Visio
5 1 (0.096%) Gephi
Business Applications
1 7 (0.67%) SAP ERP
2 6 (0.57%) SAP BPC
3 5 (0.48%) SAP CRM
3 5 (0.48%) SAP IS-U
4 4 (0.38%) Eikon
5 2 (0.19%) SAP InfiniteInsight
5 2 (0.19%) SAP S/4HANA
6 1 (0.096%) Adobe Campaign
6 1 (0.096%) ENOVIA
6 1 (0.096%) SAP CO
6 1 (0.096%) SAP FI
6 1 (0.096%) SAP FI/CO
6 1 (0.096%) SAP Hybris
Cloud Services
1 450 (43.10%) AWS
2 319 (30.56%) Azure
3 188 (18.01%) GCP
4 91 (8.72%) Amazon EMR
5 79 (7.57%) Power Platform
6 55 (5.27%) Amazon S3
7 51 (4.89%) Amazon EC2
8 33 (3.16%) Azure Data Factory
9 31 (2.97%) SaaS
9 31 (2.97%) Serverless
10 25 (2.39%) Amazon Kinesis
11 24 (2.30%) IBM Cloud
12 16 (1.53%) Cloud Computing
13 14 (1.34%) Azure Machine Learning
14 13 (1.25%) GitHub
15 11 (1.05%) AWS Lambda
15 11 (1.05%) OpenShift
16 9 (0.86%) Amazon SQS
16 9 (0.86%) Logic Apps
16 9 (0.86%) PaaS
Communications & Networking
1 18 (1.72%) HTTP
2 12 (1.15%) FTP
3 9 (0.86%) Kerberos
3 9 (0.86%) SSL
3 9 (0.86%) TCP/IP
4 6 (0.57%) DSL
5 5 (0.48%) 5G
5 5 (0.48%) DNS
6 4 (0.38%) Reverse Proxy
7 3 (0.29%) Firewall
7 3 (0.29%) ZigBee
8 2 (0.19%) 3G
8 2 (0.19%) LTE
8 2 (0.19%) Modbus
8 2 (0.19%) Profibus
8 2 (0.19%) RS-232
8 2 (0.19%) RS-485
8 2 (0.19%) SSH
8 2 (0.19%) Wi-Fi
8 2 (0.19%) WLAN
Database & Business Intelligence
1 657 (62.93%) Big Data
2 293 (28.07%) NoSQL
3 246 (23.56%) Apache Hive
4 186 (17.82%) MongoDB
5 173 (16.57%) Data Warehouse
6 164 (15.71%) Apache Cassandra
7 154 (14.75%) HBase
8 143 (13.70%) Amazon Redshift
8 143 (13.70%) SQL Server
9 100 (9.58%) Relational Database
10 93 (8.91%) PostgreSQL
11 79 (7.57%) Power BI
12 73 (6.99%) Impala
13 72 (6.90%) Data Lake
14 70 (6.70%) Neo4j
15 62 (5.94%) Data Mining
15 62 (5.94%) MySQL
16 54 (5.17%) Flink
17 52 (4.98%) BigQuery
18 42 (4.02%) Sqoop
Development Applications
1 133 (12.74%) Jenkins
2 114 (10.92%) Git (software)
3 53 (5.08%) Atlassian Bamboo
4 45 (4.31%) JIRA
5 33 (3.16%) Maven
6 31 (2.97%) Bitbucket
7 30 (2.87%) Vagrant
8 24 (2.30%) Artifactory
9 21 (2.01%) JUnit
10 20 (1.92%) Cucumber
11 18 (1.72%) TeamCity
12 15 (1.44%) Sonatype Nexus
13 10 (0.96%) Octopus Deploy
14 7 (0.67%) ERwin
14 7 (0.67%) GoCD
14 7 (0.67%) Visual Studio
14 7 (0.67%) Visual Studio Team System
15 6 (0.57%) git-flow
15 6 (0.57%) PowerDesigner
15 6 (0.57%) RStudio
General
1 267 (25.57%) Finance
2 88 (8.43%) Banking
3 85 (8.14%) Retail
4 55 (5.27%) Marketing
5 43 (4.12%) Front Office
6 39 (3.74%) Manufacturing
7 35 (3.35%) Public Sector
8 31 (2.97%) Telecoms
9 19 (1.82%) Automotive
10 14 (1.34%) Aerospace
10 14 (1.34%) Games
11 13 (1.25%) Investment Banking
11 13 (1.25%) Legal
12 7 (0.67%) Advertising
12 7 (0.67%) Financial Institution
13 5 (0.48%) Military
13 5 (0.48%) Retail Banking
14 4 (0.38%) Electronics
14 4 (0.38%) Pharmaceutical
15 2 (0.19%) Publishing
Job Titles
1 305 (29.21%) Data Engineer
2 224 (21.46%) Developer
3 133 (12.74%) Architect
4 103 (9.87%) Java Developer
5 97 (9.29%) Data Architect
6 89 (8.52%) Big Data Engineer
7 88 (8.43%) Data Scientist
8 61 (5.84%) Senior Developer
9 56 (5.36%) Software Engineer
10 49 (4.69%) Senior Data Engineer
11 43 (4.12%) Senior Data Scientist
12 40 (3.83%) Big Data Architect
13 39 (3.74%) Python Engineer
14 38 (3.64%) AWS Engineer
15 37 (3.54%) Consultant
16 33 (3.16%) Hadoop Engineer
16 33 (3.16%) Senior Java Developer
17 31 (2.97%) Solutions Architect
18 29 (2.78%) DevOps Engineer
18 29 (2.78%) Platform Engineer
Libraries, Frameworks & Software Standards
1 341 (32.66%) Kafka
2 85 (8.14%) React
3 80 (7.66%) Spring
3 80 (7.66%) Web Services
4 74 (7.09%) AngularJS
5 67 (6.42%) Spark Streaming
6 62 (5.94%) Natural Language Processing
7 61 (5.84%) .NET
8 55 (5.27%) Node.js
9 54 (5.17%) REST
9 54 (5.17%) TensorFlow
10 44 (4.21%) Spring Boot
11 40 (3.83%) HTML
12 39 (3.74%) scikit-learn
13 33 (3.16%) NumPy
14 31 (2.97%) RabbitMQ
15 29 (2.78%) Pandas
16 26 (2.49%) Hibernate
16 26 (2.49%) HTML5
17 25 (2.39%) XML
Miscellaneous
1 113 (10.82%) Analytical Skills
2 88 (8.43%) Algorithms
3 52 (4.98%) Data Structures
4 44 (4.21%) Management Information System
5 43 (4.12%) Greenfield Project
6 39 (3.74%) Hedge funds
7 34 (3.26%) Blog
8 30 (2.87%) Self-Motivation
9 27 (2.59%) Equities
10 26 (2.49%) Acoustics
11 25 (2.39%) Enterprise Software
11 25 (2.39%) Hybrid Cloud
12 24 (2.30%) Cloud Native
13 16 (1.53%) Public Cloud
13 16 (1.53%) User Experience
13 16 (1.53%) Virtual Team
14 15 (1.44%) Market Risk
15 13 (1.25%) Data Centre
15 13 (1.25%) Mobile App
15 13 (1.25%) Reference Data
Operating Systems
1 168 (16.09%) Linux
2 100 (9.58%) Unix
3 25 (2.39%) Windows
4 21 (2.01%) Red Hat Enterprise Linux
5 6 (0.57%) Android
5 6 (0.57%) Apple iOS
5 6 (0.57%) CentOS
6 3 (0.29%) Windows Server
7 1 (0.096%) Debian
7 1 (0.096%) Ubuntu
Processes & Methodologies
1 444 (42.53%) Analytics
2 431 (41.28%) Agile Software Development
3 308 (29.50%) Data Science
4 253 (24.23%) Machine Learning
5 239 (22.89%) DevOps
6 234 (22.41%) Software Engineering
7 203 (19.44%) Data Analytics
8 202 (19.35%) ETL
9 168 (16.09%) Artificial Intelligence
10 156 (14.94%) Computer Science
11 150 (14.37%) Data Modelling
11 150 (14.37%) Microservices
12 136 (13.03%) Business Intelligence
13 114 (10.92%) Data Engineering
13 114 (10.92%) Scrum
14 108 (10.34%) Visualisation
15 107 (10.25%) Continuous Integration
16 105 (10.06%) TDD
17 101 (9.67%) Data Analysis
17 101 (9.67%) Mentoring
Programming Languages
1 630 (60.34%) Python
2 528 (50.57%) Java
3 443 (42.43%) SQL
4 280 (26.82%) Scala
5 184 (17.62%) R
6 143 (13.70%) JavaScript
7 104 (9.96%) C++
8 95 (9.10%) C#
9 64 (6.13%) Bash Shell
10 38 (3.64%) C
11 35 (3.35%) Java 8
12 34 (3.26%) PL/SQL
13 30 (2.87%) Go
13 30 (2.87%) Shell Script
14 21 (2.01%) Perl
14 21 (2.01%) PHP
15 20 (1.92%) HiveQL
15 20 (1.92%) MATLAB
16 19 (1.82%) VBA
17 16 (1.53%) Ruby
Qualifications
1 249 (23.85%) Degree
2 116 (11.11%) Computer Science Degree
3 85 (8.14%) Security Cleared
4 56 (5.36%) SC Cleared
5 50 (4.79%) DV Cleared
6 24 (2.30%) Master's Degree
6 24 (2.30%) PhD
7 11 (1.05%) Numerate Degree
8 10 (0.96%) AWS Certification
9 9 (0.86%) BPSS Clearance
10 8 (0.77%) TOGAF Certification
11 7 (0.67%) Microsoft Certification
12 5 (0.48%) Postgraduate
13 4 (0.38%) MBA
13 4 (0.38%) PMI Certification
14 3 (0.29%) ISTQB
15 2 (0.19%) ACCA
15 2 (0.19%) CIMA
16 1 (0.096%) HND
Quality Assurance & Compliance
1 40 (3.83%) Data Quality
2 19 (1.82%) QA
3 8 (0.77%) GDPR
4 7 (0.67%) SLA
5 6 (0.57%) Sarbanes-Oxley
6 2 (0.19%) ISO/IEC 27001
7 1 (0.096%) Actionable Recommendations
System Software
1 202 (19.35%) Docker
2 93 (8.91%) HDFS
3 61 (5.84%) Apache ZooKeeper
4 30 (2.87%) VirtualBox
5 23 (2.20%) Apache Flume
6 14 (1.34%) VMware Infrastructure
7 6 (0.57%) Samba
8 5 (0.48%) Hyper-V
9 4 (0.38%) Active Directory
9 4 (0.38%) Varnish
10 3 (0.29%) vSphere
11 2 (0.19%) Microsoft Virtual Server
11 2 (0.19%) Virtual Servers
12 1 (0.096%) Virtual Machines
12 1 (0.096%) VMware NSX
Systems Management
1 158 (15.13%) Kubernetes
2 137 (13.12%) Ansible
3 75 (7.18%) Terraform
4 46 (4.41%) Puppet
5 37 (3.54%) Docker Swarm
6 30 (2.87%) Hadoop YARN
7 25 (2.39%) Salt
8 22 (2.11%) Opscode Chef
9 21 (2.01%) Oozie
10 18 (1.72%) Kibana
11 8 (0.77%) vRealize Orchestrator
12 7 (0.67%) Ambari
12 7 (0.67%) logstash
13 6 (0.57%) Nagios
14 4 (0.38%) Mesos
14 4 (0.38%) Prometheus
14 4 (0.38%) Single Sign-On
15 2 (0.19%) Fluentd
15 2 (0.19%) Graphite
15 2 (0.19%) Opsview
Vendors
1 147 (14.08%) Oracle
2 127 (12.16%) Google
3 115 (11.02%) Cloudera
4 110 (10.54%) Tableau
5 75 (7.18%) Microsoft
6 58 (5.56%) Informatica
7 52 (4.98%) Hortonworks
8 49 (4.69%) Talend
8 49 (4.69%) Teradata
9 45 (4.31%) Splunk
10 43 (4.12%) IBM
11 40 (3.83%) Databricks
12 20 (1.92%) Atlassian
13 18 (1.72%) SAP
14 16 (1.53%) Alteryx
14 16 (1.53%) Netezza
14 16 (1.53%) VMware
15 12 (1.15%) Cognos
16 10 (0.96%) Sybase
17 8 (0.77%) MapR