Period
to 22 September 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 22 September 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
22 Sep 2020
Same period 2019 Same period 2018
Rank 230 220 195
Rank change year-on-year -10 -25 +13
Permanent jobs citing Hadoop 659 2,034 2,879
As % of all permanent jobs advertised in England 1.44% 1.58% 1.85%
As % of the Database & Business Intelligence category 5.04% 5.86% 6.24%
Number of salaries quoted 501 1,602 2,246
Median annual salary £73,000 £70,000 £70,000
Median salary % change year-on-year +4.29% - +12.00%
10th Percentile £46,250 £43,750 £40,000
90th Percentile £115,000 £107,375 £98,750
UK median annual salary £72,500 £70,000 £67,500
% change year-on-year +3.57% +3.70% +12.50%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 13,068 34,706 46,113
As % of all permanent IT jobs advertised in England 28.51% 27.00% 29.70%
Number of salaries quoted 10,954 28,669 37,764
Median annual salary £55,000 £52,500 £50,000
Median salary % change year-on-year +4.76% +5.00% +2.04%
10th Percentile £33,750 £31,500 £31,250
90th Percentile £90,000 £86,250 £83,750
UK median annual salary £55,000 £52,500 £50,000
% change year-on-year +4.76% +5.00% +5.26%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

3-month moving average salary quoted in jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

Salary distribution for jobs citing Hadoop in England over the 6 months to 22 September 2020.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 22 September 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -3 459 £75,000 -6.25% 74
South East +75 75 £67,500 +26.17% 15
Midlands +65 50 £70,000 +21.74% 17
South West -18 37 £55,000 +2.42% 1
East Midlands +47 35 £70,250 +22.17% 12
North of England +88 24 £55,000 +0.92% 5
East of England +111 16 £70,000 - 2
West Midlands +67 15 £50,000 -13.04% 5
North West +89 13 £56,250 -6.25% 1
Yorkshire +80 10 £61,250 +17.79% 3
North East +15 1 £42,000 -7.51% 1
Hadoop
UK

For the 6 months to 22 September 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 428 (64.95%) Big Data
2 380 (57.66%) Python
3 370 (56.15%) Apache Spark
4 340 (51.59%) Java
5 313 (47.50%) AWS
6 272 (41.27%) SQL
7 269 (40.82%) Agile Software Development
8 254 (38.54%) Analytics
9 238 (36.12%) Kafka
10 230 (34.90%) Azure
11 197 (29.89%) Finance
12 193 (29.29%) Apache Hive
13 176 (26.71%) DevOps
14 170 (25.80%) Degree
15 168 (25.49%) Data Science
16 164 (24.89%) Scala
17 154 (23.37%) ETL
18 153 (23.22%) Machine Learning
19 146 (22.15%) NoSQL
19 146 (22.15%) Software Engineering
20 123 (18.66%) Computer Science
21 113 (17.15%) Docker
22 112 (17.00%) Data Analytics
22 112 (17.00%) JavaScript
23 111 (16.84%) MongoDB
23 111 (16.84%) Git (software)
24 108 (16.39%) Kubernetes
25 107 (16.24%) GCP
25 107 (16.24%) Oracle
25 107 (16.24%) Scrum

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 370 (56.15%) Apache Spark
2 83 (12.59%) Apache
3 69 (10.47%) SAS
4 44 (6.68%) Elasticsearch
5 29 (4.40%) Apache Airflow
6 20 (3.03%) Jupyter
7 14 (2.12%) Confluence
8 12 (1.82%) CMS
9 11 (1.67%) Luigi
9 11 (1.67%) Tomcat
10 10 (1.52%) Apache Pig
11 7 (1.06%) Cloud Foundry
12 5 (0.76%) Apache Solr
12 5 (0.76%) Apache Synapse
12 5 (0.76%) IBM Domino
13 4 (0.61%) nginx
13 4 (0.61%) Oracle Coherence
14 3 (0.46%) JBoss
14 3 (0.46%) Pachyderm
14 3 (0.46%) Tornado
Applications
1 4 (0.61%) Microsoft Excel
2 2 (0.30%) Microsoft Office
2 2 (0.30%) Microsoft PowerPoint
2 2 (0.30%) MS Visio
Business Applications
1 4 (0.61%) Eikon
2 3 (0.46%) Distributed Ledger
2 3 (0.46%) Oracle Cash Management
3 2 (0.30%) SAP CRM
3 2 (0.30%) SAP ERP
3 2 (0.30%) SAP IS-U
4 1 (0.15%) SAP Hybris
Cloud Services
1 313 (47.50%) AWS
2 230 (34.90%) Azure
3 107 (16.24%) GCP
4 70 (10.62%) Power Platform
5 37 (5.61%) Amazon EMR
6 34 (5.16%) Amazon S3
7 31 (4.70%) SaaS
8 27 (4.10%) Amazon EC2
9 22 (3.34%) Amazon Kinesis
10 19 (2.88%) Serverless
11 15 (2.28%) Azure Data Factory
11 15 (2.28%) IaaS
12 14 (2.12%) Amazon SQS
12 14 (2.12%) Logic Apps
13 11 (1.67%) AWS Lambda
14 9 (1.37%) PaaS
15 7 (1.06%) Amazon ECS
15 7 (1.06%) Office 365
16 6 (0.91%) Amazon CloudWatch
16 6 (0.91%) AWS CloudFormation
Communications & Networking
1 23 (3.49%) HTTP
2 12 (1.82%) Kerberos
2 12 (1.82%) TCP/IP
3 11 (1.67%) FTP
4 8 (1.21%) 5G
4 8 (1.21%) SSH
5 7 (1.06%) Internet
5 7 (1.06%) SSL
6 6 (0.91%) DSL
7 5 (0.76%) Firewall
8 3 (0.46%) HTTPS
8 3 (0.46%) Modbus
8 3 (0.46%) MQTT
8 3 (0.46%) Profibus
8 3 (0.46%) RS-232
8 3 (0.46%) RS-485
9 2 (0.30%) Network Security
10 1 (0.15%) 3G
10 1 (0.15%) 4G
10 1 (0.15%) DHCP
Database & Business Intelligence
1 428 (64.95%) Big Data
2 193 (29.29%) Apache Hive
3 146 (22.15%) NoSQL
4 111 (16.84%) MongoDB
5 98 (14.87%) Data Warehouse
6 97 (14.72%) Apache Cassandra
7 96 (14.57%) SQL Server
8 82 (12.44%) HBase
9 79 (11.99%) Amazon Redshift
10 78 (11.84%) Impala
11 70 (10.62%) Power BI
12 64 (9.71%) Data Lake
13 61 (9.26%) Relational Database
14 57 (8.65%) Data Mining
15 51 (7.74%) Flink
16 50 (7.59%) Oracle Database
16 50 (7.59%) Pentaho
17 49 (7.44%) PostgreSQL
18 46 (6.98%) BusinessObjects
19 35 (5.31%) RDBMS
Development Applications
1 111 (16.84%) Git (software)
2 73 (11.08%) Jenkins
3 29 (4.40%) JIRA
4 25 (3.79%) Cucumber
5 21 (3.19%) Artifactory
5 21 (3.19%) Bitbucket
5 21 (3.19%) Maven
6 16 (2.43%) TeamCity
7 14 (2.12%) Atlassian Bamboo
8 10 (1.52%) Sonatype Nexus
9 8 (1.21%) JUnit
10 7 (1.06%) ER Studio
10 7 (1.06%) ERwin
11 6 (0.91%) PowerDesigner
11 6 (0.91%) RStudio
12 5 (0.76%) Selenium
13 4 (0.61%) GitLab
13 4 (0.61%) GoCD
13 4 (0.61%) Octopus Deploy
13 4 (0.61%) Subversion
General
1 197 (29.89%) Finance
2 65 (9.86%) Banking
3 36 (5.46%) Front Office
4 25 (3.79%) Marketing
5 21 (3.19%) Retail
6 14 (2.12%) Manufacturing
6 14 (2.12%) Telecoms
7 13 (1.97%) Advertising
8 11 (1.67%) Investment Banking
9 7 (1.06%) Financial Institution
9 7 (1.06%) Games
10 6 (0.91%) Law
10 6 (0.91%) Pharmaceutical
10 6 (0.91%) Public Sector
11 4 (0.61%) Aerospace
11 4 (0.61%) Electronics
12 3 (0.46%) Legal
12 3 (0.46%) Retail Banking
13 2 (0.30%) Automotive
13 2 (0.30%) Private Banking
Job Titles
1 203 (30.80%) Data Engineer
2 160 (24.28%) Developer
3 73 (11.08%) Architect
4 71 (10.77%) Java Developer
5 65 (9.86%) Data Scientist
6 53 (8.04%) Big Data Engineer
7 50 (7.59%) Data Architect
8 43 (6.53%) Senior Data Engineer
9 39 (5.92%) Software Engineer
10 37 (5.61%) AWS Engineer
11 34 (5.16%) Senior Data Scientist
12 33 (5.01%) Senior Developer
13 28 (4.25%) Hadoop Engineer
14 27 (4.10%) Python Engineer
15 24 (3.64%) Java Engineer
16 23 (3.49%) Consultant
17 19 (2.88%) Scala Developer
18 18 (2.73%) Big Data Developer
18 18 (2.73%) Kubernetes Engineer
19 17 (2.58%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 238 (36.12%) Kafka
2 57 (8.65%) Spring
3 55 (8.35%) React
4 49 (7.44%) Natural Language Processing
5 44 (6.68%) AngularJS
6 41 (6.22%) Web Services
7 38 (5.77%) scikit-learn
8 37 (5.61%) TensorFlow
9 34 (5.16%) Node.js
10 33 (5.01%) NumPy
11 31 (4.70%) .NET
11 31 (4.70%) HTML
11 31 (4.70%) Pandas
12 29 (4.40%) REST
13 27 (4.10%) PySpark
14 26 (3.95%) JMS
15 25 (3.79%) Spark Streaming
16 24 (3.64%) Keras
16 24 (3.64%) Spring Boot
17 23 (3.49%) RESTful
Miscellaneous
1 76 (11.53%) Analytical Skills
2 74 (11.23%) Algorithms
3 35 (5.31%) Hedge funds
3 35 (5.31%) Management Information System
4 26 (3.95%) Equities
5 25 (3.79%) Self-Motivation
6 22 (3.34%) Hybrid Cloud
7 18 (2.73%) Cloud Native
7 18 (2.73%) Data Structures
8 15 (2.28%) Data Centre
9 14 (2.12%) Enterprise Software
9 14 (2.12%) Greenfield Project
10 10 (1.52%) Credit Risk
11 9 (1.37%) Blog
11 9 (1.37%) Linux Command Line
12 8 (1.21%) Derivative
12 8 (1.21%) Fixed Income
12 8 (1.21%) FMCG
12 8 (1.21%) Market Risk
13 7 (1.06%) User Experience
Operating Systems
1 93 (14.11%) Linux
2 78 (11.84%) Unix
3 20 (3.03%) Windows
4 13 (1.97%) Red Hat Enterprise Linux
5 10 (1.52%) CentOS
6 1 (0.15%) Android
6 1 (0.15%) Apple iOS
Processes & Methodologies
1 269 (40.82%) Agile Software Development
2 254 (38.54%) Analytics
3 176 (26.71%) DevOps
4 168 (25.49%) Data Science
5 154 (23.37%) ETL
6 153 (23.22%) Machine Learning
7 146 (22.15%) Software Engineering
8 123 (18.66%) Computer Science
9 112 (17.00%) Data Analytics
10 107 (16.24%) Scrum
11 92 (13.96%) Mathematics
12 90 (13.66%) Microservices
13 89 (13.51%) Business Intelligence
14 84 (12.75%) Artificial Intelligence
15 81 (12.29%) Mentoring
16 78 (11.84%) Visualisation
17 76 (11.53%) Data Modelling
18 65 (9.86%) Data Engineering
19 61 (9.26%) Problem-Solving
19 61 (9.26%) Requirements Gathering
Programming Languages
1 380 (57.66%) Python
2 340 (51.59%) Java
3 272 (41.27%) SQL
4 164 (24.89%) Scala
5 112 (17.00%) JavaScript
6 95 (14.42%) R
7 50 (7.59%) PL/SQL
8 48 (7.28%) C#
9 47 (7.13%) Shell Script
10 39 (5.92%) HiveQL
11 38 (5.77%) C++
12 36 (5.46%) Bash Shell
13 34 (5.16%) Java 8
14 22 (3.34%) Go
15 18 (2.73%) C
16 16 (2.43%) Kotlin
17 12 (1.82%) PHP
18 9 (1.37%) Ruby
19 8 (1.21%) TypeScript
20 7 (1.06%) ES6
Qualifications
1 170 (25.80%) Degree
2 95 (14.42%) Computer Science Degree
3 27 (4.10%) Master's Degree
3 27 (4.10%) Security Cleared
4 26 (3.95%) BPSS Clearance
5 23 (3.49%) PhD
6 20 (3.03%) DV Cleared
7 14 (2.12%) SC Cleared
8 7 (1.06%) Numerate Degree
9 5 (0.76%) AWS Certification
9 5 (0.76%) TOGAF Certification
10 4 (0.61%) PMI Certification
11 2 (0.30%) HND
Quality Assurance & Compliance
1 17 (2.58%) Data Quality
2 14 (2.12%) GDPR
3 11 (1.67%) QA
4 9 (1.37%) SLA
5 6 (0.91%) Sarbanes-Oxley
6 3 (0.46%) ISO 20022
6 3 (0.46%) PSD2
6 3 (0.46%) TARGET2
7 1 (0.15%) Basel III
7 1 (0.15%) COREP
7 1 (0.15%) CRD IV
7 1 (0.15%) IFRS
7 1 (0.15%) IFRS 9
7 1 (0.15%) ISO 26262
System Software
1 113 (17.15%) Docker
2 89 (13.51%) HDFS
3 29 (4.40%) Apache ZooKeeper
4 21 (3.19%) VMware Infrastructure
5 12 (1.82%) Hyper-V
6 9 (1.37%) Active Directory
6 9 (1.37%) Apache Flume
7 6 (0.91%) Samba
8 4 (0.61%) Varnish
9 3 (0.46%) Microsoft Virtual Server
9 3 (0.46%) Virtual Servers
9 3 (0.46%) vSphere
10 2 (0.30%) VirtualBox
11 1 (0.15%) Tivoli Workload Scheduler
11 1 (0.15%) Virtual Machines
Systems Management
1 108 (16.39%) Kubernetes
2 59 (8.95%) Ansible
3 40 (6.07%) Terraform
4 27 (4.10%) Hadoop YARN
5 16 (2.43%) Kibana
6 14 (2.12%) Puppet
7 10 (1.52%) Oozie
8 8 (1.21%) Ambari
8 8 (1.21%) vRealize Orchestrator
9 5 (0.76%) Opscode Chef
10 4 (0.61%) Nagios
10 4 (0.61%) Prometheus
11 3 (0.46%) Cobbler
11 3 (0.46%) logstash
11 3 (0.46%) Red Hat Satellite
11 3 (0.46%) Single Sign-On
12 2 (0.30%) Docker Swarm
12 2 (0.30%) Fluentd
12 2 (0.30%) HP Fortify
12 2 (0.30%) Salt
Vendors
1 107 (16.24%) Oracle
2 102 (15.48%) Cloudera
3 72 (10.93%) Tableau
4 50 (7.59%) Databricks
5 49 (7.44%) Informatica
6 48 (7.28%) Talend
7 45 (6.83%) Google
8 43 (6.53%) Microsoft
8 43 (6.53%) Teradata
9 24 (3.64%) Splunk
10 22 (3.34%) VMware
11 16 (2.43%) Hortonworks
12 14 (2.12%) IBM
13 11 (1.67%) Netezza
14 8 (1.21%) Ab Initio
14 8 (1.21%) Atlassian
15 7 (1.06%) LogicMonitor
16 5 (0.76%) MapR
16 5 (0.76%) SAP
16 5 (0.76%) Sybase