Period
to 21 October 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 October 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
21 Oct 2019
Same period 2018 Same period 2017
Rank 226 192 203
Rank change year-on-year -34 +11 +12
Permanent jobs citing Hadoop 1,903 2,782 2,972
As % of all permanent IT jobs advertised in England 1.50% 1.83% 1.82%
As % of the Database & Business Intelligence category 5.59% 6.19% 5.99%
Number of salaries quoted 1,434 2,040 2,209
England median annual salary £70,000 £70,000 £62,500
Median salary % change year-on-year - +12.00% -
10th Percentile £43,750 £39,241 £37,500
90th Percentile £105,000 £100,000 £97,500
UK median annual salary £70,000 £67,500 £60,000
% change year-on-year +3.70% +12.50% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 34,049 44,976 49,598
As % of all permanent IT jobs advertised in England 26.89% 29.50% 30.35%
Number of salaries quoted 28,327 36,865 41,139
England median annual salary £52,500 £50,000 £50,000
Median salary % change year-on-year +5.00% - +5.26%
10th Percentile £31,589 £31,250 £30,000
90th Percentile £86,250 £83,750 £77,500
UK median annual salary £52,500 £50,000 £48,000
% change year-on-year +5.00% +4.17% +1.05%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 21 October 2019.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 21 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -25 1,164 £77,500 +3.33% 136
South East -78 208 £55,750 -7.08% 36
South West +23 202 £53,700 +2.29% 29
North of England -58 144 £55,000 - 15
Midlands +15 124 £57,500 -11.54% 9
East Midlands +27 78 £58,750 -21.67% 5
Yorkshire +9 77 £55,000 +4.76% 7
North West -59 52 £60,000 +9.09% 8
West Midlands +21 46 £55,000 -8.33% 4
East of England -30 46 £70,000 +6.06% 11
North East +29 15 £45,412 -54.59%
Hadoop
UK

For the 6 months to 21 October 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,204 (63.27%) Big Data
2 1,131 (59.43%) Apache Spark
3 1,099 (57.75%) Python
4 928 (48.77%) Agile Software Development
5 833 (43.77%) Java
6 812 (42.67%) SQL
7 767 (40.30%) Analytics
8 718 (37.73%) AWS
9 657 (34.52%) Scala
10 624 (32.79%) Data Science
11 586 (30.79%) Apache Hive
12 532 (27.96%) Azure
13 457 (24.01%) Machine Learning
14 434 (22.81%) NoSQL
15 408 (21.44%) ETL
16 397 (20.86%) Data Warehouse
17 384 (20.18%) Business Intelligence
18 376 (19.76%) Kafka
19 364 (19.13%) Software Engineering
20 362 (19.02%) DevOps
21 354 (18.60%) Analytical Skills
22 335 (17.60%) Data Modelling
23 332 (17.45%) Linux
24 317 (16.66%) Finance
25 316 (16.61%) Docker
26 312 (16.40%) R
27 309 (16.24%) GCP
27 309 (16.24%) Degree
28 295 (15.50%) Data Engineering
29 268 (14.08%) Banking

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,131 (59.43%) Apache Spark
2 142 (7.46%) Apache
3 133 (6.99%) Elasticsearch
4 91 (4.78%) SAS
5 81 (4.26%) Apache Pig
6 48 (2.52%) Apache Airflow
7 42 (2.21%) Apache Solr
8 23 (1.21%) Confluence
8 23 (1.21%) Hyperledger
9 22 (1.16%) nginx
10 20 (1.05%) SharePoint
11 19 (1.00%) JBoss
12 16 (0.84%) IIS
13 15 (0.79%) Tomcat
13 15 (0.79%) WebSphere
14 14 (0.74%) Jupyter
15 12 (0.63%) Luigi
16 11 (0.58%) MQSeries
16 11 (0.58%) WebSphere Application Server
17 8 (0.42%) OpenStack
Applications
1 8 (0.42%) Microsoft Office
2 7 (0.37%) SPSS
3 5 (0.26%) Spreadsheet
4 4 (0.21%) GNU Octave
4 4 (0.21%) Microsoft Excel
4 4 (0.21%) Microsoft PowerPoint
5 2 (0.11%) Microsoft Project
6 1 (0.053%) Chatbot
6 1 (0.053%) CPLEX
6 1 (0.053%) MS Visio
6 1 (0.053%) SPSS Modeler
6 1 (0.053%) Weka
Business Applications
1 2 (0.11%) Adobe Campaign
2 1 (0.053%) Data Workbench
2 1 (0.053%) FINCAD Analytics
2 1 (0.053%) Magento
2 1 (0.053%) Sparx Enterprise Architect
2 1 (0.053%) WebTrends
Cloud Services
1 718 (37.73%) AWS
2 532 (27.96%) Azure
3 309 (16.24%) GCP
4 111 (5.83%) Power Platform
5 106 (5.57%) Amazon EMR
6 90 (4.73%) PaaS
7 85 (4.47%) Amazon S3
8 67 (3.52%) GitHub
9 65 (3.42%) Azure Data Factory
10 61 (3.21%) Serverless
11 56 (2.94%) SaaS
12 41 (2.15%) Cloud Computing
13 39 (2.05%) Amazon Kinesis
14 35 (1.84%) Amazon EC2
15 28 (1.47%) IaaS
16 22 (1.16%) Amazon ECS
16 22 (1.16%) AWS Lambda
17 21 (1.10%) IBM Cloud
18 18 (0.95%) Office 365
19 17 (0.89%) Amazon SageMaker
Communications & Networking
1 47 (2.47%) Internet
2 27 (1.42%) Firewall
3 23 (1.21%) TCP/IP
4 17 (0.89%) HTTP
5 15 (0.79%) Kerberos
6 14 (0.74%) SSL
7 12 (0.63%) Broadband
8 9 (0.47%) DNS
8 9 (0.47%) SSH
8 9 (0.47%) VPN
9 6 (0.32%) VLAN
10 5 (0.26%) HTTPS
11 4 (0.21%) ATM
11 4 (0.21%) Network Security
12 2 (0.11%) 4G
12 2 (0.11%) SMS
13 1 (0.053%) 5G
13 1 (0.053%) LAN
13 1 (0.053%) Software-Defined Networking
13 1 (0.053%) WAN
Database & Business Intelligence
1 1,204 (63.27%) Big Data
2 586 (30.79%) Apache Hive
3 434 (22.81%) NoSQL
4 397 (20.86%) Data Warehouse
5 262 (13.77%) HBase
6 241 (12.66%) MongoDB
7 218 (11.46%) Apache Cassandra
8 191 (10.04%) SQL Server
9 189 (9.93%) Impala
10 171 (8.99%) Amazon Redshift
11 165 (8.67%) Data Lake
12 157 (8.25%) PostgreSQL
13 130 (6.83%) Relational Database
14 111 (5.83%) Power BI
15 109 (5.73%) Sqoop
16 108 (5.68%) BigQuery
17 102 (5.36%) MySQL
18 95 (4.99%) Neo4j
19 86 (4.52%) Data Mining
20 70 (3.68%) SQL Server Integration Services
Development Applications
1 238 (12.51%) Jenkins
2 225 (11.82%) Git (software)
3 91 (4.78%) Maven
4 90 (4.73%) JIRA
5 79 (4.15%) Bitbucket
6 56 (2.94%) Selenium
7 51 (2.68%) Artifactory
7 51 (2.68%) Atlassian Bamboo
8 42 (2.21%) Cucumber
9 32 (1.68%) Vagrant
10 27 (1.42%) Team Foundation Server
11 25 (1.31%) ERwin
11 25 (1.31%) SonarQube
12 24 (1.26%) Ant
12 24 (1.26%) TeamCity
13 21 (1.10%) Subversion
13 21 (1.10%) Visual Studio
14 18 (0.95%) Gradle
15 17 (0.89%) GitLab
16 14 (0.74%) ProC
General
1 317 (16.66%) Finance
2 268 (14.08%) Banking
3 192 (10.09%) Retail
4 72 (3.78%) Marketing
5 71 (3.73%) Public Sector
6 67 (3.52%) Telecoms
7 54 (2.84%) Law
8 45 (2.36%) Manufacturing
9 40 (2.10%) Games
10 34 (1.79%) Advertising
11 29 (1.52%) Investment Banking
12 28 (1.47%) Automotive
13 23 (1.21%) Electronics
14 22 (1.16%) Front Office
15 9 (0.47%) Financial Institution
15 9 (0.47%) Legal
16 7 (0.37%) Retail Banking
17 5 (0.26%) Publishing
18 4 (0.21%) Online Betting
19 3 (0.16%) Music Industry
Job Titles
1 553 (29.06%) Data Engineer
2 408 (21.44%) Developer
3 208 (10.93%) Java Developer
4 198 (10.40%) Architect
5 145 (7.62%) Big Data Engineer
6 144 (7.57%) Data Architect
7 142 (7.46%) Data Scientist
8 129 (6.78%) Software Engineer
9 125 (6.57%) Senior Data Engineer
10 94 (4.94%) Senior Developer
11 79 (4.15%) Hadoop Engineer
12 76 (3.99%) Python Engineer
13 74 (3.89%) DevOps Engineer
14 66 (3.47%) Big Data Developer
15 63 (3.31%) Senior Java Developer
16 57 (3.00%) Java Engineer
17 55 (2.89%) Cloud Engineer
18 50 (2.63%) Software Developer
19 49 (2.57%) Agile Developer
20 48 (2.52%) Agile Java Developer
Libraries, Frameworks & Software Standards
1 376 (19.76%) Kafka
2 107 (5.62%) Spring
3 96 (5.04%) Web Services
4 85 (4.47%) TensorFlow
5 82 (4.31%) Pandas
6 80 (4.20%) Node.js
7 79 (4.15%) scikit-learn
8 72 (3.78%) React
8 72 (3.78%) RESTful
9 69 (3.63%) HTML
10 68 (3.57%) AngularJS
11 62 (3.26%) REST
12 61 (3.21%) Spark Streaming
13 59 (3.10%) Natural Language Processing
14 51 (2.68%) Apache Beam
15 47 (2.47%) Apache NiFi
16 46 (2.42%) Akka
17 43 (2.26%) NumPy
18 42 (2.21%) OAuth
18 42 (2.21%) Spring Boot
Miscellaneous
1 354 (18.60%) Analytical Skills
2 204 (10.72%) Algorithms
3 101 (5.31%) Data Structures
4 54 (2.84%) Public Cloud
5 52 (2.73%) Greenfield Project
6 51 (2.68%) Linux Command Line
6 51 (2.68%) Management Information System
7 38 (2.00%) User Experience
8 35 (1.84%) Private Cloud
9 28 (1.47%) Mainframe
10 27 (1.42%) Virtual Team
11 26 (1.37%) Blog
12 21 (1.10%) Cloud Native
13 20 (1.05%) Video on Demand
14 19 (1.00%) Social Media
15 18 (0.95%) Acoustics
15 18 (0.95%) Mobile App
16 17 (0.89%) Data Centre
16 17 (0.89%) Enterprise Software
17 14 (0.74%) Derivative
Operating Systems
1 332 (17.45%) Linux
2 217 (11.40%) Unix
3 45 (2.36%) Windows
4 20 (1.05%) Red Hat Enterprise Linux
5 18 (0.95%) CentOS
6 14 (0.74%) zOS
7 13 (0.68%) Ubuntu
8 11 (0.58%) Windows Server
9 9 (0.47%) Debian
10 6 (0.32%) VME
11 4 (0.21%) Android
12 2 (0.11%) SUSE Linux Enterprise Server
13 1 (0.053%) Apple iOS
13 1 (0.053%) HPUX
13 1 (0.053%) Mac OS X
13 1 (0.053%) Oracle Linux
Processes & Methodologies
1 928 (48.77%) Agile Software Development
2 767 (40.30%) Analytics
3 624 (32.79%) Data Science
4 457 (24.01%) Machine Learning
5 408 (21.44%) ETL
6 384 (20.18%) Business Intelligence
7 364 (19.13%) Software Engineering
8 362 (19.02%) DevOps
9 335 (17.60%) Data Modelling
10 295 (15.50%) Data Engineering
11 266 (13.98%) Visualisation
12 248 (13.03%) Data Analytics
13 221 (11.61%) Artificial Intelligence
14 202 (10.61%) Data Analysis
15 197 (10.35%) Open Source
16 187 (9.83%) Mathematics
17 182 (9.56%) Computer Science
18 173 (9.09%) Scrum
19 172 (9.04%) Microservices
20 161 (8.46%) TDD
Programming Languages
1 1,099 (57.75%) Python
2 833 (43.77%) Java
3 812 (42.67%) SQL
4 657 (34.52%) Scala
5 312 (16.40%) R
6 181 (9.51%) JavaScript
7 160 (8.41%) C
8 142 (7.46%) C#
9 93 (4.89%) C++
10 91 (4.78%) PL/SQL
11 71 (3.73%) Bash Shell
12 67 (3.52%) Shell Script
13 46 (2.42%) Java 8
14 44 (2.31%) Ruby
15 41 (2.15%) Go
16 37 (1.94%) TypeScript
17 35 (1.84%) PHP
18 29 (1.52%) Perl
19 27 (1.42%) HiveQL
20 25 (1.31%) PowerShell
Qualifications
1 309 (16.24%) Degree
2 110 (5.78%) Security Cleared
3 78 (4.10%) PhD
4 60 (3.15%) Computer Science Degree
5 49 (2.57%) SC Cleared
6 42 (2.21%) Master's Degree
7 37 (1.94%) DV Cleared
8 30 (1.58%) Numerate Degree
9 4 (0.21%) AWS Certification
9 4 (0.21%) Microsoft Certification
9 4 (0.21%) Postgraduate
10 3 (0.16%) ISTQB
10 3 (0.16%) ISTQB Foundation Certification
11 2 (0.11%) MBA
11 2 (0.11%) MCSA
12 1 (0.053%) CCA
12 1 (0.053%) ITIL Certification
12 1 (0.053%) MCSD
12 1 (0.053%) PMI Certification
12 1 (0.053%) SAS Certification
Quality Assurance & Compliance
1 106 (5.57%) Data Quality
2 85 (4.47%) QA
3 15 (0.79%) GDPR
3 15 (0.79%) ISO/IEC 27001
4 2 (0.11%) GxP
5 1 (0.053%) IFRS
5 1 (0.053%) IFRS 9
5 1 (0.053%) ISO 26262
5 1 (0.053%) PMO
System Software
1 316 (16.61%) Docker
2 188 (9.88%) HDFS
3 63 (3.31%) Apache ZooKeeper
4 48 (2.52%) Apache Flume
5 31 (1.63%) VirtualBox
6 10 (0.53%) Cronacle
7 6 (0.32%) Virtual Machines
7 6 (0.32%) VMware Infrastructure
8 5 (0.26%) Active Directory
9 4 (0.21%) Hyper-V
9 4 (0.21%) Varnish
10 2 (0.11%) vSphere
11 1 (0.053%) Virtual Servers
Systems Management
1 197 (10.35%) Kubernetes
2 190 (9.98%) Ansible
3 162 (8.51%) Terraform
4 105 (5.52%) Hadoop YARN
5 93 (4.89%) Oozie
6 77 (4.05%) Puppet
7 54 (2.84%) Opscode Chef
8 42 (2.21%) Docker Swarm
9 20 (1.05%) Ambari
10 17 (0.89%) Consul
11 15 (0.79%) logstash
12 11 (0.58%) Kibana
12 11 (0.58%) Mesos
13 10 (0.53%) Control-M
13 10 (0.53%) Single Sign-On
14 8 (0.42%) Prometheus
14 8 (0.42%) Salt
15 6 (0.32%) Marathon
15 6 (0.32%) Rancher
16 5 (0.26%) Nagios
Vendors
1 253 (13.29%) Google
2 228 (11.98%) Oracle
3 226 (11.88%) Cloudera
4 190 (9.98%) Tableau
5 144 (7.57%) Microsoft
6 124 (6.52%) Hortonworks
7 123 (6.46%) Teradata
8 106 (5.57%) Informatica
9 84 (4.41%) Databricks
10 77 (4.05%) Talend
11 70 (3.68%) IBM
12 42 (2.21%) Splunk
13 29 (1.52%) Netezza
13 29 (1.52%) SAP
14 28 (1.47%) Red Hat
15 22 (1.16%) Atlassian
16 21 (1.10%) Ab Initio
17 20 (1.05%) MapR
18 18 (0.95%) Dataiku
19 12 (0.63%) VMware