Period
to 17 January 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 17 January 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
17 Jan 2020
Same period 2019 Same period 2018
Rank 242 182 201
Rank change year-on-year -60 +19 -4
Permanent jobs citing Hadoop 1,572 2,650 2,859
As % of all permanent IT jobs advertised in England 1.35% 1.89% 1.76%
As % of the Database & Business Intelligence category 5.03% 6.60% 5.78%
Number of salaries quoted 1,247 1,956 2,241
England median annual salary £70,000 £70,000 £65,000
Median salary % change year-on-year - +7.69% +4.00%
10th Percentile £45,915 £41,250 £39,500
90th Percentile £108,000 £101,875 £100,000
UK median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% +4.00%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 31,245 40,135 49,496
As % of all permanent IT jobs advertised in England 26.79% 28.56% 30.52%
Number of salaries quoted 25,875 33,212 41,371
England median annual salary £52,500 £52,500 £50,000
Median salary % change year-on-year - +5.00% +5.26%
10th Percentile £32,500 £31,500 £30,500
90th Percentile £90,000 £85,000 £77,500
UK median annual salary £52,500 £52,500 £48,000
% change year-on-year - +9.38% +1.05%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 17 January 2020.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 17 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -56 969 £75,000 - 168
South East -63 174 £50,000 -18.37% 47
Midlands +40 150 £70,000 +9.80% 22
North of England -39 120 £54,835 -8.61% 22
South West -47 100 £52,500 -4.55% 21
East Midlands +20 86 £72,500 +3.57% 6
Yorkshire +34 69 £55,000 +8.91% 9
West Midlands +30 64 £62,000 +30.53% 16
East of England -10 46 £75,000 +11.11% 18
North West -49 39 £54,486 -16.18% 12
North East +3 12 £54,671 -8.88% 1
Hadoop
UK

For the 6 months to 17 January 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,044 (66.41%) Big Data
2 996 (63.36%) Apache Spark
3 896 (57.00%) Python
4 726 (46.18%) Agile Software Development
5 706 (44.91%) Java
6 689 (43.83%) SQL
7 683 (43.45%) AWS
8 621 (39.50%) Analytics
9 527 (33.52%) Azure
10 473 (30.09%) Data Science
11 472 (30.03%) Apache Hive
12 464 (29.52%) Scala
13 433 (27.54%) Machine Learning
14 427 (27.16%) NoSQL
15 335 (21.31%) ETL
16 327 (20.80%) Kafka
17 319 (20.29%) DevOps
18 315 (20.04%) Software Engineering
19 314 (19.97%) Data Modelling
20 312 (19.85%) Linux
21 301 (19.15%) Docker
22 300 (19.08%) GCP
23 297 (18.89%) Finance
24 294 (18.70%) Data Warehouse
25 289 (18.38%) Business Intelligence
26 273 (17.37%) Data Engineering
27 242 (15.39%) Analytical Skills
28 240 (15.27%) Google
28 240 (15.27%) Degree
29 238 (15.14%) Artificial Intelligence

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 996 (63.36%) Apache Spark
2 133 (8.46%) Elasticsearch
3 124 (7.89%) Apache
4 76 (4.83%) SAS
5 52 (3.31%) Apache Airflow
6 35 (2.23%) Apache Pig
7 27 (1.72%) Apache Solr
7 27 (1.72%) Tomcat
8 26 (1.65%) Confluence
9 19 (1.21%) IIS
9 19 (1.21%) Luigi
10 18 (1.15%) JBoss
11 17 (1.08%) Jupyter
12 16 (1.02%) nginx
13 15 (0.95%) SharePoint
14 8 (0.51%) WebSphere
15 7 (0.45%) MQSeries
15 7 (0.45%) WebSphere Application Server
16 6 (0.38%) Hyperledger
16 6 (0.38%) IPython
Applications
1 9 (0.57%) Microsoft Excel
2 7 (0.45%) SPSS
3 4 (0.25%) Spreadsheet
4 3 (0.19%) Microsoft Office
4 3 (0.19%) Microsoft PowerPoint
5 2 (0.13%) Microsoft Project
6 1 (0.064%) Chatbot
6 1 (0.064%) Simulink
6 1 (0.064%) SPSS Modeler
Business Applications
1 6 (0.38%) Sparx Enterprise Architect
2 3 (0.19%) SAP BPC
3 2 (0.13%) Adobe Campaign
3 2 (0.13%) Eikon
4 1 (0.064%) Data Workbench
4 1 (0.064%) FINCAD Analytics
4 1 (0.064%) NetSuite
4 1 (0.064%) SAP CO
4 1 (0.064%) SAP ERP
4 1 (0.064%) SAP FI
4 1 (0.064%) SAP FI/CO
4 1 (0.064%) SAP InfiniteInsight
4 1 (0.064%) SAP S/4HANA
4 1 (0.064%) WebTrends
Cloud Services
1 683 (43.45%) AWS
2 527 (33.52%) Azure
3 300 (19.08%) GCP
4 122 (7.76%) Amazon EMR
5 111 (7.06%) Amazon S3
6 70 (4.45%) Power Platform
7 59 (3.75%) PaaS
8 55 (3.50%) Serverless
9 50 (3.18%) Azure Data Factory
10 49 (3.12%) Amazon Kinesis
11 38 (2.42%) GitHub
12 37 (2.35%) SaaS
13 36 (2.29%) AWS Lambda
14 32 (2.04%) Amazon SageMaker
15 27 (1.72%) Amazon EC2
15 27 (1.72%) IBM Cloud
16 23 (1.46%) IaaS
16 23 (1.46%) OpenShift
17 20 (1.27%) Cloud Computing
18 17 (1.08%) Azure Machine Learning
Communications & Networking
1 36 (2.29%) TCP/IP
2 33 (2.10%) Firewall
3 25 (1.59%) SSL
4 23 (1.46%) DNS
4 23 (1.46%) HTTP
5 21 (1.34%) Internet
6 15 (0.95%) Kerberos
7 10 (0.64%) VPN
8 9 (0.57%) Broadband
8 9 (0.57%) SSH
9 8 (0.51%) ZigBee
10 5 (0.32%) HTTPS
11 4 (0.25%) 4G
11 4 (0.25%) ATM
11 4 (0.25%) Network Security
12 3 (0.19%) 3G
12 3 (0.19%) 5G
12 3 (0.19%) VLAN
12 3 (0.19%) Wi-Fi
13 2 (0.13%) SMS
Database & Business Intelligence
1 1,044 (66.41%) Big Data
2 472 (30.03%) Apache Hive
3 427 (27.16%) NoSQL
4 294 (18.70%) Data Warehouse
5 211 (13.42%) HBase
6 197 (12.53%) MongoDB
7 171 (10.88%) PostgreSQL
8 170 (10.81%) Amazon Redshift
9 164 (10.43%) SQL Server
10 154 (9.80%) Impala
11 152 (9.67%) Apache Cassandra
11 152 (9.67%) Relational Database
12 115 (7.32%) Data Lake
13 108 (6.87%) Neo4j
14 98 (6.23%) BigQuery
15 86 (5.47%) Flink
16 79 (5.03%) Data Mining
17 78 (4.96%) MySQL
18 70 (4.45%) Power BI
19 68 (4.33%) Presto
Development Applications
1 218 (13.87%) Git (software)
2 193 (12.28%) Jenkins
3 85 (5.41%) JIRA
4 77 (4.90%) Maven
5 65 (4.13%) Atlassian Bamboo
6 50 (3.18%) Artifactory
7 48 (3.05%) Bitbucket
8 44 (2.80%) Vagrant
9 35 (2.23%) TeamCity
10 29 (1.84%) SonarQube
11 26 (1.65%) Ant
12 23 (1.46%) Subversion
13 21 (1.34%) Visual Studio Team System
14 20 (1.27%) Selenium
14 20 (1.27%) Team Foundation Server
15 19 (1.21%) Octopus Deploy
16 15 (0.95%) Bower
16 15 (0.95%) MSBuild
16 15 (0.95%) TestRail
16 15 (0.95%) Zephyr
General
1 297 (18.89%) Finance
2 117 (7.44%) Banking
3 110 (7.00%) Retail
4 71 (4.52%) Public Sector
5 60 (3.82%) Marketing
6 43 (2.74%) Telecoms
7 41 (2.61%) Manufacturing
8 40 (2.54%) Automotive
9 33 (2.10%) Front Office
10 26 (1.65%) Games
11 17 (1.08%) Advertising
12 15 (0.95%) Investment Banking
12 15 (0.95%) Legal
13 13 (0.83%) Law
14 10 (0.64%) Electronics
15 7 (0.45%) Financial Institution
16 6 (0.38%) Billing
16 6 (0.38%) Online Betting
17 4 (0.25%) Retail Banking
18 3 (0.19%) Publishing
Job Titles
1 465 (29.58%) Data Engineer
2 349 (22.20%) Developer
3 195 (12.40%) Java Developer
4 180 (11.45%) Architect
5 131 (8.33%) Data Architect
6 126 (8.02%) Data Scientist
7 109 (6.93%) Software Engineer
8 103 (6.55%) Big Data Engineer
9 92 (5.85%) Senior Developer
10 78 (4.96%) Senior Data Engineer
11 64 (4.07%) Python Engineer
11 64 (4.07%) Senior Java Developer
12 63 (4.01%) Java Engineer
13 62 (3.94%) Analyst
14 55 (3.50%) DevOps Engineer
15 54 (3.44%) Consultant
16 52 (3.31%) Senior Data Scientist
17 44 (2.80%) Platform Engineer
18 42 (2.67%) Big Data Developer
18 42 (2.67%) Cloud Architect
Libraries, Frameworks & Software Standards
1 327 (20.80%) Kafka
2 116 (7.38%) React
3 114 (7.25%) Node.js
4 105 (6.68%) TensorFlow
5 98 (6.23%) AngularJS
6 89 (5.66%) Natural Language Processing
7 87 (5.53%) Web Services
8 80 (5.09%) scikit-learn
9 75 (4.77%) Spring
10 69 (4.39%) HTML
11 67 (4.26%) Spark Streaming
12 64 (4.07%) REST
13 60 (3.82%) RESTful
14 56 (3.56%) Pandas
15 46 (2.93%) HTML5
16 43 (2.74%) CSS
17 39 (2.48%) .NET
17 39 (2.48%) RabbitMQ
18 37 (2.35%) Elastic Stack
19 36 (2.29%) Apache Beam
Miscellaneous
1 242 (15.39%) Analytical Skills
2 177 (11.26%) Algorithms
3 85 (5.41%) Data Structures
4 57 (3.63%) Greenfield Project
5 52 (3.31%) Management Information System
6 43 (2.74%) Linux Command Line
7 41 (2.61%) Public Cloud
8 33 (2.10%) Blog
9 31 (1.97%) User Experience
10 29 (1.84%) Virtual Team
11 24 (1.53%) Cloud Native
12 23 (1.46%) Acoustics
13 22 (1.40%) Mobile App
14 21 (1.34%) Mainframe
14 21 (1.34%) Self-Motivation
15 20 (1.27%) Social Media
16 19 (1.21%) Video on Demand
17 17 (1.08%) Derivative
18 16 (1.02%) Data Centre
19 13 (0.83%) Private Cloud
Operating Systems
1 312 (19.85%) Linux
2 151 (9.61%) Unix
3 43 (2.74%) Windows
4 18 (1.15%) Windows Server
5 17 (1.08%) CentOS
6 15 (0.95%) Red Hat Enterprise Linux
7 11 (0.70%) Debian
7 11 (0.70%) zOS
8 9 (0.57%) Ubuntu
9 4 (0.25%) VME
10 3 (0.19%) Android
11 1 (0.064%) Solaris
Processes & Methodologies
1 726 (46.18%) Agile Software Development
2 621 (39.50%) Analytics
3 473 (30.09%) Data Science
4 433 (27.54%) Machine Learning
5 335 (21.31%) ETL
6 319 (20.29%) DevOps
7 315 (20.04%) Software Engineering
8 314 (19.97%) Data Modelling
9 289 (18.38%) Business Intelligence
10 273 (17.37%) Data Engineering
11 238 (15.14%) Artificial Intelligence
12 233 (14.82%) Data Analytics
13 213 (13.55%) Visualisation
14 210 (13.36%) Computer Science
15 174 (11.07%) Microservices
16 159 (10.11%) TDD
17 153 (9.73%) Open Source
18 142 (9.03%) Statistics
19 140 (8.91%) Problem-Solving
20 133 (8.46%) Continuous Integration
Programming Languages
1 896 (57.00%) Python
2 706 (44.91%) Java
3 689 (43.83%) SQL
4 464 (29.52%) Scala
5 227 (14.44%) JavaScript
6 183 (11.64%) R
7 147 (9.35%) C#
8 117 (7.44%) C++
9 103 (6.55%) C
10 86 (5.47%) Bash Shell
11 73 (4.64%) PL/SQL
12 46 (2.93%) PHP
13 45 (2.86%) Shell Script
14 44 (2.80%) TypeScript
15 37 (2.35%) Java 8
15 37 (2.35%) Ruby
16 35 (2.23%) Go
17 34 (2.16%) PowerShell
17 34 (2.16%) T-SQL
18 30 (1.91%) Perl
Qualifications
1 240 (15.27%) Degree
2 95 (6.04%) Security Cleared
3 89 (5.66%) Computer Science Degree
4 62 (3.94%) PhD
5 51 (3.24%) SC Cleared
6 44 (2.80%) DV Cleared
7 30 (1.91%) Master's Degree
8 25 (1.59%) Numerate Degree
9 9 (0.57%) AWS Certification
10 8 (0.51%) Postgraduate
11 3 (0.19%) MBA
12 2 (0.13%) MCSA
12 2 (0.13%) Microsoft Certification
12 2 (0.13%) PMI Certification
13 1 (0.064%) ACCA
13 1 (0.064%) CCA
13 1 (0.064%) CCNP
13 1 (0.064%) Cisco Certification
13 1 (0.064%) CISSP
13 1 (0.064%) ITIL Certification
Quality Assurance & Compliance
1 108 (6.87%) Data Quality
2 93 (5.92%) QA
3 22 (1.40%) GDPR
4 15 (0.95%) ISO/IEC 27001
5 3 (0.19%) ISO 26262
6 1 (0.064%) GxP
System Software
1 301 (19.15%) Docker
2 169 (10.75%) HDFS
3 43 (2.74%) Apache ZooKeeper
4 42 (2.67%) VirtualBox
5 31 (1.97%) Apache Flume
6 7 (0.45%) Virtual Machines
7 6 (0.38%) Active Directory
8 5 (0.32%) VMware Infrastructure
9 4 (0.25%) Cronacle
9 4 (0.25%) Hyper-V
10 3 (0.19%) Varnish
11 1 (0.064%) Alluxio
11 1 (0.064%) Ceph
11 1 (0.064%) etcd
11 1 (0.064%) Gluster
Systems Management
1 224 (14.25%) Kubernetes
2 191 (12.15%) Ansible
3 160 (10.18%) Terraform
4 80 (5.09%) Puppet
5 76 (4.83%) Oozie
6 69 (4.39%) Hadoop YARN
7 54 (3.44%) Docker Swarm
8 45 (2.86%) Opscode Chef
9 16 (1.02%) Consul
9 16 (1.02%) Salt
10 15 (0.95%) Ambari
11 10 (0.64%) Kibana
11 10 (0.64%) Single Sign-On
12 8 (0.51%) logstash
13 7 (0.45%) Mesos
14 6 (0.38%) SELinux
15 5 (0.32%) HP Quality Center
15 5 (0.32%) Prometheus
16 4 (0.25%) Marathon
16 4 (0.25%) Rancher
Vendors
1 240 (15.27%) Google
2 217 (13.80%) Cloudera
3 198 (12.60%) Oracle
4 130 (8.27%) Tableau
5 123 (7.82%) Hortonworks
6 114 (7.25%) Microsoft
7 80 (5.09%) Informatica
8 76 (4.83%) Databricks
9 75 (4.77%) Teradata
10 67 (4.26%) Talend
11 61 (3.88%) IBM
12 41 (2.61%) Splunk
13 37 (2.35%) Atlassian
14 25 (1.59%) SAP
15 24 (1.53%) Dataiku
16 19 (1.21%) MapR
17 16 (1.02%) InterSystems
18 15 (0.95%) Black Duck
18 15 (0.95%) Netezza
19 13 (0.83%) VMware