Period
to 26 February 2020

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 26 February 2020 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
26 Feb 2020
Same period 2019 Same period 2018
Rank 240 195 190
Rank change year-on-year -45 -5 +7
Permanent jobs citing Hadoop 1,650 2,738 3,195
As % of all permanent IT jobs advertised in the UK 1.34% 1.81% 1.82%
As % of the Database & Business Intelligence category 5.00% 6.32% 5.96%
Number of salaries quoted 1,279 2,038 2,476
UK median annual salary £70,000 £70,000 £65,000
Median salary % change year-on-year - +7.69% -
10th Percentile £45,000 £42,000 £39,500
90th Percentile £101,750 £105,000 £100,000
UK excluding London median annual salary £60,000 £60,000 £52,500
% change year-on-year - +14.29% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 32,987 43,335 53,596
As % of all permanent IT jobs advertised in the UK 26.79% 28.63% 30.57%
Number of salaries quoted 27,053 35,664 44,810
UK median annual salary £52,500 £52,000 £49,500
Median salary % change year-on-year +0.96% +5.05% +4.21%
10th Percentile £32,500 £31,250 £30,000
90th Percentile £88,750 £85,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 26 February 2020.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 26 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -41 1,559 £70,000 - 266
London -48 962 £75,000 - 162
UK excluding London -47 660 £60,000 - 120
South East -41 196 £52,500 -12.50% 40
Midlands +45 150 £72,500 +26.09% 18
North of England -23 122 £54,671 -12.53% 20
East Midlands +29 89 £72,500 +11.54% 2
South West -68 72 £55,500 +0.91% 20
Scotland -16 67 £53,775 -2.23% 13
Yorkshire +19 65 £55,000 +10.00% 14
West Midlands +35 61 £62,000 +30.53% 16
East of England +3 50 £75,000 +11.11% 6
North West -14 42 £52,243 -19.63% 6
North East +9 15 £54,671 -8.88%
Wales -4 3 - - 1
Channel Islands +2 1 - - 1

For the 6 months to 26 February 2020, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 1,096 (66.42%) Big Data
2 1,046 (63.39%) Apache Spark
3 968 (58.67%) Python
4 740 (44.85%) Java
5 724 (43.88%) SQL
6 723 (43.82%) Agile Software Development
7 703 (42.61%) AWS
8 665 (40.30%) Analytics
9 548 (33.21%) Azure
10 484 (29.33%) Scala
11 482 (29.21%) Data Science
12 461 (27.94%) Apache Hive
13 458 (27.76%) NoSQL
14 412 (24.97%) Machine Learning
15 394 (23.88%) Kafka
16 348 (21.09%) Finance
16 348 (21.09%) DevOps
17 342 (20.73%) ETL
18 326 (19.76%) GCP
19 320 (19.39%) Software Engineering
20 309 (18.73%) Data Modelling
21 301 (18.24%) Docker
22 293 (17.76%) Data Warehouse
23 290 (17.58%) Linux
24 281 (17.03%) Degree
25 272 (16.48%) Business Intelligence
26 271 (16.42%) Data Engineering
27 254 (15.39%) Artificial Intelligence
28 244 (14.79%) Kubernetes
29 240 (14.55%) JavaScript

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,046 (63.39%) Apache Spark
2 143 (8.67%) Elasticsearch
3 138 (8.36%) Apache
4 80 (4.85%) SAS
5 73 (4.42%) Apache Airflow
6 38 (2.30%) Luigi
7 34 (2.06%) Apache Solr
8 31 (1.88%) Tomcat
9 30 (1.82%) Apache Pig
10 24 (1.45%) Confluence
11 21 (1.27%) Jupyter
12 15 (0.91%) IIS
13 13 (0.79%) nginx
13 13 (0.79%) SharePoint
14 10 (0.61%) JBoss
15 9 (0.55%) Oracle SOA Suite
16 6 (0.36%) IPython
16 6 (0.36%) WebLogic
17 4 (0.24%) GemFire
17 4 (0.24%) Mule
Applications
1 21 (1.27%) Microsoft Excel
2 12 (0.73%) SPSS
3 9 (0.55%) Chatbot
4 5 (0.30%) Microsoft Office
5 4 (0.24%) Microsoft PowerPoint
6 1 (0.061%) Gephi
6 1 (0.061%) Simulink
6 1 (0.061%) SPSS Modeler
Business Applications
1 6 (0.36%) SAP BPC
1 6 (0.36%) Sparx Enterprise Architect
2 2 (0.12%) Eikon
2 2 (0.12%) SAP ERP
2 2 (0.12%) SAP InfiniteInsight
2 2 (0.12%) SAP S/4HANA
3 1 (0.061%) Adobe Campaign
3 1 (0.061%) Data Workbench
3 1 (0.061%) ENOVIA
3 1 (0.061%) FINCAD Analytics
3 1 (0.061%) NetSuite
3 1 (0.061%) SAP CO
3 1 (0.061%) SAP FI
3 1 (0.061%) SAP FI/CO
3 1 (0.061%) WebTrends
Cloud Services
1 703 (42.61%) AWS
2 548 (33.21%) Azure
3 326 (19.76%) GCP
4 135 (8.18%) Amazon EMR
5 110 (6.67%) Amazon S3
6 81 (4.91%) Power Platform
7 64 (3.88%) PaaS
8 57 (3.45%) Serverless
9 52 (3.15%) Azure Data Factory
10 45 (2.73%) Amazon Kinesis
11 42 (2.55%) Amazon EC2
12 39 (2.36%) IaaS
12 39 (2.36%) IBM Cloud
13 37 (2.24%) SaaS
14 32 (1.94%) GitHub
15 31 (1.88%) AWS Lambda
15 31 (1.88%) Cloud Computing
16 30 (1.82%) OpenShift
17 25 (1.52%) Azure Machine Learning
18 24 (1.45%) Amazon SageMaker
Communications & Networking
1 33 (2.00%) TCP/IP
2 32 (1.94%) Firewall
3 31 (1.88%) DNS
4 27 (1.64%) SSL
5 26 (1.58%) HTTP
6 12 (0.73%) Kerberos
7 10 (0.61%) Internet
8 9 (0.55%) VPN
8 9 (0.55%) ZigBee
9 7 (0.42%) SSH
10 6 (0.36%) 4G
10 6 (0.36%) 5G
11 5 (0.30%) 3G
11 5 (0.30%) HTTPS
11 5 (0.30%) Wi-Fi
12 4 (0.24%) ATM
12 4 (0.24%) Reverse Proxy
13 3 (0.18%) Network Security
14 2 (0.12%) LTE
14 2 (0.12%) WLAN
Database & Business Intelligence
1 1,096 (66.42%) Big Data
2 461 (27.94%) Apache Hive
3 458 (27.76%) NoSQL
4 293 (17.76%) Data Warehouse
5 218 (13.21%) HBase
6 215 (13.03%) MongoDB
7 194 (11.76%) Amazon Redshift
8 180 (10.91%) SQL Server
9 179 (10.85%) Relational Database
10 174 (10.55%) PostgreSQL
11 173 (10.48%) Apache Cassandra
12 139 (8.42%) Impala
13 125 (7.58%) Neo4j
14 116 (7.03%) Data Lake
15 105 (6.36%) BigQuery
16 81 (4.91%) Power BI
17 80 (4.85%) MySQL
18 74 (4.48%) Amazon Athena
18 74 (4.48%) Flink
19 65 (3.94%) Data Mining
Development Applications
1 219 (13.27%) Git (software)
2 193 (11.70%) Jenkins
3 84 (5.09%) JIRA
4 69 (4.18%) Atlassian Bamboo
5 62 (3.76%) Maven
6 52 (3.15%) Vagrant
7 41 (2.48%) Artifactory
8 34 (2.06%) TeamCity
9 29 (1.76%) Bitbucket
10 26 (1.58%) SonarQube
11 24 (1.45%) Ant
11 24 (1.45%) Octopus Deploy
11 24 (1.45%) Subversion
12 23 (1.39%) Visual Studio Team System
13 21 (1.27%) JUnit
14 19 (1.15%) Team Foundation Server
15 16 (0.97%) Selenium
16 15 (0.91%) Bower
16 15 (0.91%) MSBuild
16 15 (0.91%) Zephyr
General
1 348 (21.09%) Finance
2 113 (6.85%) Retail
3 97 (5.88%) Banking
4 74 (4.48%) Public Sector
5 69 (4.18%) Marketing
6 49 (2.97%) Manufacturing
7 48 (2.91%) Automotive
8 43 (2.61%) Telecoms
9 38 (2.30%) Front Office
10 28 (1.70%) Games
11 20 (1.21%) Legal
12 11 (0.67%) Advertising
13 10 (0.61%) Investment Banking
14 9 (0.55%) Electronics
15 7 (0.42%) Financial Institution
16 6 (0.36%) Billing
16 6 (0.36%) Online Betting
17 4 (0.24%) Publishing
18 3 (0.18%) Law
19 2 (0.12%) Aerospace
Job Titles
1 474 (28.73%) Data Engineer
2 349 (21.15%) Developer
3 215 (13.03%) Architect
4 191 (11.58%) Java Developer
5 149 (9.03%) Data Architect
6 117 (7.09%) Data Scientist
7 115 (6.97%) Big Data Engineer
8 99 (6.00%) Senior Developer
9 91 (5.52%) Software Engineer
10 70 (4.24%) Senior Data Engineer
10 70 (4.24%) Senior Java Developer
11 68 (4.12%) Python Engineer
12 63 (3.82%) Consultant
13 57 (3.45%) Analyst
13 57 (3.45%) DevOps Engineer
14 56 (3.39%) Software Developer
15 55 (3.33%) Java Engineer
16 53 (3.21%) Senior Data Scientist
17 48 (2.91%) Big Data Architect
18 46 (2.79%) Cloud Architect
Libraries, Frameworks & Software Standards
1 394 (23.88%) Kafka
2 131 (7.94%) React
3 126 (7.64%) Node.js
4 105 (6.36%) AngularJS
4 105 (6.36%) TensorFlow
5 100 (6.06%) Natural Language Processing
6 90 (5.45%) Web Services
7 82 (4.97%) HTML
7 82 (4.97%) Spark Streaming
8 75 (4.55%) Spring
9 72 (4.36%) .NET
10 61 (3.70%) scikit-learn
11 59 (3.58%) REST
12 54 (3.27%) HTML5
12 54 (3.27%) RESTful
13 49 (2.97%) CSS
14 38 (2.30%) Pandas
15 37 (2.24%) Elastic Stack
16 35 (2.12%) RabbitMQ
17 34 (2.06%) Spring Boot
Miscellaneous
1 222 (13.45%) Analytical Skills
2 150 (9.09%) Algorithms
3 83 (5.03%) Data Structures
4 73 (4.42%) Greenfield Project
5 57 (3.45%) Management Information System
6 45 (2.73%) Public Cloud
7 41 (2.48%) Blog
8 37 (2.24%) Self-Motivation
9 35 (2.12%) User Experience
10 34 (2.06%) Cloud Native
11 33 (2.00%) Acoustics
12 27 (1.64%) Linux Command Line
13 26 (1.58%) Virtual Team
14 22 (1.33%) Enterprise Software
15 21 (1.27%) Mobile App
16 19 (1.15%) Mainframe
16 19 (1.15%) Social Media
17 17 (1.03%) Video on Demand
18 16 (0.97%) Data Centre
18 16 (0.97%) Hedge funds
Operating Systems
1 290 (17.58%) Linux
2 122 (7.39%) Unix
3 51 (3.09%) Windows
4 20 (1.21%) Windows Server
5 15 (0.91%) CentOS
6 11 (0.67%) Red Hat Enterprise Linux
7 9 (0.55%) Debian
8 7 (0.42%) Ubuntu
9 5 (0.30%) Android
9 5 (0.30%) zOS
10 4 (0.24%) VME
11 2 (0.12%) Apple iOS
12 1 (0.061%) Solaris
Processes & Methodologies
1 723 (43.82%) Agile Software Development
2 665 (40.30%) Analytics
3 482 (29.21%) Data Science
4 412 (24.97%) Machine Learning
5 348 (21.09%) DevOps
6 342 (20.73%) ETL
7 320 (19.39%) Software Engineering
8 309 (18.73%) Data Modelling
9 272 (16.48%) Business Intelligence
10 271 (16.42%) Data Engineering
11 254 (15.39%) Artificial Intelligence
12 239 (14.48%) Computer Science
13 238 (14.42%) Data Analytics
14 202 (12.24%) Visualisation
15 198 (12.00%) Microservices
16 167 (10.12%) TDD
17 150 (9.09%) Open Source
18 145 (8.79%) Continuous Integration
18 145 (8.79%) Problem-Solving
19 140 (8.48%) Statistics
Programming Languages
1 968 (58.67%) Python
2 740 (44.85%) Java
3 724 (43.88%) SQL
4 484 (29.33%) Scala
5 240 (14.55%) JavaScript
6 200 (12.12%) R
7 170 (10.30%) C#
8 142 (8.61%) C++
9 105 (6.36%) Bash Shell
10 98 (5.94%) C
11 65 (3.94%) PL/SQL
12 49 (2.97%) Shell Script
13 40 (2.42%) PHP
14 39 (2.36%) TypeScript
15 38 (2.30%) Go
15 38 (2.30%) PowerShell
15 38 (2.30%) T-SQL
16 37 (2.24%) Ruby
17 36 (2.18%) MATLAB
18 35 (2.12%) Perl
Qualifications
1 281 (17.03%) Degree
2 117 (7.09%) Computer Science Degree
3 95 (5.76%) Security Cleared
4 66 (4.00%) SC Cleared
5 52 (3.15%) PhD
6 50 (3.03%) DV Cleared
7 20 (1.21%) Numerate Degree
8 14 (0.85%) AWS Certification
9 13 (0.79%) Master's Degree
10 11 (0.67%) Postgraduate
11 7 (0.42%) MBA
12 4 (0.24%) Microsoft Certification
13 2 (0.12%) ACCA
13 2 (0.12%) CCNP
13 2 (0.12%) CIMA
13 2 (0.12%) Cisco Certification
13 2 (0.12%) PMI Certification
14 1 (0.061%) CCNA
14 1 (0.061%) CISSP
14 1 (0.061%) ISTQB
Quality Assurance & Compliance
1 96 (5.82%) Data Quality
2 81 (4.91%) QA
3 20 (1.21%) GDPR
4 15 (0.91%) ISO/IEC 27001
5 3 (0.18%) ISO 26262
6 2 (0.12%) Sarbanes-Oxley
7 1 (0.061%) Actionable Recommendations
7 1 (0.061%) GxP
System Software
1 301 (18.24%) Docker
2 151 (9.15%) HDFS
3 59 (3.58%) Apache ZooKeeper
4 50 (3.03%) VirtualBox
5 34 (2.06%) Apache Flume
6 8 (0.48%) Active Directory
7 7 (0.42%) Virtual Machines
8 6 (0.36%) VMware Infrastructure
9 5 (0.30%) Hyper-V
10 2 (0.12%) Varnish
11 1 (0.061%) Alluxio
11 1 (0.061%) Ceph
11 1 (0.061%) etcd
11 1 (0.061%) Gluster
11 1 (0.061%) VMware NSX
11 1 (0.061%) vSphere
Systems Management
1 244 (14.79%) Kubernetes
2 202 (12.24%) Ansible
3 143 (8.67%) Terraform
4 100 (6.06%) Puppet
5 74 (4.48%) Oozie
6 63 (3.82%) Docker Swarm
7 58 (3.52%) Hadoop YARN
8 56 (3.39%) Opscode Chef
9 34 (2.06%) Salt
10 13 (0.79%) Single Sign-On
11 12 (0.73%) Ambari
12 6 (0.36%) Consul
12 6 (0.36%) Kibana
13 5 (0.30%) HP Quality Center
14 4 (0.24%) HP Fortify
14 4 (0.24%) logstash
14 4 (0.24%) Mesos
14 4 (0.24%) SELinux
15 3 (0.18%) Nagios
16 2 (0.12%) Grafana
Vendors
1 238 (14.42%) Google
2 209 (12.67%) Cloudera
3 208 (12.61%) Oracle
4 133 (8.06%) Tableau
5 120 (7.27%) Hortonworks
6 116 (7.03%) Microsoft
7 89 (5.39%) Informatica
8 73 (4.42%) IBM
9 72 (4.36%) Talend
9 72 (4.36%) Teradata
10 71 (4.30%) Databricks
11 39 (2.36%) Splunk
12 36 (2.18%) Atlassian
13 30 (1.82%) SAP
14 19 (1.15%) InterSystems
15 18 (1.09%) Dataiku
15 18 (1.09%) MapR
15 18 (1.09%) VMware
16 16 (0.97%) Netezza
17 15 (0.91%) MicroStrategy