Period
to 8 December 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 8 December 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
8 Dec 2019
Same period 2018 Same period 2017
Rank 238 192 200
Rank change year-on-year -46 +8 +5
Permanent jobs citing Hadoop 1,807 2,871 3,225
As % of all permanent IT jobs advertised in the UK 1.36% 1.81% 1.79%
As % of the Database & Business Intelligence category 5.06% 6.26% 5.93%
Number of salaries quoted 1,435 2,134 2,431
UK median annual salary £70,000 £70,000 £62,500
Median salary % change year-on-year - +12.00% -
10th Percentile £45,000 £40,500 £37,500
90th Percentile £105,600 £100,000 £97,500
UK excluding London median annual salary £57,500 £60,000 £50,000
% change year-on-year -4.17% +20.00% -4.76%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 35,679 45,842 54,367
As % of all permanent IT jobs advertised in the UK 26.85% 28.85% 30.24%
Number of salaries quoted 29,467 37,707 44,809
UK median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,750 £31,250 £30,000
90th Percentile £87,500 £85,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 8 December 2019.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 8 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -39 1,718 £70,000 - 261
London -49 1,051 £75,000 - 146
UK excluding London -51 720 £57,500 -4.17% 130
South East -87 167 £53,500 -17.69% 38
South West -9 154 £53,700 -2.81% 15
North of England -31 143 £55,000 -12.00% 26
Midlands +36 140 £65,000 +4.00% 18
East Midlands +27 89 £72,500 -3.33% 8
Yorkshire +30 82 £57,275 +4.14% 9
Scotland -33 67 £50,000 -2.44% 17
West Midlands +27 51 £60,000 +26.32% 10
East of England -20 48 £75,000 +11.11% 16
North West -70 44 £60,000 -7.69% 17
North East +26 17 £45,412 -54.59%
Northern Ireland +5 1 - -
Wales -1 1 £39,000 +35.65%

For the 6 months to 8 December 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 1,195 (66.13%) Big Data
2 1,140 (63.09%) Apache Spark
3 1,017 (56.28%) Python
4 860 (47.59%) Agile Software Development
5 817 (45.21%) Java
6 767 (42.45%) SQL
7 726 (40.18%) AWS
8 719 (39.79%) Analytics
9 587 (32.48%) Apache Hive
10 574 (31.77%) Azure
11 548 (30.33%) Scala
12 518 (28.67%) Data Science
13 462 (25.57%) Machine Learning
14 414 (22.91%) NoSQL
15 385 (21.31%) ETL
16 379 (20.97%) DevOps
17 369 (20.42%) Kafka
18 364 (20.14%) Software Engineering
19 362 (20.03%) Finance
20 356 (19.70%) Linux
21 338 (18.71%) Business Intelligence
22 337 (18.65%) Data Warehouse
23 336 (18.59%) Data Modelling
23 336 (18.59%) Docker
24 306 (16.93%) GCP
25 298 (16.49%) Data Engineering
26 271 (15.00%) Analytical Skills
27 261 (14.44%) HBase
28 260 (14.39%) Google
29 255 (14.11%) Git (software)

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,140 (63.09%) Apache Spark
2 144 (7.97%) Elasticsearch
3 136 (7.53%) Apache
4 89 (4.93%) SAS
5 50 (2.77%) Apache Airflow
6 46 (2.55%) Apache Pig
7 36 (1.99%) Apache Solr
8 30 (1.66%) Tomcat
9 27 (1.49%) Confluence
10 21 (1.16%) IIS
11 20 (1.11%) nginx
12 19 (1.05%) JBoss
13 17 (0.94%) Hyperledger
13 17 (0.94%) Jupyter
14 15 (0.83%) Luigi
15 14 (0.77%) SharePoint
16 12 (0.66%) WebSphere
17 11 (0.61%) MQSeries
17 11 (0.61%) WebSphere Application Server
18 8 (0.44%) WebLogic
Applications
1 7 (0.39%) Chatbot
2 6 (0.33%) Microsoft Excel
3 5 (0.28%) Microsoft Office
3 5 (0.28%) Microsoft PowerPoint
3 5 (0.28%) Spreadsheet
3 5 (0.28%) SPSS
4 3 (0.17%) GNU Octave
5 2 (0.11%) Microsoft Project
6 1 (0.055%) MS Visio
6 1 (0.055%) Simulink
6 1 (0.055%) SPSS Modeler
6 1 (0.055%) Weka
Business Applications
1 4 (0.22%) Sparx Enterprise Architect
2 2 (0.11%) Adobe Campaign
2 2 (0.11%) Data Workbench
2 2 (0.11%) Eikon
2 2 (0.11%) WebTrends
3 1 (0.055%) FINCAD Analytics
3 1 (0.055%) NetSuite
Cloud Services
1 726 (40.18%) AWS
2 574 (31.77%) Azure
3 306 (16.93%) GCP
4 118 (6.53%) Amazon EMR
5 110 (6.09%) Amazon S3
6 89 (4.93%) PaaS
7 72 (3.98%) Power Platform
8 64 (3.54%) GitHub
9 60 (3.32%) Serverless
10 55 (3.04%) Azure Data Factory
11 49 (2.71%) Amazon Kinesis
11 49 (2.71%) SaaS
12 40 (2.21%) AWS Lambda
13 38 (2.10%) IaaS
14 36 (1.99%) Cloud Computing
15 32 (1.77%) Amazon EC2
16 29 (1.60%) Amazon SageMaker
17 22 (1.22%) IBM Cloud
18 19 (1.05%) Amazon ECS
19 18 (1.00%) npm
Communications & Networking
1 41 (2.27%) Firewall
2 33 (1.83%) TCP/IP
3 32 (1.77%) Internet
4 25 (1.38%) DNS
4 25 (1.38%) SSL
5 24 (1.33%) HTTP
6 19 (1.05%) Kerberos
7 12 (0.66%) VPN
8 9 (0.50%) Broadband
8 9 (0.50%) SSH
9 7 (0.39%) HTTPS
10 5 (0.28%) Network Security
10 5 (0.28%) VLAN
11 4 (0.22%) 4G
11 4 (0.22%) ATM
12 3 (0.17%) 3G
12 3 (0.17%) 5G
12 3 (0.17%) Wi-Fi
13 2 (0.11%) SMS
14 1 (0.055%) Unified Communications
Database & Business Intelligence
1 1,195 (66.13%) Big Data
2 587 (32.48%) Apache Hive
3 414 (22.91%) NoSQL
4 337 (18.65%) Data Warehouse
5 261 (14.44%) HBase
6 222 (12.29%) MongoDB
7 188 (10.40%) Impala
8 183 (10.13%) Apache Cassandra
9 182 (10.07%) SQL Server
10 170 (9.41%) Amazon Redshift
11 165 (9.13%) PostgreSQL
12 157 (8.69%) Data Lake
13 148 (8.19%) Relational Database
14 107 (5.92%) BigQuery
15 95 (5.26%) Neo4j
16 90 (4.98%) MySQL
17 89 (4.93%) Data Mining
18 88 (4.87%) Sqoop
19 81 (4.48%) Flink
20 72 (3.98%) Power BI
Development Applications
1 255 (14.11%) Git (software)
2 247 (13.67%) Jenkins
3 109 (6.03%) JIRA
4 90 (4.98%) Maven
5 60 (3.32%) Bitbucket
6 58 (3.21%) Atlassian Bamboo
7 47 (2.60%) Artifactory
7 47 (2.60%) Selenium
8 38 (2.10%) SonarQube
9 36 (1.99%) Cucumber
10 34 (1.88%) Vagrant
11 32 (1.77%) TeamCity
12 31 (1.72%) Ant
13 29 (1.60%) Team Foundation Server
14 24 (1.33%) ERwin
14 24 (1.33%) Subversion
15 21 (1.16%) Gradle
16 18 (1.00%) GitLab
17 16 (0.89%) Octopus Deploy
18 15 (0.83%) Zephyr
General
1 362 (20.03%) Finance
2 164 (9.08%) Banking
3 149 (8.25%) Retail
4 76 (4.21%) Marketing
5 66 (3.65%) Public Sector
6 60 (3.32%) Telecoms
7 44 (2.43%) Manufacturing
8 36 (1.99%) Automotive
9 27 (1.49%) Advertising
9 27 (1.49%) Front Office
9 27 (1.49%) Investment Banking
10 24 (1.33%) Games
11 19 (1.05%) Electronics
12 15 (0.83%) Law
13 13 (0.72%) Legal
14 7 (0.39%) Financial Institution
15 6 (0.33%) Online Betting
16 5 (0.28%) Retail Banking
17 4 (0.22%) Billing
17 4 (0.22%) Publishing
Job Titles
1 542 (29.99%) Data Engineer
2 400 (22.14%) Developer
3 213 (11.79%) Architect
4 211 (11.68%) Java Developer
5 149 (8.25%) Data Architect
6 138 (7.64%) Big Data Engineer
7 137 (7.58%) Data Scientist
8 133 (7.36%) Software Engineer
9 111 (6.14%) Senior Data Engineer
10 98 (5.42%) Senior Developer
11 78 (4.32%) DevOps Engineer
12 72 (3.98%) Python Engineer
13 65 (3.60%) Senior Java Developer
14 62 (3.43%) Java Engineer
15 61 (3.38%) Analyst
16 59 (3.27%) Senior Data Scientist
17 52 (2.88%) Big Data Developer
17 52 (2.88%) Consultant
18 51 (2.82%) Platform Engineer
19 49 (2.71%) Cloud Architect
Libraries, Frameworks & Software Standards
1 369 (20.42%) Kafka
2 109 (6.03%) React
3 108 (5.98%) Node.js
4 102 (5.64%) TensorFlow
5 99 (5.48%) AngularJS
5 99 (5.48%) Web Services
6 97 (5.37%) Spring
7 93 (5.15%) scikit-learn
8 85 (4.70%) Natural Language Processing
9 80 (4.43%) HTML
10 77 (4.26%) REST
11 76 (4.21%) Pandas
12 72 (3.98%) RESTful
13 59 (3.27%) Spark Streaming
14 49 (2.71%) CSS
15 48 (2.66%) HTML5
16 42 (2.32%) Apache Beam
17 40 (2.21%) Elastic Stack
17 40 (2.21%) NumPy
18 39 (2.16%) RabbitMQ
Miscellaneous
1 271 (15.00%) Analytical Skills
2 208 (11.51%) Algorithms
3 86 (4.76%) Data Structures
4 59 (3.27%) Public Cloud
5 52 (2.88%) Greenfield Project
6 51 (2.82%) Management Information System
7 46 (2.55%) Linux Command Line
8 42 (2.32%) User Experience
9 37 (2.05%) Cloud Native
10 30 (1.66%) Private Cloud
11 29 (1.60%) Mainframe
11 29 (1.60%) Virtual Team
12 28 (1.55%) Blog
12 28 (1.55%) Self-Motivation
13 20 (1.11%) Acoustics
13 20 (1.11%) Video on Demand
14 19 (1.05%) Mobile App
15 18 (1.00%) Data Centre
15 18 (1.00%) Social Media
16 14 (0.77%) Derivative
Operating Systems
1 356 (19.70%) Linux
2 202 (11.18%) Unix
3 49 (2.71%) Windows
4 18 (1.00%) CentOS
4 18 (1.00%) Red Hat Enterprise Linux
4 18 (1.00%) Windows Server
5 15 (0.83%) zOS
6 11 (0.61%) Debian
7 9 (0.50%) Ubuntu
8 6 (0.33%) VME
9 3 (0.17%) Android
10 2 (0.11%) SUSE Linux Enterprise Server
11 1 (0.055%) Oracle Linux
Processes & Methodologies
1 860 (47.59%) Agile Software Development
2 719 (39.79%) Analytics
3 518 (28.67%) Data Science
4 462 (25.57%) Machine Learning
5 385 (21.31%) ETL
6 379 (20.97%) DevOps
7 364 (20.14%) Software Engineering
8 338 (18.71%) Business Intelligence
9 336 (18.59%) Data Modelling
10 298 (16.49%) Data Engineering
11 246 (13.61%) Data Analytics
12 245 (13.56%) Visualisation
13 233 (12.89%) Artificial Intelligence
14 228 (12.62%) Computer Science
15 180 (9.96%) Open Source
16 170 (9.41%) TDD
17 164 (9.08%) Mentoring
18 163 (9.02%) Microservices
19 159 (8.80%) Problem-Solving
19 159 (8.80%) Scrum
Programming Languages
1 1,017 (56.28%) Python
2 817 (45.21%) Java
3 767 (42.45%) SQL
4 548 (30.33%) Scala
5 237 (13.12%) JavaScript
6 221 (12.23%) R
7 155 (8.58%) C#
8 120 (6.64%) C++
9 102 (5.64%) C
10 87 (4.81%) Bash Shell
11 81 (4.48%) PL/SQL
12 62 (3.43%) Shell Script
13 49 (2.71%) Ruby
14 48 (2.66%) TypeScript
15 43 (2.38%) PHP
16 39 (2.16%) Java 8
17 38 (2.10%) Go
18 34 (1.88%) Perl
19 31 (1.72%) T-SQL
20 28 (1.55%) PowerShell
Qualifications
1 245 (13.56%) Degree
2 107 (5.92%) Security Cleared
3 81 (4.48%) Computer Science Degree
4 72 (3.98%) PhD
5 54 (2.99%) SC Cleared
6 48 (2.66%) DV Cleared
7 39 (2.16%) Master's Degree
8 35 (1.94%) Numerate Degree
9 7 (0.39%) AWS Certification
10 6 (0.33%) Postgraduate
11 3 (0.17%) MBA
11 3 (0.17%) Microsoft Certification
12 2 (0.11%) MCSA
12 2 (0.11%) PMI Certification
13 1 (0.055%) CCA
13 1 (0.055%) CCNA
13 1 (0.055%) CCNP
13 1 (0.055%) Cisco Certification
13 1 (0.055%) ITIL Certification
13 1 (0.055%) SAS Certification
Quality Assurance & Compliance
1 103 (5.70%) Data Quality
2 90 (4.98%) QA
3 23 (1.27%) GDPR
4 20 (1.11%) ISO/IEC 27001
5 3 (0.17%) ISO 26262
6 1 (0.055%) GxP
6 1 (0.055%) IFRS
6 1 (0.055%) IFRS 9
6 1 (0.055%) PMO
System Software
1 336 (18.59%) Docker
2 193 (10.68%) HDFS
3 42 (2.32%) Apache Flume
4 39 (2.16%) Apache ZooKeeper
5 34 (1.88%) VirtualBox
6 8 (0.44%) Cronacle
7 7 (0.39%) Virtual Machines
8 5 (0.28%) Active Directory
8 5 (0.28%) Hyper-V
8 5 (0.28%) Varnish
8 5 (0.28%) VMware Infrastructure
9 1 (0.055%) Virtual Servers
Systems Management
1 215 (11.90%) Kubernetes
2 197 (10.90%) Ansible
3 161 (8.91%) Terraform
4 102 (5.64%) Hadoop YARN
5 95 (5.26%) Oozie
6 87 (4.81%) Puppet
7 55 (3.04%) Opscode Chef
8 41 (2.27%) Docker Swarm
9 20 (1.11%) Ambari
9 20 (1.11%) Consul
10 13 (0.72%) Salt
11 12 (0.66%) logstash
11 12 (0.66%) Single Sign-On
12 11 (0.61%) Kibana
13 8 (0.44%) Control-M
13 8 (0.44%) Mesos
14 6 (0.33%) Marathon
14 6 (0.33%) Rancher
14 6 (0.33%) SELinux
15 5 (0.28%) HP Quality Center
Vendors
1 260 (14.39%) Google
2 224 (12.40%) Cloudera
3 221 (12.23%) Oracle
4 158 (8.74%) Tableau
5 137 (7.58%) Hortonworks
6 122 (6.75%) Microsoft
7 116 (6.42%) Teradata
8 103 (5.70%) Informatica
9 80 (4.43%) Databricks
10 76 (4.21%) Talend
11 69 (3.82%) IBM
12 48 (2.66%) Splunk
13 37 (2.05%) Atlassian
14 30 (1.66%) SAP
15 22 (1.22%) MapR
16 21 (1.16%) Dataiku
16 21 (1.16%) Red Hat
17 17 (0.94%) Ab Initio
17 17 (0.94%) Netezza
18 16 (0.89%) VMware