Period
to 15 December 2019

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 15 December 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > UK excluding London
6 months to
15 Dec 2019
Same period 2018 Same period 2017
Rank 309 247 287
Rank change year-on-year -62 +40 -17
Permanent jobs citing Hadoop 712 1,201 1,134
As % of all permanent IT jobs advertised in the UK excluding London 0.95% 1.37% 1.12%
As % of the Database & Business Intelligence category 3.64% 4.85% 3.60%
Number of salaries quoted 567 872 818
UK excluding London median annual salary £57,500 £60,000 £50,000
Median salary % change year-on-year -4.17% +20.00% -4.76%
10th Percentile £38,750 £37,500 £32,000
90th Percentile £81,250 £87,375 £77,500
UK median annual salary £70,000 £70,000 £62,500
% change year-on-year - +12.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK excluding London
Permanent vacancies with a requirement for database or business intelligence skills 19,535 24,740 31,465
As % of all permanent IT jobs advertised in the UK excluding London 26.06% 28.12% 31.10%
Number of salaries quoted 16,143 20,322 26,474
UK excluding London median annual salary £45,000 £45,000 £42,500
Median salary % change year-on-year - +5.88% -
10th Percentile £29,750 £28,750 £27,500
90th Percentile £67,500 £68,750 £62,500
UK median annual salary £52,500 £50,500 £47,500
% change year-on-year +3.96% +6.32% -

Hadoop
Job Vacancy Trend in the UK excluding London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Hadoop in the UK excluding London

Hadoop
Salary Trend in the UK excluding London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in the UK excluding London.

Salary trend for Hadoop in the UK excluding London

Hadoop
Salary Histogram in the UK excluding London

The salary distribution of IT jobs citing Hadoop in the UK excluding London over the 6 months to 15 December 2019.

Salary histogram for Hadoop in the UK excluding London

Hadoop
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK excluding London region over the 6 months to 15 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
South East -83 165 £53,500 -17.69% 42
Midlands +36 144 £70,000 +9.80% 26
South West -25 144 £53,700 -2.36% 14
North of England -35 141 £55,000 -8.33% 24
East Midlands +21 90 £72,500 -3.33% 8
Yorkshire +28 79 £57,275 +4.14% 11
Scotland -11 69 £50,000 -2.44% 12
West Midlands +23 54 £60,000 +26.32% 18
East of England -21 48 £75,000 +11.11% 21
North West -66 45 £55,000 -15.38% 13
North East +26 17 £45,412 -54.59%
Wales +6 1 £39,000 +56.00%
Northern Ireland - 1 - -
Hadoop
UK

For the 6 months to 15 December 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the UK excluding London region with a requirement for Hadoop.

1 442 (62.08%) Big Data
2 426 (59.83%) Apache Spark
3 371 (52.11%) Agile Software Development
4 346 (48.60%) Java
5 333 (46.77%) Python
6 262 (36.80%) Analytics
7 249 (34.97%) SQL
8 226 (31.74%) Apache Hive
9 219 (30.76%) Scala
10 197 (27.67%) AWS
11 162 (22.75%) Kafka
12 152 (21.35%) Data Science
13 151 (21.21%) Data Warehouse
13 151 (21.21%) Software Engineering
14 146 (20.51%) ETL
15 138 (19.38%) Azure
16 135 (18.96%) HBase
17 134 (18.82%) DevOps
18 132 (18.54%) MongoDB
19 131 (18.40%) Linux
20 129 (18.12%) NoSQL
21 128 (17.98%) Docker
22 124 (17.42%) Finance
23 123 (17.28%) Oracle
23 123 (17.28%) Impala
24 116 (16.29%) Business Intelligence
25 112 (15.73%) Data Modelling
26 108 (15.17%) Data Engineering
27 106 (14.89%) Machine Learning
28 102 (14.33%) Git (software)

Hadoop
Co-occurring IT Skills in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 426 (59.83%) Apache Spark
2 82 (11.52%) Elasticsearch
3 42 (5.90%) Apache
4 27 (3.79%) SAS
5 18 (2.53%) Apache Solr
6 17 (2.39%) JBoss
7 15 (2.11%) Hyperledger
8 13 (1.83%) Apache Pig
9 10 (1.40%) SharePoint
9 10 (1.40%) Tomcat
10 8 (1.12%) nginx
10 8 (1.12%) WebLogic
11 7 (0.98%) Confluence
12 6 (0.84%) WebSphere
13 5 (0.70%) MQSeries
13 5 (0.70%) WebSphere Application Server
14 3 (0.42%) WildFly
15 2 (0.28%) Luigi
15 2 (0.28%) Tornado
16 1 (0.14%) Jupyter
Applications
1 6 (0.84%) Chatbot
2 4 (0.56%) Microsoft Excel
2 4 (0.56%) Spreadsheet
3 3 (0.42%) Microsoft Office
3 3 (0.42%) Microsoft PowerPoint
4 1 (0.14%) Microsoft Project
4 1 (0.14%) MS Visio
4 1 (0.14%) SPSS
Business Applications
1 5 (0.70%) Sparx Enterprise Architect
2 1 (0.14%) Adobe Campaign
2 1 (0.14%) NetSuite
Cloud Services
1 197 (27.67%) AWS
2 138 (19.38%) Azure
3 78 (10.96%) GCP
4 32 (4.49%) Power Platform
5 28 (3.93%) Amazon EMR
6 19 (2.67%) GitHub
6 19 (2.67%) SaaS
7 18 (2.53%) Amazon S3
7 18 (2.53%) Cloud Computing
8 17 (2.39%) PaaS
9 14 (1.97%) IaaS
10 11 (1.54%) Amazon Kinesis
10 11 (1.54%) Azure Data Factory
10 11 (1.54%) OpenShift
11 8 (1.12%) Serverless
12 7 (0.98%) AWS CloudFormation
13 6 (0.84%) Amazon SageMaker
14 5 (0.70%) Office 365
15 4 (0.56%) AWS Lambda
15 4 (0.56%) Dynamics 365
Communications & Networking
1 14 (1.97%) HTTP
2 11 (1.54%) Firewall
3 10 (1.40%) DNS
3 10 (1.40%) TCP/IP
4 6 (0.84%) Kerberos
5 5 (0.70%) Network Security
5 5 (0.70%) SSH
5 5 (0.70%) SSL
6 4 (0.56%) ATM
7 3 (0.42%) 3G
7 3 (0.42%) 4G
7 3 (0.42%) 5G
7 3 (0.42%) Wi-Fi
8 2 (0.28%) HTTPS
8 2 (0.28%) VPN
8 2 (0.28%) ZigBee
9 1 (0.14%) Internet
Database & Business Intelligence
1 442 (62.08%) Big Data
2 226 (31.74%) Apache Hive
3 151 (21.21%) Data Warehouse
4 135 (18.96%) HBase
5 132 (18.54%) MongoDB
6 129 (18.12%) NoSQL
7 123 (17.28%) Impala
8 98 (13.76%) Apache Cassandra
9 74 (10.39%) Data Lake
10 66 (9.27%) SQL Server
11 60 (8.43%) Relational Database
12 46 (6.46%) PostgreSQL
13 39 (5.48%) Amazon Redshift
14 35 (4.92%) Sqoop
15 32 (4.49%) Power BI
16 30 (4.21%) SQL Server Integration Services
17 27 (3.79%) Oracle Database
18 26 (3.65%) Flink
19 23 (3.23%) BigQuery
19 23 (3.23%) Data Mining
Development Applications
1 102 (14.33%) Git (software)
2 73 (10.25%) Jenkins
3 37 (5.20%) Bitbucket
4 36 (5.06%) JIRA
5 27 (3.79%) Cucumber
5 27 (3.79%) Selenium
6 19 (2.67%) Maven
7 16 (2.25%) Atlassian Bamboo
7 16 (2.25%) Subversion
8 12 (1.69%) Team Foundation Server
9 11 (1.54%) Artifactory
9 11 (1.54%) ERwin
9 11 (1.54%) GitLab
10 9 (1.26%) SonarQube
11 8 (1.12%) Gradle
11 8 (1.12%) Mercurial
12 7 (0.98%) TeamCity
12 7 (0.98%) Visual Studio
13 6 (0.84%) Ant
13 6 (0.84%) Eclipse
General
1 124 (17.42%) Finance
2 50 (7.02%) Retail
3 42 (5.90%) Banking
4 35 (4.92%) Public Sector
5 33 (4.63%) Telecoms
6 26 (3.65%) Marketing
7 19 (2.67%) Automotive
8 12 (1.69%) Electronics
9 10 (1.40%) Manufacturing
10 6 (0.84%) Online Betting
11 3 (0.42%) Advertising
12 2 (0.28%) Aerospace
12 2 (0.28%) Financial Institution
12 2 (0.28%) Games
12 2 (0.28%) Legal
13 1 (0.14%) Humanities
13 1 (0.14%) Investment Banking
13 1 (0.14%) Law
13 1 (0.14%) Publishing
13 1 (0.14%) Social Science
Job Titles
1 193 (27.11%) Developer
2 187 (26.26%) Data Engineer
3 107 (15.03%) Java Developer
4 85 (11.94%) Software Engineer
5 81 (11.38%) Big Data Engineer
6 71 (9.97%) Architect
7 56 (7.87%) Senior Developer
8 53 (7.44%) Data Architect
9 45 (6.32%) Agile Developer
9 45 (6.32%) Agile Java Developer
9 45 (6.32%) Senior Java Developer
10 37 (5.20%) Senior Data Engineer
11 35 (4.92%) Java Engineer
12 34 (4.78%) Data Scientist
13 33 (4.63%) Java Software Engineer
14 32 (4.49%) Software Developer
15 30 (4.21%) Analyst
16 29 (4.07%) Big Data Developer
17 21 (2.95%) DevOps Engineer
18 19 (2.67%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 162 (22.75%) Kafka
2 68 (9.55%) Spring
3 58 (8.15%) Node.js
4 52 (7.30%) React
5 43 (6.04%) AngularJS
6 32 (4.49%) RESTful
7 29 (4.07%) Hibernate
8 28 (3.93%) Web Services
9 26 (3.65%) Pandas
9 26 (3.65%) scikit-learn
10 22 (3.09%) RabbitMQ
11 21 (2.95%) Java EE
12 20 (2.81%) .NET
12 20 (2.81%) Spring Cloud
13 19 (2.67%) Akka
13 19 (2.67%) HTML
13 19 (2.67%) REST
14 18 (2.53%) OAuth
15 17 (2.39%) CSS
15 17 (2.39%) SAML
Miscellaneous
1 99 (13.90%) Analytical Skills
2 48 (6.74%) Algorithms
3 42 (5.90%) Public Cloud
4 23 (3.23%) Management Information System
5 22 (3.09%) Greenfield Project
5 22 (3.09%) Private Cloud
6 20 (2.81%) Video on Demand
7 19 (2.67%) Data Structures
8 18 (2.53%) User Experience
9 17 (2.39%) Mainframe
10 16 (2.25%) Cloud Native
11 13 (1.83%) Self-Motivation
12 9 (1.26%) Enterprise Software
13 8 (1.12%) Linked Data
14 7 (0.98%) Linux Command Line
15 6 (0.84%) Clustering
15 6 (0.84%) Virtual Team
16 5 (0.70%) Blog
16 5 (0.70%) IBM Mainframe
16 5 (0.70%) Social Media
Operating Systems
1 131 (18.40%) Linux
2 95 (13.34%) Unix
3 14 (1.97%) Red Hat Enterprise Linux
4 9 (1.26%) Windows
5 6 (0.84%) CentOS
5 6 (0.84%) VME
6 5 (0.70%) zOS
7 4 (0.56%) Debian
7 4 (0.56%) Ubuntu
8 3 (0.42%) Android
8 3 (0.42%) Windows Server
9 2 (0.28%) SUSE Linux Enterprise Server
10 1 (0.14%) Oracle Linux
Processes & Methodologies
1 371 (52.11%) Agile Software Development
2 262 (36.80%) Analytics
3 152 (21.35%) Data Science
4 151 (21.21%) Software Engineering
5 146 (20.51%) ETL
6 134 (18.82%) DevOps
7 116 (16.29%) Business Intelligence
8 112 (15.73%) Data Modelling
9 108 (15.17%) Data Engineering
10 106 (14.89%) Machine Learning
11 82 (11.52%) MapReduce
12 80 (11.24%) Scrum
13 79 (11.10%) Open Source
14 76 (10.67%) Mentoring
15 66 (9.27%) Visualisation
16 65 (9.13%) TDD
17 63 (8.85%) Microservices
18 61 (8.57%) Artificial Intelligence
19 59 (8.29%) Problem-Solving
20 58 (8.15%) Technical Leadership
Programming Languages
1 346 (48.60%) Java
2 333 (46.77%) Python
3 249 (34.97%) SQL
4 219 (30.76%) Scala
5 94 (13.20%) JavaScript
6 73 (10.25%) R
7 65 (9.13%) C#
8 62 (8.71%) C++
9 38 (5.34%) C
10 34 (4.78%) Bash Shell
10 34 (4.78%) Shell Script
11 31 (4.35%) PL/SQL
12 28 (3.93%) Perl
13 26 (3.65%) Ruby
14 17 (2.39%) Java 8
15 14 (1.97%) Go
16 12 (1.69%) MATLAB
17 10 (1.40%) Data Analysis Expressions (DAX)
17 10 (1.40%) HiveQL
18 7 (0.98%) PowerShell
Qualifications
1 90 (12.64%) Degree
2 87 (12.22%) Security Cleared
3 42 (5.90%) SC Cleared
4 41 (5.76%) DV Cleared
5 29 (4.07%) Computer Science Degree
6 11 (1.54%) PhD
7 6 (0.84%) Postgraduate
8 4 (0.56%) Numerate Degree
9 3 (0.42%) AWS Certification
10 2 (0.28%) PMI Certification
11 1 (0.14%) CCNA
11 1 (0.14%) CCNP
11 1 (0.14%) Cisco Certification
Quality Assurance & Compliance
1 24 (3.37%) Data Quality
2 15 (2.11%) QA
3 9 (1.26%) GDPR
4 5 (0.70%) ISO/IEC 27001
5 3 (0.42%) ISO 26262
6 1 (0.14%) IFRS
6 1 (0.14%) IFRS 9
6 1 (0.14%) PMO
System Software
1 128 (17.98%) Docker
2 68 (9.55%) HDFS
3 22 (3.09%) Apache ZooKeeper
4 18 (2.53%) Apache Flume
5 7 (0.98%) Virtual Machines
6 1 (0.14%) Active Directory
6 1 (0.14%) Virtual Servers
Systems Management
1 79 (11.10%) Ansible
2 70 (9.83%) Kubernetes
3 38 (5.34%) Puppet
4 36 (5.06%) Terraform
5 32 (4.49%) Oozie
6 24 (3.37%) Hadoop YARN
7 18 (2.53%) Opscode Chef
8 10 (1.40%) Ambari
8 10 (1.40%) Salt
9 5 (0.70%) Docker Swarm
10 4 (0.56%) HP Fortify
10 4 (0.56%) SELinux
11 3 (0.42%) Kibana
12 2 (0.28%) Grafana
12 2 (0.28%) logstash
12 2 (0.28%) Mesos
12 2 (0.28%) Prometheus
12 2 (0.28%) Single Sign-On
13 1 (0.14%) Nagios
13 1 (0.14%) Oracle Enterprise Manager
Vendors
1 123 (17.28%) Oracle
2 75 (10.53%) Cloudera
3 60 (8.43%) Informatica
4 59 (8.29%) Teradata
5 52 (7.30%) Google
5 52 (7.30%) Tableau
6 34 (4.78%) Microsoft
7 32 (4.49%) Talend
8 26 (3.65%) Hortonworks
9 25 (3.51%) IBM
10 23 (3.23%) SAP
11 21 (2.95%) Atlassian
12 13 (1.83%) Ab Initio
13 9 (1.26%) Red Hat
14 8 (1.12%) Databricks
14 8 (1.12%) VMware
15 7 (0.98%) MapR
15 7 (0.98%) Paxata
16 6 (0.84%) Apple
16 6 (0.84%) Netezza