Period
to 27 May 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 27 May 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK
6 months to
27 May 2019
Same period 2018 Same period 2017
Rank 187 174 199
Rank change year-on-year -13 +25 -1
Permanent jobs citing Hadoop 2,632 3,357 3,027
As % of all permanent IT jobs advertised in the UK 1.83% 1.95% 1.77%
As % of the Database & Business Intelligence category 6.52% 6.35% 5.74%
Number of salaries quoted 1,961 2,521 2,399
UK median annual salary £70,000 £65,000 £65,000
Median salary % change year-on-year +7.69% - +4.00%
10th Percentile £44,500 £40,000 £36,250
90th Percentile £105,000 £100,000 £101,250
UK excluding London median annual salary £55,000 £55,000 £55,000

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Permanent vacancies with a requirement for database or business intelligence skills 40,371 52,851 52,763
As % of all permanent IT jobs advertised in the UK 28.05% 30.68% 30.92%
Number of salaries quoted 32,937 43,310 44,794
UK median annual salary £52,000 £50,000 £47,500
Median salary % change year-on-year +4.00% +5.26% -
10th Percentile £31,250 £31,250 £29,750
90th Percentile £85,000 £80,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,000
% change year-on-year - +7.14% +1.20%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a percentage of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop.

Salary trend for Hadoop in the UK

Hadoop
Salary Histogram

The salary distribution of IT jobs citing Hadoop over the 6 months to 27 May 2019.

Salary histogram for Hadoop in the UK

Hadoop
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the UK over the 6 months to 27 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -1 2,517 £70,000 +3.70% 128
London -4 1,592 £75,000 - 71
UK excluding London -18 1,007 £55,000 - 62
South East -20 301 £60,000 - 14
South West +66 226 £55,000 +10.00% 12
Midlands +86 181 £57,500 +4.55% 12
North of England -70 150 £52,000 -0.95% 13
Scotland -44 94 £55,000 +10.00% 5
East Midlands +48 93 £57,500 +15.00% 5
West Midlands +70 88 £60,000 - 7
North West -61 77 £57,500 +4.55% 10
Yorkshire -13 59 £49,337 -4.20% 3
East of England -60 55 £65,000 - 6
North East +19 14 £49,337 +25.70%
Northern Ireland -23 1 - -
Channel Islands - 1 £37,500 -

For the 6 months to 27 May 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Hadoop.

1 1,673 (63.56%) Big Data
2 1,492 (56.69%) Python
3 1,470 (55.85%) Apache Spark
4 1,344 (51.06%) Java
5 1,275 (48.44%) Agile Software Development
6 1,141 (43.35%) SQL
7 993 (37.73%) Analytics
8 923 (35.07%) Amazon AWS
9 864 (32.83%) Kafka
10 863 (32.79%) Scala
11 809 (30.74%) NoSQL
12 759 (28.84%) Apache Hive
13 696 (26.44%) Machine Learning
14 691 (26.25%) Data Science
15 615 (23.37%) Microsoft Azure
16 614 (23.33%) Software Engineering
17 604 (22.95%) DevOps
18 563 (21.39%) ETL
19 522 (19.83%) Data Modelling
20 485 (18.43%) Data Warehouse
21 482 (18.31%) Business Intelligence
22 468 (17.78%) HBase
23 463 (17.59%) Finance
24 451 (17.14%) Linux
25 435 (16.53%) Apache Cassandra
26 433 (16.45%) Analytical Skills
27 428 (16.26%) Cloudera
28 402 (15.27%) Google Cloud Platform
29 401 (15.24%) Data Engineering
30 392 (14.89%) MongoDB

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,470 (55.85%) Apache Spark
2 295 (11.21%) Apache Pig
3 263 (9.99%) Elasticsearch
4 243 (9.23%) Apache
5 172 (6.53%) SAS
6 91 (3.46%) Apache Solr
7 44 (1.67%) SharePoint
8 37 (1.41%) JBoss
9 31 (1.18%) Apache Airflow
10 27 (1.03%) Confluence
11 24 (0.91%) Tomcat
12 20 (0.76%) IIS
13 18 (0.68%) nginx
14 15 (0.57%) WebLogic
14 15 (0.57%) WebSphere
15 14 (0.53%) Drupal
15 14 (0.53%) GlassFish
16 13 (0.49%) CMS
17 12 (0.46%) BizTalk Server
17 12 (0.46%) Jupyter
Applications
1 30 (1.14%) Microsoft Office
2 16 (0.61%) Microsoft Excel
3 11 (0.42%) Maple
3 11 (0.42%) Microsoft PowerPoint
3 11 (0.42%) SPSS
4 10 (0.38%) Weka
5 7 (0.27%) MS Visio
6 3 (0.11%) Stata
7 2 (0.076%) GNU Octave
7 2 (0.076%) S-PLUS
8 1 (0.038%) Adobe XD
8 1 (0.038%) Chatbot
8 1 (0.038%) CPLEX
8 1 (0.038%) InVision
8 1 (0.038%) Photoshop
8 1 (0.038%) Zeplin
Business Applications
1 9 (0.34%) Dynamics CRM
2 2 (0.076%) Magento
2 2 (0.076%) SAP ERP
2 2 (0.076%) SAP InfiniteInsight
3 1 (0.038%) Adobe Campaign
Cloud Services
1 923 (35.07%) Amazon AWS
2 615 (23.37%) Microsoft Azure
3 402 (15.27%) Google Cloud Platform
4 219 (8.32%) Power Platform
5 102 (3.88%) PaaS
5 102 (3.88%) Serverless
6 95 (3.61%) Amazon EMR
7 77 (2.93%) GitHub
8 74 (2.81%) Amazon EC2
9 71 (2.70%) Amazon S3
9 71 (2.70%) Cloud Computing
10 65 (2.47%) SaaS
11 63 (2.39%) Azure Data Factory
12 57 (2.17%) Amazon Kinesis
13 56 (2.13%) AWS Lambda
14 33 (1.25%) Amazon SQS
15 27 (1.03%) Cortana Intelligence Suite
16 26 (0.99%) Office 365
17 24 (0.91%) AWS CloudFormation
18 23 (0.87%) OpenShift
Communications & Networking
1 64 (2.43%) Internet
2 32 (1.22%) HTTP
3 31 (1.18%) TCP/IP
4 20 (0.76%) Firewall
5 10 (0.38%) LAN
5 10 (0.38%) Software-Defined Networking
5 10 (0.38%) WAN
6 9 (0.34%) Kerberos
7 8 (0.30%) Broadband
7 8 (0.30%) Network Security
7 8 (0.30%) SSH
8 6 (0.23%) MQTT
9 5 (0.19%) DNS
10 4 (0.15%) FTP
10 4 (0.15%) SSL
10 4 (0.15%) VPN
11 3 (0.11%) SAN
11 3 (0.11%) SMS
11 3 (0.11%) SNMP
11 3 (0.11%) VoIP
Database & Business Intelligence
1 1,673 (63.56%) Big Data
2 809 (30.74%) NoSQL
3 759 (28.84%) Apache Hive
4 485 (18.43%) Data Warehouse
5 468 (17.78%) HBase
6 435 (16.53%) Apache Cassandra
7 392 (14.89%) MongoDB
8 282 (10.71%) Amazon Redshift
9 280 (10.64%) Impala
10 278 (10.56%) SQL Server
11 222 (8.43%) Data Lake
12 219 (8.32%) Power BI
13 187 (7.10%) Relational Database
14 182 (6.91%) Sqoop
15 178 (6.76%) MySQL
16 170 (6.46%) PostgreSQL
17 143 (5.43%) Flink
18 125 (4.75%) SQL Server Integration Services
19 123 (4.67%) QlikView
20 115 (4.37%) Pentaho
Development Applications
1 260 (9.88%) Jenkins
2 217 (8.24%) Git (software)
3 170 (6.46%) Maven
4 136 (5.17%) JIRA
5 72 (2.74%) Selenium
6 65 (2.47%) Bitbucket
7 63 (2.39%) Atlassian Bamboo
8 59 (2.24%) Artifactory
9 56 (2.13%) Visual Studio
10 42 (1.60%) Gradle
11 39 (1.48%) Ant
11 39 (1.48%) Cucumber
12 38 (1.44%) JMeter
13 36 (1.37%) JUnit
14 32 (1.22%) Eclipse
15 24 (0.91%) Bitbucket Server
15 24 (0.91%) Team Foundation Server
16 23 (0.87%) Visual Studio Team System
17 21 (0.80%) Travis CI
18 20 (0.76%) GitLab
General
1 463 (17.59%) Finance
2 260 (9.88%) Banking
3 230 (8.74%) Law
4 195 (7.41%) Retail
5 85 (3.23%) Marketing
6 80 (3.04%) Telecoms
7 65 (2.47%) Games
8 47 (1.79%) Military
9 29 (1.10%) Advertising
10 28 (1.06%) Front Office
11 22 (0.84%) Investment Banking
12 20 (0.76%) Financial Institution
13 18 (0.68%) Manufacturing
14 12 (0.46%) Electronics
15 11 (0.42%) Legal
16 9 (0.34%) Billing
16 9 (0.34%) Retail Banking
17 7 (0.27%) Aerospace
18 6 (0.23%) Back Office
19 3 (0.11%) Private Banking
Job Titles
1 738 (28.04%) Data Engineer
2 526 (19.98%) Developer
3 371 (14.10%) Big Data Engineer
4 322 (12.23%) Architect
5 258 (9.80%) Java Developer
6 238 (9.04%) Software Engineer
7 235 (8.93%) Data Architect
8 183 (6.95%) Hadoop Engineer
9 172 (6.53%) Data Scientist
10 157 (5.97%) Senior Data Engineer
11 151 (5.74%) Python Engineer
12 120 (4.56%) Java Engineer
13 108 (4.10%) Senior Developer
14 106 (4.03%) Big Data Developer
15 104 (3.95%) Big Data Architect
16 94 (3.57%) Analyst
17 85 (3.23%) DevOps Engineer
18 79 (3.00%) Solutions Architect
19 76 (2.89%) Software Developer
20 74 (2.81%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 864 (32.83%) Kafka
2 208 (7.90%) Spring
3 207 (7.86%) Web Services
4 157 (5.97%) Apache NiFi
5 141 (5.36%) REST
6 134 (5.09%) .NET
7 130 (4.94%) Spark Streaming
8 125 (4.75%) HTML
9 118 (4.48%) Hibernate
10 115 (4.37%) Node.js
11 108 (4.10%) AngularJS
12 95 (3.61%) React
13 91 (3.46%) Natural Language Processing
14 87 (3.31%) RESTful
15 85 (3.23%) JSON
16 84 (3.19%) CSS
17 68 (2.58%) TensorFlow
18 67 (2.55%) RabbitMQ
18 67 (2.55%) scikit-learn
19 65 (2.47%) JSF
Miscellaneous
1 433 (16.45%) Analytical Skills
2 200 (7.60%) Algorithms
3 159 (6.04%) Data Structures
4 107 (4.07%) Fintech
5 82 (3.12%) Greenfield Project
6 63 (2.39%) User Experience
7 47 (1.79%) Management Information System
8 45 (1.71%) Self-Motivation
8 45 (1.71%) Social Media
9 44 (1.67%) Linux Command Line
10 37 (1.41%) Virtual Team
11 31 (1.18%) Enterprise Software
12 30 (1.14%) Public Cloud
13 27 (1.03%) Cloud Native
13 27 (1.03%) Credit Risk
14 23 (0.87%) Video on Demand
15 19 (0.72%) Analytical Mindset
15 19 (0.72%) Clustering
16 18 (0.68%) Market Risk
17 14 (0.53%) Semantic Web
Operating Systems
1 451 (17.14%) Linux
2 255 (9.69%) Unix
3 134 (5.09%) Windows
4 44 (1.67%) CentOS
5 37 (1.41%) Android
5 37 (1.41%) Ubuntu
6 35 (1.33%) Apple iOS
7 33 (1.25%) Red Hat Enterprise Linux
8 30 (1.14%) Windows Server
9 12 (0.46%) Windows Server 2008
10 9 (0.34%) Debian
11 8 (0.30%) Mac OS X
12 6 (0.23%) Windows 7
12 6 (0.23%) Windows 8
12 6 (0.23%) Windows Mobile
13 4 (0.15%) Oracle Linux
14 2 (0.076%) AIX
14 2 (0.076%) CoreOS
14 2 (0.076%) HPUX
15 1 (0.038%) Solaris
Processes & Methodologies
1 1,275 (48.44%) Agile Software Development
2 993 (37.73%) Analytics
3 696 (26.44%) Machine Learning
4 691 (26.25%) Data Science
5 614 (23.33%) Software Engineering
6 604 (22.95%) DevOps
7 563 (21.39%) ETL
8 522 (19.83%) Data Modelling
9 482 (18.31%) Business Intelligence
10 401 (15.24%) Data Engineering
11 382 (14.51%) Visualisation
12 368 (13.98%) Scrum
13 353 (13.41%) Data Analytics
14 327 (12.42%) Data Analysis
15 305 (11.59%) Artificial Intelligence
16 289 (10.98%) MapReduce
17 283 (10.75%) TDD
18 249 (9.46%) Open Source
19 247 (9.38%) Continuous Integration
20 225 (8.55%) Data Architecture
Programming Languages
1 1,492 (56.69%) Python
2 1,344 (51.06%) Java
3 1,141 (43.35%) SQL
4 863 (32.79%) Scala
5 295 (11.21%) R
6 207 (7.86%) C#
7 204 (7.75%) JavaScript
8 169 (6.42%) C
9 147 (5.59%) Java 8
10 136 (5.17%) C++
11 96 (3.65%) PL/SQL
12 78 (2.96%) Perl
13 71 (2.70%) Bash Shell
14 65 (2.47%) Ruby
15 61 (2.32%) T-SQL
16 52 (1.98%) Shell Script
17 45 (1.71%) Groovy
18 44 (1.67%) PHP
19 43 (1.63%) MATLAB
20 37 (1.41%) PowerShell
Qualifications
1 328 (12.46%) Degree
2 175 (6.65%) Security Cleared
3 80 (3.04%) Computer Science Degree
4 77 (2.93%) SC Cleared
5 66 (2.51%) PhD
6 63 (2.39%) DV Cleared
7 48 (1.82%) BPSS Clearance
8 42 (1.60%) Numerate Degree
9 18 (0.68%) Master's Degree
10 12 (0.46%) AWS Certification
11 10 (0.38%) TOGAF Certification
12 9 (0.34%) CISSP
12 9 (0.34%) ISTQB
13 8 (0.30%) ISTQB Foundation Certification
13 8 (0.30%) MCP
14 7 (0.27%) Microsoft Certification
15 5 (0.19%) CISA
15 5 (0.19%) CISM
16 4 (0.15%) Linux+ Certification
16 4 (0.15%) Network+ Certification
Quality Assurance & Compliance
1 120 (4.56%) Data Quality
2 88 (3.34%) QA
3 54 (2.05%) GDPR
4 22 (0.84%) ISO/IEC 27001
5 15 (0.57%) SLA
6 7 (0.27%) MiFID
6 7 (0.27%) PCI DSS
7 6 (0.23%) IFRS
8 5 (0.19%) Basel III
9 4 (0.15%) COREP
9 4 (0.15%) CRD IV
9 4 (0.15%) Solvency II
10 3 (0.11%) GxP
10 3 (0.11%) ISO 9001
11 2 (0.076%) PA-DSS
12 1 (0.038%) COBIT
12 1 (0.038%) EMIR
12 1 (0.038%) ISO 22301
System Software
1 294 (11.17%) Docker
2 214 (8.13%) HDFS
3 169 (6.42%) Apache Flume
4 149 (5.66%) Apache ZooKeeper
5 7 (0.27%) VirtualBox
6 6 (0.23%) vSphere
7 5 (0.19%) Hyper-V
7 5 (0.19%) VMware Infrastructure
8 4 (0.15%) Samba
8 4 (0.15%) Virtual Machines
9 3 (0.11%) Active Directory
9 3 (0.11%) NFS
9 3 (0.11%) Varnish
9 3 (0.11%) VMware ESXi
9 3 (0.11%) VMware NSX
10 2 (0.076%) LXC
10 2 (0.076%) Tivoli Workload Scheduler
11 1 (0.038%) Cronacle
11 1 (0.038%) Virtual Servers
Systems Management
1 212 (8.05%) Oozie
2 193 (7.33%) Ansible
3 175 (6.65%) Kubernetes
4 168 (6.38%) Hadoop YARN
5 153 (5.81%) Terraform
6 122 (4.64%) Puppet
7 87 (3.31%) Opscode Chef
8 70 (2.66%) Ambari
9 33 (1.25%) Nagios
10 29 (1.10%) Kibana
11 28 (1.06%) Mesos
12 26 (0.99%) Docker Swarm
13 14 (0.53%) logstash
14 12 (0.46%) Salt
15 10 (0.38%) Cobbler
15 10 (0.38%) Microsoft Intune
15 10 (0.38%) Packer
15 10 (0.38%) Prometheus
15 10 (0.38%) SCCM
16 6 (0.23%) Marathon
Vendors
1 428 (16.26%) Cloudera
2 386 (14.67%) Oracle
3 305 (11.59%) Tableau
4 277 (10.52%) Microsoft
5 250 (9.50%) Google
6 228 (8.66%) Hortonworks
7 148 (5.62%) Informatica
8 141 (5.36%) Databricks
9 108 (4.10%) Teradata
10 107 (4.07%) Talend
11 93 (3.53%) MapR
12 92 (3.50%) IBM
13 54 (2.05%) SAP
14 50 (1.90%) Red Hat
15 43 (1.63%) Netezza
16 42 (1.60%) Vertica
17 32 (1.22%) Sybase
18 31 (1.18%) Splunk
18 31 (1.18%) TIBCO
19 27 (1.03%) SolarWinds