Period
to 10 December 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 10 December 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
10 Dec 2018
Same period 2017 Same period 2016
Rank 191 195 206
Rank change year-on-year +4 +11 +17
Permanent jobs citing Hadoop 2,742 3,037 3,015
As % of all permanent IT jobs advertised in England 1.84% 1.82% 1.73%
As % of the Database & Business Intelligence category 6.39% 6.01% 5.81%
Number of salaries quoted 2,026 2,317 2,491
England median annual salary £70,000 £62,500 £62,500
Median salary % change year-on-year +12.00% - -3.85%
10th Percentile £40,814 £37,500 £40,000
90th Percentile £100,000 £99,250 £96,250
UK median annual salary £70,000 £62,500 £62,500
% change year-on-year +12.00% - -3.85%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 42,911 50,501 51,869
As % of all permanent IT jobs advertised in England 28.83% 30.21% 29.72%
Number of salaries quoted 35,495 42,009 44,743
England median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £31,250 £30,000 £29,500
90th Percentile £85,000 £77,500 £77,500
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 10 December 2018.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 10 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -20 1,642 £75,000 +7.14% 243
South East +34 372 £65,000 +18.18% 60
North of England +11 248 £60,000 +14.29% 39
South West +12 197 £55,000 +34.15% 24
North West -13 164 £65,000 +20.37% 15
East of England +17 137 £67,500 +17.39% 12
Midlands +84 135 £62,500 +47.06% 19
East Midlands +44 84 £75,000 +76.47% 10
Yorkshire +50 76 £52,750 +5.50% 18
West Midlands +48 51 £52,500 +22.09% 9
North East +3 12 £100,000 +92.31% 6
Hadoop
UK

For the 6 months to 10 December 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,853 (67.58%) Big Data
2 1,577 (57.51%) Apache Spark
3 1,484 (54.12%) Python
4 1,401 (51.09%) Java
5 1,203 (43.87%) Agile Software Development
6 1,026 (37.42%) SQL
7 890 (32.46%) Amazon AWS
8 868 (31.66%) Analytics
9 855 (31.18%) Kafka
10 849 (30.96%) Apache Hive
11 796 (29.03%) NoSQL
12 734 (26.77%) Scala
13 710 (25.89%) Data Science
14 684 (24.95%) Machine Learning
15 606 (22.10%) Finance
16 561 (20.46%) Microsoft Azure
17 533 (19.44%) DevOps
18 530 (19.33%) Software Engineering
19 522 (19.04%) ETL
20 511 (18.64%) Degree
21 499 (18.20%) Linux
22 480 (17.51%) Data Modelling
23 433 (15.79%) Business Intelligence
24 432 (15.75%) Apache Cassandra
25 431 (15.72%) Apache
26 414 (15.10%) HBase
27 405 (14.77%) Data Warehouse
28 388 (14.15%) R
29 380 (13.86%) Tableau
30 379 (13.82%) Computer Science

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,577 (57.51%) Apache Spark
2 431 (15.72%) Apache
3 313 (11.42%) Elasticsearch
4 232 (8.46%) Apache Pig
5 164 (5.98%) SAS
6 108 (3.94%) Apache Solr
7 50 (1.82%) Tomcat
8 37 (1.35%) JBoss
9 34 (1.24%) Confluence
10 25 (0.91%) GlassFish
11 20 (0.73%) WebSphere
12 19 (0.69%) Apache Airflow
13 18 (0.66%) CMS
13 18 (0.66%) Jupyter
14 17 (0.62%) nginx
15 16 (0.58%) SharePoint
16 14 (0.51%) Jetty
16 14 (0.51%) MS Exchange
16 14 (0.51%) Oracle SOA Suite
17 13 (0.47%) Cloud Foundry
Applications
1 33 (1.20%) SPSS
2 23 (0.84%) Microsoft Excel
3 22 (0.80%) Chatbot
4 14 (0.51%) Microsoft Office
5 13 (0.47%) MS Visio
6 10 (0.36%) Weka
7 8 (0.29%) Stata
8 6 (0.22%) Microsoft PowerPoint
9 5 (0.18%) GNU Octave
10 4 (0.15%) Microsoft Project
11 1 (0.036%) CPLEX
11 1 (0.036%) Maple
Business Applications
1 12 (0.44%) Dynamics CRM
2 11 (0.40%) Dynamics AX
2 11 (0.40%) Dynamics NAV
3 2 (0.073%) Oracle EBS
3 2 (0.073%) SAP ERP
3 2 (0.073%) SAP InfiniteInsight
4 1 (0.036%) Actimize
4 1 (0.036%) Exstream
4 1 (0.036%) Magento
Cloud Services
1 890 (32.46%) Amazon AWS
2 561 (20.46%) Microsoft Azure
3 269 (9.81%) Google Cloud Platform
4 136 (4.96%) Amazon EMR
5 110 (4.01%) Cloud Computing
6 88 (3.21%) SaaS
7 79 (2.88%) Amazon EC2
8 77 (2.81%) PaaS
9 68 (2.48%) GitHub
10 59 (2.15%) Serverless
11 50 (1.82%) Amazon S3
12 46 (1.68%) IaaS
13 45 (1.64%) AWS CloudFormation
14 44 (1.60%) AWS Lambda
15 36 (1.31%) Amazon Kinesis
16 32 (1.17%) Azure Data Factory
17 30 (1.09%) Google Analytics
18 29 (1.06%) Cortana Intelligence Suite
19 21 (0.77%) Amazon SageMaker
20 20 (0.73%) IBM Cloud
Communications & Networking
1 61 (2.22%) Internet
2 52 (1.90%) HTTP
3 50 (1.82%) Firewall
4 47 (1.71%) TCP/IP
5 43 (1.57%) SSL
6 21 (0.77%) Kerberos
7 18 (0.66%) SAN
8 16 (0.58%) DNS
9 15 (0.55%) Software-Defined Networking
10 11 (0.40%) WAN
11 10 (0.36%) LAN
12 9 (0.33%) Sourcefire
13 6 (0.22%) VPN
14 5 (0.18%) DAB
14 5 (0.18%) FIX Connectivity
14 5 (0.18%) NAS
14 5 (0.18%) Network Security
15 4 (0.15%) PABX
15 4 (0.15%) SSH
15 4 (0.15%) VoIP
Database & Business Intelligence
1 1,853 (67.58%) Big Data
2 849 (30.96%) Apache Hive
3 796 (29.03%) NoSQL
4 432 (15.75%) Apache Cassandra
5 414 (15.10%) HBase
6 405 (14.77%) Data Warehouse
7 346 (12.62%) MongoDB
8 343 (12.51%) SQL Server
9 247 (9.01%) Impala
10 237 (8.64%) Relational Database
11 231 (8.42%) Amazon Redshift
12 230 (8.39%) MySQL
13 212 (7.73%) Data Lake
14 201 (7.33%) Power BI
15 174 (6.35%) Flink
16 163 (5.94%) PostgreSQL
17 146 (5.32%) SQL Server Integration Services
18 141 (5.14%) SQL Server Reporting Services
19 123 (4.49%) RDBMS
20 107 (3.90%) QlikView
Development Applications
1 267 (9.74%) Git (software)
2 198 (7.22%) Jenkins
3 168 (6.13%) JIRA
4 94 (3.43%) Selenium
5 69 (2.52%) Atlassian Bamboo
6 67 (2.44%) Visual Studio
7 64 (2.33%) Maven
8 58 (2.12%) JUnit
9 52 (1.90%) Bitbucket
10 45 (1.64%) TeamCity
11 40 (1.46%) Gradle
12 39 (1.42%) JMeter
13 37 (1.35%) Team Foundation Server
14 35 (1.28%) Cucumber
14 35 (1.28%) Subversion
15 32 (1.17%) CodeSonar
15 32 (1.17%) EasyMock
15 32 (1.17%) git-flow
15 32 (1.17%) Robot Framework
16 29 (1.06%) gulp
General
1 606 (22.10%) Finance
2 272 (9.92%) Banking
3 218 (7.95%) Retail
4 179 (6.53%) Marketing
5 178 (6.49%) Telecoms
6 136 (4.96%) Law
7 112 (4.08%) Investment Banking
8 88 (3.21%) Games
9 72 (2.63%) Military
10 50 (1.82%) Advertising
11 44 (1.60%) Manufacturing
12 42 (1.53%) Front Office
13 36 (1.31%) Automotive
14 32 (1.17%) Financial Institution
15 28 (1.02%) Electronics
16 25 (0.91%) Corporate Banking
17 21 (0.77%) Pharmaceutical
18 14 (0.51%) Retail Banking
19 9 (0.33%) Billing
19 9 (0.33%) Publishing
Job Titles
1 592 (21.59%) Developer
2 588 (21.44%) Data Engineer
3 429 (15.65%) Architect
4 378 (13.79%) Big Data Engineer
5 277 (10.10%) Data Scientist
6 259 (9.45%) Data Architect
7 216 (7.88%) Java Developer
8 208 (7.59%) Software Engineer
9 140 (5.11%) Hadoop Engineer
10 132 (4.81%) Consultant
11 125 (4.56%) Senior Data Scientist
12 124 (4.52%) Big Data Developer
13 122 (4.45%) Java Engineer
14 118 (4.30%) Senior Developer
15 114 (4.16%) Senior Data Engineer
16 107 (3.90%) Analyst
17 95 (3.46%) Big Data Architect
17 95 (3.46%) Solutions Architect
18 79 (2.88%) Hadoop Developer
19 73 (2.66%) Java Software Engineer
Libraries, Frameworks & Software Standards
1 855 (31.18%) Kafka
2 264 (9.63%) Web Services
3 221 (8.06%) .NET
4 209 (7.62%) Node.js
5 205 (7.48%) Spring
6 190 (6.93%) AngularJS
7 174 (6.35%) REST
8 170 (6.20%) HTML
9 145 (5.29%) RESTful
10 134 (4.89%) Natural Language Processing
11 128 (4.67%) TensorFlow
12 123 (4.49%) Spark Streaming
13 117 (4.27%) React
14 115 (4.19%) RabbitMQ
15 108 (3.94%) HTML5
16 97 (3.54%) CSS
16 97 (3.54%) SOAP
17 96 (3.50%) Hibernate
17 96 (3.50%) JSON
18 81 (2.95%) XML
Miscellaneous
1 298 (10.87%) Analytical Skills
2 288 (10.50%) Algorithms
3 113 (4.12%) Fintech
4 112 (4.08%) Data Structures
4 112 (4.08%) Greenfield Project
5 87 (3.17%) Management Information System
6 77 (2.81%) Self-Motivation
7 59 (2.15%) User Experience
8 52 (1.90%) Social Network
9 43 (1.57%) Virtual Team
10 42 (1.53%) Public Cloud
11 39 (1.42%) Enterprise Software
12 34 (1.24%) Equities
13 33 (1.20%) Cloud Native
13 33 (1.20%) Robotics
14 31 (1.13%) Derivative
14 31 (1.13%) Mobile App
14 31 (1.13%) Tandem
15 30 (1.09%) Clustering
15 30 (1.09%) Social Media
Operating Systems
1 499 (18.20%) Linux
2 226 (8.24%) Unix
3 139 (5.07%) Windows
4 62 (2.26%) Android
5 54 (1.97%) Apple iOS
6 47 (1.71%) Red Hat Enterprise Linux
7 32 (1.17%) Mac OS X
8 27 (0.98%) CentOS
9 23 (0.84%) Windows Server
10 17 (0.62%) Ubuntu
11 8 (0.29%) VMS
12 6 (0.22%) Solaris
12 6 (0.22%) SUSE
13 5 (0.18%) HPUX
13 5 (0.18%) Oracle Linux
13 5 (0.18%) Windows 7
13 5 (0.18%) Windows 8
14 4 (0.15%) zOS
15 3 (0.11%) AIX
16 2 (0.073%) CoreOS
Processes & Methodologies
1 1,203 (43.87%) Agile Software Development
2 868 (31.66%) Analytics
3 710 (25.89%) Data Science
4 684 (24.95%) Machine Learning
5 533 (19.44%) DevOps
6 530 (19.33%) Software Engineering
7 522 (19.04%) ETL
8 480 (17.51%) Data Modelling
9 433 (15.79%) Business Intelligence
10 379 (13.82%) Computer Science
11 370 (13.49%) Visualisation
12 364 (13.27%) Scrum
13 352 (12.84%) Artificial Intelligence
14 348 (12.69%) Data Engineering
15 347 (12.65%) Open Source
16 314 (11.45%) Data Analytics
17 275 (10.03%) TDD
18 273 (9.96%) Mathematics
19 262 (9.56%) Problem-Solving
20 250 (9.12%) Continuous Integration
Programming Languages
1 1,484 (54.12%) Python
2 1,401 (51.09%) Java
3 1,026 (37.42%) SQL
4 734 (26.77%) Scala
5 388 (14.15%) R
6 374 (13.64%) JavaScript
7 314 (11.45%) C#
8 247 (9.01%) C++
9 143 (5.22%) Bash Shell
10 127 (4.63%) C
11 118 (4.30%) Java 8
12 103 (3.76%) PowerShell
13 87 (3.17%) PHP
14 79 (2.88%) Ruby
15 77 (2.81%) Perl
16 74 (2.70%) Shell Script
17 73 (2.66%) T-SQL
18 65 (2.37%) Go
19 49 (1.79%) Objective-C
20 44 (1.60%) PL/SQL
Qualifications
1 511 (18.64%) Degree
2 181 (6.60%) Computer Science Degree
3 172 (6.27%) Security Cleared
4 92 (3.36%) DV Cleared
5 69 (2.52%) Numerate Degree
5 69 (2.52%) PhD
6 57 (2.08%) Master's Degree
7 54 (1.97%) SC Cleared
8 50 (1.82%) CISSP
9 37 (1.35%) Microsoft Certification
10 36 (1.31%) MCSE
11 32 (1.17%) SANS
12 31 (1.13%) CCNA
12 31 (1.13%) Cisco Certification
12 31 (1.13%) CompTIA Security+
12 31 (1.13%) GIAC
12 31 (1.13%) Linux+ Certification
12 31 (1.13%) Network+ Certification
12 31 (1.13%) SSCP
13 13 (0.47%) AWS Certification
Quality Assurance & Compliance
1 128 (4.67%) QA
2 107 (3.90%) Data Quality
3 43 (1.57%) GDPR
4 19 (0.69%) MiFID
5 18 (0.66%) PMO
6 17 (0.62%) ISO/IEC 27001
7 9 (0.33%) PCI DSS
8 6 (0.22%) IFRS
9 4 (0.15%) GxP
9 4 (0.15%) PA-DSS
9 4 (0.15%) SLA
10 3 (0.11%) COBIT
10 3 (0.11%) GPG13
10 3 (0.11%) Solvency II
11 1 (0.036%) Basel III
11 1 (0.036%) COREP
11 1 (0.036%) CRD IV
11 1 (0.036%) EMIR
System Software
1 290 (10.58%) Docker
2 265 (9.66%) HDFS
3 161 (5.87%) Apache Flume
4 78 (2.84%) Apache ZooKeeper
5 42 (1.53%) Active Directory
6 32 (1.17%) vSphere
7 23 (0.84%) Virtual Machines
8 19 (0.69%) VirtualBox
9 15 (0.55%) Virtual Desktop
10 12 (0.44%) VMware Infrastructure
11 9 (0.33%) Snort
12 7 (0.26%) Hyper-V
12 7 (0.26%) Oracle RAC
13 5 (0.18%) GFS2
14 3 (0.11%) XenApp
15 2 (0.073%) NFS
15 2 (0.073%) Virtual Servers
16 1 (0.036%) GridGain
16 1 (0.036%) KVM
16 1 (0.036%) VMware NSX
Systems Management
1 182 (6.64%) Oozie
2 177 (6.46%) Hadoop YARN
3 162 (5.91%) Puppet
4 149 (5.43%) Kubernetes
5 135 (4.92%) Ansible
6 102 (3.72%) Terraform
7 85 (3.10%) Kibana
8 79 (2.88%) Opscode Chef
9 51 (1.86%) logstash
10 42 (1.53%) Salt
11 38 (1.39%) Mesos
12 37 (1.35%) Prometheus
13 32 (1.17%) Grafana
14 28 (1.02%) Ambari
15 18 (0.66%) Docker Swarm
16 14 (0.51%) Nagios
17 11 (0.40%) ITRS Geneos
18 9 (0.33%) Suricata
19 5 (0.18%) QRadar
19 5 (0.18%) Rundeck
Vendors
1 380 (13.86%) Tableau
2 363 (13.24%) Cloudera
3 362 (13.20%) Oracle
4 302 (11.01%) Microsoft
5 278 (10.14%) Hortonworks
6 277 (10.10%) Google
7 140 (5.11%) MapR
8 139 (5.07%) SAP
9 114 (4.16%) Informatica
10 102 (3.72%) Databricks
11 85 (3.10%) Talend
12 76 (2.77%) IBM
13 66 (2.41%) Splunk
14 64 (2.33%) Teradata
15 50 (1.82%) Red Hat
16 44 (1.60%) CA Agile Central
17 38 (1.39%) WorldPay
18 35 (1.28%) Ab Initio
19 33 (1.20%) ServiceNow
19 33 (1.20%) TIBCO