Period
to 23 May 2018

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 23 May 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
23 May 2018
Same period 2017 Same period 2016
Rank 177 196 193
Rank change year-on-year +19 -3 +96
Permanent jobs citing Hadoop 3,127 2,808 3,424
As % of all permanent IT jobs advertised in England 1.94% 1.76% 1.81%
As % of the Database & Business Intelligence category 6.33% 5.74% 5.85%
Number of salaries quoted 2,355 2,245 2,721
England median annual salary £67,500 £65,000 £62,500
Median salary % change year-on-year +3.85% +4.00% -
10th Percentile £40,350 £38,750 £38,750
90th Percentile £100,000 £102,000 £100,000
UK median annual salary £65,500 £65,000 £62,500
% change year-on-year +0.77% +4.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 49,436 48,914 58,533
As % of all permanent IT jobs advertised in England 30.73% 30.69% 31.01%
Number of salaries quoted 40,830 41,955 50,435
England median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £31,250 £29,750 £29,000
90th Percentile £81,250 £77,500 £75,000
UK median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 23 May 2018.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 23 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +24 2,003 £75,000 +7.14% 223
South East -13 381 £60,000 +4.35% 54
North of England -18 279 £52,500 -4.55% 45
East of England +70 206 £65,000 +18.18% 16
North West -34 181 £55,000 -4.35% 30
South West -41 158 £50,000 +6.38% 19
Midlands +52 107 £54,000 -1.82% 15
Yorkshire +42 83 £52,500 +2.44% 14
East Midlands +67 70 £50,000 -4.76% 5
West Midlands -6 37 £60,000 +4.35% 10
North East -25 15 £39,250 -12.78% 1
Hadoop
UK

For the 6 months to 23 May 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 2,042 (65.30%) Big Data
2 1,774 (56.73%) Apache Spark
3 1,529 (48.90%) Java
4 1,512 (48.35%) Python
5 1,242 (39.72%) SQL
6 1,195 (38.22%) Analytics
7 1,107 (35.40%) Agile Software Development
8 969 (30.99%) Scala
9 824 (26.35%) Amazon AWS
10 809 (25.87%) Apache Hive
11 758 (24.24%) Kafka
12 750 (23.98%) Machine Learning
13 740 (23.66%) Data Science
14 678 (21.68%) NoSQL
15 627 (20.05%) Linux
16 603 (19.28%) ETL
17 539 (17.24%) Software Engineering
18 528 (16.89%) R
19 509 (16.28%) DevOps
20 508 (16.25%) Business Intelligence
21 497 (15.89%) Finance
22 484 (15.48%) Analytical Skills
23 474 (15.16%) HBase
24 467 (14.93%) MongoDB
24 467 (14.93%) Apache Cassandra
25 454 (14.52%) Degree
26 447 (14.29%) Microsoft Azure
27 440 (14.07%) Visualisation
28 431 (13.78%) Data Warehouse
28 431 (13.78%) Oracle

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,774 (56.73%) Apache Spark
2 332 (10.62%) Apache
3 271 (8.67%) Elasticsearch
4 215 (6.88%) SAS
5 214 (6.84%) Apache Pig
6 136 (4.35%) Apache Solr
7 105 (3.36%) Tomcat
8 62 (1.98%) JBoss
9 55 (1.76%) Jetty
10 47 (1.50%) Confluence
11 35 (1.12%) OpenStack
12 34 (1.09%) WebLogic
13 26 (0.83%) WebSphere
14 23 (0.74%) nginx
15 20 (0.64%) IIS
16 14 (0.45%) Cloud Foundry
17 12 (0.38%) Apache Airflow
18 11 (0.35%) CloudStack
19 10 (0.32%) BizTalk Server
19 10 (0.32%) Oracle SOA Suite
Applications
1 38 (1.22%) Microsoft Excel
2 35 (1.12%) SPSS
3 27 (0.86%) MS Visio
4 13 (0.42%) Chatbot
5 12 (0.38%) GNU Octave
6 10 (0.32%) Microsoft Office
7 8 (0.26%) Microsoft PowerPoint
7 8 (0.26%) Weka
8 5 (0.16%) Stata
9 4 (0.13%) Mathematica
10 2 (0.064%) Microsoft Project
11 1 (0.032%) CPLEX
11 1 (0.032%) Mingle
11 1 (0.032%) SPSS Modeler
Business Applications
1 5 (0.16%) SAP ERP
1 5 (0.16%) SAP InfiniteInsight
2 4 (0.13%) Dynamics CRM
2 4 (0.13%) Oracle 11i
2 4 (0.13%) Oracle Assets
2 4 (0.13%) Oracle EBS
2 4 (0.13%) Oracle EBS R12
2 4 (0.13%) Oracle General Ledger
2 4 (0.13%) Oracle iProcurement
2 4 (0.13%) Oracle Payables
2 4 (0.13%) Oracle Receivables
3 3 (0.096%) Actimize
3 3 (0.096%) Distributed Ledger
4 2 (0.064%) Oracle Procure-to-Pay
4 2 (0.064%) SAP S/4HANA
5 1 (0.032%) Cognos Business Intelligence
5 1 (0.032%) Oracle AML
5 1 (0.032%) Oracle BPM
5 1 (0.032%) WebTrends
Cloud Services
1 824 (26.35%) Amazon AWS
2 447 (14.29%) Microsoft Azure
3 186 (5.95%) Google Cloud Platform
4 125 (4.00%) Amazon S3
5 123 (3.93%) Amazon EMR
6 99 (3.17%) SaaS
7 88 (2.81%) Amazon Kinesis
8 78 (2.49%) GitHub
9 57 (1.82%) Cloud Computing
10 54 (1.73%) Serverless
11 46 (1.47%) AWS Lambda
12 40 (1.28%) PaaS
13 39 (1.25%) Adobe Analytics
14 38 (1.22%) IaaS
15 37 (1.18%) Amazon EC2
16 33 (1.06%) Azure Data Factory
16 33 (1.06%) IBM Cloud
17 25 (0.80%) Google Analytics
18 19 (0.61%) OpenShift
19 18 (0.58%) Azure Machine Learning
Communications & Networking
1 74 (2.37%) TCP/IP
2 60 (1.92%) Kerberos
3 52 (1.66%) Firewall
4 46 (1.47%) SSL
5 44 (1.41%) HTTP
6 38 (1.22%) Internet
7 24 (0.77%) DNS
7 24 (0.77%) Network Security
8 21 (0.67%) SMPP
8 21 (0.67%) Sourcefire
9 18 (0.58%) VPN
10 14 (0.45%) SMS
10 14 (0.45%) SSH
11 12 (0.38%) LAN
11 12 (0.38%) WAN
12 9 (0.29%) FIX Connectivity
12 9 (0.29%) SMTP
13 8 (0.26%) SAN
13 8 (0.26%) VLAN
14 4 (0.13%) Software-Defined Networking
Database & Business Intelligence
1 2,042 (65.30%) Big Data
2 809 (25.87%) Apache Hive
3 678 (21.68%) NoSQL
4 474 (15.16%) HBase
5 467 (14.93%) Apache Cassandra
5 467 (14.93%) MongoDB
6 431 (13.78%) Data Warehouse
7 377 (12.06%) SQL Server
8 312 (9.98%) Impala
9 299 (9.56%) Relational Database
10 270 (8.63%) MySQL
11 233 (7.45%) Data Lake
12 200 (6.40%) Sqoop
13 171 (5.47%) PostgreSQL
14 167 (5.34%) Data Mining
15 160 (5.12%) SQL Server Integration Services
16 159 (5.08%) Amazon Redshift
17 149 (4.76%) RDBMS
17 149 (4.76%) Redis
18 142 (4.54%) Power BI
Development Applications
1 310 (9.91%) Jenkins
2 226 (7.23%) Git (software)
3 187 (5.98%) JIRA
4 103 (3.29%) JUnit
5 98 (3.13%) TeamCity
6 95 (3.04%) Maven
7 81 (2.59%) Atlassian Bamboo
8 75 (2.40%) Selenium
9 66 (2.11%) Cucumber
10 52 (1.66%) Gradle
11 48 (1.54%) Vagrant
12 39 (1.25%) Octopus Deploy
13 34 (1.09%) Bitbucket
14 31 (0.99%) TestNG
15 29 (0.93%) Subversion
16 28 (0.90%) Eclipse
16 28 (0.90%) Visual Studio
17 25 (0.80%) JMeter
18 24 (0.77%) Mockito
18 24 (0.77%) Sonatype Nexus
General
1 497 (15.89%) Finance
2 236 (7.55%) Banking
3 229 (7.32%) Retail
4 201 (6.43%) Marketing
5 133 (4.25%) Telecoms
6 126 (4.03%) Investment Banking
7 83 (2.65%) Front Office
8 81 (2.59%) Games
9 64 (2.05%) Advertising
10 59 (1.89%) Electronics
11 58 (1.85%) Manufacturing
12 55 (1.76%) Law
13 49 (1.57%) Financial Institution
14 38 (1.22%) Publishing
15 30 (0.96%) Pharmaceutical
16 26 (0.83%) Automotive
17 8 (0.26%) Military
17 8 (0.26%) Retail Banking
18 6 (0.19%) Legal
19 4 (0.13%) General Ledger
Job Titles
1 695 (22.23%) Developer
2 622 (19.89%) Data Engineer
3 435 (13.91%) Architect
4 382 (12.22%) Data Scientist
5 352 (11.26%) Big Data Engineer
6 337 (10.78%) Java Developer
7 295 (9.43%) Data Architect
8 181 (5.79%) Big Data Architect
9 177 (5.66%) Java Engineer
10 167 (5.34%) Software Engineer
11 165 (5.28%) Analyst
11 165 (5.28%) Big Data Developer
12 150 (4.80%) Hadoop Engineer
13 133 (4.25%) Senior Data Scientist
14 107 (3.42%) Senior Developer
15 106 (3.39%) Consultant
16 93 (2.97%) Senior Data Engineer
17 86 (2.75%) DevOps Engineer
18 83 (2.65%) Java Software Engineer
18 83 (2.65%) Python Engineer
Libraries, Frameworks & Software Standards
1 758 (24.24%) Kafka
2 235 (7.52%) Spring
3 213 (6.81%) .NET
4 211 (6.75%) Web Services
5 156 (4.99%) HTML
6 147 (4.70%) REST
7 143 (4.57%) AngularJS
8 133 (4.25%) Hibernate
9 129 (4.13%) Node.js
10 120 (3.84%) TensorFlow
11 113 (3.61%) Pandas
12 108 (3.45%) RabbitMQ
13 96 (3.07%) XML
14 94 (3.01%) Spark Streaming
15 93 (2.97%) Natural Language Processing
16 87 (2.78%) Elastic Stack
17 86 (2.75%) Java EE
18 85 (2.72%) JSON
19 83 (2.65%) CSS
20 82 (2.62%) MLlib
Miscellaneous
1 484 (15.48%) Analytical Skills
2 354 (11.32%) Computer Science
3 297 (9.50%) Algorithms
4 179 (5.72%) Fintech
5 144 (4.61%) Data Structures
6 118 (3.77%) Greenfield Project
6 118 (3.77%) User Experience
7 87 (2.78%) Management Information System
8 74 (2.37%) Self-Motivation
9 56 (1.79%) Linux Command Line
10 43 (1.38%) Data Centre
11 40 (1.28%) Clustering
12 38 (1.22%) Cyberthreat
13 37 (1.18%) Equities
13 37 (1.18%) Virtual Team
14 36 (1.15%) Enterprise Software
14 36 (1.15%) Mobile App
15 35 (1.12%) Public Cloud
16 32 (1.02%) Fixed Income
16 32 (1.02%) Hedge funds
Operating Systems
1 627 (20.05%) Linux
2 206 (6.59%) Unix
3 142 (4.54%) Windows
4 66 (2.11%) Red Hat Enterprise Linux
5 37 (1.18%) CentOS
6 30 (0.96%) Android
7 29 (0.93%) Apple iOS
7 29 (0.93%) Ubuntu
8 24 (0.77%) Windows Server
9 18 (0.58%) Mac OS
10 17 (0.54%) Mac OS X
11 14 (0.45%) Debian
12 11 (0.35%) Windows Server 2012
13 9 (0.29%) CoreOS
14 7 (0.22%) SUSE
15 6 (0.19%) Oracle Linux
16 5 (0.16%) Amazon Linux
16 5 (0.16%) Windows 7
16 5 (0.16%) Windows 8
17 4 (0.13%) Fedora
Processes & Methodologies
1 1,195 (38.22%) Analytics
2 1,107 (35.40%) Agile Software Development
3 750 (23.98%) Machine Learning
4 740 (23.66%) Data Science
5 603 (19.28%) ETL
6 539 (17.24%) Software Engineering
7 509 (16.28%) DevOps
8 508 (16.25%) Business Intelligence
9 440 (14.07%) Visualisation
10 381 (12.18%) Problem-Solving
11 380 (12.15%) Scrum
11 380 (12.15%) TDD
12 373 (11.93%) Data Analytics
13 327 (10.46%) Continuous Integration
14 311 (9.95%) Data Modelling
15 303 (9.69%) MapReduce
16 302 (9.66%) Open Source
17 287 (9.18%) Data Visualisation
18 285 (9.11%) Mathematics
19 267 (8.54%) Artificial Intelligence
Programming Languages
1 1,529 (48.90%) Java
2 1,512 (48.35%) Python
3 1,242 (39.72%) SQL
4 969 (30.99%) Scala
5 528 (16.89%) R
6 287 (9.18%) JavaScript
7 282 (9.02%) C#
8 224 (7.16%) Bash Shell
9 201 (6.43%) C++
10 168 (5.37%) Java 8
11 149 (4.76%) Perl
12 142 (4.54%) C
13 130 (4.16%) Ruby
14 100 (3.20%) Shell Script
15 98 (3.13%) T-SQL
16 96 (3.07%) Go
17 91 (2.91%) MATLAB
18 82 (2.62%) PowerShell
19 61 (1.95%) PHP
20 57 (1.82%) PL/SQL
Qualifications
1 454 (14.52%) Degree
2 145 (4.64%) Security Cleared
3 128 (4.09%) Computer Science Degree
4 121 (3.87%) PhD
5 69 (2.21%) DV Cleared
6 58 (1.85%) Numerate Degree
7 57 (1.82%) Master's Degree
8 45 (1.44%) CISSP
8 45 (1.44%) SC Cleared
9 28 (0.90%) Microsoft Certification
10 26 (0.83%) TOGAF Certification
11 22 (0.70%) CEH
11 22 (0.70%) MCSE
12 21 (0.67%) GCIH
12 21 (0.67%) ISTQB
12 21 (0.67%) OSCP
13 19 (0.61%) Cisco Certification
14 16 (0.51%) CCNA
14 16 (0.51%) SANS
14 16 (0.51%) SSCP
Quality Assurance & Compliance
1 124 (3.97%) QA
2 106 (3.39%) Data Quality
3 47 (1.50%) GCP
4 20 (0.64%) GDPR
5 17 (0.54%) ISO/IEC 27001
6 12 (0.38%) GPG13
6 12 (0.38%) PCI DSS
7 9 (0.29%) SLA
8 7 (0.22%) MiFID
8 7 (0.22%) Solvency II
9 6 (0.19%) HIPAA
9 6 (0.19%) PMO
10 3 (0.096%) EMIR
11 2 (0.064%) Actionable Recommendations
12 1 (0.032%) COBIT
12 1 (0.032%) Dodd-Frank
12 1 (0.032%) FATCA
12 1 (0.032%) Sarbanes-Oxley
12 1 (0.032%) Val IT
System Software
1 420 (13.43%) Docker
2 408 (13.05%) HDFS
3 236 (7.55%) Apache Flume
4 50 (1.60%) Active Directory
5 40 (1.28%) Apache ZooKeeper
6 39 (1.25%) VMware Infrastructure
7 25 (0.80%) Virtual Machines
8 24 (0.77%) VirtualBox
9 21 (0.67%) Snort
10 19 (0.61%) vSphere
11 15 (0.48%) Hyper-V
12 8 (0.26%) Varnish
13 6 (0.19%) KVM
14 5 (0.16%) Xen
15 3 (0.096%) Oracle RAC
15 3 (0.096%) Virtual Desktop
15 3 (0.096%) VMware ESXi
16 2 (0.064%) vCloud
17 1 (0.032%) Cronacle
Systems Management
1 221 (7.07%) Ansible
2 207 (6.62%) Puppet
3 197 (6.30%) Kubernetes
4 168 (5.37%) Hadoop YARN
5 147 (4.70%) Opscode Chef
6 143 (4.57%) Oozie
7 101 (3.23%) Terraform
8 87 (2.78%) Mesos
9 39 (1.25%) Salt
10 33 (1.06%) Ambari
10 33 (1.06%) Kibana
11 31 (0.99%) Docker Swarm
12 27 (0.86%) Nagios
13 22 (0.70%) logstash
14 21 (0.67%) Suricata
15 18 (0.58%) Prometheus
16 13 (0.42%) Cobbler
16 13 (0.42%) HAProxy
16 13 (0.42%) ZABBIX
17 11 (0.35%) Consul
Vendors
1 431 (13.78%) Oracle
2 428 (13.69%) Cloudera
3 416 (13.30%) Tableau
4 261 (8.35%) Google
5 258 (8.25%) Microsoft
6 256 (8.19%) Hortonworks
7 174 (5.56%) Talend
8 157 (5.02%) Informatica
9 118 (3.77%) SAP
10 117 (3.74%) WorldPay
11 107 (3.42%) Teradata
12 79 (2.53%) IBM
13 73 (2.33%) MapR
14 62 (1.98%) Alteryx
15 58 (1.85%) Sybase
16 55 (1.76%) Splunk
17 54 (1.73%) Red Hat
18 53 (1.69%) Atlassian
19 52 (1.66%) VMware
20 45 (1.44%) Adobe