Period
to 18 March 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 18 March 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
18 Mar 2019
Same period 2018 Same period 2017
Rank 184 185 193
Rank change year-on-year +1 +8 +11
Permanent jobs citing Hadoop 2,577 3,048 2,974
As % of all permanent IT jobs advertised in England 1.87% 1.85% 1.82%
As % of the Database & Business Intelligence category 6.58% 6.04% 6.03%
Number of salaries quoted 1,933 2,378 2,457
England median annual salary £70,000 £65,000 £65,000
Median salary % change year-on-year +7.69% - -
10th Percentile £42,500 £39,500 £40,000
90th Percentile £106,250 £100,000 £97,500
UK median annual salary £70,000 £65,000 £65,000
% change year-on-year +7.69% - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 39,140 50,459 49,283
As % of all permanent IT jobs advertised in England 28.40% 30.70% 30.16%
Number of salaries quoted 32,531 42,500 42,439
England median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,250 £30,750 £29,750
90th Percentile £86,250 £80,000 £77,500
UK median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 18 March 2019.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 18 March 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -7 1,613 £75,000 +3.45% 245
South East +17 328 £60,000 +4.35% 67
North of England +2 201 £60,000 +14.29% 51
South West +15 200 £55,000 +22.22% 50
Midlands +78 135 £52,500 +10.53% 26
North West -20 108 £65,000 +23.81% 32
East of England -30 90 £70,000 +16.67% 19
Yorkshire +40 77 £50,000 -4.76% 16
East Midlands +21 72 £53,500 +18.89% 13
West Midlands +65 63 £47,500 -20.83% 13
North East +23 20 £60,000 +29.03% 3
Hadoop
UK

For the 6 months to 18 March 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,697 (65.85%) Big Data
2 1,472 (57.12%) Python
3 1,466 (56.89%) Apache Spark
4 1,340 (52.00%) Java
5 1,192 (46.26%) Agile Software Development
6 995 (38.61%) SQL
7 935 (36.28%) Kafka
8 917 (35.58%) Amazon AWS
9 864 (33.53%) Analytics
10 856 (33.22%) NoSQL
11 790 (30.66%) Scala
12 755 (29.30%) Apache Hive
13 711 (27.59%) Machine Learning
14 651 (25.26%) Data Science
15 642 (24.91%) Software Engineering
16 590 (22.89%) Microsoft Azure
17 589 (22.86%) DevOps
18 551 (21.38%) Data Modelling
19 528 (20.49%) ETL
20 513 (19.91%) Finance
21 506 (19.64%) HBase
22 498 (19.32%) Linux
23 473 (18.35%) Apache Cassandra
24 427 (16.57%) Business Intelligence
25 418 (16.22%) Data Engineering
26 411 (15.95%) Cloudera
27 404 (15.68%) Data Warehouse
28 390 (15.13%) MongoDB
29 386 (14.98%) Degree
30 366 (14.20%) Google Cloud Platform

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,466 (56.89%) Apache Spark
2 333 (12.92%) Apache
3 307 (11.91%) Elasticsearch
4 261 (10.13%) Apache Pig
5 182 (7.06%) SAS
6 95 (3.69%) Apache Solr
7 45 (1.75%) Tomcat
8 42 (1.63%) JBoss
9 35 (1.36%) SharePoint
10 29 (1.13%) Apache Airflow
11 25 (0.97%) GlassFish
12 23 (0.89%) WebSphere
13 22 (0.85%) Confluence
14 19 (0.74%) nginx
15 17 (0.66%) IIS
15 17 (0.66%) Jetty
16 15 (0.58%) Apache Geronimo
16 15 (0.58%) WebLogic
17 13 (0.50%) CMS
17 13 (0.50%) Drupal
Applications
1 27 (1.05%) Microsoft Office
2 21 (0.81%) SPSS
3 18 (0.70%) Weka
4 13 (0.50%) Microsoft Excel
5 11 (0.43%) Maple
6 7 (0.27%) Chatbot
6 7 (0.27%) Microsoft PowerPoint
6 7 (0.27%) Stata
7 5 (0.19%) GNU Octave
7 5 (0.19%) MS Visio
8 2 (0.078%) S-PLUS
9 1 (0.039%) InVision
9 1 (0.039%) Photoshop
Business Applications
1 6 (0.23%) Dynamics CRM
2 1 (0.039%) Adobe Campaign
2 1 (0.039%) Magento
2 1 (0.039%) SAP ERP
2 1 (0.039%) SAP InfiniteInsight
Cloud Services
1 917 (35.58%) Amazon AWS
2 590 (22.89%) Microsoft Azure
3 366 (14.20%) Google Cloud Platform
4 115 (4.46%) Amazon EMR
5 114 (4.42%) Cloud Computing
6 95 (3.69%) Serverless
7 88 (3.41%) GitHub
8 83 (3.22%) Amazon EC2
9 71 (2.76%) PaaS
10 68 (2.64%) AWS Lambda
11 58 (2.25%) Amazon S3
12 50 (1.94%) SaaS
13 39 (1.51%) Azure Data Factory
14 34 (1.32%) Amazon Kinesis
14 34 (1.32%) Amazon SQS
15 29 (1.13%) AWS CloudFormation
16 21 (0.81%) AWS Data Pipeline
16 21 (0.81%) Cortana Intelligence Suite
17 20 (0.78%) Apigee
18 18 (0.70%) IaaS
Communications & Networking
1 80 (3.10%) Internet
2 43 (1.67%) HTTP
3 37 (1.44%) TCP/IP
4 30 (1.16%) Firewall
5 16 (0.62%) Kerberos
6 13 (0.50%) SSL
7 11 (0.43%) DNS
7 11 (0.43%) SSH
8 10 (0.39%) SAN
9 8 (0.31%) Network Security
10 7 (0.27%) MQTT
10 7 (0.27%) WAN
11 6 (0.23%) LAN
11 6 (0.23%) VPN
12 5 (0.19%) Software-Defined Networking
13 4 (0.16%) FCoE
13 4 (0.16%) FTP
13 4 (0.16%) SNMP
13 4 (0.16%) VoIP
14 3 (0.12%) AMQP
Database & Business Intelligence
1 1,697 (65.85%) Big Data
2 856 (33.22%) NoSQL
3 755 (29.30%) Apache Hive
4 506 (19.64%) HBase
5 473 (18.35%) Apache Cassandra
6 404 (15.68%) Data Warehouse
7 390 (15.13%) MongoDB
8 309 (11.99%) Amazon Redshift
9 299 (11.60%) SQL Server
10 263 (10.21%) Impala
11 235 (9.12%) Data Lake
12 229 (8.89%) Relational Database
13 200 (7.76%) Power BI
14 196 (7.61%) MySQL
15 195 (7.57%) Flink
16 186 (7.22%) PostgreSQL
17 155 (6.01%) Sqoop
18 139 (5.39%) Redis
19 121 (4.70%) Couchbase
20 116 (4.50%) SQL Server Integration Services
Development Applications
1 217 (8.42%) Jenkins
2 211 (8.19%) Git (software)
3 146 (5.67%) JIRA
4 136 (5.28%) Maven
5 80 (3.10%) Selenium
6 57 (2.21%) Atlassian Bamboo
6 57 (2.21%) Visual Studio
7 51 (1.98%) Gradle
8 44 (1.71%) JMeter
9 41 (1.59%) Ant
9 41 (1.59%) Bitbucket
10 39 (1.51%) JUnit
11 37 (1.44%) Team Foundation Server
12 34 (1.32%) Cucumber
13 29 (1.13%) Artifactory
14 27 (1.05%) SoapUI
15 26 (1.01%) Eclipse
15 26 (1.01%) Visual Studio Team System
16 22 (0.85%) EasyMock
17 21 (0.81%) Mercurial
General
1 513 (19.91%) Finance
2 226 (8.77%) Banking
3 220 (8.54%) Military
4 218 (8.46%) Law
5 183 (7.10%) Retail
6 148 (5.74%) Telecoms
7 106 (4.11%) Marketing
8 60 (2.33%) Games
9 44 (1.71%) Investment Banking
10 29 (1.13%) Advertising
11 24 (0.93%) Front Office
12 21 (0.81%) Manufacturing
13 17 (0.66%) Financial Institution
14 15 (0.58%) Automotive
14 15 (0.58%) Electronics
15 11 (0.43%) Retail Banking
16 7 (0.27%) Czech Language
16 7 (0.27%) Legal
16 7 (0.27%) Pharmaceutical
17 5 (0.19%) Back Office
Job Titles
1 703 (27.28%) Data Engineer
2 492 (19.09%) Developer
3 383 (14.86%) Big Data Engineer
4 368 (14.28%) Architect
5 261 (10.13%) Data Architect
6 242 (9.39%) Software Engineer
7 233 (9.04%) Java Developer
8 192 (7.45%) Data Scientist
9 162 (6.29%) Hadoop Engineer
10 139 (5.39%) Senior Data Engineer
11 135 (5.24%) Python Engineer
12 115 (4.46%) Java Engineer
13 113 (4.38%) Big Data Architect
14 112 (4.35%) Analyst
15 109 (4.23%) Senior Developer
16 95 (3.69%) Big Data Developer
16 95 (3.69%) Consultant
17 78 (3.03%) Java Software Engineer
18 69 (2.68%) Senior Data Scientist
19 66 (2.56%) Solutions Architect
Libraries, Frameworks & Software Standards
1 935 (36.28%) Kafka
2 254 (9.86%) Web Services
3 218 (8.46%) Spring
4 165 (6.40%) REST
5 160 (6.21%) .NET
6 151 (5.86%) Spark Streaming
7 147 (5.70%) HTML
8 138 (5.36%) Node.js
9 132 (5.12%) Hibernate
10 131 (5.08%) AngularJS
11 121 (4.70%) RESTful
12 112 (4.35%) React
13 110 (4.27%) Apache NiFi
14 99 (3.84%) Natural Language Processing
15 95 (3.69%) RabbitMQ
16 91 (3.53%) CSS
17 85 (3.30%) TensorFlow
18 83 (3.22%) JSON
19 76 (2.95%) XML
20 75 (2.91%) SOAP
Miscellaneous
1 303 (11.76%) Analytical Skills
2 241 (9.35%) Algorithms
3 127 (4.93%) Data Structures
3 127 (4.93%) Fintech
4 88 (3.41%) Greenfield Project
5 67 (2.60%) User Experience
6 48 (1.86%) Self-Motivation
7 45 (1.75%) Management Information System
8 40 (1.55%) Linux Command Line
9 39 (1.51%) Virtual Team
10 35 (1.36%) Clustering
11 34 (1.32%) Social Network
11 34 (1.32%) Video on Demand
12 33 (1.28%) Social Media
13 30 (1.16%) Public Cloud
14 25 (0.97%) Cloud Native
15 24 (0.93%) Enterprise Software
16 23 (0.89%) Derivative
17 19 (0.74%) Market Risk
18 18 (0.70%) Credit Risk
Operating Systems
1 498 (19.32%) Linux
2 229 (8.89%) Unix
3 156 (6.05%) Windows
4 52 (2.02%) Red Hat Enterprise Linux
5 50 (1.94%) CentOS
6 49 (1.90%) Android
7 40 (1.55%) Apple iOS
8 36 (1.40%) Ubuntu
9 32 (1.24%) Windows Server
10 12 (0.47%) Mac OS X
10 12 (0.47%) Windows Server 2008
11 9 (0.35%) Windows 7
11 9 (0.35%) Windows 8
12 8 (0.31%) Debian
13 7 (0.27%) Oracle Linux
14 6 (0.23%) VMS
14 6 (0.23%) Windows Mobile
15 3 (0.12%) Solaris
15 3 (0.12%) SUSE
16 2 (0.078%) HPUX
Processes & Methodologies
1 1,192 (46.26%) Agile Software Development
2 864 (33.53%) Analytics
3 711 (27.59%) Machine Learning
4 651 (25.26%) Data Science
5 642 (24.91%) Software Engineering
6 589 (22.86%) DevOps
7 551 (21.38%) Data Modelling
8 528 (20.49%) ETL
9 427 (16.57%) Business Intelligence
10 418 (16.22%) Data Engineering
11 365 (14.16%) Scrum
12 354 (13.74%) Visualisation
13 341 (13.23%) Data Analytics
14 334 (12.96%) Artificial Intelligence
15 300 (11.64%) TDD
16 280 (10.87%) Data Analysis
17 274 (10.63%) Open Source
18 267 (10.36%) Computer Science
19 258 (10.01%) MapReduce
20 239 (9.27%) Continuous Integration
Programming Languages
1 1,472 (57.12%) Python
2 1,340 (52.00%) Java
3 995 (38.61%) SQL
4 790 (30.66%) Scala
5 283 (10.98%) R
6 242 (9.39%) JavaScript
7 237 (9.20%) C#
8 173 (6.71%) C++
9 148 (5.74%) Java 8
10 130 (5.04%) C
11 88 (3.41%) Bash Shell
12 83 (3.22%) Perl
12 83 (3.22%) Ruby
13 71 (2.76%) T-SQL
14 65 (2.52%) PL/SQL
14 65 (2.52%) Shell Script
15 49 (1.90%) PowerShell
16 46 (1.79%) PHP
17 43 (1.67%) Groovy
18 41 (1.59%) Go
Qualifications
1 386 (14.98%) Degree
2 175 (6.79%) Security Cleared
3 140 (5.43%) Computer Science Degree
4 74 (2.87%) Numerate Degree
5 71 (2.76%) SC Cleared
6 64 (2.48%) DV Cleared
7 63 (2.44%) PhD
8 38 (1.47%) BPSS Clearance
9 33 (1.28%) Master's Degree
10 20 (0.78%) CISSP
11 19 (0.74%) AWS Certification
12 16 (0.62%) TOGAF Certification
13 11 (0.43%) Microsoft Certification
14 10 (0.39%) CCNA
14 10 (0.39%) CISA
14 10 (0.39%) Cisco Certification
14 10 (0.39%) CompTIA Security+
14 10 (0.39%) MCSE
14 10 (0.39%) SANS
14 10 (0.39%) SSCP
Quality Assurance & Compliance
1 116 (4.50%) Data Quality
2 95 (3.69%) QA
3 64 (2.48%) GDPR
4 27 (1.05%) ISO/IEC 27001
5 16 (0.62%) SLA
6 15 (0.58%) MiFID
7 11 (0.43%) IFRS
7 11 (0.43%) PCI DSS
8 6 (0.23%) PMO
9 5 (0.19%) Solvency II
10 3 (0.12%) Basel III
10 3 (0.12%) GxP
10 3 (0.12%) ISO 9001
10 3 (0.12%) PA-DSS
11 2 (0.078%) COREP
11 2 (0.078%) CRD IV
11 2 (0.078%) EMIR
12 1 (0.039%) COBIT
12 1 (0.039%) ISO 22301
System Software
1 247 (9.58%) Docker
2 221 (8.58%) HDFS
3 184 (7.14%) Apache Flume
4 112 (4.35%) Apache ZooKeeper
5 21 (0.81%) Active Directory
6 12 (0.47%) Virtual Machines
7 10 (0.39%) VirtualBox
8 8 (0.31%) Hyper-V
8 8 (0.31%) vSphere
9 7 (0.27%) Oracle RAC
10 6 (0.23%) VMware Infrastructure
11 4 (0.16%) NFS
11 4 (0.16%) Samba
11 4 (0.16%) VMware ESXi
11 4 (0.16%) VMware NSX
12 3 (0.12%) GFS2
13 2 (0.078%) LXC
13 2 (0.078%) Varnish
14 1 (0.039%) Tivoli Workload Scheduler
14 1 (0.039%) XenApp
Systems Management
1 217 (8.42%) Oozie
2 180 (6.98%) Hadoop YARN
3 168 (6.52%) Ansible
4 138 (5.36%) Kubernetes
5 124 (4.81%) Terraform
6 113 (4.38%) Puppet
7 76 (2.95%) Opscode Chef
8 59 (2.29%) Ambari
9 47 (1.82%) Kibana
10 34 (1.32%) Mesos
11 29 (1.13%) Nagios
12 22 (0.85%) logstash
13 16 (0.62%) Docker Swarm
14 15 (0.58%) Prometheus
15 13 (0.50%) Salt
16 7 (0.27%) Oracle ZFS
16 7 (0.27%) SELinux
17 6 (0.23%) Grafana
17 6 (0.23%) Marathon
18 5 (0.19%) Microsoft Intune
Vendors
1 411 (15.95%) Cloudera
2 362 (14.05%) Oracle
3 330 (12.81%) Tableau
4 273 (10.59%) Google
5 267 (10.36%) Microsoft
6 266 (10.32%) Hortonworks
7 121 (4.70%) Databricks
8 120 (4.66%) Informatica
9 119 (4.62%) MapR
10 103 (4.00%) Talend
11 90 (3.49%) SAP
12 82 (3.18%) IBM
13 81 (3.14%) Teradata
14 64 (2.48%) Red Hat
15 50 (1.94%) Splunk
16 49 (1.90%) CA Agile Central
17 40 (1.55%) Alteryx
18 38 (1.47%) WorldPay
19 36 (1.40%) Netezza
20 31 (1.20%) Sybase