Period
to 15 July 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 15 July 2019 with a comparison to the same period in the previous 2 years.

Apache Hadoop
UK > England
6 months to
15 Jul 2019
Same period 2018 Same period 2017
Rank 195 183 197
Rank change year-on-year -12 +14 -5
Permanent jobs citing Hadoop 2,466 3,118 3,028
As % of all permanent IT jobs advertised in England 1.83% 1.90% 1.80%
As % of the Database & Business Intelligence category 6.64% 6.23% 5.91%
Number of salaries quoted 1,854 2,294 2,310
England median annual salary £70,000 £66,250 £65,000
Median salary % change year-on-year +5.66% +1.92% +4.00%
10th Percentile £45,000 £39,825 £37,500
90th Percentile £107,500 £99,625 £100,000
UK median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 37,119 50,054 51,260
As % of all permanent IT jobs advertised in England 27.50% 30.45% 30.48%
Number of salaries quoted 30,732 40,967 43,552
England median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,250 £31,250 £29,750
90th Percentile £86,250 £82,500 £77,500
UK median annual salary £52,000 £50,000 £47,500
% change year-on-year +4.00% +5.26% -

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in England.

Salary trend for Hadoop in England

Hadoop
Salary Histogram in England

The salary distribution of IT jobs citing Hadoop in England over the 6 months to 15 July 2019.

Salary histogram for Hadoop in England

Hadoop
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the England region over the 6 months to 15 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London 0 1,550 £77,500 +6.90% 158
South East -44 281 £57,500 - 33
South West +83 270 £55,000 +10.00% 30
Midlands +88 169 £60,000 +14.29% 7
North of England -97 133 £52,500 -0.94% 31
East Midlands +44 95 £60,000 +20.00% 2
West Midlands +54 74 £60,000 - 5
North West -78 67 £57,500 +4.55% 19
Yorkshire -24 57 £50,000 -3.85% 12
East of England -25 53 £65,000 - 25
North East +15 9 £49,337 +25.70%
Hadoop
UK

For the 6 months to 15 July 2019, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Hadoop.

1 1,529 (62.00%) Big Data
2 1,406 (57.02%) Python
3 1,394 (56.53%) Apache Spark
4 1,226 (49.72%) Agile Software Development
5 1,184 (48.01%) Java
6 1,065 (43.19%) SQL
7 991 (40.19%) Analytics
8 840 (34.06%) Amazon AWS
9 839 (34.02%) Scala
10 738 (29.93%) Data Science
11 718 (29.12%) Apache Hive
12 705 (28.59%) Kafka
13 626 (25.39%) NoSQL
14 602 (24.41%) Machine Learning
15 568 (23.03%) Microsoft Azure
16 551 (22.34%) Software Engineering
17 530 (21.49%) DevOps
18 508 (20.60%) Data Warehouse
19 486 (19.71%) ETL
20 458 (18.57%) Analytical Skills
21 453 (18.37%) Finance
22 450 (18.25%) Business Intelligence
23 426 (17.27%) Data Modelling
24 400 (16.22%) HBase
25 386 (15.65%) Linux
26 378 (15.33%) Apache Cassandra
27 374 (15.17%) R
28 369 (14.96%) Google Cloud Platform
29 367 (14.88%) Data Engineering
30 353 (14.31%) Visualisation

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,394 (56.53%) Apache Spark
2 239 (9.69%) Apache Pig
3 225 (9.12%) Elasticsearch
4 179 (7.26%) Apache
5 153 (6.20%) SAS
6 83 (3.37%) Apache Solr
7 32 (1.30%) Apache Airflow
8 27 (1.09%) JBoss
9 25 (1.01%) SharePoint
10 22 (0.89%) Confluence
11 19 (0.77%) Hyperledger
12 18 (0.73%) nginx
13 17 (0.69%) IIS
14 15 (0.61%) Jupyter
15 12 (0.49%) WebSphere
16 10 (0.41%) Tomcat
17 9 (0.36%) IPython
17 9 (0.36%) Luigi
18 8 (0.32%) WebLogic
19 7 (0.28%) OpenStack
Applications
1 24 (0.97%) Microsoft Office
2 10 (0.41%) SPSS
3 9 (0.36%) Microsoft Excel
4 8 (0.32%) Microsoft PowerPoint
5 7 (0.28%) Maple
6 6 (0.24%) Weka
7 5 (0.20%) GNU Octave
8 3 (0.12%) MS Visio
9 1 (0.041%) Chatbot
9 1 (0.041%) CPLEX
9 1 (0.041%) Spreadsheet
9 1 (0.041%) Stata
Business Applications
1 5 (0.20%) Dynamics CRM
2 2 (0.081%) Magento
2 2 (0.081%) SAP ERP
2 2 (0.081%) SAP InfiniteInsight
3 1 (0.041%) Adobe Campaign
3 1 (0.041%) Data Workbench
3 1 (0.041%) WebTrends
Cloud Services
1 840 (34.06%) Amazon AWS
2 568 (23.03%) Microsoft Azure
3 369 (14.96%) Google Cloud Platform
4 212 (8.60%) Power Platform
5 112 (4.54%) PaaS
6 98 (3.97%) Serverless
7 84 (3.41%) Amazon EMR
8 73 (2.96%) Azure Data Factory
9 67 (2.72%) SaaS
10 64 (2.60%) Amazon Kinesis
11 62 (2.51%) Amazon EC2
11 62 (2.51%) GitHub
12 58 (2.35%) Amazon S3
13 52 (2.11%) Cloud Computing
14 44 (1.78%) AWS Lambda
15 27 (1.09%) Cortana Intelligence Suite
16 26 (1.05%) Amazon SQS
17 24 (0.97%) AWS CloudFormation
18 21 (0.85%) Amazon CloudWatch
19 20 (0.81%) OpenShift
Communications & Networking
1 62 (2.51%) Internet
2 30 (1.22%) TCP/IP
3 28 (1.14%) HTTP
4 19 (0.77%) Firewall
5 11 (0.45%) SSH
6 9 (0.36%) LAN
6 9 (0.36%) Network Security
6 9 (0.36%) Software-Defined Networking
6 9 (0.36%) WAN
7 8 (0.32%) Broadband
7 8 (0.32%) Kerberos
8 4 (0.16%) DNS
8 4 (0.16%) FTP
8 4 (0.16%) SSL
8 4 (0.16%) VLAN
9 3 (0.12%) VPN
10 2 (0.081%) MQTT
10 2 (0.081%) SMPP
10 2 (0.081%) SMS
10 2 (0.081%) SMTP
Database & Business Intelligence
1 1,529 (62.00%) Big Data
2 718 (29.12%) Apache Hive
3 626 (25.39%) NoSQL
4 508 (20.60%) Data Warehouse
5 400 (16.22%) HBase
6 378 (15.33%) Apache Cassandra
7 333 (13.50%) MongoDB
8 269 (10.91%) Amazon Redshift
9 264 (10.71%) Impala
10 249 (10.10%) Data Lake
11 219 (8.88%) SQL Server
12 212 (8.60%) Power BI
13 160 (6.49%) Relational Database
14 148 (6.00%) Sqoop
15 144 (5.84%) MySQL
16 142 (5.76%) PostgreSQL
17 117 (4.74%) Pentaho
18 113 (4.58%) SQL Server Integration Services
19 111 (4.50%) Flink
20 104 (4.22%) QlikView
Development Applications
1 298 (12.08%) Jenkins
2 260 (10.54%) Git (software)
3 162 (6.57%) Maven
4 109 (4.42%) JIRA
5 91 (3.69%) Bitbucket
6 80 (3.24%) Selenium
7 72 (2.92%) Artifactory
8 60 (2.43%) Atlassian Bamboo
9 57 (2.31%) Cucumber
10 47 (1.91%) Visual Studio
11 35 (1.42%) Gradle
12 33 (1.34%) JMeter
13 28 (1.14%) Eclipse
13 28 (1.14%) JUnit
14 26 (1.05%) Ant
15 24 (0.97%) GitLab
16 23 (0.93%) Team Foundation Server
17 20 (0.81%) ERwin
17 20 (0.81%) Subversion
17 20 (0.81%) Travis CI
General
1 453 (18.37%) Finance
2 316 (12.81%) Banking
3 209 (8.48%) Retail
4 166 (6.73%) Law
5 84 (3.41%) Marketing
6 75 (3.04%) Telecoms
7 61 (2.47%) Games
8 38 (1.54%) Advertising
9 36 (1.46%) Military
10 35 (1.42%) Front Office
11 28 (1.14%) Investment Banking
12 26 (1.05%) Manufacturing
13 21 (0.85%) Electronics
14 15 (0.61%) Financial Institution
15 9 (0.36%) Billing
16 7 (0.28%) Aerospace
16 7 (0.28%) Legal
17 6 (0.24%) Automotive
17 6 (0.24%) Back Office
17 6 (0.24%) Retail Banking
Job Titles
1 656 (26.60%) Data Engineer
2 493 (19.99%) Developer
3 289 (11.72%) Big Data Engineer
4 264 (10.71%) Architect
5 249 (10.10%) Java Developer
6 212 (8.60%) Software Engineer
7 192 (7.79%) Data Architect
8 177 (7.18%) Data Scientist
9 155 (6.29%) Hadoop Engineer
9 155 (6.29%) Senior Data Engineer
10 120 (4.87%) Python Engineer
11 101 (4.10%) Java Engineer
12 100 (4.06%) Big Data Developer
12 100 (4.06%) Senior Developer
13 87 (3.53%) DevOps Engineer
14 83 (3.37%) Big Data Architect
15 66 (2.68%) Solutions Architect
16 61 (2.47%) Analyst
16 61 (2.47%) Hadoop Developer
17 59 (2.39%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 705 (28.59%) Kafka
2 177 (7.18%) Web Services
3 173 (7.02%) Spring
4 137 (5.56%) Apache NiFi
5 102 (4.14%) Node.js
5 102 (4.14%) REST
6 101 (4.10%) HTML
7 99 (4.01%) .NET
8 93 (3.77%) Natural Language Processing
9 89 (3.61%) RESTful
10 84 (3.41%) scikit-learn
10 84 (3.41%) Spark Streaming
11 83 (3.37%) Hibernate
12 82 (3.33%) AngularJS
13 80 (3.24%) JSON
14 77 (3.12%) React
15 75 (3.04%) Pandas
16 74 (3.00%) TensorFlow
17 69 (2.80%) CSS
18 56 (2.27%) RabbitMQ
Miscellaneous
1 458 (18.57%) Analytical Skills
2 216 (8.76%) Algorithms
3 134 (5.43%) Data Structures
4 80 (3.24%) Greenfield Project
5 56 (2.27%) User Experience
6 52 (2.11%) Public Cloud
7 51 (2.07%) Linux Command Line
8 42 (1.70%) Management Information System
9 41 (1.66%) Social Media
10 40 (1.62%) Self-Motivation
11 33 (1.34%) Cloud Native
12 30 (1.22%) Enterprise Software
12 30 (1.22%) Virtual Team
13 26 (1.05%) Private Cloud
14 25 (1.01%) Credit Risk
15 20 (0.81%) Data Protection Act
15 20 (0.81%) Market Risk
16 19 (0.77%) Analytical Mindset
17 18 (0.73%) Hedge funds
18 17 (0.69%) Video on Demand
Operating Systems
1 386 (15.65%) Linux
2 266 (10.79%) Unix
3 96 (3.89%) Windows
4 32 (1.30%) CentOS
5 31 (1.26%) Ubuntu
6 27 (1.09%) Red Hat Enterprise Linux
7 20 (0.81%) Android
8 18 (0.73%) Apple iOS
9 17 (0.69%) Windows Server
10 10 (0.41%) Debian
11 6 (0.24%) Mac OS X
11 6 (0.24%) Windows Server 2008
12 3 (0.12%) Oracle Linux
13 2 (0.081%) AIX
13 2 (0.081%) CoreOS
13 2 (0.081%) HPUX
13 2 (0.081%) SUSE Linux Enterprise Server
13 2 (0.081%) VME
13 2 (0.081%) Windows Mobile
13 2 (0.081%) zOS
Processes & Methodologies
1 1,226 (49.72%) Agile Software Development
2 991 (40.19%) Analytics
3 738 (29.93%) Data Science
4 602 (24.41%) Machine Learning
5 551 (22.34%) Software Engineering
6 530 (21.49%) DevOps
7 486 (19.71%) ETL
8 450 (18.25%) Business Intelligence
9 426 (17.27%) Data Modelling
10 367 (14.88%) Data Engineering
11 353 (14.31%) Visualisation
12 336 (13.63%) Data Analytics
13 332 (13.46%) Scrum
14 301 (12.21%) Data Analysis
15 287 (11.64%) Artificial Intelligence
16 270 (10.95%) MapReduce
17 237 (9.61%) Open Source
18 223 (9.04%) TDD
19 217 (8.80%) Continuous Integration
20 206 (8.35%) Mathematics
Programming Languages
1 1,406 (57.02%) Python
2 1,184 (48.01%) Java
3 1,065 (43.19%) SQL
4 839 (34.02%) Scala
5 374 (15.17%) R
6 195 (7.91%) C#
7 181 (7.34%) JavaScript
8 173 (7.02%) C
9 119 (4.83%) Java 8
10 105 (4.26%) C++
11 99 (4.01%) PL/SQL
12 64 (2.60%) Bash Shell
13 58 (2.35%) Ruby
14 57 (2.31%) Perl
15 53 (2.15%) Shell Script
16 35 (1.42%) T-SQL
17 33 (1.34%) Go
17 33 (1.34%) Groovy
18 31 (1.26%) HiveQL
19 30 (1.22%) PowerShell
Qualifications
1 342 (13.87%) Degree
2 157 (6.37%) Security Cleared
3 73 (2.96%) PhD
4 72 (2.92%) SC Cleared
5 56 (2.27%) Computer Science Degree
6 48 (1.95%) DV Cleared
7 37 (1.50%) BPSS Clearance
7 37 (1.50%) Numerate Degree
8 26 (1.05%) Master's Degree
9 15 (0.61%) AWS Certification
10 7 (0.28%) ISTQB
11 6 (0.24%) ISTQB Foundation Certification
12 5 (0.20%) MCP
12 5 (0.20%) Microsoft Certification
12 5 (0.20%) TOGAF Certification
13 2 (0.081%) MBA
14 1 (0.041%) GIAC
14 1 (0.041%) Linux+ Certification
14 1 (0.041%) Network+ Certification
14 1 (0.041%) Sun Certification
Quality Assurance & Compliance
1 98 (3.97%) Data Quality
2 70 (2.84%) QA
3 31 (1.26%) GDPR
4 17 (0.69%) ISO/IEC 27001
5 6 (0.24%) SLA
6 4 (0.16%) IFRS
6 4 (0.16%) MiFID
6 4 (0.16%) PCI DSS
7 3 (0.12%) Basel III
7 3 (0.12%) ISO 9001
8 2 (0.081%) COREP
8 2 (0.081%) CRD IV
8 2 (0.081%) Solvency II
9 1 (0.041%) COBIT
9 1 (0.041%) EMIR
9 1 (0.041%) GxP
9 1 (0.041%) IFRS 9
9 1 (0.041%) ISO 22301
9 1 (0.041%) PMO
System Software
1 312 (12.65%) Docker
2 176 (7.14%) HDFS
3 129 (5.23%) Apache ZooKeeper
4 117 (4.74%) Apache Flume
5 10 (0.41%) VirtualBox
6 6 (0.24%) VMware Infrastructure
7 5 (0.20%) Cronacle
8 4 (0.16%) Varnish
8 4 (0.16%) Virtual Machines
8 4 (0.16%) vSphere
9 3 (0.12%) Active Directory
9 3 (0.12%) Hyper-V
10 2 (0.081%) Tivoli Workload Scheduler
10 2 (0.081%) Virtual Servers
11 1 (0.041%) LXC
11 1 (0.041%) NFS
11 1 (0.041%) Samba
11 1 (0.041%) VMware ESXi
11 1 (0.041%) VMware NSX
Systems Management
1 219 (8.88%) Ansible
2 186 (7.54%) Kubernetes
3 168 (6.81%) Terraform
4 166 (6.73%) Oozie
5 158 (6.41%) Hadoop YARN
6 111 (4.50%) Puppet
7 91 (3.69%) Opscode Chef
8 61 (2.47%) Ambari
9 27 (1.09%) Docker Swarm
10 26 (1.05%) Kibana
11 22 (0.89%) Nagios
12 21 (0.85%) Mesos
13 16 (0.65%) logstash
14 10 (0.41%) Cobbler
14 10 (0.41%) Packer
14 10 (0.41%) Salt
15 9 (0.36%) Microsoft Intune
15 9 (0.36%) SCCM
16 7 (0.28%) Control-M
16 7 (0.28%) SELinux
Vendors
1 348 (14.11%) Cloudera
2 318 (12.90%) Oracle
3 256 (10.38%) Tableau
4 246 (9.98%) Google
5 215 (8.72%) Microsoft
6 167 (6.77%) Hortonworks
7 150 (6.08%) Informatica
8 136 (5.52%) Databricks
9 132 (5.35%) Teradata
10 105 (4.26%) Talend
11 78 (3.16%) IBM
12 71 (2.88%) MapR
13 47 (1.91%) Netezza
14 44 (1.78%) Red Hat
14 44 (1.78%) SAP
15 34 (1.38%) Ab Initio
15 34 (1.38%) Vertica
16 29 (1.18%) Splunk
17 25 (1.01%) HP
18 24 (0.97%) Greenplum