Period
to 20 November 2017

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 20 November 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
20 Nov 2017
Same period 2016 Same period 2015
Rank 127 144 122
Rank change year-on-year +17 -22 +85
Permanent jobs citing Hadoop 1995 1796 2359
As % of all permanent IT jobs advertised in London 2.65% 2.40% 2.65%
As % of the Database & Business Intelligence category 9.02% 8.15% 8.65%
Number of salaries quoted 1504 1529 1978
London median annual salary £67,500 £70,000 £67,500
Median salary % change year-on-year -3.57% +3.70% +3.85%
10th Percentile £45,000 £46,250 £43,750
90th Percentile £105,000 £105,000 £97,500
England median annual salary £62,500 £62,500 £65,000
% change year-on-year - -3.85% +8.33%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22125 22034 27265
As % of all permanent IT jobs advertised in London 29.44% 29.44% 30.60%
Number of salaries quoted 17738 19176 23065
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £88,750 £87,500 £85,000
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 20 November 2017.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 20 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -11 309 £70,000 +3.70% 27
West London -11 47 £60,000 - 9
East London +8 23 £63,750 -5.56% 6
South London +7 20 £66,000 -2.22% 4
North London +8 15 £100,000 +81.82% 2
Hadoop
England

For the 6 months to 20 November 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Hadoop.

1 1311 (65.71%) Big Data
2 1113 (55.79%) Apache Spark
3 1062 (53.23%) Java
4 953 (47.77%) Python
5 771 (38.65%) Agile Software Development
6 693 (34.74%) Analytics
7 668 (33.48%) SQL
8 608 (30.48%) Finance
9 552 (27.67%) Scala
10 513 (25.71%) NoSQL
11 465 (23.31%) Amazon AWS
12 428 (21.45%) Apache Cassandra
13 406 (20.35%) Machine Learning
14 396 (19.85%) Apache Hive
15 383 (19.20%) Kafka
16 374 (18.75%) Business Intelligence
17 367 (18.40%) Degree
17 367 (18.40%) MongoDB
18 351 (17.59%) Linux
19 341 (17.09%) Relational Database
20 333 (16.69%) Analytical Skills
21 323 (16.19%) Software Engineering
22 313 (15.69%) Open Source
23 304 (15.24%) Banking
24 294 (14.74%) R
25 293 (14.69%) Oracle
26 291 (14.59%) DevOps
27 284 (14.24%) SQL Server
28 273 (13.68%) Microsoft Azure
29 272 (13.63%) Apache

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1113 (55.79%) Apache Spark
2 272 (13.63%) Apache
3 216 (10.83%) Elasticsearch
4 171 (8.57%) SAS
5 117 (5.86%) Apache Pig
6 75 (3.76%) OpenStack
6 75 (3.76%) Tomcat
7 72 (3.61%) Apache Solr
8 34 (1.70%) Apache Airflow
8 34 (1.70%) Jetty
9 33 (1.65%) Confluence
10 32 (1.60%) JBoss
11 31 (1.55%) nginx
12 29 (1.45%) IIS
12 29 (1.45%) WebSphere
13 23 (1.15%) WebLogic
14 21 (1.05%) Cloud Foundry
15 18 (0.90%) CloudStack
16 10 (0.50%) WebSphere Application Server
17 8 (0.40%) GemFire
Applications
1 66 (3.31%) SPSS
2 49 (2.46%) Microsoft Excel
3 11 (0.55%) Microsoft Office
4 5 (0.25%) HipChat
4 5 (0.25%) Spreadsheet
5 4 (0.20%) CPLEX
6 3 (0.15%) Chatbot
7 1 (0.050%) GNU Octave
7 1 (0.050%) LaTeX
7 1 (0.050%) Microsoft PowerPoint
7 1 (0.050%) Stata
7 1 (0.050%) Weka
Business Applications
1 16 (0.80%) SAP InfiniteInsight
2 15 (0.75%) SAP ERP
3 3 (0.15%) Dynamics CRM
4 2 (0.10%) BusinessWorks
4 2 (0.10%) HFM
4 2 (0.10%) Hyperion Enterprise
4 2 (0.10%) Oracle AML
4 2 (0.10%) Payment Gateway
4 2 (0.10%) SAP HR
5 1 (0.050%) Adobe Campaign
5 1 (0.050%) Capstone
5 1 (0.050%) FastStats PeopleStage
5 1 (0.050%) SAP Hybris
5 1 (0.050%) Summit
5 1 (0.050%) Unica
Cloud Services
1 465 (23.31%) Amazon AWS
2 273 (13.68%) Microsoft Azure
3 148 (7.42%) Google Cloud Platform
4 63 (3.16%) Cloud Computing
5 58 (2.91%) GitHub
6 47 (2.36%) SaaS
7 36 (1.80%) IaaS
8 28 (1.40%) Amazon EC2
8 28 (1.40%) Amazon EMR
9 24 (1.20%) Amazon S3
10 23 (1.15%) PaaS
11 21 (1.05%) Amazon Kinesis
11 21 (1.05%) Azure Machine Learning
12 17 (0.85%) AWS CloudFormation
13 13 (0.65%) Google Analytics
14 9 (0.45%) AWS Lambda
15 8 (0.40%) Datadog
15 8 (0.40%) OpenShift
15 8 (0.40%) Serverless
16 7 (0.35%) Azure Data Factory
Communications & Networking
1 40 (2.01%) TCP/IP
2 37 (1.85%) Internet
3 35 (1.75%) Kerberos
4 27 (1.35%) Firewall
5 16 (0.80%) SMPP
5 16 (0.80%) SSL
6 15 (0.75%) HTTP
7 13 (0.65%) DNS
8 11 (0.55%) VLAN
9 10 (0.50%) LDAP
9 10 (0.50%) Network Security
10 9 (0.45%) VPN
11 7 (0.35%) ICMP
12 2 (0.10%) Broadband
12 2 (0.10%) HTTPS
12 2 (0.10%) SNMP
12 2 (0.10%) Wireshark
13 1 (0.050%) Ethernet
13 1 (0.050%) SMS
13 1 (0.050%) SMTP
Database & Business Intelligence
1 1311 (65.71%) Big Data
2 513 (25.71%) NoSQL
3 428 (21.45%) Apache Cassandra
4 396 (19.85%) Apache Hive
5 367 (18.40%) MongoDB
6 341 (17.09%) Relational Database
7 284 (14.24%) SQL Server
8 266 (13.33%) Data Warehouse
9 248 (12.43%) HBase
10 240 (12.03%) RDBMS
11 197 (9.87%) MySQL
12 143 (7.17%) Redis
13 110 (5.51%) PostgreSQL
13 110 (5.51%) SQL Server Integration Services
14 85 (4.26%) QlikView
14 85 (4.26%) SQL Server Reporting Services
15 80 (4.01%) Data Mining
16 71 (3.56%) Power BI
17 70 (3.51%) Amazon Redshift
17 70 (3.51%) Sqoop
Development Applications
1 189 (9.47%) Jenkins
2 187 (9.37%) Git (software)
3 108 (5.41%) JIRA
4 82 (4.11%) Atlassian Bamboo
5 69 (3.46%) Maven
6 66 (3.31%) JUnit
7 44 (2.21%) Bitbucket
8 41 (2.06%) Team Foundation Server
9 31 (1.55%) TeamCity
10 30 (1.50%) Cucumber
11 29 (1.45%) Selenium
12 28 (1.40%) Vagrant
13 26 (1.30%) Subversion
14 22 (1.10%) Mockito
14 22 (1.10%) SQL Server Management Studio (SSMS)
15 21 (1.05%) Hamcrest
15 21 (1.05%) IntelliJ
15 21 (1.05%) jMock
15 21 (1.05%) TestNG
16 19 (0.95%) RStudio
General
1 608 (30.48%) Finance
2 304 (15.24%) Banking
3 183 (9.17%) Investment Banking
4 171 (8.57%) Front Office
5 162 (8.12%) Marketing
6 148 (7.42%) Retail
7 109 (5.46%) Retail Banking
8 95 (4.76%) Telecoms
9 71 (3.56%) Manufacturing
10 68 (3.41%) Electronics
11 54 (2.71%) Games
12 34 (1.70%) Advertising
13 30 (1.50%) Pharmaceutical
14 21 (1.05%) Financial Institution
15 15 (0.75%) Aerospace
15 15 (0.75%) Legal
16 9 (0.45%) Automotive
17 7 (0.35%) Publishing
18 3 (0.15%) Corporate Banking
19 2 (0.10%) Mandarin Language
Job Titles
1 583 (29.22%) Developer
2 274 (13.73%) Java Developer
3 256 (12.83%) Data Engineer
4 210 (10.53%) Data Scientist
5 197 (9.87%) Architect
6 192 (9.62%) Software Engineer
7 170 (8.52%) Big Data Engineer
8 129 (6.47%) Big Data Developer
9 110 (5.51%) Data Architect
9 110 (5.51%) Senior Developer
10 92 (4.61%) Hadoop Engineer
11 77 (3.86%) Python Developer
12 76 (3.81%) Data Manager
12 76 (3.81%) Senior Java Developer
13 74 (3.71%) Analyst
13 74 (3.71%) Scala Developer
13 74 (3.71%) Senior Software Engineer
14 72 (3.61%) Hadoop Developer
15 69 (3.46%) Java Engineer
16 64 (3.21%) Big Data Architect
Libraries, Frameworks & Software Standards
1 383 (19.20%) Kafka
2 171 (8.57%) Spring
3 159 (7.97%) Web Services
4 142 (7.12%) AngularJS
5 128 (6.42%) REST
6 95 (4.76%) Node.js
7 94 (4.71%) .NET
8 87 (4.36%) HTML
9 82 (4.11%) Natural Language Processing
10 76 (3.81%) RESTful
11 74 (3.71%) Hibernate
11 74 (3.71%) React
12 65 (3.26%) RabbitMQ
13 61 (3.06%) Elastic Stack
14 58 (2.91%) CSS
15 57 (2.86%) HTML5
15 57 (2.86%) LAMP
16 52 (2.61%) ActiveMQ
17 49 (2.46%) Akka
18 45 (2.26%) NumPy
Miscellaneous
1 333 (16.69%) Analytical Skills
2 263 (13.18%) Computer Science
3 179 (8.97%) Algorithms
4 108 (5.41%) Greenfield Project
5 56 (2.81%) Data Structures
6 54 (2.71%) Fintech
7 48 (2.41%) Clustering
8 35 (1.75%) Data Centre
9 31 (1.55%) Enterprise Software
10 27 (1.35%) Public Cloud
11 25 (1.25%) Derivative
11 25 (1.25%) Private Cloud
12 24 (1.20%) Market Risk
13 18 (0.90%) Credit Risk
14 17 (0.85%) Management Information System
14 17 (0.85%) User Experience
14 17 (0.85%) Virtual Team
15 15 (0.75%) Equities
15 15 (0.75%) Fixed Income
15 15 (0.75%) Social Network
Operating Systems
1 351 (17.59%) Linux
2 113 (5.66%) Unix
3 85 (4.26%) Windows
4 21 (1.05%) Android
4 21 (1.05%) Apple iOS
5 19 (0.95%) Ubuntu
6 10 (0.50%) Windows Server
7 9 (0.45%) Red Hat Enterprise Linux
8 8 (0.40%) AIX
9 6 (0.30%) Mac OS X
10 4 (0.20%) CentOS
10 4 (0.20%) CoreOS
11 3 (0.15%) Solaris
11 3 (0.15%) VMS
12 2 (0.10%) Mesosphere
13 1 (0.050%) Windows Server 2012
Processes & Methodologies
1 771 (38.65%) Agile Software Development
2 693 (34.74%) Analytics
3 406 (20.35%) Machine Learning
4 374 (18.75%) Business Intelligence
5 323 (16.19%) Software Engineering
6 313 (15.69%) Open Source
7 291 (14.59%) DevOps
8 260 (13.03%) ETL
9 246 (12.33%) Data Analytics
10 232 (11.63%) BDD
11 217 (10.88%) TDD
12 216 (10.83%) OO
13 210 (10.53%) Scrum
14 198 (9.92%) Continuous Integration
15 197 (9.87%) Visualisation
16 182 (9.12%) SDLC
17 175 (8.77%) MapReduce
18 173 (8.67%) Multithreading
19 151 (7.57%) Microservices
20 150 (7.52%) Test Automation
Programming Languages
1 1062 (53.23%) Java
2 953 (47.77%) Python
3 668 (33.48%) SQL
4 552 (27.67%) Scala
5 294 (14.74%) R
6 206 (10.33%) JavaScript
7 194 (9.72%) C#
8 164 (8.22%) C++
9 124 (6.22%) Bash Shell
10 100 (5.01%) C
11 92 (4.61%) Go
12 83 (4.16%) Perl
13 76 (3.81%) PHP
13 76 (3.81%) Ruby
14 50 (2.51%) MATLAB
15 47 (2.36%) T-SQL
16 40 (2.01%) PowerShell
17 39 (1.95%) Shell Script
18 38 (1.90%) VBA
19 26 (1.30%) PL/SQL
Qualifications
1 367 (18.40%) Degree
2 119 (5.96%) Computer Science Degree
3 87 (4.36%) PhD
4 85 (4.26%) Security Cleared
5 52 (2.61%) DV Cleared
5 52 (2.61%) Master's Degree
6 50 (2.51%) SC Cleared
7 23 (1.15%) ISEB
8 22 (1.10%) Numerate Degree
9 15 (0.75%) MBA
9 15 (0.75%) Microsoft Certification
10 12 (0.60%) CISSP
11 8 (0.40%) CEH
11 8 (0.40%) GCIH
11 8 (0.40%) MCITP
11 8 (0.40%) MCTS
11 8 (0.40%) OSCP
12 6 (0.30%) AWS Certification
12 6 (0.30%) Postgraduate
13 4 (0.20%) Cisco Certification
Quality Assurance & Compliance
1 88 (4.41%) Data Quality
2 66 (3.31%) QA
3 25 (1.25%) GCP
4 19 (0.95%) GDPR
5 17 (0.85%) Solvency II
6 16 (0.80%) Sarbanes-Oxley
7 11 (0.55%) ISO/IEC 27001
8 10 (0.50%) SLA
9 8 (0.40%) GPG13
9 8 (0.40%) PCI DSS
10 2 (0.10%) MiFID
11 1 (0.050%) Actionable Recommendations
System Software
1 257 (12.88%) Docker
2 154 (7.72%) HDFS
3 107 (5.36%) Apache Flume
4 23 (1.15%) Apache ZooKeeper
5 20 (1.00%) VMware Infrastructure
6 17 (0.85%) Varnish
7 10 (0.50%) Active Directory
8 9 (0.45%) Virtual Machines
9 8 (0.40%) Snort
10 3 (0.15%) Tivoli Workload Scheduler
10 3 (0.15%) VirtualBox
10 3 (0.15%) vSphere
11 2 (0.10%) MapR-FS
11 2 (0.10%) VMware ESXi
12 1 (0.050%) Cronacle
12 1 (0.050%) Cygwin
12 1 (0.050%) GridGain
12 1 (0.050%) Hyper-V
Systems Management
1 136 (6.82%) Ansible
2 110 (5.51%) Puppet
3 108 (5.41%) Kubernetes
4 106 (5.31%) Opscode Chef
5 60 (3.01%) Oozie
6 58 (2.91%) Mesos
7 57 (2.86%) Terraform
8 51 (2.56%) Hadoop YARN
9 33 (1.65%) logstash
10 32 (1.60%) Salt
11 24 (1.20%) Kibana
12 20 (1.00%) HAProxy
13 17 (0.85%) ZABBIX
14 14 (0.70%) Nagios
15 13 (0.65%) Graphite
16 11 (0.55%) Ambari
17 10 (0.50%) Graylog
18 9 (0.45%) ITRS Geneos
19 8 (0.40%) QRadar
19 8 (0.40%) Suricata
Vendors
1 293 (14.69%) Oracle
2 177 (8.87%) Tableau
3 159 (7.97%) Cloudera
4 145 (7.27%) Google
5 133 (6.67%) SAP
6 129 (6.47%) Microsoft
7 91 (4.56%) Hortonworks
8 70 (3.51%) Teradata
9 60 (3.01%) Informatica
10 52 (2.61%) Splunk
11 51 (2.56%) MapR
12 31 (1.55%) IBM
13 30 (1.50%) SaltStack
14 26 (1.30%) Red Hat
15 25 (1.25%) Netezza
15 25 (1.25%) RedGate
16 24 (1.20%) Sybase
17 22 (1.10%) Vertica
18 20 (1.00%) Cognos
18 20 (1.00%) VMware