Period
to 23 September 2017

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 23 September 2017 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
23 Sep 2017
Same period 2016 Same period 2015
Rank 129 143 135
Rank change year-on-year +14 -8 +55
Permanent jobs citing Hadoop 1914 1871 2203
As % of all permanent IT jobs advertised in London 2.57% 2.37% 2.45%
As % of the Database & Business Intelligence category 8.72% 8.01% 7.93%
Number of salaries quoted 1434 1574 1868
London median annual salary £67,500 £70,000 £67,500
Median salary % change year-on-year -3.57% +3.70% +3.85%
10th Percentile £45,000 £45,000 £42,500
90th Percentile £105,000 £105,000 £100,000
England median annual salary £62,500 £62,500 £65,000
% change year-on-year - -3.85% +8.33%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21945 23357 27784
As % of all permanent IT jobs advertised in London 29.51% 29.59% 30.95%
Number of salaries quoted 17639 20341 23579
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £90,000 £87,500 £85,000
England median annual salary £49,000 £47,500 £45,000
% change year-on-year +3.16% +5.56% -

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 23 September 2017.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 23 September 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -18 241 £70,000 +1.82% 30
West London +15 64 £60,000 - 10
East London +4 16 £60,000 -4.00% 8
South London +3 10 £67,500 -3.57% 1
North London +8 9 £75,000 +30.43% 1
Hadoop
England

For the 6 months to 23 September 2017, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Hadoop.

1 1245 (65.05%) Big Data
2 1050 (54.86%) Java
3 993 (51.88%) Apache Spark
4 849 (44.36%) Python
5 800 (41.80%) Agile Software Development
6 616 (32.18%) SQL
6 616 (32.18%) Analytics
7 571 (29.83%) Finance
8 541 (28.27%) NoSQL
9 520 (27.17%) Scala
10 439 (22.94%) Amazon AWS
11 437 (22.83%) Apache Cassandra
12 378 (19.75%) MongoDB
13 376 (19.64%) Business Intelligence
14 361 (18.86%) Linux
15 359 (18.76%) Machine Learning
16 358 (18.70%) Apache Hive
17 353 (18.44%) Relational Database
18 337 (17.61%) Analytical Skills
19 330 (17.24%) Kafka
20 320 (16.72%) Banking
21 305 (15.94%) R
22 301 (15.73%) Degree
23 299 (15.62%) Software Engineering
24 275 (14.37%) Open Source
25 271 (14.16%) Oracle
26 267 (13.95%) DevOps
27 265 (13.85%) SQL Server
27 265 (13.85%) Microsoft Azure
28 254 (13.27%) ETL

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 993 (51.88%) Apache Spark
2 222 (11.60%) Apache
3 186 (9.72%) Elasticsearch
4 174 (9.09%) SAS
5 122 (6.37%) Apache Pig
6 98 (5.12%) Tomcat
7 88 (4.60%) Apache Solr
8 77 (4.02%) OpenStack
9 47 (2.46%) JBoss
10 46 (2.40%) WebLogic
11 43 (2.25%) WebSphere
12 38 (1.99%) Jetty
13 33 (1.72%) IIS
14 31 (1.62%) Confluence
15 30 (1.57%) nginx
16 26 (1.36%) Apache Airflow
17 15 (0.78%) WebSphere Application Server
18 13 (0.68%) Cloud Foundry
18 13 (0.68%) CloudStack
19 11 (0.57%) Oracle SOA Suite
Applications
1 60 (3.13%) SPSS
2 42 (2.19%) Microsoft Excel
3 13 (0.68%) Microsoft Office
4 5 (0.26%) HipChat
4 5 (0.26%) Spreadsheet
5 3 (0.16%) CPLEX
5 3 (0.16%) GIMP
6 2 (0.10%) Microsoft PowerPoint
7 1 (0.052%) LaTeX
7 1 (0.052%) MS Visio
7 1 (0.052%) SPSS Modeler
7 1 (0.052%) Stata
7 1 (0.052%) Weka
Business Applications
1 11 (0.57%) SAP InfiniteInsight
2 8 (0.42%) SAP ERP
3 2 (0.10%) BusinessWorks
3 2 (0.10%) HFM
3 2 (0.10%) Hyperion Enterprise
3 2 (0.10%) Payment Gateway
3 2 (0.10%) SAP HR
3 2 (0.10%) SAP Hybris
4 1 (0.052%) Adobe Campaign
4 1 (0.052%) Cognos Business Intelligence
4 1 (0.052%) FastStats PeopleStage
4 1 (0.052%) Oracle AML
4 1 (0.052%) Unica
Cloud Services
1 439 (22.94%) Amazon AWS
2 265 (13.85%) Microsoft Azure
3 154 (8.05%) Google Cloud Platform
4 68 (3.55%) GitHub
5 65 (3.40%) Cloud Computing
6 54 (2.82%) SaaS
7 26 (1.36%) IaaS
8 25 (1.31%) Amazon EC2
9 20 (1.04%) PaaS
10 19 (0.99%) Amazon EMR
10 19 (0.99%) Azure Machine Learning
11 16 (0.84%) Amazon S3
12 15 (0.78%) Amazon Kinesis
13 14 (0.73%) Google Analytics
14 13 (0.68%) Azure Data Factory
15 12 (0.63%) AWS CloudFormation
16 11 (0.57%) OpenShift
17 7 (0.37%) AWS Lambda
18 6 (0.31%) Adobe Analytics
18 6 (0.31%) Office 365
Communications & Networking
1 43 (2.25%) Internet
2 33 (1.72%) Kerberos
3 21 (1.10%) TCP/IP
4 16 (0.84%) SSL
5 12 (0.63%) HTTP
5 12 (0.63%) LDAP
5 12 (0.63%) SMPP
6 10 (0.52%) Firewall
7 8 (0.42%) Network Security
8 6 (0.31%) VLAN
9 5 (0.26%) DNS
10 4 (0.21%) Broadband
10 4 (0.21%) HTTPS
10 4 (0.21%) LAN
10 4 (0.21%) SNMP
10 4 (0.21%) WAN
10 4 (0.21%) Wireshark
11 3 (0.16%) Software-Defined Networking
12 2 (0.10%) DHCP
13 1 (0.052%) FTP
Database & Business Intelligence
1 1245 (65.05%) Big Data
2 541 (28.27%) NoSQL
3 437 (22.83%) Apache Cassandra
4 378 (19.75%) MongoDB
5 358 (18.70%) Apache Hive
6 353 (18.44%) Relational Database
7 265 (13.85%) SQL Server
8 250 (13.06%) Data Warehouse
9 237 (12.38%) RDBMS
10 215 (11.23%) HBase
11 214 (11.18%) MySQL
12 168 (8.78%) Redis
13 125 (6.53%) PostgreSQL
13 125 (6.53%) SQL Server Integration Services
14 99 (5.17%) SQL Server Reporting Services
15 89 (4.65%) QlikView
16 79 (4.13%) Data Mining
17 72 (3.76%) Sqoop
18 70 (3.66%) SQL Server Analysis Services
19 69 (3.61%) Amazon Redshift
Development Applications
1 174 (9.09%) Git (software)
2 165 (8.62%) Jenkins
3 105 (5.49%) JIRA
4 72 (3.76%) JUnit
5 65 (3.40%) Maven
6 64 (3.34%) Atlassian Bamboo
7 43 (2.25%) Bitbucket
8 36 (1.88%) Team Foundation Server
9 31 (1.62%) Mockito
10 30 (1.57%) TeamCity
11 29 (1.52%) Cucumber
11 29 (1.52%) Selenium
12 26 (1.36%) Subversion
13 25 (1.31%) Talend Open Studio
14 23 (1.20%) Vagrant
15 22 (1.15%) SQL Server Management Studio (SSMS)
16 21 (1.10%) Eclipse
16 21 (1.10%) Hamcrest
16 21 (1.10%) jMock
17 19 (0.99%) Travis CI
General
1 571 (29.83%) Finance
2 320 (16.72%) Banking
3 253 (13.22%) Retail
4 196 (10.24%) Investment Banking
5 175 (9.14%) Front Office
6 146 (7.63%) Marketing
7 119 (6.22%) Retail Banking
8 75 (3.92%) Telecoms
9 62 (3.24%) Manufacturing
10 59 (3.08%) Electronics
11 50 (2.61%) Games
12 23 (1.20%) Advertising
13 21 (1.10%) Legal
14 19 (0.99%) Pharmaceutical
15 15 (0.78%) Financial Institution
16 10 (0.52%) Aerospace
17 9 (0.47%) Automotive
18 5 (0.26%) Publishing
19 4 (0.21%) Law
20 3 (0.16%) Corporate Banking
Job Titles
1 576 (30.09%) Developer
2 264 (13.79%) Java Developer
3 230 (12.02%) Architect
4 215 (11.23%) Data Engineer
5 205 (10.71%) Data Scientist
6 167 (8.73%) Software Engineer
7 150 (7.84%) Big Data Engineer
8 129 (6.74%) Big Data Developer
9 111 (5.80%) Data Architect
10 109 (5.69%) Senior Developer
11 96 (5.02%) Hadoop Engineer
12 89 (4.65%) Analyst
13 73 (3.81%) Senior Java Developer
14 72 (3.76%) Big Data Architect
14 72 (3.76%) Scala Developer
15 69 (3.61%) Hadoop Developer
16 67 (3.50%) Python Developer
17 65 (3.40%) Senior Software Engineer
18 64 (3.34%) Data Manager
19 63 (3.29%) Java Engineer
Libraries, Frameworks & Software Standards
1 330 (17.24%) Kafka
2 189 (9.87%) Spring
3 178 (9.30%) Web Services
4 149 (7.78%) AngularJS
5 124 (6.48%) .NET
6 106 (5.54%) REST
7 100 (5.22%) Hibernate
8 96 (5.02%) Node.js
9 91 (4.75%) RESTful
10 88 (4.60%) HTML
11 86 (4.49%) React
12 70 (3.66%) XML
13 67 (3.50%) Natural Language Processing
14 57 (2.98%) HTML5
15 56 (2.93%) ActiveMQ
16 49 (2.56%) Akka
17 48 (2.51%) CSS
18 47 (2.46%) JMS
18 47 (2.46%) Lucene
18 47 (2.46%) RabbitMQ
Miscellaneous
1 337 (17.61%) Analytical Skills
2 232 (12.12%) Computer Science
3 155 (8.10%) Algorithms
4 118 (6.17%) Greenfield Project
5 53 (2.77%) Data Structures
6 50 (2.61%) Clustering
7 45 (2.35%) Fintech
8 37 (1.93%) Data Centre
9 36 (1.88%) Foreign Exchange (FX)
10 30 (1.57%) Derivative
11 29 (1.52%) Enterprise Software
12 26 (1.36%) Management Information System
13 25 (1.31%) Public Cloud
14 22 (1.15%) Equities
15 20 (1.04%) Private Cloud
16 18 (0.94%) Market Risk
16 18 (0.94%) User Experience
16 18 (0.94%) Virtual Team
17 15 (0.78%) Blog
17 15 (0.78%) Credit Risk
Operating Systems
1 361 (18.86%) Linux
2 97 (5.07%) Windows
3 86 (4.49%) Unix
4 22 (1.15%) Apple iOS
5 21 (1.10%) Android
6 17 (0.89%) Red Hat Enterprise Linux
7 15 (0.78%) Windows Server
8 11 (0.57%) Ubuntu
9 9 (0.47%) CentOS
10 8 (0.42%) AIX
10 8 (0.42%) Solaris
11 4 (0.21%) Mac OS X
12 3 (0.16%) Mac OS
12 3 (0.16%) VMS
13 2 (0.10%) Mesosphere
14 1 (0.052%) CoreOS
14 1 (0.052%) Debian
14 1 (0.052%) Windows Server 2012
Processes & Methodologies
1 800 (41.80%) Agile Software Development
2 616 (32.18%) Analytics
3 376 (19.64%) Business Intelligence
4 359 (18.76%) Machine Learning
5 299 (15.62%) Software Engineering
6 275 (14.37%) Open Source
7 267 (13.95%) DevOps
8 254 (13.27%) ETL
9 251 (13.11%) Scrum
10 230 (12.02%) OO
11 228 (11.91%) TDD
12 219 (11.44%) BDD
13 213 (11.13%) Data Analytics
14 211 (11.02%) Visualisation
15 198 (10.34%) MapReduce
16 195 (10.19%) SDLC
17 175 (9.14%) Continuous Integration
18 170 (8.88%) Multithreading
19 167 (8.73%) Microservices
20 161 (8.41%) Asset Management
Programming Languages
1 1050 (54.86%) Java
2 849 (44.36%) Python
3 616 (32.18%) SQL
4 520 (27.17%) Scala
5 305 (15.94%) R
6 190 (9.93%) JavaScript
7 172 (8.99%) C#
8 170 (8.88%) C++
9 97 (5.07%) Bash Shell
10 91 (4.75%) C
11 84 (4.39%) Perl
12 81 (4.23%) Go
13 78 (4.08%) PHP
14 54 (2.82%) Ruby
15 48 (2.51%) T-SQL
16 47 (2.46%) Shell Script
17 46 (2.40%) MATLAB
18 39 (2.04%) VBA
19 24 (1.25%) PowerShell
20 23 (1.20%) PL/SQL
Qualifications
1 301 (15.73%) Degree
2 102 (5.33%) PhD
3 86 (4.49%) Computer Science Degree
4 73 (3.81%) Security Cleared
5 48 (2.51%) DV Cleared
6 46 (2.40%) Master's Degree
7 44 (2.30%) SC Cleared
8 15 (0.78%) ISEB
9 14 (0.73%) Numerate Degree
10 12 (0.63%) Microsoft Certification
11 8 (0.42%) MCITP
11 8 (0.42%) MCTS
12 6 (0.31%) Postgraduate
13 5 (0.26%) MBA
14 3 (0.16%) AWS Certification
14 3 (0.16%) CTC Cleared
15 2 (0.10%) CITP
15 2 (0.10%) EMC Certification
15 2 (0.10%) PMI Certification
15 2 (0.10%) PMP
Quality Assurance & Compliance
1 83 (4.34%) Data Quality
2 71 (3.71%) QA
3 23 (1.20%) GCP
4 16 (0.84%) GDPR
5 10 (0.52%) Sarbanes-Oxley
6 9 (0.47%) SLA
7 8 (0.42%) PCI DSS
7 8 (0.42%) Solvency II
8 2 (0.10%) Actionable Recommendations
8 2 (0.10%) ISO/IEC 27001
9 1 (0.052%) MiFID
System Software
1 209 (10.92%) Docker
2 146 (7.63%) HDFS
3 106 (5.54%) Apache Flume
4 15 (0.78%) VMware Infrastructure
5 14 (0.73%) Apache ZooKeeper
5 14 (0.73%) Varnish
6 13 (0.68%) Active Directory
7 12 (0.63%) Virtual Machines
8 4 (0.21%) Tivoli Workload Scheduler
9 2 (0.10%) Cronacle
9 2 (0.10%) etcd
9 2 (0.10%) flannel
9 2 (0.10%) VMware ESXi
9 2 (0.10%) vSphere
10 1 (0.052%) Cygwin
10 1 (0.052%) VirtualBox
Systems Management
1 123 (6.43%) Ansible
2 121 (6.32%) Puppet
3 105 (5.49%) Opscode Chef
4 88 (4.60%) Kubernetes
5 62 (3.24%) Oozie
6 48 (2.51%) Mesos
7 34 (1.78%) Terraform
8 30 (1.57%) logstash
9 26 (1.36%) Salt
10 24 (1.25%) Hadoop YARN
11 18 (0.94%) Kibana
12 15 (0.78%) HAProxy
13 14 (0.73%) Ambari
14 12 (0.63%) Nagios
15 11 (0.57%) ZABBIX
16 8 (0.42%) Failover Clustering
16 8 (0.42%) ITRS Geneos
17 7 (0.37%) Graphite
17 7 (0.37%) Tivoli
18 6 (0.31%) Red Hat Satellite
Vendors
1 271 (14.16%) Oracle
2 194 (10.14%) Tableau
3 147 (7.68%) Google
4 137 (7.16%) Cloudera
4 137 (7.16%) Microsoft
5 118 (6.17%) SAP
6 95 (4.96%) Hortonworks
7 61 (3.19%) Teradata
8 58 (3.03%) Informatica
9 53 (2.77%) MapR
10 48 (2.51%) Splunk
11 41 (2.14%) IBM
12 38 (1.99%) Red Hat
13 28 (1.46%) Sybase
13 28 (1.46%) Vertica
14 26 (1.36%) Netezza
15 25 (1.31%) SaltStack
15 25 (1.31%) Talend
16 24 (1.25%) MicroStrategy
16 24 (1.25%) TIBCO