Period
to 18 January 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 18 January 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
18 Jan 2018
Same period 2017 Same period 2016
Rank 126 130 114
Rank change year-on-year +4 -16 +91
Permanent jobs citing Hadoop 1,899 1,801 2,393
As % of all permanent IT jobs advertised in London 2.70% 2.54% 2.83%
As % of the Database & Business Intelligence category 8.98% 8.55% 9.18%
Number of salaries quoted 1,524 1,544 2,033
London median annual salary £70,000 £70,000 £67,500
Median salary % change year-on-year - +3.70% +3.85%
10th Percentile £45,250 £46,250 £45,000
90th Percentile £107,500 £105,000 £102,500
England median annual salary £65,000 £62,500 £65,000
% change year-on-year +4.00% -3.85% +8.33%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 21,142 21,070 26,077
As % of all permanent IT jobs advertised in London 30.07% 29.74% 30.81%
Number of salaries quoted 17,244 18,413 22,258
London median annual salary £60,000 £57,500 £55,000
Median salary % change year-on-year +4.35% +4.55% +4.76%
10th Percentile £36,250 £35,000 £35,000
90th Percentile £88,750 £87,500 £85,000
England median annual salary £50,000 £47,500 £46,000
% change year-on-year +5.26% +3.26% +2.22%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 18 January 2018.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 18 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -6 322 £75,000 +7.14% 78
West London -14 35 £57,500 -2.13% 34
South London +3 31 £55,000 -18.52% 6
East London +3 24 £77,500 +10.71% 17
North London +12 16 £100,000 +81.82% 1
Hadoop
England

For the 6 months to 18 January 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for Hadoop.

1 1,300 (68.46%) Big Data
2 1,128 (59.40%) Apache Spark
3 996 (52.45%) Java
4 956 (50.34%) Python
5 692 (36.44%) Analytics
6 685 (36.07%) SQL
7 669 (35.23%) Agile Software Development
8 633 (33.33%) Scala
9 487 (25.65%) Finance
10 473 (24.91%) Amazon AWS
11 472 (24.86%) Machine Learning
12 447 (23.54%) NoSQL
13 446 (23.49%) Apache Hive
14 422 (22.22%) Kafka
15 371 (19.54%) Apache Cassandra
16 358 (18.85%) Linux
17 341 (17.96%) Software Engineering
18 338 (17.80%) Degree
19 336 (17.69%) MongoDB
20 308 (16.22%) Business Intelligence
21 303 (15.96%) HBase
22 301 (15.85%) R
23 298 (15.69%) Analytical Skills
24 289 (15.22%) DevOps
25 271 (14.27%) Computer Science
26 269 (14.17%) Apache
27 263 (13.85%) Relational Database
28 257 (13.53%) Docker
29 254 (13.38%) Microsoft Azure
30 250 (13.16%) Oracle

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,128 (59.40%) Apache Spark
2 269 (14.17%) Apache
3 181 (9.53%) Elasticsearch
4 153 (8.06%) SAS
5 118 (6.21%) Apache Pig
6 66 (3.48%) Apache Solr
7 65 (3.42%) OpenStack
8 55 (2.90%) Tomcat
9 34 (1.79%) Apache Airflow
10 28 (1.47%) nginx
11 24 (1.26%) Confluence
12 20 (1.05%) IIS
12 20 (1.05%) Jetty
13 19 (1.00%) Cloud Foundry
14 16 (0.84%) JBoss
15 15 (0.79%) CloudStack
16 14 (0.74%) WebSphere
17 10 (0.53%) WebLogic
18 7 (0.37%) IPython
18 7 (0.37%) Skype for Business
Applications
1 55 (2.90%) SPSS
2 47 (2.47%) Microsoft Excel
3 6 (0.32%) HipChat
4 5 (0.26%) Chatbot
5 4 (0.21%) CPLEX
6 3 (0.16%) GNU Octave
6 3 (0.16%) Microsoft Office
7 2 (0.11%) Microsoft PowerPoint
7 2 (0.11%) Stata
8 1 (0.053%) Mathematica
8 1 (0.053%) Weka
Business Applications
1 14 (0.74%) SAP ERP
1 14 (0.74%) SAP InfiniteInsight
2 4 (0.21%) Dynamics CRM
3 3 (0.16%) Oracle AML
4 2 (0.11%) Payment Gateway
5 1 (0.053%) Adobe Campaign
5 1 (0.053%) Capstone
5 1 (0.053%) Cognos Business Intelligence
5 1 (0.053%) FastStats PeopleStage
5 1 (0.053%) HFM
5 1 (0.053%) Hyperion Enterprise
5 1 (0.053%) Oracle BPM
5 1 (0.053%) Summit
5 1 (0.053%) Unica
5 1 (0.053%) WebTrends
Cloud Services
1 473 (24.91%) Amazon AWS
2 254 (13.38%) Microsoft Azure
3 100 (5.27%) Google Cloud Platform
4 59 (3.11%) Cloud Computing
5 36 (1.90%) SaaS
6 35 (1.84%) GitHub
7 34 (1.79%) Amazon S3
8 31 (1.63%) Amazon EMR
9 27 (1.42%) Amazon EC2
9 27 (1.42%) Amazon Kinesis
9 27 (1.42%) IaaS
10 25 (1.32%) Azure Machine Learning
11 20 (1.05%) PaaS
12 12 (0.63%) AWS CloudFormation
13 10 (0.53%) Datadog
14 9 (0.47%) AWS Lambda
14 9 (0.47%) Azure Data Factory
15 8 (0.42%) Google Analytics
15 8 (0.42%) Serverless
16 7 (0.37%) OpenShift
Communications & Networking
1 42 (2.21%) Internet
2 40 (2.11%) TCP/IP
3 30 (1.58%) Kerberos
4 29 (1.53%) Firewall
5 24 (1.26%) SSL
6 19 (1.00%) DNS
7 17 (0.90%) HTTP
8 13 (0.68%) SMPP
9 11 (0.58%) VLAN
9 11 (0.58%) VPN
10 10 (0.53%) Network Security
11 9 (0.47%) ICMP
12 7 (0.37%) LDAP
13 2 (0.11%) Broadband
13 2 (0.11%) HTTPS
13 2 (0.11%) SAN
14 1 (0.053%) Ethernet
14 1 (0.053%) LAN
14 1 (0.053%) SMTP
14 1 (0.053%) WAN
Database & Business Intelligence
1 1,300 (68.46%) Big Data
2 447 (23.54%) NoSQL
3 446 (23.49%) Apache Hive
4 371 (19.54%) Apache Cassandra
5 336 (17.69%) MongoDB
6 303 (15.96%) HBase
7 263 (13.85%) Relational Database
8 250 (13.16%) Data Warehouse
9 241 (12.69%) SQL Server
10 187 (9.85%) RDBMS
11 176 (9.27%) MySQL
12 111 (5.85%) Redis
13 108 (5.69%) PostgreSQL
14 95 (5.00%) Data Mining
15 91 (4.79%) Data Lake
16 90 (4.74%) QlikView
17 85 (4.48%) Impala
18 81 (4.27%) SQL Server Integration Services
19 72 (3.79%) Power BI
20 58 (3.05%) Neo4j
Development Applications
1 182 (9.58%) Jenkins
2 173 (9.11%) Git (software)
3 100 (5.27%) JIRA
4 67 (3.53%) Atlassian Bamboo
5 64 (3.37%) Maven
6 58 (3.05%) JUnit
7 34 (1.79%) Team Foundation Server
8 33 (1.74%) Vagrant
9 31 (1.63%) Bitbucket
10 25 (1.32%) Selenium
11 22 (1.16%) Cucumber
12 21 (1.11%) TeamCity
13 18 (0.95%) TestNG
14 16 (0.84%) Artifactory
15 15 (0.79%) SQL Server Management Studio (SSMS)
15 15 (0.79%) Subversion
16 13 (0.68%) Hamcrest
16 13 (0.68%) jMock
17 11 (0.58%) Gradle
17 11 (0.58%) IntelliJ
General
1 487 (25.65%) Finance
2 224 (11.80%) Banking
3 152 (8.00%) Retail
4 134 (7.06%) Investment Banking
5 132 (6.95%) Marketing
6 114 (6.00%) Front Office
7 95 (5.00%) Telecoms
8 61 (3.21%) Retail Banking
9 45 (2.37%) Games
10 42 (2.21%) Manufacturing
11 35 (1.84%) Electronics
12 31 (1.63%) Advertising
13 26 (1.37%) Pharmaceutical
14 19 (1.00%) Financial Institution
15 13 (0.68%) Publishing
16 11 (0.58%) Automotive
16 11 (0.58%) Legal
17 8 (0.42%) Aerospace
18 6 (0.32%) Law
19 2 (0.11%) Mandarin Language
Job Titles
1 501 (26.38%) Developer
2 306 (16.11%) Data Engineer
3 219 (11.53%) Java Developer
4 217 (11.43%) Architect
5 206 (10.85%) Data Scientist
6 204 (10.74%) Big Data Engineer
7 157 (8.27%) Software Engineer
8 131 (6.90%) Data Architect
9 123 (6.48%) Big Data Developer
10 95 (5.00%) Java Engineer
11 93 (4.90%) Senior Developer
12 78 (4.11%) Hadoop Engineer
13 77 (4.05%) Big Data Architect
14 75 (3.95%) Scala Developer
15 66 (3.48%) Consultant
16 64 (3.37%) DevOps Engineer
17 59 (3.11%) Senior Data Scientist
18 57 (3.00%) Data Manager
18 57 (3.00%) Senior Java Developer
19 56 (2.95%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 422 (22.22%) Kafka
2 155 (8.16%) Web Services
3 128 (6.74%) Spring
4 123 (6.48%) REST
5 115 (6.06%) AngularJS
6 87 (4.58%) Node.js
7 84 (4.42%) .NET
8 79 (4.16%) HTML
9 73 (3.84%) Natural Language Processing
10 70 (3.69%) Elastic Stack
11 62 (3.26%) RabbitMQ
11 62 (3.26%) Spark Streaming
12 59 (3.11%) React
13 55 (2.90%) CSS
13 55 (2.90%) LAMP
14 53 (2.79%) Akka
14 53 (2.79%) HTML5
15 51 (2.69%) Hibernate
16 48 (2.53%) NumPy
16 48 (2.53%) XML
Miscellaneous
1 298 (15.69%) Analytical Skills
2 271 (14.27%) Computer Science
3 207 (10.90%) Algorithms
4 101 (5.32%) Greenfield Project
5 58 (3.05%) Data Structures
6 55 (2.90%) Fintech
7 45 (2.37%) Data Centre
8 34 (1.79%) Clustering
8 34 (1.79%) Enterprise Software
9 29 (1.53%) Derivative
10 28 (1.47%) Market Risk
11 22 (1.16%) Mobile App
12 18 (0.95%) Public Cloud
13 17 (0.90%) Management Information System
13 17 (0.90%) Social Media
14 16 (0.84%) Linux Command Line
15 15 (0.79%) NHS
15 15 (0.79%) Private Cloud
16 14 (0.74%) User Experience
16 14 (0.74%) Virtual Team
Operating Systems
1 358 (18.85%) Linux
2 123 (6.48%) Unix
3 70 (3.69%) Windows
4 23 (1.21%) Ubuntu
5 16 (0.84%) Android
5 16 (0.84%) Apple iOS
6 14 (0.74%) Red Hat Enterprise Linux
7 9 (0.47%) CoreOS
7 9 (0.47%) Windows Server
8 8 (0.42%) AIX
9 6 (0.32%) Mac OS X
10 5 (0.26%) CentOS
11 2 (0.11%) Mesosphere
11 2 (0.11%) Windows 7
11 2 (0.11%) Windows 8
12 1 (0.053%) DC/OS
12 1 (0.053%) Windows Server 2012
Processes & Methodologies
1 692 (36.44%) Analytics
2 669 (35.23%) Agile Software Development
3 472 (24.86%) Machine Learning
4 341 (17.96%) Software Engineering
5 308 (16.22%) Business Intelligence
6 289 (15.22%) DevOps
7 245 (12.90%) ETL
8 243 (12.80%) Open Source
9 228 (12.01%) Data Analytics
10 196 (10.32%) TDD
11 195 (10.27%) Visualisation
12 187 (9.85%) Mathematics
13 186 (9.79%) Continuous Integration
14 174 (9.16%) Data Modelling
15 166 (8.74%) BDD
16 162 (8.53%) Scrum
17 159 (8.37%) OO
18 157 (8.27%) MapReduce
19 145 (7.64%) Microservices
20 140 (7.37%) Test Automation
Programming Languages
1 996 (52.45%) Java
2 956 (50.34%) Python
3 685 (36.07%) SQL
4 633 (33.33%) Scala
5 301 (15.85%) R
6 185 (9.74%) C#
7 175 (9.22%) JavaScript
8 139 (7.32%) C++
9 137 (7.21%) Bash Shell
10 83 (4.37%) Go
11 76 (4.00%) Perl
12 73 (3.84%) Ruby
13 70 (3.69%) C
14 69 (3.63%) PHP
15 57 (3.00%) MATLAB
16 46 (2.42%) T-SQL
17 42 (2.21%) PowerShell
18 35 (1.84%) Shell Script
19 27 (1.42%) VBA
20 26 (1.37%) ES6
Qualifications
1 338 (17.80%) Degree
2 102 (5.37%) Computer Science Degree
3 79 (4.16%) PhD
4 71 (3.74%) Security Cleared
5 58 (3.05%) Master's Degree
6 39 (2.05%) SC Cleared
7 34 (1.79%) DV Cleared
8 32 (1.69%) Numerate Degree
9 21 (1.11%) CISSP
9 21 (1.11%) ISEB
10 15 (0.79%) MBA
11 14 (0.74%) Microsoft Certification
12 12 (0.63%) CEH
12 12 (0.63%) GCIH
12 12 (0.63%) OSCP
13 6 (0.32%) AWS Certification
13 6 (0.32%) MCSE
14 5 (0.26%) Cisco Certification
15 4 (0.21%) CCNA
15 4 (0.21%) SANS
Quality Assurance & Compliance
1 81 (4.27%) Data Quality
2 63 (3.32%) QA
3 20 (1.05%) GCP
4 19 (1.00%) Solvency II
5 17 (0.90%) ISO/IEC 27001
6 16 (0.84%) Sarbanes-Oxley
7 15 (0.79%) GDPR
8 12 (0.63%) GPG13
9 10 (0.53%) SLA
10 4 (0.21%) PCI DSS
11 2 (0.11%) HIPAA
11 2 (0.11%) MiFID
12 1 (0.053%) Dodd-Frank
12 1 (0.053%) EMIR
12 1 (0.053%) FATCA
System Software
1 257 (13.53%) Docker
2 147 (7.74%) HDFS
3 96 (5.06%) Apache Flume
4 28 (1.47%) Apache ZooKeeper
5 27 (1.42%) VMware Infrastructure
6 12 (0.63%) Snort
6 12 (0.63%) Varnish
7 9 (0.47%) Active Directory
8 6 (0.32%) VirtualBox
9 4 (0.21%) vSphere
10 3 (0.16%) Virtual Machines
11 2 (0.11%) MapR-FS
11 2 (0.11%) VMware ESXi
12 1 (0.053%) Cygwin
12 1 (0.053%) GridGain
12 1 (0.053%) Hyper-V
12 1 (0.053%) Xen
Systems Management
1 127 (6.69%) Ansible
2 112 (5.90%) Kubernetes
3 106 (5.58%) Puppet
4 89 (4.69%) Hadoop YARN
5 87 (4.58%) Opscode Chef
6 75 (3.95%) Terraform
7 68 (3.58%) Mesos
8 53 (2.79%) Oozie
9 26 (1.37%) Salt
10 24 (1.26%) logstash
11 20 (1.05%) ZABBIX
12 19 (1.00%) Kibana
13 17 (0.90%) HAProxy
14 14 (0.74%) Graphite
15 13 (0.68%) Nagios
16 12 (0.63%) Ambari
16 12 (0.63%) Suricata
17 10 (0.53%) Graylog
18 8 (0.42%) ITRS Geneos
18 8 (0.42%) QRadar
Vendors
1 250 (13.16%) Oracle
2 196 (10.32%) Cloudera
3 162 (8.53%) Tableau
4 132 (6.95%) Microsoft
5 127 (6.69%) Google
6 110 (5.79%) Hortonworks
7 80 (4.21%) SAP
8 76 (4.00%) Teradata
9 56 (2.95%) Informatica
10 49 (2.58%) MapR
11 44 (2.32%) Splunk
12 31 (1.63%) SaltStack
13 29 (1.53%) Netezza
14 28 (1.47%) IBM
14 28 (1.47%) Red Hat
15 27 (1.42%) VMware
16 26 (1.37%) Talend
17 25 (1.32%) RedGate
18 22 (1.16%) Vertica
19 19 (1.00%) Cognos