Period
to 21 July 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 July 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
21 Jul 2018
Same period 2017 Same period 2016
Rank 127 138 128
Rank change year-on-year +11 -10 +28
Permanent jobs citing Hadoop 1,953 1,845 2,156
As % of all permanent IT jobs advertised in London 2.74% 2.50% 2.60%
As % of the Database & Business Intelligence category 8.69% 8.43% 8.61%
Number of salaries quoted 1,386 1,429 1,799
London median annual salary £72,500 £70,000 £70,000
Median salary % change year-on-year +3.57% - +7.69%
10th Percentile £46,500 £45,000 £45,000
90th Percentile £107,500 £105,000 £107,500
England median annual salary £67,500 £65,000 £62,500
% change year-on-year +3.85% +4.00% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 22,477 21,879 25,034
As % of all permanent IT jobs advertised in London 31.58% 29.65% 30.19%
Number of salaries quoted 17,730 18,167 21,817
London median annual salary £62,500 £60,000 £56,000
Median salary % change year-on-year +4.17% +7.14% +1.82%
10th Percentile £37,500 £36,250 £35,400
90th Percentile £92,500 £90,000 £85,000
England median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 21 July 2018.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 21 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +20 311 £75,000 +7.14% 69
East London +25 39 £95,000 +58.33% 14
West London -18 32 £50,000 -13.04% 30
South London -3 5 £53,250 -28.04% 5
North London - 2 £42,283 - 2
Hadoop
England

For the 6 months to 21 July 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 1,302 (66.67%) Big Data
2 1,212 (62.06%) Apache Spark
3 1,008 (51.61%) Python
4 931 (47.67%) Java
5 810 (41.47%) SQL
6 775 (39.68%) Analytics
7 678 (34.72%) Scala
8 666 (34.10%) Agile Software Development
9 582 (29.80%) Kafka
10 547 (28.01%) Apache Hive
11 543 (27.80%) Amazon AWS
12 505 (25.86%) Data Science
13 502 (25.70%) NoSQL
14 489 (25.04%) Machine Learning
15 474 (24.27%) ETL
16 395 (20.23%) Finance
17 367 (18.79%) Linux
18 328 (16.79%) R
19 314 (16.08%) Analytical Skills
20 304 (15.57%) Apache Cassandra
21 301 (15.41%) Degree
22 298 (15.26%) Oracle
23 293 (15.00%) HBase
24 287 (14.70%) Problem-Solving
25 279 (14.29%) DevOps
26 277 (14.18%) Cloudera
27 270 (13.82%) Visualisation
28 261 (13.36%) Software Engineering
29 260 (13.31%) Apache
30 259 (13.26%) Business Intelligence

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,212 (62.06%) Apache Spark
2 260 (13.31%) Apache
3 205 (10.50%) Elasticsearch
4 120 (6.14%) Apache Pig
5 109 (5.58%) SAS
6 80 (4.10%) Apache Solr
7 57 (2.92%) Tomcat
8 29 (1.48%) Jetty
9 26 (1.33%) Confluence
10 19 (0.97%) nginx
11 18 (0.92%) OpenStack
12 15 (0.77%) IIS
13 14 (0.72%) JBoss
13 14 (0.72%) WebSphere
14 9 (0.46%) Apache Airflow
15 8 (0.41%) WebLogic
16 7 (0.36%) Jupyter
17 6 (0.31%) Cloud Foundry
18 5 (0.26%) Oracle Workflow
19 4 (0.20%) CMS
Applications
1 33 (1.69%) Microsoft Excel
2 25 (1.28%) SPSS
3 24 (1.23%) MS Visio
4 11 (0.56%) Chatbot
5 8 (0.41%) Microsoft Office
6 6 (0.31%) Microsoft PowerPoint
7 5 (0.26%) GNU Octave
8 4 (0.20%) Stata
9 3 (0.15%) Mathematica
10 1 (0.051%) CPLEX
10 1 (0.051%) Microsoft Project
10 1 (0.051%) Mingle
10 1 (0.051%) SPSS Modeler
10 1 (0.051%) Weka
Business Applications
1 11 (0.56%) Dynamics AX
1 11 (0.56%) Dynamics CRM
1 11 (0.56%) Dynamics NAV
2 5 (0.26%) Actimize
3 4 (0.20%) SAP ERP
3 4 (0.20%) SAP InfiniteInsight
4 3 (0.15%) Distributed Ledger
5 2 (0.10%) Oracle Procure-to-Pay
5 2 (0.10%) SAP S/4HANA
Cloud Services
1 543 (27.80%) Amazon AWS
2 244 (12.49%) Microsoft Azure
3 113 (5.79%) Google Cloud Platform
4 83 (4.25%) Amazon EMR
5 70 (3.58%) Amazon S3
6 55 (2.82%) SaaS
7 49 (2.51%) Serverless
8 47 (2.41%) Cloud Computing
9 45 (2.30%) AWS Lambda
10 38 (1.95%) GitHub
11 32 (1.64%) Amazon Kinesis
12 30 (1.54%) Amazon EC2
12 30 (1.54%) IBM Cloud
13 26 (1.33%) Adobe Analytics
14 23 (1.18%) PaaS
15 21 (1.08%) Google Analytics
16 20 (1.02%) IaaS
17 19 (0.97%) OpenShift
18 14 (0.72%) AWS CloudFormation
19 12 (0.61%) Azure Machine Learning
Communications & Networking
1 56 (2.87%) TCP/IP
2 41 (2.10%) Kerberos
3 33 (1.69%) HTTP
4 28 (1.43%) Firewall
5 26 (1.33%) SSL
6 20 (1.02%) DNS
6 20 (1.02%) Sourcefire
7 18 (0.92%) Internet
8 17 (0.87%) LAN
8 17 (0.87%) SMPP
8 17 (0.87%) WAN
9 14 (0.72%) FIX Connectivity
10 10 (0.51%) VPN
11 9 (0.46%) Network Security
11 9 (0.46%) SMTP
12 7 (0.36%) SAN
13 3 (0.15%) HTTPS
13 3 (0.15%) SSH
14 2 (0.10%) UMTS
14 2 (0.10%) Wireshark
Database & Business Intelligence
1 1,302 (66.67%) Big Data
2 547 (28.01%) Apache Hive
3 502 (25.70%) NoSQL
4 304 (15.57%) Apache Cassandra
5 293 (15.00%) HBase
6 259 (13.26%) MongoDB
7 244 (12.49%) Data Warehouse
8 237 (12.14%) SQL Server
9 195 (9.98%) MySQL
10 179 (9.17%) Relational Database
11 178 (9.11%) Data Lake
12 177 (9.06%) Impala
13 116 (5.94%) SQL Server Integration Services
14 109 (5.58%) Sqoop
15 99 (5.07%) SQL Server Reporting Services
16 97 (4.97%) Amazon Redshift
17 94 (4.81%) RDBMS
18 93 (4.76%) Redis
19 88 (4.51%) PostgreSQL
19 88 (4.51%) QlikView
Development Applications
1 190 (9.73%) Jenkins
2 129 (6.61%) Git (software)
3 102 (5.22%) JIRA
4 78 (3.99%) JUnit
5 73 (3.74%) Maven
6 57 (2.92%) Atlassian Bamboo
7 49 (2.51%) Gradle
8 41 (2.10%) TeamCity
9 37 (1.89%) Selenium
9 37 (1.89%) Vagrant
10 32 (1.64%) Cucumber
11 29 (1.48%) TestNG
12 24 (1.23%) Mockito
13 20 (1.02%) Sonatype Nexus
13 20 (1.02%) Visual Studio
14 17 (0.87%) Hamcrest
14 17 (0.87%) jMock
15 15 (0.77%) GitLab
15 15 (0.77%) RStudio
16 14 (0.72%) SQL Server Management Studio (SSMS)
General
1 395 (20.23%) Finance
2 244 (12.49%) Banking
3 140 (7.17%) Investment Banking
4 112 (5.73%) Retail
5 104 (5.33%) Games
6 99 (5.07%) Marketing
7 97 (4.97%) Front Office
8 56 (2.87%) Telecoms
9 49 (2.51%) Financial Institution
10 40 (2.05%) Advertising
11 36 (1.84%) Law
12 30 (1.54%) Pharmaceutical
13 21 (1.08%) Manufacturing
14 15 (0.77%) Publishing
15 11 (0.56%) Military
16 8 (0.41%) Corporate Banking
16 8 (0.41%) Electronics
16 8 (0.41%) Legal
17 6 (0.31%) Automotive
18 4 (0.20%) Music Industry
Job Titles
1 498 (25.50%) Developer
2 431 (22.07%) Data Engineer
3 250 (12.80%) Architect
3 250 (12.80%) Data Scientist
4 244 (12.49%) Big Data Engineer
5 197 (10.09%) Java Developer
6 173 (8.86%) Data Architect
7 146 (7.48%) Big Data Developer
8 106 (5.43%) Senior Data Scientist
9 105 (5.38%) Big Data Architect
10 104 (5.33%) Analyst
11 80 (4.10%) Scala Developer
12 77 (3.94%) Java Engineer
13 73 (3.74%) Software Engineer
14 72 (3.69%) Hadoop Engineer
15 54 (2.76%) Senior Developer
16 50 (2.56%) Data Analyst
17 49 (2.51%) DevOps Engineer
18 48 (2.46%) Consultant
19 46 (2.36%) Systems Engineer
Libraries, Frameworks & Software Standards
1 582 (29.80%) Kafka
2 147 (7.53%) Web Services
3 134 (6.86%) .NET
4 130 (6.66%) Spring
5 96 (4.92%) REST
6 92 (4.71%) Node.js
7 83 (4.25%) RabbitMQ
8 82 (4.20%) Natural Language Processing
9 81 (4.15%) Hibernate
10 79 (4.05%) RESTful
11 73 (3.74%) scikit-learn
12 70 (3.58%) Pandas
12 70 (3.58%) TensorFlow
13 69 (3.53%) Spark Streaming
14 63 (3.23%) Elastic Stack
14 63 (3.23%) HTML
15 59 (3.02%) JSON
16 58 (2.97%) AngularJS
17 56 (2.87%) Akka
17 56 (2.87%) NumPy
Miscellaneous
1 314 (16.08%) Analytical Skills
2 248 (12.70%) Computer Science
3 206 (10.55%) Algorithms
4 193 (9.88%) Fintech
5 119 (6.09%) Data Structures
6 76 (3.89%) Management Information System
7 73 (3.74%) Greenfield Project
8 67 (3.43%) User Experience
9 51 (2.61%) Self-Motivation
10 48 (2.46%) Equities
11 47 (2.41%) Cyberthreat
12 43 (2.20%) Linux Command Line
13 41 (2.10%) Fixed Income
14 37 (1.89%) Hedge funds
15 36 (1.84%) Tandem
16 32 (1.64%) Public Cloud
17 30 (1.54%) Robotics
18 28 (1.43%) Foreign Exchange (FX)
18 28 (1.43%) Virtual Team
19 25 (1.28%) Derivative
Operating Systems
1 367 (18.79%) Linux
2 140 (7.17%) Unix
3 58 (2.97%) Windows
4 21 (1.08%) CentOS
5 20 (1.02%) Red Hat Enterprise Linux
6 18 (0.92%) Apple iOS
7 15 (0.77%) Android
8 11 (0.56%) Mac OS X
8 11 (0.56%) Windows Server
9 9 (0.46%) Ubuntu
10 6 (0.31%) CoreOS
11 5 (0.26%) Amazon Linux
12 3 (0.15%) SUSE
12 3 (0.15%) Windows 7
12 3 (0.15%) Windows 8
13 2 (0.10%) DC/OS
13 2 (0.10%) Solaris
14 1 (0.051%) Debian
14 1 (0.051%) Mesosphere
14 1 (0.051%) Windows Server 2008
Processes & Methodologies
1 775 (39.68%) Analytics
2 666 (34.10%) Agile Software Development
3 505 (25.86%) Data Science
4 489 (25.04%) Machine Learning
5 474 (24.27%) ETL
6 287 (14.70%) Problem-Solving
7 279 (14.29%) DevOps
8 270 (13.82%) Visualisation
9 261 (13.36%) Software Engineering
10 259 (13.26%) Business Intelligence
11 235 (12.03%) Data Analytics
12 215 (11.01%) Data Modelling
13 213 (10.91%) TDD
14 211 (10.80%) Artificial Intelligence
15 199 (10.19%) Scrum
16 177 (9.06%) Data Engineering
17 168 (8.60%) Data Visualisation
18 167 (8.55%) Open Source
19 165 (8.45%) Mathematics
20 164 (8.40%) Continuous Integration
Programming Languages
1 1,008 (51.61%) Python
2 931 (47.67%) Java
3 810 (41.47%) SQL
4 678 (34.72%) Scala
5 328 (16.79%) R
6 173 (8.86%) JavaScript
7 167 (8.55%) C#
8 144 (7.37%) Java 8
9 139 (7.12%) Bash Shell
10 110 (5.63%) Perl
11 89 (4.56%) C++
12 82 (4.20%) C
13 74 (3.79%) T-SQL
14 71 (3.64%) Ruby
15 61 (3.12%) PowerShell
16 60 (3.07%) MATLAB
17 50 (2.56%) Shell Script
18 44 (2.25%) PHP
19 35 (1.79%) PL/SQL
20 34 (1.74%) Go
Qualifications
1 301 (15.41%) Degree
2 94 (4.81%) Computer Science Degree
3 93 (4.76%) PhD
4 65 (3.33%) Security Cleared
5 48 (2.46%) Master's Degree
6 43 (2.20%) Numerate Degree
7 36 (1.84%) CISSP
7 36 (1.84%) DV Cleared
8 22 (1.13%) Microsoft Certification
9 20 (1.02%) CEH
9 20 (1.02%) GCIH
9 20 (1.02%) MCSE
9 20 (1.02%) OSCP
10 13 (0.67%) CCNA
10 13 (0.67%) Cisco Certification
10 13 (0.67%) GIAC
10 13 (0.67%) Linux+ Certification
10 13 (0.67%) Network+ Certification
10 13 (0.67%) SANS
10 13 (0.67%) SSCP
Quality Assurance & Compliance
1 67 (3.43%) Data Quality
2 55 (2.82%) QA
3 22 (1.13%) GCP
4 13 (0.67%) MiFID
4 13 (0.67%) PCI DSS
5 11 (0.56%) GDPR
5 11 (0.56%) ISO/IEC 27001
6 10 (0.51%) SLA
7 8 (0.41%) GPG13
8 7 (0.36%) PMO
9 5 (0.26%) Solvency II
10 4 (0.20%) Actionable Recommendations
10 4 (0.20%) HIPAA
11 2 (0.10%) EMIR
12 1 (0.051%) Sarbanes-Oxley
12 1 (0.051%) Val IT
System Software
1 258 (13.21%) HDFS
2 240 (12.29%) Docker
3 139 (7.12%) Apache Flume
4 46 (2.36%) Active Directory
5 29 (1.48%) VMware Infrastructure
6 27 (1.38%) VirtualBox
7 26 (1.33%) Apache ZooKeeper
8 20 (1.02%) Snort
9 12 (0.61%) vSphere
10 10 (0.51%) Hyper-V
11 8 (0.41%) KVM
12 7 (0.36%) Virtual Machines
12 7 (0.36%) Xen
13 3 (0.15%) Oracle RAC
13 3 (0.15%) Varnish
13 3 (0.15%) VMware ESXi
14 2 (0.10%) Virtual Servers
15 1 (0.051%) Cronacle
15 1 (0.051%) GridGain
15 1 (0.051%) NFS
Systems Management
1 132 (6.76%) Ansible
2 122 (6.25%) Puppet
3 109 (5.58%) Kubernetes
4 103 (5.27%) Oozie
5 78 (3.99%) Hadoop YARN
6 77 (3.94%) Opscode Chef
7 71 (3.64%) Terraform
8 65 (3.33%) Mesos
9 36 (1.84%) Kibana
10 32 (1.64%) Docker Swarm
11 31 (1.59%) Salt
12 27 (1.38%) Nagios
13 24 (1.23%) Ambari
13 24 (1.23%) Prometheus
14 22 (1.13%) logstash
15 20 (1.02%) Suricata
16 17 (0.87%) ITRS Geneos
17 12 (0.61%) Consul
18 11 (0.56%) Grafana
19 8 (0.41%) QRadar
Vendors
1 298 (15.26%) Oracle
2 277 (14.18%) Cloudera
3 259 (13.26%) Tableau
4 200 (10.24%) Hortonworks
5 168 (8.60%) Google
6 162 (8.29%) Microsoft
7 128 (6.55%) Informatica
7 128 (6.55%) Talend
8 119 (6.09%) WorldPay
9 63 (3.23%) IBM
10 58 (2.97%) Sybase
11 56 (2.87%) MapR
11 56 (2.87%) Splunk
12 48 (2.46%) SAP
13 47 (2.41%) Teradata
14 38 (1.95%) VMware
15 33 (1.69%) EXASOL
16 30 (1.54%) Netezza
16 30 (1.54%) ServiceNow
16 30 (1.54%) SnapLogic