Period
to 21 November 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Hadoop over the 6 months to 21 November 2018 with a comparison to the same period in the previous 2 years.

Apache Hadoop
England > London
6 months to
21 Nov 2018
Same period 2017 Same period 2016
Rank 139 132 143
Rank change year-on-year -7 +11 -21
Permanent jobs citing Hadoop 1,644 1,998 1,822
As % of all permanent IT jobs advertised in London 2.44% 2.64% 2.41%
As % of the Database & Business Intelligence category 8.11% 8.98% 8.17%
Number of salaries quoted 1,230 1,507 1,552
London median annual salary £75,000 £67,500 £70,000
Median salary % change year-on-year +11.11% -3.57% +3.70%
10th Percentile £46,500 £45,000 £46,250
90th Percentile £105,000 £105,000 £105,000
England median annual salary £70,000 £62,500 £62,500
% change year-on-year +12.00% - -3.85%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Permanent vacancies with a requirement for database or business intelligence skills 20,266 22,245 22,300
As % of all permanent IT jobs advertised in London 30.09% 29.42% 29.47%
Number of salaries quoted 16,531 17,839 19,432
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £37,500 £36,250 £35,000
90th Percentile £95,000 £88,750 £87,500
England median annual salary £51,500 £50,000 £47,500
% change year-on-year +3.00% +5.26% +5.56%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Hadoop in London.

Salary trend for Hadoop in London

Hadoop
Salary Histogram in London

The salary distribution of IT jobs citing Hadoop in London over the 6 months to 21 November 2018.

Salary histogram for Hadoop in London

Hadoop
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Hadoop within the London region over the 6 months to 21 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -14 264 £75,000 +7.14% 69
East London +19 38 £95,000 +49.02% 21
West London -7 24 £57,500 -4.17% 30
South London -19 8 £72,500 +9.85% 2
North London -5 1 £80,000 -20.00% 4
Hadoop
England

For the 6 months to 21 November 2018, IT jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Hadoop.

1 1,157 (70.38%) Big Data
2 1,034 (62.90%) Apache Spark
3 952 (57.91%) Python
4 802 (48.78%) Java
5 668 (40.63%) Agile Software Development
6 666 (40.51%) SQL
7 572 (34.79%) Amazon AWS
8 567 (34.49%) Kafka
9 548 (33.33%) Analytics
10 537 (32.66%) Scala
11 520 (31.63%) Apache Hive
12 515 (31.33%) NoSQL
13 463 (28.16%) Machine Learning
14 440 (26.76%) Data Science
15 399 (24.27%) Finance
16 361 (21.96%) ETL
17 319 (19.40%) Microsoft Azure
18 303 (18.43%) HBase
19 292 (17.76%) DevOps
20 279 (16.97%) Apache Cassandra
21 269 (16.36%) Software Engineering
22 267 (16.24%) Data Modelling
23 255 (15.51%) Data Warehouse
23 255 (15.51%) Degree
24 251 (15.27%) Linux
25 243 (14.78%) Banking
25 243 (14.78%) Cloudera
26 234 (14.23%) Apache
27 231 (14.05%) Business Intelligence
28 221 (13.44%) C#

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,034 (62.90%) Apache Spark
2 234 (14.23%) Apache
3 221 (13.44%) Elasticsearch
4 150 (9.12%) Apache Pig
5 73 (4.44%) SAS
6 69 (4.20%) Apache Solr
7 21 (1.28%) Confluence
8 20 (1.22%) Tomcat
9 15 (0.91%) Apache Airflow
10 14 (0.85%) MS Exchange
11 10 (0.61%) OpenStack
12 9 (0.55%) GlassFish
13 8 (0.49%) IIS
13 8 (0.49%) nginx
13 8 (0.49%) SharePoint
14 7 (0.43%) Oracle SOA Suite
15 6 (0.36%) WebSphere
16 5 (0.30%) Jetty
16 5 (0.30%) SharePoint 2010
16 5 (0.30%) SharePoint 2013
Applications
1 28 (1.70%) SPSS
2 14 (0.85%) Microsoft Excel
3 12 (0.73%) Chatbot
4 11 (0.67%) Microsoft Office
5 10 (0.61%) MS Visio
6 8 (0.49%) Stata
7 3 (0.18%) GNU Octave
7 3 (0.18%) Microsoft PowerPoint
8 1 (0.061%) CPLEX
8 1 (0.061%) Microsoft Project
Business Applications
1 13 (0.79%) Dynamics AX
1 13 (0.79%) Dynamics CRM
1 13 (0.79%) Dynamics NAV
2 2 (0.12%) Actimize
2 2 (0.12%) SAP ERP
2 2 (0.12%) SAP InfiniteInsight
3 1 (0.061%) Magento
3 1 (0.061%) Oracle EBS
Cloud Services
1 572 (34.79%) Amazon AWS
2 319 (19.40%) Microsoft Azure
3 169 (10.28%) Google Cloud Platform
4 84 (5.11%) Amazon EMR
5 53 (3.22%) Cloud Computing
6 46 (2.80%) Serverless
7 42 (2.55%) Amazon S3
8 37 (2.25%) Amazon EC2
8 37 (2.25%) Amazon Kinesis
9 36 (2.19%) AWS Lambda
10 31 (1.89%) SaaS
11 29 (1.76%) GitHub
12 26 (1.58%) PaaS
13 22 (1.34%) AWS CloudFormation
13 22 (1.34%) Cortana Intelligence Suite
14 20 (1.22%) Azure Data Factory
15 17 (1.03%) Amazon SageMaker
16 15 (0.91%) IaaS
17 14 (0.85%) Azure Functions
17 14 (0.85%) Office 365
Communications & Networking
1 36 (2.19%) Internet
2 19 (1.16%) HTTP
3 18 (1.09%) SAN
4 17 (1.03%) Firewall
5 14 (0.85%) TCP/IP
6 12 (0.73%) LAN
6 12 (0.73%) WAN
7 11 (0.67%) Kerberos
7 11 (0.67%) SSL
8 10 (0.61%) Sourcefire
9 9 (0.55%) DNS
10 6 (0.36%) FIX Connectivity
10 6 (0.36%) VPN
11 5 (0.30%) NAS
12 4 (0.24%) Network Security
12 4 (0.24%) PABX
12 4 (0.24%) VoIP
13 2 (0.12%) DSL
13 2 (0.12%) HTTPS
13 2 (0.12%) SMPP
Database & Business Intelligence
1 1,157 (70.38%) Big Data
2 520 (31.63%) Apache Hive
3 515 (31.33%) NoSQL
4 303 (18.43%) HBase
5 279 (16.97%) Apache Cassandra
6 255 (15.51%) Data Warehouse
7 216 (13.14%) SQL Server
8 199 (12.10%) MongoDB
9 159 (9.67%) Impala
10 157 (9.55%) Amazon Redshift
11 153 (9.31%) Relational Database
12 135 (8.21%) Data Lake
13 131 (7.97%) MySQL
14 111 (6.75%) SQL Server Reporting Services
15 109 (6.63%) Flink
16 101 (6.14%) SQL Server Integration Services
17 96 (5.84%) Power BI
18 82 (4.99%) QlikView
19 79 (4.81%) PostgreSQL
20 71 (4.32%) RDBMS
Development Applications
1 131 (7.97%) Jenkins
2 130 (7.91%) Git (software)
3 58 (3.53%) JIRA
4 51 (3.10%) JUnit
5 37 (2.25%) Maven
6 36 (2.19%) Visual Studio
7 35 (2.13%) Selenium
8 27 (1.64%) Atlassian Bamboo
9 26 (1.58%) TeamCity
10 20 (1.22%) Cucumber
11 18 (1.09%) Visual Studio Team System
12 17 (1.03%) Vagrant
13 16 (0.97%) Gradle
14 15 (0.91%) RStudio
15 14 (0.85%) EasyMock
15 14 (0.85%) Octopus Deploy
16 13 (0.79%) Mockito
16 13 (0.79%) SQL Server Management Studio (SSMS)
17 11 (0.67%) Bitbucket
17 11 (0.67%) TestNG
General
1 399 (24.27%) Finance
2 243 (14.78%) Banking
3 118 (7.18%) Investment Banking
4 91 (5.54%) Marketing
5 87 (5.29%) Games
6 86 (5.23%) Law
7 83 (5.05%) Retail
8 71 (4.32%) Telecoms
9 54 (3.28%) Front Office
10 52 (3.16%) Military
11 40 (2.43%) Advertising
12 30 (1.82%) Automotive
13 25 (1.52%) Corporate Banking
14 21 (1.28%) Financial Institution
15 18 (1.09%) Manufacturing
16 16 (0.97%) Pharmaceutical
17 12 (0.73%) Electronics
17 12 (0.73%) Retail Banking
18 8 (0.49%) Billing
19 6 (0.36%) Music Industry
Job Titles
1 434 (26.40%) Data Engineer
2 407 (24.76%) Developer
3 263 (16.00%) Big Data Engineer
4 230 (13.99%) Architect
5 160 (9.73%) Data Architect
6 156 (9.49%) Data Scientist
7 131 (7.97%) Java Developer
8 104 (6.33%) Big Data Developer
9 88 (5.35%) Hadoop Engineer
10 84 (5.11%) Analyst
11 81 (4.93%) Consultant
12 75 (4.56%) Senior Data Scientist
13 70 (4.26%) Big Data Architect
14 66 (4.01%) Software Engineer
15 61 (3.71%) Senior Data Engineer
16 57 (3.47%) Senior Developer
17 56 (3.41%) Python Engineer
18 55 (3.35%) Scala Developer
18 55 (3.35%) Solutions Architect
19 54 (3.28%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 567 (34.49%) Kafka
2 134 (8.15%) .NET
3 123 (7.48%) Web Services
4 112 (6.81%) RESTful
5 111 (6.75%) Node.js
6 102 (6.20%) Spring
7 85 (5.17%) Natural Language Processing
8 82 (4.99%) AngularJS
9 81 (4.93%) HTML
10 75 (4.56%) TensorFlow
11 72 (4.38%) REST
12 65 (3.95%) Spark Streaming
13 64 (3.89%) PySpark
13 64 (3.89%) scikit-learn
14 62 (3.77%) React
15 59 (3.59%) RabbitMQ
16 50 (3.04%) Hibernate
16 50 (3.04%) Pandas
17 47 (2.86%) HTML5
18 44 (2.68%) JSON
Miscellaneous
1 220 (13.38%) Analytical Skills
2 218 (13.26%) Computer Science
3 167 (10.16%) Algorithms
4 116 (7.06%) Fintech
5 89 (5.41%) Data Structures
6 71 (4.32%) Greenfield Project
7 52 (3.16%) Management Information System
7 52 (3.16%) Self-Motivation
8 45 (2.74%) User Experience
9 40 (2.43%) Equities
10 34 (2.07%) Robotics
10 34 (2.07%) Tandem
11 30 (1.82%) Derivative
12 29 (1.76%) Virtual Team
13 27 (1.64%) Credit Risk
13 27 (1.64%) Market Risk
14 23 (1.40%) Hedge funds
14 23 (1.40%) Public Cloud
15 19 (1.16%) Cyberthreat
15 19 (1.16%) Life Science
Operating Systems
1 251 (15.27%) Linux
2 144 (8.76%) Unix
3 60 (3.65%) Windows
4 28 (1.70%) Android
5 20 (1.22%) Apple iOS
5 20 (1.22%) Windows Server
6 9 (0.55%) Red Hat Enterprise Linux
7 8 (0.49%) Mac OS X
8 4 (0.24%) HPUX
8 4 (0.24%) Solaris
8 4 (0.24%) zOS
9 3 (0.18%) CentOS
9 3 (0.18%) CoreOS
10 2 (0.12%) DC/OS
10 2 (0.12%) Ubuntu
10 2 (0.12%) Windows 7
10 2 (0.12%) Windows 8
11 1 (0.061%) AIX
11 1 (0.061%) Debian
11 1 (0.061%) Mesosphere
Processes & Methodologies
1 668 (40.63%) Agile Software Development
2 548 (33.33%) Analytics
3 463 (28.16%) Machine Learning
4 440 (26.76%) Data Science
5 361 (21.96%) ETL
6 292 (17.76%) DevOps
7 269 (16.36%) Software Engineering
8 267 (16.24%) Data Modelling
9 231 (14.05%) Business Intelligence
10 217 (13.20%) Artificial Intelligence
11 209 (12.71%) Problem-Solving
12 197 (11.98%) Data Analytics
13 195 (11.86%) Visualisation
14 190 (11.56%) Scrum
15 173 (10.52%) Open Source
16 149 (9.06%) TDD
17 144 (8.76%) Data Engineering
18 132 (8.03%) Data Analysis
18 132 (8.03%) Microservices
19 130 (7.91%) MapReduce
Programming Languages
1 952 (57.91%) Python
2 802 (48.78%) Java
3 666 (40.51%) SQL
4 537 (32.66%) Scala
5 221 (13.44%) C#
6 219 (13.32%) JavaScript
7 206 (12.53%) R
8 102 (6.20%) C++
9 97 (5.90%) Java 8
10 82 (4.99%) Bash Shell
11 63 (3.83%) PowerShell
12 60 (3.65%) C
13 57 (3.47%) PHP
14 48 (2.92%) Ruby
15 47 (2.86%) Perl
15 47 (2.86%) T-SQL
16 44 (2.68%) Shell Script
17 34 (2.07%) BeanShell
18 33 (2.01%) PL/SQL
19 31 (1.89%) Go
Qualifications
1 255 (15.51%) Degree
2 96 (5.84%) Computer Science Degree
3 65 (3.95%) Security Cleared
4 56 (3.41%) PhD
5 42 (2.55%) DV Cleared
6 41 (2.49%) Master's Degree
7 30 (1.82%) Numerate Degree
8 21 (1.28%) CISSP
9 13 (0.79%) AWS Certification
9 13 (0.79%) SC Cleared
10 12 (0.73%) MCSE
10 12 (0.73%) Microsoft Certification
11 10 (0.61%) CEH
11 10 (0.61%) GCIH
11 10 (0.61%) OSCP
12 9 (0.55%) GIAC
12 9 (0.55%) Linux+ Certification
12 9 (0.55%) Network+ Certification
12 9 (0.55%) SANS
12 9 (0.55%) SSCP
Quality Assurance & Compliance
1 69 (4.20%) QA
2 67 (4.08%) Data Quality
3 21 (1.28%) GDPR
4 18 (1.09%) MiFID
5 16 (0.97%) PMO
6 4 (0.24%) GxP
6 4 (0.24%) PCI DSS
6 4 (0.24%) SLA
7 3 (0.18%) COBIT
7 3 (0.18%) GPG13
7 3 (0.18%) IFRS
7 3 (0.18%) ISO/IEC 27001
7 3 (0.18%) Solvency II
8 2 (0.12%) Actionable Recommendations
9 1 (0.061%) EMIR
System Software
1 201 (12.23%) Docker
2 192 (11.68%) HDFS
3 116 (7.06%) Apache Flume
4 46 (2.80%) Apache ZooKeeper
5 31 (1.89%) Active Directory
6 17 (1.03%) VirtualBox
7 12 (0.73%) VMware Infrastructure
8 10 (0.61%) Snort
9 8 (0.49%) Virtual Machines
9 8 (0.49%) vSphere
10 7 (0.43%) Oracle RAC
11 6 (0.36%) Hyper-V
12 4 (0.24%) Xen
13 3 (0.18%) KVM
14 2 (0.12%) NFS
14 2 (0.12%) Virtual Servers
15 1 (0.061%) GridGain
15 1 (0.061%) SRDF
Systems Management
1 126 (7.66%) Oozie
2 97 (5.90%) Kubernetes
3 89 (5.41%) Hadoop YARN
4 86 (5.23%) Ansible
5 79 (4.81%) Terraform
6 69 (4.20%) Puppet
7 60 (3.65%) Opscode Chef
8 49 (2.98%) Kibana
9 42 (2.55%) Mesos
10 36 (2.19%) Prometheus
11 35 (2.13%) logstash
12 25 (1.52%) Grafana
13 18 (1.09%) Salt
14 17 (1.03%) Docker Swarm
15 15 (0.91%) Ambari
16 13 (0.79%) ITRS Geneos
17 11 (0.67%) Nagios
18 10 (0.61%) Suricata
19 5 (0.30%) QRadar
19 5 (0.30%) ZABBIX
Vendors
1 243 (14.78%) Cloudera
2 217 (13.20%) Tableau
3 200 (12.17%) Hortonworks
4 182 (11.07%) Oracle
5 181 (11.01%) Microsoft
6 172 (10.46%) Google
7 113 (6.87%) MapR
8 82 (4.99%) Informatica
9 81 (4.93%) Databricks
10 72 (4.38%) Talend
11 61 (3.71%) IBM
12 56 (3.41%) SAP
13 55 (3.35%) Splunk
14 38 (2.31%) WorldPay
15 34 (2.07%) ServiceNow
16 28 (1.70%) TIBCO
17 22 (1.34%) HP
17 22 (1.34%) Vertica
18 21 (1.28%) Sybase
19 18 (1.09%) Apple