Period
to 25 May 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 25 May 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
25 May 2018
Same period 2017 Same period 2016
Rank 86 78 124
Rank change year-on-year -8 +46 +40
Contract jobs citing Hadoop 1,305 1,263 889
As % of all contract IT jobs advertised in London 2.84% 3.20% 2.05%
As % of the Database & Business Intelligence category 11.38% 13.13% 8.70%
Number of daily rates quoted 990 890 655
London median daily rate £550 £550 £550
10th Percentile £425 £405 £400
90th Percentile £700 £688 £700
England median daily rate £550 £525 £550
% change year-on-year +4.76% -4.55% -
Number of hourly rates quoted 3 0 0
London median hourly rate £82.50 - -
England median hourly rate £47.50 £47.00 £38.00
% change year-on-year +1.06% +23.68% +46.15%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,472 9,616 10,216
As % of all contract IT jobs advertised in London 24.97% 24.34% 23.55%
Number of daily rates quoted 8,626 6,969 7,402
London median daily rate £513 £493 £475
Median daily rate % change year-on-year +4.06% +3.68% +5.56%
10th Percentile £356 £325 £313
90th Percentile £663 £650 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 77 41 64
London median hourly rate £30.00 £31.00 £27.50
Median hourly rate % change year-on-year -3.23% +12.73% -8.33%
10th Percentile £20.25 £18.50 £16.32
90th Percentile £46.30 £47.00 £100.00
England median hourly rate £32.25 £30.00 £28.25
% change year-on-year +7.50% +6.19% +2.73%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 25 May 2018.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Hadoop in London over the 6 months to 25 May 2018.

Contractor hourly rate histogram for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 25 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -7 252 £563 +1.12% 64
South London +4 83 £550 +15.79%
East London +14 51 £550 -6.38% 17
West London -52 19 £538 +13.16% 26
North London +6 5 £303 -39.50% 1
Hadoop
England

For the 6 months to 25 May 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 910 (69.73%) Big Data
2 695 (53.26%) Apache Spark
3 565 (43.30%) Python
4 497 (38.08%) Java
5 467 (35.79%) SQL
6 464 (35.56%) Agile Software Development
7 447 (34.25%) Apache Hive
8 438 (33.56%) Kafka
9 398 (30.50%) Analytics
10 378 (28.97%) Amazon AWS
11 372 (28.51%) Scala
12 350 (26.82%) Finance
13 288 (22.07%) Data Science
13 288 (22.07%) HBase
14 268 (20.54%) DevOps
15 264 (20.23%) NoSQL
16 262 (20.08%) Linux
17 234 (17.93%) ETL
18 229 (17.55%) Data Warehouse
19 227 (17.39%) Machine Learning
20 221 (16.93%) Docker
21 205 (15.71%) MongoDB
22 198 (15.17%) Data Modelling
23 197 (15.10%) HDFS
24 177 (13.56%) Microsoft Azure
24 177 (13.56%) Apache
25 175 (13.41%) Jenkins
26 172 (13.18%) Cloudera
27 169 (12.95%) Business Intelligence
28 164 (12.57%) Banking

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 695 (53.26%) Apache Spark
2 177 (13.56%) Apache
3 135 (10.34%) Elasticsearch
4 110 (8.43%) Apache Pig
5 61 (4.67%) Confluence
5 61 (4.67%) Tomcat
6 60 (4.60%) Apache Solr
7 52 (3.98%) nginx
8 50 (3.83%) SAS
9 27 (2.07%) JBoss
10 20 (1.53%) Jupyter
11 15 (1.15%) WebLogic
12 12 (0.92%) Jetty
12 12 (0.92%) SharePoint
13 11 (0.84%) OpenStack
14 10 (0.77%) Gunicorn
15 8 (0.61%) Oracle Coherence
16 6 (0.46%) Mule
17 5 (0.38%) Mule ESB
18 4 (0.31%) Apache Airflow
Applications
1 21 (1.61%) Microsoft Excel
2 9 (0.69%) MS Visio
3 5 (0.38%) Chatbot
3 5 (0.38%) SPSS
4 4 (0.31%) HipChat
5 3 (0.23%) Microsoft Office
5 3 (0.23%) Stata
6 2 (0.15%) Microsoft PowerPoint
7 1 (0.077%) Shockwave
Business Applications
1 17 (1.30%) SAP Oil and Gas
2 7 (0.54%) ION MarketView
3 4 (0.31%) Summit
4 1 (0.077%) Actimize
4 1 (0.077%) Dynamics CRM
4 1 (0.077%) Finacle
4 1 (0.077%) FLEXCUBE
4 1 (0.077%) Oracle BPM
4 1 (0.077%) Revive Adserver
Cloud Services
1 378 (28.97%) Amazon AWS
2 177 (13.56%) Microsoft Azure
3 70 (5.36%) Amazon S3
4 49 (3.75%) Serverless
5 48 (3.68%) Google Cloud Platform
6 41 (3.14%) Amazon EMR
7 40 (3.07%) AWS Lambda
8 36 (2.76%) Amazon Kinesis
9 28 (2.15%) Amazon EC2
10 19 (1.46%) GitHub
10 19 (1.46%) PaaS
11 17 (1.30%) Azure Data Factory
12 16 (1.23%) Google Analytics
13 15 (1.15%) SaaS
14 13 (1.00%) Virtual Private Cloud
15 12 (0.92%) Amazon CloudWatch
16 10 (0.77%) Data Lake Analytics
16 10 (0.77%) Route 53
17 9 (0.69%) Cloud Computing
18 8 (0.61%) AWS CloudFormation
Communications & Networking
1 66 (5.06%) Kerberos
2 33 (2.53%) SSL
3 22 (1.69%) Internet
3 22 (1.69%) VPN
4 20 (1.53%) DNS
5 13 (1.00%) HTTP
6 11 (0.84%) Firewall
6 11 (0.84%) TCP/IP
7 10 (0.77%) OpenLDAP
8 8 (0.61%) ICMP
9 7 (0.54%) WAN
10 6 (0.46%) SMS
11 5 (0.38%) SSH
12 4 (0.31%) Network Security
13 3 (0.23%) iSCSI
13 3 (0.23%) Multicast
13 3 (0.23%) RTMP
14 2 (0.15%) FCoE
14 2 (0.15%) Fibre Channel
14 2 (0.15%) NAS
Database & Business Intelligence
1 910 (69.73%) Big Data
2 447 (34.25%) Apache Hive
3 288 (22.07%) HBase
4 264 (20.23%) NoSQL
5 229 (17.55%) Data Warehouse
6 205 (15.71%) MongoDB
7 161 (12.34%) SQL Server
8 159 (12.18%) PostgreSQL
9 152 (11.65%) Apache Cassandra
10 128 (9.81%) Relational Database
11 125 (9.58%) Data Lake
12 112 (8.58%) MySQL
13 98 (7.51%) Impala
14 85 (6.51%) Amazon Redshift
15 79 (6.05%) Sqoop
16 69 (5.29%) Power BI
17 65 (4.98%) Star Schema
18 64 (4.90%) OLAP
19 57 (4.37%) Enterprise Data Warehouse
20 56 (4.29%) OLAP Cube
Development Applications
1 175 (13.41%) Jenkins
2 147 (11.26%) Git (software)
3 79 (6.05%) JIRA
4 40 (3.07%) Maven
5 35 (2.68%) Subversion
6 34 (2.61%) JUnit
7 30 (2.30%) Artifactory
8 26 (1.99%) Visual Studio Team System
9 23 (1.76%) TeamCity
10 21 (1.61%) Cucumber
10 21 (1.61%) GitLab
10 21 (1.61%) Vagrant
11 18 (1.38%) Team Foundation Server
12 16 (1.23%) Sonatype Nexus
13 15 (1.15%) Mockito
14 14 (1.07%) SonarQube
15 12 (0.92%) Selenium
16 10 (0.77%) SpecFlow
17 9 (0.69%) FishEye
17 9 (0.69%) WebDriver
General
1 350 (26.82%) Finance
2 164 (12.57%) Banking
3 59 (4.52%) Investment Banking
4 53 (4.06%) Retail
5 44 (3.37%) Marketing
6 43 (3.30%) Games
7 32 (2.45%) Front Office
8 19 (1.46%) Telecoms
9 14 (1.07%) Advertising
10 9 (0.69%) Legal
10 9 (0.69%) Manufacturing
11 8 (0.61%) Publishing
12 5 (0.38%) Back Office
12 5 (0.38%) Electronics
12 5 (0.38%) French Language
12 5 (0.38%) Private Banking
13 4 (0.31%) Automotive
13 4 (0.31%) Digital Economy
13 4 (0.31%) Law
13 4 (0.31%) Retail Banking
Job Titles
1 334 (25.59%) Developer
2 314 (24.06%) Data Engineer
3 203 (15.56%) Big Data Engineer
4 177 (13.56%) Architect
5 140 (10.73%) Hadoop Engineer
6 130 (9.96%) Java Developer
7 127 (9.73%) Big Data Developer
8 114 (8.74%) Data Architect
9 107 (8.20%) Consultant
10 81 (6.21%) DevOps Engineer
11 73 (5.59%) Big Data Architect
12 70 (5.36%) Data Scientist
13 69 (5.29%) Analyst
14 66 (5.06%) AWS Engineer
14 66 (5.06%) Senior Developer
15 57 (4.37%) Python Engineer
16 50 (3.83%) Senior Java Developer
17 46 (3.52%) Hadoop Developer
18 44 (3.37%) Scala Developer
19 41 (3.14%) Data Analyst
Libraries, Frameworks & Software Standards
1 438 (33.56%) Kafka
2 86 (6.59%) Web Services
3 83 (6.36%) REST
4 73 (5.59%) JSON
5 61 (4.67%) Hibernate
6 58 (4.44%) Spring
7 56 (4.29%) RESTful
8 52 (3.98%) AngularJS
9 51 (3.91%) XML
10 49 (3.75%) Elastic Stack
11 47 (3.60%) HTML
12 42 (3.22%) Node.js
12 42 (3.22%) TensorFlow
13 37 (2.84%) JMS
13 37 (2.84%) Spark Streaming
14 36 (2.76%) RabbitMQ
15 34 (2.61%) .NET
15 34 (2.61%) HTML5
16 33 (2.53%) ActiveMQ
16 33 (2.53%) PySpark
Miscellaneous
1 131 (10.04%) Analytical Skills
2 115 (8.81%) Algorithms
3 75 (5.75%) Computer Science
4 51 (3.91%) Greenfield Project
5 38 (2.91%) Fintech
6 36 (2.76%) Data Structures
6 36 (2.76%) User Experience
7 29 (2.22%) Data Centre
8 28 (2.15%) Public Cloud
9 22 (1.69%) Self-Motivation
9 22 (1.69%) Virtual Team
10 20 (1.53%) Derivative
11 18 (1.38%) Market Risk
12 13 (1.00%) Grid Computing
12 13 (1.00%) Linux Command Line
12 13 (1.00%) Management Information System
13 12 (0.92%) Enterprise Software
13 12 (0.92%) Mobile App
14 11 (0.84%) HoloLens
14 11 (0.84%) Wiki
Operating Systems
1 262 (20.08%) Linux
2 74 (5.67%) Unix
3 61 (4.67%) Red Hat Enterprise Linux
4 35 (2.68%) Windows
5 26 (1.99%) CentOS
6 23 (1.76%) Ubuntu
7 22 (1.69%) CoreOS
8 11 (0.84%) Windows Server
9 8 (0.61%) Windows Server 2008
10 7 (0.54%) Android
10 7 (0.54%) Apple iOS
11 4 (0.31%) DC/OS
11 4 (0.31%) Debian
12 3 (0.23%) Mac OS X
13 2 (0.15%) Solaris
14 1 (0.077%) Mesosphere
Processes & Methodologies
1 464 (35.56%) Agile Software Development
2 398 (30.50%) Analytics
3 288 (22.07%) Data Science
4 268 (20.54%) DevOps
5 234 (17.93%) ETL
6 227 (17.39%) Machine Learning
7 198 (15.17%) Data Modelling
8 169 (12.95%) Business Intelligence
9 153 (11.72%) Scrum
10 142 (10.88%) TDD
11 127 (9.73%) Open Source
12 125 (9.58%) Microservices
13 122 (9.35%) Continuous Integration
14 117 (8.97%) Visualisation
15 111 (8.51%) MapReduce
16 102 (7.82%) Data Analytics
17 99 (7.59%) Problem-Solving
18 94 (7.20%) Data Engineering
19 83 (6.36%) Data Architecture
20 82 (6.28%) Test Automation
Programming Languages
1 565 (43.30%) Python
2 497 (38.08%) Java
3 467 (35.79%) SQL
4 372 (28.51%) Scala
5 118 (9.04%) R
6 115 (8.81%) JavaScript
7 101 (7.74%) Bash Shell
8 91 (6.97%) Java 8
9 56 (4.29%) Groovy
10 46 (3.52%) Shell Script
11 43 (3.30%) Perl
12 42 (3.22%) C#
13 39 (2.99%) Ruby
14 30 (2.30%) C++
15 24 (1.84%) Go
16 23 (1.76%) C
17 21 (1.61%) MATLAB
18 20 (1.53%) PowerShell
19 19 (1.46%) T-SQL
20 11 (0.84%) PL/SQL
Qualifications
1 138 (10.57%) Security Cleared
2 106 (8.12%) SC Cleared
3 75 (5.75%) Degree
4 28 (2.15%) Master's Degree
5 20 (1.53%) DV Cleared
6 19 (1.46%) PhD
7 16 (1.23%) Computer Science Degree
8 15 (1.15%) Numerate Degree
9 8 (0.61%) CHECK Team Member
10 4 (0.31%) TOGAF Certification
11 3 (0.23%) CTC Cleared
12 2 (0.15%) CIPD
12 2 (0.15%) Microsoft Certification
12 2 (0.15%) PMI Certification
12 2 (0.15%) PMP
12 2 (0.15%) PRINCE2 Certification
13 1 (0.077%) ACCA
13 1 (0.077%) IIBA
13 1 (0.077%) MBA
13 1 (0.077%) MCSD
Quality Assurance & Compliance
1 98 (7.51%) Data Quality
2 37 (2.84%) QA
3 19 (1.46%) GDPR
4 9 (0.69%) MiFID
5 8 (0.61%) GCP
6 6 (0.46%) EMIR
7 5 (0.38%) Dodd-Frank
8 4 (0.31%) SLA
9 2 (0.15%) GAAP
10 1 (0.077%) Basel III
10 1 (0.077%) Disclosure Scotland
10 1 (0.077%) HL7
10 1 (0.077%) PMO
10 1 (0.077%) Sarbanes-Oxley
10 1 (0.077%) Solvency II
System Software
1 221 (16.93%) Docker
2 197 (15.10%) HDFS
3 108 (8.28%) Apache Flume
4 74 (5.67%) Apache ZooKeeper
5 26 (1.99%) Active Directory
6 12 (0.92%) VMware Infrastructure
7 6 (0.46%) NFS
7 6 (0.46%) Squid
8 5 (0.38%) Ceph
9 4 (0.31%) Lustre
9 4 (0.31%) vCloud
10 3 (0.23%) KVM
10 3 (0.23%) OpenDJ
10 3 (0.23%) OpenIDM
10 3 (0.23%) Xen
11 2 (0.15%) Hyper-V
11 2 (0.15%) Oracle RAC
11 2 (0.15%) SRDF
11 2 (0.15%) VMware ESXi
12 1 (0.077%) Postfix
Systems Management
1 163 (12.49%) Oozie
2 157 (12.03%) Ansible
3 119 (9.12%) Kubernetes
4 110 (8.43%) Hadoop YARN
5 108 (8.28%) Terraform
6 94 (7.20%) Puppet
7 67 (5.13%) Opscode Chef
8 35 (2.68%) Ambari
9 33 (2.53%) Kibana
10 28 (2.15%) Mesos
11 23 (1.76%) Prometheus
12 22 (1.69%) Salt
13 20 (1.53%) Consul
13 20 (1.53%) logstash
14 18 (1.38%) Apache Slider
15 17 (1.30%) Host Intrusion Detection System
15 17 (1.30%) Network Intrusion Detection System
15 17 (1.30%) Sysdig
16 16 (1.23%) HAProxy
17 15 (1.15%) Packer
Vendors
1 172 (13.18%) Cloudera
2 138 (10.57%) Hortonworks
3 123 (9.43%) Oracle
4 107 (8.20%) Microsoft
5 84 (6.44%) Tableau
6 74 (5.67%) Google
7 56 (4.29%) SAP
8 51 (3.91%) Splunk
9 50 (3.83%) MapR
10 39 (2.99%) Alteryx
10 39 (2.99%) Talend
11 38 (2.91%) Informatica
12 35 (2.68%) IBM
12 35 (2.68%) Teradata
13 24 (1.84%) SaltStack
14 23 (1.76%) Red Hat
15 21 (1.61%) Salesforce.com
16 20 (1.53%) Ab Initio
17 17 (1.30%) VMware
18 15 (1.15%) AppDynamics