Period
to 20 February 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 20 February 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
20 Feb 2018
Same period 2017 Same period 2016
Rank 86 65 128
Rank change year-on-year -21 +63 +38
Contract jobs citing Hadoop 1,256 1,480 865
As % of all contract IT jobs advertised in London 2.68% 3.61% 1.96%
As % of the Database & Business Intelligence category 11.38% 15.01% 8.22%
Number of daily rates quoted 947 1,001 617
London median daily rate £550 £550 £550
10th Percentile £425 £413 £375
90th Percentile £701 £713 £675
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -
Number of hourly rates quoted 1 1 1
London median hourly rate £82.50 £100.00 £37.50
Median hourly rate % change year-on-year -17.50% +166.67% -
10th Percentile £73.75 £90.00 £36.25
90th Percentile £91.25 £110.00 £38.75
England median hourly rate £37.50 £47.00 £37.50
% change year-on-year -20.21% +25.33% +2.74%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,033 9,862 10,519
As % of all contract IT jobs advertised in London 23.51% 24.04% 23.85%
Number of daily rates quoted 8,385 7,021 7,593
London median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +5.88%
10th Percentile £356 £325 £313
90th Percentile £660 £650 £635
England median daily rate £475 £438 £425
% change year-on-year +8.57% +2.94% +6.25%
Number of hourly rates quoted 64 45 61
London median hourly rate £27.50 £32.50 £26.00
Median hourly rate % change year-on-year -15.38% +25.00% -7.96%
10th Percentile £17.32 £15.25 £16.00
90th Percentile £43.74 £58.50 £100.00
England median hourly rate £35.00 £25.95 £27.12
% change year-on-year +34.90% -4.33% -1.38%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 20 February 2018.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 20 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -48 210 £575 -2.13% 70
South London +8 126 £550 +15.18% 5
East London -9 21 £600 +4.35% 13
West London -50 10 £506 +1.25% 39
North London - 3 £288 - 2
Hadoop
England

For the 6 months to 20 February 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 842 (67.04%) Big Data
2 669 (53.26%) Apache Spark
3 566 (45.06%) Java
4 517 (41.16%) Python
5 450 (35.83%) Agile Software Development
6 380 (30.25%) SQL
7 351 (27.95%) Kafka
8 350 (27.87%) Apache Hive
9 338 (26.91%) Scala
10 337 (26.83%) Amazon AWS
11 296 (23.57%) HBase
12 283 (22.53%) Finance
13 281 (22.37%) DevOps
14 275 (21.89%) Analytics
14 275 (21.89%) Linux
15 265 (21.10%) NoSQL
16 232 (18.47%) HDFS
17 225 (17.91%) Data Science
18 224 (17.83%) Docker
19 217 (17.28%) TDD
20 209 (16.64%) MongoDB
21 192 (15.29%) Ansible
22 189 (15.05%) Jenkins
22 189 (15.05%) Apache
23 180 (14.33%) Scrum
24 178 (14.17%) Machine Learning
25 177 (14.09%) ETL
26 172 (13.69%) Banking
27 168 (13.38%) Security Cleared
28 164 (13.06%) Data Warehouse

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 669 (53.26%) Apache Spark
2 189 (15.05%) Apache
3 96 (7.64%) Elasticsearch
4 87 (6.93%) Apache Pig
5 82 (6.53%) Confluence
5 82 (6.53%) Tomcat
6 58 (4.62%) Apache Solr
7 50 (3.98%) SAS
8 46 (3.66%) JBoss
9 35 (2.79%) Jetty
10 33 (2.63%) nginx
11 22 (1.75%) Jupyter
12 15 (1.19%) Oracle Coherence
13 11 (0.88%) SharePoint
13 11 (0.88%) WebLogic
14 10 (0.80%) OpenStack
15 8 (0.64%) Apache Airflow
15 8 (0.64%) Oracle SOA Suite
16 7 (0.56%) IIS
16 7 (0.56%) Mule
Applications
1 15 (1.19%) SPSS
2 7 (0.56%) Microsoft Excel
3 3 (0.24%) HipChat
4 2 (0.16%) Microsoft Office
4 2 (0.16%) Microsoft PowerPoint
4 2 (0.16%) MS Visio
5 1 (0.080%) Chatbot
5 1 (0.080%) Gephi
5 1 (0.080%) Stata
Business Applications
1 8 (0.64%) Oracle BPM
2 7 (0.56%) SAP Oil and Gas
3 2 (0.16%) Dynamics CRM
3 2 (0.16%) Summit
4 1 (0.080%) Revive Adserver
4 1 (0.080%) SAP HR
Cloud Services
1 337 (26.83%) Amazon AWS
2 124 (9.87%) Microsoft Azure
3 50 (3.98%) Amazon S3
4 47 (3.74%) Google Cloud Platform
5 38 (3.03%) GitHub
6 28 (2.23%) Amazon EMR
7 27 (2.15%) Serverless
8 26 (2.07%) Amazon EC2
8 26 (2.07%) AWS Lambda
9 24 (1.91%) Amazon Kinesis
9 24 (1.91%) SaaS
10 16 (1.27%) AWS CloudFormation
10 16 (1.27%) Bluemix
10 16 (1.27%) IBM Cloud
11 15 (1.19%) PaaS
12 14 (1.11%) IaaS
13 13 (1.04%) Amazon CloudWatch
14 12 (0.96%) Virtual Private Cloud
15 9 (0.72%) Azure Data Factory
15 9 (0.72%) OpenShift
Communications & Networking
1 97 (7.72%) Kerberos
2 32 (2.55%) SSL
3 20 (1.59%) Internet
3 20 (1.59%) Network Security
4 14 (1.11%) DNS
5 12 (0.96%) OpenLDAP
6 11 (0.88%) TCP/IP
7 10 (0.80%) HTTP
7 10 (0.80%) VPN
8 8 (0.64%) Firewall
9 7 (0.56%) ICMP
10 5 (0.40%) DMZ
11 2 (0.16%) Multicast
11 2 (0.16%) SMS
11 2 (0.16%) SSH
12 1 (0.080%) AMQP
12 1 (0.080%) DSL
12 1 (0.080%) iSCSI
12 1 (0.080%) OpenVPN
12 1 (0.080%) WAN
Database & Business Intelligence
1 842 (67.04%) Big Data
2 350 (27.87%) Apache Hive
3 296 (23.57%) HBase
4 265 (21.10%) NoSQL
5 209 (16.64%) MongoDB
6 164 (13.06%) Data Warehouse
7 157 (12.50%) PostgreSQL
8 145 (11.54%) Apache Cassandra
9 108 (8.60%) SQL Server
10 100 (7.96%) Relational Database
11 96 (7.64%) Data Lake
12 88 (7.01%) MySQL
13 67 (5.33%) Impala
14 65 (5.18%) Sqoop
15 50 (3.98%) RDBMS
16 45 (3.58%) Amazon Redshift
17 35 (2.79%) Power BI
18 31 (2.47%) Mahout
19 30 (2.39%) Redis
20 29 (2.31%) Oracle Database
Development Applications
1 189 (15.05%) Jenkins
2 128 (10.19%) Git (software)
3 106 (8.44%) JIRA
4 36 (2.87%) Maven
5 33 (2.63%) Artifactory
6 32 (2.55%) JUnit
7 28 (2.23%) Cucumber
8 24 (1.91%) Subversion
9 22 (1.75%) IntelliJ
10 21 (1.67%) Vagrant
11 19 (1.51%) GitLab
11 19 (1.51%) Sonatype Nexus
12 18 (1.43%) TeamCity
13 16 (1.27%) Mockito
14 12 (0.96%) SonarQube
15 11 (0.88%) Team Foundation Server
15 11 (0.88%) Visual Studio
15 11 (0.88%) Visual Studio Team System
16 10 (0.80%) ERwin
17 9 (0.72%) WebDriver
General
1 283 (22.53%) Finance
2 172 (13.69%) Banking
3 64 (5.10%) Investment Banking
4 59 (4.70%) Retail
5 58 (4.62%) Marketing
6 31 (2.47%) Front Office
7 29 (2.31%) Games
8 25 (1.99%) Telecoms
9 22 (1.75%) Publishing
10 15 (1.19%) Manufacturing
11 12 (0.96%) Legal
12 11 (0.88%) Advertising
13 10 (0.80%) Electronics
14 7 (0.56%) Retail Banking
15 5 (0.40%) Financial Institution
15 5 (0.40%) French Language
15 5 (0.40%) Law
15 5 (0.40%) Pharmaceutical
16 4 (0.32%) Digital Economy
17 3 (0.24%) Automotive
Job Titles
1 374 (29.78%) Developer
2 236 (18.79%) Data Engineer
3 167 (13.30%) Architect
4 162 (12.90%) Big Data Engineer
4 162 (12.90%) Java Developer
5 146 (11.62%) Big Data Developer
6 115 (9.16%) Data Architect
7 103 (8.20%) DevOps Engineer
8 99 (7.88%) Hadoop Engineer
9 92 (7.32%) Consultant
10 88 (7.01%) Data Scientist
11 73 (5.81%) Senior Developer
12 71 (5.65%) Big Data Architect
13 61 (4.86%) Analyst
13 61 (4.86%) AWS Engineer
14 56 (4.46%) Hadoop Developer
15 52 (4.14%) Scala Developer
16 47 (3.74%) Senior Java Developer
17 45 (3.58%) AWS DevOps
18 40 (3.18%) AWS DevOps Engineer
Libraries, Frameworks & Software Standards
1 351 (27.95%) Kafka
2 128 (10.19%) Spring
3 92 (7.32%) Web Services
4 91 (7.25%) REST
5 84 (6.69%) Hibernate
6 72 (5.73%) RESTful
7 64 (5.10%) AngularJS
8 63 (5.02%) PySpark
9 54 (4.30%) ActiveMQ
9 54 (4.30%) Elastic Stack
10 48 (3.82%) Spring Boot
11 46 (3.66%) JSON
12 40 (3.18%) .NET
12 40 (3.18%) Akka
13 38 (3.03%) JMS
14 37 (2.95%) TensorFlow
15 34 (2.71%) HTML
15 34 (2.71%) Natural Language Processing
16 32 (2.55%) scikit-learn
16 32 (2.55%) Spark Streaming
Miscellaneous
1 102 (8.12%) Algorithms
2 100 (7.96%) Analytical Skills
3 82 (6.53%) Computer Science
3 82 (6.53%) Greenfield Project
4 29 (2.31%) Data Centre
5 28 (2.23%) Fintech
6 24 (1.91%) Market Risk
7 23 (1.83%) Management Information System
8 21 (1.67%) Data Structures
9 19 (1.51%) User Experience
9 19 (1.51%) Virtual Team
10 18 (1.43%) Public Cloud
11 16 (1.27%) Derivative
11 16 (1.27%) Foreign Exchange (FX)
12 14 (1.11%) Replication
13 13 (1.04%) Equities
14 12 (0.96%) Credit Risk
14 12 (0.96%) Digital Media
15 10 (0.80%) Grid Computing
16 9 (0.72%) Linked Data
Operating Systems
1 275 (21.89%) Linux
2 74 (5.89%) Unix
3 65 (5.18%) Red Hat Enterprise Linux
4 41 (3.26%) Windows
5 27 (2.15%) CentOS
6 18 (1.43%) Ubuntu
7 13 (1.04%) CoreOS
8 8 (0.64%) Windows Server
9 5 (0.40%) Windows Server 2012
10 3 (0.24%) Android
10 3 (0.24%) Apple iOS
10 3 (0.24%) DC/OS
10 3 (0.24%) VMS
10 3 (0.24%) Windows Server 2008
11 1 (0.080%) Debian
11 1 (0.080%) Mesosphere
Processes & Methodologies
1 450 (35.83%) Agile Software Development
2 281 (22.37%) DevOps
3 275 (21.89%) Analytics
4 225 (17.91%) Data Science
5 217 (17.28%) TDD
6 180 (14.33%) Scrum
7 178 (14.17%) Machine Learning
8 177 (14.09%) ETL
9 142 (11.31%) Business Intelligence
10 138 (10.99%) MapReduce
10 138 (10.99%) Open Source
11 132 (10.51%) Continuous Integration
12 119 (9.47%) BDD
13 118 (9.39%) Microservices
14 115 (9.16%) Data Modelling
15 92 (7.32%) Data Analytics
15 92 (7.32%) Software Engineering
16 91 (7.25%) Data Architecture
17 88 (7.01%) Visualisation
18 87 (6.93%) Data Engineering
Programming Languages
1 566 (45.06%) Java
2 517 (41.16%) Python
3 380 (30.25%) SQL
4 338 (26.91%) Scala
5 117 (9.32%) R
6 109 (8.68%) JavaScript
7 85 (6.77%) Bash Shell
8 55 (4.38%) Shell Script
9 47 (3.74%) C#
10 42 (3.34%) Groovy
11 35 (2.79%) Ruby
12 31 (2.47%) Go
13 27 (2.15%) Perl
14 23 (1.83%) C++
14 23 (1.83%) PowerShell
15 22 (1.75%) C
15 22 (1.75%) MATLAB
16 21 (1.67%) PL/SQL
17 18 (1.43%) T-SQL
18 9 (0.72%) SPARQL
Qualifications
1 168 (13.38%) Security Cleared
2 135 (10.75%) SC Cleared
3 88 (7.01%) Degree
4 30 (2.39%) Master's Degree
5 23 (1.83%) PhD
6 19 (1.51%) Computer Science Degree
7 16 (1.27%) DV Cleared
8 15 (1.19%) Numerate Degree
9 3 (0.24%) CTC Cleared
10 2 (0.16%) DBS Check
10 2 (0.16%) Microsoft Certification
11 1 (0.080%) ACCA
11 1 (0.080%) CISSP
11 1 (0.080%) GCIA
11 1 (0.080%) GCIH
11 1 (0.080%) MCPD
11 1 (0.080%) MCSD
11 1 (0.080%) PMI Certification
11 1 (0.080%) PMP
11 1 (0.080%) PRINCE2 Certification
Quality Assurance & Compliance
1 37 (2.95%) Data Quality
2 34 (2.71%) QA
3 17 (1.35%) GDPR
4 11 (0.88%) MiFID
5 7 (0.56%) GCP
6 5 (0.40%) EMIR
7 4 (0.32%) Dodd-Frank
8 3 (0.24%) IFRS
8 3 (0.24%) IFRS 9
9 2 (0.16%) Disclosure Scotland
9 2 (0.16%) GAAP
9 2 (0.16%) SLA
10 1 (0.080%) Basel II
10 1 (0.080%) Basel III
10 1 (0.080%) COBIT
10 1 (0.080%) HL7
10 1 (0.080%) ISO/IEC 27001
10 1 (0.080%) NIST 800
10 1 (0.080%) Sarbanes-Oxley
10 1 (0.080%) Solvency II
System Software
1 232 (18.47%) HDFS
2 224 (17.83%) Docker
3 135 (10.75%) Apache Flume
4 61 (4.86%) Apache ZooKeeper
5 27 (2.15%) Active Directory
6 22 (1.75%) VMware Infrastructure
7 12 (0.96%) vCloud
8 6 (0.48%) Squid
8 6 (0.48%) Virtual Machines
9 3 (0.24%) NFS
10 2 (0.16%) etcd
10 2 (0.16%) OpenDJ
10 2 (0.16%) OpenIDM
10 2 (0.16%) VMware ESXi
11 1 (0.080%) Ceph
11 1 (0.080%) flannel
11 1 (0.080%) Postfix
11 1 (0.080%) Samba
11 1 (0.080%) VirtualBox
Systems Management
1 192 (15.29%) Ansible
2 133 (10.59%) Puppet
3 130 (10.35%) Kubernetes
4 106 (8.44%) Oozie
5 105 (8.36%) Terraform
6 104 (8.28%) Opscode Chef
7 93 (7.40%) Hadoop YARN
8 68 (5.41%) Ambari
9 43 (3.42%) Mesos
10 31 (2.47%) Cobbler
11 26 (2.07%) Kibana
12 25 (1.99%) ZABBIX
13 23 (1.83%) Salt
14 20 (1.59%) ITRS Geneos
14 20 (1.59%) Nagios
15 15 (1.19%) Apache Slider
15 15 (1.19%) logstash
16 14 (1.11%) Prometheus
17 10 (0.80%) Consul
18 9 (0.72%) Packer
Vendors
1 139 (11.07%) Hortonworks
2 133 (10.59%) Oracle
3 131 (10.43%) Cloudera
4 85 (6.77%) Microsoft
4 85 (6.77%) Tableau
5 69 (5.49%) Splunk
6 57 (4.54%) Google
7 44 (3.50%) SAP
8 43 (3.42%) MapR
9 40 (3.18%) IBM
10 32 (2.55%) VMware
11 30 (2.39%) Red Hat
12 29 (2.31%) AppDynamics
12 29 (2.31%) Teradata
13 25 (1.99%) SaltStack
14 23 (1.83%) Informatica
14 23 (1.83%) Talend
15 21 (1.67%) Alteryx
16 14 (1.11%) Atlassian
17 13 (1.04%) New Relic