Period
to 21 August 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 21 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
21 Aug 2018
Same period 2017 Same period 2016
Rank 93 75 95
Rank change year-on-year -18 +20 +68
Contract jobs citing Hadoop 1,266 1,404 1,213
As % of all contract IT jobs advertised in London 2.78% 3.28% 2.69%
As % of the Database & Business Intelligence category 10.98% 13.44% 11.56%
Number of daily rates quoted 942 1,020 870
London median daily rate £550 £550 £550
10th Percentile £413 £406 £412
90th Percentile £700 £688 £713
England median daily rate £550 £525 £525
% change year-on-year +4.76% - -4.55%
Number of hourly rates quoted 3 0 0
London median hourly rate £75.00 - -
England median hourly rate £47.50 £35.00 £45.00
% change year-on-year +35.71% -22.22% +60.71%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,532 10,448 10,496
As % of all contract IT jobs advertised in London 25.36% 24.39% 23.24%
Number of daily rates quoted 8,576 7,581 7,575
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £356 £338 £313
90th Percentile £675 £650 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 70 55 44
London median hourly rate £27.50 £27.16 £27.50
Median hourly rate % change year-on-year +1.25% -1.24% +10.00%
10th Percentile £19.50 £17.55 £17.05
90th Percentile £47.38 £58.75 £100.00
England median hourly rate £30.00 £30.00 £28.50
% change year-on-year - +5.26% +4.34%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 21 August 2018.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Hadoop in London over the 6 months to 21 August 2018.

Contractor hourly rate histogram for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 21 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -3 281 £575 +1.10% 59
South London -26 101 £525 -1.18% 3
East London +25 74 £550 - 12
West London -30 22 £538 +7.50% 27
North London 0 3 £316 -36.75%
Hadoop
England

For the 6 months to 21 August 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 914 (72.20%) Big Data
2 659 (52.05%) Apache Spark
3 543 (42.89%) Python
4 485 (38.31%) Java
5 474 (37.44%) Kafka
6 470 (37.12%) SQL
7 461 (36.41%) Agile Software Development
8 452 (35.70%) Apache Hive
9 387 (30.57%) Amazon AWS
10 376 (29.70%) Analytics
10 376 (29.70%) Finance
11 337 (26.62%) Scala
12 305 (24.09%) Data Science
13 284 (22.43%) HBase
14 255 (20.14%) DevOps
15 241 (19.04%) Linux
16 231 (18.25%) ETL
17 226 (17.85%) NoSQL
18 214 (16.90%) Docker
19 212 (16.75%) HDFS
20 205 (16.19%) Machine Learning
21 197 (15.56%) Data Modelling
22 194 (15.32%) Jenkins
23 187 (14.77%) Business Intelligence
24 183 (14.45%) SQL Server
25 182 (14.38%) Scrum
26 180 (14.22%) Data Warehouse
27 179 (14.14%) Cloudera
28 176 (13.90%) Ansible
29 171 (13.51%) Microsoft Azure

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 659 (52.05%) Apache Spark
2 144 (11.37%) Elasticsearch
3 118 (9.32%) Apache
4 79 (6.24%) Apache Pig
5 67 (5.29%) Confluence
6 59 (4.66%) Apache Solr
7 56 (4.42%) SAS
8 31 (2.45%) nginx
9 25 (1.97%) Tomcat
10 11 (0.87%) Gunicorn
10 11 (0.87%) SharePoint
11 8 (0.63%) OpenStack
12 7 (0.55%) JBoss
12 7 (0.55%) Jupyter
13 6 (0.47%) Apache Airflow
13 6 (0.47%) Jetty
14 5 (0.39%) WebLogic
15 3 (0.24%) Luigi
15 3 (0.24%) Oracle SOA Suite
15 3 (0.24%) WebSphere
Applications
1 55 (4.34%) Microsoft Excel
2 36 (2.84%) MS Visio
3 6 (0.47%) Chatbot
4 3 (0.24%) Microsoft PowerPoint
4 3 (0.24%) Stata
5 2 (0.16%) HipChat
5 2 (0.16%) Microsoft Office
5 2 (0.16%) Shockwave
5 2 (0.16%) SPSS
Business Applications
1 15 (1.18%) SAP Oil and Gas
2 7 (0.55%) ION MarketView
3 2 (0.16%) SAP ERP
3 2 (0.16%) Summit
4 1 (0.079%) Actimize
4 1 (0.079%) Dynamics AX
4 1 (0.079%) Dynamics CRM
4 1 (0.079%) Dynamics NAV
4 1 (0.079%) Finacle
4 1 (0.079%) FLEXCUBE
4 1 (0.079%) Oracle BPM
4 1 (0.079%) SAP S/4HANA
Cloud Services
1 387 (30.57%) Amazon AWS
2 171 (13.51%) Microsoft Azure
3 92 (7.27%) Amazon S3
4 75 (5.92%) Google Cloud Platform
5 55 (4.34%) Amazon EC2
6 50 (3.95%) Amazon EMR
7 37 (2.92%) Virtual Private Cloud
8 33 (2.61%) GitHub
9 32 (2.53%) Serverless
10 29 (2.29%) Amazon Kinesis
11 26 (2.05%) AWS Lambda
12 16 (1.26%) PaaS
13 15 (1.18%) Azure Data Factory
14 12 (0.95%) Google Analytics
14 12 (0.95%) Heroku
15 11 (0.87%) Cloud Computing
16 10 (0.79%) Route 53
17 7 (0.55%) SaaS
18 6 (0.47%) IaaS
19 5 (0.39%) IBM Cloud
Communications & Networking
1 61 (4.82%) Kerberos
2 32 (2.53%) SSL
3 28 (2.21%) DNS
3 28 (2.21%) HTTP
4 21 (1.66%) Firewall
4 21 (1.66%) VPN
5 19 (1.50%) TCP/IP
6 15 (1.18%) Internet
7 12 (0.95%) FTP
8 8 (0.63%) WAN
9 7 (0.55%) Network Security
9 7 (0.55%) RTMP
10 6 (0.47%) SNA
11 5 (0.39%) ICMP
11 5 (0.39%) LAN
11 5 (0.39%) SSH
12 4 (0.32%) DOCSIS
12 4 (0.32%) HTTPS
12 4 (0.32%) Multicast
12 4 (0.32%) SMS
Database & Business Intelligence
1 914 (72.20%) Big Data
2 452 (35.70%) Apache Hive
3 284 (22.43%) HBase
4 226 (17.85%) NoSQL
5 183 (14.45%) SQL Server
6 180 (14.22%) Data Warehouse
7 159 (12.56%) MongoDB
8 137 (10.82%) Relational Database
9 131 (10.35%) Apache Cassandra
10 128 (10.11%) Impala
11 121 (9.56%) PostgreSQL
12 111 (8.77%) Sqoop
13 96 (7.58%) Data Lake
14 84 (6.64%) Power BI
15 83 (6.56%) Amazon Redshift
16 66 (5.21%) RDBMS
17 57 (4.50%) Enterprise Data Warehouse
17 57 (4.50%) OLAP
18 54 (4.27%) MySQL
18 54 (4.27%) Star Schema
Development Applications
1 194 (15.32%) Jenkins
2 152 (12.01%) Git (software)
3 88 (6.95%) JIRA
4 49 (3.87%) Maven
5 32 (2.53%) Visual Studio Team System
6 28 (2.21%) GitLab
7 24 (1.90%) Cucumber
8 21 (1.66%) Subversion
9 20 (1.58%) IntelliJ
10 19 (1.50%) Gradle
11 18 (1.42%) Artifactory
12 17 (1.34%) JUnit
13 15 (1.18%) TeamCity
14 13 (1.03%) Team Foundation Server
15 12 (0.95%) gulp
15 12 (0.95%) Selenium
16 11 (0.87%) Eclipse
16 11 (0.87%) SonarQube
17 10 (0.79%) FishEye
17 10 (0.79%) Sonatype Nexus
General
1 376 (29.70%) Finance
2 133 (10.51%) Banking
3 44 (3.48%) Investment Banking
4 40 (3.16%) Front Office
5 31 (2.45%) Retail
6 29 (2.29%) Games
7 23 (1.82%) Marketing
8 21 (1.66%) Legal
9 20 (1.58%) Telecoms
10 14 (1.11%) Publishing
11 11 (0.87%) Advertising
12 7 (0.55%) Back Office
12 7 (0.55%) Electronics
12 7 (0.55%) Manufacturing
13 6 (0.47%) Retail Banking
14 4 (0.32%) Private Banking
15 3 (0.24%) Financial Institution
16 2 (0.16%) Law
17 1 (0.079%) Billing
17 1 (0.079%) Corporate Banking
Job Titles
1 355 (28.04%) Developer
2 319 (25.20%) Data Engineer
3 225 (17.77%) Big Data Engineer
4 147 (11.61%) Java Developer
5 144 (11.37%) Hadoop Engineer
6 132 (10.43%) Architect
7 118 (9.32%) Big Data Developer
8 94 (7.42%) Consultant
9 82 (6.48%) Data Architect
10 71 (5.61%) Analyst
10 71 (5.61%) Senior Developer
11 59 (4.66%) Big Data Architect
11 59 (4.66%) Data Scientist
12 52 (4.11%) Python Engineer
13 51 (4.03%) AWS Engineer
14 49 (3.87%) Scala Developer
15 48 (3.79%) DevOps Engineer
15 48 (3.79%) Hadoop Developer
15 48 (3.79%) Senior Java Developer
16 46 (3.63%) Platform Engineer
Libraries, Frameworks & Software Standards
1 474 (37.44%) Kafka
2 121 (9.56%) REST
3 87 (6.87%) JSON
4 84 (6.64%) Web Services
5 68 (5.37%) Spring
6 59 (4.66%) HTML
7 57 (4.50%) AngularJS
8 51 (4.03%) Hibernate
9 46 (3.63%) Spring Boot
10 45 (3.55%) RESTful
10 45 (3.55%) XML
11 43 (3.40%) JSON Schema
11 43 (3.40%) Natural Language Processing
12 39 (3.08%) HTML5
13 38 (3.00%) Samza
14 37 (2.92%) Node.js
15 36 (2.84%) Spark Streaming
16 35 (2.76%) Elastic Stack
16 35 (2.76%) Guice
17 32 (2.53%) JPA
Miscellaneous
1 145 (11.45%) Algorithms
2 137 (10.82%) Analytical Skills
3 72 (5.69%) Greenfield Project
4 58 (4.58%) Computer Science
5 42 (3.32%) Data Structures
6 37 (2.92%) Fintech
6 37 (2.92%) User Experience
6 37 (2.92%) Wiki
7 32 (2.53%) Self-Motivation
8 24 (1.90%) HoloLens
9 23 (1.82%) Public Cloud
10 19 (1.50%) Data Centre
11 18 (1.42%) Derivative
12 14 (1.11%) Enterprise Software
13 12 (0.95%) Equity Derivative
13 12 (0.95%) Linux Command Line
14 11 (0.87%) Market Risk
14 11 (0.87%) Social Network
14 11 (0.87%) Virtual Team
15 9 (0.71%) Mobile App
Operating Systems
1 241 (19.04%) Linux
2 129 (10.19%) Unix
3 56 (4.42%) Windows
4 28 (2.21%) Red Hat Enterprise Linux
5 17 (1.34%) Ubuntu
6 14 (1.11%) CentOS
6 14 (1.11%) CoreOS
7 8 (0.63%) Android
8 6 (0.47%) Apple iOS
9 5 (0.39%) Windows Server
9 5 (0.39%) Windows Server 2008
10 3 (0.24%) DC/OS
10 3 (0.24%) Debian
10 3 (0.24%) Mac OS X
10 3 (0.24%) Solaris
11 1 (0.079%) AIX
11 1 (0.079%) SUSE
11 1 (0.079%) SUSE Linux Enterprise Server
Processes & Methodologies
1 461 (36.41%) Agile Software Development
2 376 (29.70%) Analytics
3 305 (24.09%) Data Science
4 255 (20.14%) DevOps
5 231 (18.25%) ETL
6 205 (16.19%) Machine Learning
7 197 (15.56%) Data Modelling
8 187 (14.77%) Business Intelligence
9 182 (14.38%) Scrum
10 149 (11.77%) TDD
11 148 (11.69%) Microservices
12 136 (10.74%) Visualisation
13 124 (9.79%) Continuous Integration
14 113 (8.93%) Open Source
15 110 (8.69%) Problem-Solving
16 106 (8.37%) Data Engineering
17 95 (7.50%) MapReduce
18 91 (7.19%) Test Automation
19 88 (6.95%) Data Analysis
20 85 (6.71%) Mentoring
Programming Languages
1 543 (42.89%) Python
2 485 (38.31%) Java
3 470 (37.12%) SQL
4 337 (26.62%) Scala
5 137 (10.82%) Java 8
6 109 (8.61%) R
7 108 (8.53%) Bash Shell
8 80 (6.32%) JavaScript
9 76 (6.00%) Groovy
10 57 (4.50%) Shell Script
11 41 (3.24%) MATLAB
11 41 (3.24%) PowerShell
12 36 (2.84%) Perl
13 35 (2.76%) Korn
14 33 (2.61%) C++
15 32 (2.53%) C#
16 29 (2.29%) Ruby
17 21 (1.66%) T-SQL
17 21 (1.66%) TypeScript
18 20 (1.58%) C
Qualifications
1 127 (10.03%) Security Cleared
2 86 (6.79%) SC Cleared
3 59 (4.66%) Degree
4 24 (1.90%) Computer Science Degree
4 24 (1.90%) PhD
5 18 (1.42%) DV Cleared
6 8 (0.63%) CHECK Team Member
6 8 (0.63%) Master's Degree
6 8 (0.63%) Numerate Degree
7 5 (0.39%) CISSP
8 4 (0.32%) AWS Certification
9 3 (0.24%) CEH
9 3 (0.24%) CISM
9 3 (0.24%) SANS
10 2 (0.16%) CIPD
10 2 (0.16%) CTC Cleared
11 1 (0.079%) CBAP
11 1 (0.079%) CISMP
11 1 (0.079%) IIBA
11 1 (0.079%) TOGAF Certification
Quality Assurance & Compliance
1 104 (8.21%) Data Quality
2 36 (2.84%) QA
3 25 (1.97%) GCP
4 19 (1.50%) GDPR
5 5 (0.39%) ISO/IEC 27001
5 5 (0.39%) SLA
6 4 (0.32%) PMO
7 1 (0.079%) Dodd-Frank
7 1 (0.079%) EMIR
7 1 (0.079%) MiFID
System Software
1 214 (16.90%) Docker
2 212 (16.75%) HDFS
3 82 (6.48%) Apache Flume
4 47 (3.71%) Apache ZooKeeper
5 16 (1.26%) Active Directory
6 4 (0.32%) Ceph
6 4 (0.32%) Lustre
6 4 (0.32%) NFS
7 3 (0.24%) KVM
7 3 (0.24%) VMware Infrastructure
7 3 (0.24%) Xen
8 2 (0.16%) Hyper-V
8 2 (0.16%) Oracle RAC
8 2 (0.16%) SRDF
8 2 (0.16%) vCloud
9 1 (0.079%) OpenIDM
9 1 (0.079%) Postfix
9 1 (0.079%) Squid
9 1 (0.079%) Veritas Cluster Server
9 1 (0.079%) Virtual Machines
Systems Management
1 176 (13.90%) Ansible
2 151 (11.93%) Oozie
3 134 (10.58%) Kubernetes
4 127 (10.03%) Hadoop YARN
5 120 (9.48%) Terraform
6 115 (9.08%) Puppet
7 89 (7.03%) Opscode Chef
8 27 (2.13%) Ambari
9 25 (1.97%) Kibana
10 18 (1.42%) logstash
11 14 (1.11%) Prometheus
12 13 (1.03%) Docker Swarm
13 12 (0.95%) Consul
13 12 (0.95%) HAProxy
13 12 (0.95%) Host Intrusion Detection System
13 12 (0.95%) Mesos
13 12 (0.95%) Network Intrusion Detection System
14 11 (0.87%) Salt
14 11 (0.87%) Sysdig
15 10 (0.79%) Packer
Vendors
1 179 (14.14%) Cloudera
2 134 (10.58%) Oracle
3 113 (8.93%) Hortonworks
4 108 (8.53%) Tableau
5 95 (7.50%) Google
6 67 (5.29%) Microsoft
7 50 (3.95%) Informatica
8 46 (3.63%) SAP
9 41 (3.24%) Alteryx
10 33 (2.61%) Talend
11 30 (2.37%) IBM
12 29 (2.29%) Teradata
13 28 (2.21%) MapR
13 28 (2.21%) Splunk
14 19 (1.50%) Salesforce.com
15 14 (1.11%) Ab Initio
16 13 (1.03%) Sybase
17 11 (0.87%) Red Hat
18 10 (0.79%) Cognos
18 10 (0.79%) SaltStack