Period
to 19 July 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 19 July 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
19 Jul 2018
Same period 2017 Same period 2016
Rank 83 77 115
Rank change year-on-year -6 +38 +22
Contract jobs citing Hadoop 213 204 131
As % of all contract IT jobs advertised in the City of London 3.03% 3.17% 1.91%
As % of the Database & Business Intelligence category 11.91% 12.30% 7.53%
Number of daily rates quoted 182 179 109
City of London median daily rate £575 £550 £550
Median daily rate % change year-on-year +4.55% - -4.35%
10th Percentile £463 £425 £375
90th Percentile £713 £700 £713
Central London median daily rate £563 £550 £545
% change year-on-year +2.27% +0.92% -5.22%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,789 1,659 1,740
As % of all contract IT jobs advertised in the City of London 25.41% 25.74% 25.39%
Number of daily rates quoted 1,440 1,299 1,387
City of London median daily rate £525 £513 £475
Median daily rate % change year-on-year +2.44% +7.89% +5.56%
10th Percentile £363 £347 £313
90th Percentile £688 £675 £638
Central London median daily rate £525 £500 £463
% change year-on-year +5.00% +8.11% +2.78%
Number of hourly rates quoted 12 6 8
City of London median hourly rate £22.00 £21.92 £19.00
Median hourly rate % change year-on-year +0.38% +15.36% -30.91%
10th Percentile £17.57 £20.75 £15.83
90th Percentile £33.00 £27.74 £26.72
Central London median hourly rate £22.50 £21.92 £19.00
% change year-on-year +2.66% +15.36% -24.00%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 19 July 2018.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 19 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 15 £525 -
Hadoop
Central London

For the 6 months to 19 July 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 165 (77.46%) Big Data
2 111 (52.11%) Apache Spark
3 108 (50.70%) Python
4 102 (47.89%) Java
5 99 (46.48%) Apache Hive
6 82 (38.50%) Kafka
7 69 (32.39%) Finance
8 66 (30.99%) Amazon AWS
9 65 (30.52%) SQL
10 64 (30.05%) Agile Software Development
11 55 (25.82%) ETL
11 55 (25.82%) HDFS
12 53 (24.88%) Scala
13 49 (23.00%) Analytics
14 45 (21.13%) NoSQL
15 43 (20.19%) Java 8
16 42 (19.72%) HBase
17 41 (19.25%) Elasticsearch
17 41 (19.25%) Linux
18 34 (15.96%) Machine Learning
19 33 (15.49%) SQL Server
20 32 (15.02%) MongoDB
21 31 (14.55%) Cloudera
21 31 (14.55%) Data Science
22 30 (14.08%) Apache Cassandra
22 30 (14.08%) Microservices
23 29 (13.62%) Hadoop YARN
24 28 (13.15%) TDD
25 26 (12.21%) Microsoft Azure
25 26 (12.21%) AngularJS

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 111 (52.11%) Apache Spark
2 41 (19.25%) Elasticsearch
3 22 (10.33%) Apache
4 18 (8.45%) Apache Pig
5 14 (6.57%) Apache Solr
6 7 (3.29%) SAS
7 4 (1.88%) Confluence
8 3 (1.41%) Apache Airflow
8 3 (1.41%) Tomcat
9 2 (0.94%) Cloud Foundry
9 2 (0.94%) Luigi
9 2 (0.94%) WebSphere
10 1 (0.47%) Gunicorn
10 1 (0.47%) IIS
10 1 (0.47%) nginx
10 1 (0.47%) Oracle HTTP Server
Applications
1 14 (6.57%) Microsoft Excel
2 12 (5.63%) MS Visio
3 1 (0.47%) Microsoft Office
3 1 (0.47%) Microsoft PowerPoint
Business Applications
1 2 (0.94%) ION MarketView
Cloud Services
1 66 (30.99%) Amazon AWS
2 26 (12.21%) Microsoft Azure
3 18 (8.45%) Amazon S3
4 16 (7.51%) Google Cloud Platform
5 11 (5.16%) Amazon EC2
5 11 (5.16%) Virtual Private Cloud
6 6 (2.82%) Amazon Kinesis
6 6 (2.82%) Heroku
7 5 (2.35%) Amazon EMR
8 3 (1.41%) Azure Data Factory
9 2 (0.94%) Cloud Computing
9 2 (0.94%) Data Lake Analytics
9 2 (0.94%) GitHub
9 2 (0.94%) IBM Cloud
9 2 (0.94%) Serverless
10 1 (0.47%) Adobe Analytics
10 1 (0.47%) Akamai
10 1 (0.47%) Google Analytics
10 1 (0.47%) IaaS
10 1 (0.47%) Route 53
Communications & Networking
1 13 (6.10%) SSL
2 11 (5.16%) Kerberos
3 9 (4.23%) HTTP
4 7 (3.29%) DNS
5 6 (2.82%) FTP
5 6 (2.82%) TCP/IP
6 3 (1.41%) SMS
7 2 (0.94%) Firewall
7 2 (0.94%) WAN
8 1 (0.47%) FCoE
8 1 (0.47%) Fibre Channel
8 1 (0.47%) Internet
8 1 (0.47%) iSCSI
8 1 (0.47%) LAN
8 1 (0.47%) Multicast
8 1 (0.47%) NAS
8 1 (0.47%) SAN
8 1 (0.47%) SNA
8 1 (0.47%) X.509
Database & Business Intelligence
1 165 (77.46%) Big Data
2 99 (46.48%) Apache Hive
3 45 (21.13%) NoSQL
4 42 (19.72%) HBase
5 33 (15.49%) SQL Server
6 32 (15.02%) MongoDB
7 30 (14.08%) Apache Cassandra
8 24 (11.27%) Sqoop
9 23 (10.80%) Relational Database
10 22 (10.33%) Data Warehouse
11 21 (9.86%) Impala
12 16 (7.51%) Amazon Redshift
12 16 (7.51%) PostgreSQL
13 14 (6.57%) Data Lake
14 11 (5.16%) MySQL
15 10 (4.69%) RDBMS
16 9 (4.23%) SQL Server Integration Services
17 8 (3.76%) Power BI
18 5 (2.35%) Data Mining
19 4 (1.88%) Spotfire
Development Applications
1 24 (11.27%) Git (software)
1 24 (11.27%) Jenkins
2 21 (9.86%) Maven
3 10 (4.69%) GitLab
4 7 (3.29%) JIRA
5 6 (2.82%) Gradle
5 6 (2.82%) gulp
6 4 (1.88%) TeamCity
7 3 (1.41%) ERwin
7 3 (1.41%) JUnit
8 2 (0.94%) Sonatype Nexus
8 2 (0.94%) Subversion
8 2 (0.94%) Travis CI
9 1 (0.47%) Atlassian Bamboo
9 1 (0.47%) FishEye
9 1 (0.47%) jMock
9 1 (0.47%) Octopus Deploy
9 1 (0.47%) RStudio
9 1 (0.47%) Team Foundation Server
9 1 (0.47%) Visual Studio Team System
General
1 69 (32.39%) Finance
2 20 (9.39%) Banking
3 9 (4.23%) Retail
4 8 (3.76%) Advertising
5 7 (3.29%) Investment Banking
6 4 (1.88%) Marketing
7 3 (1.41%) Private Banking
8 2 (0.94%) Front Office
8 2 (0.94%) Games
8 2 (0.94%) Publishing
9 1 (0.47%) Corporate Banking
9 1 (0.47%) Financial Institution
9 1 (0.47%) Legal
Job Titles
1 63 (29.58%) Developer
2 51 (23.94%) Big Data Engineer
3 49 (23.00%) Data Engineer
4 27 (12.68%) Hadoop Engineer
5 25 (11.74%) Big Data Developer
6 24 (11.27%) Java Developer
7 19 (8.92%) Senior Hadoop Engineer
8 18 (8.45%) Elasticsearch Engineer
8 18 (8.45%) Java Engineer
8 18 (8.45%) Python Engineer
8 18 (8.45%) Senior Developer
8 18 (8.45%) Senior Java Engineer
9 16 (7.51%) Architect
10 12 (5.63%) Data Architect
10 12 (5.63%) Platform Engineer
10 12 (5.63%) Senior Java Developer
11 11 (5.16%) Consultant
11 11 (5.16%) Data Scientist
12 9 (4.23%) Analyst
13 7 (3.29%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 82 (38.50%) Kafka
2 26 (12.21%) AngularJS
3 24 (11.27%) REST
4 15 (7.04%) Spring Boot
5 13 (6.10%) JSON
6 11 (5.16%) HTML
7 10 (4.69%) Spring
8 9 (4.23%) HTML5
8 9 (4.23%) SOAP
9 8 (3.76%) CSS
10 7 (3.29%) RabbitMQ
11 6 (2.82%) Dropwizard
11 6 (2.82%) Ember.js
11 6 (2.82%) Guice
11 6 (2.82%) OAuth
11 6 (2.82%) OAuth2
11 6 (2.82%) Ratpack
11 6 (2.82%) TensorFlow
11 6 (2.82%) XML
12 5 (2.35%) JMS
Miscellaneous
1 25 (11.74%) Algorithms
2 14 (6.57%) Greenfield Project
3 13 (6.10%) Analytical Skills
4 11 (5.16%) Wiki
5 6 (2.82%) Fintech
6 4 (1.88%) Computer Science
6 4 (1.88%) Data Centre
7 3 (1.41%) Data Structures
7 3 (1.41%) Linux Command Line
7 3 (1.41%) PKI
8 2 (0.94%) Blog
8 2 (0.94%) iPad
8 2 (0.94%) Management Information System
8 2 (0.94%) Online Games
9 1 (0.47%) CUDA
9 1 (0.47%) Fat Client
9 1 (0.47%) Hybrid Cloud
9 1 (0.47%) Market Risk
9 1 (0.47%) Social Network
9 1 (0.47%) User Experience
Operating Systems
1 41 (19.25%) Linux
2 20 (9.39%) Unix
3 12 (5.63%) Windows
4 9 (4.23%) Red Hat Enterprise Linux
5 4 (1.88%) DC/OS
6 1 (0.47%) Android
6 1 (0.47%) CoreOS
6 1 (0.47%) Solaris
6 1 (0.47%) Ubuntu
Processes & Methodologies
1 64 (30.05%) Agile Software Development
2 55 (25.82%) ETL
3 49 (23.00%) Analytics
4 34 (15.96%) Machine Learning
5 31 (14.55%) Data Science
6 30 (14.08%) Microservices
7 28 (13.15%) TDD
8 25 (11.74%) DevOps
9 24 (11.27%) Data Modelling
9 24 (11.27%) MapReduce
9 24 (11.27%) Scrum
10 20 (9.39%) Continuous Integration
11 19 (8.92%) Business Intelligence
11 19 (8.92%) Data Analysis
12 17 (7.98%) Mentoring
12 17 (7.98%) Test Automation
13 14 (6.57%) Problem-Solving
14 13 (6.10%) Data Extraction
15 12 (5.63%) Visualisation
16 11 (5.16%) Predictive Modelling
Programming Languages
1 108 (50.70%) Python
2 102 (47.89%) Java
3 65 (30.52%) SQL
4 53 (24.88%) Scala
5 43 (20.19%) Java 8
6 22 (10.33%) R
7 18 (8.45%) Bash Shell
8 15 (7.04%) Shell Script
9 13 (6.10%) JavaScript
9 13 (6.10%) MATLAB
9 13 (6.10%) PowerShell
10 11 (5.16%) Korn
11 7 (3.29%) ES6
11 7 (3.29%) TypeScript
12 6 (2.82%) Perl
13 5 (2.35%) T-SQL
14 4 (1.88%) C#
15 3 (1.41%) Clojure
15 3 (1.41%) PL/SQL
16 2 (0.94%) Groovy
Qualifications
1 6 (2.82%) Security Cleared
2 4 (1.88%) Degree
2 4 (1.88%) SC Cleared
3 3 (1.41%) DV Cleared
3 3 (1.41%) PhD
4 2 (0.94%) Microsoft Certification
5 1 (0.47%) Computer Science Degree
5 1 (0.47%) MCSD
5 1 (0.47%) Numerate Degree
Quality Assurance & Compliance
1 8 (3.76%) GCP
2 7 (3.29%) Data Quality
3 6 (2.82%) QA
4 4 (1.88%) GDPR
5 1 (0.47%) SLA
System Software
1 55 (25.82%) HDFS
2 19 (8.92%) Apache Flume
2 19 (8.92%) Docker
3 12 (5.63%) Apache ZooKeeper
4 7 (3.29%) Active Directory
5 1 (0.47%) Hyper-V
5 1 (0.47%) KVM
5 1 (0.47%) NFS
5 1 (0.47%) Oracle RAC
5 1 (0.47%) SRDF
5 1 (0.47%) VMware Infrastructure
5 1 (0.47%) Xen
Systems Management
1 29 (13.62%) Hadoop YARN
2 19 (8.92%) Ansible
2 19 (8.92%) Puppet
3 16 (7.51%) Kubernetes
3 16 (7.51%) Oozie
4 11 (5.16%) Opscode Chef
5 7 (3.29%) Ambari
5 7 (3.29%) Apache Slider
5 7 (3.29%) Terraform
6 6 (2.82%) Docker Swarm
7 4 (1.88%) Mesos
8 2 (0.94%) Kibana
8 2 (0.94%) Prometheus
9 1 (0.47%) logstash
9 1 (0.47%) Salt
Vendors
1 31 (14.55%) Cloudera
2 26 (12.21%) Oracle
3 23 (10.80%) Hortonworks
4 18 (8.45%) Google
5 12 (5.63%) Tableau
6 9 (4.23%) Informatica
6 9 (4.23%) Microsoft
7 8 (3.76%) IBM
8 5 (2.35%) Splunk
8 5 (2.35%) Teradata
9 4 (1.88%) Ab Initio
9 4 (1.88%) MapR
9 4 (1.88%) Talend
10 3 (1.41%) Alteryx
10 3 (1.41%) ION Trading
10 3 (1.41%) Red Hat
11 2 (0.94%) CA
11 2 (0.94%) Sybase
11 2 (0.94%) TIBCO
12 1 (0.47%) Palantir