Period
to 18 October 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 18 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
18 Oct 2018
Same period 2017 Same period 2016
Rank 88 72 84
Rank change year-on-year -16 +12 +40
Contract jobs citing Hadoop 213 232 199
As % of all contract IT jobs advertised in the City of London 3.04% 3.38% 2.98%
As % of the Database & Business Intelligence category 11.95% 13.73% 11.86%
Number of daily rates quoted 182 204 163
City of London median daily rate £575 £590 £575
Median daily rate % change year-on-year -2.54% +2.61% -
10th Percentile £439 £469 £438
90th Percentile £700 £725 £713
Central London median daily rate £575 £575 £575
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,783 1,690 1,678
As % of all contract IT jobs advertised in the City of London 25.44% 24.65% 25.12%
Number of daily rates quoted 1,403 1,343 1,330
City of London median daily rate £525 £525 £466
Median daily rate % change year-on-year - +12.60% +0.81%
10th Percentile £375 £363 £325
90th Percentile £675 £688 £650
Central London median daily rate £525 £513 £453
% change year-on-year +2.44% +13.13% +0.67%
Number of hourly rates quoted 14 9 3
City of London median hourly rate £27.25 £27.50 £19.00
Median hourly rate % change year-on-year -0.91% +44.74% -24.00%
10th Percentile £19.50 £20.75 £16.60
90th Percentile £40.66 £33.25 £41.90
Central London median hourly rate £27.25 £27.50 £19.00
% change year-on-year -0.91% +44.74% -15.56%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 18 October 2018.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 18 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 25 £525 -
Hadoop
Central London

For the 6 months to 18 October 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 155 (72.77%) Big Data
2 118 (55.40%) Apache Spark
3 104 (48.83%) Kafka
4 99 (46.48%) Python
5 96 (45.07%) Java
5 96 (45.07%) Apache Hive
6 74 (34.74%) Finance
7 61 (28.64%) SQL
7 61 (28.64%) Agile Software Development
8 57 (26.76%) Amazon AWS
9 50 (23.47%) Java 8
10 44 (20.66%) Elasticsearch
11 42 (19.72%) Data Science
12 41 (19.25%) Machine Learning
13 40 (18.78%) HDFS
14 39 (18.31%) SQL Server
15 38 (17.84%) ETL
16 37 (17.37%) Linux
16 37 (17.37%) Scala
17 34 (15.96%) Analytics
17 34 (15.96%) MongoDB
17 34 (15.96%) NoSQL
18 33 (15.49%) Jenkins
18 33 (15.49%) Microservices
19 32 (15.02%) AngularJS
19 32 (15.02%) Git (software)
19 32 (15.02%) Oracle
20 30 (14.08%) Apache Cassandra
20 30 (14.08%) HBase
21 29 (13.62%) Hadoop YARN

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (55.40%) Apache Spark
2 44 (20.66%) Elasticsearch
3 16 (7.51%) Apache
4 10 (4.69%) Apache Pig
5 7 (3.29%) Confluence
5 7 (3.29%) SAS
6 6 (2.82%) Apache Solr
7 4 (1.88%) Apache Airflow
8 3 (1.41%) Luigi
9 2 (0.94%) Cloud Foundry
10 1 (0.47%) Gunicorn
10 1 (0.47%) nginx
10 1 (0.47%) SharePoint
10 1 (0.47%) WebSphere
Applications
1 15 (7.04%) Microsoft Excel
2 14 (6.57%) MS Visio
3 1 (0.47%) Microsoft Office
3 1 (0.47%) Microsoft PowerPoint
Cloud Services
1 57 (26.76%) Amazon AWS
2 23 (10.80%) Microsoft Azure
3 16 (7.51%) Amazon S3
4 14 (6.57%) Amazon EC2
4 14 (6.57%) Google Cloud Platform
5 13 (6.10%) Virtual Private Cloud
6 12 (5.63%) Heroku
7 6 (2.82%) GitHub
8 5 (2.35%) IBM Cloud
9 4 (1.88%) Amazon EMR
9 4 (1.88%) Amazon Kinesis
10 2 (0.94%) AWS Lambda
10 2 (0.94%) Serverless
11 1 (0.47%) Akamai
11 1 (0.47%) Azure Data Factory
11 1 (0.47%) Azure Machine Learning
11 1 (0.47%) Data Lake Analytics
11 1 (0.47%) Route 53
Communications & Networking
1 16 (7.51%) HTTP
2 15 (7.04%) SSL
3 13 (6.10%) DNS
4 12 (5.63%) FTP
4 12 (5.63%) TCP/IP
5 7 (3.29%) Kerberos
6 3 (1.41%) Firewall
7 2 (0.94%) SMS
8 1 (0.47%) Internet
8 1 (0.47%) LAN
8 1 (0.47%) SNA
8 1 (0.47%) WAN
8 1 (0.47%) X.509
Database & Business Intelligence
1 155 (72.77%) Big Data
2 96 (45.07%) Apache Hive
3 39 (18.31%) SQL Server
4 34 (15.96%) MongoDB
4 34 (15.96%) NoSQL
5 30 (14.08%) Apache Cassandra
5 30 (14.08%) HBase
6 28 (13.15%) Impala
6 28 (13.15%) Sqoop
7 20 (9.39%) Data Warehouse
8 18 (8.45%) Relational Database
9 13 (6.10%) SQL Server Integration Services
10 10 (4.69%) Data Lake
10 10 (4.69%) Power BI
11 9 (4.23%) Data Mining
11 9 (4.23%) Enterprise Data Warehouse
11 9 (4.23%) OLAP
11 9 (4.23%) OLAP Cube
11 9 (4.23%) PostgreSQL
11 9 (4.23%) Star Schema
Development Applications
1 33 (15.49%) Jenkins
2 32 (15.02%) Git (software)
3 23 (10.80%) Maven
4 15 (7.04%) GitLab
5 12 (5.63%) Gradle
5 12 (5.63%) gulp
6 11 (5.16%) JIRA
7 6 (2.82%) Subversion
8 5 (2.35%) Cucumber
9 4 (1.88%) Atlassian Bamboo
9 4 (1.88%) FishEye
9 4 (1.88%) jMock
9 4 (1.88%) JUnit
10 3 (1.41%) Artifactory
10 3 (1.41%) Visual Studio
10 3 (1.41%) Visual Studio Team System
11 2 (0.94%) Octopus Deploy
11 2 (0.94%) Sonatype Nexus
11 2 (0.94%) TeamCity
11 2 (0.94%) Travis CI
General
1 74 (34.74%) Finance
2 12 (5.63%) Banking
3 9 (4.23%) Front Office
4 4 (1.88%) Advertising
4 4 (1.88%) Publishing
4 4 (1.88%) Retail
5 3 (1.41%) Back Office
6 2 (0.94%) Financial Institution
6 2 (0.94%) Legal
6 2 (0.94%) Marketing
7 1 (0.47%) Corporate Banking
7 1 (0.47%) Electronics
7 1 (0.47%) Investment Banking
7 1 (0.47%) Telecoms
Job Titles
1 63 (29.58%) Developer
2 53 (24.88%) Data Engineer
3 51 (23.94%) Big Data Engineer
4 37 (17.37%) Hadoop Engineer
5 32 (15.02%) Java Developer
6 29 (13.62%) Senior Developer
7 19 (8.92%) Java Engineer
7 19 (8.92%) Senior Hadoop Engineer
7 19 (8.92%) Senior Java Developer
7 19 (8.92%) Senior Java Engineer
8 18 (8.45%) Elasticsearch Engineer
9 15 (7.04%) Data Scientist
9 15 (7.04%) Python Engineer
10 14 (6.57%) Platform Engineer
11 12 (5.63%) Big Data Developer
12 10 (4.69%) Architect
13 9 (4.23%) Apache Spark Developer
13 9 (4.23%) DevOps Engineer
13 9 (4.23%) Technical Leader
14 8 (3.76%) Lead Java Developer
Libraries, Frameworks & Software Standards
1 104 (48.83%) Kafka
2 32 (15.02%) AngularJS
3 25 (11.74%) REST
4 20 (9.39%) Spring Boot
5 14 (6.57%) CSS
5 14 (6.57%) HTML
5 14 (6.57%) OAuth
5 14 (6.57%) OAuth2
5 14 (6.57%) Spring
6 13 (6.10%) HTML5
7 12 (5.63%) Dropwizard
7 12 (5.63%) Ember.js
7 12 (5.63%) Guice
7 12 (5.63%) Ratpack
7 12 (5.63%) SOAP
8 11 (5.16%) JSON
9 9 (4.23%) Spark Streaming
10 7 (3.29%) Natural Language Processing
10 7 (3.29%) NumPy
10 7 (3.29%) Pandas
Miscellaneous
1 20 (9.39%) Greenfield Project
2 19 (8.92%) Algorithms
3 13 (6.10%) Wiki
4 7 (3.29%) Analytical Skills
4 7 (3.29%) Computer Science
4 7 (3.29%) Fintech
5 3 (1.41%) User Experience
6 2 (0.94%) Data Structures
6 2 (0.94%) iPad
6 2 (0.94%) Management Information System
6 2 (0.94%) PKI
6 2 (0.94%) Private Cloud
7 1 (0.47%) CUDA
7 1 (0.47%) Data Centre
7 1 (0.47%) Derivative
7 1 (0.47%) Distributed Denial-of-Service
7 1 (0.47%) Hybrid Cloud
7 1 (0.47%) Media Streaming
7 1 (0.47%) Reference Data
7 1 (0.47%) Robotics
Operating Systems
1 37 (17.37%) Linux
2 24 (11.27%) Unix
3 13 (6.10%) Windows
4 9 (4.23%) Red Hat Enterprise Linux
5 2 (0.94%) Android
6 1 (0.47%) CoreOS
6 1 (0.47%) DC/OS
6 1 (0.47%) Ubuntu
Processes & Methodologies
1 61 (28.64%) Agile Software Development
2 42 (19.72%) Data Science
3 41 (19.25%) Machine Learning
4 38 (17.84%) ETL
5 34 (15.96%) Analytics
6 33 (15.49%) Microservices
7 28 (13.15%) Data Modelling
7 28 (13.15%) DevOps
7 28 (13.15%) Scrum
8 25 (11.74%) TDD
9 24 (11.27%) MapReduce
10 20 (9.39%) Business Intelligence
10 20 (9.39%) Continuous Integration
11 18 (8.45%) Data Analysis
11 18 (8.45%) Test Automation
12 15 (7.04%) Data Extraction
13 14 (6.57%) Visualisation
14 13 (6.10%) Build Automation
14 13 (6.10%) Data Engineering
14 13 (6.10%) Software Engineering
Programming Languages
1 99 (46.48%) Python
2 96 (45.07%) Java
3 61 (28.64%) SQL
4 50 (23.47%) Java 8
5 37 (17.37%) Scala
6 23 (10.80%) JavaScript
7 18 (8.45%) Bash Shell
8 15 (7.04%) PowerShell
8 15 (7.04%) Shell Script
9 14 (6.57%) R
10 13 (6.10%) Korn
11 12 (5.63%) ES6
11 12 (5.63%) TypeScript
12 9 (4.23%) MATLAB
13 7 (3.29%) C#
14 6 (2.82%) Clojure
15 5 (2.35%) T-SQL
16 3 (1.41%) Groovy
16 3 (1.41%) Kotlin
17 2 (0.94%) Perl
Qualifications
1 7 (3.29%) PhD
2 6 (2.82%) Degree
3 2 (0.94%) SC Cleared
3 2 (0.94%) Security Cleared
4 1 (0.47%) Computer Science Degree
4 1 (0.47%) Master's Degree
4 1 (0.47%) Microsoft Certification
4 1 (0.47%) Numerate Degree
Quality Assurance & Compliance
1 14 (6.57%) Data Quality
2 6 (2.82%) QA
3 1 (0.47%) GDPR
3 1 (0.47%) SLA
System Software
1 40 (18.78%) HDFS
2 28 (13.15%) Docker
3 16 (7.51%) Apache Flume
4 6 (2.82%) Active Directory
4 6 (2.82%) Apache ZooKeeper
Systems Management
1 29 (13.62%) Hadoop YARN
2 28 (13.15%) Ansible
3 23 (10.80%) Kubernetes
3 23 (10.80%) Puppet
4 22 (10.33%) Oozie
5 15 (7.04%) Opscode Chef
6 12 (5.63%) Docker Swarm
7 9 (4.23%) Terraform
8 6 (2.82%) Ambari
9 3 (1.41%) Apache Slider
9 3 (1.41%) ITRS Geneos
10 2 (0.94%) Kibana
10 2 (0.94%) logstash
10 2 (0.94%) Prometheus
11 1 (0.47%) Mesos
11 1 (0.47%) Salt
Vendors
1 32 (15.02%) Oracle
2 25 (11.74%) Cloudera
3 18 (8.45%) Hortonworks
4 14 (6.57%) Google
5 12 (5.63%) Tableau
6 9 (4.23%) Microsoft
7 8 (3.76%) IBM
7 8 (3.76%) Informatica
8 6 (2.82%) Red Hat
9 5 (2.35%) Ab Initio
9 5 (2.35%) MapR
9 5 (2.35%) Talend
10 4 (1.88%) Atlassian
10 4 (1.88%) Sybase
10 4 (1.88%) Teradata
11 3 (1.41%) Alteryx
12 2 (0.94%) CA
12 2 (0.94%) TIBCO
13 1 (0.47%) ION Trading
13 1 (0.47%) Palantir