Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Job Locations Skill Sets
Period
to 25 April 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 25 April 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
25 Apr 2018		 Same period 2017 Same period 2016
Rank 102 66 124
Rank change year-on-year -36 +58 +5
Contract jobs citing Hadoop 168 209 110
As % of all contract IT jobs advertised in the City of London 2.40% 3.44% 1.68%
As % of the Database & Business Intelligence category 9.69% 12.30% 6.43%
Number of daily rates quoted 143 180 95
City of London median daily rate £575 £563 £550
Median daily rate % change year-on-year +2.22% +2.27% -4.35%
10th Percentile £473 £424 £363
90th Percentile £700 £688 £670
Central London median daily rate £550 £563 £550
% change year-on-year -2.22% +2.27% -4.35%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,733 1,699 1,711
As % of all contract IT jobs advertised in the City of London 24.74% 27.94% 26.13%
Number of daily rates quoted 1,464 1,353 1,352
City of London median daily rate £513 £488 £475
Median daily rate % change year-on-year +5.13% +2.63% +5.56%
10th Percentile £363 £325 £313
90th Percentile £675 £643 £638
Central London median daily rate £513 £475 £475
% change year-on-year +7.89% - +5.56%
Number of hourly rates quoted 9 1 11
City of London median hourly rate £22.50 £22.34 £19.00
Median hourly rate % change year-on-year +0.74% +17.55% -53.09%
10th Percentile £20.06 £21.67 £16.13
90th Percentile £40.81 £23.00 £60.00
Central London median hourly rate £30.00 £22.34 £19.00
% change year-on-year +34.32% +17.55% -30.44%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 25 April 2018.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 25 April 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London Bridge - 3 £475 -
Hadoop
Central London

For the 6 months to 25 April 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 124 (73.81%) Big Data
2 103 (61.31%) Apache Spark
3 85 (50.60%) Java
4 81 (48.21%) Apache Hive
5 78 (46.43%) Python
6 61 (36.31%) SQL
7 60 (35.71%) Finance
7 60 (35.71%) Analytics
8 56 (33.33%) Kafka
9 55 (32.74%) Scala
10 54 (32.14%) Agile Software Development
11 50 (29.76%) HDFS
12 45 (26.79%) Amazon AWS
12 45 (26.79%) ETL
13 44 (26.19%) HBase
14 41 (24.40%) NoSQL
15 36 (21.43%) Data Science
16 33 (19.64%) Linux
17 32 (19.05%) Apache
17 32 (19.05%) Machine Learning
18 31 (18.45%) Banking
19 30 (17.86%) Data Warehouse
20 28 (16.67%) Apache Cassandra
21 26 (15.48%) Cloudera
21 26 (15.48%) Data Modelling
22 25 (14.88%) Hortonworks
22 25 (14.88%) R
23 24 (14.29%) Relational Database
23 24 (14.29%) Algorithms
23 24 (14.29%) Java 8

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 103 (61.31%) Apache Spark
2 32 (19.05%) Apache
3 23 (13.69%) Elasticsearch
4 17 (10.12%) Apache Pig
5 12 (7.14%) Apache Solr
6 5 (2.98%) SAS
6 5 (2.98%) Tomcat
7 3 (1.79%) nginx
8 2 (1.19%) Confluence
8 2 (1.19%) IPython
8 2 (1.19%) Jupyter
8 2 (1.19%) Oracle Coherence
9 1 (0.60%) Apache Airflow
9 1 (0.60%) Gunicorn
9 1 (0.60%) IIS
9 1 (0.60%) Jetty
9 1 (0.60%) Luigi
9 1 (0.60%) Oracle HTTP Server
9 1 (0.60%) WebSphere
Applications
1 2 (1.19%) SPSS
2 1 (0.60%) Microsoft Excel
Business Applications
1 2 (1.19%) ION MarketView
Cloud Services
1 45 (26.79%) Amazon AWS
2 23 (13.69%) Microsoft Azure
3 7 (4.17%) Google Cloud Platform
4 6 (3.57%) Amazon S3
5 5 (2.98%) Amazon Kinesis
6 3 (1.79%) GitHub
6 3 (1.79%) Serverless
7 2 (1.19%) Amazon EMR
7 2 (1.19%) AWS Lambda
7 2 (1.19%) Azure Data Factory
7 2 (1.19%) Cloud Computing
7 2 (1.19%) PaaS
7 2 (1.19%) Route 53
8 1 (0.60%) Adobe Analytics
8 1 (0.60%) Amazon EC2
8 1 (0.60%) AWS CloudTrail
8 1 (0.60%) Azure Active Directory
8 1 (0.60%) Google Analytics
8 1 (0.60%) SaaS
8 1 (0.60%) Virtual Private Cloud
Communications & Networking
1 11 (6.55%) Kerberos
2 6 (3.57%) SSL
3 2 (1.19%) HTTP
3 2 (1.19%) SMS
4 1 (0.60%) FCoE
4 1 (0.60%) Fibre Channel
4 1 (0.60%) Firewall
4 1 (0.60%) iSCSI
4 1 (0.60%) LAN
4 1 (0.60%) Multicast
4 1 (0.60%) NAS
4 1 (0.60%) SAN
4 1 (0.60%) SSH
4 1 (0.60%) WAN
Database & Business Intelligence
1 124 (73.81%) Big Data
2 81 (48.21%) Apache Hive
3 44 (26.19%) HBase
4 41 (24.40%) NoSQL
5 30 (17.86%) Data Warehouse
6 28 (16.67%) Apache Cassandra
7 24 (14.29%) Relational Database
8 21 (12.50%) MongoDB
9 18 (10.71%) SQL Server
10 17 (10.12%) Amazon Redshift
11 16 (9.52%) Data Lake
11 16 (9.52%) PostgreSQL
12 11 (6.55%) Impala
12 11 (6.55%) RDBMS
13 10 (5.95%) MySQL
14 9 (5.36%) Sqoop
15 5 (2.98%) DB2
16 4 (2.38%) Data Mining
16 4 (2.38%) Power BI
16 4 (2.38%) SQL Server Integration Services
Development Applications
1 19 (11.31%) Git (software)
2 17 (10.12%) Maven
3 15 (8.93%) Jenkins
4 9 (5.36%) TeamCity
5 6 (3.57%) JUnit
6 4 (2.38%) ERwin
6 4 (2.38%) JIRA
7 3 (1.79%) Cucumber
7 3 (1.79%) Subversion
8 2 (1.19%) ER Studio
8 2 (1.19%) GoCD
8 2 (1.19%) SonarQube
8 2 (1.19%) Vagrant
9 1 (0.60%) Babel
9 1 (0.60%) Bower
9 1 (0.60%) GitLab
9 1 (0.60%) Grunt
9 1 (0.60%) JConsole
9 1 (0.60%) Travis CI
9 1 (0.60%) VisualVM
General
1 60 (35.71%) Finance
2 31 (18.45%) Banking
3 15 (8.93%) Investment Banking
3 15 (8.93%) Retail
4 9 (5.36%) Front Office
5 7 (4.17%) Advertising
6 5 (2.98%) Marketing
7 3 (1.79%) Games
7 3 (1.79%) Private Banking
7 3 (1.79%) Telecoms
8 1 (0.60%) Automotive
8 1 (0.60%) Corporate Banking
8 1 (0.60%) Electronics
8 1 (0.60%) French Language
8 1 (0.60%) Manufacturing
8 1 (0.60%) Retail Banking
8 1 (0.60%) Spanish Language
Job Titles
1 47 (27.98%) Data Engineer
2 36 (21.43%) Big Data Engineer
3 35 (20.83%) Developer
4 24 (14.29%) Hadoop Engineer
5 21 (12.50%) Big Data Developer
6 18 (10.71%) Python Engineer
7 16 (9.52%) Java Engineer
8 15 (8.93%) Architect
9 14 (8.33%) Senior Hadoop Engineer
9 14 (8.33%) Senior Java Engineer
10 13 (7.74%) Data Scientist
11 12 (7.14%) Data Architect
11 12 (7.14%) Elasticsearch Engineer
12 10 (5.95%) Analyst
12 10 (5.95%) Java Developer
13 8 (4.76%) Consultant
14 6 (3.57%) AWS Engineer
14 6 (3.57%) DevOps Engineer
14 6 (3.57%) Scala Developer
15 5 (2.98%) Big Data Architect
Libraries, Frameworks & Software Standards
1 56 (33.33%) Kafka
2 14 (8.33%) AngularJS
3 10 (5.95%) Akka
3 10 (5.95%) XML
4 8 (4.76%) JSON
5 7 (4.17%) TensorFlow
6 6 (3.57%) HTML
6 6 (3.57%) JMS
6 6 (3.57%) Keras
6 6 (3.57%) REST
6 6 (3.57%) scikit-learn
7 5 (2.98%) MLlib
8 4 (2.38%) HTML5
8 4 (2.38%) J2EE
8 4 (2.38%) Natural Language Processing
8 4 (2.38%) RabbitMQ
8 4 (2.38%) React
8 4 (2.38%) RESTful
8 4 (2.38%) Web Services
9 3 (1.79%) SOAP
Miscellaneous
1 24 (14.29%) Algorithms
2 20 (11.90%) Analytical Skills
3 7 (4.17%) Computer Science
3 7 (4.17%) Derivative
3 7 (4.17%) Greenfield Project
4 5 (2.98%) Data Centre
5 3 (1.79%) Credit Risk
5 3 (1.79%) Data Structures
5 3 (1.79%) Grid Computing
5 3 (1.79%) Linux Command Line
5 3 (1.79%) Market Risk
6 2 (1.19%) Blog
6 2 (1.19%) Fintech
6 2 (1.19%) Interest Rate Derivative
6 2 (1.19%) iPad
6 2 (1.19%) Life Science
6 2 (1.19%) Online Games
6 2 (1.19%) Replication
6 2 (1.19%) Social Network
7 1 (0.60%) Public Cloud
Operating Systems
1 33 (19.64%) Linux
2 10 (5.95%) Red Hat Enterprise Linux
3 7 (4.17%) Unix
4 5 (2.98%) Windows
5 3 (1.79%) DC/OS
5 3 (1.79%) Windows Server
6 2 (1.19%) Windows Server 2008
7 1 (0.60%) Solaris
7 1 (0.60%) Ubuntu
Processes & Methodologies
1 60 (35.71%) Analytics
2 54 (32.14%) Agile Software Development
3 45 (26.79%) ETL
4 36 (21.43%) Data Science
5 32 (19.05%) Machine Learning
6 26 (15.48%) Data Modelling
7 23 (13.69%) DevOps
7 23 (13.69%) MapReduce
8 21 (12.50%) Business Intelligence
9 18 (10.71%) TDD
10 15 (8.93%) Data Engineering
10 15 (8.93%) Mentoring
10 15 (8.93%) Problem-Solving
11 14 (8.33%) Scrum
12 11 (6.55%) Continuous Integration
12 11 (6.55%) Data Analytics
12 11 (6.55%) E-Commerce
12 11 (6.55%) Risk Management
12 11 (6.55%) Software Engineering
13 10 (5.95%) Open Source
Programming Languages
1 85 (50.60%) Java
2 78 (46.43%) Python
3 61 (36.31%) SQL
4 55 (32.74%) Scala
5 25 (14.88%) R
6 24 (14.29%) Java 8
7 10 (5.95%) Shell Script
8 9 (5.36%) Bash Shell
9 8 (4.76%) JavaScript
10 7 (4.17%) MATLAB
11 5 (2.98%) PL/SQL
12 4 (2.38%) Haskell
12 4 (2.38%) Perl
13 3 (1.79%) C#
13 3 (1.79%) Julia
14 2 (1.19%) C
14 2 (1.19%) Go
14 2 (1.19%) PowerShell
14 2 (1.19%) T-SQL
15 1 (0.60%) C++
Qualifications
1 6 (3.57%) Security Cleared
2 4 (2.38%) Degree
2 4 (2.38%) DV Cleared
3 3 (1.79%) SC Cleared
4 2 (1.19%) Numerate Degree
5 1 (0.60%) Computer Science Degree
5 1 (0.60%) MCSD
5 1 (0.60%) Microsoft Certification
5 1 (0.60%) PRINCE2 Certification
Quality Assurance & Compliance
1 5 (2.98%) Data Quality
2 4 (2.38%) GCP
3 3 (1.79%) GDPR
3 3 (1.79%) QA
4 2 (1.19%) Dodd-Frank
4 2 (1.19%) EMIR
4 2 (1.19%) MiFID
System Software
1 50 (29.76%) HDFS
2 21 (12.50%) Apache Flume
3 12 (7.14%) Apache ZooKeeper
4 10 (5.95%) Docker
5 6 (3.57%) Active Directory
6 1 (0.60%) Hyper-V
6 1 (0.60%) KVM
6 1 (0.60%) NFS
6 1 (0.60%) Oracle RAC
6 1 (0.60%) SRDF
6 1 (0.60%) Virtual Machines
6 1 (0.60%) VMware Infrastructure
6 1 (0.60%) Xen
Systems Management
1 17 (10.12%) Oozie
2 16 (9.52%) Hadoop YARN
3 8 (4.76%) Ambari
4 7 (4.17%) Mesos
5 6 (3.57%) Ansible
5 6 (3.57%) Apache Slider
6 3 (1.79%) Kubernetes
6 3 (1.79%) Terraform
7 1 (0.60%) ITRS Geneos
7 1 (0.60%) Kibana
7 1 (0.60%) Opscode Chef
7 1 (0.60%) Puppet
7 1 (0.60%) Salt
Vendors
1 26 (15.48%) Cloudera
2 25 (14.88%) Hortonworks
3 17 (10.12%) Oracle
4 13 (7.74%) Tableau
5 11 (6.55%) Microsoft
6 9 (5.36%) Google
7 7 (4.17%) MapR
8 6 (3.57%) IBM
8 6 (3.57%) Informatica
9 5 (2.98%) Splunk
9 5 (2.98%) Talend
10 4 (2.38%) SAP
11 3 (1.79%) Ab Initio
11 3 (1.79%) Embarcadero
11 3 (1.79%) Sybase
11 3 (1.79%) Teradata
12 2 (1.19%) Cognos
12 2 (1.19%) ION Trading
12 2 (1.19%) MicroStrategy
12 2 (1.19%) Red Hat