Period
to 23 March 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 23 March 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
23 Mar 2019
Same period 2018 Same period 2017
Rank 92 106 59
Rank change year-on-year +14 -47 +57
Contract jobs citing Hadoop 177 168 225
As % of all contract IT jobs advertised in the City of London 2.61% 2.34% 3.73%
As % of the Database & Business Intelligence category 10.31% 9.50% 13.36%
Number of daily rates quoted 137 142 192
City of London median daily rate £575 £600 £575
Median daily rate % change year-on-year -4.17% +4.35% +4.55%
10th Percentile £513 £465 £425
90th Percentile £725 £723 £688
Central London median daily rate £575 £575 £578
% change year-on-year - -0.43% +6.94%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,717 1,769 1,684
As % of all contract IT jobs advertised in the City of London 25.30% 24.63% 27.92%
Number of daily rates quoted 1,365 1,494 1,347
City of London median daily rate £535 £525 £500
Median daily rate % change year-on-year +1.90% +5.00% +5.26%
10th Percentile £400 £363 £325
90th Percentile £675 £688 £650
Central London median daily rate £525 £513 £475
% change year-on-year +2.44% +7.89% -
Number of hourly rates quoted 6 8 2
City of London median hourly rate £38.60 £25.00 £33.67
Median hourly rate % change year-on-year +54.38% -25.74% +72.65%
10th Percentile £32.50 £19.72 £23.75
90th Percentile £56.50 £42.61 £45.05
Central London median hourly rate £35.00 £27.75 £33.67
% change year-on-year +26.13% -17.58% +72.65%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 23 March 2019.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 23 March 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -17 36 £550 +22.22%
Hadoop
Central London

For the 6 months to 23 March 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 129 (72.88%) Apache Spark
2 124 (70.06%) Big Data
3 100 (56.50%) Kafka
4 79 (44.63%) Apache Hive
5 72 (40.68%) Python
6 67 (37.85%) Data Modelling
7 66 (37.29%) SQL
8 60 (33.90%) Finance
9 59 (33.33%) Data Science
9 59 (33.33%) Analytics
10 55 (31.07%) Machine Learning
11 54 (30.51%) Java
12 48 (27.12%) Data Warehouse
13 40 (22.60%) Agile Software Development
13 40 (22.60%) Amazon AWS
14 37 (20.90%) Linux
15 34 (19.21%) Enterprise Data Warehouse
15 34 (19.21%) Oozie
15 34 (19.21%) OLAP
15 34 (19.21%) Star Schema
15 34 (19.21%) Data Quality
16 33 (18.64%) OLAP Cube
16 33 (18.64%) SQL Optimisation
17 29 (16.38%) Business Intelligence
18 28 (15.82%) Git (software)
18 28 (15.82%) Scala
19 27 (15.25%) DevOps
20 26 (14.69%) SQL Server
21 25 (14.12%) HDFS
21 25 (14.12%) Java 8

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 129 (72.88%) Apache Spark
2 18 (10.17%) Apache
3 14 (7.91%) Elasticsearch
4 13 (7.34%) Confluence
5 4 (2.26%) Apache Pig
5 4 (2.26%) Apache Solr
5 4 (2.26%) Cloud Foundry
6 3 (1.69%) SAS
7 2 (1.13%) Apache Airflow
7 2 (1.13%) Jupyter
8 1 (0.56%) nginx
Applications
1 3 (1.69%) Microsoft Excel
2 1 (0.56%) Spreadsheet
Business Applications
1 1 (0.56%) Dynamics NAV
1 1 (0.56%) Eloqua
1 1 (0.56%) SAP ERP
1 1 (0.56%) SAP Oil and Gas
1 1 (0.56%) SAP S/4HANA
Cloud Services
1 40 (22.60%) Amazon AWS
2 23 (12.99%) Microsoft Azure
3 17 (9.60%) Google Cloud Platform
4 9 (5.08%) Amazon EMR
5 8 (4.52%) Heroku
6 4 (2.26%) Amazon S3
6 4 (2.26%) Apigee
6 4 (2.26%) Azure Data Factory
6 4 (2.26%) IBM Cloud
6 4 (2.26%) Serverless
7 2 (1.13%) Amazon EC2
7 2 (1.13%) Amazon Kinesis
7 2 (1.13%) AWS Lambda
7 2 (1.13%) GitHub
8 1 (0.56%) Adobe Analytics
8 1 (0.56%) Azure Functions
8 1 (0.56%) Data Lake Analytics
8 1 (0.56%) iPaaS
8 1 (0.56%) PaaS
8 1 (0.56%) SaaS
Communications & Networking
1 12 (6.78%) HTTP
2 9 (5.08%) DNS
3 8 (4.52%) FTP
3 8 (4.52%) Kerberos
3 8 (4.52%) SSL
3 8 (4.52%) TCP/IP
Database & Business Intelligence
1 124 (70.06%) Big Data
2 79 (44.63%) Apache Hive
3 48 (27.12%) Data Warehouse
4 34 (19.21%) Enterprise Data Warehouse
4 34 (19.21%) OLAP
4 34 (19.21%) Star Schema
5 33 (18.64%) OLAP Cube
6 26 (14.69%) SQL Server
7 24 (13.56%) HBase
7 24 (13.56%) Impala
8 19 (10.73%) Data Lake
8 19 (10.73%) MongoDB
8 19 (10.73%) NoSQL
9 18 (10.17%) Relational Database
10 17 (9.60%) Apache Cassandra
11 16 (9.04%) Power BI
12 10 (5.65%) Apache Kudu
13 9 (5.08%) Spotfire
13 9 (5.08%) SQL Server Integration Services
14 7 (3.95%) Data Mining
Development Applications
1 28 (15.82%) Git (software)
2 16 (9.04%) JIRA
3 15 (8.47%) Jenkins
4 14 (7.91%) Maven
5 10 (5.65%) Cucumber
5 10 (5.65%) Subversion
6 9 (5.08%) Atlassian Bamboo
6 9 (5.08%) FishEye
6 9 (5.08%) jMock
6 9 (5.08%) JUnit
7 8 (4.52%) GitLab
7 8 (4.52%) Gradle
7 8 (4.52%) gulp
8 6 (3.39%) Sonatype Nexus
9 5 (2.82%) Visual Studio Team System
10 3 (1.69%) Artifactory
10 3 (1.69%) Visual Studio
11 1 (0.56%) Bitbucket
11 1 (0.56%) Octopus Deploy
11 1 (0.56%) tSQLt
General
1 60 (33.90%) Finance
2 16 (9.04%) Banking
2 16 (9.04%) Retail
3 13 (7.34%) Front Office
4 3 (1.69%) Marketing
5 2 (1.13%) Investment Banking
5 2 (1.13%) Telecoms
6 1 (0.56%) Corporate Banking
6 1 (0.56%) Legal
6 1 (0.56%) Pharmaceutical
Job Titles
1 71 (40.11%) Data Engineer
2 42 (23.73%) Developer
3 36 (20.34%) Hadoop Engineer
4 25 (14.12%) Java Developer
5 18 (10.17%) Big Data Engineer
6 14 (7.91%) Data Scientist
7 13 (7.34%) Architect
7 13 (7.34%) Data Architect
8 11 (6.21%) Apache Spark Developer
8 11 (6.21%) DevOps Engineer
8 11 (6.21%) Senior Developer
9 9 (5.08%) Administrator
9 9 (5.08%) Hadoop Administrator
9 9 (5.08%) Senior Java Developer
9 9 (5.08%) Technical Leader
10 8 (4.52%) Big Data Developer
11 6 (3.39%) Azure Engineer
12 5 (2.82%) Big Data Architect
12 5 (2.82%) Cloud Engineer
12 5 (2.82%) Senior DevOps Engineer
Libraries, Frameworks & Software Standards
1 100 (56.50%) Kafka
2 15 (8.47%) Spring
3 11 (6.21%) PySpark
3 11 (6.21%) Spring Boot
4 10 (5.65%) AngularJS
5 9 (5.08%) REST
6 8 (4.52%) CSS
6 8 (4.52%) Dropwizard
6 8 (4.52%) Ember.js
6 8 (4.52%) Guice
6 8 (4.52%) HTML
6 8 (4.52%) HTML5
6 8 (4.52%) LDAP
6 8 (4.52%) OAuth
6 8 (4.52%) OAuth2
6 8 (4.52%) Ratpack
6 8 (4.52%) SOAP
7 7 (3.95%) Spark Streaming
8 5 (2.82%) TensorFlow
9 4 (2.26%) Web Services
Miscellaneous
1 13 (7.34%) Algorithms
2 11 (6.21%) Analytical Skills
3 8 (4.52%) Greenfield Project
4 5 (2.82%) Fintech
5 4 (2.26%) iPad
6 3 (1.69%) Market Risk
7 1 (0.56%) Data Centre
7 1 (0.56%) Enterprise Software
7 1 (0.56%) HoloLens
7 1 (0.56%) Management Information System
7 1 (0.56%) Robotics
Operating Systems
1 37 (20.90%) Linux
2 13 (7.34%) Unix
3 6 (3.39%) Red Hat Enterprise Linux
4 1 (0.56%) CentOS
4 1 (0.56%) Debian
4 1 (0.56%) Ubuntu
Processes & Methodologies
1 67 (37.85%) Data Modelling
2 59 (33.33%) Analytics
2 59 (33.33%) Data Science
3 55 (31.07%) Machine Learning
4 40 (22.60%) Agile Software Development
5 33 (18.64%) SQL Optimisation
6 29 (16.38%) Business Intelligence
7 27 (15.25%) DevOps
8 21 (11.86%) Visualisation
9 20 (11.30%) TDD
10 19 (10.73%) ETL
11 17 (9.60%) BDD
12 14 (7.91%) Data Analysis
12 14 (7.91%) Data Integration
13 11 (6.21%) Dimensional Modelling
14 10 (5.65%) Artificial Intelligence
14 10 (5.65%) Data Management
14 10 (5.65%) OO
14 10 (5.65%) Open Source
14 10 (5.65%) UML
Programming Languages
1 72 (40.68%) Python
2 66 (37.29%) SQL
3 54 (30.51%) Java
4 28 (15.82%) Scala
5 25 (14.12%) Java 8
6 12 (6.78%) JavaScript
7 10 (5.65%) R
8 8 (4.52%) ES6
8 8 (4.52%) TypeScript
9 6 (3.39%) Shell Script
10 5 (2.82%) Groovy
11 4 (2.26%) C#
11 4 (2.26%) PowerShell
12 3 (1.69%) MATLAB
12 3 (1.69%) T-SQL
13 2 (1.13%) Ruby
13 2 (1.13%) U-SQL
13 2 (1.13%) VBA
14 1 (0.56%) Data Analysis Expressions (DAX)
14 1 (0.56%) Kotlin
Qualifications
1 9 (5.08%) Degree
2 8 (4.52%) Master's Degree
2 8 (4.52%) PhD
3 2 (1.13%) SC Cleared
3 2 (1.13%) Security Cleared
4 1 (0.56%) Numerate Degree
4 1 (0.56%) Postgraduate
4 1 (0.56%) RHCE
Quality Assurance & Compliance
1 34 (19.21%) Data Quality
System Software
1 25 (14.12%) HDFS
2 18 (10.17%) Docker
3 14 (7.91%) Apache Flume
4 3 (1.69%) Active Directory
5 1 (0.56%) Oracle RAC
Systems Management
1 34 (19.21%) Oozie
2 17 (9.60%) Kubernetes
3 14 (7.91%) Hadoop YARN
4 11 (6.21%) Ansible
5 8 (4.52%) Docker Swarm
6 7 (3.95%) Terraform
7 5 (2.82%) Tivoli
8 3 (1.69%) Ambari
8 3 (1.69%) Grafana
8 3 (1.69%) ITRS Geneos
9 2 (1.13%) Puppet
10 1 (0.56%) Opscode Chef
Vendors
1 22 (12.43%) Cloudera
2 20 (11.30%) Oracle
3 19 (10.73%) Hortonworks
4 14 (7.91%) Google
4 14 (7.91%) Microsoft
5 12 (6.78%) Tableau
6 11 (6.21%) Talend
7 9 (5.08%) Atlassian
7 9 (5.08%) Sybase
8 6 (3.39%) IBM
9 5 (2.82%) MapR
10 4 (2.26%) Alteryx
10 4 (2.26%) Red Hat
11 3 (1.69%) Informatica
11 3 (1.69%) SAP
12 2 (1.13%) Ab Initio
12 2 (1.13%) Adobe
12 2 (1.13%) Datameer
13 1 (0.56%) Marketo
13 1 (0.56%) ServiceNow