Period
to 25 October 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 25 October 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
25 Oct 2020
Same period 2019 Same period 2018
Rank 81 100 85
Rank change year-on-year +19 -15 -13
Contract jobs citing Hadoop 34 142 212
As % of all contract jobs advertised in the City of London 1.90% 2.39% 3.01%
As % of the Database & Business Intelligence category 7.23% 9.42% 11.56%
Number of daily rates quoted 17 123 179
Median daily rate £550 £575 £575
Median daily rate % change year-on-year -4.35% - -2.54%
10th Percentile £406 £500 £425
90th Percentile £610 £700 £713
Central London median daily rate £550 £569 £575
% change year-on-year -3.30% -1.09% -
Number of hourly rates quoted 0 2 0
Median hourly rate - £46.85 -
Central London median hourly rate - £46.85 -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 470 1,507 1,834
As % of all contract IT jobs advertised in the City of London 26.20% 25.36% 26.01%
Number of daily rates quoted 334 1,211 1,441
Median daily rate £518 £525 £525
Median daily rate % change year-on-year -1.43% - -
10th Percentile £354 £388 £375
90th Percentile £675 £675 £675
Central London median daily rate £520 £525 £525
% change year-on-year -0.95% - +2.19%
Number of hourly rates quoted 6 6 12
Median hourly rate £30.50 £46.85 £22.25
Median hourly rate % change year-on-year -34.90% +110.55% -19.09%
10th Percentile £20.75 £21.21 £19.50
90th Percentile £38.75 £81.50 £41.68
Median hourly rate £30.50 £46.85 £22.25
% change year-on-year -34.90% +110.55% -19.09%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Hadoop in the City of London.

Daily rate trend for Hadoop in the City of London

Hadoop
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Hadoop in the City of London over the 6 months to 25 October 2020.

Daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Hadoop in the City of London.

Hourly rate trend for Hadoop in the City of London

For the 6 months to 25 October 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 26 (76.47%) Apache Spark
2 17 (50.00%) Big Data
3 14 (41.18%) Python
4 13 (38.24%) Java
4 13 (38.24%) Agile Software Development
5 12 (35.29%) SQL
6 11 (32.35%) Degree
6 11 (32.35%) Mathematics
7 10 (29.41%) Computer Science
7 10 (29.41%) AWS
7 10 (29.41%) Cloudera
7 10 (29.41%) Scrum
7 10 (29.41%) Banking
8 9 (26.47%) Finance
8 9 (26.47%) Scala
8 9 (26.47%) Numerate Degree
9 8 (23.53%) BDD
9 8 (23.53%) Azure
9 8 (23.53%) Front Office
9 8 (23.53%) TDD
9 8 (23.53%) Investment Banking
9 8 (23.53%) Economics
10 7 (20.59%) ETL
11 6 (17.65%) Data Warehouse
11 6 (17.65%) Git (software)
11 6 (17.65%) Security Cleared
11 6 (17.65%) Jenkins
12 5 (14.71%) Analytics
12 5 (14.71%) Kafka
12 5 (14.71%) Data Integration

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 26 (76.47%) Apache Spark
2 4 (11.76%) SAS
3 1 (2.94%) Apache Airflow
3 1 (2.94%) Elasticsearch
3 1 (2.94%) R Markdown
Applications
1 1 (2.94%) Chatbot
Cloud Services
1 10 (29.41%) AWS
2 8 (23.53%) Azure
3 5 (14.71%) GCP
4 2 (5.88%) Power Platform
5 1 (2.94%) Amazon EMR
5 1 (2.94%) Amazon S3
5 1 (2.94%) AWS CloudFormation
5 1 (2.94%) Azure Data Factory
5 1 (2.94%) Serverless
Communications & Networking
1 1 (2.94%) Kerberos
1 1 (2.94%) SSL
Database & Business Intelligence
1 17 (50.00%) Big Data
2 6 (17.65%) Data Warehouse
3 5 (14.71%) Amazon Redshift
4 4 (11.76%) NoSQL
4 4 (11.76%) Relational Database
5 3 (8.82%) Apache Hive
5 3 (8.82%) RDBMS
5 3 (8.82%) SAS EBI
6 2 (5.88%) BusinessObjects
6 2 (5.88%) Data Lake
6 2 (5.88%) Impala
6 2 (5.88%) Power BI
7 1 (2.94%) BusinessObjects Web Intelligence
7 1 (2.94%) Data Mart
7 1 (2.94%) MariaDB
7 1 (2.94%) Oracle OLAP
7 1 (2.94%) Pentaho
7 1 (2.94%) PostgreSQL
7 1 (2.94%) Spotfire
7 1 (2.94%) SQL Server Reporting Services
Development Applications
1 6 (17.65%) Git (software)
1 6 (17.65%) Jenkins
2 1 (2.94%) Artifactory
2 1 (2.94%) Bitbucket
2 1 (2.94%) Cucumber
2 1 (2.94%) Maven
2 1 (2.94%) MLflow
2 1 (2.94%) Selenium
General
1 10 (29.41%) Banking
2 9 (26.47%) Finance
3 8 (23.53%) Front Office
3 8 (23.53%) Investment Banking
4 3 (8.82%) Marketing
5 2 (5.88%) Law
6 1 (2.94%) Retail
Job Titles
1 11 (32.35%) Developer
2 8 (23.53%) Agile Developer
2 8 (23.53%) Agile Java Developer
2 8 (23.53%) Data Engineer
2 8 (23.53%) Java Developer
3 6 (17.65%) Architect
4 4 (11.76%) DevOps Engineer
5 3 (8.82%) Consultant
5 3 (8.82%) Data Scientist
5 3 (8.82%) Hadoop Consultant
6 2 (5.88%) AWS Engineer
6 2 (5.88%) Big Data Engineer
6 2 (5.88%) Cloud Architect
6 2 (5.88%) Cloud Engineer
6 2 (5.88%) Infrastructure Consultant
6 2 (5.88%) Lead Architect
6 2 (5.88%) Pega Architect
7 1 (2.94%) Cloud Developer
7 1 (2.94%) Data Warehouse Developer
7 1 (2.94%) SQL Developer
Libraries, Frameworks & Software Standards
1 5 (14.71%) Kafka
2 2 (5.88%) XML
3 1 (2.94%) .NET
3 1 (2.94%) Anaconda
3 1 (2.94%) Natural Language Processing
3 1 (2.94%) RESTful
3 1 (2.94%) TensorFlow
3 1 (2.94%) Web Services
Miscellaneous
1 3 (8.82%) Algorithms
2 2 (5.88%) Public Cloud
3 1 (2.94%) Analytical Mindset
3 1 (2.94%) Analytical Skills
3 1 (2.94%) Data Centre
3 1 (2.94%) Taxonomies
Operating Systems
1 2 (5.88%) Linux
2 1 (2.94%) Unix
Processes & Methodologies
1 13 (38.24%) Agile Software Development
2 11 (32.35%) Mathematics
3 10 (29.41%) Computer Science
3 10 (29.41%) Scrum
4 8 (23.53%) BDD
4 8 (23.53%) Economics
4 8 (23.53%) TDD
5 7 (20.59%) ETL
6 5 (14.71%) Analytics
6 5 (14.71%) Business Intelligence
6 5 (14.71%) Data Integration
6 5 (14.71%) Data Modelling
6 5 (14.71%) Data Science
6 5 (14.71%) DevOps
7 4 (11.76%) Machine Learning
8 3 (8.82%) Data Ingestion
8 3 (8.82%) Microservices
8 3 (8.82%) Visualisation
9 2 (5.88%) Data Architecture
9 2 (5.88%) Stakeholder Management
Programming Languages
1 14 (41.18%) Python
2 13 (38.24%) Java
3 12 (35.29%) SQL
4 9 (26.47%) Scala
5 2 (5.88%) C#
5 2 (5.88%) R
6 1 (2.94%) Bash Shell
6 1 (2.94%) Data Analysis Expressions (DAX)
6 1 (2.94%) Go
6 1 (2.94%) Kotlin
6 1 (2.94%) Perl
6 1 (2.94%) PHP
6 1 (2.94%) PowerShell
6 1 (2.94%) Ruby
6 1 (2.94%) Shell Script
Qualifications
1 11 (32.35%) Degree
2 9 (26.47%) Numerate Degree
3 6 (17.65%) Security Cleared
4 4 (11.76%) SC Cleared
5 1 (2.94%) PhD
5 1 (2.94%) TOGAF Certification
Quality Assurance & Compliance
1 1 (2.94%) CDISC
1 1 (2.94%) GDPR
1 1 (2.94%) IFRS
1 1 (2.94%) MiFID
1 1 (2.94%) Solvency II
System Software
1 2 (5.88%) Docker
1 2 (5.88%) HDFS
Systems Management
1 5 (14.71%) Kubernetes
2 4 (11.76%) Terraform
3 3 (8.82%) Ansible
4 2 (5.88%) Kubeflow
5 1 (2.94%) Oozie
5 1 (2.94%) Puppet
Vendors
1 10 (29.41%) Cloudera
2 4 (11.76%) Google
3 3 (8.82%) Oracle
4 2 (5.88%) EMC
4 2 (5.88%) Hortonworks
4 2 (5.88%) Informatica
4 2 (5.88%) Microsoft
4 2 (5.88%) NetApp
4 2 (5.88%) Pega
5 1 (2.94%) CenturyLink
5 1 (2.94%) Databricks
5 1 (2.94%) IBM
5 1 (2.94%) MapR