Period
to 11 May 2021

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 11 May 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
11 May 2021
Same period 2020 Same period 2019
Rank 105 109 82
Rank change year-on-year +4 -27 +21
Contract jobs citing Hadoop 45 48 196
As % of all contract jobs advertised in the City of London 1.66% 1.39% 2.98%
As % of the Database & Business Intelligence category 7.79% 5.90% 11.42%
Number of daily rates quoted 33 34 151
10th Percentile £513 £348 £519
25th Percentile £525 £513 £525
Median daily rate (50th Percentile) £600 £575 £550
Median % change year-on-year +4.35% +4.55% -4.35%
75th Percentile £638 £669 £650
90th Percentile £670 £700 £725
Central London median daily rate £593 £575 £550
% change year-on-year +3.04% +4.55% -
Number of hourly rates quoted 0 0 2
Median hourly rate - - £42.07
Central London median hourly rate - - £42.07

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 578 814 1,716
As % of all contract IT jobs advertised in the City of London 21.35% 23.64% 26.08%
Number of daily rates quoted 397 613 1,361
10th Percentile £384 £363 £406
25th Percentile £456 £415 £458
Median daily rate (50th Percentile) £550 £500 £525
Median % change year-on-year +10.00% -4.76% +0.96%
75th Percentile £638 £600 £613
90th Percentile £701 £675 £675
Central London median daily rate £550 £500 £525
% change year-on-year +10.00% -4.76% +2.44%
Number of hourly rates quoted 5 5 10
Median hourly rate £8.00 £25.00 £35.00
Median % change year-on-year -68.00% -28.57% +57.30%
Central London median hourly rate £17.00 £25.00 £35.00
% change year-on-year -32.00% -28.57% +33.33%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Hadoop in the City of London.

Daily rate trend for Hadoop in the City of London

Hadoop
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Hadoop in the City of London over the 6 months to 11 May 2021.

Daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Hadoop in the City of London.

Hourly rate trend for Hadoop in the City of London

For the 6 months to 11 May 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 31 (68.89%) Apache Spark
2 26 (57.78%) Big Data
3 23 (51.11%) AWS
3 23 (51.11%) Java
4 22 (48.89%) SQL
5 20 (44.44%) Python
6 18 (40.00%) Data Lake
7 17 (37.78%) Data Pipeline
8 16 (35.56%) Data Science
8 16 (35.56%) Apache
8 16 (35.56%) Apache Hive
9 13 (28.89%) Scala
9 13 (28.89%) Amazon Redshift
10 12 (26.67%) Apache Airflow
10 12 (26.67%) Kafka
10 12 (26.67%) Analytics
11 11 (24.44%) NoSQL
11 11 (24.44%) Analytical Skills
12 10 (22.22%) DevOps
12 10 (22.22%) Machine Learning
12 10 (22.22%) Data Warehouse
12 10 (22.22%) Data Modelling
13 9 (20.00%) Talend
13 9 (20.00%) Data Transformation
14 8 (17.78%) Amazon RDS
14 8 (17.78%) Cloudera
14 8 (17.78%) Security Cleared
14 8 (17.78%) Azure
14 8 (17.78%) JIRA
14 8 (17.78%) Computer Science

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 31 (68.89%) Apache Spark
2 16 (35.56%) Apache
3 12 (26.67%) Apache Airflow
4 4 (8.89%) SAS
5 3 (6.67%) Confluence
6 2 (4.44%) Elasticsearch
7 1 (2.22%) Oracle SOA Suite
7 1 (2.22%) SharePoint
Applications
1 1 (2.22%) Microsoft Excel
1 1 (2.22%) SPSS
Business Applications
1 1 (2.22%) Oracle BPM
1 1 (2.22%) SAP MDG
1 1 (2.22%) SAP MDM
Cloud Services
1 23 (51.11%) AWS
2 8 (17.78%) Azure
3 7 (15.56%) Amazon EC2
4 3 (6.67%) Amazon EMR
4 3 (6.67%) Serverless
5 2 (4.44%) Amazon S3
6 1 (2.22%) Amazon Cognito
6 1 (2.22%) Amazon SageMaker
6 1 (2.22%) AWS Lambda
6 1 (2.22%) Azure Data Factory
6 1 (2.22%) Azure Synapse Analytics
6 1 (2.22%) Cloud Computing
6 1 (2.22%) GCP
6 1 (2.22%) IaaS
6 1 (2.22%) PaaS
6 1 (2.22%) Power Platform
Communications & Networking
1 1 (2.22%) Firewall
1 1 (2.22%) Remote Desktop
Database & Business Intelligence
1 26 (57.78%) Big Data
2 18 (40.00%) Data Lake
3 16 (35.56%) Apache Hive
4 13 (28.89%) Amazon Redshift
5 11 (24.44%) NoSQL
6 10 (22.22%) Data Warehouse
7 8 (17.78%) Amazon RDS
8 7 (15.56%) Relational Database
9 6 (13.33%) Impala
9 6 (13.33%) Spark SQL
10 5 (11.11%) Presto
11 4 (8.89%) Tableau
12 3 (6.67%) Data Mining
12 3 (6.67%) PostgreSQL
12 3 (6.67%) SQL Server
13 2 (4.44%) MySQL
14 1 (2.22%) BusinessObjects
14 1 (2.22%) HBase
14 1 (2.22%) PowerCenter
14 1 (2.22%) SAP HANA
Development Applications
1 8 (17.78%) JIRA
2 4 (8.89%) Jenkins
3 2 (4.44%) Git (software)
4 1 (2.22%) Bitbucket
4 1 (2.22%) ERwin
4 1 (2.22%) Oracle APEX
4 1 (2.22%) Sonatype Nexus
General
1 11 (24.44%) Analytical Skills
2 8 (17.78%) Social Skills
3 6 (13.33%) Finance
4 4 (8.89%) Banking
4 4 (8.89%) Games
5 2 (4.44%) Organisational Skills
6 1 (2.22%) Documentation Skills
6 1 (2.22%) Pharmaceutical
Job Titles
1 28 (62.22%) Data Engineer
2 11 (24.44%) AWS Engineer
2 11 (24.44%) Big Data Engineer
3 7 (15.56%) Developer
4 5 (11.11%) Architect
4 5 (11.11%) Hadoop Engineer
5 4 (8.89%) Data Scientist
6 3 (6.67%) Data Architect
6 3 (6.67%) Java Developer
7 2 (4.44%) ETL Developer
7 2 (4.44%) Platform Engineer
7 2 (4.44%) Scala Engineer
7 2 (4.44%) Senior Data Scientist
8 1 (2.22%) Azure Engineer
8 1 (2.22%) DataOps Engineer
8 1 (2.22%) Developer/Software Engineer
8 1 (2.22%) Lead DevOps
8 1 (2.22%) Lead DevOps Engineer
8 1 (2.22%) Senior Data Engineer
8 1 (2.22%) Supply Chain Architect
Libraries, Frameworks & Software Standards
1 12 (26.67%) Kafka
2 4 (8.89%) PySpark
2 4 (8.89%) TensorFlow
3 3 (6.67%) GraphX
3 3 (6.67%) MLlib
3 3 (6.67%) RabbitMQ
3 3 (6.67%) Spring
4 2 (4.44%) Apache NiFi
4 2 (4.44%) JSON
4 2 (4.44%) XML
5 1 (2.22%) Django
Miscellaneous
1 7 (15.56%) Algorithms
2 3 (6.67%) Data Structures
3 2 (4.44%) Cloud Native
4 1 (2.22%) Linux Command Line
4 1 (2.22%) Video\Live Streaming
Operating Systems
1 5 (11.11%) Linux
2 2 (4.44%) Unix
2 2 (4.44%) Windows
Processes & Methodologies
1 17 (37.78%) Data Pipeline
2 16 (35.56%) Data Science
3 12 (26.67%) Analytics
4 10 (22.22%) Data Modelling
4 10 (22.22%) DevOps
4 10 (22.22%) Machine Learning
5 9 (20.00%) Data Transformation
6 8 (17.78%) Computer Science
6 8 (17.78%) Data Engineering
6 8 (17.78%) ETL
7 7 (15.56%) Agile Software Development
7 7 (15.56%) Data Ingestion
7 7 (15.56%) Fintech
8 6 (13.33%) Business Intelligence
9 5 (11.11%) Continuous Integration
9 5 (11.11%) Insurtech
9 5 (11.11%) TDD
10 4 (8.89%) Microservices
10 4 (8.89%) Natural Language Processing
10 4 (8.89%) Performance Tuning
Programming Languages
1 23 (51.11%) Java
2 22 (48.89%) SQL
3 20 (44.44%) Python
4 13 (28.89%) Scala
5 6 (13.33%) C++
6 4 (8.89%) R
7 1 (2.22%) C
7 1 (2.22%) HiveQL
7 1 (2.22%) Perl
7 1 (2.22%) PL/SQL
7 1 (2.22%) Shell Script
7 1 (2.22%) VBA
Qualifications
1 8 (17.78%) Security Cleared
2 7 (15.56%) SC Cleared
3 2 (4.44%) Degree
3 2 (4.44%) DV Cleared
3 2 (4.44%) PhD
4 1 (2.22%) AWS Certification
Quality Assurance & Compliance
1 4 (8.89%) QA
2 1 (2.22%) Data Quality
2 1 (2.22%) SLA
System Software
1 6 (13.33%) HDFS
2 4 (8.89%) Docker
Systems Management
1 4 (8.89%) Hadoop YARN
2 3 (6.67%) Ambari
2 3 (6.67%) Ansible
2 3 (6.67%) Grafana
2 3 (6.67%) Kubernetes
3 1 (2.22%) Oozie
3 1 (2.22%) Terraform
Vendors
1 9 (20.00%) Talend
2 8 (17.78%) Cloudera
3 4 (8.89%) Oracle
4 2 (4.44%) Hortonworks
4 2 (4.44%) Informatica
5 1 (2.22%) Cognos
5 1 (2.22%) Databricks
5 1 (2.22%) IBM
5 1 (2.22%) SAP