Period
to 3 March 2021

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 3 March 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
3 Mar 2021
Same period 2020 Same period 2019
Rank 96 126 95
Rank change year-on-year +30 -31 +7
Contract jobs citing Hadoop 36 72 180
As % of all contract jobs advertised in the City of London 1.59% 1.56% 2.68%
As % of the Database & Business Intelligence category 7.11% 6.69% 10.50%
Number of daily rates quoted 28 55 143
Median daily rate £575 £575 £575
10th Percentile £411 £435 £513
90th Percentile £638 £719 £725
Central London median daily rate £575 £575 £575
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 506 1,076 1,715
As % of all contract IT jobs advertised in the City of London 22.37% 23.36% 25.49%
Number of daily rates quoted 370 838 1,372
Median daily rate £550 £510 £537
Median daily rate % change year-on-year +7.84% -4.96% +2.21%
10th Percentile £337 £363 £400
90th Percentile £689 £675 £675
Central London median daily rate £528 £500 £525
% change year-on-year +5.50% -4.76% +2.44%
Number of hourly rates quoted 1 4 6
Median hourly rate £23.45 £25.00 £36.05
Median hourly rate % change year-on-year -6.20% -30.64% +29.89%
10th Percentile £21.73 £22.17 £26.88
90th Percentile £25.18 £35.13 £49.35
Median hourly rate £42.98 £25.00 £35.00
% change year-on-year +71.90% -28.57% +26.13%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Hadoop in the City of London.

Daily rate trend for Hadoop in the City of London

Hadoop
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Hadoop in the City of London over the 6 months to 3 March 2021.

Daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Hadoop in the City of London.

Hourly rate trend for Hadoop in the City of London

For the 6 months to 3 March 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 27 (75.00%) Apache Spark
2 23 (63.89%) SQL
2 23 (63.89%) Big Data
3 22 (61.11%) AWS
4 15 (41.67%) Data Lake
4 15 (41.67%) Java
5 14 (38.89%) Python
5 14 (38.89%) NoSQL
6 13 (36.11%) Amazon Redshift
7 12 (33.33%) Analytics
7 12 (33.33%) Data Warehouse
7 12 (33.33%) Apache
8 11 (30.56%) Data Science
9 10 (27.78%) Cloudera
10 9 (25.00%) Data Transformation
10 9 (25.00%) Relational Database
10 9 (25.00%) Apache Hive
10 9 (25.00%) ETL
10 9 (25.00%) Apache Airflow
11 8 (22.22%) Scala
11 8 (22.22%) DevOps
11 8 (22.22%) Analytical Skills
11 8 (22.22%) Talend
11 8 (22.22%) Kafka
12 7 (19.44%) Amazon RDS
12 7 (19.44%) Amazon EC2
12 7 (19.44%) Security Cleared
12 7 (19.44%) Azure
12 7 (19.44%) Data Modelling
12 7 (19.44%) Business Intelligence

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 27 (75.00%) Apache Spark
2 12 (33.33%) Apache
3 9 (25.00%) Apache Airflow
4 3 (8.33%) SAS
5 1 (2.78%) Confluence
5 1 (2.78%) Elasticsearch
Applications
1 1 (2.78%) Chatbot
1 1 (2.78%) Microsoft Excel
Cloud Services
1 22 (61.11%) AWS
2 7 (19.44%) Amazon EC2
2 7 (19.44%) Azure
3 5 (13.89%) Amazon EMR
4 4 (11.11%) Amazon S3
5 1 (2.78%) Amazon Cognito
5 1 (2.78%) Amazon SageMaker
5 1 (2.78%) AWS Lambda
5 1 (2.78%) Azure Data Factory
5 1 (2.78%) Cloud Computing
5 1 (2.78%) GCP
5 1 (2.78%) IaaS
5 1 (2.78%) PaaS
5 1 (2.78%) Power Platform
5 1 (2.78%) Serverless
Communications & Networking
1 1 (2.78%) Remote Desktop
Database & Business Intelligence
1 23 (63.89%) Big Data
2 15 (41.67%) Data Lake
3 14 (38.89%) NoSQL
4 13 (36.11%) Amazon Redshift
5 12 (33.33%) Data Warehouse
6 9 (25.00%) Apache Hive
6 9 (25.00%) Relational Database
7 7 (19.44%) Amazon RDS
8 6 (16.67%) Spark SQL
9 4 (11.11%) Impala
10 3 (8.33%) PostgreSQL
11 2 (5.56%) Presto
11 2 (5.56%) RDBMS
11 2 (5.56%) SAS EBI
12 1 (2.78%) Amazon QuickSight
12 1 (2.78%) MySQL
12 1 (2.78%) Power BI
12 1 (2.78%) Sisense
12 1 (2.78%) SQL Server
12 1 (2.78%) Sqoop
Development Applications
1 5 (13.89%) JIRA
2 2 (5.56%) Git (software)
2 2 (5.56%) Jenkins
3 1 (2.78%) Bitbucket
3 1 (2.78%) Cucumber
3 1 (2.78%) MLflow
3 1 (2.78%) Selenium
General
1 7 (19.44%) Finance
2 4 (11.11%) Banking
3 2 (5.56%) Games
3 2 (5.56%) Marketing
4 1 (2.78%) Italian Language
Job Titles
1 21 (58.33%) Data Engineer
2 11 (30.56%) AWS Engineer
3 7 (19.44%) Architect
3 7 (19.44%) Big Data Engineer
4 5 (13.89%) Developer
4 5 (13.89%) Hadoop Engineer
5 2 (5.56%) Consultant
5 2 (5.56%) Data Architect
5 2 (5.56%) DevOps Engineer
5 2 (5.56%) ETL Developer
5 2 (5.56%) Java Developer
5 2 (5.56%) Lead Architect
5 2 (5.56%) Lead DevOps
5 2 (5.56%) Lead DevOps Engineer
5 2 (5.56%) Pega Architect
5 2 (5.56%) Platform Engineer
5 2 (5.56%) Solutions Architect
6 1 (2.78%) Cloud Architect
6 1 (2.78%) Data Scientist
6 1 (2.78%) Platform Architect
Libraries, Frameworks & Software Standards
1 8 (22.22%) Kafka
2 3 (8.33%) GraphX
2 3 (8.33%) MLlib
2 3 (8.33%) PySpark
3 2 (5.56%) JSON
3 2 (5.56%) XML
4 1 (2.78%) Django
4 1 (2.78%) Natural Language Processing
4 1 (2.78%) RabbitMQ
4 1 (2.78%) TensorFlow
Miscellaneous
1 8 (22.22%) Analytical Skills
2 4 (11.11%) Algorithms
3 2 (5.56%) Cloud Native
3 2 (5.56%) Data Structures
4 1 (2.78%) Public Cloud
4 1 (2.78%) Video\Live Streaming
Operating Systems
1 5 (13.89%) Linux
2 2 (5.56%) Windows
3 1 (2.78%) Unix
Processes & Methodologies
1 12 (33.33%) Analytics
2 11 (30.56%) Data Science
3 9 (25.00%) Data Transformation
3 9 (25.00%) ETL
4 8 (22.22%) DevOps
5 7 (19.44%) Business Intelligence
5 7 (19.44%) Data Modelling
6 6 (16.67%) Data Ingestion
7 5 (13.89%) Agile Software Development
7 5 (13.89%) Continuous Integration
7 5 (13.89%) Insurtech
7 5 (13.89%) Machine Learning
7 5 (13.89%) Performance Tuning
8 4 (11.11%) Data Engineering
8 4 (11.11%) Data Integration
8 4 (11.11%) Fintech
8 4 (11.11%) TDD
9 3 (8.33%) Data Management
9 3 (8.33%) Performance Testing
9 3 (8.33%) Resource Allocation
Programming Languages
1 23 (63.89%) SQL
2 15 (41.67%) Java
3 14 (38.89%) Python
4 8 (22.22%) Scala
5 2 (5.56%) C++
6 1 (2.78%) HiveQL
6 1 (2.78%) Kotlin
6 1 (2.78%) Perl
6 1 (2.78%) PL/SQL
6 1 (2.78%) R
6 1 (2.78%) Shell Script
6 1 (2.78%) VBA
Qualifications
1 7 (19.44%) Security Cleared
2 6 (16.67%) SC Cleared
3 1 (2.78%) AWS Certification
3 1 (2.78%) Degree
3 1 (2.78%) PhD
3 1 (2.78%) TOGAF Certification
Quality Assurance & Compliance
1 4 (11.11%) QA
2 1 (2.78%) GDPR
2 1 (2.78%) IFRS
2 1 (2.78%) MiFID
2 1 (2.78%) Solvency II
System Software
1 6 (16.67%) HDFS
2 1 (2.78%) Docker
Systems Management
1 3 (8.33%) Ambari
1 3 (8.33%) Grafana
1 3 (8.33%) Hadoop YARN
2 1 (2.78%) Ansible
2 1 (2.78%) Kubeflow
2 1 (2.78%) Terraform
Vendors
1 10 (27.78%) Cloudera
2 8 (22.22%) Talend
3 4 (11.11%) Oracle
4 3 (8.33%) Hortonworks
4 3 (8.33%) Informatica
5 2 (5.56%) Pega
6 1 (2.78%) Databricks
6 1 (2.78%) EMC
6 1 (2.78%) Google
6 1 (2.78%) NetApp