Period
to 21 September 2021

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 21 September 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
21 Sep 2021
Same period 2020 Same period 2019
Rank 123 82 93
Rank change year-on-year -41 +11 -10
Contract jobs citing Hadoop 51 35 167
As % of all contract jobs advertised in the City of London 1.40% 1.99% 2.69%
As % of the Database & Business Intelligence category 6.42% 7.35% 10.39%
Number of daily rates quoted 43 17 139
10th Percentile £488 £406 £500
25th Percentile £513 £410 £525
Median daily rate (50th Percentile) £585 £550 £575
Median % change year-on-year +6.36% -4.35% -
75th Percentile £675 £600 £638
90th Percentile £840 £635 £700
Central London median daily rate £585 £550 £563
% change year-on-year +6.36% -2.22% -2.17%
Number of hourly rates quoted 0 0 3
Median hourly rate - - £44.57
Central London median hourly rate - - £44.57

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 794 476 1,608
As % of all contract IT jobs advertised in the City of London 21.78% 27.09% 25.94%
Number of daily rates quoted 577 355 1,287
10th Percentile £366 £387 £388
25th Percentile £463 £431 £456
Median daily rate (50th Percentile) £550 £525 £525
Median % change year-on-year +4.76% - -
75th Percentile £650 £603 £618
90th Percentile £725 £688 £688
Central London median daily rate £550 £525 £525
% change year-on-year +4.76% - -
Number of hourly rates quoted 8 6 8
10th Percentile " £18.50 £17.89
25th Percentile £8.00 £20.50 £21.23
Median hourly rate £15.25 £29.75 £28.75
Median % change year-on-year -48.74% +3.48% +27.78%
75th Percentile £33.69 £39.00 £47.42
90th Percentile £43.33 £43.50 £51.04
Central London median hourly rate £17.00 £29.75 £28.75
% change year-on-year -42.86% +3.48% +27.78%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Hadoop in the City of London.

Daily rate trend for Hadoop in the City of London

Hadoop
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Hadoop in the City of London over the 6 months to 21 September 2021.

Daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Hadoop in the City of London.

Hourly rate trend for Hadoop in the City of London

For the 6 months to 21 September 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 38 (74.51%) Apache Spark
2 25 (49.02%) Big Data
3 24 (47.06%) SQL
4 22 (43.14%) Python
5 20 (39.22%) Java
6 17 (33.33%) AWS
6 17 (33.33%) Analytics
7 16 (31.37%) Apache Hive
8 14 (27.45%) Computer Science
8 14 (27.45%) Data Modelling
8 14 (27.45%) Machine Learning
8 14 (27.45%) Kafka
9 13 (25.49%) DevOps
9 13 (25.49%) Data Science
10 12 (23.53%) Data Pipeline
10 12 (23.53%) Data Engineering
10 12 (23.53%) Scala
11 11 (21.57%) Analytical Skills
12 10 (19.61%) Algorithms
12 10 (19.61%) GCP
12 10 (19.61%) Tableau
12 10 (19.61%) Visualisation
12 10 (19.61%) Artificial Intelligence
13 9 (17.65%) Banking
13 9 (17.65%) C++
13 9 (17.65%) Azure
14 8 (15.69%) Natural Language Processing
14 8 (15.69%) SQL Server
14 8 (15.69%) Apache
14 8 (15.69%) Agile Software Development

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 38 (74.51%) Apache Spark
2 8 (15.69%) Apache
2 8 (15.69%) Elasticsearch
3 5 (9.80%) Apache Airflow
4 3 (5.88%) SAS
5 2 (3.92%) Confluence
Cloud Services
1 17 (33.33%) AWS
2 10 (19.61%) GCP
3 9 (17.65%) Azure
4 7 (13.73%) Amazon EMR
5 5 (9.80%) Amazon EC2
6 4 (7.84%) Amazon ECS
6 4 (7.84%) Amazon EKS
6 4 (7.84%) Amazon S3
6 4 (7.84%) Route 53
6 4 (7.84%) Serverless
7 2 (3.92%) AWS CloudFormation
7 2 (3.92%) AWS Lambda
7 2 (3.92%) AWS Step Functions
7 2 (3.92%) Azure Cosmos DB
7 2 (3.92%) Datadog
8 1 (1.96%) Amazon CloudWatch
8 1 (1.96%) GitHub
8 1 (1.96%) Google Data Studio
8 1 (1.96%) IaaS
8 1 (1.96%) Virtual Private Cloud
Communications & Networking
1 4 (7.84%) DNS
2 1 (1.96%) Firewall
2 1 (1.96%) Kerberos
2 1 (1.96%) LAN
2 1 (1.96%) Multicast
2 1 (1.96%) WAN
Database & Business Intelligence
1 25 (49.02%) Big Data
2 16 (31.37%) Apache Hive
3 10 (19.61%) Tableau
4 8 (15.69%) Data Lake
4 8 (15.69%) SQL Server
5 7 (13.73%) Apache Cassandra
6 6 (11.76%) Impala
7 4 (7.84%) BigQuery
7 4 (7.84%) Data Mining
7 4 (7.84%) Data Warehouse
7 4 (7.84%) HBase
7 4 (7.84%) MySQL
7 4 (7.84%) NoSQL
7 4 (7.84%) PostgreSQL
7 4 (7.84%) Presto
8 3 (5.88%) Flink
8 3 (5.88%) MongoDB
8 3 (5.88%) Relational Database
9 2 (3.92%) Amazon Athena
9 2 (3.92%) Delta Lake
Development Applications
1 2 (3.92%) Jenkins
1 2 (3.92%) JIRA
2 1 (1.96%) Git (software)
2 1 (1.96%) GitLab
2 1 (1.96%) JUnit
2 1 (1.96%) Maven
2 1 (1.96%) Mockito
2 1 (1.96%) Subversion
2 1 (1.96%) Visual Studio
2 1 (1.96%) Visual Studio Team System
General
1 11 (21.57%) Analytical Skills
2 9 (17.65%) Banking
3 8 (15.69%) Finance
4 6 (11.76%) Social Skills
5 3 (5.88%) Presentation Skills
6 2 (3.92%) Games
6 2 (3.92%) Investment Banking
7 1 (1.96%) Advertising
7 1 (1.96%) Documentation Skills
7 1 (1.96%) Financial Institution
7 1 (1.96%) Legal
7 1 (1.96%) Public Sector
Job Titles
1 16 (31.37%) Data Engineer
2 10 (19.61%) Developer
3 8 (15.69%) Data Scientist
4 7 (13.73%) Architect
5 6 (11.76%) Senior Data Scientist
6 5 (9.80%) Java Developer
7 4 (7.84%) Big Data Engineer
7 4 (7.84%) DevOps Engineer
7 4 (7.84%) Senior Data Engineer
8 2 (3.92%) AWS Engineer
8 2 (3.92%) Business Intelligence Architect
9 1 (1.96%) Analyst
9 1 (1.96%) Business Architect
9 1 (1.96%) Consultant
9 1 (1.96%) Data Analyst
9 1 (1.96%) Data Consultant
9 1 (1.96%) Java Engineer
9 1 (1.96%) Security Architect
9 1 (1.96%) Senior Architect
9 1 (1.96%) Senior Java Engineer
Libraries, Frameworks & Software Standards
1 14 (27.45%) Kafka
2 5 (9.80%) Spring
3 4 (7.84%) PySpark
3 4 (7.84%) Web Services
4 3 (5.88%) JMS
4 3 (5.88%) JSON
4 3 (5.88%) TensorFlow
5 2 (3.92%) Apache Avro
5 2 (3.92%) Apache NiFi
5 2 (3.92%) JDBC
5 2 (3.92%) RabbitMQ
5 2 (3.92%) Spark Streaming
6 1 (1.96%) Akka
6 1 (1.96%) Dropwizard
6 1 (1.96%) HTML
6 1 (1.96%) PyArrow
6 1 (1.96%) RESTful
6 1 (1.96%) Spring Boot
6 1 (1.96%) XML
Miscellaneous
1 10 (19.61%) Algorithms
2 4 (7.84%) Data Structures
2 4 (7.84%) PKI
3 2 (3.92%) Hybrid Cloud
4 1 (1.96%) Credit Risk
4 1 (1.96%) Hedge funds
4 1 (1.96%) Market Risk
4 1 (1.96%) Replication
4 1 (1.96%) User Experience
Operating Systems
1 2 (3.92%) Unix
2 1 (1.96%) Linux
Processes & Methodologies
1 17 (33.33%) Analytics
2 14 (27.45%) Computer Science
2 14 (27.45%) Data Modelling
2 14 (27.45%) Machine Learning
3 13 (25.49%) Data Science
3 13 (25.49%) DevOps
4 12 (23.53%) Data Engineering
4 12 (23.53%) Data Pipeline
5 10 (19.61%) Artificial Intelligence
5 10 (19.61%) Visualisation
6 8 (15.69%) Agile Software Development
6 8 (15.69%) Natural Language Processing
7 7 (13.73%) Data Ingestion
7 7 (13.73%) Statistics
8 6 (11.76%) Business Intelligence
8 6 (11.76%) Data Cleansing
8 6 (11.76%) ETL
8 6 (11.76%) Mathematics
8 6 (11.76%) Microservices
8 6 (11.76%) Migration
Programming Languages
1 24 (47.06%) SQL
2 22 (43.14%) Python
3 20 (39.22%) Java
4 12 (23.53%) Scala
5 9 (17.65%) C++
6 5 (9.80%) C
7 4 (7.84%) R
8 2 (3.92%) JavaScript
8 2 (3.92%) Shell Script
9 1 (1.96%) Bash Shell
9 1 (1.96%) C#
9 1 (1.96%) CQL
9 1 (1.96%) Java 8
9 1 (1.96%) Perl
9 1 (1.96%) TypeScript
Qualifications
1 7 (13.73%) Degree
2 3 (5.88%) Security Cleared
3 2 (3.92%) Computer Science Degree
3 2 (3.92%) DV Cleared
3 2 (3.92%) PhD
3 2 (3.92%) SC Cleared
Quality Assurance & Compliance
1 3 (5.88%) Data Quality
2 2 (3.92%) GDPR
3 1 (1.96%) SLA
System Software
1 8 (15.69%) Docker
2 2 (3.92%) HDFS
Systems Management
1 4 (7.84%) Prometheus
1 4 (7.84%) Terraform
2 3 (5.88%) Kubernetes
3 2 (3.92%) Ansible
3 2 (3.92%) Hadoop YARN
4 1 (1.96%) Oozie
Vendors
1 5 (9.80%) Cloudera
1 5 (9.80%) Splunk
2 3 (5.88%) Google
3 2 (3.92%) Alteryx
3 2 (3.92%) AppDynamics
3 2 (3.92%) Confluent
3 2 (3.92%) Databricks
3 2 (3.92%) Hortonworks
3 2 (3.92%) Microsoft
3 2 (3.92%) Oracle
4 1 (1.96%) Ab Initio
4 1 (1.96%) Cognizant
4 1 (1.96%) Informatica
4 1 (1.96%) SAP