Period
to 5 August 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 5 August 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
5 Aug 2020
Same period 2019 Same period 2018
Rank 93 90 80
Rank change year-on-year -3 -10 -7
Contract jobs citing Hadoop 42 175 209
As % of all contract jobs advertised in the City of London 1.84% 2.69% 3.00%
As % of the Database & Business Intelligence category 7.19% 10.05% 11.62%
Number of daily rates quoted 23 141 182
Median daily rate £550 £575 £575
Median daily rate % change year-on-year -4.35% - +4.55%
10th Percentile £280 £500 £463
90th Percentile £645 £700 £711
Central London median daily rate £550 £563 £575
% change year-on-year -2.22% -2.17% +4.55%
Number of hourly rates quoted 0 3 0
Median hourly rate - £44.57 -
Central London median hourly rate - £44.57 -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 584 1,742 1,799
As % of all contract IT jobs advertised in the City of London 25.57% 26.78% 25.80%
Number of daily rates quoted 403 1,382 1,434
Median daily rate £513 £525 £525
Median daily rate % change year-on-year -2.38% - +2.44%
10th Percentile £375 £398 £367
90th Percentile £688 £675 £688
Central London median daily rate £518 £525 £525
% change year-on-year -1.43% - +5.00%
Number of hourly rates quoted 10 12 13
Median hourly rate £35.00 £46.85 £22.00
Median hourly rate % change year-on-year -25.29% +112.94% -4.32%
10th Percentile £21.35 £23.28 £19.50
90th Percentile £40.10 £60.33 £33.00
Median hourly rate £35.00 £35.00 £22.25
% change year-on-year - +57.30% -3.23%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Hadoop in the City of London.

Daily rate trend for Hadoop in the City of London

Hadoop
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Hadoop in the City of London over the 6 months to 5 August 2020.

Daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Hadoop in the City of London.

Hourly rate trend for Hadoop in the City of London

For the 6 months to 5 August 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 27 (64.29%) Python
2 22 (52.38%) Apache Spark
3 21 (50.00%) Big Data
4 18 (42.86%) AWS
5 16 (38.10%) Java
6 13 (30.95%) SQL
7 12 (28.57%) Agile Software Development
8 11 (26.19%) Cloudera
9 10 (23.81%) DevOps
9 10 (23.81%) GCP
9 10 (23.81%) Kubernetes
10 9 (21.43%) Scala
10 9 (21.43%) Degree
11 8 (19.05%) Mathematics
11 8 (19.05%) Investment Banking
11 8 (19.05%) Banking
11 8 (19.05%) Finance
11 8 (19.05%) Scrum
11 8 (19.05%) ETL
11 8 (19.05%) Terraform
11 8 (19.05%) TensorFlow
11 8 (19.05%) Amazon Redshift
11 8 (19.05%) Analytics
12 7 (16.67%) Jenkins
12 7 (16.67%) Data Warehouse
12 7 (16.67%) TDD
12 7 (16.67%) Economics
12 7 (16.67%) Google
12 7 (16.67%) Computer Science
12 7 (16.67%) BDD

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 22 (52.38%) Apache Spark
2 6 (14.29%) SAS
3 2 (4.76%) Apache
4 1 (2.38%) Elasticsearch
4 1 (2.38%) R Markdown
Cloud Services
1 18 (42.86%) AWS
2 10 (23.81%) GCP
3 7 (16.67%) Azure
4 6 (14.29%) Serverless
5 3 (7.14%) Amazon Kinesis
5 3 (7.14%) AWS Lambda
6 2 (4.76%) Amazon CloudWatch
6 2 (4.76%) Power Platform
7 1 (2.38%) AWS CloudFormation
7 1 (2.38%) Azure Data Factory
7 1 (2.38%) Data Lake Analytics
Communications & Networking
1 2 (4.76%) TCP/IP
Database & Business Intelligence
1 21 (50.00%) Big Data
2 8 (19.05%) Amazon Redshift
3 7 (16.67%) Data Warehouse
4 6 (14.29%) BigQuery
5 4 (9.52%) Apache Hive
5 4 (9.52%) Data Lake
5 4 (9.52%) NoSQL
5 4 (9.52%) SQL Server
6 3 (7.14%) Impala
6 3 (7.14%) Relational Database
6 3 (7.14%) SAS EBI
7 2 (4.76%) Apache Cassandra
7 2 (4.76%) Azure SQL Data Warehouse
7 2 (4.76%) Azure SQL Database
7 2 (4.76%) Data Mining
7 2 (4.76%) MongoDB
7 2 (4.76%) Neo4j
7 2 (4.76%) Parquet
7 2 (4.76%) Power BI
7 2 (4.76%) SQL Server Reporting Services
Development Applications
1 7 (16.67%) Jenkins
2 3 (7.14%) Git (software)
2 3 (7.14%) Maven
3 2 (4.76%) Atlassian Bamboo
3 2 (4.76%) TeamCity
4 1 (2.38%) Artifactory
4 1 (2.38%) Bitbucket
General
1 8 (19.05%) Banking
1 8 (19.05%) Finance
1 8 (19.05%) Investment Banking
2 6 (14.29%) Front Office
3 5 (11.90%) Marketing
4 3 (7.14%) Telecoms
5 2 (4.76%) Law
5 2 (4.76%) Retail
Job Titles
1 14 (33.33%) Developer
2 10 (23.81%) Data Engineer
3 8 (19.05%) Java Developer
4 6 (14.29%) Agile Developer
4 6 (14.29%) Agile Java Developer
4 6 (14.29%) Architect
4 6 (14.29%) DevOps Engineer
5 5 (11.90%) AWS Engineer
6 4 (9.52%) AWS DevOps
6 4 (9.52%) Python Engineer
7 3 (7.14%) AWS DevOps Engineer
7 3 (7.14%) Consultant
7 3 (7.14%) Data Scientist
7 3 (7.14%) DevOps Consultant
8 2 (4.76%) Analyst
8 2 (4.76%) AWS Architect
8 2 (4.76%) Cloud Engineer
8 2 (4.76%) Data Architect
8 2 (4.76%) Lead Architect
8 2 (4.76%) Security Architect
Libraries, Frameworks & Software Standards
1 8 (19.05%) TensorFlow
2 4 (9.52%) Kafka
3 3 (7.14%) .NET
3 3 (7.14%) H2O
3 3 (7.14%) PySpark
3 3 (7.14%) RESTful
3 3 (7.14%) scikit-learn
3 3 (7.14%) Web Services
4 2 (4.76%) Apache Avro
4 2 (4.76%) Elastic Stack
4 2 (4.76%) Natural Language Processing
4 2 (4.76%) Serverless Framework
4 2 (4.76%) Spring
4 2 (4.76%) XML
5 1 (2.38%) Anaconda
5 1 (2.38%) AngularJS
5 1 (2.38%) D3.js
5 1 (2.38%) Pandas
5 1 (2.38%) SailPoint
5 1 (2.38%) Spark Streaming
Miscellaneous
1 2 (4.76%) Algorithms
1 2 (4.76%) Analytical Skills
1 2 (4.76%) Credit Risk
1 2 (4.76%) Management Information System
1 2 (4.76%) Market Risk
1 2 (4.76%) Public Cloud
2 1 (2.38%) Enterprise Software
2 1 (2.38%) Greenfield Project
2 1 (2.38%) Hybrid Cloud
2 1 (2.38%) Robotics
2 1 (2.38%) Tandem
2 1 (2.38%) Taxonomies
Operating Systems
1 5 (11.90%) Linux
2 1 (2.38%) Unix
Processes & Methodologies
1 12 (28.57%) Agile Software Development
2 10 (23.81%) DevOps
3 8 (19.05%) Analytics
3 8 (19.05%) ETL
3 8 (19.05%) Mathematics
3 8 (19.05%) Scrum
4 7 (16.67%) BDD
4 7 (16.67%) Computer Science
4 7 (16.67%) Economics
4 7 (16.67%) TDD
5 6 (14.29%) Business Intelligence
6 5 (11.90%) Data Architecture
6 5 (11.90%) Data Integration
6 5 (11.90%) Data Modelling
7 4 (9.52%) Data Engineering
7 4 (9.52%) Data Science
7 4 (9.52%) Visualisation
8 3 (7.14%) Machine Learning
8 3 (7.14%) Market Research
8 3 (7.14%) Microservices
Programming Languages
1 27 (64.29%) Python
2 16 (38.10%) Java
3 13 (30.95%) SQL
4 9 (21.43%) Scala
5 5 (11.90%) R
6 4 (9.52%) C#
7 3 (7.14%) Go
7 3 (7.14%) PHP
7 3 (7.14%) Ruby
8 2 (4.76%) Java 8
8 2 (4.76%) JavaScript
8 2 (4.76%) PowerShell
9 1 (2.38%) Bash Shell
9 1 (2.38%) BeanShell
9 1 (2.38%) Data Analysis Expressions (DAX)
Qualifications
1 9 (21.43%) Degree
2 6 (14.29%) Numerate Degree
2 6 (14.29%) SC Cleared
2 6 (14.29%) Security Cleared
3 2 (4.76%) AWS Certification
4 1 (2.38%) Master's Degree
Quality Assurance & Compliance
1 1 (2.38%) CDISC
1 1 (2.38%) Data Quality
System Software
1 5 (11.90%) Docker
2 4 (9.52%) HDFS
3 2 (4.76%) Apache Flume
Systems Management
1 10 (23.81%) Kubernetes
2 8 (19.05%) Terraform
3 5 (11.90%) Ansible
4 3 (7.14%) Puppet
5 2 (4.76%) Kubeflow
6 1 (2.38%) Hadoop YARN
6 1 (2.38%) Oozie
Vendors
1 11 (26.19%) Cloudera
2 7 (16.67%) Google
3 4 (9.52%) Tableau
4 3 (7.14%) Informatica
4 3 (7.14%) Splunk
5 2 (4.76%) MapR
5 2 (4.76%) Microsoft
5 2 (4.76%) New Relic
5 2 (4.76%) Oracle
5 2 (4.76%) Pega
6 1 (2.38%) Databricks
6 1 (2.38%) IBM
6 1 (2.38%) ServiceNow