Period
to 8 April 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 8 April 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
8 Apr 2020
Same period 2019 Same period 2018
Rank 122 88 108
Rank change year-on-year -34 +20 -50
Contract jobs citing Hadoop 59 185 170
As % of all contract jobs advertised in the City of London 1.43% 2.71% 2.39%
As % of the Database & Business Intelligence category 6.05% 10.53% 9.60%
Number of daily rates quoted 39 141 145
Median daily rate £575 £575 £588
Median daily rate % change year-on-year - -2.13% +2.17%
10th Percentile £385 £513 £469
90th Percentile £700 £725 £715
Central London median daily rate £575 £550 £563
% change year-on-year +4.55% -2.22% -2.17%
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 975 1,757 1,770
As % of all contract IT jobs advertised in the City of London 23.60% 25.72% 24.91%
Number of daily rates quoted 726 1,394 1,492
Median daily rate £500 £534 £525
Median daily rate % change year-on-year -6.32% +1.67% +6.87%
10th Percentile £363 £402 £363
90th Percentile £675 £675 £677
Central London median daily rate £500 £525 £513
% change year-on-year -4.76% +2.44% +7.89%
Number of hourly rates quoted 6 6 9
Median hourly rate £35.00 £35.00 £22.50
Median hourly rate % change year-on-year - +55.56% +0.74%
10th Percentile £24.50 £27.38 £20.06
90th Percentile £37.13 £56.50 £38.41
Median hourly rate £35.00 £28.75 £27.50
% change year-on-year +21.74% +4.55% +23.13%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Hadoop in the City of London.

Daily rate trend for Hadoop in the City of London

Hadoop
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Hadoop in the City of London over the 6 months to 8 April 2020.

Daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Hadoop in the City of London.

Hourly rate trend for Hadoop in the City of London

For the 6 months to 8 April 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 39 (66.10%) Python
2 36 (61.02%) Big Data
3 27 (45.76%) Apache Spark
4 25 (42.37%) SQL
5 21 (35.59%) Java
6 20 (33.90%) DevOps
7 16 (27.12%) Kafka
8 15 (25.42%) AWS
8 15 (25.42%) Agile Software Development
9 14 (23.73%) Scala
10 13 (22.03%) NoSQL
10 13 (22.03%) GCP
11 12 (20.34%) Analytics
11 12 (20.34%) Finance
12 11 (18.64%) Jenkins
12 11 (18.64%) HBase
12 11 (18.64%) Apache Hive
13 10 (16.95%) HDFS
13 10 (16.95%) Kubernetes
13 10 (16.95%) Data Warehouse
13 10 (16.95%) Google
14 9 (15.25%) Business Intelligence
14 9 (15.25%) PySpark
15 8 (13.56%) Data Science
15 8 (13.56%) ETL
15 8 (13.56%) Unix
15 8 (13.56%) Linux
15 8 (13.56%) Marketing
15 8 (13.56%) Spring
15 8 (13.56%) TDD

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 27 (45.76%) Apache Spark
2 4 (6.78%) Apache Airflow
2 4 (6.78%) SAS
3 3 (5.08%) Luigi
4 2 (3.39%) Apache
4 2 (3.39%) Elasticsearch
5 1 (1.69%) Apache Pig
5 1 (1.69%) Oracle Workflow
Business Applications
1 1 (1.69%) SAP Oil and Gas
Cloud Services
1 15 (25.42%) AWS
2 13 (22.03%) GCP
3 7 (11.86%) Azure
4 4 (6.78%) Power Platform
4 4 (6.78%) Serverless
5 3 (5.08%) Amazon Kinesis
6 2 (3.39%) Amazon CloudWatch
6 2 (3.39%) AWS Lambda
7 1 (1.69%) Amazon EMR
7 1 (1.69%) Amazon S3
7 1 (1.69%) Cloud Computing
7 1 (1.69%) Data Lake Analytics
Communications & Networking
1 2 (3.39%) TCP/IP
Database & Business Intelligence
1 36 (61.02%) Big Data
2 13 (22.03%) NoSQL
3 11 (18.64%) Apache Hive
3 11 (18.64%) HBase
4 10 (16.95%) Data Warehouse
5 6 (10.17%) BigQuery
5 6 (10.17%) SQL Server
6 5 (8.47%) Apache Cassandra
6 5 (8.47%) Impala
6 5 (8.47%) MongoDB
6 5 (8.47%) PostgreSQL
7 4 (6.78%) Data Lake
7 4 (6.78%) Power BI
7 4 (6.78%) Relational Database
8 3 (5.08%) Amazon Redshift
8 3 (5.08%) Azkaban
9 2 (3.39%) Data Mining
9 2 (3.39%) MySQL
9 2 (3.39%) Neo4j
9 2 (3.39%) Sisense
Development Applications
1 11 (18.64%) Jenkins
2 6 (10.17%) Git (software)
2 6 (10.17%) JIRA
3 5 (8.47%) Maven
4 4 (6.78%) Travis CI
5 2 (3.39%) Atlassian Bamboo
5 2 (3.39%) Team Foundation Server
5 2 (3.39%) TeamCity
6 1 (1.69%) Eclipse
6 1 (1.69%) JUnit
6 1 (1.69%) PowerDesigner
General
1 12 (20.34%) Finance
2 8 (13.56%) Marketing
3 4 (6.78%) Banking
3 4 (6.78%) Retail Banking
3 4 (6.78%) Telecoms
4 3 (5.08%) Retail
5 2 (3.39%) Investment Banking
6 1 (1.69%) Financial Institution
Job Titles
1 20 (33.90%) Data Engineer
2 14 (23.73%) Developer
3 8 (13.56%) Java Developer
4 6 (10.17%) Analyst
5 5 (8.47%) Hadoop Developer
5 5 (8.47%) Python Engineer
6 4 (6.78%) Architect
6 4 (6.78%) AWS DevOps
6 4 (6.78%) AWS Engineer
6 4 (6.78%) DevOps Engineer
6 4 (6.78%) Java Hadoop Developer
7 3 (5.08%) AWS DevOps Engineer
7 3 (5.08%) Data Analyst
7 3 (5.08%) Data Scientist
8 2 (3.39%) AWS Developer
8 2 (3.39%) Big Data Consultant
8 2 (3.39%) Big Data Engineer
8 2 (3.39%) Data Consultant
8 2 (3.39%) DevOps Consultant
8 2 (3.39%) Kubernetes Consultant
Libraries, Frameworks & Software Standards
1 16 (27.12%) Kafka
2 9 (15.25%) PySpark
3 8 (13.56%) Spring
3 8 (13.56%) TensorFlow
4 7 (11.86%) Spark Streaming
5 4 (6.78%) REST
6 3 (5.08%) RESTful
6 3 (5.08%) scikit-learn
7 2 (3.39%) .NET
7 2 (3.39%) Apache Avro
7 2 (3.39%) Elastic Stack
7 2 (3.39%) Natural Language Processing
7 2 (3.39%) Node.js
7 2 (3.39%) Web Services
8 1 (1.69%) D3.js
8 1 (1.69%) HTML
8 1 (1.69%) Java Concurrency
8 1 (1.69%) JMX
8 1 (1.69%) OAuth
8 1 (1.69%) SailPoint
Miscellaneous
1 6 (10.17%) Data Structures
2 4 (6.78%) Linux Command Line
3 3 (5.08%) Algorithms
3 3 (5.08%) Greenfield Project
4 2 (3.39%) Analytical Skills
4 2 (3.39%) Credit Risk
4 2 (3.39%) Management Information System
4 2 (3.39%) Market Risk
5 1 (1.69%) Enterprise Software
5 1 (1.69%) Equities
5 1 (1.69%) Grid Computing
5 1 (1.69%) Hybrid Cloud
5 1 (1.69%) Public Cloud
5 1 (1.69%) Robotics
5 1 (1.69%) Self-Motivation
5 1 (1.69%) Tandem
5 1 (1.69%) User Experience
Operating Systems
1 8 (13.56%) Linux
1 8 (13.56%) Unix
2 2 (3.39%) Windows
Processes & Methodologies
1 20 (33.90%) DevOps
2 15 (25.42%) Agile Software Development
3 12 (20.34%) Analytics
4 9 (15.25%) Business Intelligence
5 8 (13.56%) Data Science
5 8 (13.56%) ETL
5 8 (13.56%) TDD
6 7 (11.86%) Computer Science
7 6 (10.17%) Actionable Insight
7 6 (10.17%) Microservices
7 6 (10.17%) Performance Optimisation
8 5 (8.47%) Data Architecture
8 5 (8.47%) Data Modelling
8 5 (8.47%) Performance Tuning
8 5 (8.47%) Workflow
9 4 (6.78%) Migration
9 4 (6.78%) OO
9 4 (6.78%) OOP
9 4 (6.78%) Process Improvement
9 4 (6.78%) Service Delivery
Programming Languages
1 39 (66.10%) Python
2 25 (42.37%) SQL
3 21 (35.59%) Java
4 14 (23.73%) Scala
5 8 (13.56%) R
6 3 (5.08%) AWK
6 3 (5.08%) C++
6 3 (5.08%) sed
7 2 (3.39%) C#
7 2 (3.39%) Go
7 2 (3.39%) Java 8
7 2 (3.39%) JavaScript
7 2 (3.39%) PHP
7 2 (3.39%) Ruby
8 1 (1.69%) BeanShell
8 1 (1.69%) MATLAB
8 1 (1.69%) PowerShell
Qualifications
1 3 (5.08%) Security Cleared
2 2 (3.39%) Degree
2 2 (3.39%) SC Cleared
3 1 (1.69%) AWS Certification
3 1 (1.69%) DV Cleared
3 1 (1.69%) Master's Degree
Quality Assurance & Compliance
1 2 (3.39%) Data Quality
System Software
1 10 (16.95%) HDFS
2 5 (8.47%) Docker
3 3 (5.08%) Apache Flume
Systems Management
1 10 (16.95%) Kubernetes
2 7 (11.86%) Hadoop YARN
3 6 (10.17%) Terraform
4 3 (5.08%) Ansible
5 2 (3.39%) Puppet
6 1 (1.69%) Grafana
6 1 (1.69%) ITRS Geneos
6 1 (1.69%) Kibana
6 1 (1.69%) Kubeflow
6 1 (1.69%) Prometheus
Vendors
1 10 (16.95%) Google
2 7 (11.86%) Tableau
3 4 (6.78%) MapR
3 4 (6.78%) Oracle
3 4 (6.78%) Splunk
4 3 (5.08%) Cloudera
4 3 (5.08%) Informatica
4 3 (5.08%) Microsoft
5 2 (3.39%) New Relic
5 2 (3.39%) SAP
5 2 (3.39%) Teradata
6 1 (1.69%) Hortonworks
6 1 (1.69%) Okta
6 1 (1.69%) Palantir
6 1 (1.69%) Pega
6 1 (1.69%) ServiceNow
6 1 (1.69%) Talend