Period
to 24 May 2020

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 24 May 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
London > Central London
6 months to
24 May 2020
Same period 2019 Same period 2018
Rank 122 85 99
Rank change year-on-year -37 +14 -15
Contract jobs citing Hadoop 50 251 246
As % of all contract jobs advertised in Central London 1.28% 2.95% 2.69%
As % of the Database & Business Intelligence category 5.25% 11.49% 10.68%
Number of daily rates quoted 35 190 217
Median daily rate £588 £550 £550
Median daily rate % change year-on-year +6.82% - -2.22%
10th Percentile £355 £513 £463
90th Percentile £713 £700 £688
London median daily rate £550 £575 £550
% change year-on-year -4.35% +4.55% -
Number of hourly rates quoted 0 3 0
Median hourly rate - £44.57 -
London median hourly rate £35.00 £42.50 £82.50
% change year-on-year -17.65% -48.48% -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 952 2,185 2,304
As % of all contract IT jobs advertised in Central London 24.40% 25.72% 25.19%
Number of daily rates quoted 677 1,712 1,864
Median daily rate £500 £525 £513
Median daily rate % change year-on-year -4.76% +2.44% +4.59%
10th Percentile £363 £388 £363
90th Percentile £675 £675 £650
London median daily rate £525 £525 £513
% change year-on-year - +2.44% +4.59%
Number of hourly rates quoted 13 14 13
Median hourly rate £35.00 £35.00 £30.00
Median hourly rate % change year-on-year - +16.67% +34.32%
10th Percentile £24.50 £20.00 £21.00
90th Percentile £38.40 £56.50 £37.60
Median hourly rate £35.00 £35.00 £30.00
% change year-on-year - +16.67% -3.23%

Hadoop
Job Vacancy Trend in Central London

Job postings citing Hadoop as a proportion of all IT jobs advertised in Central London.

Job vacancy trend for Hadoop in Central London

Hadoop
Contractor Daily Rate Trend in Central London

3-month moving average daily rate quoted in jobs citing Hadoop in Central London.

Daily rate trend for Hadoop in Central London

Hadoop
Daily Rate Histogram in Central London

Daily rate distribution for jobs citing Hadoop in Central London over the 6 months to 24 May 2020.

Daily rate histogram for Hadoop in Central London

Hadoop
Contractor Hourly Rate Trend in Central London

3-month moving average hourly rates quoted in jobs citing Hadoop in Central London.

Hourly rate trend for Hadoop in Central London

Hadoop
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the Central London region over the 6 months to 24 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London -32 44 £575 +4.55% 16
City of Westminster +27 3 £675 +12.50%
Hadoop
London

For the 6 months to 24 May 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Hadoop.

1 34 (68.00%) Python
2 28 (56.00%) Big Data
3 26 (52.00%) Apache Spark
4 17 (34.00%) SQL
4 17 (34.00%) AWS
5 16 (32.00%) Java
6 15 (30.00%) DevOps
7 14 (28.00%) Analytics
7 14 (28.00%) GCP
8 13 (26.00%) Kafka
9 12 (24.00%) Finance
9 12 (24.00%) Agile Software Development
10 11 (22.00%) Apache Hive
11 10 (20.00%) Google
11 10 (20.00%) Scala
12 9 (18.00%) TensorFlow
12 9 (18.00%) HDFS
12 9 (18.00%) Kubernetes
13 8 (16.00%) NoSQL
13 8 (16.00%) R
13 8 (16.00%) Jenkins
13 8 (16.00%) Spring
13 8 (16.00%) Data Warehouse
13 8 (16.00%) ETL
13 8 (16.00%) PySpark
14 7 (14.00%) Linux
14 7 (14.00%) Data Architecture
14 7 (14.00%) Azure
14 7 (14.00%) HBase
15 6 (12.00%) Cloudera

Hadoop
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 26 (52.00%) Apache Spark
2 4 (8.00%) SAS
3 2 (4.00%) Apache
3 2 (4.00%) Apache Airflow
4 1 (2.00%) Apache Pig
4 1 (2.00%) Apache Pulsar
4 1 (2.00%) Elasticsearch
4 1 (2.00%) Luigi
4 1 (2.00%) Oracle Workflow
Business Applications
1 2 (4.00%) SAP Oil and Gas
Cloud Services
1 17 (34.00%) AWS
2 14 (28.00%) GCP
3 7 (14.00%) Azure
4 6 (12.00%) Serverless
5 5 (10.00%) Amazon Kinesis
5 5 (10.00%) AWS Lambda
6 2 (4.00%) Amazon CloudWatch
6 2 (4.00%) Data Lake Analytics
7 1 (2.00%) Power Platform
Communications & Networking
1 2 (4.00%) TCP/IP
Database & Business Intelligence
1 28 (56.00%) Big Data
2 11 (22.00%) Apache Hive
3 8 (16.00%) Data Warehouse
3 8 (16.00%) NoSQL
4 7 (14.00%) HBase
5 6 (12.00%) Amazon Redshift
5 6 (12.00%) Apache Cassandra
5 6 (12.00%) BigQuery
5 6 (12.00%) Data Lake
5 6 (12.00%) SQL Server
6 5 (10.00%) Impala
7 3 (6.00%) MongoDB
7 3 (6.00%) PostgreSQL
7 3 (6.00%) Relational Database
8 2 (4.00%) Azure SQL Database
8 2 (4.00%) Data Mining
8 2 (4.00%) MySQL
8 2 (4.00%) Neo4j
8 2 (4.00%) OLAP
8 2 (4.00%) Presto
Development Applications
1 8 (16.00%) Jenkins
2 5 (10.00%) JIRA
3 3 (6.00%) Git (software)
3 3 (6.00%) Maven
3 3 (6.00%) Travis CI
4 2 (4.00%) Atlassian Bamboo
4 2 (4.00%) PowerDesigner
4 2 (4.00%) Team Foundation Server
4 2 (4.00%) TeamCity
General
1 12 (24.00%) Finance
2 6 (12.00%) Marketing
3 4 (8.00%) Banking
3 4 (8.00%) Retail
4 3 (6.00%) Retail Banking
4 3 (6.00%) Telecoms
5 2 (4.00%) Front Office
5 2 (4.00%) Investment Banking
Job Titles
1 14 (28.00%) Developer
2 13 (26.00%) Data Engineer
3 8 (16.00%) Java Developer
4 6 (12.00%) Architect
5 5 (10.00%) AWS Engineer
5 5 (10.00%) Python Engineer
6 4 (8.00%) Analyst
6 4 (8.00%) AWS DevOps
6 4 (8.00%) DevOps Engineer
6 4 (8.00%) Hadoop Developer
7 3 (6.00%) AWS DevOps Engineer
7 3 (6.00%) Consultant
7 3 (6.00%) Data Analyst
7 3 (6.00%) Data Architect
7 3 (6.00%) DevOps Consultant
7 3 (6.00%) Java Hadoop Developer
8 2 (4.00%) Angular Developer
8 2 (4.00%) Azure Engineer
8 2 (4.00%) Full Stack Developer
8 2 (4.00%) Kubernetes Consultant
Libraries, Frameworks & Software Standards
1 13 (26.00%) Kafka
2 9 (18.00%) TensorFlow
3 8 (16.00%) PySpark
3 8 (16.00%) Spring
4 5 (10.00%) Spark Streaming
5 4 (8.00%) REST
6 3 (6.00%) .NET
6 3 (6.00%) AngularJS
6 3 (6.00%) H2O
6 3 (6.00%) HTML
6 3 (6.00%) scikit-learn
6 3 (6.00%) Spring Boot
7 2 (4.00%) Apache Avro
7 2 (4.00%) Apache NiFi
7 2 (4.00%) Elastic Stack
7 2 (4.00%) Hibernate
7 2 (4.00%) React
7 2 (4.00%) RESTful
7 2 (4.00%) Serverless Framework
7 2 (4.00%) Web Services
Miscellaneous
1 4 (8.00%) Management Information System
2 3 (6.00%) Greenfield Project
2 3 (6.00%) Hedge funds
2 3 (6.00%) Linux Command Line
3 2 (4.00%) Algorithms
3 2 (4.00%) Analytical Skills
3 2 (4.00%) Credit Risk
3 2 (4.00%) Data Structures
3 2 (4.00%) Equities
3 2 (4.00%) Market Risk
4 1 (2.00%) Cloud Native
4 1 (2.00%) Enterprise Software
4 1 (2.00%) Hybrid Cloud
4 1 (2.00%) Public Cloud
4 1 (2.00%) Robotics
4 1 (2.00%) Self-Motivation
4 1 (2.00%) Tandem
4 1 (2.00%) Taxonomies
Operating Systems
1 7 (14.00%) Linux
2 4 (8.00%) Unix
3 1 (2.00%) Windows
Processes & Methodologies
1 15 (30.00%) DevOps
2 14 (28.00%) Analytics
3 12 (24.00%) Agile Software Development
4 8 (16.00%) ETL
5 7 (14.00%) Data Architecture
6 6 (12.00%) Data Integration
6 6 (12.00%) Data Modelling
6 6 (12.00%) TDD
7 5 (10.00%) Business Intelligence
7 5 (10.00%) Computer Science
7 5 (10.00%) Data Engineering
7 5 (10.00%) Performance Optimisation
8 4 (8.00%) Performance Tuning
8 4 (8.00%) Problem-Solving
9 3 (6.00%) Actionable Insight
9 3 (6.00%) Dashboard Development
9 3 (6.00%) Data Science
9 3 (6.00%) Functional Programming
9 3 (6.00%) Machine Learning
9 3 (6.00%) Microservices
Programming Languages
1 34 (68.00%) Python
2 17 (34.00%) SQL
3 16 (32.00%) Java
4 10 (20.00%) Scala
5 8 (16.00%) R
6 4 (8.00%) JavaScript
7 3 (6.00%) C#
7 3 (6.00%) PHP
8 2 (4.00%) Go
8 2 (4.00%) Java 8
8 2 (4.00%) Ruby
8 2 (4.00%) TypeScript
9 1 (2.00%) AWK
9 1 (2.00%) BeanShell
9 1 (2.00%) C++
9 1 (2.00%) PowerShell
9 1 (2.00%) sed
Qualifications
1 6 (12.00%) Security Cleared
2 5 (10.00%) SC Cleared
3 2 (4.00%) AWS Certification
3 2 (4.00%) Degree
4 1 (2.00%) DV Cleared
4 1 (2.00%) Master's Degree
Quality Assurance & Compliance
1 2 (4.00%) Data Quality
System Software
1 9 (18.00%) HDFS
2 4 (8.00%) Apache Flume
2 4 (8.00%) Docker
Systems Management
1 9 (18.00%) Kubernetes
2 6 (12.00%) Hadoop YARN
2 6 (12.00%) Terraform
3 2 (4.00%) Ansible
3 2 (4.00%) Puppet
4 1 (2.00%) Kubeflow
Vendors
1 10 (20.00%) Google
2 6 (12.00%) Cloudera
3 5 (10.00%) Oracle
3 5 (10.00%) Tableau
4 4 (8.00%) MapR
5 3 (6.00%) Microsoft
5 3 (6.00%) Splunk
6 2 (4.00%) Informatica
6 2 (4.00%) New Relic
6 2 (4.00%) SAP
6 2 (4.00%) Teradata
7 1 (2.00%) Hortonworks
7 1 (2.00%) IBM
7 1 (2.00%) Okta
7 1 (2.00%) Palantir
7 1 (2.00%) Pega
7 1 (2.00%) ServiceNow