Period
to 23 January 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 23 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
Central London > City of London
6 months to
23 Jan 2020
Same period 2019 Same period 2018
Rank 117 92 91
Rank change year-on-year -25 -1 -38
Contract jobs citing Hadoop 79 194 196
As % of all contract IT jobs advertised in the City of London 1.60% 2.84% 2.75%
As % of the Database & Business Intelligence category 7.03% 11.54% 11.05%
Number of daily rates quoted 62 151 172
City of London median daily rate £575 £575 £600
Median daily rate % change year-on-year - -4.17% +2.13%
10th Percentile £472 £513 £465
90th Percentile £722 £725 £725
Central London median daily rate £575 £575 £575
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,124 1,681 1,773
As % of all contract IT jobs advertised in the City of London 22.72% 24.61% 24.87%
Number of daily rates quoted 879 1,346 1,487
City of London median daily rate £515 £525 £525
Median daily rate % change year-on-year -1.90% - +10.53%
10th Percentile £375 £381 £363
90th Percentile £675 £675 £688
Central London median daily rate £500 £525 £513
% change year-on-year -4.76% +2.44% +7.89%
Number of hourly rates quoted 4 7 6
City of London median hourly rate £25.00 £37.09 £27.75
Median hourly rate % change year-on-year -32.60% +33.66% -38.33%
10th Percentile £22.17 £29.50 £23.38
90th Percentile £46.50 £65.61 £33.25
Central London median hourly rate £35.00 £37.09 £27.50
% change year-on-year -5.63% +34.87% -38.89%

Hadoop
Job Vacancy Trend in the City of London

Job postings citing Hadoop as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the City of London.

Contractor daily rate trend for Hadoop in the City of London

Hadoop
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Hadoop in the City of London over the 6 months to 23 January 2020.

Contractor daily rate histogram for Hadoop in the City of London

Hadoop
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in the City of London.

Contractor hourly rate trend for Hadoop in the City of London

Hadoop
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the City of London region over the 6 months to 23 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 6 £500 - 1
Hadoop
Central London

For the 6 months to 23 January 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Hadoop.

1 47 (59.49%) Python
2 43 (54.43%) Apache Spark
3 41 (51.90%) Big Data
4 37 (46.84%) Java
5 36 (45.57%) SQL
6 26 (32.91%) Agile Software Development
6 26 (32.91%) Scala
7 24 (30.38%) AWS
7 24 (30.38%) Apache Hive
8 21 (26.58%) NoSQL
9 20 (25.32%) Kafka
10 19 (24.05%) Finance
11 17 (21.52%) DevOps
12 15 (18.99%) ETL
12 15 (18.99%) TDD
12 15 (18.99%) Data Science
13 14 (17.72%) Kubernetes
13 14 (17.72%) Analytics
14 13 (16.46%) Jenkins
14 13 (16.46%) Docker
14 13 (16.46%) Spring
14 13 (16.46%) Microservices
15 12 (15.19%) HBase
16 11 (13.92%) MongoDB
16 11 (13.92%) Ansible
16 11 (13.92%) HDFS
16 11 (13.92%) Software Engineering
16 11 (13.92%) Data Warehouse
16 11 (13.92%) Unix
16 11 (13.92%) PySpark

Hadoop
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 43 (54.43%) Apache Spark
2 6 (7.59%) JBoss
2 6 (7.59%) Jetty
2 6 (7.59%) Tomcat
3 5 (6.33%) Apache Airflow
4 4 (5.06%) Elasticsearch
5 3 (3.80%) Luigi
5 3 (3.80%) SAS
6 2 (2.53%) Apache
7 1 (1.27%) Jupyter
Applications
1 2 (2.53%) Microsoft Excel
Business Applications
1 1 (1.27%) FINCAD Analytics
1 1 (1.27%) SAP Oil and Gas
Cloud Services
1 24 (30.38%) AWS
2 10 (12.66%) GCP
3 9 (11.39%) Azure
4 7 (8.86%) Amazon S3
5 6 (7.59%) Power Platform
6 5 (6.33%) Amazon EMR
7 3 (3.80%) GitHub
8 2 (2.53%) Amazon Kinesis
8 2 (2.53%) AWS Lambda
8 2 (2.53%) Cloud Computing
8 2 (2.53%) Serverless
9 1 (1.27%) Amazon EC2
9 1 (1.27%) Amazon EKS
9 1 (1.27%) Amazon SQS
9 1 (1.27%) AWS CloudFormation
9 1 (1.27%) AWS Step Functions
9 1 (1.27%) Azure Data Factory
9 1 (1.27%) SaaS
9 1 (1.27%) Virtual Private Cloud
Communications & Networking
1 1 (1.27%) Broadband
1 1 (1.27%) Internet
1 1 (1.27%) Wi-Fi
Database & Business Intelligence
1 41 (51.90%) Big Data
2 24 (30.38%) Apache Hive
3 21 (26.58%) NoSQL
4 12 (15.19%) HBase
5 11 (13.92%) Data Warehouse
5 11 (13.92%) MongoDB
6 10 (12.66%) Impala
7 9 (11.39%) PostgreSQL
8 8 (10.13%) Spark SQL
9 6 (7.59%) Data Lake
9 6 (7.59%) Power BI
10 5 (6.33%) MySQL
10 5 (6.33%) SQL Server
11 4 (5.06%) Amazon Redshift
11 4 (5.06%) Presto
11 4 (5.06%) Relational Database
12 3 (3.80%) Amazon Athena
12 3 (3.80%) Apache Cassandra
12 3 (3.80%) Azkaban
12 3 (3.80%) BigQuery
Development Applications
1 13 (16.46%) Jenkins
2 8 (10.13%) Git (software)
3 7 (8.86%) JIRA
4 5 (6.33%) Maven
5 4 (5.06%) Travis CI
6 2 (2.53%) Atlassian Bamboo
6 2 (2.53%) Team Foundation Server
7 1 (1.27%) Cucumber
7 1 (1.27%) Eclipse
7 1 (1.27%) GitLab
7 1 (1.27%) JUnit
7 1 (1.27%) PowerDesigner
7 1 (1.27%) TeamCity
7 1 (1.27%) Vagrant
General
1 19 (24.05%) Finance
2 8 (10.13%) Banking
3 6 (7.59%) Marketing
4 4 (5.06%) Retail Banking
5 3 (3.80%) Retail
6 2 (2.53%) Investment Banking
7 1 (1.27%) Financial Institution
7 1 (1.27%) Front Office
7 1 (1.27%) Public Sector
7 1 (1.27%) Telecoms
Job Titles
1 25 (31.65%) Developer
2 24 (30.38%) Data Engineer
3 12 (15.19%) Java Developer
4 7 (8.86%) Analyst
4 7 (8.86%) Architect
5 6 (7.59%) Big Data Developer
5 6 (7.59%) Data Architect
5 6 (7.59%) Hadoop Developer
6 4 (5.06%) Big Data Engineer
6 4 (5.06%) Data Analyst
6 4 (5.06%) Data Scientist
6 4 (5.06%) Java Hadoop Developer
7 3 (3.80%) DevOps Engineer
7 3 (3.80%) Python Developer
7 3 (3.80%) Scala Developer
8 2 (2.53%) Business Analyst
8 2 (2.53%) Cloud Architect
8 2 (2.53%) Hadoop Engineer
8 2 (2.53%) Machine Learning Scientist
8 2 (2.53%) Senior DevOps Engineer
Libraries, Frameworks & Software Standards
1 20 (25.32%) Kafka
2 13 (16.46%) Spring
3 11 (13.92%) PySpark
4 10 (12.66%) Spark Streaming
5 7 (8.86%) Spring Boot
6 6 (7.59%) Hibernate
7 3 (3.80%) NumPy
7 3 (3.80%) React
7 3 (3.80%) REST
8 2 (2.53%) Anaconda
8 2 (2.53%) Java Concurrency
8 2 (2.53%) Lambda Expressions
8 2 (2.53%) Natural Language Processing
8 2 (2.53%) Node.js
8 2 (2.53%) OpenNLP
8 2 (2.53%) scikit-learn
8 2 (2.53%) Web Services
9 1 (1.27%) CSS
9 1 (1.27%) HTML
9 1 (1.27%) JMX
Miscellaneous
1 8 (10.13%) Algorithms
1 8 (10.13%) Data Structures
2 6 (7.59%) Greenfield Project
3 5 (6.33%) Linux Command Line
4 3 (3.80%) Analytical Skills
5 2 (2.53%) Equities
5 2 (2.53%) Self-Motivation
5 2 (2.53%) User Experience
6 1 (1.27%) Derivative
6 1 (1.27%) Fixed Income
6 1 (1.27%) Grid Computing
6 1 (1.27%) Hedge funds
Operating Systems
1 11 (13.92%) Unix
2 5 (6.33%) Linux
3 2 (2.53%) Windows
Processes & Methodologies
1 26 (32.91%) Agile Software Development
2 17 (21.52%) DevOps
3 15 (18.99%) Data Science
3 15 (18.99%) ETL
3 15 (18.99%) TDD
4 14 (17.72%) Analytics
5 13 (16.46%) Microservices
6 11 (13.92%) Software Engineering
7 10 (12.66%) Business Intelligence
7 10 (12.66%) Migration
8 9 (11.39%) BDD
8 9 (11.39%) Computer Science
8 9 (11.39%) Machine Learning
9 8 (10.13%) Open Source
10 6 (7.59%) Data Migration
10 6 (7.59%) Digital Transformation Programme
10 6 (7.59%) Multithreading
11 5 (6.33%) Actionable Insight
11 5 (6.33%) Functional Programming
11 5 (6.33%) Performance Testing
Programming Languages
1 47 (59.49%) Python
2 37 (46.84%) Java
3 36 (45.57%) SQL
4 26 (32.91%) Scala
5 9 (11.39%) R
6 4 (5.06%) C++
7 3 (3.80%) AWK
7 3 (3.80%) sed
8 2 (2.53%) Go
8 2 (2.53%) MATLAB
9 1 (1.27%) Bash Shell
9 1 (1.27%) C
9 1 (1.27%) C#
9 1 (1.27%) Clojure
9 1 (1.27%) HiveQL
9 1 (1.27%) JavaScript
9 1 (1.27%) Kotlin
9 1 (1.27%) PHP
9 1 (1.27%) PHP 7
9 1 (1.27%) Shell Script
Qualifications
1 3 (3.80%) Security Cleared
2 2 (2.53%) PhD
2 2 (2.53%) SC Cleared
3 1 (1.27%) Degree
3 1 (1.27%) DV Cleared
3 1 (1.27%) Numerate Degree
Quality Assurance & Compliance
1 3 (3.80%) Data Quality
2 1 (1.27%) QA
System Software
1 13 (16.46%) Docker
2 11 (13.92%) HDFS
3 1 (1.27%) Apache ZooKeeper
3 1 (1.27%) VirtualBox
Systems Management
1 14 (17.72%) Kubernetes
2 11 (13.92%) Ansible
3 10 (12.66%) Hadoop YARN
4 7 (8.86%) Opscode Chef
4 7 (8.86%) Puppet
5 6 (7.59%) Cobbler
5 6 (7.59%) Terraform
6 2 (2.53%) Kibana
7 1 (1.27%) Docker Swarm
7 1 (1.27%) Grafana
7 1 (1.27%) ITRS Geneos
7 1 (1.27%) Oozie
7 1 (1.27%) Prometheus
Vendors
1 9 (11.39%) Cloudera
1 9 (11.39%) Google
2 7 (8.86%) Oracle
3 6 (7.59%) Tableau
4 5 (6.33%) Hortonworks
4 5 (6.33%) Teradata
5 4 (5.06%) Microsoft
6 3 (3.80%) Informatica
6 3 (3.80%) Palantir
6 3 (3.80%) Talend
7 2 (2.53%) MapR
7 2 (2.53%) SAP
8 1 (1.27%) Ab Initio
8 1 (1.27%) Bloomberg
8 1 (1.27%) Cognos
8 1 (1.27%) Datactics
8 1 (1.27%) Foundry
8 1 (1.27%) IBM
8 1 (1.27%) New Relic
8 1 (1.27%) Splunk