Period
to 5 March 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 5 March 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
5 Mar 2021
Same period 2020 Same period 2019
Rank 163 143 107
Rank change year-on-year -20 -36 -14
Contract jobs citing Hadoop 328 535 1,084
As % of all contract jobs advertised in London 1.63% 1.91% 2.47%
As % of the Database & Business Intelligence category 6.93% 7.84% 10.05%
Number of daily rates quoted 234 400 777
Median daily rate £575 £575 £575
10th Percentile £424 £425 £463
90th Percentile £675 £738 £725
England median daily rate £550 £550 £550
Number of hourly rates quoted 1 0 2
Median hourly rate £27.00 - £50.00
10th Percentile £26.00 - £43.50
90th Percentile £28.00 - £56.50
England median hourly rate £38.50 - £55.00

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 4,731 6,828 10,783
As % of all contract IT jobs advertised in London 23.53% 24.34% 24.60%
Number of daily rates quoted 3,350 4,976 8,019
Median daily rate £525 £525 £525
10th Percentile £350 £363 £363
90th Percentile £700 £700 £675
England median daily rate £495 £488 £485
% change year-on-year +1.54% +0.52% +2.11%
Number of hourly rates quoted 27 31 42
Median hourly rate £42.00 £35.00 £24.50
Median hourly rate % change year-on-year +20.00% +42.86% -9.79%
10th Percentile £20.60 £18.25 £16.83
90th Percentile £68.00 £64.88 £47.50
Median hourly rate £25.00 £25.80 £31.25
% change year-on-year -3.09% -17.45% -4.58%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Hadoop in London.

Daily rate trend for Hadoop in London

Hadoop
Daily Rate Histogram in London

Daily rate distribution for jobs citing Hadoop in London over the 6 months to 5 March 2021.

Daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Hadoop in London.

Hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 5 March 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +33 37 £575 - 36
West London +24 13 £587 +6.68% 18
South London +32 1 £563 +12.50%
East London +23 1 £405 -22.86% 9
Hadoop
England

For the 6 months to 5 March 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 218 (66.46%) Apache Spark
2 161 (49.09%) Big Data
3 146 (44.51%) Python
4 137 (41.77%) Java
5 127 (38.72%) Apache Hive
6 115 (35.06%) Agile Software Development
7 109 (33.23%) SQL
8 102 (31.10%) Scala
9 93 (28.35%) AWS
10 82 (25.00%) Kafka
11 76 (23.17%) Finance
12 75 (22.87%) HDFS
13 73 (22.26%) Analytics
13 73 (22.26%) Banking
14 71 (21.65%) DevOps
15 64 (19.51%) ETL
16 59 (17.99%) Cloudera
16 59 (17.99%) Azure
17 58 (17.68%) NoSQL
18 55 (16.77%) Security Cleared
18 55 (16.77%) Data Science
19 53 (16.16%) TDD
20 51 (15.55%) SC Cleared
20 51 (15.55%) HBase
21 48 (14.63%) BDD
21 48 (14.63%) Linux
22 47 (14.33%) Oracle
22 47 (14.33%) Jenkins
23 45 (13.72%) Scrum
23 45 (13.72%) Degree

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 218 (66.46%) Apache Spark
2 34 (10.37%) Apache
3 23 (7.01%) Apache Airflow
4 21 (6.40%) Confluence
5 18 (5.49%) Apache Pig
6 8 (2.44%) Elasticsearch
7 6 (1.83%) SAS
8 5 (1.52%) Jupyter
8 5 (1.52%) Tomcat
8 5 (1.52%) WebSphere
9 4 (1.22%) Apache Solr
9 4 (1.22%) WebSphere Application Server
10 2 (0.61%) Camunda
10 2 (0.61%) Luigi
10 2 (0.61%) SharePoint
11 1 (0.30%) JBoss
11 1 (0.30%) Jetty
11 1 (0.30%) Oracle SOA Suite
Applications
1 4 (1.22%) Microsoft Excel
1 4 (1.22%) MS Visio
2 2 (0.61%) Chatbot
3 1 (0.30%) Microsoft Office
3 1 (0.30%) Spreadsheet
3 1 (0.30%) SPSS
Business Applications
1 1 (0.30%) Oracle BPM
1 1 (0.30%) SAP CRM
1 1 (0.30%) SAP ERP
1 1 (0.30%) SAP IS-U
1 1 (0.30%) SAP MDG
1 1 (0.30%) SAP MDM
Cloud Services
1 93 (28.35%) AWS
2 59 (17.99%) Azure
3 41 (12.50%) GCP
4 33 (10.06%) Amazon S3
5 28 (8.54%) Amazon EMR
6 20 (6.10%) Serverless
7 16 (4.88%) PaaS
8 15 (4.57%) Amazon EC2
9 14 (4.27%) AWS Lambda
9 14 (4.27%) IaaS
10 10 (3.05%) GitHub
10 10 (3.05%) Power Platform
11 7 (2.13%) Azure Data Factory
12 6 (1.83%) Amazon ECS
13 5 (1.52%) Amazon CloudWatch
13 5 (1.52%) AWS CloudFormation
14 4 (1.22%) Amazon Kinesis
14 4 (1.22%) AWS Step Functions
14 4 (1.22%) Route 53
14 4 (1.22%) Virtual Private Cloud
Communications & Networking
1 4 (1.22%) Cisco Nexus
1 4 (1.22%) FCoE
1 4 (1.22%) Fibre Channel
1 4 (1.22%) iSCSI
1 4 (1.22%) LAN
1 4 (1.22%) Multicast
1 4 (1.22%) NAS
1 4 (1.22%) SAN
1 4 (1.22%) WAN
2 3 (0.91%) DNS
2 3 (0.91%) Network Security
2 3 (0.91%) Remote Desktop
2 3 (0.91%) VPN
2 3 (0.91%) VSAN
3 2 (0.61%) Kerberos
4 1 (0.30%) Firewall
4 1 (0.30%) Internet
4 1 (0.30%) Software-Defined Networking
Database & Business Intelligence
1 161 (49.09%) Big Data
2 127 (38.72%) Apache Hive
3 58 (17.68%) NoSQL
4 51 (15.55%) HBase
5 44 (13.41%) Impala
6 41 (12.50%) Data Warehouse
7 35 (10.67%) Data Lake
8 30 (9.15%) MongoDB
9 28 (8.54%) Relational Database
10 25 (7.62%) Amazon Redshift
10 25 (7.62%) SQL Server
11 24 (7.32%) Spark SQL
12 22 (6.71%) Tableau
13 21 (6.40%) Apache Cassandra
14 16 (4.88%) PostgreSQL
15 15 (4.57%) MySQL
16 14 (4.27%) Presto
17 13 (3.96%) Amazon RDS
17 13 (3.96%) BigQuery
17 13 (3.96%) Parquet
Development Applications
1 47 (14.33%) Jenkins
2 37 (11.28%) Git (software)
3 19 (5.79%) JIRA
4 12 (3.66%) TeamCity
5 11 (3.35%) Sonatype Nexus
6 10 (3.05%) Bitbucket
6 10 (3.05%) Selenium
7 7 (2.13%) Cucumber
8 5 (1.52%) Atlassian Bamboo
8 5 (1.52%) Maven
9 4 (1.22%) Artifactory
9 4 (1.22%) ProC
10 3 (0.91%) Hudson
11 2 (0.61%) ERwin
11 2 (0.61%) MLflow
11 2 (0.61%) RStudio
12 1 (0.30%) ER Studio
12 1 (0.30%) IntelliJ
12 1 (0.30%) kappa
12 1 (0.30%) Oracle APEX
General
1 76 (23.17%) Finance
2 73 (22.26%) Banking
3 43 (13.11%) Investment Banking
4 33 (10.06%) Front Office
5 17 (5.18%) Public Sector
6 12 (3.66%) Marketing
7 9 (2.74%) Retail
8 6 (1.83%) Legal
9 5 (1.52%) Manufacturing
10 4 (1.22%) Financial Institution
10 4 (1.22%) Games
10 4 (1.22%) Telecoms
11 3 (0.91%) Automotive
11 3 (0.91%) Electronics
11 3 (0.91%) French Language
12 2 (0.61%) Military
12 2 (0.61%) Retail Banking
13 1 (0.30%) Italian Language
13 1 (0.30%) Publishing
13 1 (0.30%) Swedish Language
Job Titles
1 92 (28.05%) Data Engineer
2 88 (26.83%) Developer
3 58 (17.68%) Architect
4 35 (10.67%) Java Developer
5 32 (9.76%) Big Data Engineer
6 30 (9.15%) AWS Engineer
7 22 (6.71%) Data Architect
8 21 (6.40%) Solutions Architect
9 19 (5.79%) Hadoop Engineer
9 19 (5.79%) Scala Developer
10 17 (5.18%) Data Scientist
11 16 (4.88%) Apache Spark Developer
12 15 (4.57%) Cloud Engineer
12 15 (4.57%) Hadoop Developer
13 14 (4.27%) DevOps Engineer
13 14 (4.27%) Python Developer
13 14 (4.27%) Senior Developer
14 13 (3.96%) AWS Architect
15 12 (3.66%) Big Data Developer
15 12 (3.66%) Scala Engineer
Libraries, Frameworks & Software Standards
1 82 (25.00%) Kafka
2 23 (7.01%) JSON
3 18 (5.49%) PySpark
4 11 (3.35%) XML
5 9 (2.74%) Spark Streaming
5 9 (2.74%) Spring
6 8 (2.44%) Pandas
7 6 (1.83%) Apache NiFi
7 6 (1.83%) Lambda Expressions
7 6 (1.83%) TensorFlow
8 5 (1.52%) Apache Avro
8 5 (1.52%) Node.js
8 5 (1.52%) NumPy
8 5 (1.52%) PyTorch
8 5 (1.52%) RESTful
9 4 (1.22%) Anaconda
9 4 (1.22%) AngularJS
9 4 (1.22%) Middleware
9 4 (1.22%) Natural Language Processing
9 4 (1.22%) scikit-learn
Miscellaneous
1 28 (8.54%) Analytical Skills
2 15 (4.57%) Algorithms
3 13 (3.96%) Data Structures
4 10 (3.05%) Cloud Native
5 8 (2.44%) Public Cloud
6 7 (2.13%) Cybercrime
7 6 (1.83%) Virtual Team
8 5 (1.52%) Analytical Mindset
8 5 (1.52%) Credit Risk
8 5 (1.52%) Equities
8 5 (1.52%) Replication
9 4 (1.22%) FMCG
9 4 (1.22%) VSAM
10 3 (0.91%) Greenfield Project
10 3 (0.91%) Market Risk
10 3 (0.91%) User Experience
11 2 (0.61%) Clustering
11 2 (0.61%) CUDA
11 2 (0.61%) Reference Data
11 2 (0.61%) Self-Motivation
Operating Systems
1 48 (14.63%) Linux
2 17 (5.18%) Unix
3 13 (3.96%) Windows
4 7 (2.13%) CentOS
5 6 (1.83%) Ubuntu
6 5 (1.52%) Solaris
7 3 (0.91%) Windows 10
8 2 (0.61%) AIX
8 2 (0.61%) Red Hat Enterprise Linux
8 2 (0.61%) SUSE
Processes & Methodologies
1 115 (35.06%) Agile Software Development
2 73 (22.26%) Analytics
3 71 (21.65%) DevOps
4 64 (19.51%) ETL
5 55 (16.77%) Data Science
6 53 (16.16%) TDD
7 48 (14.63%) BDD
8 45 (13.72%) Computer Science
8 45 (13.72%) Scrum
9 44 (13.41%) Data Modelling
10 39 (11.89%) Machine Learning
11 38 (11.59%) Business Intelligence
11 38 (11.59%) Mathematics
12 37 (11.28%) Data Engineering
13 31 (9.45%) Data Ingestion
14 30 (9.15%) Migration
15 28 (8.54%) Visualisation
16 26 (7.93%) Data Management
17 25 (7.62%) Data Analytics
17 25 (7.62%) Economics
Programming Languages
1 146 (44.51%) Python
2 137 (41.77%) Java
3 109 (33.23%) SQL
4 102 (31.10%) Scala
5 18 (5.49%) R
6 12 (3.66%) Shell Script
7 10 (3.05%) Bash Shell
7 10 (3.05%) Kotlin
8 8 (2.44%) JavaScript
8 8 (2.44%) PL/SQL
9 6 (1.83%) C#
9 6 (1.83%) Perl
10 5 (1.52%) PowerShell
11 4 (1.22%) VBA
12 3 (0.91%) C++
12 3 (0.91%) Go
12 3 (0.91%) HiveQL
12 3 (0.91%) TypeScript
13 2 (0.61%) C
13 2 (0.61%) T-SQL
Qualifications
1 55 (16.77%) Security Cleared
2 51 (15.55%) SC Cleared
3 45 (13.72%) Degree
4 27 (8.23%) Numerate Degree
5 13 (3.96%) AWS Certification
6 12 (3.66%) TOGAF Certification
7 7 (2.13%) Computer Science Degree
8 6 (1.83%) PhD
9 1 (0.30%) DV Cleared
9 1 (0.30%) Master's Degree
Quality Assurance & Compliance
1 14 (4.27%) QA
2 13 (3.96%) Data Quality
3 4 (1.22%) SLA
4 2 (0.61%) GDPR
5 1 (0.30%) IFRS
5 1 (0.30%) ISO 20022
5 1 (0.30%) MiFID
5 1 (0.30%) PCI DSS
5 1 (0.30%) PMO
5 1 (0.30%) SEPA
5 1 (0.30%) Solvency II
5 1 (0.30%) TARGET2
System Software
1 75 (22.87%) HDFS
2 31 (9.45%) Docker
3 7 (2.13%) Apache ZooKeeper
3 7 (2.13%) VMware Infrastructure
4 6 (1.83%) Apache Flume
5 4 (1.22%) Active Directory
5 4 (1.22%) Hyper-V
5 4 (1.22%) KVM
5 4 (1.22%) NFS
5 4 (1.22%) Oracle RAC
5 4 (1.22%) SRDF
5 4 (1.22%) Xen
6 3 (0.91%) Active Directory Lightweight Directory Services
6 3 (0.91%) VMware ESXi
6 3 (0.91%) VMware NSX
6 3 (0.91%) vSphere
7 1 (0.30%) Virtual Machines
Systems Management
1 36 (10.98%) Ansible
2 30 (9.15%) Terraform
3 26 (7.93%) Kubernetes
4 18 (5.49%) Hadoop YARN
5 11 (3.35%) Grafana
6 10 (3.05%) Oozie
6 10 (3.05%) Puppet
7 6 (1.83%) Ambari
7 6 (1.83%) Opscode Chef
8 5 (1.52%) Prometheus
9 2 (0.61%) Consul
9 2 (0.61%) FreeIPA
10 1 (0.30%) Control-M
10 1 (0.30%) Kubeflow
10 1 (0.30%) Rancher
Vendors
1 59 (17.99%) Cloudera
2 47 (14.33%) Oracle
3 26 (7.93%) Hortonworks
4 25 (7.62%) Google
5 21 (6.40%) Informatica
6 16 (4.88%) Microsoft
7 13 (3.96%) Teradata
8 12 (3.66%) Talend
9 11 (3.35%) Ab Initio
10 10 (3.05%) StreamSets
11 9 (2.74%) VMware
12 8 (2.44%) MapR
13 7 (2.13%) Databricks
13 7 (2.13%) TIBCO
14 6 (1.83%) Atlassian
15 5 (1.52%) Red Hat
15 5 (1.52%) Salesforce.com
15 5 (1.52%) SAP
16 4 (1.22%) Cisco
16 4 (1.22%) Sybase