Period
to 13 May 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 13 May 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
13 May 2021
Same period 2020 Same period 2019
Rank 173 157 104
Rank change year-on-year -16 -53 -13
Contract jobs citing Hadoop 372 354 1,043
As % of all contract jobs advertised in London 1.57% 1.70% 2.58%
As % of the Database & Business Intelligence category 6.73% 6.99% 10.30%
Number of daily rates quoted 213 257 740
10th Percentile £425 £413 £463
25th Percentile £513 £491 £513
Median daily rate (50th Percentile) £580 £550 £575
Median % change year-on-year +5.45% -4.35% +4.55%
75th Percentile £638 £650 £650
90th Percentile £716 £700 £725
England median daily rate £550 £550 £550
Number of hourly rates quoted 1 0 5
10th Percentile " " "
25th Percentile £26.00 " £32.50
Median hourly rate £27.00 - £49.13
75th Percentile £28.00 " £50.00
90th Percentile " " £54.50
England median hourly rate £27.00 - £49.57

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 5,527 5,062 10,124
As % of all contract IT jobs advertised in London 23.36% 24.26% 25.03%
Number of daily rates quoted 3,922 3,680 7,447
10th Percentile £375 £363 £363
25th Percentile £450 £425 £425
Median daily rate (50th Percentile) £525 £525 £525
75th Percentile £638 £625 £609
90th Percentile £713 £700 £675
England median daily rate £500 £495 £488
% change year-on-year +1.01% +1.54% +2.63%
Number of hourly rates quoted 33 30 46
10th Percentile £14.35 £15.89 £18.53
25th Percentile £20.00 £20.11 £20.63
Median hourly rate £34.88 £25.75 £24.50
Median % change year-on-year +35.46% +5.10% -10.35%
75th Percentile £58.75 £38.44 £43.75
90th Percentile £66.50 £49.86 £54.25
England median hourly rate £24.64 £24.70 £30.00
% change year-on-year -0.24% -17.67% -

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Hadoop in London.

Daily rate trend for Hadoop in London

Hadoop
Daily Rate Histogram in London

Daily rate distribution for jobs citing Hadoop in London over the 6 months to 13 May 2021.

Daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Hadoop in London.

Hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 13 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +23 47 £593 +3.04% 41
South London +28 4 £563 +12.50% 1
West London +8 4 £624 +13.36% 4
East London +6 1 £405 -22.86% 1
Hadoop
England

For the 6 months to 13 May 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 219 (58.87%) Apache Spark
2 202 (54.30%) Big Data
3 159 (42.74%) Python
4 151 (40.59%) Java
5 129 (34.68%) SQL
5 129 (34.68%) Agile Software Development
6 126 (33.87%) Apache Hive
7 114 (30.65%) Scala
7 114 (30.65%) AWS
8 104 (27.96%) Kafka
9 89 (23.92%) DevOps
10 87 (23.39%) Analytics
11 85 (22.85%) Finance
12 77 (20.70%) ETL
13 75 (20.16%) Banking
14 71 (19.09%) Azure
15 70 (18.82%) Social Skills
16 69 (18.55%) Data Science
17 67 (18.01%) GCP
17 67 (18.01%) Cloudera
18 61 (16.40%) Computer Science
18 61 (16.40%) Data Pipeline
19 60 (16.13%) Scrum
20 59 (15.86%) Data Warehouse
21 58 (15.59%) TDD
22 57 (15.32%) HDFS
23 51 (13.71%) Linux
23 51 (13.71%) Degree
23 51 (13.71%) Docker
23 51 (13.71%) Kubernetes

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 219 (58.87%) Apache Spark
2 47 (12.63%) Apache
3 32 (8.60%) Apache Airflow
4 26 (6.99%) Confluence
5 9 (2.42%) Apache Pig
5 9 (2.42%) Elasticsearch
5 9 (2.42%) SAS
6 7 (1.88%) Tomcat
6 7 (1.88%) WebSphere
7 4 (1.08%) Apache Solr
7 4 (1.08%) WebSphere Application Server
8 3 (0.81%) JBoss
8 3 (0.81%) Jetty
8 3 (0.81%) Luigi
8 3 (0.81%) OpenStack
9 2 (0.54%) Camunda
9 2 (0.54%) Cloud Foundry
9 2 (0.54%) CMS
9 2 (0.54%) SharePoint
10 1 (0.27%) Oracle SOA Suite
Applications
1 3 (0.81%) Microsoft Excel
2 2 (0.54%) SPSS
3 1 (0.27%) Microsoft Office
3 1 (0.27%) MS Visio
3 1 (0.27%) Spreadsheet
Business Applications
1 1 (0.27%) Oracle BPM
1 1 (0.27%) SAP CRM
1 1 (0.27%) SAP ERP
1 1 (0.27%) SAP IS-U
1 1 (0.27%) SAP MDG
1 1 (0.27%) SAP MDM
Cloud Services
1 114 (30.65%) AWS
2 71 (19.09%) Azure
3 67 (18.01%) GCP
4 28 (7.53%) Amazon S3
5 22 (5.91%) Serverless
6 20 (5.38%) Amazon EC2
7 18 (4.84%) PaaS
7 18 (4.84%) Power Platform
8 17 (4.57%) Amazon EMR
8 17 (4.57%) IaaS
9 16 (4.30%) AWS Lambda
10 13 (3.49%) GitHub
11 9 (2.42%) Amazon CloudWatch
12 8 (2.15%) Google Data Studio
13 7 (1.88%) Amazon ECS
13 7 (1.88%) Amazon SQS
13 7 (1.88%) Azure Cosmos DB
13 7 (1.88%) Azure Data Factory
13 7 (1.88%) Route 53
14 5 (1.34%) OpenShift
Communications & Networking
1 6 (1.61%) Firewall
2 4 (1.08%) Cisco Nexus
2 4 (1.08%) FCoE
2 4 (1.08%) Fibre Channel
2 4 (1.08%) iSCSI
2 4 (1.08%) LAN
2 4 (1.08%) Multicast
2 4 (1.08%) NAS
2 4 (1.08%) Network Security
2 4 (1.08%) SAN
2 4 (1.08%) WAN
3 3 (0.81%) DNS
3 3 (0.81%) Kerberos
3 3 (0.81%) Remote Desktop
3 3 (0.81%) VSAN
4 2 (0.54%) FTP
5 1 (0.27%) Internet
5 1 (0.27%) Software-Defined Networking
Database & Business Intelligence
1 202 (54.30%) Big Data
2 126 (33.87%) Apache Hive
3 59 (15.86%) Data Warehouse
4 49 (13.17%) NoSQL
5 46 (12.37%) MongoDB
6 45 (12.10%) HBase
7 42 (11.29%) Data Lake
8 37 (9.95%) Relational Database
9 35 (9.41%) Tableau
10 33 (8.87%) Impala
11 32 (8.60%) SQL Server
12 31 (8.33%) Amazon Redshift
13 28 (7.53%) PostgreSQL
14 26 (6.99%) MySQL
15 25 (6.72%) Apache Cassandra
16 24 (6.45%) BigQuery
17 22 (5.91%) Spark SQL
18 18 (4.84%) Power BI
19 16 (4.30%) Amazon RDS
19 16 (4.30%) Presto
Development Applications
1 43 (11.56%) Jenkins
2 37 (9.95%) Git (software)
3 27 (7.26%) JIRA
4 14 (3.76%) Bitbucket
5 13 (3.49%) Sonatype Nexus
6 12 (3.23%) TeamCity
7 9 (2.42%) Artifactory
8 8 (2.15%) Maven
9 6 (1.61%) Selenium
10 5 (1.34%) Cucumber
10 5 (1.34%) Protractor
11 4 (1.08%) ProC
12 3 (0.81%) Gradle
12 3 (0.81%) Hudson
12 3 (0.81%) JUnit
12 3 (0.81%) Mockito
12 3 (0.81%) Subversion
12 3 (0.81%) Visual Studio
12 3 (0.81%) Visual Studio Team System
12 3 (0.81%) WebDriver
General
1 85 (22.85%) Finance
2 75 (20.16%) Banking
3 70 (18.82%) Social Skills
4 50 (13.44%) Analytical Skills
5 39 (10.48%) Investment Banking
6 27 (7.26%) Front Office
7 16 (4.30%) Marketing
8 14 (3.76%) Presentation Skills
9 11 (2.96%) Documentation Skills
9 11 (2.96%) Public Sector
10 9 (2.42%) Games
11 7 (1.88%) Retail
12 5 (1.34%) French Language
12 5 (1.34%) Influencing Skills
13 4 (1.08%) Financial Institution
13 4 (1.08%) Legal
13 4 (1.08%) Organisational Skills
14 3 (0.81%) Automotive
14 3 (0.81%) Telecoms
15 2 (0.54%) Manufacturing
Job Titles
1 107 (28.76%) Data Engineer
2 92 (24.73%) Developer
3 54 (14.52%) Architect
4 37 (9.95%) Big Data Engineer
5 29 (7.80%) Java Developer
6 26 (6.99%) AWS Engineer
7 24 (6.45%) Scala Developer
8 22 (5.91%) DevOps Engineer
9 21 (5.65%) Data Architect
10 19 (5.11%) Data Scientist
11 18 (4.84%) Apache Spark Developer
12 17 (4.57%) AWS Architect
12 17 (4.57%) Hadoop Engineer
12 17 (4.57%) Solutions Architect
13 15 (4.03%) Analyst
14 13 (3.49%) Administrator
14 13 (3.49%) Big Data Developer
14 13 (3.49%) Cloud Engineer
14 13 (3.49%) Hadoop Developer
14 13 (3.49%) Scala Engineer
Libraries, Frameworks & Software Standards
1 104 (27.96%) Kafka
2 21 (5.65%) PySpark
2 21 (5.65%) Spring
3 18 (4.84%) JSON
4 14 (3.76%) RESTful
5 13 (3.49%) Node.js
5 13 (3.49%) Spark Streaming
6 12 (3.23%) Apache NiFi
7 11 (2.96%) Spring Boot
8 10 (2.69%) TensorFlow
9 9 (2.42%) AngularJS
10 8 (2.15%) Akka
10 8 (2.15%) XML
11 7 (1.88%) Pandas
12 6 (1.61%) Anaconda
12 6 (1.61%) Apache Avro
12 6 (1.61%) Lambda Expressions
13 5 (1.34%) Gherkin
13 5 (1.34%) NumPy
13 5 (1.34%) RabbitMQ
Miscellaneous
1 16 (4.30%) Algorithms
1 16 (4.30%) Data Structures
2 7 (1.88%) Cloud Native
2 7 (1.88%) Equities
3 6 (1.61%) Linux Command Line
3 6 (1.61%) Self-Motivation
3 6 (1.61%) Virtual Team
4 5 (1.34%) Analytical Mindset
4 5 (1.34%) Cybercrime
5 4 (1.08%) Clustering
5 4 (1.08%) Data Centre
5 4 (1.08%) Management Information System
5 4 (1.08%) Replication
5 4 (1.08%) VSAM
6 3 (0.81%) N-Tier
7 2 (0.54%) Client/Server
7 2 (0.54%) CUDA
7 2 (0.54%) Foreign Exchange (FX)
7 2 (0.54%) PKI
7 2 (0.54%) Social Media
Operating Systems
1 51 (13.71%) Linux
2 27 (7.26%) Unix
3 13 (3.49%) Windows
4 7 (1.88%) CentOS
5 6 (1.61%) Ubuntu
6 5 (1.34%) Solaris
7 3 (0.81%) Windows 10
8 2 (0.54%) AIX
8 2 (0.54%) Debian
8 2 (0.54%) Red Hat Enterprise Linux
8 2 (0.54%) SUSE
8 2 (0.54%) VMS
9 1 (0.27%) MVS
Processes & Methodologies
1 129 (34.68%) Agile Software Development
2 89 (23.92%) DevOps
3 87 (23.39%) Analytics
4 77 (20.70%) ETL
5 69 (18.55%) Data Science
6 61 (16.40%) Computer Science
6 61 (16.40%) Data Pipeline
7 60 (16.13%) Scrum
8 58 (15.59%) TDD
9 49 (13.17%) BDD
10 46 (12.37%) Business Intelligence
10 46 (12.37%) Migration
11 41 (11.02%) Data Modelling
12 40 (10.75%) Mathematics
13 39 (10.48%) Microservices
14 38 (10.22%) Data Engineering
15 35 (9.41%) Machine Learning
16 34 (9.14%) Visualisation
17 28 (7.53%) Problem-Solving
18 27 (7.26%) Data Analytics
Programming Languages
1 159 (42.74%) Python
2 151 (40.59%) Java
3 129 (34.68%) SQL
4 114 (30.65%) Scala
5 20 (5.38%) R
6 12 (3.23%) Go
7 11 (2.96%) JavaScript
7 11 (2.96%) Shell Script
8 10 (2.69%) C++
9 9 (2.42%) PL/SQL
10 5 (1.34%) Ruby
11 4 (1.08%) Bash Shell
11 4 (1.08%) C#
11 4 (1.08%) Groovy
11 4 (1.08%) VBA
12 3 (0.81%) C
12 3 (0.81%) HiveQL
12 3 (0.81%) Perl
13 2 (0.54%) PowerShell
13 2 (0.54%) TypeScript
Qualifications
1 51 (13.71%) Degree
2 50 (13.44%) Security Cleared
3 45 (12.10%) SC Cleared
4 23 (6.18%) Numerate Degree
5 14 (3.76%) Computer Science Degree
6 8 (2.15%) AWS Certification
6 8 (2.15%) DV Cleared
7 7 (1.88%) PhD
8 4 (1.08%) Master's Degree
Quality Assurance & Compliance
1 25 (6.72%) QA
2 14 (3.76%) Data Quality
3 12 (3.23%) SLA
4 7 (1.88%) GDPR
5 1 (0.27%) PCI DSS
5 1 (0.27%) PMO
System Software
1 57 (15.32%) HDFS
2 51 (13.71%) Docker
3 8 (2.15%) Apache Flume
4 7 (1.88%) VMware Infrastructure
5 5 (1.34%) Apache ZooKeeper
6 4 (1.08%) Active Directory
6 4 (1.08%) Hyper-V
6 4 (1.08%) KVM
6 4 (1.08%) NFS
6 4 (1.08%) Oracle RAC
6 4 (1.08%) SRDF
6 4 (1.08%) Xen
7 3 (0.81%) VMware ESXi
7 3 (0.81%) VMware NSX
7 3 (0.81%) vSphere
8 1 (0.27%) Virtual Machines
Systems Management
1 51 (13.71%) Kubernetes
2 38 (10.22%) Ansible
3 36 (9.68%) Terraform
4 20 (5.38%) Hadoop YARN
5 16 (4.30%) Grafana
6 14 (3.76%) Oozie
7 13 (3.49%) Puppet
8 8 (2.15%) Ambari
9 7 (1.88%) Control-M
9 7 (1.88%) Prometheus
10 4 (1.08%) Rancher
11 2 (0.54%) Consul
11 2 (0.54%) FreeIPA
11 2 (0.54%) Kibana
11 2 (0.54%) logstash
11 2 (0.54%) Opscode Chef
12 1 (0.27%) Istio
Vendors
1 67 (18.01%) Cloudera
2 49 (13.17%) Oracle
3 37 (9.95%) Google
4 25 (6.72%) Hortonworks
4 25 (6.72%) Microsoft
5 15 (4.03%) StreamSets
5 15 (4.03%) Teradata
6 13 (3.49%) Informatica
7 12 (3.23%) Talend
8 11 (2.96%) Alteryx
8 11 (2.96%) MapR
9 8 (2.15%) SAP
10 7 (1.88%) Ab Initio
10 7 (1.88%) Databricks
10 7 (1.88%) IBM
10 7 (1.88%) VMware
11 6 (1.61%) Red Hat
12 5 (1.34%) Salesforce.com
13 4 (1.08%) EMC
13 4 (1.08%) NetApp