Period
to 20 September 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 20 September 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
20 Sep 2021
Same period 2020 Same period 2019
Rank 176 148 127
Rank change year-on-year -28 -21 -28
Contract jobs citing Hadoop 529 234 876
As % of all contract jobs advertised in London 1.59% 1.78% 2.26%
As % of the Database & Business Intelligence category 6.59% 6.96% 9.16%
Number of daily rates quoted 320 135 645
10th Percentile £418 £413 £425
25th Percentile £484 £450 £513
Median daily rate (50th Percentile) £575 £550 £575
Median % change year-on-year +4.55% -4.35% +4.55%
75th Percentile £675 £628 £675
90th Percentile £738 £721 £725
England median daily rate £563 £536 £550
% change year-on-year +4.90% -2.50% +2.33%
Number of hourly rates quoted 3 0 6
Median hourly rate £65.00 - £46.85
England median hourly rate £26.00 £24.50 £49.13
% change year-on-year +6.12% -50.13% -19.79%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,024 3,364 9,564
As % of all contract IT jobs advertised in London 24.04% 25.63% 24.63%
Number of daily rates quoted 5,773 2,398 6,990
10th Percentile £382 £363 £363
25th Percentile £463 £431 £425
Median daily rate (50th Percentile) £550 £525 £525
Median % change year-on-year +4.76% - -
75th Percentile £660 £631 £610
90th Percentile £738 £713 £688
England median daily rate £525 £500 £475
% change year-on-year +5.00% +5.26% -
Number of hourly rates quoted 44 28 49
10th Percentile £14.52 £15.98 £15.44
25th Percentile £20.57 £20.75 £20.50
Median hourly rate £32.25 £32.75 £29.96
Median % change year-on-year -1.51% +9.30% -0.13%
75th Percentile £50.19 £41.50 £45.00
90th Percentile £61.70 £51.40 £51.75
England median hourly rate £30.00 £25.00 £30.00
% change year-on-year +20.00% -16.67% +9.09%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Hadoop in London.

Daily rate trend for Hadoop in London

Hadoop
Daily Rate Histogram in London

Daily rate distribution for jobs citing Hadoop in London over the 6 months to 20 September 2021.

Daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Hadoop in London.

Hourly rate trend for Hadoop in London

Hadoop
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Hadoop in London over the 6 months to 20 September 2021.

Hourly rate histogram for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 20 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -41 52 £585 +6.36% 40
South London +15 14 £575 +10.05% 1
West London -27 2 £660 +4.68% 8
North London - 1 - - 2
Hadoop
England

For the 6 months to 20 September 2021, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 327 (61.81%) Apache Spark
2 294 (55.58%) Big Data
3 242 (45.75%) SQL
4 221 (41.78%) Python
5 186 (35.16%) Kafka
6 173 (32.70%) Java
7 168 (31.76%) AWS
8 163 (30.81%) Apache Hive
9 160 (30.25%) Analytics
10 145 (27.41%) Agile Software Development
11 126 (23.82%) Finance
12 125 (23.63%) Scala
13 118 (22.31%) Azure
13 118 (22.31%) DevOps
14 109 (20.60%) ETL
15 103 (19.47%) Data Modelling
16 99 (18.71%) Data Warehouse
16 99 (18.71%) Social Skills
16 99 (18.71%) Data Pipeline
17 94 (17.77%) GCP
17 94 (17.77%) Docker
18 92 (17.39%) Banking
19 88 (16.64%) Kubernetes
20 84 (15.88%) HBase
21 80 (15.12%) NoSQL
22 79 (14.93%) Business Intelligence
23 78 (14.74%) Computer Science
24 74 (13.99%) PostgreSQL
25 71 (13.42%) Data Lake
26 69 (13.04%) Scrum

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 327 (61.81%) Apache Spark
2 54 (10.21%) Apache
3 46 (8.70%) Apache Airflow
4 42 (7.94%) Elasticsearch
5 25 (4.73%) Confluence
6 23 (4.35%) Luigi
7 15 (2.84%) SAS
8 13 (2.46%) OpenStack
9 11 (2.08%) Apache Pig
10 6 (1.13%) Tomcat
11 5 (0.95%) nginx
12 4 (0.76%) WebSphere
13 3 (0.57%) JBoss
14 2 (0.38%) CMS
14 2 (0.38%) Jetty
14 2 (0.38%) WebSphere Application Server
15 1 (0.19%) Cloud Foundry
15 1 (0.19%) DataSynapse
15 1 (0.19%) IBM HTTP Server
15 1 (0.19%) MQSeries
Applications
1 6 (1.13%) SPSS
2 1 (0.19%) Spreadsheet
2 1 (0.19%) SPSS Modeler
Business Applications
1 1 (0.19%) Distributed Ledger
1 1 (0.19%) Oracle BPM
1 1 (0.19%) Oracle Cash Management
1 1 (0.19%) SAP Oil and Gas
1 1 (0.19%) Workday HCM
Cloud Services
1 168 (31.76%) AWS
2 118 (22.31%) Azure
3 94 (17.77%) GCP
4 50 (9.45%) Serverless
5 40 (7.56%) Azure Cosmos DB
6 38 (7.18%) Amazon EMR
7 37 (6.99%) Amazon S3
8 26 (4.91%) Amazon EC2
9 25 (4.73%) Azure Functions
9 25 (4.73%) Power Platform
10 24 (4.54%) Azure Data Factory
11 23 (4.35%) AWS Lambda
11 23 (4.35%) GitHub
12 21 (3.97%) Route 53
13 20 (3.78%) Amazon ECS
13 20 (3.78%) Amazon EKS
13 20 (3.78%) PaaS
14 17 (3.21%) Snowflake
15 14 (2.65%) IaaS
16 13 (2.46%) Google Data Studio
Communications & Networking
1 10 (1.89%) DNS
2 9 (1.70%) Firewall
2 9 (1.70%) Kerberos
3 8 (1.51%) FTP
4 5 (0.95%) SSL
5 4 (0.76%) LAN
5 4 (0.76%) Multicast
5 4 (0.76%) WAN
6 3 (0.57%) HTTP
6 3 (0.57%) NAS
6 3 (0.57%) SAN
7 2 (0.38%) Cisco Nexus
7 2 (0.38%) FCoE
7 2 (0.38%) Fibre Channel
7 2 (0.38%) iSCSI
8 1 (0.19%) Cisco ASA
8 1 (0.19%) Internet
8 1 (0.19%) VPN
Database & Business Intelligence
1 294 (55.58%) Big Data
2 163 (30.81%) Apache Hive
3 99 (18.71%) Data Warehouse
4 84 (15.88%) HBase
5 80 (15.12%) NoSQL
6 74 (13.99%) PostgreSQL
7 71 (13.42%) Data Lake
8 64 (12.10%) MongoDB
9 63 (11.91%) Apache Cassandra
9 63 (11.91%) Relational Database
10 62 (11.72%) Tableau
11 48 (9.07%) SQL Server
12 44 (8.32%) MySQL
13 33 (6.24%) Spark SQL
14 30 (5.67%) BigQuery
15 29 (5.48%) Impala
16 25 (4.73%) Power BI
17 24 (4.54%) Metadata
17 24 (4.54%) RDBMS
18 21 (3.97%) Azkaban
Development Applications
1 67 (12.67%) Git (software)
2 58 (10.96%) Jenkins
3 44 (8.32%) JIRA
4 18 (3.40%) GitLab
5 16 (3.02%) Maven
6 15 (2.84%) TeamCity
7 13 (2.46%) Mockito
7 13 (2.46%) Sonatype Nexus
8 12 (2.27%) JUnit
8 12 (2.27%) Subversion
9 10 (1.89%) Bitbucket
10 9 (1.70%) Cucumber
10 9 (1.70%) Selenium
11 8 (1.51%) Visual Studio
12 7 (1.32%) Artifactory
12 7 (1.32%) ERwin
12 7 (1.32%) Visual Studio Team System
12 7 (1.32%) WebDriver
13 6 (1.13%) ER Studio
14 5 (0.95%) Protractor
General
1 126 (23.82%) Finance
2 99 (18.71%) Social Skills
3 92 (17.39%) Banking
4 58 (10.96%) Analytical Skills
5 25 (4.73%) Presentation Skills
6 24 (4.54%) Investment Banking
7 14 (2.65%) Marketing
7 14 (2.65%) Telecoms
8 12 (2.27%) Games
8 12 (2.27%) Legal
9 11 (2.08%) Documentation Skills
10 10 (1.89%) Public Sector
11 9 (1.70%) Financial Institution
12 8 (1.51%) Retail
13 6 (1.13%) Influencing Skills
14 5 (0.95%) Front Office
15 4 (0.76%) Aerospace
15 4 (0.76%) Retail Banking
16 3 (0.57%) Electronics
16 3 (0.57%) Law
Job Titles
1 145 (27.41%) Data Engineer
2 120 (22.68%) Developer
3 80 (15.12%) Architect
4 41 (7.75%) DevOps Engineer
5 37 (6.99%) Big Data Engineer
5 37 (6.99%) Data Architect
6 32 (6.05%) Scala Developer
7 24 (4.54%) AWS Engineer
8 23 (4.35%) Hadoop Engineer
9 22 (4.16%) Java Developer
10 21 (3.97%) Solutions Architect
11 19 (3.59%) Hadoop Developer
12 18 (3.40%) Azure Engineer
12 18 (3.40%) Data Manager
13 17 (3.21%) Cloud Architect
14 16 (3.02%) Python Engineer
15 15 (2.84%) Java Engineer
16 14 (2.65%) Analyst
16 14 (2.65%) Data Scientist
16 14 (2.65%) Senior Architect
Libraries, Frameworks & Software Standards
1 186 (35.16%) Kafka
2 49 (9.26%) PySpark
3 43 (8.13%) Spring
4 35 (6.62%) Spark Streaming
5 27 (5.10%) RESTful
6 25 (4.73%) Spring Boot
7 19 (3.59%) ARM Templates
8 18 (3.40%) Akka
9 17 (3.21%) JSON
10 15 (2.84%) Apache NiFi
11 14 (2.65%) Web Services
12 13 (2.46%) Apache Avro
12 13 (2.46%) RabbitMQ
12 13 (2.46%) XML
13 11 (2.08%) OAuth
14 10 (1.89%) AngularJS
14 10 (1.89%) HTML
14 10 (1.89%) WireMock
15 9 (1.70%) .NET
15 9 (1.70%) TensorFlow
Miscellaneous
1 42 (7.94%) Data Structures
2 19 (3.59%) Algorithms
3 18 (3.40%) Data Centre
4 17 (3.21%) Management Information System
5 15 (2.84%) Virtual Team
6 14 (2.65%) Data Protection Act
7 11 (2.08%) Legacy Systems
7 11 (2.08%) Self-Motivation
8 10 (1.89%) Market Risk
9 8 (1.51%) Derivative
9 8 (1.51%) Linux Command Line
10 7 (1.32%) Legacy Code
10 7 (1.32%) Public Cloud
10 7 (1.32%) Reference Data
11 6 (1.13%) Cloud Native
11 6 (1.13%) Private Cloud
12 5 (0.95%) Hedge funds
12 5 (0.95%) PKI
13 4 (0.76%) Mainframe
14 3 (0.57%) Equities
Operating Systems
1 62 (11.72%) Linux
2 41 (7.75%) Unix
3 11 (2.08%) Debian
4 6 (1.13%) VMS
5 5 (0.95%) Windows
6 2 (0.38%) Red Hat Enterprise Linux
6 2 (0.38%) Solaris
Processes & Methodologies
1 160 (30.25%) Analytics
2 145 (27.41%) Agile Software Development
3 118 (22.31%) DevOps
4 109 (20.60%) ETL
5 103 (19.47%) Data Modelling
6 99 (18.71%) Data Pipeline
7 79 (14.93%) Business Intelligence
8 78 (14.74%) Computer Science
9 69 (13.04%) Scrum
10 68 (12.85%) Data Science
11 67 (12.67%) Microservices
12 65 (12.29%) Machine Learning
13 59 (11.15%) Data Engineering
14 56 (10.59%) Migration
15 53 (10.02%) Visualisation
16 49 (9.26%) Data Architecture
17 45 (8.51%) Data Analytics
17 45 (8.51%) Data Management
18 43 (8.13%) Open Source
19 41 (7.75%) OO
Programming Languages
1 242 (45.75%) SQL
2 221 (41.78%) Python
3 173 (32.70%) Java
4 125 (23.63%) Scala
5 26 (4.91%) R
5 26 (4.91%) Shell Script
6 21 (3.97%) JavaScript
7 12 (2.27%) C++
7 12 (2.27%) PL/SQL
8 11 (2.08%) C#
9 10 (1.89%) Bash Shell
9 10 (1.89%) CQL
9 10 (1.89%) Go
9 10 (1.89%) Groovy
10 9 (1.70%) C
10 9 (1.70%) Java 8
11 8 (1.51%) Perl
12 7 (1.32%) Java 11
12 7 (1.32%) PowerShell
12 7 (1.32%) Ruby
Qualifications
1 67 (12.67%) Degree
2 49 (9.26%) Computer Science Degree
3 41 (7.75%) Security Cleared
4 24 (4.54%) SC Cleared
5 4 (0.76%) DV Cleared
5 4 (0.76%) Master's Degree
6 3 (0.57%) PhD
7 2 (0.38%) BPSS Clearance
8 1 (0.19%) CBAP
8 1 (0.19%) PMI Certification
8 1 (0.19%) SAS Certification
Quality Assurance & Compliance
1 35 (6.62%) Data Quality
2 25 (4.73%) QA
3 11 (2.08%) GDPR
4 8 (1.51%) SLA
5 4 (0.76%) MiFID
6 2 (0.38%) COBIT
6 2 (0.38%) ISO/IEC 27001
6 2 (0.38%) NIST
7 1 (0.19%) Dodd-Frank
7 1 (0.19%) EMIR
7 1 (0.19%) ISO 20022
7 1 (0.19%) PSD2
7 1 (0.19%) TARGET2
System Software
1 94 (17.77%) Docker
2 51 (9.64%) HDFS
3 14 (2.65%) Apache ZooKeeper
4 5 (0.95%) Oracle RAC
4 5 (0.95%) vCloud
5 4 (0.76%) Apache Flume
6 3 (0.57%) VMware Infrastructure
7 2 (0.38%) Active Directory
7 2 (0.38%) Hyper-V
7 2 (0.38%) KVM
7 2 (0.38%) NFS
7 2 (0.38%) SRDF
7 2 (0.38%) Xen
Systems Management
1 88 (16.64%) Kubernetes
2 59 (11.15%) Terraform
3 41 (7.75%) Ansible
4 25 (4.73%) Prometheus
5 21 (3.97%) Hadoop YARN
6 20 (3.78%) Grafana
7 19 (3.59%) Oozie
8 14 (2.65%) Puppet
9 11 (2.08%) Control-M
10 7 (1.32%) Ambari
10 7 (1.32%) Consul
11 6 (1.13%) Rancher
12 5 (0.95%) Fluentd
12 5 (0.95%) HAProxy
12 5 (0.95%) ZABBIX
13 4 (0.76%) Kibana
14 2 (0.38%) logstash
14 2 (0.38%) Opscode Chef
14 2 (0.38%) Tivoli
15 1 (0.19%) FortiGate
Vendors
1 68 (12.85%) Cloudera
2 62 (11.72%) Google
3 60 (11.34%) Oracle
4 42 (7.94%) Databricks
5 38 (7.18%) Microsoft
6 35 (6.62%) Informatica
7 27 (5.10%) Teradata
8 24 (4.54%) Splunk
9 21 (3.97%) Hortonworks
10 18 (3.40%) Alteryx
11 17 (3.21%) SAP
12 13 (2.46%) Ab Initio
13 11 (2.08%) AppDynamics
14 10 (1.89%) MapR
15 9 (1.70%) IBM
15 9 (1.70%) StreamSets
16 8 (1.51%) Adobe
16 8 (1.51%) Red Hat
16 8 (1.51%) VMware
17 7 (1.32%) Salesforce.com