Period
to 27 January 2022

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 27 January 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
27 Jan 2022
Same period 2021 Same period 2020
Rank 218 174 149
Rank change year-on-year -44 -25 -42
Contract jobs citing Hadoop 477 276 547
As % of all contract jobs advertised in London 1.27% 1.54% 1.84%
As % of the Database & Business Intelligence category 5.51% 6.53% 7.65%
Number of daily rates quoted 277 167 398
10th Percentile £437 £413 £425
25th Percentile £513 £475 £500
Median daily rate (50th Percentile) £601 £563 £575
Median % change year-on-year +6.76% -2.17% -
75th Percentile £713 £638 £679
90th Percentile £800 £675 £738
England median daily rate £575 £525 £550
% change year-on-year +9.52% -4.55% -
Number of hourly rates quoted 3 0 0
10th Percentile £60.40 - -
25th Percentile £62.13 - -
Median hourly rate £65.00 - -
75th Percentile - - -
90th Percentile - - -
England median hourly rate £60.00 £24.50 -
% change year-on-year +144.90% - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,659 4,226 7,147
As % of all contract IT jobs advertised in London 23.03% 23.57% 24.02%
Number of daily rates quoted 6,450 3,052 5,201
10th Percentile £400 £350 £363
25th Percentile £488 £425 £425
Median daily rate (50th Percentile) £575 £525 £525
Median % change year-on-year +9.52% - -
75th Percentile £680 £619 £613
90th Percentile £763 £700 £700
England median daily rate £540 £488 £475
% change year-on-year +10.77% +2.63% -1.04%
Number of hourly rates quoted 42 25 36
10th Percentile £24.50 £20.40 £19.38
25th Percentile £26.00 £30.25 £25.00
Median hourly rate £36.88 £47.50 £33.75
Median % change year-on-year -22.36% +40.74% +21.71%
75th Percentile £60.75 £63.75 £48.97
90th Percentile £65.00 £68.00 £54.63
England median hourly rate £43.58 £26.00 £26.25
% change year-on-year +67.63% -0.95% -11.48%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a proportion of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Hadoop in London.

Daily rate trend for Hadoop in London

Hadoop
Daily Rate Histogram in London

Daily rate distribution for jobs citing Hadoop in London over the 6 months to 27 January 2022.

Daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Hadoop in London.

Hourly rate trend for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 27 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London -45 50 £600 +6.71% 24
South London -4 9 £540 +7.20%
West London -32 2 £636 +7.80% 10
Hadoop
England

For the 6 months to 27 January 2022, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 291 (61.01%) Apache Spark
2 260 (54.51%) Big Data
3 201 (42.14%) SQL
4 190 (39.83%) Python
5 180 (37.74%) Analytics
6 159 (33.33%) Kafka
7 148 (31.03%) Java
8 138 (28.93%) AWS
9 128 (26.83%) Agile Software Development
10 127 (26.62%) Apache Hive
11 123 (25.79%) ETL
12 121 (25.37%) Finance
13 116 (24.32%) Azure
14 115 (24.11%) Data Warehouse
15 110 (23.06%) Scala
16 105 (22.01%) DevOps
17 95 (19.92%) NoSQL
18 94 (19.71%) HBase
18 94 (19.71%) Business Intelligence
18 94 (19.71%) CI/CD
19 92 (19.29%) Data Modelling
20 91 (19.08%) Social Skills
21 81 (16.98%) Banking
22 80 (16.77%) Tableau
23 76 (15.93%) Linux
24 75 (15.72%) Machine Learning
25 74 (15.51%) Docker
26 73 (15.30%) Data Lake
27 72 (15.09%) GCP
28 68 (14.26%) MongoDB

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 291 (61.01%) Apache Spark
2 55 (11.53%) Apache
3 35 (7.34%) Apache Airflow
4 30 (6.29%) Elasticsearch
5 20 (4.19%) OpenStack
6 19 (3.98%) Luigi
7 18 (3.77%) SAS
8 16 (3.35%) Confluence
9 14 (2.94%) nginx
10 8 (1.68%) Apache Pig
11 5 (1.05%) Jupyter
12 2 (0.42%) Apache Solr
13 1 (0.21%) ArcGIS
13 1 (0.21%) Camunda
13 1 (0.21%) JBoss
13 1 (0.21%) Tomcat
Applications
1 15 (3.14%) Microsoft Excel
2 5 (1.05%) SPSS
3 1 (0.21%) Microsoft PowerPoint
3 1 (0.21%) SPSS Modeler
3 1 (0.21%) Stata
Business Applications
1 2 (0.42%) SAP Oil and Gas
2 1 (0.21%) Oracle BPM
2 1 (0.21%) Workday HCM
Cloud Services
1 138 (28.93%) AWS
2 116 (24.32%) Azure
3 72 (15.09%) GCP
4 40 (8.39%) Power Platform
5 35 (7.34%) Amazon EMR
6 33 (6.92%) Amazon S3
7 31 (6.50%) Serverless
8 29 (6.08%) Azure Cosmos DB
9 26 (5.45%) Snowflake
10 23 (4.82%) GitHub
11 20 (4.19%) PaaS
12 19 (3.98%) Amazon EC2
13 18 (3.77%) Azure Data Factory
14 16 (3.35%) Azure Functions
15 15 (3.14%) Amazon EKS
15 15 (3.14%) AWS Lambda
15 15 (3.14%) Route 53
16 13 (2.73%) Amazon ECS
16 13 (2.73%) Amazon Kinesis
17 10 (2.10%) Adobe Analytics
Communications & Networking
1 18 (3.77%) DNS
2 14 (2.94%) SSL
3 9 (1.89%) Kerberos
4 8 (1.68%) FTP
5 7 (1.47%) Firewall
6 4 (0.84%) HTTP
7 3 (0.63%) MQTT
7 3 (0.63%) VPN
8 2 (0.42%) LAN
8 2 (0.42%) Multicast
8 2 (0.42%) WAN
Database & Business Intelligence
1 260 (54.51%) Big Data
2 127 (26.62%) Apache Hive
3 115 (24.11%) Data Warehouse
4 95 (19.92%) NoSQL
5 94 (19.71%) HBase
6 80 (16.77%) Tableau
7 73 (15.30%) Data Lake
8 68 (14.26%) MongoDB
9 59 (12.37%) PostgreSQL
10 58 (12.16%) Apache Cassandra
11 40 (8.39%) Power BI
12 38 (7.97%) SQL Server
13 36 (7.55%) Relational Database
14 27 (5.66%) MySQL
15 25 (5.24%) BigQuery
15 25 (5.24%) Flink
16 22 (4.61%) Amazon Redshift
17 21 (4.40%) Metadata
18 19 (3.98%) Spark SQL
19 18 (3.77%) Amazon Athena
Development Applications
1 57 (11.95%) Git (software)
2 55 (11.53%) Jenkins
3 27 (5.66%) JIRA
4 24 (5.03%) GitLab
5 16 (3.35%) Sonatype Nexus
6 12 (2.52%) ERwin
6 12 (2.52%) Subversion
7 10 (2.10%) TeamCity
8 8 (1.68%) ER Studio
8 8 (1.68%) Maven
9 7 (1.47%) Artifactory
10 6 (1.26%) Bitbucket
11 5 (1.05%) JUnit
11 5 (1.05%) Mockito
11 5 (1.05%) PowerDesigner
12 4 (0.84%) Visual Studio
12 4 (0.84%) WebDriver
13 3 (0.63%) CircleCI
13 3 (0.63%) Visual Studio Team System
14 2 (0.42%) Terragrunt
General
1 121 (25.37%) Finance
2 91 (19.08%) Social Skills
3 81 (16.98%) Banking
4 53 (11.11%) Analytical Skills
5 30 (6.29%) Retail
6 26 (5.45%) Investment Banking
7 24 (5.03%) Marketing
8 22 (4.61%) Presentation Skills
9 16 (3.35%) Financial Institution
9 16 (3.35%) Telecoms
10 13 (2.73%) Legal
10 13 (2.73%) Public Sector
11 12 (2.52%) Games
12 9 (1.89%) Influencing Skills
13 5 (1.05%) Publishing
14 4 (0.84%) Aerospace
14 4 (0.84%) Documentation Skills
14 4 (0.84%) Electronics
14 4 (0.84%) Manufacturing
15 2 (0.42%) Retail Banking
Job Titles
1 128 (26.83%) Data Engineer
2 102 (21.38%) Developer
3 68 (14.26%) Architect
4 38 (7.97%) Data Architect
5 36 (7.55%) Scala Developer
6 35 (7.34%) Big Data Engineer
7 32 (6.71%) Senior Developer
8 29 (6.08%) DevOps Engineer
9 27 (5.66%) Analyst
10 26 (5.45%) Data Manager
10 26 (5.45%) Python Engineer
11 25 (5.24%) Senior Scala Developer
12 22 (4.61%) Hadoop Engineer
13 17 (3.56%) AWS Engineer
13 17 (3.56%) Big Data Manager
13 17 (3.56%) Software Engineer
13 17 (3.56%) Solutions Architect
14 16 (3.35%) Java Developer
14 16 (3.35%) Platform Manager
15 14 (2.94%) Senior Architect
Libraries, Frameworks & Software Standards
1 159 (33.33%) Kafka
2 35 (7.34%) PySpark
3 30 (6.29%) Spark Streaming
4 20 (4.19%) gRPC
5 18 (3.77%) OAuth
5 18 (3.77%) RabbitMQ
6 17 (3.56%) Spring
7 15 (3.14%) Apache NiFi
7 15 (3.14%) Elastic Stack
7 15 (3.14%) TensorFlow
8 14 (2.94%) JWT
8 14 (2.94%) RESTful
9 13 (2.73%) ARM Templates
9 13 (2.73%) REST
10 11 (2.31%) JSON
10 11 (2.31%) XML
11 10 (2.10%) NumPy
11 10 (2.10%) Pandas
11 10 (2.10%) Spring Boot
12 9 (1.89%) PyTorch
Miscellaneous
1 30 (6.29%) Algorithms
2 16 (3.35%) Data Structures
3 14 (2.94%) Legacy Systems
4 11 (2.31%) Self-Motivation
5 10 (2.10%) Market Risk
6 9 (1.89%) Cloud Native
7 8 (1.68%) Data Protection Act
8 7 (1.47%) Data Centre
8 7 (1.47%) Hedge funds
8 7 (1.47%) Legacy Applications
8 7 (1.47%) Management Information System
9 6 (1.26%) Derivative
9 6 (1.26%) PKI
10 5 (1.05%) Enterprise Software
10 5 (1.05%) Public Cloud
10 5 (1.05%) Virtual Team
11 4 (0.84%) Renewable Energy
12 3 (0.63%) Enterprise Cloud
12 3 (0.63%) Greenfield Project
12 3 (0.63%) Hybrid Cloud
Operating Systems
1 76 (15.93%) Linux
2 24 (5.03%) Unix
3 15 (3.14%) Debian
4 8 (1.68%) Windows
5 6 (1.26%) Ubuntu
6 4 (0.84%) Red Hat Enterprise Linux
7 3 (0.63%) CentOS
8 2 (0.42%) Windows Server
8 2 (0.42%) Windows Server 2012
9 1 (0.21%) VMS
9 1 (0.21%) Windows 10
Processes & Methodologies
1 180 (37.74%) Analytics
2 128 (26.83%) Agile Software Development
3 123 (25.79%) ETL
4 105 (22.01%) DevOps
5 94 (19.71%) Business Intelligence
5 94 (19.71%) CI/CD
6 92 (19.29%) Data Modelling
7 75 (15.72%) Machine Learning
8 67 (14.05%) Data Science
9 66 (13.84%) Data Management
10 59 (12.37%) Data Architecture
11 58 (12.16%) Data Pipeline
11 58 (12.16%) Microservices
12 56 (11.74%) Data Engineering
12 56 (11.74%) Scrum
12 56 (11.74%) Visualisation
13 52 (10.90%) Problem-Solving
14 44 (9.22%) Computer Science
15 43 (9.01%) Data Analytics
15 43 (9.01%) Migration
Programming Languages
1 201 (42.14%) SQL
2 190 (39.83%) Python
3 148 (31.03%) Java
4 110 (23.06%) Scala
5 24 (5.03%) R
6 22 (4.61%) C++
7 21 (4.40%) PL/SQL
8 20 (4.19%) C
8 20 (4.19%) Shell Script
9 15 (3.14%) JavaScript
10 11 (2.31%) Bash
10 11 (2.31%) C#
11 8 (1.68%) PowerShell
12 7 (1.47%) T-SQL
13 6 (1.26%) HiveQL
14 5 (1.05%) Java 8
14 5 (1.05%) Kotlin
15 4 (0.84%) Java 11
15 4 (0.84%) TypeScript
16 3 (0.63%) Perl
Qualifications
1 44 (9.22%) Degree
2 30 (6.29%) Computer Science Degree
3 17 (3.56%) Security Cleared
4 14 (2.94%) SC Cleared
5 4 (0.84%) AWS Certification
5 4 (0.84%) Master's Degree
6 3 (0.63%) DV Cleared
7 2 (0.42%) BPSS Clearance
8 1 (0.21%) ACCA
8 1 (0.21%) PhD
Quality Assurance & Compliance
1 43 (9.01%) Data Quality
2 15 (3.14%) GDPR
3 3 (0.63%) QA
4 2 (0.42%) MiFID
4 2 (0.42%) NCSC
4 2 (0.42%) Sarbanes-Oxley
4 2 (0.42%) SLA
5 1 (0.21%) COREP
5 1 (0.21%) FINREP
5 1 (0.21%) IFRS
5 1 (0.21%) IFRS 9
System Software
1 74 (15.51%) Docker
2 61 (12.79%) HDFS
3 14 (2.94%) Apache ZooKeeper
3 14 (2.94%) vCloud
4 5 (1.05%) Apache Flume
5 2 (0.42%) Active Directory Lightweight Directory Services
6 1 (0.21%) Ceph
6 1 (0.21%) Oracle RAC
Systems Management
1 65 (13.63%) Kubernetes
2 47 (9.85%) Terraform
3 36 (7.55%) Ansible
4 32 (6.71%) Prometheus
5 28 (5.87%) Grafana
6 20 (4.19%) Kibana
7 17 (3.56%) Hadoop YARN
8 16 (3.35%) Consul
9 14 (2.94%) Fluentd
9 14 (2.94%) HAProxy
9 14 (2.94%) Oozie
9 14 (2.94%) ZABBIX
10 9 (1.89%) logstash
11 2 (0.42%) Ambari
11 2 (0.42%) Control-M
11 2 (0.42%) Kubeflow
11 2 (0.42%) Puppet
12 1 (0.21%) Docker Swarm
12 1 (0.21%) Opscode Chef
12 1 (0.21%) Single Sign-On
Vendors
1 46 (9.64%) Cloudera
2 44 (9.22%) Hortonworks
3 43 (9.01%) Google
4 42 (8.81%) Databricks
5 37 (7.76%) Informatica
6 34 (7.13%) Microsoft
7 33 (6.92%) Oracle
8 25 (5.24%) Ab Initio
9 23 (4.82%) Alteryx
9 23 (4.82%) Teradata
10 22 (4.61%) Red Hat
11 20 (4.19%) Splunk
12 18 (3.77%) MapR
12 18 (3.77%) SAP
13 16 (3.35%) Adobe
14 14 (2.94%) CA
14 14 (2.94%) CyberArk
14 14 (2.94%) Sonatype
14 14 (2.94%) VMware
15 12 (2.52%) Salesforce.com