Period
to

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 24 May 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK
6 months to
24 May 2022
Same period 2021 Same period 2020
Rank 304 189 190
Rank change year-on-year -115 +1 -55
Contract jobs citing Hadoop 713 812 676
As % of all contract jobs advertised in the UK 0.81% 1.39% 1.40%
As % of the Database & Business Intelligence category 4.16% 6.57% 6.50%
Number of daily rates quoted 449 452 490
10th Percentile £425 £400 £410
25th Percentile £512 £475 £463
Median daily rate (50th Percentile) £600 £550 £550
Median % change year-on-year +9.09% - -
75th Percentile £713 £625 £650
90th Percentile £825 £688 £725
UK excluding London median daily rate £540 £500 £520
% change year-on-year +8.00% -3.85% +2.97%
Number of hourly rates quoted 2 8 0
10th Percentile £57.68 £20.90 -
25th Percentile £57.94 £24.16 -
Median hourly rate £60.25 £27.00 -
Median % change year-on-year +123.15% - -
75th Percentile £62.31 £31.00 -
90th Percentile £62.43 £44.50 -
UK excluding London median hourly rate - £24.50 -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 17,151 12,351 10,396
As % of all contract IT jobs advertised in the UK 19.59% 21.18% 21.58%
Number of daily rates quoted 12,199 8,417 7,162
10th Percentile £375 £325 £325
25th Percentile £450 £406 £400
Median daily rate (50th Percentile) £549 £500 £488
Median % change year-on-year +9.80% +2.56% +2.63%
75th Percentile £650 £600 £588
90th Percentile £750 £688 £675
UK excluding London median daily rate £500 £445 £450
% change year-on-year +12.36% -1.11% +4.65%
Number of hourly rates quoted 180 215 151
10th Percentile £14.93 £11.64 £14.25
25th Percentile £22.40 £19.00 £18.25
Median hourly rate £45.00 £26.50 £24.71
Median % change year-on-year +69.81% +7.24% -13.30%
75th Percentile £65.00 £45.09 £46.00
90th Percentile £75.00 £60.55 £57.50
UK excluding London median hourly rate £35.00 £24.00 £23.50
% change year-on-year +45.83% +2.13% -13.20%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop.

Daily rate trend for Hadoop in the UK

Hadoop
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop over the 6 months to 24 May 2022.

Daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Hadoop.

Hourly rate trend for Hadoop in the UK

Hadoop
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 24 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -160 497 £600 +9.09% 91
Work from Home -87 391 £600 +11.11% 23
London -122 310 £625 +6.38% 56
UK excluding London -95 207 £540 +8.00% 37
South East -48 61 £588 +16.05% 7
Scotland -3 40 £500 +17.65% 2
Midlands -65 37 £490 +1.98% 12
North of England -61 36 £550 -0.90% 8
West Midlands -68 33 £495 +4.21% 9
Yorkshire -23 24 £575 +3.60% 2
East of England -25 12 £798 +59.50% 2
North West -43 11 £438 -27.08% 5
South West -53 10 £600 +14.29% 5
Wales -19 8 £549 +2.16%
Northern Ireland - 5 £475 - 1
East Midlands -21 4 £360 -40.00% 3
North East -13 1 £700 -6.67% 1

For the 6 months to 24 May 2022, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Hadoop.

1 397 (55.68%) Python
2 394 (55.26%) Apache Spark
3 346 (48.53%) SQL
4 321 (45.02%) Big Data
5 261 (36.61%) Java
6 251 (35.20%) Kafka
7 250 (35.06%) Analytics
8 238 (33.38%) Azure
9 215 (30.15%) AWS
10 205 (28.75%) Scala
11 199 (27.91%) Agile
12 191 (26.79%) Apache Hive
13 185 (25.95%) Finance
14 156 (21.88%) GCP
15 154 (21.60%) ETL
16 150 (21.04%) CI/CD
17 149 (20.90%) Linux
18 147 (20.62%) DevOps
19 139 (19.50%) Data Pipeline
20 136 (19.07%) NoSQL
21 132 (18.51%) Data Modelling
22 130 (18.23%) HDFS
23 127 (17.81%) Git (software)
24 124 (17.39%) Data Warehouse
25 122 (17.11%) Kubernetes
26 118 (16.55%) Apache
27 115 (16.13%) Business Intelligence
28 113 (15.85%) Machine Learning
29 111 (15.57%) HBase
29 111 (15.57%) Data Engineering

Hadoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 394 (55.26%) Apache Spark
2 118 (16.55%) Apache
3 59 (8.27%) Apache Airflow
4 45 (6.31%) Confluence
5 41 (5.75%) SAS
6 29 (4.07%) Elasticsearch
7 21 (2.95%) Apache Pig
8 14 (1.96%) Luigi
9 13 (1.82%) OpenStack
10 11 (1.54%) SharePoint
11 9 (1.26%) nginx
12 8 (1.12%) Tomcat
13 6 (0.84%) Jupyter
13 6 (0.84%) WebLogic
14 5 (0.70%) JBoss
14 5 (0.70%) WebSphere
15 4 (0.56%) Apache Pulsar
15 4 (0.56%) Oracle SOA Suite
16 3 (0.42%) Mule
16 3 (0.42%) Oracle Service Bus
Applications
1 34 (4.77%) Microsoft Excel
2 15 (2.10%) SPSS
3 8 (1.12%) Microsoft Office
4 7 (0.98%) Microsoft PowerPoint
4 7 (0.98%) Stata
5 6 (0.84%) Spreadsheet
6 4 (0.56%) MS Visio
7 1 (0.14%) Microsoft Project
Business Applications
1 5 (0.70%) SAP Oil and Gas
2 4 (0.56%) Oracle BPM
3 3 (0.42%) SAP FI-CA
3 3 (0.42%) SAP PSCD
Cloud Services
1 238 (33.38%) Azure
2 215 (30.15%) AWS
3 156 (21.88%) GCP
4 60 (8.42%) Power Platform
5 36 (5.05%) Azure Cosmos DB
6 32 (4.49%) Amazon EMR
6 32 (4.49%) Amazon S3
6 32 (4.49%) Azure Data Factory
6 32 (4.49%) dbt
7 29 (4.07%) Serverless
8 25 (3.51%) Snowflake
9 23 (3.23%) PaaS
10 22 (3.09%) Amazon EC2
10 22 (3.09%) GitHub
11 19 (2.66%) Azure Synapse Analytics
12 16 (2.24%) AWS Lambda
13 13 (1.82%) Amazon Kinesis
13 13 (1.82%) Azure Functions
13 13 (1.82%) IaaS
14 12 (1.68%) Azure Service Bus
Communications & Networking
1 9 (1.26%) HTTP
2 8 (1.12%) Firewall
3 7 (0.98%) DNS
3 7 (0.98%) FTP
3 7 (0.98%) MQTT
3 7 (0.98%) SSH
3 7 (0.98%) SSL
4 3 (0.42%) AMQP
4 3 (0.42%) Internet
5 2 (0.28%) 2G
5 2 (0.28%) 3G
5 2 (0.28%) 4G
5 2 (0.28%) 5G
5 2 (0.28%) Radio Access Network
5 2 (0.28%) TCP/IP
6 1 (0.14%) DHCP
6 1 (0.14%) Ethernet
6 1 (0.14%) Kerberos
6 1 (0.14%) SMTP
6 1 (0.14%) VPN
Database & Business Intelligence
1 321 (45.02%) Big Data
2 191 (26.79%) Apache Hive
3 136 (19.07%) NoSQL
4 124 (17.39%) Data Warehouse
5 111 (15.57%) HBase
6 84 (11.78%) Data Lake
7 81 (11.36%) MongoDB
8 74 (10.38%) Tableau
9 65 (9.12%) PostgreSQL
10 62 (8.70%) MySQL
11 60 (8.42%) BigQuery
11 60 (8.42%) Impala
12 59 (8.27%) SQL Server
13 58 (8.13%) Power BI
14 56 (7.85%) Apache Cassandra
15 50 (7.01%) Relational Database
16 40 (5.61%) Metadata
17 38 (5.33%) Amazon Redshift
18 35 (4.91%) Pentaho
19 30 (4.21%) Flink
Development Applications
1 127 (17.81%) Git (software)
2 87 (12.20%) Jenkins
3 56 (7.85%) JIRA
4 43 (6.03%) GitLab
5 35 (4.91%) Bitbucket
6 21 (2.95%) TeamCity
7 18 (2.52%) ERwin
8 16 (2.24%) MLflow
9 14 (1.96%) Subversion
10 13 (1.82%) Artifactory
10 13 (1.82%) Maven
11 12 (1.68%) Sonatype Nexus
12 10 (1.40%) ER Studio
13 8 (1.12%) SonarQube
14 5 (0.70%) Cucumber
14 5 (0.70%) IntelliJ
14 5 (0.70%) kappa
15 4 (0.56%) IBM UrbanCode
15 4 (0.56%) Spinnaker
16 3 (0.42%) Postman
General
1 185 (25.95%) Finance
2 108 (15.15%) Social Skills
3 78 (10.94%) Banking
4 72 (10.10%) Analytical Skills
5 48 (6.73%) Public Sector
6 35 (4.91%) Retail
7 30 (4.21%) Financial Institution
7 30 (4.21%) Marketing
8 28 (3.93%) Telecoms
9 25 (3.51%) Legal
10 14 (1.96%) Presentation Skills
11 13 (1.82%) Front Office
12 10 (1.40%) Manufacturing
13 9 (1.26%) Electronics
13 9 (1.26%) Investment Banking
14 8 (1.12%) Law
15 6 (0.84%) Influencing Skills
16 5 (0.70%) Documentation Skills
16 5 (0.70%) Games
17 4 (0.56%) Publishing
Job Titles
1 214 (30.01%) Data Engineer
2 126 (17.67%) Developer
3 92 (12.90%) Architect
4 67 (9.40%) Big Data Engineer
5 61 (8.56%) Analyst
6 53 (7.43%) Data Architect
7 46 (6.45%) Software Engineer
8 44 (6.17%) Data Analyst
9 42 (5.89%) Hadoop Engineer
10 39 (5.47%) Python Engineer
11 36 (5.05%) Cloud Engineer
12 35 (4.91%) Senior Developer
13 32 (4.49%) Solutions Architect
14 31 (4.35%) Scala Developer
15 30 (4.21%) DevOps Engineer
15 30 (4.21%) Machine Learning Engineer
16 29 (4.07%) Java Developer
17 26 (3.65%) Azure Engineer
18 25 (3.51%) Senior Data Engineer
19 20 (2.81%) AWS Engineer
Libraries, Frameworks & Software Standards
1 251 (35.20%) Kafka
2 74 (10.38%) PySpark
3 41 (5.75%) Apache NiFi
4 40 (5.61%) Spark Streaming
5 34 (4.77%) TensorFlow
6 33 (4.63%) Spring
7 25 (3.51%) Apache Beam
7 25 (3.51%) PyTorch
8 22 (3.09%) Elastic Stack
8 22 (3.09%) RabbitMQ
9 20 (2.81%) AngularJS
10 17 (2.38%) .NET
10 17 (2.38%) React
10 17 (2.38%) scikit-learn
11 16 (2.24%) BentoML
11 16 (2.24%) REST
11 16 (2.24%) Spring Boot
12 15 (2.10%) Apache Avro
12 15 (2.10%) gRPC
12 15 (2.10%) Pandas
Miscellaneous
1 46 (6.45%) Algorithms
2 37 (5.19%) Data Structures
3 34 (4.77%) Cloud Native
4 29 (4.07%) Self-Motivation
5 23 (3.23%) Hedge funds
5 23 (3.23%) Public Cloud
6 21 (2.95%) Greenfield Project
6 21 (2.95%) IoT
6 21 (2.95%) Management Information System
7 16 (2.24%) Enterprise Software
7 16 (2.24%) Legacy Systems
8 14 (1.96%) Equities
9 12 (1.68%) iPad
9 12 (1.68%) Linux Command Line
10 11 (1.54%) Data Protection Act
11 10 (1.40%) Virtual Team
12 8 (1.12%) Market Risk
13 7 (0.98%) Reference Data
14 6 (0.84%) Derivative
14 6 (0.84%) PKI
Operating Systems
1 149 (20.90%) Linux
2 65 (9.12%) Unix
3 43 (6.03%) Windows
4 9 (1.26%) CentOS
4 9 (1.26%) Ubuntu
5 6 (0.84%) Windows Server
6 5 (0.70%) Debian
7 3 (0.42%) VMS
7 3 (0.42%) Windows Server 2012
8 2 (0.28%) Android
8 2 (0.28%) Apple iOS
9 1 (0.14%) Red Hat Enterprise Linux
9 1 (0.14%) Windows 10
Processes & Methodologies
1 250 (35.06%) Analytics
2 199 (27.91%) Agile
3 154 (21.60%) ETL
4 150 (21.04%) CI/CD
5 147 (20.62%) DevOps
6 139 (19.50%) Data Pipeline
7 132 (18.51%) Data Modelling
8 115 (16.13%) Business Intelligence
9 113 (15.85%) Machine Learning
10 111 (15.57%) Data Engineering
11 108 (15.15%) Data Science
12 99 (13.88%) Software Engineering
13 81 (11.36%) Scrum
14 80 (11.22%) Microservices
15 79 (11.08%) Data Analytics
16 70 (9.82%) Continuous Integration
17 66 (9.26%) Data Architecture
18 65 (9.12%) Problem-Solving
19 62 (8.70%) Migration
20 58 (8.13%) OO
Programming Languages
1 397 (55.68%) Python
2 346 (48.53%) SQL
3 261 (36.61%) Java
4 205 (28.75%) Scala
5 81 (11.36%) R
6 47 (6.59%) Shell Script
7 36 (5.05%) PL/SQL
8 29 (4.07%) JavaScript
9 28 (3.93%) VBA
10 26 (3.65%) Perl
11 25 (3.51%) C++
12 23 (3.23%) HiveQL
13 21 (2.95%) C
14 19 (2.66%) Bash
14 19 (2.66%) C#
15 9 (1.26%) Go
15 9 (1.26%) Kotlin
15 9 (1.26%) TypeScript
16 6 (0.84%) PowerShell
17 5 (0.70%) T-SQL
Qualifications
1 85 (11.92%) Security Cleared
2 67 (9.40%) SC Cleared
3 35 (4.91%) Degree
4 20 (2.81%) Computer Science Degree
4 20 (2.81%) DV Cleared
5 19 (2.66%) PhD
6 8 (1.12%) Master's Degree
7 4 (0.56%) AWS Certification
7 4 (0.56%) TOGAF Certification
8 3 (0.42%) BPSS Clearance
8 3 (0.42%) ISEB
8 3 (0.42%) ISTQB
8 3 (0.42%) ISTQB Foundation Certification
9 1 (0.14%) DBS Check
9 1 (0.14%) Microsoft Certification
9 1 (0.14%) SAS Certification
9 1 (0.14%) Sun Certification
Quality Assurance & Compliance
1 42 (5.89%) Data Quality
2 22 (3.09%) QA
3 21 (2.95%) GDPR
4 7 (0.98%) SLA
5 4 (0.56%) ISO/IEC 27001
6 3 (0.42%) OASIS TOSCA
7 2 (0.28%) Accessibility
System Software
1 130 (18.23%) HDFS
2 85 (11.92%) Docker
3 19 (2.66%) Apache ZooKeeper
4 12 (1.68%) Apache Flume
5 6 (0.84%) Virtual Machines
6 5 (0.70%) Ceph
6 5 (0.70%) vCloud
7 3 (0.42%) Active Directory
7 3 (0.42%) VMware Infrastructure
8 1 (0.14%) Tivoli Workload Scheduler
8 1 (0.14%) VMware ESXi
Systems Management
1 122 (17.11%) Kubernetes
2 47 (6.59%) Ansible
3 40 (5.61%) Terraform
4 24 (3.37%) Kibana
5 22 (3.09%) Hadoop YARN
6 20 (2.81%) Grafana
7 19 (2.66%) Prometheus
8 17 (2.38%) Kubeflow
9 16 (2.24%) Argo
10 13 (1.82%) logstash
11 12 (1.68%) Oozie
12 9 (1.26%) ZABBIX
13 8 (1.12%) Ambari
13 8 (1.12%) Consul
14 7 (0.98%) HAProxy
15 5 (0.70%) Fluentd
16 4 (0.56%) Active Directory Federation Services
16 4 (0.56%) Opscode Chef
16 4 (0.56%) Packer
16 4 (0.56%) Puppet
Vendors
1 92 (12.90%) Oracle
2 91 (12.76%) Databricks
3 89 (12.48%) Cloudera
4 67 (9.40%) Google
5 47 (6.59%) Informatica
5 47 (6.59%) Talend
6 36 (5.05%) Microsoft
7 33 (4.63%) Teradata
8 31 (4.35%) SAP
9 30 (4.21%) Hortonworks
10 28 (3.93%) Alteryx
11 20 (2.81%) Splunk
12 15 (2.10%) StreamSets
13 13 (1.82%) VMware
14 12 (1.68%) Red Hat
15 11 (1.54%) Salesforce.com
16 9 (1.26%) Adobe
17 8 (1.12%) IBM
18 6 (0.84%) MapR
18 6 (0.84%) MicroStrategy