Period
to

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 17 May 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
17 May 2022
Same period 2021 Same period 2020
Rank 350 191 185
Rank change year-on-year -159 -6 -58
Contract jobs citing Hadoop 507 635 643
As % of all contract jobs advertised in England 0.72% 1.40% 1.44%
As % of the Database & Business Intelligence category 3.68% 6.61% 6.58%
Number of daily rates quoted 306 377 460
10th Percentile £424 £400 £409
25th Percentile £513 £473 £463
Median daily rate (50th Percentile) £601 £550 £550
Median % change year-on-year +9.32% - -
75th Percentile £718 £625 £650
90th Percentile £813 £675 £714
UK median daily rate £600 £550 £550
% change year-on-year +9.09% - -
Number of hourly rates quoted 2 3 0
10th Percentile £57.68 £16.60 -
25th Percentile £57.94 £20.13 -
Median hourly rate £60.25 £27.00 -
Median % change year-on-year +123.15% - -
75th Percentile £62.31 £41.50 -
90th Percentile £62.43 £49.60 -
UK median hourly rate £60.25 £27.00 -
% change year-on-year +123.15% - -

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 13,767 9,607 9,778
As % of all contract IT jobs advertised in England 19.58% 21.21% 21.86%
Number of daily rates quoted 9,983 6,659 6,824
10th Percentile £363 £322 £325
25th Percentile £450 £408 £403
Median daily rate (50th Percentile) £550 £500 £498
Median % change year-on-year +10.00% +0.50% +2.05%
75th Percentile £653 £600 £588
90th Percentile £750 £688 £675
UK median daily rate £545 £500 £481
% change year-on-year +9.00% +4.03% +1.18%
Number of hourly rates quoted 168 175 143
10th Percentile £14.78 £11.25 £13.74
25th Percentile £22.22 £18.00 £17.83
Median hourly rate £45.00 £24.50 £24.70
Median % change year-on-year +83.67% -0.81% -17.67%
75th Percentile £65.14 £48.13 £45.25
90th Percentile £75.00 £63.05 £57.40
UK median hourly rate £45.00 £26.00 £24.10
% change year-on-year +73.08% +7.88% -15.44%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a proportion of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Hadoop in England.

Daily rate trend for Hadoop in England

Hadoop
Daily Rate Histogram in England

Daily rate distribution for jobs citing Hadoop in England over the 6 months to 17 May 2022.

Daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Hadoop in England.

Hourly rate trend for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 17 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London -132 314 £625 +8.23% 74
South East -44 65 £575 +15.00% 13
North of England -43 39 £550 -0.90% 14
Midlands -61 34 £483 -0.72% 11
West Midlands -62 30 £495 +4.21% 7
Yorkshire -22 27 £575 +3.60% 7
East of England -28 13 £798 +59.50%
North West -50 11 £438 -26.32% 6
South West -54 7 - - 2
East Midlands -11 4 £360 -40.00% 4
North East - 1 £700 - 1
Hadoop
UK

For the 6 months to 17 May 2022, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 269 (53.06%) Python
2 258 (50.89%) Apache Spark
3 237 (46.75%) SQL
4 228 (44.97%) Big Data
5 187 (36.88%) Java
6 185 (36.49%) Analytics
7 184 (36.29%) Azure
8 167 (32.94%) Kafka
9 158 (31.16%) AWS
10 154 (30.37%) Agile
11 153 (30.18%) Scala
12 148 (29.19%) Apache Hive
12 148 (29.19%) Finance
13 131 (25.84%) Linux
14 116 (22.88%) CI/CD
15 107 (21.10%) ETL
16 105 (20.71%) Git (software)
17 102 (20.12%) DevOps
18 101 (19.92%) HDFS
19 96 (18.93%) NoSQL
20 95 (18.74%) Data Pipeline
21 93 (18.34%) GCP
22 88 (17.36%) Machine Learning
23 85 (16.77%) HBase
23 85 (16.77%) Data Modelling
24 84 (16.57%) Apache
25 82 (16.17%) Data Warehouse
26 81 (15.98%) Business Intelligence
27 79 (15.58%) Data Science
28 78 (15.38%) Kubernetes

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 258 (50.89%) Apache Spark
2 84 (16.57%) Apache
3 36 (7.10%) Apache Airflow
4 34 (6.71%) Confluence
4 34 (6.71%) SAS
5 22 (4.34%) Elasticsearch
6 15 (2.96%) Apache Pig
7 13 (2.56%) Luigi
7 13 (2.56%) OpenStack
8 10 (1.97%) nginx
9 8 (1.58%) SharePoint
9 8 (1.58%) Tomcat
10 4 (0.79%) Apache Pulsar
11 3 (0.59%) Mule
11 3 (0.59%) WebLogic
12 2 (0.39%) IIS
12 2 (0.39%) JBoss
12 2 (0.39%) Jupyter
12 2 (0.39%) Oracle SOA Suite
12 2 (0.39%) WebSphere
Applications
1 26 (5.13%) Microsoft Excel
2 12 (2.37%) SPSS
3 6 (1.18%) Stata
4 5 (0.99%) Spreadsheet
5 4 (0.79%) Microsoft Office
6 2 (0.39%) Microsoft PowerPoint
7 1 (0.20%) Microsoft Project
7 1 (0.20%) MS Visio
Business Applications
1 5 (0.99%) SAP Oil and Gas
2 3 (0.59%) SAP FI-CA
2 3 (0.59%) SAP PSCD
3 2 (0.39%) Oracle BPM
Cloud Services
1 184 (36.29%) Azure
2 158 (31.16%) AWS
3 93 (18.34%) GCP
4 47 (9.27%) Power Platform
5 24 (4.73%) Azure Cosmos DB
6 23 (4.54%) Amazon S3
7 21 (4.14%) Amazon EMR
8 20 (3.94%) GitHub
9 18 (3.55%) PaaS
10 17 (3.35%) Amazon EC2
11 16 (3.16%) Serverless
12 14 (2.76%) Azure Data Factory
12 14 (2.76%) Azure Synapse Analytics
13 12 (2.37%) Snowflake
14 10 (1.97%) Azure Service Bus
14 10 (1.97%) OpenShift
15 9 (1.78%) Amazon SQS
15 9 (1.78%) Azure Functions
16 8 (1.58%) Adobe Analytics
17 7 (1.38%) IaaS
Communications & Networking
1 9 (1.78%) DNS
1 9 (1.78%) HTTP
1 9 (1.78%) SSL
2 6 (1.18%) FTP
2 6 (1.18%) MQTT
3 4 (0.79%) Firewall
3 4 (0.79%) SSH
4 3 (0.59%) Internet
5 2 (0.39%) Radio Access Network
6 1 (0.20%) 2G
6 1 (0.20%) 3G
6 1 (0.20%) 4G
6 1 (0.20%) 5G
6 1 (0.20%) AMQP
6 1 (0.20%) DHCP
6 1 (0.20%) Ethernet
6 1 (0.20%) Kerberos
6 1 (0.20%) SMTP
6 1 (0.20%) TCP/IP
6 1 (0.20%) VPN
Database & Business Intelligence
1 228 (44.97%) Big Data
2 148 (29.19%) Apache Hive
3 96 (18.93%) NoSQL
4 85 (16.77%) HBase
5 82 (16.17%) Data Warehouse
6 63 (12.43%) MongoDB
7 62 (12.23%) Data Lake
8 53 (10.45%) MySQL
9 50 (9.86%) Tableau
10 46 (9.07%) SQL Server
11 45 (8.88%) Power BI
12 44 (8.68%) PostgreSQL
13 43 (8.48%) Impala
14 42 (8.28%) Apache Cassandra
15 34 (6.71%) Relational Database
16 30 (5.92%) Metadata
16 30 (5.92%) Pentaho
17 27 (5.33%) Amazon Redshift
18 20 (3.94%) Amazon Athena
18 20 (3.94%) BigQuery
Development Applications
1 105 (20.71%) Git (software)
2 77 (15.19%) Jenkins
3 46 (9.07%) JIRA
4 34 (6.71%) GitLab
5 29 (5.72%) Bitbucket
6 16 (3.16%) Subversion
7 13 (2.56%) TeamCity
8 12 (2.37%) Maven
9 11 (2.17%) Sonatype Nexus
10 10 (1.97%) ERwin
11 9 (1.78%) ER Studio
11 9 (1.78%) MLflow
12 6 (1.18%) Artifactory
13 5 (0.99%) Cucumber
13 5 (0.99%) Log4j
13 5 (0.99%) Mercurial
13 5 (0.99%) SonarQube
14 4 (0.79%) FindBugs
14 4 (0.79%) IBM UrbanCode
14 4 (0.79%) Visual Studio Team System
General
1 148 (29.19%) Finance
2 74 (14.60%) Social Skills
3 60 (11.83%) Banking
4 58 (11.44%) Analytical Skills
5 35 (6.90%) Retail
6 31 (6.11%) Financial Institution
7 29 (5.72%) Marketing
7 29 (5.72%) Public Sector
8 28 (5.52%) Telecoms
9 26 (5.13%) Legal
10 14 (2.76%) Presentation Skills
11 13 (2.56%) Front Office
12 11 (2.17%) Manufacturing
13 8 (1.58%) Electronics
13 8 (1.58%) Investment Banking
14 7 (1.38%) Influencing Skills
15 6 (1.18%) Games
16 4 (0.79%) Publishing
17 3 (0.59%) Documentation Skills
18 2 (0.39%) Spanish Language
Job Titles
1 137 (27.02%) Data Engineer
2 100 (19.72%) Developer
3 58 (11.44%) Architect
4 48 (9.47%) Big Data Engineer
5 39 (7.69%) Analyst
6 38 (7.50%) Software Engineer
7 37 (7.30%) Hadoop Engineer
8 32 (6.31%) Data Architect
9 31 (6.11%) DevOps Engineer
10 30 (5.92%) Senior Developer
11 29 (5.72%) Python Engineer
12 28 (5.52%) Java Developer
13 27 (5.33%) Cloud Engineer
14 24 (4.73%) Data Analyst
14 24 (4.73%) Machine Learning Engineer
14 24 (4.73%) Scala Developer
15 23 (4.54%) Azure Engineer
16 22 (4.34%) Senior Data Engineer
17 21 (4.14%) Solutions Architect
18 15 (2.96%) Big Data Developer
Libraries, Frameworks & Software Standards
1 167 (32.94%) Kafka
2 49 (9.66%) PySpark
3 35 (6.90%) Apache NiFi
4 30 (5.92%) Spark Streaming
5 24 (4.73%) Spring
5 24 (4.73%) TensorFlow
6 23 (4.54%) Elastic Stack
7 21 (4.14%) RabbitMQ
8 17 (3.35%) PyTorch
9 16 (3.16%) Apache Beam
9 16 (3.16%) gRPC
9 16 (3.16%) REST
10 13 (2.56%) OAuth
10 13 (2.56%) RESTful
10 13 (2.56%) Spring Boot
11 12 (2.37%) .NET
11 12 (2.37%) JSON
12 11 (2.17%) scikit-learn
13 10 (1.97%) AngularJS
14 9 (1.78%) Apache Avro
Miscellaneous
1 35 (6.90%) Algorithms
2 27 (5.33%) Data Structures
3 24 (4.73%) Hedge funds
4 22 (4.34%) Cloud Native
4 22 (4.34%) Self-Motivation
5 16 (3.16%) IoT
6 14 (2.76%) Management Information System
7 13 (2.56%) Enterprise Software
7 13 (2.56%) Public Cloud
8 12 (2.37%) Legacy Systems
9 11 (2.17%) Data Protection Act
9 11 (2.17%) Equities
10 9 (1.78%) Linux Command Line
11 8 (1.58%) Virtual Team
12 7 (1.38%) Market Risk
12 7 (1.38%) PKI
13 6 (1.18%) Greenfield Project
13 6 (1.18%) iPad
13 6 (1.18%) Reference Data
14 5 (0.99%) Renewable Energy
Operating Systems
1 131 (25.84%) Linux
2 50 (9.86%) Unix
3 37 (7.30%) Windows
4 7 (1.38%) Debian
4 7 (1.38%) Ubuntu
4 7 (1.38%) Windows Server
5 6 (1.18%) CentOS
6 3 (0.59%) VMS
6 3 (0.59%) Windows Server 2012
7 2 (0.39%) Android
7 2 (0.39%) Apple iOS
8 1 (0.20%) Windows 10
Processes & Methodologies
1 185 (36.49%) Analytics
2 154 (30.37%) Agile
3 116 (22.88%) CI/CD
4 107 (21.10%) ETL
5 102 (20.12%) DevOps
6 95 (18.74%) Data Pipeline
7 88 (17.36%) Machine Learning
8 85 (16.77%) Data Modelling
9 81 (15.98%) Business Intelligence
10 79 (15.58%) Data Science
11 75 (14.79%) Software Engineering
12 72 (14.20%) Scrum
13 70 (13.81%) Data Engineering
14 61 (12.03%) Microservices
15 60 (11.83%) Continuous Integration
16 57 (11.24%) Data Analytics
17 52 (10.26%) Migration
18 51 (10.06%) Problem-Solving
19 47 (9.27%) Data Architecture
20 41 (8.09%) Data Protection
Programming Languages
1 269 (53.06%) Python
2 237 (46.75%) SQL
3 187 (36.88%) Java
4 153 (30.18%) Scala
5 54 (10.65%) R
6 37 (7.30%) Shell Script
7 30 (5.92%) PL/SQL
8 24 (4.73%) VBA
9 23 (4.54%) JavaScript
10 22 (4.34%) Perl
11 21 (4.14%) C++
12 20 (3.94%) HiveQL
13 17 (3.35%) C
14 16 (3.16%) Bash
15 13 (2.56%) C#
16 7 (1.38%) Kotlin
16 7 (1.38%) PowerShell
17 6 (1.18%) TypeScript
18 5 (0.99%) T-SQL
19 4 (0.79%) Go
Qualifications
1 72 (14.20%) Security Cleared
2 57 (11.24%) SC Cleared
3 25 (4.93%) Degree
4 14 (2.76%) DV Cleared
5 13 (2.56%) Computer Science Degree
6 9 (1.78%) PhD
7 5 (0.99%) Master's Degree
8 3 (0.59%) BPSS Clearance
8 3 (0.59%) ISEB
8 3 (0.59%) ISTQB
8 3 (0.59%) ISTQB Foundation Certification
9 1 (0.20%) AWS Certification
9 1 (0.20%) DBS Check
9 1 (0.20%) SAS Certification
9 1 (0.20%) Sun Certification
9 1 (0.20%) TOGAF Certification
Quality Assurance & Compliance
1 36 (7.10%) Data Quality
2 22 (4.34%) GDPR
3 16 (3.16%) QA
4 3 (0.59%) OASIS TOSCA
5 2 (0.39%) Accessibility
5 2 (0.39%) SLA
System Software
1 101 (19.92%) HDFS
2 70 (13.81%) Docker
3 13 (2.56%) Apache ZooKeeper
4 7 (1.38%) vCloud
5 5 (0.99%) Apache Flume
5 5 (0.99%) Ceph
5 5 (0.99%) Virtual Machines
6 3 (0.59%) Active Directory
Systems Management
1 78 (15.38%) Kubernetes
2 42 (8.28%) Ansible
3 27 (5.33%) Terraform
4 23 (4.54%) Kibana
5 21 (4.14%) Grafana
6 17 (3.35%) Prometheus
7 14 (2.76%) Hadoop YARN
8 13 (2.56%) logstash
9 12 (2.37%) ZABBIX
10 10 (1.97%) Consul
10 10 (1.97%) Kubeflow
10 10 (1.97%) Oozie
11 9 (1.78%) HAProxy
12 7 (1.38%) Ambari
12 7 (1.38%) Argo
12 7 (1.38%) Fluentd
13 4 (0.79%) Puppet
14 3 (0.59%) Opscode Chef
14 3 (0.59%) Packer
14 3 (0.59%) Rancher
Vendors
1 63 (12.43%) Cloudera
2 60 (11.83%) Oracle
3 55 (10.85%) Databricks
4 44 (8.68%) Google
4 44 (8.68%) Informatica
5 32 (6.31%) Microsoft
6 28 (5.52%) SAP
7 27 (5.33%) Hortonworks
7 27 (5.33%) Talend
8 24 (4.73%) Alteryx
9 18 (3.55%) Teradata
10 15 (2.96%) Splunk
11 13 (2.56%) StreamSets
12 11 (2.17%) Red Hat
13 10 (1.97%) Adobe
13 10 (1.97%) VMware
14 7 (1.38%) CA
14 7 (1.38%) CyberArk
14 7 (1.38%) Salesforce.com
14 7 (1.38%) Sonatype