Period
to 25 February 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 25 February 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
25 Feb 2020
Same period 2019 Same period 2018
Rank 191 123 123
Rank change year-on-year -68 0 -19
Contract jobs citing Hadoop 886 1,896 1,945
As % of all contract IT jobs advertised in England 1.43% 2.11% 2.12%
As % of the Database & Business Intelligence category 6.69% 9.34% 9.68%
Number of daily rates quoted 602 1,273 1,383
England median daily rate £550 £550 £550
10th Percentile £413 £413 £400
90th Percentile £725 £719 £675
UK median daily rate £550 £550 £550
% change year-on-year - +0.09% +2.23%
Number of hourly rates quoted 0 4 7
England median hourly rate - £50.00 £37.50
Median hourly rate % change year-on-year - +33.33% -20.21%
UK median hourly rate - £50.00 £37.50
% change year-on-year - +33.33% -20.21%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 13,252 20,301 20,097
As % of all contract IT jobs advertised in England 21.45% 22.54% 21.87%
Number of daily rates quoted 8,878 14,144 14,157
England median daily rate £488 £488 £475
Median daily rate % change year-on-year - +2.63% +8.57%
10th Percentile £325 £325 £313
90th Percentile £675 £650 £638
UK median daily rate £475 £475 £463
% change year-on-year - +2.70% +8.70%
Number of hourly rates quoted 224 222 220
England median hourly rate £31.25 £35.00 £33.50
Median hourly rate % change year-on-year -10.71% +4.48% +21.82%
10th Percentile £14.08 £14.00 £15.16
90th Percentile £56.73 £55.00 £56.94
UK median hourly rate £31.00 £35.00 £34.00
% change year-on-year -11.43% +2.94% +23.64%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in England.

Contractor daily rate trend for Hadoop in England

Hadoop
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Hadoop in England over the 6 months to 25 February 2020.

Contractor daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in England.

Contractor hourly rate trend for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 25 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -36 539 £575 - 168
South East -64 115 £476 -9.29% 44
North of England +3 114 £550 - 22
North West +19 71 £563 -6.25% 8
South West -22 54 £550 +11.11% 20
Yorkshire -18 35 £488 -2.50% 14
East of England +7 30 £513 -6.82% 8
Midlands -20 30 £475 -3.94% 18
West Midlands +37 22 £525 - 16
North East +23 9 £663 +34.18%
East Midlands -12 8 £450 -5.26% 2
Hadoop
UK

For the 6 months to 25 February 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 541 (61.06%) Big Data
2 462 (52.14%) Apache Spark
3 457 (51.58%) Python
4 356 (40.18%) SQL
5 299 (33.75%) Java
6 253 (28.56%) Kafka
7 251 (28.33%) AWS
8 250 (28.22%) Analytics
9 247 (27.88%) Agile Software Development
10 232 (26.19%) Scala
11 221 (24.94%) Apache Hive
12 203 (22.91%) ETL
13 188 (21.22%) Azure
14 180 (20.32%) NoSQL
15 179 (20.20%) Finance
16 176 (19.86%) DevOps
17 165 (18.62%) Data Science
18 164 (18.51%) Data Modelling
19 161 (18.17%) Cloudera
20 147 (16.59%) Data Warehouse
21 141 (15.91%) Linux
22 138 (15.58%) Jenkins
23 137 (15.46%) HBase
24 134 (15.12%) Machine Learning
24 134 (15.12%) HDFS
25 133 (15.01%) Kubernetes
26 130 (14.67%) Docker
27 119 (13.43%) Business Intelligence
28 112 (12.64%) Git (software)
29 111 (12.53%) Oracle

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 462 (52.14%) Apache Spark
2 70 (7.90%) Apache
3 62 (7.00%) SAS
4 40 (4.51%) Elasticsearch
5 27 (3.05%) Confluence
6 24 (2.71%) Apache Airflow
7 21 (2.37%) Jupyter
8 18 (2.03%) Apache Pig
9 16 (1.81%) Tomcat
10 9 (1.02%) Luigi
10 9 (1.02%) OpenStack
11 7 (0.79%) JBoss
12 6 (0.68%) WebLogic
13 5 (0.56%) Apache Solr
13 5 (0.56%) Jetty
14 3 (0.34%) Oracle Workflow
14 3 (0.34%) Tornado
15 2 (0.23%) CMS
15 2 (0.23%) nginx
16 1 (0.11%) Blackberry Enterprise Server
Applications
1 13 (1.47%) Microsoft Excel
2 5 (0.56%) Microsoft Office
3 2 (0.23%) SPSS
4 1 (0.11%) Chatbot
4 1 (0.11%) Microsoft Project
4 1 (0.11%) Stata
Business Applications
1 10 (1.13%) FINCAD Analytics
2 6 (0.68%) SAP Oil and Gas
3 4 (0.45%) SAP CRM
3 4 (0.45%) SAP ERP
3 4 (0.45%) SAP IS-U
4 3 (0.34%) SAP FI-CA
4 3 (0.34%) SAP PSCD
5 2 (0.23%) Hyperion Planning
5 2 (0.23%) Oracle Subledger Accounting
5 2 (0.23%) Sparx Enterprise Architect
6 1 (0.11%) ENOVIA
6 1 (0.11%) NetSuite
6 1 (0.11%) SAP MDM
Cloud Services
1 251 (28.33%) AWS
2 188 (21.22%) Azure
3 104 (11.74%) GCP
4 46 (5.19%) Power Platform
5 41 (4.63%) Amazon Kinesis
6 39 (4.40%) Amazon EMR
7 38 (4.29%) Amazon S3
8 30 (3.39%) GitHub
9 28 (3.16%) Serverless
10 25 (2.82%) AWS Lambda
11 21 (2.37%) OpenShift
12 18 (2.03%) Cloud Computing
13 13 (1.47%) Amazon SQS
14 12 (1.35%) Amazon EKS
14 12 (1.35%) PaaS
15 10 (1.13%) Amazon EC2
15 10 (1.13%) AWS Step Functions
16 8 (0.90%) Amazon SageMaker
16 8 (0.90%) Azure Data Factory
16 8 (0.90%) Azure Machine Learning
Communications & Networking
1 24 (2.71%) Kerberos
2 12 (1.35%) SSH
3 7 (0.79%) HTTP
3 7 (0.79%) SSL
4 6 (0.68%) VPN
5 5 (0.56%) Internet
5 5 (0.56%) TCP/IP
6 4 (0.45%) 5G
6 4 (0.45%) Radio Access Network
6 4 (0.45%) SAN
6 4 (0.45%) Wi-Fi
7 3 (0.34%) 4G
7 3 (0.34%) DNS
7 3 (0.34%) Firewall
7 3 (0.34%) HTTPS
7 3 (0.34%) Wireshark
8 1 (0.11%) OpenLDAP
Database & Business Intelligence
1 541 (61.06%) Big Data
2 221 (24.94%) Apache Hive
3 180 (20.32%) NoSQL
4 147 (16.59%) Data Warehouse
5 137 (15.46%) HBase
6 91 (10.27%) Relational Database
7 90 (10.16%) Data Lake
8 88 (9.93%) PostgreSQL
9 87 (9.82%) MongoDB
10 71 (8.01%) Impala
11 61 (6.88%) SQL Server
12 59 (6.66%) Amazon Redshift
12 59 (6.66%) Apache Cassandra
13 46 (5.19%) MySQL
13 46 (5.19%) Power BI
14 43 (4.85%) BigQuery
14 43 (4.85%) Flink
15 40 (4.51%) RDBMS
16 34 (3.84%) Amazon Athena
16 34 (3.84%) Spark SQL
Development Applications
1 138 (15.58%) Jenkins
2 112 (12.64%) Git (software)
3 59 (6.66%) JIRA
4 51 (5.76%) Maven
5 26 (2.93%) GitLab
6 22 (2.48%) Sonatype Nexus
7 17 (1.92%) IBM UrbanCode
8 16 (1.81%) Artifactory
9 15 (1.69%) Team Foundation Server
10 14 (1.58%) Atlassian Bamboo
11 13 (1.47%) Vagrant
12 12 (1.35%) Cucumber
13 11 (1.24%) ERwin
13 11 (1.24%) Selenium
13 11 (1.24%) Subversion
14 10 (1.13%) PowerDesigner
15 9 (1.02%) ER Studio
15 9 (1.02%) Mercurial
15 9 (1.02%) SonarQube
16 8 (0.90%) FindBugs
General
1 179 (20.20%) Finance
2 65 (7.34%) Banking
3 42 (4.74%) Retail
4 34 (3.84%) Public Sector
5 29 (3.27%) Marketing
6 26 (2.93%) Telecoms
7 23 (2.60%) Front Office
8 15 (1.69%) Investment Banking
9 13 (1.47%) Pharmaceutical
10 9 (1.02%) Games
10 9 (1.02%) Retail Banking
11 8 (0.90%) Legal
11 8 (0.90%) Manufacturing
12 4 (0.45%) Financial Institution
13 2 (0.23%) Aerospace
13 2 (0.23%) Automotive
13 2 (0.23%) Billing
14 1 (0.11%) Advertising
14 1 (0.11%) Electronics
14 1 (0.11%) Humanities
Job Titles
1 243 (27.43%) Data Engineer
2 173 (19.53%) Developer
3 101 (11.40%) Architect
4 93 (10.50%) Big Data Engineer
5 76 (8.58%) Data Architect
6 69 (7.79%) Data Scientist
7 67 (7.56%) Analyst
8 56 (6.32%) Administrator
8 56 (6.32%) Python Engineer
9 49 (5.53%) DevOps Engineer
9 49 (5.53%) Java Developer
10 39 (4.40%) Hadoop Engineer
11 38 (4.29%) Big Data Architect
12 36 (4.06%) Data Analyst
13 35 (3.95%) Python Developer
14 31 (3.50%) Hadoop Developer
15 30 (3.39%) AWS Engineer
16 28 (3.16%) Big Data Developer
16 28 (3.16%) Software Engineer
17 27 (3.05%) Senior Developer
Libraries, Frameworks & Software Standards
1 253 (28.56%) Kafka
2 90 (10.16%) PySpark
3 47 (5.30%) Spring
4 41 (4.63%) TensorFlow
5 40 (4.51%) Spark Streaming
5 40 (4.51%) Web Services
6 39 (4.40%) XML
7 38 (4.29%) scikit-learn
8 34 (3.84%) Apache NiFi
8 34 (3.84%) React
9 29 (3.27%) Pandas
10 28 (3.16%) Natural Language Processing
11 25 (2.82%) NumPy
11 25 (2.82%) Spring Boot
12 24 (2.71%) RESTful
13 23 (2.60%) AngularJS
14 22 (2.48%) JSON
14 22 (2.48%) RabbitMQ
15 21 (2.37%) REST
16 19 (2.14%) LDAP
Miscellaneous
1 86 (9.71%) Analytical Skills
2 75 (8.47%) Algorithms
3 34 (3.84%) Data Structures
4 32 (3.61%) Greenfield Project
5 25 (2.82%) Public Cloud
6 22 (2.48%) Management Information System
7 17 (1.92%) Self-Motivation
8 16 (1.81%) Hedge funds
9 15 (1.69%) User Experience
10 13 (1.47%) Fixed Income
10 13 (1.47%) Linux Command Line
11 12 (1.35%) Data Centre
11 12 (1.35%) Reference Data
12 11 (1.24%) Derivative
13 10 (1.13%) Credit Risk
14 9 (1.02%) Cloud Native
15 8 (0.90%) Social Media
16 7 (0.79%) Equities
17 6 (0.68%) Clustering
17 6 (0.68%) Market Risk
Operating Systems
1 141 (15.91%) Linux
2 78 (8.80%) Unix
3 37 (4.18%) Windows
4 24 (2.71%) Red Hat Enterprise Linux
5 18 (2.03%) CentOS
6 16 (1.81%) Ubuntu
7 14 (1.58%) Windows Server
8 9 (1.02%) Debian
9 3 (0.34%) Solaris
10 2 (0.23%) Android
10 2 (0.23%) Apple iOS
11 1 (0.11%) AIX
11 1 (0.11%) CoreOS
11 1 (0.11%) DC/OS
11 1 (0.11%) Mac OS X
11 1 (0.11%) SUSE Linux Enterprise Server
11 1 (0.11%) VME
11 1 (0.11%) zOS
Processes & Methodologies
1 250 (28.22%) Analytics
2 247 (27.88%) Agile Software Development
3 203 (22.91%) ETL
4 176 (19.86%) DevOps
5 165 (18.62%) Data Science
6 164 (18.51%) Data Modelling
7 134 (15.12%) Machine Learning
8 119 (13.43%) Business Intelligence
9 90 (10.16%) Data Architecture
9 90 (10.16%) Software Engineering
10 89 (10.05%) Continuous Integration
11 88 (9.93%) Visualisation
12 86 (9.71%) Data Engineering
13 81 (9.14%) Computer Science
14 79 (8.92%) Open Source
15 78 (8.80%) Migration
16 77 (8.69%) Data Analysis
17 76 (8.58%) Data Management
17 76 (8.58%) Scrum
18 70 (7.90%) Problem-Solving
Programming Languages
1 457 (51.58%) Python
2 356 (40.18%) SQL
3 299 (33.75%) Java
4 232 (26.19%) Scala
5 73 (8.24%) R
6 45 (5.08%) Bash Shell
7 41 (4.63%) C
8 39 (4.40%) C#
9 35 (3.95%) Shell Script
10 34 (3.84%) C++
10 34 (3.84%) JavaScript
11 33 (3.72%) PL/SQL
12 27 (3.05%) Go
13 25 (2.82%) Ruby
14 24 (2.71%) Java 8
15 22 (2.48%) PowerShell
16 18 (2.03%) Perl
17 16 (1.81%) Kotlin
18 8 (0.90%) Groovy
18 8 (0.90%) T-SQL
Qualifications
1 74 (8.35%) Degree
2 73 (8.24%) Security Cleared
3 49 (5.53%) SC Cleared
4 37 (4.18%) Computer Science Degree
5 22 (2.48%) DV Cleared
6 17 (1.92%) PhD
7 13 (1.47%) CCA
8 9 (1.02%) Numerate Degree
9 5 (0.56%) BPSS Clearance
9 5 (0.56%) ISTQB
9 5 (0.56%) SAS Certification
10 4 (0.45%) AWS Certification
10 4 (0.45%) Master's Degree
11 3 (0.34%) ISEB
11 3 (0.34%) ISTQB Foundation Certification
12 2 (0.23%) DBS Check
13 1 (0.11%) Cisco Certification
13 1 (0.11%) MBA
13 1 (0.11%) Microsoft Certification
13 1 (0.11%) TOGAF Certification
Quality Assurance & Compliance
1 35 (3.95%) Data Quality
2 17 (1.92%) QA
3 5 (0.56%) PMO
4 2 (0.23%) Disclosure Scotland
5 1 (0.11%) IFRS
5 1 (0.11%) ISO/IEC 27001
5 1 (0.11%) PCI DSS
5 1 (0.11%) Sarbanes-Oxley
System Software
1 134 (15.12%) HDFS
2 130 (14.67%) Docker
3 33 (3.72%) Apache Flume
4 11 (1.24%) Apache ZooKeeper
5 9 (1.02%) VirtualBox
6 4 (0.45%) Active Directory
6 4 (0.45%) Virtual Desktop
6 4 (0.45%) Virtual Servers
Systems Management
1 133 (15.01%) Kubernetes
2 89 (10.05%) Ansible
3 84 (9.48%) Terraform
4 70 (7.90%) Hadoop YARN
5 46 (5.19%) Puppet
6 30 (3.39%) Oozie
7 13 (1.47%) Packer
8 11 (1.24%) ITRS Geneos
8 11 (1.24%) Opscode Chef
9 10 (1.13%) Ambari
9 10 (1.13%) Kibana
9 10 (1.13%) Single Sign-On
10 9 (1.02%) Docker Swarm
11 7 (0.79%) logstash
12 6 (0.68%) Prometheus
13 4 (0.45%) Cobbler
13 4 (0.45%) Grafana
14 3 (0.34%) Red Hat Satellite
14 3 (0.34%) SELinux
14 3 (0.34%) ZABBIX
Vendors
1 161 (18.17%) Cloudera
2 111 (12.53%) Oracle
3 110 (12.42%) Hortonworks
4 65 (7.34%) Tableau
5 61 (6.88%) Microsoft
6 56 (6.32%) Google
7 52 (5.87%) Informatica
8 44 (4.97%) SAP
9 34 (3.84%) Talend
10 31 (3.50%) Teradata
11 26 (2.93%) Ab Initio
12 22 (2.48%) MapR
13 21 (2.37%) Palantir
14 18 (2.03%) Databricks
15 17 (1.92%) Red Hat
16 16 (1.81%) IBM
17 15 (1.69%) Splunk
18 10 (1.13%) StreamSets
19 9 (1.02%) Alteryx
19 9 (1.02%) Datactics