Period
to 25 February 2020

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 25 February 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > South East
6 months to
25 Feb 2020
Same period 2019 Same period 2018
Rank 191 127 103
Rank change year-on-year -64 -24 +30
Contract jobs citing Hadoop 115 327 382
As % of all contract IT jobs advertised in the South East 1.07% 2.06% 2.31%
As % of the Database & Business Intelligence category 5.28% 9.73% 11.41%
Number of daily rates quoted 48 181 205
South East median daily rate £476 £525 £500
Median daily rate % change year-on-year -9.29% +5.00% -
10th Percentile £398 £350 £377
90th Percentile £575 £650 £608
England median daily rate £550 £550 £550
Number of hourly rates quoted 0 0 2
South East median hourly rate - - £45.00
England median hourly rate - £50.00 £37.50
% change year-on-year - +33.33% -20.21%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 2,178 3,362 3,348
As % of all contract IT jobs advertised in the South East 20.30% 21.17% 20.26%
Number of daily rates quoted 1,347 2,165 2,117
South East median daily rate £450 £450 £425
Median daily rate % change year-on-year - +5.88% +4.04%
10th Percentile £306 £313 £300
90th Percentile £608 £588 £575
England median daily rate £488 £488 £475
% change year-on-year - +2.63% +8.57%
Number of hourly rates quoted 55 43 37
South East median hourly rate £30.00 £41.50 £45.00
Median hourly rate % change year-on-year -27.71% -7.78% +164.71%
10th Percentile £16.64 £18.05 £14.70
90th Percentile £76.75 £59.47 £50.00
England median hourly rate £31.25 £35.00 £33.50
% change year-on-year -10.71% +4.48% +21.82%

Hadoop
Job Vacancy Trend in the South East

Job postings citing Hadoop as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Hadoop in the South East

Hadoop
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the South East.

Contractor daily rate trend for Hadoop in the South East

Hadoop
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Hadoop in the South East over the 6 months to 25 February 2020.

Contractor daily rate histogram for Hadoop in the South East

Hadoop
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in the South East.

Contractor hourly rate trend for Hadoop in the South East

Hadoop
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the South East region over the 6 months to 25 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +5 48 £463 -15.91% 16
Buckinghamshire +44 30 £494 -24.04%
Hampshire -41 28 £500 -4.76% 16
Surrey -9 17 £476 +0.26% 3
Berkshire -25 13 £419 -23.86% 13
East Sussex +25 12 £425 -29.90% 1
West Sussex +35 9 £500 -3.85% 1
Oxfordshire +24 5 £513 - 3
Hadoop
England

For the 6 months to 25 February 2020, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Hadoop.

1 92 (80.00%) Big Data
2 63 (54.78%) Apache Spark
3 53 (46.09%) SQL
3 53 (46.09%) Python
4 33 (28.70%) Kafka
5 31 (26.96%) Cloudera
6 29 (25.22%) Apache Hive
7 28 (24.35%) AWS
8 27 (23.48%) ETL
9 26 (22.61%) Scala
10 24 (20.87%) Analytics
11 23 (20.00%) Data Modelling
11 23 (20.00%) Data Lake
11 23 (20.00%) Data Science
12 22 (19.13%) Linux
12 22 (19.13%) Java
13 21 (18.26%) Finance
13 21 (18.26%) Agile Software Development
13 21 (18.26%) Data Architecture
13 21 (18.26%) HDFS
13 21 (18.26%) Data Munging
14 19 (16.52%) Impala
14 19 (16.52%) Data Engineering
14 19 (16.52%) Azure
14 19 (16.52%) HBase
15 17 (14.78%) Data Warehouse
16 16 (13.91%) Data Management
16 16 (13.91%) Data Analysis
16 16 (13.91%) Visualisation
16 16 (13.91%) Problem-Solving

Hadoop
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 63 (54.78%) Apache Spark
2 15 (13.04%) SAS
3 12 (10.43%) Jupyter
4 9 (7.83%) Apache
5 7 (6.09%) Tomcat
6 4 (3.48%) Apache Airflow
7 2 (1.74%) Apache Pig
7 2 (1.74%) Elasticsearch
7 2 (1.74%) Jetty
7 2 (1.74%) Luigi
8 1 (0.87%) Cloud Foundry
8 1 (0.87%) SharePoint
Applications
1 1 (0.87%) Microsoft Excel
1 1 (0.87%) SPSS
Business Applications
1 4 (3.48%) SAP CRM
1 4 (3.48%) SAP ERP
1 4 (3.48%) SAP IS-U
2 1 (0.87%) NetSuite
Cloud Services
1 28 (24.35%) AWS
2 19 (16.52%) Azure
3 10 (8.70%) Cloud Computing
4 6 (5.22%) GitHub
5 5 (4.35%) Power Platform
6 4 (3.48%) Amazon S3
7 3 (2.61%) Amazon EMR
7 3 (2.61%) PaaS
8 2 (1.74%) Amazon EC2
8 2 (1.74%) Amazon SageMaker
8 2 (1.74%) Azure Data Factory
8 2 (1.74%) Google Analytics
8 2 (1.74%) OpenShift
9 1 (0.87%) Dynamics 365
9 1 (0.87%) GCP
9 1 (0.87%) IaaS
9 1 (0.87%) Office 365
Communications & Networking
1 4 (3.48%) Radio Access Network
1 4 (3.48%) SAN
2 3 (2.61%) 4G
2 3 (2.61%) 5G
3 2 (1.74%) Internet
4 1 (0.87%) HTTP
4 1 (0.87%) Kerberos
Database & Business Intelligence
1 92 (80.00%) Big Data
2 29 (25.22%) Apache Hive
3 23 (20.00%) Data Lake
4 19 (16.52%) HBase
4 19 (16.52%) Impala
5 17 (14.78%) Data Warehouse
6 15 (13.04%) Relational Database
7 13 (11.30%) NoSQL
8 9 (7.83%) Data Mining
9 7 (6.09%) Cloudera CDH
10 6 (5.22%) MongoDB
10 6 (5.22%) MySQL
11 5 (4.35%) Amazon Redshift
11 5 (4.35%) Apache Zeppelin
11 5 (4.35%) OLAP
11 5 (4.35%) Power BI
11 5 (4.35%) SQL Server
12 4 (3.48%) Apache Cassandra
12 4 (3.48%) Azure SQL Data Warehouse
12 4 (3.48%) Redis
Development Applications
1 11 (9.57%) Jenkins
2 9 (7.83%) Maven
3 7 (6.09%) Git (software)
4 6 (5.22%) SonarQube
5 5 (4.35%) Cucumber
5 5 (4.35%) FindBugs
5 5 (4.35%) Log4j
5 5 (4.35%) Mercurial
5 5 (4.35%) Subversion
6 2 (1.74%) Atlassian Bamboo
6 2 (1.74%) Concordion
6 2 (1.74%) EasyMock
6 2 (1.74%) ERwin
6 2 (1.74%) Gradle
6 2 (1.74%) IntelliJ
6 2 (1.74%) Mockito
6 2 (1.74%) PowerDesigner
6 2 (1.74%) Selenium
6 2 (1.74%) SQL Server Management Studio (SSMS)
6 2 (1.74%) TeamCity
General
1 21 (18.26%) Finance
2 7 (6.09%) Retail
3 6 (5.22%) Banking
4 5 (4.35%) Marketing
5 4 (3.48%) Telecoms
6 2 (1.74%) Games
6 2 (1.74%) Investment Banking
6 2 (1.74%) Pharmaceutical
6 2 (1.74%) Public Sector
Job Titles
1 25 (21.74%) Data Engineer
2 19 (16.52%) Developer
3 17 (14.78%) Architect
4 13 (11.30%) Analyst
4 13 (11.30%) Data Scientist
5 12 (10.43%) Data Architect
6 10 (8.70%) Administrator
6 10 (8.70%) Big Data Engineer
7 9 (7.83%) Hadoop Engineer
8 8 (6.96%) SQL Analyst
9 7 (6.09%) Business Analyst
9 7 (6.09%) Java Developer
10 6 (5.22%) Credit Analyst
10 6 (5.22%) Credit Risk Analyst
10 6 (5.22%) Risk Analyst
10 6 (5.22%) Senior Data Scientist
11 5 (4.35%) Big Data Developer
11 5 (4.35%) Data Administrator
11 5 (4.35%) Python Developer
11 5 (4.35%) Risk Business Analyst
Libraries, Frameworks & Software Standards
1 33 (28.70%) Kafka
2 10 (8.70%) Apache NiFi
3 8 (6.96%) RabbitMQ
4 7 (6.09%) NumPy
4 7 (6.09%) Pandas
4 7 (6.09%) Spring
5 6 (5.22%) RESTful
5 6 (5.22%) XML
6 4 (3.48%) JSON
7 3 (2.61%) GraphQL
7 3 (2.61%) Natural Language Processing
7 3 (2.61%) scikit-learn
8 2 (1.74%) AngularJS
8 2 (1.74%) Gherkin
8 2 (1.74%) Node.js
8 2 (1.74%) PySpark
8 2 (1.74%) SciPy
8 2 (1.74%) Spring Boot
8 2 (1.74%) XSD
9 1 (0.87%) HTML
Miscellaneous
1 13 (11.30%) Analytical Skills
2 11 (9.57%) Algorithms
3 6 (5.22%) Credit Risk
4 4 (3.48%) Analytical Mindset
5 3 (2.61%) Greenfield Project
5 3 (2.61%) Linux Command Line
5 3 (2.61%) Reference Data
6 2 (1.74%) Clustering
6 2 (1.74%) Enterprise Software
7 1 (0.87%) Data Protection Act
7 1 (0.87%) DataPower
7 1 (0.87%) Market Risk
Operating Systems
1 22 (19.13%) Linux
2 14 (12.17%) Red Hat Enterprise Linux
3 9 (7.83%) CentOS
4 6 (5.22%) Unix
5 5 (4.35%) Debian
5 5 (4.35%) Ubuntu
6 4 (3.48%) Windows
6 4 (3.48%) Windows Server
Processes & Methodologies
1 27 (23.48%) ETL
2 24 (20.87%) Analytics
3 23 (20.00%) Data Modelling
3 23 (20.00%) Data Science
4 21 (18.26%) Agile Software Development
4 21 (18.26%) Data Architecture
4 21 (18.26%) Data Munging
5 19 (16.52%) Data Engineering
6 16 (13.91%) Data Analysis
6 16 (13.91%) Data Management
6 16 (13.91%) Problem-Solving
6 16 (13.91%) Visualisation
7 14 (12.17%) Machine Learning
8 12 (10.43%) Mathematics
8 12 (10.43%) Migration
9 11 (9.57%) Data Visualisation
10 10 (8.70%) Coaching
10 10 (8.70%) Continuous Integration
10 10 (8.70%) Open Source
10 10 (8.70%) Project Delivery
Programming Languages
1 53 (46.09%) Python
1 53 (46.09%) SQL
2 26 (22.61%) Scala
3 22 (19.13%) Java
4 7 (6.09%) Bash Shell
5 4 (3.48%) C++
6 3 (2.61%) Ruby
7 2 (1.74%) Data Analysis Expressions (DAX)
7 2 (1.74%) Groovy
7 2 (1.74%) JavaScript
7 2 (1.74%) Korn
7 2 (1.74%) R
7 2 (1.74%) T-SQL
8 1 (0.87%) C#
8 1 (0.87%) Go
8 1 (0.87%) Haskell
8 1 (0.87%) Java 8
8 1 (0.87%) Perl
8 1 (0.87%) PHP
Qualifications
1 14 (12.17%) Security Cleared
2 10 (8.70%) SC Cleared
3 6 (5.22%) Degree
4 4 (3.48%) AWS Certification
5 2 (1.74%) Computer Science Degree
5 2 (1.74%) ISTQB
6 1 (0.87%) PhD
6 1 (0.87%) TOGAF Certification
Quality Assurance & Compliance
1 3 (2.61%) QA
2 2 (1.74%) Data Quality
3 1 (0.87%) PCI DSS
3 1 (0.87%) Sarbanes-Oxley
System Software
1 21 (18.26%) HDFS
2 9 (7.83%) Docker
3 5 (4.35%) Apache Flume
4 4 (3.48%) Virtual Desktop
4 4 (3.48%) Virtual Servers
5 1 (0.87%) Active Directory
5 1 (0.87%) Apache ZooKeeper
Systems Management
1 9 (7.83%) Ansible
1 9 (7.83%) Oozie
2 5 (4.35%) Terraform
3 2 (1.74%) Hadoop YARN
3 2 (1.74%) Kubernetes
4 1 (0.87%) Ambari
4 1 (0.87%) logstash
Vendors
1 31 (26.96%) Cloudera
2 10 (8.70%) Oracle
3 8 (6.96%) Talend
4 6 (5.22%) Hortonworks
5 5 (4.35%) Microsoft
6 4 (3.48%) Ab Initio
6 4 (3.48%) SAP
6 4 (3.48%) StreamSets
6 4 (3.48%) Tableau
7 3 (2.61%) Imperva
7 3 (2.61%) Varonis
8 2 (1.74%) Cognos
8 2 (1.74%) Google
8 2 (1.74%) IBM
8 2 (1.74%) Palantir
9 1 (0.87%) JD Edwards
9 1 (0.87%) Red Hat
9 1 (0.87%) Salesforce.com
9 1 (0.87%) Sitecore
9 1 (0.87%) TIBCO