Period
to 21 September 2019

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 21 September 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > South East
6 months to
21 Sep 2019
Same period 2018 Same period 2017
Rank 197 119 142
Rank change year-on-year -78 +23 +28
Contract jobs citing Hadoop 166 357 279
As % of all contract IT jobs advertised in the South East 1.16% 2.16% 1.70%
As % of the Database & Business Intelligence category 5.98% 9.96% 7.80%
Number of daily rates quoted 73 224 170
South East median daily rate £500 £525 £450
Median daily rate % change year-on-year -4.76% +16.67% -
10th Percentile £395 £425 £296
90th Percentile £638 £588 £588
England median daily rate £550 £538 £535
% change year-on-year +2.33% +0.47% +1.90%
Number of hourly rates quoted 0 1 5
South East median hourly rate - £47.50 £45.00
Median hourly rate % change year-on-year - +5.56% -
England median hourly rate £43.53 £61.25 £35.00
% change year-on-year -28.93% +75.00% -23.50%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 2,777 3,583 3,579
As % of all contract IT jobs advertised in the South East 19.37% 21.66% 21.84%
Number of daily rates quoted 1,717 2,294 2,214
South East median daily rate £445 £446 £401
Median daily rate % change year-on-year -0.28% +11.42% +0.13%
10th Percentile £300 £313 £278
90th Percentile £600 £575 £538
England median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 80 58 70
South East median hourly rate £45.32 £35.00 £25.00
Median hourly rate % change year-on-year +29.48% +40.00% -29.58%
10th Percentile £15.23 £12.88 £9.25
90th Percentile £73.75 £58.25 £50.00
England median hourly rate £35.00 £28.75 £29.62
% change year-on-year +21.74% -2.94% -0.87%

Hadoop
Job Vacancy Trend in the South East

Job postings citing Hadoop as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Hadoop in the South East

Hadoop
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the South East.

Contractor daily rate trend for Hadoop in the South East

Hadoop
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Hadoop in the South East over the 6 months to 21 September 2019.

Contractor daily rate histogram for Hadoop in the South East

Hadoop
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in the South East.

Contractor hourly rate trend for Hadoop in the South East

Hadoop
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the South East region over the 6 months to 21 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Hampshire -40 58 £575 +9.52% 12
Thames Valley -44 53 £500 -9.09% 9
Surrey -20 35 £450 -10.00% 3
Buckinghamshire -2 26 £450 -14.29% 5
Berkshire -47 25 £525 -4.55% 2
West Sussex +18 8 £508 -20.39% 1
East Sussex -2 8 £488 -11.36%
Oxfordshire - 2 £633 - 2
Hadoop
England

For the 6 months to 21 September 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Hadoop.

1 126 (75.90%) Big Data
2 81 (48.80%) Apache Spark
3 70 (42.17%) Kafka
4 67 (40.36%) Python
5 64 (38.55%) Linux
6 52 (31.33%) SQL
7 49 (29.52%) Java
8 46 (27.71%) HBase
9 45 (27.11%) Agile Software Development
10 43 (25.90%) Jenkins
11 42 (25.30%) Analytics
12 41 (24.70%) Continuous Integration
13 40 (24.10%) Apache Hive
14 39 (23.49%) Docker
15 38 (22.89%) Data Lake
16 36 (21.69%) HDFS
16 36 (21.69%) AWS
17 34 (20.48%) Security Cleared
18 33 (19.88%) Ansible
19 30 (18.07%) NoSQL
19 30 (18.07%) Data Warehouse
20 27 (16.27%) Oracle
21 26 (15.66%) TDD
21 26 (15.66%) Scala
21 26 (15.66%) Data Analytics
22 25 (15.06%) Git (software)
22 25 (15.06%) Scrum
23 24 (14.46%) SQL Server
23 24 (14.46%) Unix
23 24 (14.46%) Red Hat Enterprise Linux

Hadoop
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 81 (48.80%) Apache Spark
2 22 (13.25%) Apache
3 14 (8.43%) SAS
4 11 (6.63%) Apache Pig
5 10 (6.02%) Elasticsearch
6 9 (5.42%) Apache Airflow
7 8 (4.82%) Jupyter
7 8 (4.82%) Tomcat
8 6 (3.61%) Luigi
9 5 (3.01%) Confluence
10 3 (1.81%) JBoss
11 1 (0.60%) Apache Solr
11 1 (0.60%) Hyperledger
Applications
1 5 (3.01%) Microsoft Excel
1 5 (3.01%) Microsoft Office
2 1 (0.60%) SPSS
Business Applications
1 1 (0.60%) Cognos Business Intelligence
Cloud Services
1 36 (21.69%) AWS
2 20 (12.05%) Azure
3 16 (9.64%) Amazon EMR
3 16 (9.64%) GitHub
4 12 (7.23%) Amazon S3
5 11 (6.63%) Amazon EC2
6 9 (5.42%) GCP
6 9 (5.42%) Power Platform
7 8 (4.82%) PaaS
8 7 (4.22%) AWS CloudFormation
9 6 (3.61%) Amazon Kinesis
10 5 (3.01%) Amazon ECS
10 5 (3.01%) Amazon SQS
10 5 (3.01%) Azure Data Factory
11 4 (2.41%) Amazon Glacier
12 3 (1.81%) Serverless
13 2 (1.20%) Amazon SageMaker
13 2 (1.20%) AWS Lambda
13 2 (1.20%) IaaS
14 1 (0.60%) OpenShift
Communications & Networking
1 7 (4.22%) SAN
2 6 (3.61%) Kerberos
3 5 (3.01%) MQTT
4 4 (2.41%) Multicast
4 4 (2.41%) SSL
5 3 (1.81%) OpenLDAP
6 2 (1.20%) DSL
6 2 (1.20%) TCP/IP
7 1 (0.60%) 5G
Database & Business Intelligence
1 126 (75.90%) Big Data
2 46 (27.71%) HBase
3 40 (24.10%) Apache Hive
4 38 (22.89%) Data Lake
5 30 (18.07%) Data Warehouse
5 30 (18.07%) NoSQL
6 24 (14.46%) Relational Database
6 24 (14.46%) SQL Server
7 16 (9.64%) MySQL
8 14 (8.43%) MongoDB
9 13 (7.83%) Impala
9 13 (7.83%) Sqoop
10 12 (7.23%) Apache Cassandra
10 12 (7.23%) PostgreSQL
11 10 (6.02%) MS Access
12 9 (5.42%) Amazon Redshift
12 9 (5.42%) Power BI
13 8 (4.82%) Amazon Athena
13 8 (4.82%) Amazon DynamoDB
13 8 (4.82%) Parquet
Development Applications
1 43 (25.90%) Jenkins
2 25 (15.06%) Git (software)
3 13 (7.83%) Gradle
3 13 (7.83%) Maven
4 9 (5.42%) Cucumber
4 9 (5.42%) JIRA
5 6 (3.61%) Atlassian Bamboo
6 5 (3.01%) FindBugs
6 5 (3.01%) Log4j
6 5 (3.01%) Mercurial
6 5 (3.01%) PyCharm
6 5 (3.01%) SonarQube
6 5 (3.01%) Sonatype Nexus
6 5 (3.01%) SQL Server Management Studio (SSMS)
6 5 (3.01%) Subversion
7 4 (2.41%) Bitbucket
7 4 (2.41%) Concordion
7 4 (2.41%) IntelliJ
7 4 (2.41%) Mockito
7 4 (2.41%) TeamCity
General
1 10 (6.02%) Finance
2 9 (5.42%) Banking
3 8 (4.82%) Telecoms
4 7 (4.22%) Retail
5 4 (2.41%) Games
5 4 (2.41%) Public Sector
6 2 (1.20%) Investment Banking
6 2 (1.20%) Marketing
6 2 (1.20%) Military
7 1 (0.60%) Automotive
7 1 (0.60%) Police
Job Titles
1 44 (26.51%) Data Engineer
2 33 (19.88%) Developer
3 27 (16.27%) Architect
4 18 (10.84%) Data Architect
4 18 (10.84%) Java Developer
5 15 (9.04%) Big Data Developer
6 12 (7.23%) Administrator
7 11 (6.63%) Analyst
7 11 (6.63%) Big Data Engineer
8 9 (5.42%) Big Data Architect
8 9 (5.42%) Hadoop Developer
9 8 (4.82%) Solutions Architect
10 7 (4.22%) DevOps Engineer
10 7 (4.22%) Hadoop Engineer
11 6 (3.61%) Apache Spark Developer
11 6 (3.61%) Hadoop Architect
11 6 (3.61%) Scrum Master
11 6 (3.61%) Software Engineer
11 6 (3.61%) Systems Architect
12 5 (3.01%) Consultant
Libraries, Frameworks & Software Standards
1 70 (42.17%) Kafka
2 20 (12.05%) RabbitMQ
3 18 (10.84%) Apache NiFi
3 18 (10.84%) Spring
4 9 (5.42%) Middleware
5 8 (4.82%) Apache Avro
5 8 (4.82%) REST
6 7 (4.22%) Elastic Stack
7 6 (3.61%) GraphQL
7 6 (3.61%) JSON
7 6 (3.61%) Ultra Messaging
8 4 (2.41%) .NET
8 4 (2.41%) Gherkin
8 4 (2.41%) J2EE
8 4 (2.41%) RESTful
8 4 (2.41%) Spark Streaming
9 3 (1.81%) ActiveMQ
9 3 (1.81%) Apache Camel
9 3 (1.81%) LAPP Stack
10 2 (1.20%) MDX
Miscellaneous
1 13 (7.83%) Analytical Skills
2 11 (6.63%) Linux Command Line
3 10 (6.02%) Greenfield Project
4 7 (4.22%) Virtual Team
5 6 (3.61%) Cloud Native
5 6 (3.61%) Data Structures
6 5 (3.01%) Data Centre
6 5 (3.01%) PKI
7 4 (2.41%) Management Information System
7 4 (2.41%) Smart Home
8 3 (1.81%) Public Cloud
9 2 (1.20%) Data Protection Act
9 2 (1.20%) Enterprise Software
9 2 (1.20%) Private Cloud
9 2 (1.20%) Self-Motivation
10 1 (0.60%) Algorithms
10 1 (0.60%) Clustering
10 1 (0.60%) Credit Risk
10 1 (0.60%) Cyber Defence
10 1 (0.60%) Reference Data
Operating Systems
1 64 (38.55%) Linux
2 24 (14.46%) Red Hat Enterprise Linux
2 24 (14.46%) Unix
3 15 (9.04%) CentOS
4 11 (6.63%) Ubuntu
5 10 (6.02%) Windows
6 7 (4.22%) Windows Server
7 5 (3.01%) Debian
8 2 (1.20%) Android
8 2 (1.20%) Apple iOS
8 2 (1.20%) Mac OS X
Processes & Methodologies
1 45 (27.11%) Agile Software Development
2 42 (25.30%) Analytics
3 41 (24.70%) Continuous Integration
4 26 (15.66%) Data Analytics
4 26 (15.66%) TDD
5 25 (15.06%) Scrum
6 24 (14.46%) Data Analysis
6 24 (14.46%) DevOps
7 22 (13.25%) Data Modelling
8 20 (12.05%) Configuration Management
8 20 (12.05%) Test Automation
9 19 (11.45%) Business Intelligence
9 19 (11.45%) ETL
9 19 (11.45%) Open Source
10 18 (10.84%) BDD
10 18 (10.84%) Migration
11 17 (10.24%) Data Management
12 16 (9.64%) Data Architecture
12 16 (9.64%) Data Transformation
13 14 (8.43%) Data Science
Programming Languages
1 67 (40.36%) Python
2 52 (31.33%) SQL
3 49 (29.52%) Java
4 26 (15.66%) Scala
5 13 (7.83%) R
6 11 (6.63%) Bash Shell
7 10 (6.02%) Shell Script
8 6 (3.61%) C#
8 6 (3.61%) C++
8 6 (3.61%) Perl
9 4 (2.41%) Java 8
9 4 (2.41%) JavaScript
10 2 (1.20%) C
10 2 (1.20%) Data Analysis Expressions (DAX)
10 2 (1.20%) Groovy
10 2 (1.20%) Ruby
10 2 (1.20%) VB.NET
11 1 (0.60%) Objective-C
11 1 (0.60%) PL/SQL
11 1 (0.60%) PowerShell
Qualifications
1 34 (20.48%) Security Cleared
2 24 (14.46%) SC Cleared
3 15 (9.04%) Degree
4 4 (2.41%) AWS Certification
4 4 (2.41%) Master's Degree
5 3 (1.81%) Computer Science Degree
6 2 (1.20%) DV Cleared
6 2 (1.20%) TOGAF Certification
7 1 (0.60%) BC Cleared
7 1 (0.60%) CISSP
7 1 (0.60%) ISTQB
7 1 (0.60%) MCSE
7 1 (0.60%) Microsoft Certification
Quality Assurance & Compliance
1 7 (4.22%) Data Quality
2 6 (3.61%) QA
3 2 (1.20%) PCI DSS
3 2 (1.20%) Sarbanes-Oxley
4 1 (0.60%) ISO/IEC 27001
4 1 (0.60%) PMO
System Software
1 39 (23.49%) Docker
2 36 (21.69%) HDFS
3 16 (9.64%) Apache Flume
3 16 (9.64%) Apache ZooKeeper
4 7 (4.22%) Virtual Desktop
4 7 (4.22%) Virtual Servers
5 6 (3.61%) Active Directory
6 5 (3.01%) vSphere
7 1 (0.60%) Virtual Machines
7 1 (0.60%) VirtualBox
Systems Management
1 33 (19.88%) Ansible
2 19 (11.45%) Kubernetes
2 19 (11.45%) Terraform
3 14 (8.43%) Puppet
4 13 (7.83%) Oozie
5 10 (6.02%) Opscode Chef
6 7 (4.22%) Hadoop YARN
7 6 (3.61%) logstash
8 5 (3.01%) vCenter Server
9 4 (2.41%) Consul
9 4 (2.41%) Mesos
9 4 (2.41%) Prometheus
10 3 (1.81%) Control-M
10 3 (1.81%) Kibana
10 3 (1.81%) ZABBIX
11 1 (0.60%) Grafana
Vendors
1 27 (16.27%) Oracle
2 22 (13.25%) Cloudera
3 18 (10.84%) Microsoft
4 15 (9.04%) Hortonworks
5 10 (6.02%) Splunk
6 9 (5.42%) Talend
7 8 (4.82%) Red Hat
8 7 (4.22%) StreamSets
9 6 (3.61%) Google
9 6 (3.61%) Informatica
10 5 (3.01%) Databricks
10 5 (3.01%) Imperva
10 5 (3.01%) Minitab
10 5 (3.01%) Varonis
11 3 (1.81%) Ab Initio
11 3 (1.81%) Tableau
12 2 (1.20%) IBM
12 2 (1.20%) Teradata
13 1 (0.60%) ArcSight
13 1 (0.60%) Atlassian