Period
to 19 November 2017

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 19 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > South East
6 months to
19 Nov 2017
Same period 2016 Same period 2015
Rank 115 150 226
Rank change year-on-year +35 +76 +82
Contract jobs citing Hadoop 337 253 176
As % of all contract IT jobs advertised in the South East 2.03% 1.52% 0.90%
As % of the Database & Business Intelligence category 9.66% 7.46% 4.03%
Number of daily rates quoted 207 105 109
South East median daily rate £500 £450 £450
Median daily rate % change year-on-year +11.11% - -10.00%
10th Percentile £321 £315 £337
90th Percentile £610 £650 £557
England median daily rate £538 £525 £525
% change year-on-year +2.38% - -
Number of hourly rates quoted 5 0 1
South East median hourly rate £45.00 - £40.00
England median hourly rate £32.75 £46.00 £37.50
% change year-on-year -28.80% +22.67% +5.63%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 3487 3390 4371
As % of all contract IT jobs advertised in the South East 21.02% 20.40% 22.46%
Number of daily rates quoted 2213 2034 2580
South East median daily rate £413 £400 £375
Median daily rate % change year-on-year +3.13% +6.67% +7.14%
10th Percentile £291 £275 £263
90th Percentile £556 £538 £525
England median daily rate £458 £425 £413
% change year-on-year +7.65% +3.03% +3.13%
Number of hourly rates quoted 55 89 94
South East median hourly rate £42.50 £27.38 £28.06
Median hourly rate % change year-on-year +55.25% -2.45% +18.16%
10th Percentile £9.25 £9.25 £9.25
90th Percentile £50.00 £52.25 £48.75
England median hourly rate £31.50 £28.00 £28.00
% change year-on-year +12.50% - +16.67%

Hadoop
Job Vacancy Trend in the South East

Job postings citing Hadoop as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Hadoop in the South East

Hadoop
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in the South East.

Contractor daily rate trend for Hadoop in the South East

Hadoop
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Hadoop in the South East over the 6 months to 19 November 2017.

Contractor daily rate histogram for Hadoop in the South East

Hadoop
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in the South East.

Contractor hourly rate trend for Hadoop in the South East

Hadoop
Contractor Hourly Rate Histogram in the South East

The hourly rate distribution of IT jobs citing Hadoop in the South East over the 6 months to 19 November 2017.

Contractor hourly rate histogram for Hadoop in the South East

Hadoop
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the South East region over the 6 months to 19 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +43 184 £500 +5.26% 10
Buckinghamshire -13 90 £413 -10.81% 2
Berkshire +45 70 £519 - 6
Hampshire +12 64 £385 -9.41%
Surrey -2 64 £500 -4.76% 2
Oxfordshire +26 24 £500 - 2
Middlesex +6 14 £425 +18.06%
East Sussex - 5 £310 -
West Sussex -17 1 - -
Hadoop
England

For the 6 months to 19 November 2017, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the South East region with a requirement for Hadoop.

1 254 (75.37%) Big Data
2 206 (61.13%) Apache Spark
3 124 (36.80%) Agile Software Development
4 122 (36.20%) Java
5 121 (35.91%) Kafka
6 109 (32.34%) Apache Hive
7 103 (30.56%) SQL
8 96 (28.49%) Cloudera
9 85 (25.22%) Python
10 83 (24.63%) TDD
11 80 (23.74%) Linux
12 79 (23.44%) HDFS
13 76 (22.55%) HBase
14 74 (21.96%) Scala
15 73 (21.66%) Analytics
15 73 (21.66%) Jenkins
16 70 (20.77%) Git (software)
17 67 (19.88%) Unix
18 64 (18.99%) ETL
19 63 (18.69%) MapReduce
20 59 (17.51%) Finance
21 55 (16.32%) Scrum
21 55 (16.32%) RESTful
22 54 (16.02%) Apache
23 50 (14.84%) JSON
23 50 (14.84%) Sqoop
23 50 (14.84%) Apache Flume
24 47 (13.95%) Hadoop YARN
25 46 (13.65%) NoSQL
25 46 (13.65%) Banking

Hadoop
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 206 (61.13%) Apache Spark
2 54 (16.02%) Apache
3 16 (4.75%) Apache Pig
3 16 (4.75%) Cloud Foundry
4 15 (4.45%) Tomcat
5 14 (4.15%) GemFire
5 14 (4.15%) SAS
6 11 (3.26%) Apache Airflow
6 11 (3.26%) Elasticsearch
7 10 (2.97%) Luigi
8 7 (2.08%) Confluence
8 7 (2.08%) Oracle SOA Suite
9 4 (1.19%) nginx
10 3 (0.89%) Apache Solr
10 3 (0.89%) Jupyter
11 2 (0.59%) IIS
11 2 (0.59%) JBoss
11 2 (0.59%) MS Exchange
11 2 (0.59%) WebSphere
12 1 (0.30%) SharePoint
Applications
1 10 (2.97%) Pipeline Pilot
2 6 (1.78%) Microsoft Excel
3 5 (1.48%) Microsoft Office
3 5 (1.48%) SPSS
4 1 (0.30%) Adobe Illustrator
4 1 (0.30%) GNU Octave
4 1 (0.30%) Photoshop
4 1 (0.30%) Stata
Business Applications
1 6 (1.78%) Oracle BPM
2 2 (0.59%) SAP CRM
Cloud Services
1 37 (10.98%) Amazon AWS
2 27 (8.01%) GitHub
3 22 (6.53%) PaaS
4 15 (4.45%) Microsoft Azure
5 11 (3.26%) Google Analytics
5 11 (3.26%) Google Cloud Platform
6 6 (1.78%) IaaS
6 6 (1.78%) OpenShift
7 5 (1.48%) BlazeMeter
7 5 (1.48%) Bluemix
7 5 (1.48%) IBM Cloud
8 4 (1.19%) Slack
9 3 (0.89%) Amazon EMR
9 3 (0.89%) AWS CloudFormation
9 3 (0.89%) SaaS
10 2 (0.59%) Amazon S3
10 2 (0.59%) Office 365
11 1 (0.30%) Amazon EC2
11 1 (0.30%) Cloud Computing
11 1 (0.30%) Data Lake Analytics
Communications & Networking
1 11 (3.26%) Network Security
2 4 (1.19%) Internet
2 4 (1.19%) Kerberos
2 4 (1.19%) SAN
3 3 (0.89%) Firewall
3 3 (0.89%) SSL
4 2 (0.59%) HTTP
4 2 (0.59%) NAS
5 1 (0.30%) AMQP
5 1 (0.30%) LDAP
5 1 (0.30%) Wi-Fi
Database & Business Intelligence
1 254 (75.37%) Big Data
2 109 (32.34%) Apache Hive
3 76 (22.55%) HBase
4 50 (14.84%) Sqoop
5 46 (13.65%) NoSQL
6 40 (11.87%) Impala
7 35 (10.39%) SQL Server
8 33 (9.79%) Data Lake
9 23 (6.82%) Data Warehouse
10 22 (6.53%) Relational Database
11 21 (6.23%) PostgreSQL
12 19 (5.64%) SQL Server 2008
13 16 (4.75%) IBM BigInsights
14 14 (4.15%) Cloudera CDH
15 13 (3.86%) Data Mining
15 13 (3.86%) OLTP
15 13 (3.86%) SQL Server 2012
16 10 (2.97%) KNIME
17 9 (2.67%) MongoDB
17 9 (2.67%) RDBMS
Development Applications
1 73 (21.66%) Jenkins
2 70 (20.77%) Git (software)
3 29 (8.61%) JIRA
4 28 (8.31%) Gradle
5 17 (5.04%) IntelliJ
6 15 (4.45%) Team Foundation Server
7 14 (4.15%) JUnit
8 10 (2.97%) Subversion
9 9 (2.67%) Cucumber
9 9 (2.67%) Hudson
10 8 (2.37%) Bitbucket
11 7 (2.08%) Eclipse
11 7 (2.08%) Maven
12 5 (1.48%) Gatling
12 5 (1.48%) JMeter
12 5 (1.48%) Talend Open Studio
13 4 (1.19%) Atlassian Bamboo
13 4 (1.19%) Selenium
13 4 (1.19%) Sonatype Nexus
13 4 (1.19%) SQL Server Management Studio (SSMS)
General
1 59 (17.51%) Finance
2 46 (13.65%) Banking
3 40 (11.87%) Telecoms
4 10 (2.97%) Retail
5 9 (2.67%) Publishing
5 9 (2.67%) Retail Banking
6 6 (1.78%) Marketing
6 6 (1.78%) Pharmaceutical
7 4 (1.19%) Corporate Banking
7 4 (1.19%) Electronics
8 2 (0.59%) Manufacturing
8 2 (0.59%) Spanish Language
9 1 (0.30%) Legal
Job Titles
1 114 (33.83%) Developer
2 56 (16.62%) Data Engineer
3 54 (16.02%) Big Data Engineer
4 49 (14.54%) Architect
4 49 (14.54%) Big Data Developer
5 46 (13.65%) Java Developer
6 33 (9.79%) Hadoop Engineer
7 32 (9.50%) Hadoop Developer
8 27 (8.01%) Data Architect
9 24 (7.12%) Big Data Architect
10 23 (6.82%) Administrator
10 23 (6.82%) Apache Spark Developer
11 20 (5.93%) Analyst
12 19 (5.64%) Hadoop Administrator
13 15 (4.45%) Scala Developer
13 15 (4.45%) Test Architect
14 13 (3.86%) Data Analyst
14 13 (3.86%) Data Scientist
15 11 (3.26%) Cloud Architect
15 11 (3.26%) Python Developer
Libraries, Frameworks & Software Standards
1 121 (35.91%) Kafka
2 55 (16.32%) RESTful
3 50 (14.84%) JSON
4 43 (12.76%) Spring
5 40 (11.87%) J2EE
6 33 (9.79%) Spring Boot
7 32 (9.50%) Middleware
8 26 (7.72%) REST
9 23 (6.82%) XML
10 22 (6.53%) Spark Streaming
11 19 (5.64%) RabbitMQ
11 19 (5.64%) Web Services
12 17 (5.04%) Apache Camel
13 15 (4.45%) SOAP
14 13 (3.86%) Spring Integration
15 10 (2.97%) Elastic Stack
16 8 (2.37%) Apache Avro
16 8 (2.37%) Apache Tez
16 8 (2.37%) PySpark
17 5 (1.48%) CSS
Miscellaneous
1 30 (8.90%) Analytical Skills
2 21 (6.23%) Virtual Team
3 18 (5.34%) Linux Command Line
4 16 (4.75%) Greenfield Project
5 13 (3.86%) Replication
6 12 (3.56%) Life Science
7 11 (3.26%) Computer Science
8 9 (2.67%) Fintech
9 8 (2.37%) Data Centre
10 6 (1.78%) Semantic Web
11 4 (1.19%) Algorithms
12 3 (0.89%) Management Information System
13 2 (0.59%) Clustering
14 1 (0.30%) IBM Mainframe
14 1 (0.30%) Mainframe
14 1 (0.30%) Mobile App
14 1 (0.30%) Smart Meter
Operating Systems
1 80 (23.74%) Linux
2 67 (19.88%) Unix
3 21 (6.23%) Red Hat Enterprise Linux
4 15 (4.45%) Ubuntu
5 9 (2.67%) Windows
6 3 (0.89%) Android
6 3 (0.89%) Apple iOS
6 3 (0.89%) Debian
6 3 (0.89%) Mac OS X
7 2 (0.59%) Solaris
7 2 (0.59%) Windows Server
7 2 (0.59%) Windows Server 2003
7 2 (0.59%) Windows Vista
8 1 (0.30%) CentOS
Processes & Methodologies
1 124 (36.80%) Agile Software Development
2 83 (24.63%) TDD
3 73 (21.66%) Analytics
4 64 (18.99%) ETL
5 63 (18.69%) MapReduce
6 55 (16.32%) Scrum
7 35 (10.39%) Unit Testing
8 34 (10.09%) BDD
9 31 (9.20%) Test Automation
10 28 (8.31%) Continuous Integration
10 28 (8.31%) System Testing
11 26 (7.72%) Business Intelligence
11 26 (7.72%) Visualisation
12 25 (7.42%) Continuous Delivery
13 24 (7.12%) DevOps
14 23 (6.82%) Data Modelling
15 21 (6.23%) Performance Tuning
15 21 (6.23%) Validation
15 21 (6.23%) Workflow
16 20 (5.93%) Technical Architecture
Programming Languages
1 122 (36.20%) Java
2 103 (30.56%) SQL
3 85 (25.22%) Python
4 74 (21.96%) Scala
5 20 (5.93%) Shell Script
6 16 (4.75%) Ruby
7 14 (4.15%) R
8 12 (3.56%) Perl
9 10 (2.97%) JavaScript
10 9 (2.67%) C
10 9 (2.67%) C++
11 7 (2.08%) C#
12 5 (1.48%) PHP
12 5 (1.48%) VBA
13 4 (1.19%) Bash Shell
13 4 (1.19%) HiveQL
14 3 (0.89%) Apple Swift
14 3 (0.89%) PowerShell
15 2 (0.59%) T-SQL
15 2 (0.59%) VB.NET
Qualifications
1 20 (5.93%) Degree
1 20 (5.93%) Security Cleared
2 16 (4.75%) SC Cleared
3 11 (3.26%) PhD
4 3 (0.89%) Microsoft Certification
5 2 (0.59%) ISTQB
5 2 (0.59%) MCITP
5 2 (0.59%) MCSE
5 2 (0.59%) Numerate Degree
6 1 (0.30%) BPSS Clearance
6 1 (0.30%) CCNA
6 1 (0.30%) Cisco Certification
6 1 (0.30%) DV Cleared
6 1 (0.30%) MCPD
6 1 (0.30%) VMware Certified Professional (VCP)
Quality Assurance & Compliance
1 31 (9.20%) QA
2 13 (3.86%) Data Quality
2 13 (3.86%) GDPR
3 2 (0.59%) SLA
4 1 (0.30%) CDISC
4 1 (0.30%) Disclosure Scotland
4 1 (0.30%) PMO
System Software
1 79 (23.44%) HDFS
2 50 (14.84%) Apache Flume
3 43 (12.76%) Docker
4 33 (9.79%) Apache ZooKeeper
5 2 (0.59%) Active Directory
5 2 (0.59%) Hyper-V
5 2 (0.59%) VMware Infrastructure
Systems Management
1 47 (13.95%) Hadoop YARN
2 35 (10.39%) Oozie
3 27 (8.01%) Ambari
4 18 (5.34%) Mesos
5 14 (4.15%) Ansible
6 13 (3.86%) Kubernetes
7 12 (3.56%) Control-M
8 11 (3.26%) Puppet
9 8 (2.37%) Kibana
10 7 (2.08%) Opscode Chef
11 5 (1.48%) Netcool
11 5 (1.48%) Tivoli
11 5 (1.48%) Tivoli Monitoring
11 5 (1.48%) ZABBIX
12 4 (1.19%) Terraform
13 3 (0.89%) Ganglia
13 3 (0.89%) HP Quality Center
13 3 (0.89%) logstash
13 3 (0.89%) Nagios
13 3 (0.89%) StatsD
Vendors
1 96 (28.49%) Cloudera
2 36 (10.68%) Oracle
3 35 (10.39%) Hortonworks
4 31 (9.20%) Red Hat
5 26 (7.72%) Google
5 26 (7.72%) IBM
6 22 (6.53%) Tableau
7 13 (3.86%) Netezza
8 12 (3.56%) Salesforce.com
8 12 (3.56%) SAP
9 10 (2.97%) RapidMiner
10 8 (2.37%) MapR
11 6 (1.78%) Microsoft
11 6 (1.78%) MicroStrategy
12 5 (1.48%) Cognos
12 5 (1.48%) HP
12 5 (1.48%) ILOG
12 5 (1.48%) Talend
13 4 (1.19%) DataFlux
14 3 (0.89%) Informatica