Period
to 27 June 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 27 June 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
UK > England
6 months to
27 Jun 2019
Same period 2018 Same period 2017
Rank 134 113 109
Rank change year-on-year -21 -4 +72
Contract jobs citing Hadoop 1,641 2,047 1,863
As % of all contract IT jobs advertised in England 1.97% 2.22% 2.20%
As % of the Database & Business Intelligence category 8.80% 9.76% 9.70%
Number of daily rates quoted 1,142 1,479 1,244
England median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% -
10th Percentile £419 £400 £375
90th Percentile £710 £688 £675
UK median daily rate £550 £550 £513
% change year-on-year - +7.32% -2.38%
Number of hourly rates quoted 12 7 6
England median hourly rate £43.53 £47.50 £47.00
Median hourly rate % change year-on-year -8.35% +1.06% +23.68%
10th Percentile £32.75 £20.80 £22.38
90th Percentile £68.23 £96.50 £50.00
UK median hourly rate £44.57 £47.50 £47.00
% change year-on-year -6.18% +1.06% +23.68%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 18,647 20,966 19,210
As % of all contract IT jobs advertised in England 22.40% 22.72% 22.64%
Number of daily rates quoted 12,920 14,723 12,882
England median daily rate £480 £475 £450
Median daily rate % change year-on-year +1.05% +5.56% +5.88%
10th Percentile £325 £313 £300
90th Percentile £650 £638 £625
UK median daily rate £475 £463 £445
% change year-on-year +2.70% +3.93% +4.71%
Number of hourly rates quoted 228 220 238
England median hourly rate £35.00 £33.75 £30.00
Median hourly rate % change year-on-year +3.70% +12.50% -0.83%
10th Percentile £14.27 £14.00 £9.25
90th Percentile £59.39 £53.88 £50.00
UK median hourly rate £35.00 £33.50 £30.50
% change year-on-year +4.48% +9.84% +7.02%

Hadoop
Job Vacancy Trend in England

Job postings citing Hadoop as a percentage of all IT jobs advertised in England.

Job vacancy trend for Hadoop in England

Hadoop
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in England.

Contractor daily rate trend for Hadoop in England

Hadoop
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Hadoop in England over the 6 months to 27 June 2019.

Contractor daily rate histogram for Hadoop in England

Hadoop
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in England.

Contractor hourly rate trend for Hadoop in England

Hadoop
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Hadoop in England over the 6 months to 27 June 2019.

Contractor hourly rate histogram for Hadoop in England

Hadoop
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the England region over the 6 months to 27 June 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -28 965 £575 +4.55% 57
North of England +55 235 £525 +5.00% 5
South East -43 219 £500 -2.44% 13
Yorkshire +31 124 £500 -
North West +41 103 £550 +4.76% 5
South West -16 93 £519 +9.21% 15
Midlands +12 65 £525 +16.67% 3
East of England -24 40 £563 +18.42% 4
West Midlands +24 36 £600 +65.52%
East Midlands -10 29 £475 +5.56% 3
North East +29 8 £476 -32.70%
South Coast - 1 - -
Hadoop
UK

For the 6 months to 27 June 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Hadoop.

1 1,102 (67.15%) Big Data
2 916 (55.82%) Apache Spark
3 813 (49.54%) Python
4 603 (36.75%) SQL
5 572 (34.86%) Amazon AWS
6 570 (34.73%) Java
7 568 (34.61%) Agile Software Development
8 551 (33.58%) Apache Hive
9 530 (32.30%) Kafka
10 422 (25.72%) Analytics
11 372 (22.67%) Finance
12 371 (22.61%) Scala
13 369 (22.49%) DevOps
14 362 (22.06%) Data Science
15 355 (21.63%) Linux
16 318 (19.38%) Data Warehouse
17 306 (18.65%) Jenkins
18 302 (18.40%) NoSQL
19 297 (18.10%) Microsoft Azure
20 293 (17.85%) Docker
21 292 (17.79%) HBase
22 270 (16.45%) ETL
23 262 (15.97%) Machine Learning
24 248 (15.11%) Data Modelling
25 237 (14.44%) Cloudera
26 227 (13.83%) Google Cloud Platform
26 227 (13.83%) Kubernetes
27 217 (13.22%) HDFS
27 217 (13.22%) Google
28 208 (12.68%) Data Lake

Hadoop
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 916 (55.82%) Apache Spark
2 162 (9.87%) Apache
3 109 (6.64%) Elasticsearch
4 81 (4.94%) SAS
5 54 (3.29%) Apache Pig
6 50 (3.05%) Apache Airflow
7 47 (2.86%) Confluence
8 36 (2.19%) Apache Solr
9 28 (1.71%) Luigi
10 22 (1.34%) JBoss
10 22 (1.34%) nginx
11 18 (1.10%) Jupyter
12 17 (1.04%) Tomcat
13 13 (0.79%) Pachyderm
14 9 (0.55%) OpenStack
15 7 (0.43%) Jetty
16 6 (0.37%) Cloud Foundry
17 5 (0.30%) Oracle SOA Suite
17 5 (0.30%) SharePoint
17 5 (0.30%) SharePoint 2013
Applications
1 11 (0.67%) Microsoft Excel
2 10 (0.61%) SPSS
3 9 (0.55%) Stata
4 7 (0.43%) Microsoft PowerPoint
5 5 (0.30%) MS Visio
6 3 (0.18%) Microsoft Office
7 2 (0.12%) Chatbot
8 1 (0.061%) Spreadsheet
Business Applications
1 17 (1.04%) SAP Oil and Gas
2 5 (0.30%) Dynamics NAV
2 5 (0.30%) Oracle BPM
3 4 (0.24%) Revive Adserver
3 4 (0.24%) SAP ERP
3 4 (0.24%) SAP S/4HANA
4 1 (0.061%) Cognos Business Intelligence
4 1 (0.061%) Dynamics CRM
4 1 (0.061%) Eloqua
4 1 (0.061%) Oracle Receivables
4 1 (0.061%) Oracle Retail
4 1 (0.061%) SAP IS-U
Cloud Services
1 572 (34.86%) Amazon AWS
2 297 (18.10%) Microsoft Azure
3 227 (13.83%) Google Cloud Platform
4 123 (7.50%) Amazon EMR
5 94 (5.73%) Serverless
6 89 (5.42%) Amazon S3
7 78 (4.75%) Power Platform
8 76 (4.63%) GitHub
9 61 (3.72%) Amazon Kinesis
10 53 (3.23%) Amazon EC2
11 48 (2.93%) AWS Lambda
12 40 (2.44%) Azure Data Factory
13 36 (2.19%) AWS CloudFormation
14 34 (2.07%) PaaS
15 22 (1.34%) SaaS
16 21 (1.28%) Cloud Computing
17 18 (1.10%) Amazon CloudWatch
18 17 (1.04%) Amazon SageMaker
18 17 (1.04%) Azure Functions
19 16 (0.98%) Data Lake Analytics
Communications & Networking
1 42 (2.56%) Kerberos
2 16 (0.98%) TCP/IP
3 15 (0.91%) Internet
4 14 (0.85%) Firewall
4 14 (0.85%) MQTT
5 10 (0.61%) DNS
6 8 (0.49%) OpenLDAP
7 7 (0.43%) VPN
8 6 (0.37%) SSL
9 5 (0.30%) Cisco IOS
10 4 (0.24%) HTTP
11 3 (0.18%) NAS
11 3 (0.18%) Network Security
11 3 (0.18%) SAN
11 3 (0.18%) Software-Defined Networking
12 2 (0.12%) DSL
12 2 (0.12%) ICMP
12 2 (0.12%) LAN
12 2 (0.12%) VSAN
12 2 (0.12%) WAN
Database & Business Intelligence
1 1,102 (67.15%) Big Data
2 551 (33.58%) Apache Hive
3 318 (19.38%) Data Warehouse
4 302 (18.40%) NoSQL
5 292 (17.79%) HBase
6 208 (12.68%) Data Lake
7 168 (10.24%) MongoDB
8 156 (9.51%) Apache Cassandra
9 149 (9.08%) PostgreSQL
10 123 (7.50%) Impala
11 115 (7.01%) Relational Database
11 115 (7.01%) SQL Server
12 95 (5.79%) Amazon Redshift
13 78 (4.75%) Power BI
14 73 (4.45%) MySQL
15 71 (4.33%) Sqoop
16 64 (3.90%) Parquet
17 58 (3.53%) RDBMS
18 54 (3.29%) BigQuery
19 53 (3.23%) Amazon RDS
Development Applications
1 306 (18.65%) Jenkins
2 192 (11.70%) Git (software)
3 113 (6.89%) JIRA
4 69 (4.20%) Maven
5 57 (3.47%) Gradle
6 42 (2.56%) Subversion
7 41 (2.50%) GitLab
8 38 (2.32%) Sonatype Nexus
9 33 (2.01%) Atlassian Bamboo
10 31 (1.89%) Cucumber
11 24 (1.46%) Mercurial
11 24 (1.46%) Visual Studio Team System
12 20 (1.22%) RStudio
12 20 (1.22%) TeamCity
13 19 (1.16%) JUnit
14 17 (1.04%) Ant
14 17 (1.04%) Apache Ivy
15 16 (0.98%) ERwin
15 16 (0.98%) IntelliJ
16 15 (0.91%) Selenium
General
1 372 (22.67%) Finance
2 150 (9.14%) Banking
3 58 (3.53%) Retail
4 42 (2.56%) Front Office
5 41 (2.50%) Investment Banking
6 34 (2.07%) Legal
7 33 (2.01%) Marketing
8 19 (1.16%) Telecoms
9 14 (0.85%) Financial Institution
10 11 (0.67%) Publishing
11 10 (0.61%) Pharmaceutical
11 10 (0.61%) Retail Banking
12 8 (0.49%) Advertising
13 7 (0.43%) Games
14 5 (0.30%) Aerospace
14 5 (0.30%) General Ledger
14 5 (0.30%) Manufacturing
15 3 (0.18%) Back Office
15 3 (0.18%) Greek Language
16 2 (0.12%) Social Science
Job Titles
1 479 (29.19%) Data Engineer
2 381 (23.22%) Developer
3 211 (12.86%) Big Data Engineer
4 209 (12.74%) Architect
5 164 (9.99%) Hadoop Engineer
6 161 (9.81%) Java Developer
7 131 (7.98%) DevOps Engineer
8 122 (7.43%) Data Architect
9 110 (6.70%) Python Engineer
10 101 (6.15%) Big Data Developer
11 77 (4.69%) Administrator
12 76 (4.63%) Cloud Engineer
12 76 (4.63%) Hadoop Developer
13 74 (4.51%) Data Scientist
14 69 (4.20%) AWS Engineer
15 63 (3.84%) Hadoop Administrator
16 58 (3.53%) Analyst
17 55 (3.35%) Big Data Architect
18 54 (3.29%) Senior Developer
19 53 (3.23%) Python Developer
Libraries, Frameworks & Software Standards
1 530 (32.30%) Kafka
2 118 (7.19%) Spring
3 94 (5.73%) Web Services
4 80 (4.88%) PySpark
5 67 (4.08%) Spark Streaming
6 66 (4.02%) REST
7 57 (3.47%) RabbitMQ
7 57 (3.47%) RESTful
8 52 (3.17%) Spring Boot
9 49 (2.99%) Apache NiFi
10 43 (2.62%) JSON
11 41 (2.50%) Natural Language Processing
12 39 (2.38%) TensorFlow
13 34 (2.07%) AngularJS
13 34 (2.07%) Elastic Stack
14 33 (2.01%) HTML
14 33 (2.01%) Pandas
15 31 (1.89%) Apache Avro
16 30 (1.83%) Hibernate
16 30 (1.83%) Node.js
Miscellaneous
1 146 (8.90%) Analytical Skills
2 115 (7.01%) Algorithms
3 106 (6.46%) Greenfield Project
4 59 (3.60%) Self-Motivation
5 55 (3.35%) Data Structures
6 35 (2.13%) Virtual Team
7 31 (1.89%) Linux Command Line
8 28 (1.71%) User Experience
9 24 (1.46%) Credit Risk
10 22 (1.34%) Public Cloud
11 21 (1.28%) Data Centre
12 13 (0.79%) Cloud Native
12 13 (0.79%) Hedge funds
12 13 (0.79%) Market Risk
13 11 (0.67%) Data Protection Act
13 11 (0.67%) Enterprise Software
14 10 (0.61%) Derivative
14 10 (0.61%) Foreign Exchange (FX)
15 8 (0.49%) Industry 4.0
16 7 (0.43%) Equity Derivative
Operating Systems
1 355 (21.63%) Linux
2 178 (10.85%) Unix
3 46 (2.80%) Red Hat Enterprise Linux
4 39 (2.38%) Windows
5 19 (1.16%) CentOS
6 13 (0.79%) Ubuntu
7 10 (0.61%) Solaris
8 7 (0.43%) Windows Server
9 6 (0.37%) Debian
10 5 (0.30%) Android
10 5 (0.30%) Apple iOS
11 3 (0.18%) SUSE Linux Enterprise Server
11 3 (0.18%) Windows Server 2003
11 3 (0.18%) Windows Server 2008
11 3 (0.18%) Windows Server 2012
11 3 (0.18%) Windows Vista
12 2 (0.12%) zOS
13 1 (0.061%) Data ONTAP
13 1 (0.061%) Mac OS X
13 1 (0.061%) Mesosphere
Processes & Methodologies
1 568 (34.61%) Agile Software Development
2 422 (25.72%) Analytics
3 369 (22.49%) DevOps
4 362 (22.06%) Data Science
5 270 (16.45%) ETL
6 262 (15.97%) Machine Learning
7 248 (15.11%) Data Modelling
8 204 (12.43%) TDD
9 183 (11.15%) Continuous Integration
10 175 (10.66%) Software Engineering
11 164 (9.99%) Business Intelligence
12 146 (8.90%) Microservices
13 139 (8.47%) Problem-Solving
14 128 (7.80%) Scrum
15 123 (7.50%) Visualisation
16 118 (7.19%) MapReduce
17 112 (6.83%) Computer Science
18 111 (6.76%) Artificial Intelligence
19 107 (6.52%) Data Architecture
20 105 (6.40%) Migration
Programming Languages
1 813 (49.54%) Python
2 603 (36.75%) SQL
3 570 (34.73%) Java
4 371 (22.61%) Scala
5 144 (8.78%) R
6 86 (5.24%) JavaScript
7 75 (4.57%) C#
8 74 (4.51%) Shell Script
9 73 (4.45%) Java 8
10 62 (3.78%) C++
11 53 (3.23%) Ruby
12 50 (3.05%) Bash Shell
13 35 (2.13%) C
14 32 (1.95%) Perl
15 31 (1.89%) MATLAB
16 30 (1.83%) Go
17 28 (1.71%) T-SQL
18 18 (1.10%) U-SQL
19 15 (0.91%) PL/SQL
20 14 (0.85%) Julia
Qualifications
1 133 (8.10%) Security Cleared
2 110 (6.70%) Degree
3 98 (5.97%) SC Cleared
4 37 (2.25%) DV Cleared
5 33 (2.01%) Computer Science Degree
6 32 (1.95%) PhD
7 29 (1.77%) Master's Degree
8 18 (1.10%) CCA
8 18 (1.10%) RHCE
9 11 (0.67%) TOGAF Certification
10 9 (0.55%) AWS Certification
11 6 (0.37%) BPSS Clearance
12 5 (0.30%) ISTQB
13 4 (0.24%) CISSP
13 4 (0.24%) MCSE
13 4 (0.24%) Microsoft Certification
14 3 (0.18%) CEH
14 3 (0.18%) CISA
14 3 (0.18%) CISM
14 3 (0.18%) GIAC
Quality Assurance & Compliance
1 74 (4.51%) Data Quality
2 17 (1.04%) QA
3 14 (0.85%) GDPR
4 10 (0.61%) SLA
5 5 (0.30%) ISO/IEC 27001
6 4 (0.24%) IFRS
7 3 (0.18%) PMO
7 3 (0.18%) Sarbanes-Oxley
8 2 (0.12%) Actionable Recommendations
8 2 (0.12%) MiFID
8 2 (0.12%) PSD2
9 1 (0.061%) Basel III
9 1 (0.061%) Disclosure Scotland
9 1 (0.061%) EMIR
9 1 (0.061%) GxP
9 1 (0.061%) IFRS 9
9 1 (0.061%) PCI DSS
System Software
1 293 (17.85%) Docker
2 217 (13.22%) HDFS
3 107 (6.52%) Apache Flume
4 37 (2.25%) Apache ZooKeeper
5 27 (1.65%) VMware Infrastructure
6 17 (1.04%) Active Directory
7 16 (0.98%) Oracle RAC
8 11 (0.67%) vCloud
9 7 (0.43%) VMware ESXi
9 7 (0.43%) vSphere
10 5 (0.30%) Virtual Machines
11 4 (0.24%) Hyper-V
11 4 (0.24%) Samba
12 3 (0.18%) NFS
13 2 (0.12%) VMware NSX
14 1 (0.061%) KVM
14 1 (0.061%) Virtual Servers
14 1 (0.061%) VirtualBox
Systems Management
1 227 (13.83%) Kubernetes
2 185 (11.27%) Ansible
3 147 (8.96%) Terraform
4 126 (7.68%) Puppet
5 107 (6.52%) Hadoop YARN
6 103 (6.28%) Oozie
7 61 (3.72%) Opscode Chef
8 22 (1.34%) Kibana
8 22 (1.34%) logstash
9 19 (1.16%) ZABBIX
10 16 (0.98%) Packer
11 15 (0.91%) Ambari
12 13 (0.79%) Kubeflow
13 9 (0.55%) Nagios
14 7 (0.43%) Cobbler
14 7 (0.43%) Mesos
15 6 (0.37%) vCenter Server
16 5 (0.30%) Grafana
16 5 (0.30%) Marathon
17 4 (0.24%) Microsoft Clustering
Vendors
1 237 (14.44%) Cloudera
2 217 (13.22%) Google
3 175 (10.66%) Hortonworks
4 133 (8.10%) Oracle
5 115 (7.01%) Tableau
6 96 (5.85%) Microsoft
7 70 (4.27%) Talend
8 65 (3.96%) Databricks
9 59 (3.60%) Informatica
10 50 (3.05%) Teradata
11 45 (2.74%) Red Hat
12 44 (2.68%) MapR
13 41 (2.50%) SAP
14 32 (1.95%) Splunk
14 32 (1.95%) VMware
15 17 (1.04%) Atlassian
16 16 (0.98%) MicroStrategy
17 15 (0.91%) Ab Initio
18 13 (0.79%) Dataiku
19 12 (0.73%) IBM