Period
to 10 December 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 10 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
10 Dec 2018
Same period 2017 Same period 2016
Rank 99 88 69
Rank change year-on-year -11 -19 +54
Contract jobs citing Hadoop 1,244 1,410 1,599
As % of all contract IT jobs advertised in London 2.65% 2.99% 3.60%
As % of the Database & Business Intelligence category 10.92% 12.60% 15.32%
Number of daily rates quoted 887 1,040 1,072
London median daily rate £575 £550 £550
Median daily rate % change year-on-year +4.55% - -4.35%
10th Percentile £450 £413 £407
90th Percentile £713 £700 £711
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -4.55%
Number of hourly rates quoted 3 0 1
London median hourly rate £55.00 - £100.00
10th Percentile £44.50 - £90.00
90th Percentile £152.90 - £110.00
England median hourly rate £51.25 £35.00 £46.00
% change year-on-year +46.43% -23.91% +22.67%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,388 11,190 10,434
As % of all contract IT jobs advertised in London 24.26% 23.74% 23.50%
Number of daily rates quoted 8,514 8,335 7,370
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £363 £352 £325
90th Percentile £675 £663 £638
England median daily rate £475 £463 £425
% change year-on-year +2.70% +8.82% +1.67%
Number of hourly rates quoted 48 63 39
London median hourly rate £27.50 £27.50 £29.88
Median hourly rate % change year-on-year - -7.97% +35.97%
10th Percentile £18.35 £18.30 £15.25
90th Percentile £50.50 £58.75 £68.15
England median hourly rate £33.75 £32.50 £27.50
% change year-on-year +3.85% +18.18% -

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 10 December 2018.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Hadoop in London over the 6 months to 10 December 2018.

Contractor hourly rate histogram for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 10 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -3 251 £575 -4.17% 83
South London -16 125 £525 -2.33% 6
East London +27 95 £575 +3.37% 21
West London +8 24 £550 +10.00% 26
North London +2 8 £700 +40.00% 1
Hadoop
England

For the 6 months to 10 December 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 763 (61.33%) Big Data
2 600 (48.23%) Apache Spark
3 597 (47.99%) Python
4 494 (39.71%) Agile Software Development
5 470 (37.78%) Java
6 438 (35.21%) Kafka
7 433 (34.81%) Apache Hive
8 406 (32.64%) Amazon AWS
9 395 (31.75%) SQL
10 344 (27.65%) Finance
11 336 (27.01%) DevOps
12 285 (22.91%) Analytics
13 281 (22.59%) Data Science
14 273 (21.95%) Scala
15 262 (21.06%) Docker
16 251 (20.18%) Ansible
17 246 (19.77%) Linux
18 240 (19.29%) HBase
19 236 (18.97%) Jenkins
20 210 (16.88%) ETL
21 208 (16.72%) Cloudera
22 205 (16.48%) Terraform
23 198 (15.92%) Kubernetes
24 190 (15.27%) Business Intelligence
25 184 (14.79%) Microsoft Azure
26 183 (14.71%) Machine Learning
27 180 (14.47%) HDFS
28 176 (14.15%) Microservices
29 167 (13.42%) Scrum
30 164 (13.18%) Data Modelling

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 600 (48.23%) Apache Spark
2 125 (10.05%) Elasticsearch
3 104 (8.36%) Apache
4 71 (5.71%) SAS
5 59 (4.74%) Confluence
6 51 (4.10%) Apache Pig
7 43 (3.46%) Apache Solr
8 19 (1.53%) SharePoint
9 6 (0.48%) Apache Airflow
9 6 (0.48%) nginx
10 5 (0.40%) Tomcat
11 3 (0.24%) Cloud Foundry
11 3 (0.24%) Jupyter
11 3 (0.24%) Luigi
12 2 (0.16%) K2 blackpearl
12 2 (0.16%) Oracle Coherence
12 2 (0.16%) Oracle SOA Suite
12 2 (0.16%) SharePoint 2013
13 1 (0.080%) MS Exchange
13 1 (0.080%) OpenStack
Applications
1 47 (3.78%) Microsoft Excel
2 38 (3.05%) MS Visio
3 3 (0.24%) Chatbot
4 2 (0.16%) Microsoft Office
4 2 (0.16%) Microsoft PowerPoint
4 2 (0.16%) Spreadsheet
4 2 (0.16%) SPSS
5 1 (0.080%) GNU Octave
5 1 (0.080%) InVision
5 1 (0.080%) Shockwave
Business Applications
1 16 (1.29%) SAP Oil and Gas
2 3 (0.24%) SAP MM
2 3 (0.24%) SAP R/3
3 2 (0.16%) Dynamics NAV
4 1 (0.080%) Dynamics AX
4 1 (0.080%) Dynamics CRM
4 1 (0.080%) Oracle BPM
4 1 (0.080%) SAP ERP
4 1 (0.080%) Summit
Cloud Services
1 406 (32.64%) Amazon AWS
2 184 (14.79%) Microsoft Azure
3 85 (6.83%) Google Cloud Platform
4 79 (6.35%) Amazon EMR
5 78 (6.27%) Amazon S3
6 67 (5.39%) Amazon EC2
7 46 (3.70%) Virtual Private Cloud
8 40 (3.22%) GitHub
9 34 (2.73%) AWS CloudFormation
10 26 (2.09%) Serverless
11 22 (1.77%) AWS Lambda
12 21 (1.69%) Azure Data Factory
12 21 (1.69%) PaaS
13 17 (1.37%) Amazon Kinesis
14 16 (1.29%) Heroku
15 15 (1.21%) SaaS
16 13 (1.05%) IaaS
17 11 (0.88%) Cloud Computing
17 11 (0.88%) Data Lake Analytics
18 8 (0.64%) Amazon CloudWatch
Communications & Networking
1 62 (4.98%) Kerberos
2 36 (2.89%) HTTP
3 30 (2.41%) SSL
4 27 (2.17%) DNS
5 26 (2.09%) Firewall
6 24 (1.93%) TCP/IP
7 19 (1.53%) VPN
8 16 (1.29%) FTP
9 9 (0.72%) Internet
10 8 (0.64%) HTTPS
10 8 (0.64%) Network Security
11 5 (0.40%) LAN
12 4 (0.32%) DOCSIS
12 4 (0.32%) SNA
13 3 (0.24%) ICMP
13 3 (0.24%) RTMP
13 3 (0.24%) WAN
14 2 (0.16%) Multicast
14 2 (0.16%) SAN
15 1 (0.080%) Intranet
Database & Business Intelligence
1 763 (61.33%) Big Data
2 433 (34.81%) Apache Hive
3 240 (19.29%) HBase
4 157 (12.62%) SQL Server
5 155 (12.46%) NoSQL
6 154 (12.38%) MongoDB
7 145 (11.66%) Impala
8 139 (11.17%) Data Warehouse
9 126 (10.13%) Apache Cassandra
10 113 (9.08%) Data Lake
11 109 (8.76%) Relational Database
12 105 (8.44%) Sqoop
13 82 (6.59%) Power BI
14 68 (5.47%) PostgreSQL
15 49 (3.94%) Amazon Redshift
16 46 (3.70%) Data Mining
16 46 (3.70%) SQL Server Integration Services
17 39 (3.14%) RDBMS
18 36 (2.89%) Spotfire
19 34 (2.73%) MySQL
Development Applications
1 236 (18.97%) Jenkins
2 136 (10.93%) Git (software)
3 92 (7.40%) JIRA
4 73 (5.87%) Maven
5 50 (4.02%) Artifactory
6 42 (3.38%) Atlassian Bamboo
7 32 (2.57%) Cucumber
8 31 (2.49%) Hudson
9 29 (2.33%) Visual Studio Team System
10 24 (1.93%) GitLab
11 23 (1.85%) Gradle
12 21 (1.69%) Subversion
13 20 (1.61%) JUnit
14 16 (1.29%) gulp
14 16 (1.29%) IntelliJ
15 15 (1.21%) TeamCity
16 13 (1.05%) Sonatype Nexus
17 12 (0.96%) Visual Studio
18 11 (0.88%) Selenium
19 10 (0.80%) FishEye
General
1 344 (27.65%) Finance
2 141 (11.33%) Banking
3 95 (7.64%) Front Office
4 60 (4.82%) Retail
5 37 (2.97%) Legal
6 32 (2.57%) Investment Banking
7 28 (2.25%) Marketing
8 23 (1.85%) Publishing
9 14 (1.13%) Games
10 11 (0.88%) Telecoms
11 9 (0.72%) Advertising
11 9 (0.72%) Financial Institution
11 9 (0.72%) Retail Banking
12 7 (0.56%) Back Office
12 7 (0.56%) Manufacturing
13 4 (0.32%) Electronics
14 2 (0.16%) French Language
15 1 (0.080%) Avionics
15 1 (0.080%) Dutch Language
15 1 (0.080%) Pharmaceutical
Job Titles
1 304 (24.44%) Developer
2 295 (23.71%) Data Engineer
3 184 (14.79%) Big Data Engineer
4 144 (11.58%) Java Developer
5 133 (10.69%) Architect
6 131 (10.53%) Hadoop Engineer
7 107 (8.60%) DevOps Engineer
8 104 (8.36%) Consultant
9 86 (6.91%) AWS Engineer
9 86 (6.91%) Big Data Developer
10 84 (6.75%) Data Scientist
11 73 (5.87%) Python Engineer
12 70 (5.63%) Data Architect
13 66 (5.31%) Senior Developer
14 65 (5.23%) DevOps Consultant
15 60 (4.82%) Kubernetes Consultant
16 51 (4.10%) Software Engineer
17 49 (3.94%) Java Engineer
18 48 (3.86%) Analyst
19 47 (3.78%) Platform Engineer
Libraries, Frameworks & Software Standards
1 438 (35.21%) Kafka
2 107 (8.60%) Web Services
3 87 (6.99%) AngularJS
4 86 (6.91%) REST
5 75 (6.03%) Spring
6 68 (5.47%) JSON
7 59 (4.74%) React
8 57 (4.58%) RESTful
9 54 (4.34%) Spark Streaming
10 52 (4.18%) NumPy
11 51 (4.10%) JSON Schema
11 51 (4.10%) Spring Boot
12 50 (4.02%) PySpark
13 47 (3.78%) TensorFlow
14 46 (3.70%) HTML
15 38 (3.05%) SciPy
16 36 (2.89%) HTML5
17 33 (2.65%) CSS
18 32 (2.57%) Elastic Stack
18 32 (2.57%) Theano
Miscellaneous
1 157 (12.62%) Greenfield Project
2 153 (12.30%) Algorithms
3 120 (9.65%) Analytical Skills
4 37 (2.97%) Wiki
5 32 (2.57%) Data Structures
6 31 (2.49%) Fintech
7 22 (1.77%) User Experience
8 20 (1.61%) Self-Motivation
9 13 (1.05%) HoloLens
10 12 (0.96%) Virtual Team
11 11 (0.88%) Public Cloud
12 10 (0.80%) Data Centre
12 10 (0.80%) Enterprise Software
13 9 (0.72%) Derivative
13 9 (0.72%) Fixed Income
13 9 (0.72%) Management Information System
13 9 (0.72%) Social Network
14 7 (0.56%) Market Risk
14 7 (0.56%) Security Operations Centre
15 5 (0.40%) Cyberthreat
Operating Systems
1 246 (19.77%) Linux
2 115 (9.24%) Unix
3 53 (4.26%) Windows
4 21 (1.69%) Red Hat Enterprise Linux
5 5 (0.40%) Android
6 3 (0.24%) CoreOS
7 2 (0.16%) Apple iOS
7 2 (0.16%) DC/OS
7 2 (0.16%) Solaris
8 1 (0.080%) CentOS
8 1 (0.080%) Mac OS X
8 1 (0.080%) Mesosphere
8 1 (0.080%) Oracle Linux
8 1 (0.080%) Ubuntu
Processes & Methodologies
1 494 (39.71%) Agile Software Development
2 336 (27.01%) DevOps
3 285 (22.91%) Analytics
4 281 (22.59%) Data Science
5 210 (16.88%) ETL
6 190 (15.27%) Business Intelligence
7 183 (14.71%) Machine Learning
8 176 (14.15%) Microservices
9 167 (13.42%) Scrum
10 164 (13.18%) Data Modelling
11 144 (11.58%) Visualisation
12 137 (11.01%) TDD
13 122 (9.81%) Continuous Integration
14 112 (9.00%) Software Engineering
15 105 (8.44%) Open Source
16 100 (8.04%) BDD
17 97 (7.80%) Data Analysis
18 94 (7.56%) Computer Science
19 91 (7.32%) Problem-Solving
20 86 (6.91%) MapReduce
Programming Languages
1 597 (47.99%) Python
2 470 (37.78%) Java
3 395 (31.75%) SQL
4 273 (21.95%) Scala
5 133 (10.69%) Java 8
6 112 (9.00%) R
7 102 (8.20%) Groovy
8 92 (7.40%) Bash Shell
9 78 (6.27%) JavaScript
10 58 (4.66%) Shell Script
11 57 (4.58%) C++
12 50 (4.02%) PowerShell
13 46 (3.70%) MATLAB
14 37 (2.97%) C#
15 36 (2.89%) Korn
16 25 (2.01%) Ruby
17 24 (1.93%) TypeScript
18 21 (1.69%) C
19 17 (1.37%) ES6
20 16 (1.29%) Perl
Qualifications
1 107 (8.60%) Security Cleared
2 106 (8.52%) Degree
3 48 (3.86%) Master's Degree
4 44 (3.54%) PhD
5 41 (3.30%) AWS Certification
6 39 (3.14%) SC Cleared
7 35 (2.81%) Computer Science Degree
8 8 (0.64%) CISSP
9 7 (0.56%) Numerate Degree
10 6 (0.48%) CEH
10 6 (0.48%) DV Cleared
11 5 (0.40%) SANS
12 4 (0.32%) CISM
13 2 (0.16%) PMI Certification
14 1 (0.080%) CCA
14 1 (0.080%) CCNA
14 1 (0.080%) CISA
14 1 (0.080%) MBA
14 1 (0.080%) Network+ Certification
14 1 (0.080%) SSCP
Quality Assurance & Compliance
1 65 (5.23%) Data Quality
2 31 (2.49%) QA
3 17 (1.37%) GDPR
4 7 (0.56%) ISO/IEC 27001
4 7 (0.56%) SLA
5 5 (0.40%) PMO
6 2 (0.16%) Dodd-Frank
6 2 (0.16%) EMIR
6 2 (0.16%) MiFID
7 1 (0.080%) PSD2
System Software
1 262 (21.06%) Docker
2 180 (14.47%) HDFS
3 81 (6.51%) Apache Flume
4 29 (2.33%) Apache ZooKeeper
5 22 (1.77%) Active Directory
6 2 (0.16%) etcd
6 2 (0.16%) flannel
6 2 (0.16%) LXC
7 1 (0.080%) Cronacle
7 1 (0.080%) Oracle RAC
7 1 (0.080%) VMware Infrastructure
7 1 (0.080%) vSphere
Systems Management
1 251 (20.18%) Ansible
2 205 (16.48%) Terraform
3 198 (15.92%) Kubernetes
4 140 (11.25%) Puppet
5 134 (10.77%) Hadoop YARN
6 120 (9.65%) Opscode Chef
7 90 (7.23%) Oozie
8 27 (2.17%) Ambari
9 20 (1.61%) Kibana
9 20 (1.61%) logstash
10 16 (1.29%) Docker Swarm
10 16 (1.29%) ITRS Geneos
11 11 (0.88%) Mesos
12 9 (0.72%) Consul
12 9 (0.72%) Sysdig
13 8 (0.64%) Control-M
14 7 (0.56%) Marathon
14 7 (0.56%) ZABBIX
15 6 (0.48%) ArcSight ESM
15 6 (0.48%) Salt
Vendors
1 208 (16.72%) Cloudera
2 159 (12.78%) Oracle
3 128 (10.29%) Hortonworks
4 106 (8.52%) Tableau
5 90 (7.23%) Google
6 79 (6.35%) Microsoft
7 53 (4.26%) Talend
8 47 (3.78%) Informatica
9 43 (3.46%) Alteryx
10 40 (3.22%) SAP
11 31 (2.49%) Splunk
12 27 (2.17%) Databricks
12 27 (2.17%) MapR
13 21 (1.69%) Teradata
14 17 (1.37%) IBM
14 17 (1.37%) Red Hat
15 12 (0.96%) ArcSight
15 12 (0.96%) SaltStack
16 11 (0.88%) Ab Initio
16 11 (0.88%) Atlassian