Period
to 20 October 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 20 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
20 Oct 2018
Same period 2017 Same period 2016
Rank 99 84 81
Rank change year-on-year -15 -3 +60
Contract jobs citing Hadoop 1,237 1,402 1,387
As % of all contract IT jobs advertised in London 2.70% 3.11% 3.11%
As % of the Database & Business Intelligence category 10.90% 13.18% 13.52%
Number of daily rates quoted 890 1,030 951
London median daily rate £563 £550 £550
Median daily rate % change year-on-year +2.27% - -
10th Percentile £425 £411 £413
90th Percentile £713 £700 £725
England median daily rate £550 £538 £525
% change year-on-year +2.33% +2.38% -
Number of hourly rates quoted 4 0 0
London median hourly rate £60.00 - -
England median hourly rate £47.50 £35.00 £45.75
% change year-on-year +35.71% -23.50% +36.36%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11,352 10,638 10,262
As % of all contract IT jobs advertised in London 24.82% 23.61% 23.00%
Number of daily rates quoted 8,436 7,816 7,342
London median daily rate £525 £500 £475
Median daily rate % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £363 £350 £313
90th Percentile £675 £650 £638
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 52 54 40
London median hourly rate £27.50 £26.88 £35.00
Median hourly rate % change year-on-year +2.30% -23.19% +55.56%
10th Percentile £16.55 £18.56 £15.25
90th Percentile £47.73 £58.75 £108.75
England median hourly rate £32.48 £30.50 £28.50
% change year-on-year +6.48% +7.02% +3.64%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 20 October 2018.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Hadoop in London over the 6 months to 20 October 2018.

Contractor hourly rate histogram for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 20 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -11 247 £575 - 49
South London -19 114 £525 -2.33% 10
East London +28 77 £575 +4.55% 13
West London +6 29 £550 +10.00% 20
North London -1 4 £488 -2.50% 2
Hadoop
England

For the 6 months to 20 October 2018, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 797 (64.43%) Big Data
2 607 (49.07%) Apache Spark
3 566 (45.76%) Python
4 504 (40.74%) Agile Software Development
5 491 (39.69%) Java
6 439 (35.49%) Apache Hive
7 425 (34.36%) Kafka
8 400 (32.34%) SQL
9 371 (29.99%) Finance
10 369 (29.83%) Amazon AWS
11 317 (25.63%) DevOps
12 286 (23.12%) Scala
13 279 (22.55%) Analytics
14 267 (21.58%) Data Science
15 249 (20.13%) Jenkins
16 247 (19.97%) HBase
17 243 (19.64%) Linux
18 238 (19.24%) Ansible
19 233 (18.84%) Docker
20 205 (16.57%) Scrum
21 203 (16.41%) ETL
22 201 (16.25%) Business Intelligence
23 198 (16.01%) HDFS
24 188 (15.20%) NoSQL
25 185 (14.96%) SQL Server
26 184 (14.87%) Machine Learning
27 179 (14.47%) Cloudera
28 177 (14.31%) Terraform
29 169 (13.66%) Microservices
30 168 (13.58%) Kubernetes

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 607 (49.07%) Apache Spark
2 126 (10.19%) Elasticsearch
3 116 (9.38%) Apache
4 63 (5.09%) Apache Pig
5 54 (4.37%) Confluence
6 52 (4.20%) SAS
7 50 (4.04%) Apache Solr
8 9 (0.73%) SharePoint
8 9 (0.73%) Tomcat
9 8 (0.65%) Apache Airflow
10 6 (0.49%) Jupyter
11 5 (0.40%) nginx
12 4 (0.32%) Luigi
13 3 (0.24%) Cloud Foundry
13 3 (0.24%) OpenStack
13 3 (0.24%) Oracle Coherence
14 2 (0.16%) K2 blackpearl
14 2 (0.16%) SharePoint 2013
15 1 (0.081%) Gunicorn
15 1 (0.081%) Oracle SOA Suite
Applications
1 60 (4.85%) Microsoft Excel
2 46 (3.72%) MS Visio
3 3 (0.24%) Microsoft Office
3 3 (0.24%) Microsoft PowerPoint
3 3 (0.24%) SPSS
4 2 (0.16%) Chatbot
4 2 (0.16%) Spreadsheet
5 1 (0.081%) GNU Octave
5 1 (0.081%) InVision
5 1 (0.081%) Shockwave
Business Applications
1 12 (0.97%) SAP Oil and Gas
2 3 (0.24%) SAP MM
2 3 (0.24%) SAP R/3
3 2 (0.16%) ION MarketView
3 2 (0.16%) SAP ERP
3 2 (0.16%) Summit
4 1 (0.081%) Dynamics AX
4 1 (0.081%) Dynamics CRM
4 1 (0.081%) Dynamics NAV
4 1 (0.081%) Oracle BPM
4 1 (0.081%) SAP S/4HANA
Cloud Services
1 369 (29.83%) Amazon AWS
2 160 (12.93%) Microsoft Azure
3 91 (7.36%) Amazon S3
4 81 (6.55%) Google Cloud Platform
5 67 (5.42%) Amazon EC2
6 59 (4.77%) Amazon EMR
7 47 (3.80%) Virtual Private Cloud
8 40 (3.23%) GitHub
9 28 (2.26%) AWS CloudFormation
10 25 (2.02%) Serverless
11 23 (1.86%) Amazon Kinesis
12 20 (1.62%) AWS Lambda
13 19 (1.54%) PaaS
14 14 (1.13%) Cloud Computing
15 13 (1.05%) Azure Data Factory
15 13 (1.05%) SaaS
16 12 (0.97%) Heroku
17 8 (0.65%) IaaS
18 6 (0.49%) Akamai
19 5 (0.40%) Datadog
Communications & Networking
1 63 (5.09%) Kerberos
2 36 (2.91%) HTTP
3 30 (2.43%) Firewall
4 29 (2.34%) SSL
5 26 (2.10%) DNS
6 19 (1.54%) TCP/IP
7 15 (1.21%) VPN
8 12 (0.97%) FTP
9 9 (0.73%) Internet
10 7 (0.57%) HTTPS
10 7 (0.57%) RTMP
10 7 (0.57%) WAN
11 6 (0.49%) Network Security
12 5 (0.40%) SNA
13 4 (0.32%) DOCSIS
13 4 (0.32%) LAN
14 3 (0.24%) SAN
14 3 (0.24%) SMS
15 2 (0.16%) NAS
15 2 (0.16%) X.509
Database & Business Intelligence
1 797 (64.43%) Big Data
2 439 (35.49%) Apache Hive
3 247 (19.97%) HBase
4 188 (15.20%) NoSQL
5 185 (14.96%) SQL Server
6 159 (12.85%) MongoDB
7 152 (12.29%) Impala
8 137 (11.08%) Data Warehouse
9 131 (10.59%) Apache Cassandra
10 119 (9.62%) Sqoop
11 110 (8.89%) Relational Database
12 95 (7.68%) Data Lake
13 79 (6.39%) Power BI
14 76 (6.14%) PostgreSQL
15 55 (4.45%) Amazon Redshift
16 54 (4.37%) SQL Server Integration Services
17 45 (3.64%) RDBMS
18 40 (3.23%) MySQL
19 37 (2.99%) Data Mining
20 33 (2.67%) Presto
Development Applications
1 249 (20.13%) Jenkins
2 137 (11.08%) Git (software)
3 86 (6.95%) JIRA
4 80 (6.47%) Maven
5 47 (3.80%) Artifactory
6 39 (3.15%) Atlassian Bamboo
7 32 (2.59%) Hudson
8 29 (2.34%) Visual Studio Team System
9 21 (1.70%) Cucumber
10 18 (1.46%) Gradle
10 18 (1.46%) Subversion
11 17 (1.37%) GitLab
11 17 (1.37%) IntelliJ
11 17 (1.37%) TeamCity
12 16 (1.29%) JUnit
13 13 (1.05%) Sonatype Nexus
14 12 (0.97%) Eclipse
14 12 (0.97%) gulp
15 9 (0.73%) Gerrit
15 9 (0.73%) SoapUI
General
1 371 (29.99%) Finance
2 155 (12.53%) Banking
3 91 (7.36%) Front Office
4 46 (3.72%) Investment Banking
5 35 (2.83%) Retail
6 27 (2.18%) Legal
7 18 (1.46%) Games
7 18 (1.46%) Publishing
8 17 (1.37%) Marketing
9 14 (1.13%) Telecoms
10 10 (0.81%) Financial Institution
11 9 (0.73%) Advertising
11 9 (0.73%) Retail Banking
12 7 (0.57%) Back Office
12 7 (0.57%) Manufacturing
13 4 (0.32%) Electronics
14 2 (0.16%) Corporate Banking
15 1 (0.081%) Aerospace
15 1 (0.081%) Dutch Language
15 1 (0.081%) Pharmaceutical
Job Titles
1 307 (24.82%) Developer
2 277 (22.39%) Data Engineer
3 197 (15.93%) Big Data Engineer
4 147 (11.88%) Architect
5 135 (10.91%) Java Developer
6 130 (10.51%) Hadoop Engineer
7 117 (9.46%) Consultant
8 83 (6.71%) Data Architect
9 82 (6.63%) Big Data Developer
10 78 (6.31%) DevOps Engineer
11 76 (6.14%) AWS Engineer
12 67 (5.42%) Python Engineer
12 67 (5.42%) Senior Developer
13 66 (5.34%) DevOps Consultant
14 58 (4.69%) Data Scientist
15 57 (4.61%) Kubernetes Consultant
16 56 (4.53%) Software Engineer
17 55 (4.45%) Big Data Architect
18 54 (4.37%) Java Engineer
18 54 (4.37%) Platform Engineer
Libraries, Frameworks & Software Standards
1 425 (34.36%) Kafka
2 109 (8.81%) Web Services
3 91 (7.36%) REST
4 88 (7.11%) AngularJS
5 73 (5.90%) JSON
6 62 (5.01%) Spring
7 57 (4.61%) React
8 53 (4.28%) NumPy
9 52 (4.20%) Spring Boot
10 50 (4.04%) JSON Schema
11 48 (3.88%) RESTful
11 48 (3.88%) Spark Streaming
12 44 (3.56%) HTML
13 40 (3.23%) SciPy
14 34 (2.75%) .NET
15 32 (2.59%) Natural Language Processing
16 31 (2.51%) Elastic Stack
16 31 (2.51%) Hibernate
17 30 (2.43%) HTML5
17 30 (2.43%) PySpark
Miscellaneous
1 134 (10.83%) Greenfield Project
2 128 (10.35%) Algorithms
3 116 (9.38%) Analytical Skills
4 70 (5.66%) Computer Science
5 47 (3.80%) Wiki
6 34 (2.75%) Data Structures
7 33 (2.67%) Fintech
8 29 (2.34%) User Experience
9 23 (1.86%) Self-Motivation
10 16 (1.29%) Data Centre
10 16 (1.29%) HoloLens
11 15 (1.21%) Virtual Team
12 14 (1.13%) Derivative
13 12 (0.97%) Enterprise Software
13 12 (0.97%) Public Cloud
14 11 (0.89%) Fixed Income
15 10 (0.81%) Social Network
16 9 (0.73%) Market Risk
16 9 (0.73%) PKI
17 8 (0.65%) Equity Derivative
Operating Systems
1 243 (19.64%) Linux
2 132 (10.67%) Unix
3 60 (4.85%) Windows
4 26 (2.10%) Red Hat Enterprise Linux
5 7 (0.57%) CoreOS
6 6 (0.49%) CentOS
7 5 (0.40%) Android
8 2 (0.16%) Apple iOS
8 2 (0.16%) DC/OS
8 2 (0.16%) Ubuntu
9 1 (0.081%) AIX
9 1 (0.081%) Mac OS X
9 1 (0.081%) Mesosphere
9 1 (0.081%) Oracle Linux
9 1 (0.081%) Solaris
9 1 (0.081%) SUSE
9 1 (0.081%) SUSE Linux Enterprise Server
Processes & Methodologies
1 504 (40.74%) Agile Software Development
2 317 (25.63%) DevOps
3 279 (22.55%) Analytics
4 267 (21.58%) Data Science
5 205 (16.57%) Scrum
6 203 (16.41%) ETL
7 201 (16.25%) Business Intelligence
8 184 (14.87%) Machine Learning
9 169 (13.66%) Microservices
10 160 (12.93%) Data Modelling
11 140 (11.32%) TDD
12 134 (10.83%) Visualisation
13 133 (10.75%) Continuous Integration
14 105 (8.49%) MapReduce
15 103 (8.33%) Software Engineering
16 93 (7.52%) Open Source
17 92 (7.44%) Test Automation
18 90 (7.28%) Problem-Solving
19 88 (7.11%) Data Analysis
20 84 (6.79%) BDD
Programming Languages
1 566 (45.76%) Python
2 491 (39.69%) Java
3 400 (32.34%) SQL
4 286 (23.12%) Scala
5 134 (10.83%) Java 8
6 104 (8.41%) Bash Shell
7 99 (8.00%) R
8 92 (7.44%) Groovy
9 80 (6.47%) JavaScript
10 67 (5.42%) Shell Script
11 61 (4.93%) C++
12 59 (4.77%) PowerShell
13 45 (3.64%) Korn
14 43 (3.48%) C#
15 34 (2.75%) MATLAB
16 25 (2.02%) Ruby
17 24 (1.94%) C
18 23 (1.86%) Perl
18 23 (1.86%) TypeScript
19 15 (1.21%) T-SQL
Qualifications
1 102 (8.25%) Security Cleared
2 75 (6.06%) Degree
3 41 (3.31%) SC Cleared
4 40 (3.23%) AWS Certification
5 29 (2.34%) PhD
6 25 (2.02%) Computer Science Degree
7 19 (1.54%) Master's Degree
8 8 (0.65%) CISSP
9 6 (0.49%) CEH
10 5 (0.40%) SANS
11 4 (0.32%) CISM
11 4 (0.32%) DV Cleared
12 3 (0.24%) Numerate Degree
13 2 (0.16%) Microsoft Certification
13 2 (0.16%) PMI Certification
14 1 (0.081%) CCA
14 1 (0.081%) CCNA
14 1 (0.081%) Cisco Certification
14 1 (0.081%) ITIL Certification
14 1 (0.081%) PRINCE2 Certification
Quality Assurance & Compliance
1 71 (5.74%) Data Quality
2 36 (2.91%) QA
3 18 (1.46%) GDPR
4 7 (0.57%) ISO/IEC 27001
5 6 (0.49%) PMO
6 5 (0.40%) SLA
7 1 (0.081%) Dodd-Frank
7 1 (0.081%) EMIR
7 1 (0.081%) MiFID
7 1 (0.081%) PSD2
System Software
1 233 (18.84%) Docker
2 198 (16.01%) HDFS
3 77 (6.22%) Apache Flume
4 33 (2.67%) Apache ZooKeeper
5 25 (2.02%) Active Directory
6 2 (0.16%) LXC
6 2 (0.16%) NFS
7 1 (0.081%) Ceph
7 1 (0.081%) Cronacle
7 1 (0.081%) Lustre
7 1 (0.081%) OpenDJ
7 1 (0.081%) OpenIDM
7 1 (0.081%) vCloud
7 1 (0.081%) Veritas Cluster Server
7 1 (0.081%) Virtual Machines
7 1 (0.081%) VMware Infrastructure
7 1 (0.081%) vSphere
Systems Management
1 238 (19.24%) Ansible
2 177 (14.31%) Terraform
3 168 (13.58%) Kubernetes
4 157 (12.69%) Puppet
5 137 (11.08%) Hadoop YARN
6 132 (10.67%) Opscode Chef
7 109 (8.81%) Oozie
8 21 (1.70%) Ambari
9 20 (1.62%) Kibana
10 19 (1.54%) logstash
11 15 (1.21%) ITRS Geneos
12 14 (1.13%) Mesos
13 12 (0.97%) Docker Swarm
14 7 (0.57%) Control-M
15 6 (0.49%) ArcSight ESM
15 6 (0.49%) Marathon
15 6 (0.49%) Salt
15 6 (0.49%) Single Sign-On
15 6 (0.49%) Sysdig
16 5 (0.40%) Consul
Vendors
1 179 (14.47%) Cloudera
2 149 (12.05%) Oracle
3 107 (8.65%) Tableau
4 99 (8.00%) Hortonworks
5 90 (7.28%) Google
6 70 (5.66%) Microsoft
7 49 (3.96%) Informatica
8 38 (3.07%) SAP
9 37 (2.99%) Talend
10 34 (2.75%) Splunk
11 29 (2.34%) Alteryx
12 24 (1.94%) Teradata
13 23 (1.86%) MapR
14 22 (1.78%) Ab Initio
15 20 (1.62%) IBM
16 17 (1.37%) Red Hat
17 12 (0.97%) ArcSight
18 10 (0.81%) Cognos
19 9 (0.73%) Atlassian
19 9 (0.73%) HP