Period
to 25 April 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 25 April 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Hadoop
England > London
6 months to
25 Apr 2019
Same period 2018 Same period 2017
Rank 104 88 73
Rank change year-on-year -16 -15 +46
Contract jobs citing Hadoop 1,037 1,278 1,329
As % of all contract IT jobs advertised in London 2.47% 2.78% 3.34%
As % of the Database & Business Intelligence category 10.12% 11.32% 13.58%
Number of daily rates quoted 721 965 920
London median daily rate £575 £550 £550
Median daily rate % change year-on-year +4.55% - -
10th Percentile £475 £425 £400
90th Percentile £725 £691 £688
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -4.55%
Number of hourly rates quoted 3 2 1
London median hourly rate £35.00 £101.25 £100.00
Median hourly rate % change year-on-year -65.43% +1.25% -
10th Percentile £32.50 £77.88 £90.00
90th Percentile £53.50 £121.63 £110.00
England median hourly rate £49.13 £41.25 £47.00
% change year-on-year +19.10% -12.23% +23.68%

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 10,252 11,286 9,790
As % of all contract IT jobs advertised in London 24.45% 24.51% 24.62%
Number of daily rates quoted 7,461 8,508 7,054
London median daily rate £525 £513 £485
Median daily rate % change year-on-year +2.44% +5.67% +2.11%
10th Percentile £363 £356 £325
90th Percentile £675 £663 £650
England median daily rate £488 £475 £450
% change year-on-year +2.63% +5.56% +5.88%
Number of hourly rates quoted 52 85 40
London median hourly rate £35.00 £30.00 £34.50
Median hourly rate % change year-on-year +16.67% -13.04% +32.69%
10th Percentile £20.00 £19.05 £16.53
90th Percentile £56.50 £44.92 £47.63
England median hourly rate £35.00 £32.50 £29.00
% change year-on-year +7.69% +12.07% +11.54%

Hadoop
Job Vacancy Trend in London

Job postings citing Hadoop as a percentage of all IT jobs advertised in London.

Job vacancy trend for Hadoop in London

Hadoop
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Hadoop in London.

Contractor daily rate trend for Hadoop in London

Hadoop
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Hadoop in London over the 6 months to 25 April 2019.

Contractor daily rate histogram for Hadoop in London

Hadoop
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Hadoop in London.

Contractor hourly rate trend for Hadoop in London

Hadoop
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Hadoop in London over the 6 months to 25 April 2019.

Contractor hourly rate histogram for Hadoop in London

Hadoop
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the London region over the 6 months to 25 April 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +9 240 £550 - 26
East London +21 106 £525 -6.67% 1
South London -24 50 £635 +15.45% 1
West London +22 18 £500 -9.09% 5
North London 0 10 £700 +131.40%
Hadoop
England

For the 6 months to 25 April 2019, IT contractor jobs citing Hadoop also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Hadoop.

1 714 (68.85%) Big Data
2 582 (56.12%) Apache Spark
3 560 (54.00%) Python
4 390 (37.61%) Apache Hive
5 385 (37.13%) Amazon AWS
6 370 (35.68%) Kafka
7 354 (34.14%) SQL
8 325 (31.34%) Analytics
9 320 (30.86%) Data Science
10 311 (29.99%) Java
11 282 (27.19%) Finance
11 282 (27.19%) Agile Software Development
12 244 (23.53%) Machine Learning
13 233 (22.47%) DevOps
14 209 (20.15%) Scala
15 196 (18.90%) Microsoft Azure
16 188 (18.13%) HBase
17 186 (17.94%) Linux
18 184 (17.74%) Data Modelling
19 173 (16.68%) Data Warehouse
20 172 (16.59%) Docker
21 169 (16.30%) ETL
22 156 (15.04%) NoSQL
23 152 (14.66%) Cloudera
24 144 (13.89%) HDFS
25 139 (13.40%) Google Cloud Platform
26 136 (13.11%) Kubernetes
27 135 (13.02%) Hortonworks
28 130 (12.54%) Business Intelligence
29 126 (12.15%) R

Hadoop
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 582 (56.12%) Apache Spark
2 79 (7.62%) Apache
3 77 (7.43%) Elasticsearch
4 50 (4.82%) SAS
5 47 (4.53%) Confluence
6 39 (3.76%) Apache Solr
7 38 (3.66%) Apache Pig
8 17 (1.64%) Apache Airflow
9 15 (1.45%) Jupyter
10 10 (0.96%) Cloud Foundry
10 10 (0.96%) Luigi
11 9 (0.87%) SharePoint
12 7 (0.68%) nginx
13 1 (0.096%) JBoss
13 1 (0.096%) OpenStack
13 1 (0.096%) Oracle SOA Suite
13 1 (0.096%) Tomcat
Applications
1 12 (1.16%) Microsoft Excel
2 7 (0.68%) Microsoft PowerPoint
3 6 (0.58%) Chatbot
4 4 (0.39%) MS Visio
5 3 (0.29%) Microsoft Office
5 3 (0.29%) SPSS
6 2 (0.19%) Stata
7 1 (0.096%) iWork
Business Applications
1 20 (1.93%) SAP Oil and Gas
2 4 (0.39%) SAP ERP
2 4 (0.39%) SAP S/4HANA
3 1 (0.096%) Dynamics NAV
3 1 (0.096%) Eloqua
3 1 (0.096%) Oracle Retail
3 1 (0.096%) Summit
Cloud Services
1 385 (37.13%) Amazon AWS
2 196 (18.90%) Microsoft Azure
3 139 (13.40%) Google Cloud Platform
4 92 (8.87%) Amazon EMR
5 54 (5.21%) Serverless
6 52 (5.01%) Amazon S3
7 35 (3.38%) Azure Data Factory
8 32 (3.09%) Amazon Kinesis
9 29 (2.80%) AWS Lambda
10 26 (2.51%) Amazon EC2
11 24 (2.31%) GitHub
12 18 (1.74%) Data Lake Analytics
12 18 (1.74%) SaaS
13 17 (1.64%) AWS CloudFormation
14 16 (1.54%) Datadog
15 13 (1.25%) Amazon CloudWatch
15 13 (1.25%) Cloud Computing
15 13 (1.25%) Heroku
15 13 (1.25%) PaaS
16 10 (0.96%) Virtual Private Cloud
Communications & Networking
1 32 (3.09%) Kerberos
2 18 (1.74%) DNS
3 17 (1.64%) TCP/IP
4 16 (1.54%) VPN
5 13 (1.25%) Firewall
6 11 (1.06%) SSL
7 10 (0.96%) Internet
8 9 (0.87%) HTTP
9 8 (0.77%) FTP
10 3 (0.29%) ICMP
10 3 (0.29%) OpenLDAP
11 2 (0.19%) Network Security
Database & Business Intelligence
1 714 (68.85%) Big Data
2 390 (37.61%) Apache Hive
3 188 (18.13%) HBase
4 173 (16.68%) Data Warehouse
5 156 (15.04%) NoSQL
6 120 (11.57%) Data Lake
7 118 (11.38%) MongoDB
8 113 (10.90%) Apache Cassandra
9 90 (8.68%) SQL Server
10 84 (8.10%) Relational Database
11 73 (7.04%) Impala
12 70 (6.75%) PostgreSQL
13 63 (6.08%) Amazon Redshift
14 62 (5.98%) Power BI
15 59 (5.69%) Data Mining
16 48 (4.63%) Redis
17 47 (4.53%) Enterprise Data Warehouse
18 46 (4.44%) OLAP
18 46 (4.44%) Star Schema
19 43 (4.15%) OLAP Cube
Development Applications
1 114 (10.99%) Jenkins
2 113 (10.90%) Git (software)
3 62 (5.98%) JIRA
4 38 (3.66%) Visual Studio Team System
5 33 (3.18%) Maven
6 29 (2.80%) Sonatype Nexus
7 22 (2.12%) Cucumber
8 17 (1.64%) GitLab
8 17 (1.64%) Gradle
8 17 (1.64%) RStudio
8 17 (1.64%) Subversion
9 16 (1.54%) JUnit
10 14 (1.35%) Atlassian Bamboo
10 14 (1.35%) Visual Studio
11 13 (1.25%) Artifactory
11 13 (1.25%) TeamCity
12 10 (0.96%) IBM UrbanCode
13 9 (0.87%) FishEye
13 9 (0.87%) IntelliJ
14 8 (0.77%) TestNG
General
1 282 (27.19%) Finance
2 122 (11.76%) Banking
3 62 (5.98%) Retail
4 45 (4.34%) Front Office
5 42 (4.05%) Marketing
6 27 (2.60%) Investment Banking
7 25 (2.41%) Legal
8 10 (0.96%) Financial Institution
9 9 (0.87%) Telecoms
10 8 (0.77%) Publishing
11 6 (0.58%) Advertising
12 5 (0.48%) General Ledger
13 4 (0.39%) Games
14 3 (0.29%) Back Office
14 3 (0.29%) Manufacturing
14 3 (0.29%) Retail Banking
15 2 (0.19%) Aerospace
15 2 (0.19%) Electronics
15 2 (0.19%) Pharmaceutical
15 2 (0.19%) Social Science
Job Titles
1 348 (33.56%) Data Engineer
2 194 (18.71%) Developer
3 171 (16.49%) Big Data Engineer
4 130 (12.54%) Hadoop Engineer
5 121 (11.67%) Architect
6 109 (10.51%) Data Scientist
7 99 (9.55%) DevOps Engineer
8 93 (8.97%) Java Developer
9 82 (7.91%) Python Engineer
10 71 (6.85%) Data Architect
11 66 (6.36%) AWS Engineer
12 61 (5.88%) Big Data Developer
13 44 (4.24%) Administrator
14 42 (4.05%) Analyst
15 41 (3.95%) AWS DevOps
16 40 (3.86%) Hadoop Administrator
17 38 (3.66%) Senior Developer
18 37 (3.57%) AWS DevOps Engineer
18 37 (3.57%) Big Data Architect
18 37 (3.57%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 370 (35.68%) Kafka
2 76 (7.33%) PySpark
3 62 (5.98%) Spring
4 58 (5.59%) TensorFlow
5 53 (5.11%) Web Services
6 47 (4.53%) RESTful
7 46 (4.44%) REST
8 41 (3.95%) Spring Boot
9 34 (3.28%) Apache NiFi
9 34 (3.28%) Natural Language Processing
9 34 (3.28%) Spark Streaming
10 32 (3.09%) HTML
11 31 (2.99%) AngularJS
12 29 (2.80%) HTML5
13 28 (2.70%) Elastic Stack
14 23 (2.22%) JSON
14 23 (2.22%) Theano
15 22 (2.12%) React
15 22 (2.12%) SOAP
16 21 (2.03%) Anaconda
Miscellaneous
1 126 (12.15%) Analytical Skills
2 114 (10.99%) Algorithms
3 93 (8.97%) Greenfield Project
4 36 (3.47%) Fintech
5 24 (2.31%) Data Structures
6 21 (2.03%) Credit Risk
7 19 (1.83%) Market Risk
8 17 (1.64%) Self-Motivation
9 15 (1.45%) User Experience
10 13 (1.25%) Hedge funds
10 13 (1.25%) Public Cloud
11 12 (1.16%) Cloud Native
12 11 (1.06%) HoloLens
13 9 (0.87%) Grid Computing
13 9 (0.87%) Replication
14 8 (0.77%) Linux Command Line
15 6 (0.58%) Virtual Team
16 5 (0.48%) Management Information System
16 5 (0.48%) Robotics
17 4 (0.39%) Life Science
Operating Systems
1 186 (17.94%) Linux
2 75 (7.23%) Unix
3 36 (3.47%) Red Hat Enterprise Linux
4 23 (2.22%) Windows
5 4 (0.39%) Solaris
6 3 (0.29%) Android
6 3 (0.29%) Apple iOS
6 3 (0.29%) CentOS
7 2 (0.19%) CoreOS
7 2 (0.19%) Debian
7 2 (0.19%) Ubuntu
8 1 (0.096%) Mesosphere
Processes & Methodologies
1 325 (31.34%) Analytics
2 320 (30.86%) Data Science
3 282 (27.19%) Agile Software Development
4 244 (23.53%) Machine Learning
5 233 (22.47%) DevOps
6 184 (17.74%) Data Modelling
7 169 (16.30%) ETL
8 130 (12.54%) Business Intelligence
9 123 (11.86%) Visualisation
10 99 (9.55%) Microservices
11 92 (8.87%) Open Source
12 87 (8.39%) Deep Learning
13 83 (8.00%) TDD
14 80 (7.71%) Data Analysis
15 78 (7.52%) Problem-Solving
16 77 (7.43%) Software Engineering
17 73 (7.04%) Artificial Intelligence
18 71 (6.85%) Computer Science
18 71 (6.85%) Data Analytics
19 70 (6.75%) MapReduce
Programming Languages
1 560 (54.00%) Python
2 354 (34.14%) SQL
3 311 (29.99%) Java
4 209 (20.15%) Scala
5 126 (12.15%) R
6 70 (6.75%) Java 8
7 55 (5.30%) JavaScript
8 37 (3.57%) C#
8 37 (3.57%) MATLAB
9 31 (2.99%) C++
10 26 (2.51%) Bash Shell
11 25 (2.41%) Shell Script
12 22 (2.12%) Perl
12 22 (2.12%) T-SQL
13 15 (1.45%) C
13 15 (1.45%) Go
13 15 (1.45%) Groovy
13 15 (1.45%) Ruby
14 11 (1.06%) PowerShell
14 11 (1.06%) VBA
Qualifications
1 103 (9.93%) Degree
2 85 (8.20%) Security Cleared
3 67 (6.46%) SC Cleared
4 63 (6.08%) Master's Degree
5 49 (4.73%) PhD
6 22 (2.12%) RHCE
7 17 (1.64%) Computer Science Degree
8 10 (0.96%) DV Cleared
9 7 (0.68%) TOGAF Certification
10 6 (0.58%) Numerate Degree
11 5 (0.48%) AWS Certification
12 4 (0.39%) CFA
12 4 (0.39%) ITIL Foundation Certificate
13 3 (0.29%) MBA
14 2 (0.19%) CEH
14 2 (0.19%) CISA
14 2 (0.19%) CISM
14 2 (0.19%) CISSP
14 2 (0.19%) GIAC
14 2 (0.19%) Postgraduate
Quality Assurance & Compliance
1 67 (6.46%) Data Quality
2 13 (1.25%) QA
3 7 (0.68%) GDPR
4 2 (0.19%) Actionable Recommendations
4 2 (0.19%) Dodd-Frank
4 2 (0.19%) EMIR
4 2 (0.19%) ISO/IEC 27001
4 2 (0.19%) MiFID
4 2 (0.19%) Sarbanes-Oxley
4 2 (0.19%) SLA
5 1 (0.096%) PSD2
System Software
1 172 (16.59%) Docker
2 144 (13.89%) HDFS
3 78 (7.52%) Apache Flume
4 20 (1.93%) Apache ZooKeeper
5 16 (1.54%) Oracle RAC
6 12 (1.16%) VMware Infrastructure
7 11 (1.06%) vCloud
8 3 (0.29%) Active Directory
9 2 (0.19%) etcd
9 2 (0.19%) flannel
10 1 (0.096%) Hyper-V
10 1 (0.096%) NFS
Systems Management
1 136 (13.11%) Kubernetes
2 118 (11.38%) Ansible
3 94 (9.06%) Terraform
4 81 (7.81%) Hadoop YARN
5 75 (7.23%) Oozie
6 62 (5.98%) Puppet
7 34 (3.28%) Opscode Chef
8 20 (1.93%) logstash
9 18 (1.74%) Kibana
10 14 (1.35%) Ambari
11 11 (1.06%) ZABBIX
12 8 (0.77%) Docker Swarm
12 8 (0.77%) Tivoli
13 7 (0.68%) Grafana
13 7 (0.68%) Nagios
14 6 (0.58%) Consul
14 6 (0.58%) Prometheus
15 5 (0.48%) Sysdig
16 4 (0.39%) Marathon
16 4 (0.39%) Mesos
Vendors
1 152 (14.66%) Cloudera
2 135 (13.02%) Hortonworks
3 124 (11.96%) Google
4 90 (8.68%) Oracle
5 83 (8.00%) Microsoft
6 82 (7.91%) Tableau
7 55 (5.30%) Talend
8 50 (4.82%) Databricks
9 31 (2.99%) Alteryx
9 31 (2.99%) SAP
10 30 (2.89%) Red Hat
11 29 (2.80%) Splunk
12 27 (2.60%) Informatica
13 18 (1.74%) IBM
14 17 (1.64%) Teradata
15 16 (1.54%) MapR
16 14 (1.35%) Qualys
17 13 (1.25%) Atlassian
18 12 (1.16%) SaltStack
18 12 (1.16%) VMware