Period
to 19 November 2017

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 19 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
19 Nov 2017
Same period 2016 Same period 2015
Rank 55 56 102
Rank change year-on-year +1 +46 +47
Contract jobs citing Big Data 278 269 202
As % of all contract IT jobs advertised in the City of London 3.96% 4.04% 2.20%
As % of the Database & Business Intelligence category 16.22% 15.50% 8.46%
Number of daily rates quoted 243 213 173
City of London median daily rate £575 £575 £550
Median daily rate % change year-on-year - +4.55% +4.76%
10th Percentile £450 £413 £352
90th Percentile £725 £713 £725
Central London median daily rate £575 £575 £550
% change year-on-year - +4.55% +4.76%
Number of hourly rates quoted 0 0 1
City of London median hourly rate - - £37.50
Central London median hourly rate - - £37.50

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1714 1736 2389
As % of all contract IT jobs advertised in the City of London 24.40% 26.10% 26.01%
Number of daily rates quoted 1391 1382 1915
City of London median daily rate £525 £475 £463
Median daily rate % change year-on-year +10.53% +2.70% +6.32%
10th Percentile £363 £325 £313
90th Percentile £688 £675 £638
Central London median daily rate £525 £475 £450
% change year-on-year +10.53% +5.56% +5.88%
Number of hourly rates quoted 11 1 9
City of London median hourly rate £27.50 £45.00 £25.00
Median hourly rate % change year-on-year -38.89% +80.00% -18.88%
10th Percentile £20.75 £42.50 £16.25
90th Percentile £33.25 £47.50 £70.75
Central London median hourly rate £25.99 £45.00 £21.98
% change year-on-year -42.24% +104.78% -25.46%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 19 November 2017.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 19 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 1 £550 -
London Bridge - 1 £450 -
Big Data
Central London

For the 6 months to 19 November 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region with a requirement for Big Data.

1 168 (60.43%) Hadoop
2 153 (55.04%) Java
3 146 (52.52%) Apache Spark
4 119 (42.81%) Agile Software Development
5 96 (34.53%) Apache Hive
6 95 (34.17%) Python
7 87 (31.29%) Finance
8 76 (27.34%) Banking
8 76 (27.34%) Kafka
9 75 (26.98%) DevOps
10 71 (25.54%) HDFS
10 71 (25.54%) SQL
11 68 (24.46%) HBase
12 66 (23.74%) Scala
13 63 (22.66%) TDD
14 59 (21.22%) MapReduce
15 55 (19.78%) Amazon AWS
16 53 (19.06%) Analytics
17 51 (18.35%) Apache Flume
17 51 (18.35%) Oozie
18 48 (17.27%) Jenkins
19 45 (16.19%) Data Modelling
20 43 (15.47%) Oracle
20 43 (15.47%) BDD
20 43 (15.47%) NoSQL
21 41 (14.75%) MongoDB
22 39 (14.03%) Open Source
23 38 (13.67%) Apache
24 33 (11.87%) Linux
24 33 (11.87%) Data Engineering

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 146 (52.52%) Apache Spark
2 38 (13.67%) Apache
3 24 (8.63%) Elasticsearch
4 15 (5.40%) Apache Pig
5 9 (3.24%) Confluence
6 8 (2.88%) SAS
7 7 (2.52%) Apache Solr
8 3 (1.08%) JBoss
8 3 (1.08%) OpenStack
8 3 (1.08%) Oracle Coherence
9 2 (0.72%) Tomcat
10 1 (0.36%) CICS
10 1 (0.36%) nginx
10 1 (0.36%) WebLogic
Applications
1 5 (1.80%) Microsoft Excel
2 2 (0.72%) Microsoft PowerPoint
2 2 (0.72%) MS Visio
3 1 (0.36%) Microsoft Office
3 1 (0.36%) SPSS
3 1 (0.36%) Weka
Business Applications
1 1 (0.36%) Bloomberg TOMS
1 1 (0.36%) Eagle PACE
1 1 (0.36%) WebTrends
Cloud Services
1 55 (19.78%) Amazon AWS
2 19 (6.83%) GitHub
3 15 (5.40%) Bluemix
3 15 (5.40%) IBM Cloud
4 10 (3.60%) Microsoft Azure
5 5 (1.80%) Virtual Private Cloud
6 4 (1.44%) Amazon EC2
6 4 (1.44%) Amazon S3
6 4 (1.44%) Cloud Computing
6 4 (1.44%) PaaS
6 4 (1.44%) SaaS
7 3 (1.08%) AWS CloudFormation
7 3 (1.08%) Google Cloud Platform
8 2 (0.72%) Amazon CloudWatch
9 1 (0.36%) Amazon ELB
9 1 (0.36%) Google Analytics
9 1 (0.36%) Google Tag Manager
9 1 (0.36%) IaaS
9 1 (0.36%) Route 53
9 1 (0.36%) Serverless
Communications & Networking
1 3 (1.08%) HTTP
2 2 (0.72%) DSL
2 2 (0.72%) Internet
2 2 (0.72%) Kerberos
2 2 (0.72%) Network Security
2 2 (0.72%) SSL
3 1 (0.36%) HTTPS
3 1 (0.36%) LDAP
Database & Business Intelligence
1 168 (60.43%) Hadoop
2 96 (34.53%) Apache Hive
3 68 (24.46%) HBase
4 43 (15.47%) NoSQL
5 41 (14.75%) MongoDB
6 31 (11.15%) Impala
6 31 (11.15%) PostgreSQL
7 30 (10.79%) Data Warehouse
8 29 (10.43%) Apache Cassandra
9 28 (10.07%) Sqoop
10 21 (7.55%) Relational Database
11 18 (6.47%) RDBMS
12 15 (5.40%) Oracle ODI
13 11 (3.96%) Oracle Database
14 8 (2.88%) SQL Server
15 6 (2.16%) MySQL
16 5 (1.80%) Data Lake
16 5 (1.80%) Qlik Sense
16 5 (1.80%) QlikView
17 3 (1.08%) Spark SQL
Development Applications
1 48 (17.27%) Jenkins
2 26 (9.35%) Git (software)
3 23 (8.27%) JIRA
4 13 (4.68%) Cucumber
5 12 (4.32%) Maven
6 5 (1.80%) Selenium
6 5 (1.80%) SonarQube
6 5 (1.80%) TeamCity
7 4 (1.44%) Appium
7 4 (1.44%) LoadRunner
7 4 (1.44%) Subversion
8 3 (1.08%) Ant
8 3 (1.08%) Build Forge
8 3 (1.08%) Octopus Deploy
9 2 (0.72%) Artifactory
9 2 (0.72%) Eclipse
9 2 (0.72%) JUnit
9 2 (0.72%) Mockito
9 2 (0.72%) MSBuild
9 2 (0.72%) WebDriver
General
1 87 (31.29%) Finance
2 76 (27.34%) Banking
3 31 (11.15%) Investment Banking
4 14 (5.04%) Front Office
5 7 (2.52%) Financial Institution
5 7 (2.52%) Marketing
5 7 (2.52%) Publishing
6 6 (2.16%) Advertising
7 4 (1.44%) Legal
7 4 (1.44%) Retail
8 3 (1.08%) Wholesale Banking
9 2 (0.72%) Back Office
9 2 (0.72%) Electronics
9 2 (0.72%) Manufacturing
9 2 (0.72%) Telecoms
10 1 (0.36%) Corporate Banking
10 1 (0.36%) French Language
10 1 (0.36%) Retail Banking
Job Titles
1 102 (36.69%) Developer
2 42 (15.11%) Big Data Developer
3 38 (13.67%) Java Developer
4 37 (13.31%) Scala Developer
5 28 (10.07%) Data Engineer
6 25 (8.99%) Java Engineer
7 21 (7.55%) Hadoop Engineer
8 19 (6.83%) Big Data Engineer
9 18 (6.47%) Architect
10 17 (6.12%) Analyst
11 14 (5.04%) Data Scientist
11 14 (5.04%) Senior Hadoop Engineer
11 14 (5.04%) Senior Java Engineer
12 13 (4.68%) Java Scala Developer
12 13 (4.68%) Senior Developer
13 12 (4.32%) Apache Spark Developer
13 12 (4.32%) Data Architect
13 12 (4.32%) DevOps Engineer
14 10 (3.60%) Hadoop Developer
14 10 (3.60%) Salesforce Developer
Libraries, Frameworks & Software Standards
1 76 (27.34%) Kafka
2 29 (10.43%) PySpark
3 24 (8.63%) Web Services
4 23 (8.27%) Akka
5 22 (7.91%) JSON
6 20 (7.19%) RESTful
7 19 (6.83%) AngularJS
8 18 (6.47%) REST
9 13 (4.68%) React
10 12 (4.32%) Spring
11 9 (3.24%) Hibernate
12 8 (2.88%) Gherkin
12 8 (2.88%) JPA
12 8 (2.88%) Redux
12 8 (2.88%) Twitter Bootstrap
13 7 (2.52%) HTML
13 7 (2.52%) Samza
13 7 (2.52%) XML
14 6 (2.16%) CSS
14 6 (2.16%) OpenCL
Miscellaneous
1 30 (10.79%) Analytical Skills
2 14 (5.04%) Algorithms
3 12 (4.32%) Market Risk
4 11 (3.96%) Reference Data
5 10 (3.60%) Greenfield Project
5 10 (3.60%) User Experience
6 9 (3.24%) Virtual Team
7 7 (2.52%) Computer Science
7 7 (2.52%) Derivative
7 7 (2.52%) Hedge funds
8 6 (2.16%) Data Centre
8 6 (2.16%) Mobile App
9 5 (1.80%) Credit Risk
9 5 (1.80%) Mobile Banking
10 4 (1.44%) Fixed Income
10 4 (1.44%) Foreign Exchange (FX)
10 4 (1.44%) PDA
10 4 (1.44%) Semantic Web
11 3 (1.08%) Linked Data
11 3 (1.08%) Management Information System
Operating Systems
1 33 (11.87%) Linux
2 20 (7.19%) Unix
3 9 (3.24%) Windows
4 5 (1.80%) CentOS
5 4 (1.44%) Android
5 4 (1.44%) Apple iOS
5 4 (1.44%) Ubuntu
6 1 (0.36%) AIX
6 1 (0.36%) Red Hat Enterprise Linux
6 1 (0.36%) Solaris
Processes & Methodologies
1 119 (42.81%) Agile Software Development
2 75 (26.98%) DevOps
3 63 (22.66%) TDD
4 59 (21.22%) MapReduce
5 53 (19.06%) Analytics
6 45 (16.19%) Data Modelling
7 43 (15.47%) BDD
8 39 (14.03%) Open Source
9 33 (11.87%) Data Engineering
10 27 (9.71%) Scrum
11 26 (9.35%) Visualisation
12 25 (8.99%) Test Automation
13 23 (8.27%) Business Intelligence
13 23 (8.27%) Multithreading
14 20 (7.19%) ETL
14 20 (7.19%) SDLC
15 19 (6.83%) Continuous Integration
16 18 (6.47%) Data Analytics
16 18 (6.47%) Data Visualisation
16 18 (6.47%) Machine Learning
Programming Languages
1 153 (55.04%) Java
2 95 (34.17%) Python
3 71 (25.54%) SQL
4 66 (23.74%) Scala
5 21 (7.55%) JavaScript
5 21 (7.55%) R
6 19 (6.83%) Shell Script
7 12 (4.32%) Bash Shell
7 12 (4.32%) PL/SQL
8 7 (2.52%) C#
9 6 (2.16%) PowerShell
10 5 (1.80%) Groovy
10 5 (1.80%) SPARQL
11 4 (1.44%) Ruby
12 3 (1.08%) COBOL
13 1 (0.36%) C
13 1 (0.36%) C++
13 1 (0.36%) T-SQL
13 1 (0.36%) VBA
13 1 (0.36%) XAML
Qualifications
1 10 (3.60%) Security Cleared
2 9 (3.24%) Degree
3 5 (1.80%) SC Cleared
4 3 (1.08%) Computer Science Degree
4 3 (1.08%) DV Cleared
5 2 (0.72%) Numerate Degree
5 2 (0.72%) PhD
6 1 (0.36%) CFA
6 1 (0.36%) Master's Degree
6 1 (0.36%) PMP
Quality Assurance & Compliance
1 10 (3.60%) QA
2 6 (2.16%) Data Quality
3 1 (0.36%) GCP
3 1 (0.36%) IFRS
3 1 (0.36%) IFRS 9
3 1 (0.36%) MiFID
System Software
1 71 (25.54%) HDFS
2 51 (18.35%) Apache Flume
3 32 (11.51%) Docker
4 12 (4.32%) Apache ZooKeeper
Systems Management
1 51 (18.35%) Oozie
2 27 (9.71%) Ambari
3 25 (8.99%) Hadoop YARN
4 24 (8.63%) Ansible
5 20 (7.19%) Kubernetes
6 12 (4.32%) Puppet
6 12 (4.32%) Terraform
7 6 (2.16%) Opscode Chef
8 5 (1.80%) Mesos
9 2 (0.72%) Control-M
9 2 (0.72%) Graphite
9 2 (0.72%) Kibana
9 2 (0.72%) Rundeck
10 1 (0.36%) Apache Slider
10 1 (0.36%) BladeLogic
10 1 (0.36%) Grafana
10 1 (0.36%) logstash
10 1 (0.36%) Packer
10 1 (0.36%) Rsyslog
10 1 (0.36%) ZABBIX
Vendors
1 43 (15.47%) Oracle
2 28 (10.07%) Tableau
3 17 (6.12%) IBM
4 16 (5.76%) Cloudera
5 13 (4.68%) Salesforce.com
6 8 (2.88%) Google
7 6 (2.16%) Hortonworks
7 6 (2.16%) Teradata
8 4 (1.44%) HP
8 4 (1.44%) Microsoft
9 3 (1.08%) Informatica
9 3 (1.08%) SaltStack
9 3 (1.08%) SAP
9 3 (1.08%) Splunk
10 2 (0.72%) Alteryx
10 2 (0.72%) MapR
10 2 (0.72%) Palantir
10 2 (0.72%) Red Hat
10 2 (0.72%) TIBCO
10 2 (0.72%) Vertica