The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 3 months to 28 June 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
London / City of London
3 months to
28 Jun 2017
Same period 2016 Same period 2015
Rank 51 91 89
Rank change year-on-year +40 -2  
Contract jobs citing Big Data 140 76 122
As % of all contract IT jobs advertised in the City of London 4.29% 2.26% 2.13%
As % of the Database & Business Intelligence category 16.75% 9.35% 8.27%
Number of daily rates quoted 116 60 101
Median daily rate £556 £531 £575
Median daily rate % change year-on-year +4.70% -7.60%  
90% offered a daily rate of more than £450 £423 £413
10% offered a daily rate of more than £725 £755 £700
UK excluding London median daily rate £441 £450 £475
% change year-on-year -1.94% -5.26%  
Number of hourly rates quoted 0 0 0
Median hourly rate - - -
UK excluding London median hourly rate £50.00 £42.65 £16.00
% change year-on-year +17.23% +166.56%  

Big Data is in the database and business intelligence skills category. The next table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database and business intelligence skills.

Contract Database & Business Intelligence Skills
City of London
Contract job vacancies with a requirement for database and business intelligence skills 836 813 1475
As % of all contract IT job vacancies advertised in the City of London 25.62% 24.15% 25.69%
Number of daily rates quoted 652 648 1171
Median daily rate £503 £475 £450
Median daily rate % change year-on-year +5.78% +5.55%  
90% offered a daily rate of more than £388 £340 £325
10% offered a daily rate of more than £650 £625 £600
UK excluding London median daily rate £400 £375 £350
% change year-on-year +6.66% +7.14%  
Number of hourly rates quoted 2 4 7
Median hourly rate £21.50 £17.88 £30.00
Median hourly rate % change year-on-year +20.27% -40.41%  
UK excluding London median hourly rate £38.00 £31.14 £26.00
% change year-on-year +22.04% +19.75%  

Big Data
Job Vacancy Trend in the City of London

The job posting trend of jobs advertised in the City of London citing Big Data as a proportion of all contract or permanent IT jobs with a match in the Database & Business Intelligence category.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 3 months to 28 June 2017.

Contractor daily rate histogram for Big Data in the City of London

For the 6 months to 28 June 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region with a requirement for Big Data.

1 148 (54.61%) Hadoop
2 132 (48.71%) Java
3 105 (38.75%) Agile Software Development
4 99 (36.53%) Apache Spark
5 95 (35.06%) Python
6 82 (30.26%) Finance
7 67 (24.72%) Linux
8 65 (23.99%) Analytics
9 64 (23.62%) SQL
10 63 (23.25%) DevOps
11 61 (22.51%) Banking
12 55 (20.30%) Apache Hive
13 52 (19.19%) Scala
14 43 (15.87%) Amazon AWS
15 42 (15.50%) TDD
16 39 (14.39%) Apache Cassandra
17 38 (14.02%) Unix
17 38 (14.02%) E-Commerce
18 36 (13.28%) Scrum
19 34 (12.55%) NoSQL
20 33 (12.18%) R
21 31 (11.44%) Open Source
22 30 (11.07%) ETL
23 29 (10.70%) Business Intelligence
24 28 (10.33%) Apache
24 28 (10.33%) Investment Banking
24 28 (10.33%) Kafka
25 27 (9.96%) HBase
25 27 (9.96%) Tableau
25 27 (9.96%) Spring

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 99 (36.53%) Apache Spark
2 28 (10.33%) Apache
3 19 (7.01%) Apache Pig
4 8 (2.95%) Confluence
4 8 (2.95%) Elasticsearch
4 8 (2.95%) SAS
5 7 (2.58%) Apache Solr
6 3 (1.11%) Oracle SOA Suite
7 2 (0.74%) JBoss
7 2 (0.74%) Mule
7 2 (0.74%) OpenStack
8 1 (0.37%) Adobe Experience Manager
8 1 (0.37%) CICS
8 1 (0.37%) CMS
8 1 (0.37%) EPiServer
8 1 (0.37%) Facebook Platform
8 1 (0.37%) nginx
8 1 (0.37%) Oracle Coherence
8 1 (0.37%) Sitecore CMS
8 1 (0.37%) WebSphere
Applications
1 5 (1.85%) Microsoft Excel
2 2 (0.74%) Microsoft PowerPoint
2 2 (0.74%) MS Visio
2 2 (0.74%) S-PLUS
2 2 (0.74%) Spreadsheet
3 1 (0.37%) Microsoft Office
3 1 (0.37%) SPSS
Business Applications
1 1 (0.37%) Bloomberg TOMS
1 1 (0.37%) Eagle PACE
1 1 (0.37%) Eloqua
1 1 (0.37%) NetSuite
1 1 (0.37%) RMDS
1 1 (0.37%) SAP Oil and Gas
1 1 (0.37%) SessionCam
1 1 (0.37%) Social Studio
1 1 (0.37%) thinkFolio
Cloud Services
1 43 (15.87%) Amazon AWS
2 16 (5.90%) Virtual Private Cloud
3 11 (4.06%) Amazon EMR
4 8 (2.95%) Google Analytics
4 8 (2.95%) Microsoft Azure
5 7 (2.58%) GitHub
5 7 (2.58%) Google Cloud Platform
6 5 (1.85%) Cloud Computing
7 4 (1.48%) Amazon EC2
7 4 (1.48%) Amazon S3
8 3 (1.11%) PaaS
9 2 (0.74%) Amazon CloudWatch
9 2 (0.74%) Bluemix
9 2 (0.74%) IBM Cloud
9 2 (0.74%) Salesforce Service Cloud
10 1 (0.37%) Azure Data Factory
10 1 (0.37%) Azure Machine Learning
10 1 (0.37%) Data Lake Analytics
10 1 (0.37%) Heroku
10 1 (0.37%) iPaaS
Communications & Networking
1 4 (1.48%) HTTP
1 4 (1.48%) Kerberos
2 3 (1.11%) TCP/IP
3 2 (0.74%) DNS
3 2 (0.74%) DSL
3 2 (0.74%) LDAP
3 2 (0.74%) SSL
3 2 (0.74%) WAN
4 1 (0.37%) Firewall
4 1 (0.37%) IPsec
4 1 (0.37%) LAN
4 1 (0.37%) Network Security
4 1 (0.37%) VLAN
4 1 (0.37%) VPN
Database & Business Intelligence
1 148 (54.61%) Hadoop
2 55 (20.30%) Apache Hive
3 39 (14.39%) Apache Cassandra
4 34 (12.55%) NoSQL
5 27 (9.96%) HBase
6 25 (9.23%) Data Warehouse
7 20 (7.38%) SQL Server
8 17 (6.27%) MongoDB
9 13 (4.80%) Relational Database
10 12 (4.43%) Sqoop
11 9 (3.32%) QlikView
12 8 (2.95%) PostgreSQL
12 8 (2.95%) RDBMS
12 8 (2.95%) SQL Server Integration Services
13 7 (2.58%) BigQuery
13 7 (2.58%) Data Lake
13 7 (2.58%) Impala
13 7 (2.58%) Looker
13 7 (2.58%) MySQL
13 7 (2.58%) Power BI
Development Applications
1 22 (8.12%) Jenkins
2 18 (6.64%) Git (software)
2 18 (6.64%) JIRA
3 11 (4.06%) Talend Open Studio
4 10 (3.69%) Maven
5 7 (2.58%) Eclipse
5 7 (2.58%) Selenium
6 6 (2.21%) JUnit
7 5 (1.85%) Mockito
8 4 (1.48%) Team Foundation Server
9 3 (1.11%) Build Forge
9 3 (1.11%) Jasmine
9 3 (1.11%) Mocha
9 3 (1.11%) Oracle APEX
9 3 (1.11%) Subversion
9 3 (1.11%) TeamCity
9 3 (1.11%) Toad
10 2 (0.74%) Artifactory
10 2 (0.74%) Bitbucket
10 2 (0.74%) Cucumber
General
1 82 (30.26%) Finance
2 61 (22.51%) Banking
3 28 (10.33%) Investment Banking
4 14 (5.17%) Front Office
4 14 (5.17%) Retail
5 6 (2.21%) Marketing
6 5 (1.85%) Legal
7 4 (1.48%) Advertising
7 4 (1.48%) Back Office
8 3 (1.11%) Retail Banking
8 3 (1.11%) Wholesale Banking
9 2 (0.74%) Publishing
10 1 (0.37%) Corporate Banking
10 1 (0.37%) Electronics
10 1 (0.37%) Games
10 1 (0.37%) Law
10 1 (0.37%) Manufacturing
10 1 (0.37%) Telecoms
Job Titles
1 113 (41.70%) Developer
2 64 (23.62%) Java Developer
3 53 (19.56%) Big Data Developer
4 39 (14.39%) Architect
5 30 (11.07%) Scala Developer
6 26 (9.59%) Analyst
6 26 (9.59%) Big Data Engineer
6 26 (9.59%) Data Engineer
6 26 (9.59%) Java Scala Developer
7 24 (8.86%) Senior Developer
8 23 (8.49%) AWS DevOps
8 23 (8.49%) Data Architect
9 22 (8.12%) Senior Java Developer
10 20 (7.38%) AWS Developer
10 20 (7.38%) DevOps Engineer
11 18 (6.64%) Hadoop Developer
12 17 (6.27%) Big Data Architect
13 16 (5.90%) AWS Engineer
13 16 (5.90%) Data Scientist
14 15 (5.54%) Data Analyst
Libraries, Frameworks & Software Standards
1 28 (10.33%) Kafka
2 27 (9.96%) Spring
3 22 (8.12%) Web Services
4 20 (7.38%) RESTful
5 15 (5.54%) Akka
6 13 (4.80%) JSON
7 12 (4.43%) AngularJS
8 11 (4.06%) HTML
9 9 (3.32%) .NET
9 9 (3.32%) HTML5
10 8 (2.95%) REST
11 7 (2.58%) CSS
11 7 (2.58%) Middleware
11 7 (2.58%) Natural Language Processing
12 5 (1.85%) XML
13 4 (1.48%) Cascading
13 4 (1.48%) D3.js
13 4 (1.48%) Hibernate
13 4 (1.48%) J2EE
13 4 (1.48%) RabbitMQ
Miscellaneous
1 21 (7.75%) Algorithms
2 17 (6.27%) Analytical Skills
3 13 (4.80%) Client/Server
4 10 (3.69%) Greenfield Project
5 8 (2.95%) Computer Science
5 8 (2.95%) Market Risk
5 8 (2.95%) User Experience
6 7 (2.58%) Foreign Exchange (FX)
7 6 (2.21%) Credit Risk
7 6 (2.21%) Data Structures
8 5 (1.85%) Data Centre
8 5 (1.85%) Enterprise Software
8 5 (1.85%) Equities
9 4 (1.48%) Derivative
9 4 (1.48%) Management Information System
9 4 (1.48%) Minimum Viable Product
10 3 (1.11%) Hedge funds
10 3 (1.11%) Linux Command Line
11 2 (0.74%) Mobile Banking
11 2 (0.74%) Private Cloud
Operating Systems
1 67 (24.72%) Linux
2 38 (14.02%) Unix
3 11 (4.06%) Windows
4 6 (2.21%) Red Hat Enterprise Linux
5 5 (1.85%) Solaris
6 4 (1.48%) Windows Server
7 3 (1.11%) CentOS
8 2 (0.74%) AIX
8 2 (0.74%) Ubuntu
9 1 (0.37%) Android
9 1 (0.37%) Apple iOS
Processes & Methodologies
1 105 (38.75%) Agile Software Development
2 65 (23.99%) Analytics
3 63 (23.25%) DevOps
4 42 (15.50%) TDD
5 38 (14.02%) E-Commerce
6 36 (13.28%) Scrum
7 31 (11.44%) Open Source
8 30 (11.07%) ETL
9 29 (10.70%) Business Intelligence
10 27 (9.96%) Data Modelling
11 25 (9.23%) Data Analytics
11 25 (9.23%) Machine Learning
12 21 (7.75%) Visualisation
13 20 (7.38%) MapReduce
14 18 (6.64%) Data Analysis
15 17 (6.27%) OO
16 16 (5.90%) Stakeholder Management
17 15 (5.54%) Big Data Analytics
17 15 (5.54%) Data Visualisation
17 15 (5.54%) Mentoring
Programming Languages
1 132 (48.71%) Java
2 95 (35.06%) Python
3 64 (23.62%) SQL
4 52 (19.19%) Scala
5 33 (12.18%) R
6 25 (9.23%) Bash Shell
7 17 (6.27%) C#
8 12 (4.43%) Perl
9 10 (3.69%) JavaScript
10 5 (1.85%) Ruby
11 4 (1.48%) PowerShell
11 4 (1.48%) Shell Script
11 4 (1.48%) T-SQL
12 3 (1.11%) Apex Code
12 3 (1.11%) C++
12 3 (1.11%) ES6
12 3 (1.11%) TypeScript
13 2 (0.74%) HiveQL
13 2 (0.74%) SOQL
13 2 (0.74%) SOSL
Qualifications
1 11 (4.06%) Degree
2 5 (1.85%) PhD
3 3 (1.11%) Computer Science Degree
3 3 (1.11%) SC Cleared
3 3 (1.11%) Security Cleared
4 2 (0.74%) PMP
4 2 (0.74%) Postgraduate
5 1 (0.37%) Master's Degree
5 1 (0.37%) Numerate Degree
5 1 (0.37%) PMI Certification
5 1 (0.37%) SAS Certification
Quality Assurance & Compliance
1 10 (3.69%) QA
2 8 (2.95%) Data Quality
3 5 (1.85%) MiFID
4 2 (0.74%) PMO
5 1 (0.37%) IFRS
5 1 (0.37%) IFRS 9
5 1 (0.37%) Sarbanes-Oxley
5 1 (0.37%) Solvency II
System Software
1 22 (8.12%) HDFS
2 19 (7.01%) Docker
3 11 (4.06%) Apache ZooKeeper
4 8 (2.95%) Apache Flume
5 5 (1.85%) Active Directory
6 3 (1.11%) VMware Infrastructure
7 2 (0.74%) Hyper-V
7 2 (0.74%) Oracle RAC
7 2 (0.74%) Xen
8 1 (0.37%) vCloud
Systems Management
1 21 (7.75%) Puppet
2 13 (4.80%) Ansible
2 13 (4.80%) Opscode Chef
3 9 (3.32%) Terraform
4 8 (2.95%) Oozie
5 7 (2.58%) Hadoop YARN
6 5 (1.85%) Kubernetes
7 3 (1.11%) Mesos
7 3 (1.11%) Rsyslog
8 2 (0.74%) Ambari
8 2 (0.74%) Graphite
8 2 (0.74%) MOM
9 1 (0.37%) Control-M
9 1 (0.37%) Kibana
9 1 (0.37%) OpenIDM
9 1 (0.37%) Packer
Vendors
1 27 (9.96%) Tableau
2 17 (6.27%) Cloudera
2 17 (6.27%) Oracle
3 14 (5.17%) Google
3 14 (5.17%) Microsoft
4 11 (4.06%) IBM
4 11 (4.06%) Talend
5 10 (3.69%) Hortonworks
5 10 (3.69%) Splunk
6 9 (3.32%) Teradata
7 8 (2.95%) Red Hat
8 7 (2.58%) SnapLogic
9 6 (2.21%) Informatica
10 5 (1.85%) Salesforce.com
10 5 (1.85%) VMware
11 4 (1.48%) Cisco
11 4 (1.48%) Citrix
12 3 (1.11%) HP
12 3 (1.11%) SAP
12 3 (1.11%) TIBCO
City, London
Hays Finance Technology
Rate: £550.00 - £610.00 per day
Posted: 6 hours ago
City, London
Hays Finance Technology
Rate: £550.00 - £610.00 per day
Posted: Yesterday
City, London
Hays Finance Technology
Rate: £550.00 - £610.00 per day
Posted: Yesterday
City, London
Venturi
Rate: £500 - £600 per day
Posted: Yesterday
City, London
TEKsystems
Rate: £600 - £700 per day
Posted: 2 days ago
City, London
LA International
Posted: 2 days ago
City, London
TEKsystems
Rate: £700 - £751 per annum
Posted: 2 days ago
City, London
Spencer Rose
Posted: 2 days ago
City, London
Oliver Bernard
Rate: £550 - £600 per day
Posted: 6 days ago
City of London
Edward Carter Solutions
Rate: £500 per day
Posted: 7 days ago
City, London
Haybrook IT Resourcing Ltd
Rate: Up to £500 per day
Posted: 6 days ago
City, London
PBIT Consultants
Rate: From £450 to £500 per day
Posted: 5 days ago