The table below looks at the statistics for Big Data skills in IT contracts advertised for the City of London region. Included is a guide to the contractor rates offered in IT contracts that have cited Big Data over the 3 months to 6 December 2016 with a comparison to the same period over the previous 2 years.

Note that daily contractor rates and hourly contractor rates are treated separately. When calculating average contractor rates, daily rates are not derived from quoted hourly rates or vice versa.

3 months to
6 Dec 2016
Same period 2015 Same period 2014
Big Data
Rank 36 84 103
Rank change year-on-year
+48 +19
Contract jobs citing Big Data 167 80 106
As % of all contract IT jobs located in the City of London 5.09% 2.34% 1.85%
As % of the Database & Business Intelligence category 18.09% 9.30% 8.14%
Number of daily rates quoted 132 64 85
Median daily rate £580 £525 £500
Median daily rate % change year-on-year
+10.47% +5.00%
90% offered a daily rate of more than £439 £332 £296
10% offered a daily rate of more than £700 £650 £650
UK excluding London median daily rate £498 £460 £475
% change year-on-year
+8.15% -3.15%
Number of hourly rates quoted 0 1 0
Median hourly rate - £37.50 -
UK excluding London median hourly rate £42.92 £54.50 £37.50
% change year-on-year
-21.24% +45.33%
Big Data
London

The following table is for comparison with the above and provides statistics for the entire Database & Business Intelligence category in contract jobs advertised in the City of London region.

Database & Business Intelligence Category
City of London
Contract IT job ads with a match in the
Database & Business Intelligence category
923 860 1302
As % of all contract IT jobs located in the City of London 28.15% 25.12% 22.70%
Number of daily rates quoted 743 700 1038
Median daily rate £500 £475 £420
Median daily rate % change year-on-year
+5.26% +13.09%
90% offered a daily rate of more than £350 £345 £288
10% offered a daily rate of more than £650 £625 £600
UK excluding London median daily rate £400 £388 £363
% change year-on-year
+3.22% +6.89%
Number of hourly rates quoted 1 2 3
Median hourly rate £45.00 £37.50 £30.00
Median hourly rate % change year-on-year
+20.00% +25.00%
UK excluding London median hourly rate £38.00 £25.44 £33.00
% change year-on-year
+49.37% -22.90%

Big Data
Jobs Demand Trend in the City of London

The demand trend of contract jobs across the City of London region citing Big Data as a proportion of all IT contracts with a match in the Database & Business Intelligence category.

Big Data Jobs Demand Trend in the City of London

Big Data
Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in IT contract jobs citing Big Data across the City of London region.

Big Data Daily Rate Trend in the City of London

Big Data
Daily Rate Histogram in the City of London

This chart provides a histogram of daily rates quoted in contract IT jobs citing Big Data across the City of London region over the 3 months to 6 December 2016.

Big Data Daily Rate Histogram in the City of London

Big Data
Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for hourly rates quoted in IT contractor jobs citing Big Data across the City of London region.

Big Data Hourly Rate Trend in the City of London

Big Data
Top 30 Related IT Skills in the City of London

For the 6 months to 6 December 2016, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region with a requirement for Big Data.

1 170 (59.65%) Agile Software Development
2 168 (58.95%) Hadoop
3 140 (49.12%) Java
4 118 (41.40%) Apache Spark
5 98 (34.39%) Scala
6 92 (32.28%) SQL
7 81 (28.42%) Python
8 76 (26.67%) Scrum
9 70 (24.56%) Finance
10 68 (23.86%) Banking
11 54 (18.95%) Apache Hive
11 54 (18.95%) Analytics
12 53 (18.60%) ETL
13 50 (17.54%) DevOps
13 50 (17.54%) Continuous Integration
14 48 (16.84%) Apache Cassandra
15 47 (16.49%) TDD
16 44 (15.44%) Business Intelligence
17 43 (15.09%) Linux
18 42 (14.74%) Data Warehouse
18 42 (14.74%) MongoDB
19 40 (14.04%) Amazon AWS
19 40 (14.04%) Git (software)
20 39 (13.68%) R
20 39 (13.68%) Kafka
21 38 (13.33%) Analytical Skills
22 35 (12.28%) SQL Server
22 35 (12.28%) Investment Banking
22 35 (12.28%) JIRA
23 34 (11.93%) HDFS

Big Data
Top Related IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (41.40%) Apache Spark
2 19 (6.67%) Apache
2 19 (6.67%) Apache Pig
3 18 (6.32%) Elasticsearch
4 7 (2.46%) Confluence
4 7 (2.46%) Oracle Coherence
5 5 (1.75%) SAS
6 4 (1.40%) Jupyter
7 3 (1.05%) Apache Solr
7 3 (1.05%) SharePoint
8 1 (0.35%) GemFire
8 1 (0.35%) WebLogic
8 1 (0.35%) WebSphere
Applications
1 6 (2.11%) MS Excel
2 2 (0.70%) Spreadsheet
2 2 (0.70%) SPSS
3 1 (0.35%) MS Office
3 1 (0.35%) MS PowerPoint
Business Applications
1 4 (1.40%) SAP Oil and Gas
Cloud Services
1 40 (14.04%) Amazon AWS
2 13 (4.56%) Cloud Computing
3 11 (3.86%) Microsoft Azure
4 5 (1.75%) Google Cloud Platform
5 4 (1.40%) Amazon Kinesis
6 3 (1.05%) GitHub
7 2 (0.70%) SaaS
8 1 (0.35%) Amazon EC2
8 1 (0.35%) Amazon EMR
8 1 (0.35%) Google Compute Engine
8 1 (0.35%) IaaS
8 1 (0.35%) PaaS
Communications & Networking
1 7 (2.46%) FTP
2 6 (2.11%) HTTP
3 5 (1.75%) Kerberos
4 3 (1.05%) Firewall
4 3 (1.05%) Internet
4 3 (1.05%) Network Security
5 2 (0.70%) TCP/IP
6 1 (0.35%) AMQP
6 1 (0.35%) DNS
Database & Business Intelligence
1 168 (58.95%) Hadoop
2 54 (18.95%) Apache Hive
3 48 (16.84%) Apache Cassandra
4 42 (14.74%) Data Warehouse
4 42 (14.74%) MongoDB
5 35 (12.28%) SQL Server
6 31 (10.88%) HBase
6 31 (10.88%) Relational Database
7 27 (9.47%) NoSQL
8 20 (7.02%) PostgreSQL
9 16 (5.61%) Data Lake
10 14 (4.91%) SQL Server Integration Services
11 9 (3.16%) SQL Server Analysis Services
11 9 (3.16%) SQL Server Reporting Services
11 9 (3.16%) Sqoop
12 8 (2.81%) Impala
13 7 (2.46%) Cloudera CDH
14 6 (2.11%) Amazon Redshift
14 6 (2.11%) QlikView
15 5 (1.75%) RDBMS
Development Applications
1 40 (14.04%) Git (software)
2 35 (12.28%) JIRA
3 17 (5.96%) Gradle
4 12 (4.21%) IntelliJ
4 12 (4.21%) Jenkins
5 10 (3.51%) JUnit
5 10 (3.51%) Maven
6 9 (3.16%) Cucumber
7 8 (2.81%) Subversion
8 7 (2.46%) Selenium
9 6 (2.11%) Atlassian Bamboo
9 6 (2.11%) ERwin
9 6 (2.11%) JBehave
9 6 (2.11%) Team Foundation Server
10 5 (1.75%) TeamCity
11 4 (1.40%) Bitbucket
11 4 (1.40%) DbUnit
11 4 (1.40%) JSUnit
11 4 (1.40%) PHPUnit
11 4 (1.40%) Robot Framework
General
1 70 (24.56%) Finance
2 68 (23.86%) Banking
3 35 (12.28%) Investment Banking
4 33 (11.58%) Front Office
5 22 (7.72%) Retail
6 13 (4.56%) Marketing
7 10 (3.51%) Legal
8 9 (3.16%) Financial Institution
9 8 (2.81%) Telecoms
10 4 (1.40%) Electronics
10 4 (1.40%) Manufacturing
11 3 (1.05%) Games
12 1 (0.35%) Billing
Job Titles
1 127 (44.56%) Developer
2 74 (25.96%) Java Developer
3 51 (17.89%) Big Data Developer
4 44 (15.44%) Architect
5 36 (12.63%) Senior Developer
6 34 (11.93%) Scala Developer
6 34 (11.93%) Senior Java Developer
7 30 (10.53%) Data Engineer
8 29 (10.18%) Java Scala Developer
9 28 (9.82%) Big Data Engineer
10 22 (7.72%) Data Architect
11 17 (5.96%) Big Data Architect
12 16 (5.61%) Hadoop Engineer
13 15 (5.26%) Senior Big Data Developer
14 14 (4.91%) Analyst
14 14 (4.91%) Apache Spark Developer
15 13 (4.56%) Market Risk Developer
15 13 (4.56%) Market Risk Java Developer
16 12 (4.21%) Hadoop Developer
17 11 (3.86%) Data Scientist
Libraries, Frameworks & Software Standards
1 39 (13.68%) Kafka
2 33 (11.58%) Web Services
3 29 (10.18%) HTML
4 28 (9.82%) Akka
5 23 (8.07%) HTML5
6 22 (7.72%) AngularJS
7 19 (6.67%) Node.js
8 18 (6.32%) CSS
9 16 (5.61%) Dropwizard
9 16 (5.61%) REST
10 15 (5.26%) Play Framework
11 12 (4.21%) Hystrix
11 12 (4.21%) Scalatra
11 12 (4.21%) XML
12 11 (3.86%) .NET
12 11 (3.86%) Spring
13 10 (3.51%) JMS
13 10 (3.51%) JSON
14 9 (3.16%) React
15 5 (1.75%) scikit-learn
Miscellaneous
1 38 (13.33%) Analytical Skills
2 23 (8.07%) Statistics
3 22 (7.72%) Equities
4 18 (6.32%) Foreign Exchange (FX)
5 17 (5.96%) Computer Science
5 17 (5.96%) Market Risk
6 13 (4.56%) Mathematics
7 12 (4.21%) Derivative
7 12 (4.21%) Management Information System
8 11 (3.86%) Data Integration
9 10 (3.51%) Algorithms
10 9 (3.16%) Visualisation
11 8 (2.81%) Fixed Income
12 7 (2.46%) User Experience
13 6 (2.11%) Fintech
14 5 (1.75%) Credit Risk
14 5 (1.75%) Interest Rate Derivative
15 4 (1.40%) Contactless
15 4 (1.40%) Data Centre
15 4 (1.40%) Enterprise Software
Operating Systems
1 43 (15.09%) Linux
2 14 (4.91%) Unix
3 12 (4.21%) Windows
4 9 (3.16%) Red Hat Enterprise Linux
5 4 (1.40%) Ubuntu
6 2 (0.70%) AIX
6 2 (0.70%) Android
6 2 (0.70%) Apple iOS
6 2 (0.70%) CentOS
6 2 (0.70%) Windows Server
7 1 (0.35%) Mac OS X
7 1 (0.35%) Solaris
Processes & Methodologies
1 170 (59.65%) Agile Software Development
2 76 (26.67%) Scrum
3 54 (18.95%) Analytics
4 53 (18.60%) ETL
5 50 (17.54%) Continuous Integration
5 50 (17.54%) DevOps
6 47 (16.49%) TDD
7 44 (15.44%) Business Intelligence
8 33 (11.58%) BDD
9 32 (11.23%) Open Source
9 32 (11.23%) Software Engineering
10 31 (10.88%) Risk Management
11 27 (9.47%) Automated Testing
12 26 (9.12%) Data Modelling
13 25 (8.77%) MapReduce
14 19 (6.67%) SOA
15 18 (6.32%) Kanban
16 17 (5.96%) E-Commerce
17 16 (5.61%) Machine Learning
17 16 (5.61%) Pair Programming
Programming Languages
1 140 (49.12%) Java
2 98 (34.39%) Scala
3 92 (32.28%) SQL
4 81 (28.42%) Python
5 39 (13.68%) R
6 31 (10.88%) JavaScript
7 14 (4.91%) Shell Script
8 13 (4.56%) C#
8 13 (4.56%) Ruby
9 12 (4.21%) Haskell
10 10 (3.51%) Bash Shell
10 10 (3.51%) T-SQL
11 7 (2.46%) MATLAB
11 7 (2.46%) PHP
12 6 (2.11%) PL/SQL
13 5 (1.75%) PowerShell
14 4 (1.40%) C++
14 4 (1.40%) Go
14 4 (1.40%) Perl
15 2 (0.70%) VBA
Qualifications
1 18 (6.32%) Degree
2 13 (4.56%) Security Cleared
3 6 (2.11%) DV Cleared
3 6 (2.11%) PhD
3 6 (2.11%) SC Cleared
4 2 (0.70%) BPSS Clearance
4 2 (0.70%) RHCE
4 2 (0.70%) RHCSA
5 1 (0.35%) BC Cleared
5 1 (0.35%) PMP
Quality Assurance & Compliance
1 30 (10.53%) QA
2 12 (4.21%) Data Quality
3 2 (0.70%) MiFID
System Software
1 34 (11.93%) HDFS
2 12 (4.21%) Docker
3 5 (1.75%) Active Directory
3 5 (1.75%) Apache ZooKeeper
4 4 (1.40%) Apache Flume
5 3 (1.05%) VMware Infrastructure
6 2 (0.70%) Oracle RAC
7 1 (0.35%) Hyper-V
7 1 (0.35%) vSphere
Systems Management
1 12 (4.21%) Hadoop YARN
2 11 (3.86%) Puppet
3 7 (2.46%) Oozie
4 5 (1.75%) Ansible
5 4 (1.40%) Opscode Chef
6 3 (1.05%) Grafana
6 3 (1.05%) Graphite
6 3 (1.05%) Nagios
7 2 (0.70%) Ambari
7 2 (0.70%) Kubernetes
7 2 (0.70%) Mesos
7 2 (0.70%) MOM
7 2 (0.70%) Salt
8 1 (0.35%) ArcSight ESM
8 1 (0.35%) Control-M
8 1 (0.35%) Marathon
8 1 (0.35%) Terraform
Vendors
1 21 (7.37%) Teradata
2 17 (5.96%) Oracle
2 17 (5.96%) Tableau
3 12 (4.21%) Cloudera
3 12 (4.21%) New Relic
4 10 (3.51%) Hortonworks
4 10 (3.51%) Microsoft
5 9 (3.16%) MicroStrategy
5 9 (3.16%) SAP
6 8 (2.81%) Atlassian
6 8 (2.81%) Red Hat
7 7 (2.46%) Netezza
8 6 (2.11%) Google
9 5 (1.75%) IBM
9 5 (1.75%) VMware
10 4 (1.40%) Greenplum
10 4 (1.40%) Informatica
10 4 (1.40%) SaltStack
10 4 (1.40%) Sybase
10 4 (1.40%) Vertica
City, London
TEKsystems
Rate: £600 - £650 per day
Posted: Yesterday
City, London
Empiric Solutions
Posted: 4 days ago
City of London
Churchill Frank
Rate: £550 - £650 per day
Posted: 4 days ago
City, London
Linux Recruit
Rate: £550 - £650 per day
Posted: 5 days ago
City, London
Empiric Solutions
Posted: 5 days ago
City, London
Empiric Solutions
Posted: 5 days ago
City, London
McGregor Boyall
Rate: £600 - £700 per day
Posted: 6 days ago
City, London
E-synergy Solutions
Rate: £550 - £600 per annum
Posted: 5 days ago
City, London
Harvey Nash plc
Rate: £175000 - £200000 per annum + Bonus and Benefits Package
Posted: 6 days ago
City of London
People Source Consulting
Rate: £450 - £550 per day
Posted: 13 days ago