Period
to 18 January 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 18 January 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
18 Jan 2018
Same period 2017 Same period 2016
Rank 62 42 96
Rank change year-on-year -20 +54 +20
Contract jobs citing Big Data 260 291 164
As % of all contract IT jobs advertised in the City of London 3.68% 4.66% 2.30%
As % of the Database & Business Intelligence category 14.68% 16.82% 8.77%
Number of daily rates quoted 226 234 139
City of London median daily rate £575 £575 £525
Median daily rate % change year-on-year - +9.52% -
10th Percentile £425 £413 £350
90th Percentile £700 £713 £703
Central London median daily rate £575 £569 £530
% change year-on-year +1.10% +7.31% +0.95%
Number of hourly rates quoted 0 0 1
City of London median hourly rate - - £37.50
Central London median hourly rate - - £37.50

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,771 1,730 1,870
As % of all contract IT jobs advertised in the City of London 25.06% 27.73% 26.23%
Number of daily rates quoted 1,481 1,385 1,505
City of London median daily rate £525 £475 £475
Median daily rate % change year-on-year +10.53% - +11.76%
10th Percentile £363 £325 £313
90th Percentile £688 £650 £638
Central London median daily rate £513 £475 £475
% change year-on-year +7.89% - +11.76%
Number of hourly rates quoted 6 1 6
City of London median hourly rate £27.75 £45.00 £40.00
Median hourly rate % change year-on-year -38.33% +12.50% +29.79%
10th Percentile £23.38 £42.50 £27.75
90th Percentile £33.25 £47.50 £60.00
Central London median hourly rate £27.50 £45.00 £38.75
% change year-on-year -38.89% +16.13% +27.43%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 18 January 2018.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 18 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 1 £425 -
Big Data
Central London

For the 6 months to 18 January 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region with a requirement for Big Data.

1 149 (57.31%) Hadoop
2 147 (56.54%) Apache Spark
3 139 (53.46%) Java
4 102 (39.23%) Agile Software Development
5 95 (36.54%) Apache Hive
6 92 (35.38%) Python
7 88 (33.85%) Kafka
8 81 (31.15%) Finance
9 71 (27.31%) HDFS
10 68 (26.15%) DevOps
10 68 (26.15%) Banking
11 63 (24.23%) SQL
11 63 (24.23%) HBase
12 61 (23.46%) Scala
13 56 (21.54%) Amazon AWS
13 56 (21.54%) MapReduce
13 56 (21.54%) Analytics
14 55 (21.15%) Apache Flume
15 53 (20.38%) Oozie
16 48 (18.46%) MongoDB
16 48 (18.46%) NoSQL
16 48 (18.46%) TDD
17 46 (17.69%) Jenkins
18 43 (16.54%) Oracle
19 40 (15.38%) Data Modelling
20 39 (15.00%) Docker
21 38 (14.62%) Data Engineering
22 37 (14.23%) Analytical Skills
23 36 (13.85%) BDD
23 36 (13.85%) Open Source

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 147 (56.54%) Apache Spark
2 36 (13.85%) Apache
3 26 (10.00%) Elasticsearch
4 11 (4.23%) Apache Pig
5 7 (2.69%) Confluence
5 7 (2.69%) SAS
6 6 (2.31%) Tomcat
7 5 (1.92%) nginx
8 3 (1.15%) Oracle Coherence
9 2 (0.77%) IPython
9 2 (0.77%) JBoss
9 2 (0.77%) Jupyter
9 2 (0.77%) OpenStack
10 1 (0.38%) Apache Solr
10 1 (0.38%) NServiceBus
10 1 (0.38%) SharePoint
10 1 (0.38%) Tornado
10 1 (0.38%) WebLogic
10 1 (0.38%) WebSphere
10 1 (0.38%) WebSphere Application Server
Applications
1 3 (1.15%) Microsoft Excel
1 3 (1.15%) SPSS
2 1 (0.38%) Spreadsheet
2 1 (0.38%) Weka
Business Applications
1 1 (0.38%) WebTrends
Cloud Services
1 56 (21.54%) Amazon AWS
2 20 (7.69%) GitHub
3 14 (5.38%) Bluemix
3 14 (5.38%) IBM Cloud
3 14 (5.38%) Microsoft Azure
4 7 (2.69%) Google Cloud Platform
5 4 (1.54%) Cloud Computing
5 4 (1.54%) PaaS
6 3 (1.15%) SaaS
7 2 (0.77%) Amazon Kinesis
7 2 (0.77%) AWS CloudFormation
8 1 (0.38%) Amazon EC2
8 1 (0.38%) Amazon S3
8 1 (0.38%) Google Analytics
8 1 (0.38%) Google Tag Manager
Communications & Networking
1 5 (1.92%) Kerberos
2 4 (1.54%) LDAP
3 3 (1.15%) Firewall
3 3 (1.15%) Internet
4 2 (0.77%) Network Security
5 1 (0.38%) HTTPS
5 1 (0.38%) SSH
Database & Business Intelligence
1 149 (57.31%) Hadoop
2 95 (36.54%) Apache Hive
3 63 (24.23%) HBase
4 48 (18.46%) MongoDB
4 48 (18.46%) NoSQL
5 31 (11.92%) Data Warehouse
5 31 (11.92%) Impala
6 30 (11.54%) PostgreSQL
7 27 (10.38%) Relational Database
7 27 (10.38%) Sqoop
8 23 (8.85%) Apache Cassandra
9 16 (6.15%) RDBMS
10 14 (5.38%) Oracle ODI
11 11 (4.23%) Oracle Database
12 8 (3.08%) SQL Server
13 7 (2.69%) Data Lake
14 6 (2.31%) MySQL
15 5 (1.92%) Amazon Redshift
16 4 (1.54%) BigQuery
16 4 (1.54%) Data Mining
Development Applications
1 46 (17.69%) Jenkins
2 26 (10.00%) Git (software)
3 19 (7.31%) JIRA
4 10 (3.85%) Cucumber
4 10 (3.85%) Maven
5 8 (3.08%) TeamCity
6 5 (1.92%) SonarQube
7 4 (1.54%) JUnit
7 4 (1.54%) Selenium
8 3 (1.15%) LoadRunner
8 3 (1.15%) Subversion
8 3 (1.15%) WebDriver
9 2 (0.77%) Ant
9 2 (0.77%) Appium
9 2 (0.77%) GoCD
9 2 (0.77%) Mockito
9 2 (0.77%) Octopus Deploy
9 2 (0.77%) Vagrant
9 2 (0.77%) Visual Studio
10 1 (0.38%) TestRail
General
1 81 (31.15%) Finance
2 68 (26.15%) Banking
3 26 (10.00%) Investment Banking
4 9 (3.46%) Front Office
4 9 (3.46%) Marketing
4 9 (3.46%) Retail
5 7 (2.69%) Advertising
5 7 (2.69%) Financial Institution
6 6 (2.31%) Publishing
7 5 (1.92%) Telecoms
8 3 (1.15%) Legal
8 3 (1.15%) Retail Banking
9 2 (0.77%) Electronics
9 2 (0.77%) French Language
9 2 (0.77%) Manufacturing
10 1 (0.38%) Automotive
10 1 (0.38%) Back Office
10 1 (0.38%) Games
10 1 (0.38%) Spanish Language
10 1 (0.38%) Wholesale Banking
Job Titles
1 81 (31.15%) Developer
2 41 (15.77%) Data Engineer
3 30 (11.54%) Big Data Developer
3 30 (11.54%) Big Data Engineer
4 27 (10.38%) Java Engineer
5 24 (9.23%) Java Developer
5 24 (9.23%) Scala Developer
6 22 (8.46%) Hadoop Engineer
7 19 (7.31%) Architect
8 15 (5.77%) Senior Hadoop Engineer
8 15 (5.77%) Senior Java Engineer
9 13 (5.00%) Analyst
9 13 (5.00%) DevOps Engineer
10 12 (4.62%) Data Architect
10 12 (4.62%) Data Scientist
11 11 (4.23%) Senior Developer
12 10 (3.85%) Apache Spark Developer
12 10 (3.85%) Salesforce Developer
13 7 (2.69%) Investment Banking Java Developer
14 6 (2.31%) Big Data Architect
Libraries, Frameworks & Software Standards
1 88 (33.85%) Kafka
2 28 (10.77%) PySpark
3 20 (7.69%) Akka
4 19 (7.31%) Web Services
5 18 (6.92%) AngularJS
5 18 (6.92%) JSON
6 15 (5.77%) React
6 15 (5.77%) REST
7 13 (5.00%) RESTful
8 10 (3.85%) Redux
9 9 (3.46%) HTML
9 9 (3.46%) XML
10 8 (3.08%) HTML5
10 8 (3.08%) Twitter Bootstrap
11 7 (2.69%) Gherkin
12 6 (2.31%) CSS
12 6 (2.31%) Hibernate
12 6 (2.31%) OpenCL
12 6 (2.31%) Samza
12 6 (2.31%) Spring
Miscellaneous
1 37 (14.23%) Analytical Skills
2 12 (4.62%) Algorithms
3 11 (4.23%) Computer Science
3 11 (4.23%) Market Risk
4 9 (3.46%) User Experience
5 8 (3.08%) Reference Data
5 8 (3.08%) Virtual Team
6 7 (2.69%) Derivative
6 7 (2.69%) Hedge funds
7 5 (1.92%) Data Centre
7 5 (1.92%) Greenfield Project
7 5 (1.92%) Mobile App
8 4 (1.54%) Fixed Income
8 4 (1.54%) Foreign Exchange (FX)
8 4 (1.54%) Replication
8 4 (1.54%) Semantic Web
9 3 (1.15%) Credit Risk
9 3 (1.15%) Equities
9 3 (1.15%) Interest Rate Derivative
9 3 (1.15%) Linked Data
Operating Systems
1 29 (11.15%) Linux
2 15 (5.77%) Unix
3 9 (3.46%) Windows
4 6 (2.31%) CentOS
5 5 (1.92%) Red Hat Enterprise Linux
5 5 (1.92%) Ubuntu
6 3 (1.15%) Windows Server
7 2 (0.77%) Android
7 2 (0.77%) Apple iOS
7 2 (0.77%) Windows 10
7 2 (0.77%) Windows Server 2008
8 1 (0.38%) AIX
Processes & Methodologies
1 102 (39.23%) Agile Software Development
2 68 (26.15%) DevOps
3 56 (21.54%) Analytics
3 56 (21.54%) MapReduce
4 48 (18.46%) TDD
5 40 (15.38%) Data Modelling
6 38 (14.62%) Data Engineering
7 36 (13.85%) BDD
7 36 (13.85%) Open Source
8 26 (10.00%) ETL
8 26 (10.00%) Visualisation
9 25 (9.62%) Business Intelligence
9 25 (9.62%) Machine Learning
10 20 (7.69%) Test Automation
11 19 (7.31%) Scrum
11 19 (7.31%) SDLC
12 18 (6.92%) Continuous Integration
12 18 (6.92%) Multithreading
13 17 (6.54%) Data Analytics
13 17 (6.54%) Data Visualisation
Programming Languages
1 139 (53.46%) Java
2 92 (35.38%) Python
3 63 (24.23%) SQL
4 61 (23.46%) Scala
5 26 (10.00%) JavaScript
6 19 (7.31%) Shell Script
7 16 (6.15%) R
8 12 (4.62%) PL/SQL
9 7 (2.69%) Bash Shell
9 7 (2.69%) C#
10 6 (2.31%) Go
11 5 (1.92%) Ruby
12 4 (1.54%) Groovy
13 3 (1.15%) PowerShell
13 3 (1.15%) SPARQL
14 2 (0.77%) C
15 1 (0.38%) C++
15 1 (0.38%) Korn
15 1 (0.38%) VBA
15 1 (0.38%) XAML
Qualifications
1 13 (5.00%) Degree
2 8 (3.08%) Security Cleared
3 7 (2.69%) Computer Science Degree
4 4 (1.54%) SC Cleared
5 3 (1.15%) DV Cleared
6 2 (0.77%) CISSP
6 2 (0.77%) Numerate Degree
6 2 (0.77%) PhD
7 1 (0.38%) Master's Degree
7 1 (0.38%) PRINCE2 Certification
Quality Assurance & Compliance
1 8 (3.08%) QA
2 5 (1.92%) GCP
3 4 (1.54%) Data Quality
4 2 (0.77%) Dodd-Frank
4 2 (0.77%) EMIR
4 2 (0.77%) MiFID
5 1 (0.38%) IFRS
5 1 (0.38%) IFRS 9
System Software
1 71 (27.31%) HDFS
2 55 (21.15%) Apache Flume
3 39 (15.00%) Docker
4 7 (2.69%) Apache ZooKeeper
5 2 (0.77%) Active Directory
Systems Management
1 53 (20.38%) Oozie
2 27 (10.38%) Ambari
3 26 (10.00%) Ansible
4 25 (9.62%) Kubernetes
5 23 (8.85%) Hadoop YARN
6 10 (3.85%) Puppet
7 9 (3.46%) Terraform
8 8 (3.08%) Mesos
9 7 (2.69%) Opscode Chef
10 4 (1.54%) Salt
11 3 (1.15%) Kibana
11 3 (1.15%) logstash
12 2 (0.77%) Rundeck
13 1 (0.38%) Apache Slider
13 1 (0.38%) BladeLogic
13 1 (0.38%) Docker Swarm
13 1 (0.38%) Rsyslog
13 1 (0.38%) ZABBIX
Vendors
1 43 (16.54%) Oracle
2 33 (12.69%) Tableau
3 20 (7.69%) Cloudera
4 16 (6.15%) IBM
5 14 (5.38%) Hortonworks
6 13 (5.00%) Salesforce.com
7 8 (3.08%) Google
8 6 (2.31%) Microsoft
9 5 (1.92%) MapR
10 4 (1.54%) SaltStack
10 4 (1.54%) SAP
10 4 (1.54%) Vertica
11 3 (1.15%) HP
11 3 (1.15%) Informatica
11 3 (1.15%) Splunk
11 3 (1.15%) Talend
11 3 (1.15%) Teradata
12 2 (0.77%) Cognos
12 2 (0.77%) Facebook
13 1 (0.38%) Red Hat