Period
to 22 April 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 22 April 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
22 Apr 2018
Same period 2017 Same period 2016
Rank 76 44 90
Rank change year-on-year -32 +46 +7
Contract jobs citing Big Data 231 286 166
As % of all contract IT jobs advertised in the City of London 3.28% 4.66% 2.54%
As % of the Database & Business Intelligence category 13.28% 16.58% 9.71%
Number of daily rates quoted 193 238 137
City of London median daily rate £575 £550 £525
Median daily rate % change year-on-year +4.55% +4.76% -4.55%
10th Percentile £463 £400 £363
90th Percentile £688 £700 £663
Central London median daily rate £550 £550 £525
% change year-on-year - +4.76% -4.55%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,740 1,725 1,709
As % of all contract IT jobs advertised in the City of London 24.72% 28.10% 26.18%
Number of daily rates quoted 1,469 1,376 1,356
City of London median daily rate £513 £488 £475
Median daily rate % change year-on-year +5.13% +2.63% +5.56%
10th Percentile £363 £325 £313
90th Percentile £675 £650 £638
Central London median daily rate £513 £475 £475
% change year-on-year +7.89% - +5.56%
Number of hourly rates quoted 10 1 11
City of London median hourly rate £25.25 £22.34 £19.00
Median hourly rate % change year-on-year +13.05% +17.55% -47.22%
10th Percentile £20.41 £21.67 £16.13
90th Percentile £36.90 £23.00 £60.00
Central London median hourly rate £29.00 £22.34 £19.00
% change year-on-year +29.84% +17.55% -30.44%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 22 April 2018.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 22 April 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 2 £450 -
Big Data
Central London

For the 6 months to 22 April 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 127 (54.98%) Hadoop
2 118 (51.08%) Apache Spark
3 113 (48.92%) Java
4 94 (40.69%) Python
5 89 (38.53%) Agile Software Development
6 79 (34.20%) Analytics
7 71 (30.74%) Apache Hive
7 71 (30.74%) Finance
8 65 (28.14%) SQL
8 65 (28.14%) Kafka
9 62 (26.84%) Scala
10 52 (22.51%) Amazon AWS
11 48 (20.78%) ETL
12 47 (20.35%) NoSQL
13 44 (19.05%) Banking
14 42 (18.18%) DevOps
15 39 (16.88%) HDFS
15 39 (16.88%) HBase
16 37 (16.02%) Linux
17 35 (15.15%) Java 8
18 33 (14.29%) Data Science
18 33 (14.29%) Apache
18 33 (14.29%) Machine Learning
19 32 (13.85%) Relational Database
19 32 (13.85%) TDD
20 30 (12.99%) MongoDB
21 29 (12.55%) Data Warehouse
21 29 (12.55%) Data Engineering
22 27 (11.69%) Data Modelling
22 27 (11.69%) Scrum

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (51.08%) Apache Spark
2 33 (14.29%) Apache
3 26 (11.26%) Elasticsearch
4 16 (6.93%) Apache Pig
5 8 (3.46%) Apache Solr
6 6 (2.60%) SAS
6 6 (2.60%) Tomcat
7 5 (2.16%) nginx
7 5 (2.16%) SharePoint
8 2 (0.87%) IPython
8 2 (0.87%) Jupyter
8 2 (0.87%) Oracle Coherence
9 1 (0.43%) Apache Airflow
9 1 (0.43%) CMS
9 1 (0.43%) Luigi
9 1 (0.43%) OpenStack
9 1 (0.43%) Sitecore CMS
9 1 (0.43%) Tornado
9 1 (0.43%) WebSphere
9 1 (0.43%) WebSphere Application Server
Applications
1 4 (1.73%) Microsoft Excel
2 3 (1.30%) Spreadsheet
2 3 (1.30%) SPSS
3 1 (0.43%) Weka
Business Applications
1 1 (0.43%) Dynamics CRM
1 1 (0.43%) Eloqua
1 1 (0.43%) ION MarketView
1 1 (0.43%) Salesforce.com CRM
1 1 (0.43%) Temenos T24
Cloud Services
1 52 (22.51%) Amazon AWS
2 26 (11.26%) Microsoft Azure
3 10 (4.33%) Google Cloud Platform
4 8 (3.46%) Amazon Kinesis
5 7 (3.03%) Amazon S3
6 6 (2.60%) GitHub
7 4 (1.73%) Amazon EMR
7 4 (1.73%) Cloud Computing
8 3 (1.30%) Serverless
9 2 (0.87%) AWS Lambda
9 2 (0.87%) Azure Data Factory
9 2 (0.87%) PaaS
9 2 (0.87%) SaaS
10 1 (0.43%) Data Lake Analytics
10 1 (0.43%) Dynamics 365
10 1 (0.43%) Salesforce Sales Cloud
10 1 (0.43%) Salesforce Service Cloud
10 1 (0.43%) Yarn
Communications & Networking
1 8 (3.46%) Kerberos
2 3 (1.30%) Firewall
3 2 (0.87%) HTTP
3 2 (0.87%) Internet
3 2 (0.87%) Network Security
4 1 (0.43%) SMS
4 1 (0.43%) SSH
Database & Business Intelligence
1 127 (54.98%) Hadoop
2 71 (30.74%) Apache Hive
3 47 (20.35%) NoSQL
4 39 (16.88%) HBase
5 32 (13.85%) Relational Database
6 30 (12.99%) MongoDB
7 29 (12.55%) Data Warehouse
8 24 (10.39%) Apache Cassandra
9 19 (8.23%) Data Lake
10 18 (7.79%) Amazon Redshift
11 17 (7.36%) Impala
12 16 (6.93%) SQL Server
13 14 (6.06%) PostgreSQL
14 12 (5.19%) MySQL
15 11 (4.76%) RDBMS
16 10 (4.33%) Sqoop
17 6 (2.60%) Oracle Database
17 6 (2.60%) QlikView
18 5 (2.16%) Data Mining
18 5 (2.16%) SQL Server Integration Services
Development Applications
1 25 (10.82%) Git (software)
2 22 (9.52%) Jenkins
3 18 (7.79%) Maven
4 10 (4.33%) JIRA
5 9 (3.90%) TeamCity
6 7 (3.03%) JUnit
7 6 (2.60%) Cucumber
8 5 (2.16%) Selenium
9 3 (1.30%) Subversion
10 2 (0.87%) ER Studio
10 2 (0.87%) GoCD
10 2 (0.87%) Mockito
10 2 (0.87%) SonarQube
10 2 (0.87%) SpecFlow
10 2 (0.87%) Team Foundation Server
10 2 (0.87%) Vagrant
10 2 (0.87%) Visual Studio
10 2 (0.87%) WebDriver
11 1 (0.43%) GitLab
11 1 (0.43%) Spock
General
1 71 (30.74%) Finance
2 44 (19.05%) Banking
3 18 (7.79%) Retail
4 17 (7.36%) Investment Banking
5 10 (4.33%) Advertising
6 9 (3.90%) Marketing
7 5 (2.16%) Front Office
7 5 (2.16%) Telecoms
8 4 (1.73%) Financial Institution
9 3 (1.30%) Games
9 3 (1.30%) Publishing
10 2 (0.87%) Electronics
10 2 (0.87%) Legal
10 2 (0.87%) Manufacturing
10 2 (0.87%) Private Banking
10 2 (0.87%) Retail Banking
11 1 (0.43%) Automotive
11 1 (0.43%) French Language
11 1 (0.43%) Spanish Language
11 1 (0.43%) Wholesale Banking
Job Titles
1 67 (29.00%) Developer
2 62 (26.84%) Data Engineer
3 55 (23.81%) Big Data Engineer
4 29 (12.55%) Big Data Developer
5 25 (10.82%) Architect
6 19 (8.23%) Hadoop Engineer
6 19 (8.23%) Java Developer
7 17 (7.36%) Java Engineer
8 15 (6.49%) DevOps Engineer
9 14 (6.06%) Data Architect
9 14 (6.06%) Data Scientist
9 14 (6.06%) Senior Hadoop Engineer
9 14 (6.06%) Senior Java Engineer
10 13 (5.63%) Python Engineer
10 13 (5.63%) Scala Developer
11 12 (5.19%) Elasticsearch Engineer
12 11 (4.76%) Analyst
13 9 (3.90%) AWS Engineer
14 8 (3.46%) Full Stack Developer
14 8 (3.46%) Senior Developer
Libraries, Frameworks & Software Standards
1 65 (28.14%) Kafka
2 21 (9.09%) AngularJS
3 15 (6.49%) Akka
3 15 (6.49%) JSON
4 13 (5.63%) HTML
5 12 (5.19%) Spring
5 12 (5.19%) XML
6 10 (4.33%) HTML5
6 10 (4.33%) JMS
6 10 (4.33%) React
6 10 (4.33%) REST
7 9 (3.90%) RESTful
8 7 (3.03%) scikit-learn
8 7 (3.03%) Web Services
9 6 (2.60%) J2EE
9 6 (2.60%) Natural Language Processing
9 6 (2.60%) PySpark
9 6 (2.60%) SOAP
9 6 (2.60%) TensorFlow
9 6 (2.60%) WPF
Miscellaneous
1 26 (11.26%) Analytical Skills
2 20 (8.66%) Algorithms
3 13 (5.63%) Computer Science
4 11 (4.76%) Greenfield Project
5 9 (3.90%) Data Structures
6 8 (3.46%) Data Centre
6 8 (3.46%) User Experience
7 4 (1.73%) Linux Command Line
8 3 (1.30%) Derivative
8 3 (1.30%) Fintech
8 3 (1.30%) Management Information System
8 3 (1.30%) Market Risk
9 2 (0.87%) Clustering
9 2 (0.87%) Credit Risk
9 2 (0.87%) Foreign Exchange (FX)
9 2 (0.87%) Grid Computing
9 2 (0.87%) Interest Rate Derivative
9 2 (0.87%) Life Science
9 2 (0.87%) Replication
9 2 (0.87%) Social Network
Operating Systems
1 37 (16.02%) Linux
2 12 (5.19%) Unix
3 7 (3.03%) Red Hat Enterprise Linux
4 6 (2.60%) Windows
5 4 (1.73%) CentOS
5 4 (1.73%) Ubuntu
6 3 (1.30%) DC/OS
6 3 (1.30%) Windows Server
7 2 (0.87%) Windows 10
7 2 (0.87%) Windows Server 2008
8 1 (0.43%) Android
8 1 (0.43%) Apple iOS
Processes & Methodologies
1 89 (38.53%) Agile Software Development
2 79 (34.20%) Analytics
3 48 (20.78%) ETL
4 42 (18.18%) DevOps
5 33 (14.29%) Data Science
5 33 (14.29%) Machine Learning
6 32 (13.85%) TDD
7 29 (12.55%) Data Engineering
8 27 (11.69%) Data Modelling
8 27 (11.69%) Scrum
9 24 (10.39%) Data Analytics
10 23 (9.96%) MapReduce
11 22 (9.52%) Business Intelligence
11 22 (9.52%) Problem-Solving
12 21 (9.09%) Continuous Integration
12 21 (9.09%) Microservices
13 19 (8.23%) Open Source
13 19 (8.23%) Software Engineering
14 17 (7.36%) Visualisation
15 15 (6.49%) Migration
Programming Languages
1 113 (48.92%) Java
2 94 (40.69%) Python
3 65 (28.14%) SQL
4 62 (26.84%) Scala
5 35 (15.15%) Java 8
6 22 (9.52%) R
7 16 (6.93%) JavaScript
8 15 (6.49%) C#
9 12 (5.19%) Bash Shell
10 11 (4.76%) Shell Script
11 8 (3.46%) Go
12 7 (3.03%) C
13 6 (2.60%) PowerShell
14 5 (2.16%) C++
14 5 (2.16%) Perl
15 4 (1.73%) PL/SQL
16 3 (1.30%) Ruby
16 3 (1.30%) T-SQL
17 2 (0.87%) Julia
18 1 (0.43%) ES6
Qualifications
1 16 (6.93%) Degree
2 5 (2.16%) Computer Science Degree
2 5 (2.16%) Numerate Degree
2 5 (2.16%) Security Cleared
3 4 (1.73%) DV Cleared
3 4 (1.73%) PhD
4 2 (0.87%) CISSP
5 1 (0.43%) Master's Degree
5 1 (0.43%) MCSD
5 1 (0.43%) Microsoft Certification
5 1 (0.43%) PRINCE2 Certification
5 1 (0.43%) SAFe Agilist
5 1 (0.43%) SC Cleared
5 1 (0.43%) TOGAF Certification
Quality Assurance & Compliance
1 7 (3.03%) GCP
2 6 (2.60%) Data Quality
2 6 (2.60%) QA
3 4 (1.73%) GDPR
4 3 (1.30%) MiFID
5 2 (0.87%) Dodd-Frank
5 2 (0.87%) EMIR
5 2 (0.87%) IFRS
5 2 (0.87%) IFRS 9
System Software
1 39 (16.88%) HDFS
2 22 (9.52%) Docker
3 15 (6.49%) Apache Flume
4 7 (3.03%) Apache ZooKeeper
5 2 (0.87%) Active Directory
Systems Management
1 19 (8.23%) Ansible
2 14 (6.06%) Oozie
3 13 (5.63%) Kubernetes
4 9 (3.90%) Hadoop YARN
4 9 (3.90%) Mesos
5 5 (2.16%) Kibana
5 5 (2.16%) Terraform
6 4 (1.73%) Puppet
6 4 (1.73%) Salt
7 3 (1.30%) logstash
8 2 (0.87%) Ambari
8 2 (0.87%) CASB
8 2 (0.87%) Opscode Chef
9 1 (0.43%) BladeLogic
9 1 (0.43%) Docker Swarm
9 1 (0.43%) HP ALM
9 1 (0.43%) Rsyslog
9 1 (0.43%) Rundeck
Vendors
1 26 (11.26%) Cloudera
2 23 (9.96%) Oracle
3 18 (7.79%) Hortonworks
3 18 (7.79%) Tableau
4 15 (6.49%) Microsoft
5 8 (3.46%) Splunk
6 7 (3.03%) Google
6 7 (3.03%) MapR
7 5 (2.16%) Talend
8 4 (1.73%) Hitachi
8 4 (1.73%) Salesforce.com
8 4 (1.73%) SaltStack
8 4 (1.73%) SAP
9 3 (1.30%) Informatica
9 3 (1.30%) Vertica
10 2 (0.87%) Alteryx
10 2 (0.87%) Cognos
10 2 (0.87%) IBM
10 2 (0.87%) Pega
10 2 (0.87%) Red Hat