Period
to 21 August 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 21 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
21 Aug 2018
Same period 2017 Same period 2016
Rank 68 54 88
Rank change year-on-year -14 +34 +15
Contract jobs citing Big Data 262 299 190
As % of all contract IT jobs advertised in the City of London 3.73% 4.51% 2.81%
As % of the Database & Business Intelligence category 14.38% 17.26% 11.45%
Number of daily rates quoted 222 251 146
City of London median daily rate £575 £550 £531
Median daily rate % change year-on-year +4.55% +3.53% -7.61%
10th Percentile £426 £413 £388
90th Percentile £713 £725 £713
Central London median daily rate £550 £550 £538
% change year-on-year - +2.33% -6.52%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,822 1,732 1,660
As % of all contract IT jobs advertised in the City of London 25.97% 26.14% 24.56%
Number of daily rates quoted 1,440 1,348 1,308
City of London median daily rate £525 £513 £475
Median daily rate % change year-on-year +2.44% +7.89% +5.56%
10th Percentile £366 £356 £319
90th Percentile £675 £675 £638
Central London median daily rate £525 £500 £473
% change year-on-year +5.00% +5.82% +5.00%
Number of hourly rates quoted 12 6 8
City of London median hourly rate £21.75 £22.99 £19.00
Median hourly rate % change year-on-year -5.40% +21.01% -45.71%
10th Percentile £19.50 £20.75 £15.83
90th Percentile £32.70 £31.44 £26.72
Central London median hourly rate £22.00 £24.49 £19.00
% change year-on-year -10.15% +28.87% -30.44%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 21 August 2018.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 21 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -11 15 £525 +16.67%
Big Data
Central London

For the 6 months to 21 August 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 164 (62.60%) Hadoop
2 110 (41.98%) Java
3 107 (40.84%) Apache Spark
4 105 (40.08%) Python
5 99 (37.79%) Agile Software Development
6 88 (33.59%) Apache Hive
7 84 (32.06%) Finance
8 82 (31.30%) SQL
9 79 (30.15%) Amazon AWS
10 78 (29.77%) Kafka
11 63 (24.05%) Analytics
12 52 (19.85%) ETL
13 50 (19.08%) Scala
14 49 (18.70%) Java 8
15 46 (17.56%) Elasticsearch
16 45 (17.18%) Microservices
17 43 (16.41%) Data Science
18 42 (16.03%) Scrum
19 41 (15.65%) MongoDB
20 40 (15.27%) HDFS
20 40 (15.27%) AngularJS
20 40 (15.27%) Linux
21 38 (14.50%) Machine Learning
22 36 (13.74%) NoSQL
23 35 (13.36%) DevOps
24 34 (12.98%) Jenkins
25 33 (12.60%) TDD
26 32 (12.21%) SQL Server
26 32 (12.21%) Kubernetes
27 31 (11.83%) Continuous Integration

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 107 (40.84%) Apache Spark
2 46 (17.56%) Elasticsearch
3 15 (5.73%) Apache
4 12 (4.58%) Apache Pig
5 6 (2.29%) Apache Airflow
5 6 (2.29%) Apache Solr
6 5 (1.91%) SAS
7 4 (1.53%) Confluence
8 2 (0.76%) Cloud Foundry
8 2 (0.76%) Jetty
8 2 (0.76%) Luigi
8 2 (0.76%) Tomcat
8 2 (0.76%) WebSphere
9 1 (0.38%) CMS
9 1 (0.38%) EPiServer
9 1 (0.38%) OpenStack
9 1 (0.38%) Oracle Coherence
9 1 (0.38%) Oracle SOA Suite
9 1 (0.38%) Sitecore CMS
9 1 (0.38%) WordPress
Applications
1 18 (6.87%) Microsoft Excel
2 15 (5.73%) MS Visio
3 2 (0.76%) Microsoft Office
3 2 (0.76%) Microsoft PowerPoint
4 1 (0.38%) Chatbot
4 1 (0.38%) Spreadsheet
Business Applications
1 2 (0.76%) Salesforce.com CRM
2 1 (0.38%) Distributed Ledger
2 1 (0.38%) Dynamics CRM
2 1 (0.38%) Eloqua
2 1 (0.38%) ION MarketView
2 1 (0.38%) Payment Gateway
2 1 (0.38%) Temenos T24
Cloud Services
1 79 (30.15%) Amazon AWS
2 27 (10.31%) Microsoft Azure
3 24 (9.16%) Amazon S3
4 17 (6.49%) Google Cloud Platform
5 14 (5.34%) Amazon EC2
5 14 (5.34%) Virtual Private Cloud
6 12 (4.58%) Amazon EMR
6 12 (4.58%) Heroku
7 8 (3.05%) GitHub
8 7 (2.67%) Serverless
9 6 (2.29%) Amazon Kinesis
9 6 (2.29%) Cloud Computing
10 4 (1.53%) IBM Cloud
11 3 (1.15%) AWS Lambda
11 3 (1.15%) Azure Data Factory
12 2 (0.76%) Data Lake Analytics
12 2 (0.76%) SaaS
12 2 (0.76%) Salesforce Sales Cloud
12 2 (0.76%) Salesforce Service Cloud
13 1 (0.38%) PaaS
Communications & Networking
1 15 (5.73%) HTTP
2 13 (4.96%) DNS
2 13 (4.96%) SSL
2 13 (4.96%) TCP/IP
3 12 (4.58%) FTP
4 4 (1.53%) Firewall
5 2 (0.76%) Kerberos
5 2 (0.76%) WAN
6 1 (0.38%) DSL
6 1 (0.38%) HTTPS
6 1 (0.38%) Intranet
6 1 (0.38%) Intrusion Detection
6 1 (0.38%) LAN
6 1 (0.38%) NAS
6 1 (0.38%) PABX
6 1 (0.38%) SAN
6 1 (0.38%) SNA
6 1 (0.38%) VoIP
6 1 (0.38%) VPN
Database & Business Intelligence
1 164 (62.60%) Hadoop
2 88 (33.59%) Apache Hive
3 41 (15.65%) MongoDB
4 36 (13.74%) NoSQL
5 32 (12.21%) SQL Server
6 30 (11.45%) Apache Cassandra
7 29 (11.07%) HBase
8 26 (9.92%) Data Warehouse
8 26 (9.92%) Sqoop
9 24 (9.16%) Relational Database
10 22 (8.40%) Impala
11 16 (6.11%) Amazon Redshift
12 14 (5.34%) Data Lake
13 13 (4.96%) PostgreSQL
14 12 (4.58%) MySQL
15 11 (4.20%) SQL Server Integration Services
16 8 (3.05%) Power BI
17 7 (2.67%) RDBMS
18 6 (2.29%) Data Mining
19 5 (1.91%) SQL Server Reporting Services
Development Applications
1 34 (12.98%) Jenkins
2 27 (10.31%) Git (software)
3 23 (8.78%) Maven
4 15 (5.73%) GitLab
5 14 (5.34%) JIRA
6 13 (4.96%) Gradle
7 12 (4.58%) gulp
8 2 (0.76%) Bitbucket
8 2 (0.76%) Mocha
8 2 (0.76%) Selenium
8 2 (0.76%) Sonatype Nexus
8 2 (0.76%) Travis CI
9 1 (0.38%) ERwin
9 1 (0.38%) Jasmine
9 1 (0.38%) SpecFlow
9 1 (0.38%) Subversion
9 1 (0.38%) TeamCity
9 1 (0.38%) Visual Studio
9 1 (0.38%) Visual Studio Team System
9 1 (0.38%) Xcode
General
1 84 (32.06%) Finance
2 19 (7.25%) Banking
3 11 (4.20%) Marketing
4 6 (2.29%) Advertising
4 6 (2.29%) Front Office
4 6 (2.29%) Retail
5 5 (1.91%) Games
6 4 (1.53%) Financial Institution
6 4 (1.53%) Investment Banking
7 3 (1.15%) Law
7 3 (1.15%) Legal
7 3 (1.15%) Publishing
8 2 (0.76%) Electronics
8 2 (0.76%) Telecoms
9 1 (0.38%) Manufacturing
9 1 (0.38%) Private Banking
Job Titles
1 89 (33.97%) Developer
2 55 (20.99%) Big Data Engineer
3 45 (17.18%) Data Engineer
4 35 (13.36%) Java Developer
5 27 (10.31%) Senior Developer
6 26 (9.92%) Hadoop Engineer
7 23 (8.78%) Big Data Developer
8 22 (8.40%) Java Engineer
9 21 (8.02%) Senior Hadoop Engineer
9 21 (8.02%) Senior Java Engineer
10 20 (7.63%) Elasticsearch Engineer
11 19 (7.25%) Architect
11 19 (7.25%) Senior Java Developer
12 18 (6.87%) Data Scientist
13 13 (4.96%) Platform Engineer
13 13 (4.96%) Python Engineer
14 12 (4.58%) Data Architect
14 12 (4.58%) Lead Developer
15 11 (4.20%) Analyst
15 11 (4.20%) DevOps Engineer
Libraries, Frameworks & Software Standards
1 78 (29.77%) Kafka
2 40 (15.27%) AngularJS
3 29 (11.07%) REST
4 21 (8.02%) CSS
4 21 (8.02%) HTML
4 21 (8.02%) Spring Boot
5 20 (7.63%) Spring
6 18 (6.87%) JSON
6 18 (6.87%) SOAP
7 16 (6.11%) HTML5
8 15 (5.73%) OAuth
8 15 (5.73%) OAuth2
9 12 (4.58%) Dropwizard
9 12 (4.58%) Ember.js
9 12 (4.58%) Guice
9 12 (4.58%) Ratpack
10 10 (3.82%) React
11 9 (3.44%) .NET
11 9 (3.44%) Natural Language Processing
12 7 (2.67%) JMS
Miscellaneous
1 20 (7.63%) Algorithms
2 16 (6.11%) Greenfield Project
3 14 (5.34%) Analytical Skills
3 14 (5.34%) Wiki
4 11 (4.20%) Computer Science
5 6 (2.29%) Fintech
6 5 (1.91%) Data Structures
6 5 (1.91%) Linux Command Line
6 5 (1.91%) User Experience
7 4 (1.53%) Data Centre
8 3 (1.15%) Management Information System
8 3 (1.15%) Self-Motivation
9 2 (0.76%) iPad
9 2 (0.76%) Online Games
9 2 (0.76%) Virtual Team
10 1 (0.38%) Hybrid Cloud
10 1 (0.38%) iSeries
10 1 (0.38%) Private Cloud
10 1 (0.38%) Social Media
10 1 (0.38%) Social Network
Operating Systems
1 40 (15.27%) Linux
2 22 (8.40%) Unix
3 15 (5.73%) Windows
4 4 (1.53%) Red Hat Enterprise Linux
5 2 (0.76%) Android
5 2 (0.76%) CentOS
5 2 (0.76%) CoreOS
5 2 (0.76%) DC/OS
6 1 (0.38%) Apple iOS
6 1 (0.38%) HPUX
6 1 (0.38%) Solaris
6 1 (0.38%) Windows 7
6 1 (0.38%) Windows Server
6 1 (0.38%) zOS
Processes & Methodologies
1 99 (37.79%) Agile Software Development
2 63 (24.05%) Analytics
3 52 (19.85%) ETL
4 45 (17.18%) Microservices
5 43 (16.41%) Data Science
6 42 (16.03%) Scrum
7 38 (14.50%) Machine Learning
8 35 (13.36%) DevOps
9 33 (12.60%) TDD
10 31 (11.83%) Continuous Integration
11 24 (9.16%) Data Modelling
12 23 (8.78%) Business Intelligence
12 23 (8.78%) MapReduce
13 22 (8.40%) Data Analysis
14 21 (8.02%) Test Automation
15 19 (7.25%) Data Analytics
15 19 (7.25%) Mathematics
16 18 (6.87%) Software Engineering
17 16 (6.11%) Data Extraction
17 16 (6.11%) Visualisation
Programming Languages
1 110 (41.98%) Java
2 105 (40.08%) Python
3 82 (31.30%) SQL
4 50 (19.08%) Scala
5 49 (18.70%) Java 8
6 25 (9.54%) JavaScript
7 24 (9.16%) R
8 20 (7.63%) Bash Shell
9 15 (5.73%) PowerShell
10 14 (5.34%) ES6
10 14 (5.34%) Shell Script
11 13 (4.96%) Korn
11 13 (4.96%) TypeScript
12 12 (4.58%) C#
13 10 (3.82%) T-SQL
14 6 (2.29%) Clojure
14 6 (2.29%) MATLAB
15 5 (1.91%) C
15 5 (1.91%) C++
15 5 (1.91%) PL/SQL
Qualifications
1 11 (4.20%) PhD
2 9 (3.44%) Security Cleared
3 8 (3.05%) Degree
4 7 (2.67%) SC Cleared
5 3 (1.15%) Numerate Degree
6 2 (0.76%) DV Cleared
7 1 (0.38%) AWS Certification
7 1 (0.38%) CISA
7 1 (0.38%) CISSP
7 1 (0.38%) Computer Science Degree
7 1 (0.38%) Microsoft Certification
7 1 (0.38%) SAFe Agilist
Quality Assurance & Compliance
1 10 (3.82%) QA
2 8 (3.05%) Data Quality
2 8 (3.05%) GCP
3 3 (1.15%) GDPR
3 3 (1.15%) MiFID
4 2 (0.76%) EMIR
4 2 (0.76%) IFRS
4 2 (0.76%) IFRS 9
5 1 (0.38%) PMO
System Software
1 40 (15.27%) HDFS
2 30 (11.45%) Docker
3 9 (3.44%) Apache Flume
4 5 (1.91%) Apache ZooKeeper
5 1 (0.38%) Oracle RAC
5 1 (0.38%) VirtualBox
5 1 (0.38%) VMware Infrastructure
Systems Management
1 32 (12.21%) Kubernetes
2 26 (9.92%) Ansible
3 23 (8.78%) Puppet
4 22 (8.40%) Hadoop YARN
5 14 (5.34%) Opscode Chef
6 12 (4.58%) Docker Swarm
7 9 (3.44%) Oozie
8 7 (2.67%) Terraform
9 4 (1.53%) Prometheus
10 3 (1.15%) Kibana
11 2 (0.76%) Ambari
11 2 (0.76%) logstash
11 2 (0.76%) Mesos
12 1 (0.38%) Packer
Vendors
1 30 (11.45%) Oracle
2 28 (10.69%) Cloudera
3 14 (5.34%) Hortonworks
3 14 (5.34%) Tableau
4 13 (4.96%) Google
4 13 (4.96%) Microsoft
5 6 (2.29%) IBM
6 4 (1.53%) Alteryx
6 4 (1.53%) Informatica
6 4 (1.53%) Salesforce.com
6 4 (1.53%) Splunk
7 3 (1.15%) Red Hat
8 2 (0.76%) Capita
8 2 (0.76%) MapR
8 2 (0.76%) New Relic
8 2 (0.76%) Pega
8 2 (0.76%) Talend
8 2 (0.76%) Telerik
8 2 (0.76%) Teradata
9 1 (0.38%) Salesforce Marketing Cloud