Period
to 15 October 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 15 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
15 Oct 2018
Same period 2017 Same period 2016
Rank 65 50 72
Rank change year-on-year -15 +22 +26
Contract jobs citing Big Data 252 290 218
As % of all contract IT jobs advertised in the City of London 3.60% 4.27% 3.29%
As % of the Database & Business Intelligence category 14.20% 17.39% 13.12%
Number of daily rates quoted 218 246 172
City of London median daily rate £575 £575 £550
Median daily rate % change year-on-year - +4.55% -
10th Percentile £421 £450 £409
90th Percentile £700 £725 £724
Central London median daily rate £575 £575 £550
% change year-on-year - +4.55% -1.12%
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,775 1,668 1,662
As % of all contract IT jobs advertised in the City of London 25.35% 24.58% 25.06%
Number of daily rates quoted 1,401 1,317 1,320
City of London median daily rate £525 £525 £474
Median daily rate % change year-on-year - +10.82% +2.43%
10th Percentile £375 £363 £325
90th Percentile £675 £675 £663
Central London median daily rate £525 £513 £463
% change year-on-year +2.44% +10.81% +2.78%
Number of hourly rates quoted 14 9 3
City of London median hourly rate £27.25 £27.50 £19.00
Median hourly rate % change year-on-year -0.91% +44.74% -24.00%
10th Percentile £19.50 £20.75 £16.60
90th Percentile £40.66 £33.25 £41.90
Central London median hourly rate £27.25 £27.50 £19.00
% change year-on-year -0.91% +44.74% -15.56%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 15 October 2018.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 15 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -11 28 £525 +16.67%
Big Data
Central London

For the 6 months to 15 October 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 153 (60.71%) Hadoop
2 109 (43.25%) Apache Spark
3 103 (40.87%) Java
4 95 (37.70%) Python
5 90 (35.71%) Finance
5 90 (35.71%) Kafka
6 85 (33.73%) Agile Software Development
7 84 (33.33%) Apache Hive
8 79 (31.35%) SQL
9 68 (26.98%) Amazon AWS
10 56 (22.22%) Analytics
11 48 (19.05%) Data Science
12 47 (18.65%) Machine Learning
13 46 (18.25%) Java 8
14 45 (17.86%) Elasticsearch
15 41 (16.27%) Scrum
16 39 (15.48%) Microservices
16 39 (15.48%) Docker
16 39 (15.48%) MongoDB
17 38 (15.08%) Scala
17 38 (15.08%) DevOps
17 38 (15.08%) Jenkins
18 37 (14.68%) ETL
19 35 (13.89%) Kubernetes
20 34 (13.49%) Data Warehouse
21 33 (13.10%) SQL Server
21 33 (13.10%) AngularJS
22 32 (12.70%) NoSQL
23 31 (12.30%) Apache Cassandra
23 31 (12.30%) Ansible

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 109 (43.25%) Apache Spark
2 45 (17.86%) Elasticsearch
3 12 (4.76%) Apache
4 9 (3.57%) Apache Pig
5 7 (2.78%) Apache Airflow
6 4 (1.59%) Confluence
6 4 (1.59%) Oracle Coherence
6 4 (1.59%) Oracle SOA Suite
7 3 (1.19%) Apache Solr
7 3 (1.19%) Luigi
8 2 (0.79%) Cloud Foundry
8 2 (0.79%) Jetty
8 2 (0.79%) SAS
8 2 (0.79%) Tomcat
8 2 (0.79%) WebSphere
9 1 (0.40%) OpenStack
9 1 (0.40%) WordPress
Applications
1 18 (7.14%) Microsoft Excel
2 15 (5.95%) MS Visio
3 2 (0.79%) Microsoft Office
3 2 (0.79%) Microsoft PowerPoint
4 1 (0.40%) Chatbot
4 1 (0.40%) Microsoft Project
4 1 (0.40%) Open Workbench
4 1 (0.40%) Spreadsheet
Business Applications
1 2 (0.79%) SAP Oil and Gas
2 1 (0.40%) Distributed Ledger
2 1 (0.40%) Payment Gateway
2 1 (0.40%) Salesforce.com CRM
2 1 (0.40%) SAP MM
2 1 (0.40%) SAP R/3
Cloud Services
1 68 (26.98%) Amazon AWS
2 25 (9.92%) Microsoft Azure
3 21 (8.33%) Amazon S3
4 15 (5.95%) Amazon EC2
5 14 (5.56%) Google Cloud Platform
5 14 (5.56%) Virtual Private Cloud
6 12 (4.76%) Heroku
7 10 (3.97%) Amazon EMR
8 9 (3.57%) GitHub
9 6 (2.38%) Serverless
10 5 (1.98%) Amazon Kinesis
10 5 (1.98%) IBM Cloud
11 4 (1.59%) Cloud Computing
12 3 (1.19%) AWS Lambda
13 1 (0.40%) Azure Data Factory
13 1 (0.40%) Azure Machine Learning
13 1 (0.40%) Data Lake Analytics
13 1 (0.40%) SaaS
13 1 (0.40%) Salesforce Sales Cloud
13 1 (0.40%) Salesforce Service Cloud
Communications & Networking
1 13 (5.16%) DNS
1 13 (5.16%) HTTP
1 13 (5.16%) SSL
1 13 (5.16%) TCP/IP
2 12 (4.76%) FTP
3 4 (1.59%) Firewall
4 3 (1.19%) WAN
5 2 (0.79%) LAN
6 1 (0.40%) DSL
6 1 (0.40%) HTTPS
6 1 (0.40%) Intranet
6 1 (0.40%) Intrusion Detection
6 1 (0.40%) Kerberos
6 1 (0.40%) NAS
6 1 (0.40%) PABX
6 1 (0.40%) SAN
6 1 (0.40%) SNA
6 1 (0.40%) VoIP
6 1 (0.40%) VPN
6 1 (0.40%) Wi-Fi
Database & Business Intelligence
1 153 (60.71%) Hadoop
2 84 (33.33%) Apache Hive
3 39 (15.48%) MongoDB
4 34 (13.49%) Data Warehouse
5 33 (13.10%) SQL Server
6 32 (12.70%) NoSQL
7 31 (12.30%) Apache Cassandra
8 28 (11.11%) Sqoop
9 21 (8.33%) HBase
10 18 (7.14%) Relational Database
11 17 (6.75%) Impala
12 14 (5.56%) Star Schema
13 12 (4.76%) PostgreSQL
13 12 (4.76%) SQL Server Integration Services
14 11 (4.37%) OLAP
15 10 (3.97%) MySQL
16 9 (3.57%) Amazon Redshift
16 9 (3.57%) Data Lake
16 9 (3.57%) Enterprise Data Warehouse
16 9 (3.57%) OLAP Cube
Development Applications
1 38 (15.08%) Jenkins
2 26 (10.32%) Git (software)
3 21 (8.33%) Maven
4 14 (5.56%) GitLab
5 13 (5.16%) Gradle
6 12 (4.76%) gulp
6 12 (4.76%) JIRA
7 3 (1.19%) Mocha
7 3 (1.19%) Selenium
7 3 (1.19%) Visual Studio
7 3 (1.19%) Visual Studio Team System
8 2 (0.79%) Bitbucket
8 2 (0.79%) Sonatype Nexus
8 2 (0.79%) Subversion
8 2 (0.79%) Travis CI
8 2 (0.79%) Xcode
9 1 (0.40%) Babel
9 1 (0.40%) LSMW
9 1 (0.40%) TestRail
9 1 (0.40%) webpack
General
1 90 (35.71%) Finance
2 18 (7.14%) Banking
3 8 (3.17%) Marketing
4 7 (2.78%) Front Office
5 5 (1.98%) Retail
6 4 (1.59%) Financial Institution
6 4 (1.59%) Games
6 4 (1.59%) Law
6 4 (1.59%) Publishing
6 4 (1.59%) Telecoms
7 3 (1.19%) Advertising
8 2 (0.79%) Electronics
8 2 (0.79%) Investment Banking
8 2 (0.79%) Legal
8 2 (0.79%) Manufacturing
9 1 (0.40%) Corporate Banking
Job Titles
1 88 (34.92%) Developer
2 53 (21.03%) Big Data Engineer
3 46 (18.25%) Data Engineer
4 40 (15.87%) Java Developer
5 35 (13.89%) Senior Developer
6 33 (13.10%) Hadoop Engineer
7 27 (10.71%) Senior Java Developer
8 21 (8.33%) Java Engineer
9 20 (7.94%) Senior Java Engineer
10 19 (7.54%) Big Data Developer
10 19 (7.54%) Senior Hadoop Engineer
11 18 (7.14%) Elasticsearch Engineer
12 16 (6.35%) Data Scientist
13 13 (5.16%) DevOps Engineer
13 13 (5.16%) Platform Engineer
14 12 (4.76%) Architect
14 12 (4.76%) Lead Developer
15 11 (4.37%) Analyst
16 9 (3.57%) Data Architect
16 9 (3.57%) Technical Leader
Libraries, Frameworks & Software Standards
1 90 (35.71%) Kafka
2 33 (13.10%) AngularJS
3 24 (9.52%) REST
4 21 (8.33%) Spring Boot
5 18 (7.14%) CSS
6 17 (6.75%) HTML
6 17 (6.75%) Spring
7 15 (5.95%) OAuth
7 15 (5.95%) OAuth2
8 14 (5.56%) HTML5
8 14 (5.56%) SOAP
9 13 (5.16%) JSON
10 12 (4.76%) Dropwizard
10 12 (4.76%) Ember.js
10 12 (4.76%) Guice
10 12 (4.76%) NumPy
10 12 (4.76%) Ratpack
11 11 (4.37%) Pandas
11 11 (4.37%) PySpark
12 8 (3.17%) React
Miscellaneous
1 19 (7.54%) Algorithms
2 16 (6.35%) Greenfield Project
3 13 (5.16%) Analytical Skills
3 13 (5.16%) Wiki
4 8 (3.17%) Computer Science
5 6 (2.38%) Fintech
6 5 (1.98%) Market Risk
7 4 (1.59%) Foreign Exchange (FX)
8 3 (1.19%) Data Structures
8 3 (1.19%) Management Information System
8 3 (1.19%) User Experience
9 2 (0.79%) Data Centre
9 2 (0.79%) Equities
9 2 (0.79%) iPad
9 2 (0.79%) Linux Command Line
9 2 (0.79%) Self-Motivation
9 2 (0.79%) Virtual Team
10 1 (0.40%) Hybrid Cloud
10 1 (0.40%) Life Science
10 1 (0.40%) Robotics
Operating Systems
1 29 (11.51%) Linux
2 21 (8.33%) Unix
3 15 (5.95%) Windows
4 3 (1.19%) Android
4 3 (1.19%) Red Hat Enterprise Linux
5 2 (0.79%) Apple iOS
5 2 (0.79%) CentOS
5 2 (0.79%) CoreOS
6 1 (0.40%) DC/OS
6 1 (0.40%) HPUX
6 1 (0.40%) Solaris
6 1 (0.40%) Windows 7
6 1 (0.40%) Windows Server
6 1 (0.40%) zOS
Processes & Methodologies
1 85 (33.73%) Agile Software Development
2 56 (22.22%) Analytics
3 48 (19.05%) Data Science
4 47 (18.65%) Machine Learning
5 41 (16.27%) Scrum
6 39 (15.48%) Microservices
7 38 (15.08%) DevOps
8 37 (14.68%) ETL
9 29 (11.51%) Continuous Integration
10 27 (10.71%) Data Modelling
10 27 (10.71%) TDD
11 24 (9.52%) Business Intelligence
11 24 (9.52%) Data Analysis
12 21 (8.33%) MapReduce
13 20 (7.94%) Software Engineering
13 20 (7.94%) Test Automation
14 17 (6.75%) Visualisation
15 16 (6.35%) Data Extraction
15 16 (6.35%) Mathematics
16 15 (5.95%) Artificial Intelligence
Programming Languages
1 103 (40.87%) Java
2 95 (37.70%) Python
3 79 (31.35%) SQL
4 46 (18.25%) Java 8
5 38 (15.08%) Scala
6 24 (9.52%) JavaScript
7 20 (7.94%) R
8 19 (7.54%) Bash Shell
9 14 (5.56%) ES6
9 14 (5.56%) PowerShell
10 13 (5.16%) Korn
10 13 (5.16%) Shell Script
10 13 (5.16%) TypeScript
11 10 (3.97%) T-SQL
12 9 (3.57%) C#
13 7 (2.78%) Clojure
14 5 (1.98%) MATLAB
14 5 (1.98%) PL/SQL
15 4 (1.59%) Groovy
16 3 (1.19%) Ruby
Qualifications
1 8 (3.17%) PhD
2 6 (2.38%) Degree
2 6 (2.38%) SC Cleared
2 6 (2.38%) Security Cleared
3 2 (0.79%) Computer Science Degree
4 1 (0.40%) AWS Certification
4 1 (0.40%) CISA
4 1 (0.40%) CISSP
4 1 (0.40%) IIBA
4 1 (0.40%) Microsoft Certification
4 1 (0.40%) Numerate Degree
4 1 (0.40%) PMI Certification
Quality Assurance & Compliance
1 14 (5.56%) Data Quality
2 10 (3.97%) QA
3 2 (0.79%) EMIR
3 2 (0.79%) MiFID
4 1 (0.40%) GDPR
4 1 (0.40%) PMO
System Software
1 39 (15.48%) Docker
2 29 (11.51%) HDFS
3 10 (3.97%) Apache Flume
4 4 (1.59%) Apache ZooKeeper
5 3 (1.19%) Oracle RAC
6 1 (0.40%) VirtualBox
6 1 (0.40%) VMware Infrastructure
Systems Management
1 35 (13.89%) Kubernetes
2 31 (12.30%) Ansible
3 25 (9.92%) Puppet
4 22 (8.73%) Hadoop YARN
5 19 (7.54%) Oozie
6 16 (6.35%) Opscode Chef
7 12 (4.76%) Docker Swarm
8 8 (3.17%) Terraform
9 4 (1.59%) Prometheus
10 3 (1.19%) Ambari
11 2 (0.79%) Kibana
11 2 (0.79%) logstash
12 1 (0.40%) Mesos
12 1 (0.40%) Packer
Vendors
1 30 (11.90%) Oracle
2 21 (8.33%) Cloudera
3 17 (6.75%) Tableau
4 16 (6.35%) Microsoft
5 15 (5.95%) Hortonworks
6 11 (4.37%) Google
7 6 (2.38%) IBM
8 5 (1.98%) MapR
8 5 (1.98%) Splunk
9 3 (1.19%) Alteryx
9 3 (1.19%) Informatica
9 3 (1.19%) SAP
10 2 (0.79%) New Relic
10 2 (0.79%) Red Hat
10 2 (0.79%) Talend
10 2 (0.79%) Teradata
11 1 (0.40%) Ab Initio
11 1 (0.40%) Palantir
11 1 (0.40%) ServiceNow
11 1 (0.40%) VMware