Period
to 17 December 2018

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 17 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
17 Dec 2018
Same period 2017 Same period 2016
Rank 66 65 50
Rank change year-on-year -1 -15 +43
Contract jobs citing Big Data 259 270 281
As % of all contract IT jobs advertised in the City of London 3.65% 3.78% 4.33%
As % of the Database & Business Intelligence category 14.55% 15.27% 16.09%
Number of daily rates quoted 216 233 221
City of London median daily rate £575 £580 £575
Median daily rate % change year-on-year -0.86% +0.87% +4.55%
10th Percentile £434 £450 £413
90th Percentile £713 £725 £713
Central London median daily rate £575 £575 £575
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,780 1,768 1,746
As % of all contract IT jobs advertised in the City of London 25.08% 24.74% 26.90%
Number of daily rates quoted 1,418 1,455 1,390
City of London median daily rate £525 £525 £475
Median daily rate % change year-on-year - +10.53% -
10th Percentile £375 £369 £325
90th Percentile £675 £688 £663
Central London median daily rate £525 £520 £475
% change year-on-year +0.96% +9.47% +0.53%
Number of hourly rates quoted 11 9 1
City of London median hourly rate £35.00 £27.50 £45.00
Median hourly rate % change year-on-year +27.27% -38.89% +44.00%
10th Percentile £19.50 £20.75 £42.50
90th Percentile £42.19 £33.25 £47.50
Central London median hourly rate £35.00 £27.50 £45.00
% change year-on-year +27.27% -38.89% +91.59%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 17 December 2018.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 17 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge -23 35 £550 +22.22%
Big Data
Central London

For the 6 months to 17 December 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 157 (60.62%) Hadoop
2 117 (45.17%) Apache Spark
3 103 (39.77%) Kafka
4 102 (39.38%) Finance
5 91 (35.14%) Python
6 89 (34.36%) SQL
7 87 (33.59%) Java
8 85 (32.82%) Apache Hive
9 77 (29.73%) Analytics
10 76 (29.34%) Agile Software Development
11 71 (27.41%) Amazon AWS
12 60 (23.17%) Data Science
13 53 (20.46%) Machine Learning
14 49 (18.92%) Data Warehouse
15 47 (18.15%) Data Modelling
16 42 (16.22%) Docker
17 39 (15.06%) Elasticsearch
17 39 (15.06%) Jenkins
18 38 (14.67%) DevOps
18 38 (14.67%) Kubernetes
19 37 (14.29%) Scrum
20 36 (13.90%) Java 8
20 36 (13.90%) Microsoft Azure
20 36 (13.90%) Git (software)
21 35 (13.51%) Business Intelligence
22 34 (13.13%) ETL
22 34 (13.13%) Linux
23 33 (12.74%) SQL Server
23 33 (12.74%) Data Analysis
24 32 (12.36%) Scala

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 117 (45.17%) Apache Spark
2 39 (15.06%) Elasticsearch
3 13 (5.02%) Apache
4 6 (2.32%) Apache Pig
4 6 (2.32%) Confluence
5 4 (1.54%) Apache Airflow
5 4 (1.54%) Cloud Foundry
5 4 (1.54%) Oracle Coherence
5 4 (1.54%) Oracle SOA Suite
5 4 (1.54%) SAS
6 2 (0.77%) Jetty
6 2 (0.77%) Tomcat
7 1 (0.39%) Apache Solr
7 1 (0.39%) Jupyter
7 1 (0.39%) Luigi
7 1 (0.39%) SharePoint
7 1 (0.39%) WebSphere
7 1 (0.39%) WordPress
Applications
1 11 (4.25%) Microsoft Excel
2 10 (3.86%) MS Visio
3 1 (0.39%) Microsoft Project
3 1 (0.39%) Open Workbench
Business Applications
1 2 (0.77%) SAP Oil and Gas
2 1 (0.39%) Distributed Ledger
2 1 (0.39%) Dynamics NAV
2 1 (0.39%) SAP MDG
2 1 (0.39%) SAP MM
2 1 (0.39%) SAP R/3
Cloud Services
1 71 (27.41%) Amazon AWS
2 36 (13.90%) Microsoft Azure
3 18 (6.95%) Google Cloud Platform
3 18 (6.95%) Heroku
4 16 (6.18%) Amazon S3
5 12 (4.63%) Amazon EC2
6 11 (4.25%) Amazon EMR
7 10 (3.86%) Virtual Private Cloud
8 7 (2.70%) GitHub
8 7 (2.70%) IBM Cloud
9 3 (1.16%) AWS Lambda
9 3 (1.16%) SaaS
9 3 (1.16%) Serverless
10 2 (0.77%) Cloud Computing
10 2 (0.77%) PaaS
11 1 (0.39%) Adobe Analytics
11 1 (0.39%) Amazon Kinesis
11 1 (0.39%) AWS CloudFormation
11 1 (0.39%) Datadog
11 1 (0.39%) IaaS
Communications & Networking
1 20 (7.72%) HTTP
2 18 (6.95%) TCP/IP
3 17 (6.56%) DNS
3 17 (6.56%) FTP
3 17 (6.56%) SSL
4 3 (1.16%) Firewall
5 2 (0.77%) LAN
5 2 (0.77%) WAN
6 1 (0.39%) DSL
6 1 (0.39%) Kerberos
6 1 (0.39%) NAS
6 1 (0.39%) PABX
6 1 (0.39%) SAN
6 1 (0.39%) SNA
6 1 (0.39%) VoIP
6 1 (0.39%) VPN
6 1 (0.39%) Wi-Fi
Database & Business Intelligence
1 157 (60.62%) Hadoop
2 85 (32.82%) Apache Hive
3 49 (18.92%) Data Warehouse
4 33 (12.74%) SQL Server
5 32 (12.36%) Apache Cassandra
5 32 (12.36%) MongoDB
6 30 (11.58%) Star Schema
7 27 (10.42%) NoSQL
8 24 (9.27%) OLAP
9 21 (8.11%) Enterprise Data Warehouse
9 21 (8.11%) OLAP Cube
10 19 (7.34%) Sqoop
11 18 (6.95%) Data Lake
12 16 (6.18%) Impala
13 15 (5.79%) HBase
14 13 (5.02%) Relational Database
15 12 (4.63%) SQL Server Integration Services
16 11 (4.25%) PostgreSQL
17 10 (3.86%) Power BI
18 9 (3.47%) MySQL
Development Applications
1 39 (15.06%) Jenkins
2 36 (13.90%) Git (software)
3 19 (7.34%) GitLab
4 18 (6.95%) Gradle
5 17 (6.56%) gulp
6 16 (6.18%) Maven
7 14 (5.41%) JIRA
8 5 (1.93%) Sonatype Nexus
9 4 (1.54%) Visual Studio
9 4 (1.54%) Visual Studio Team System
10 3 (1.16%) Subversion
11 2 (0.77%) Bitbucket
11 2 (0.77%) Cucumber
11 2 (0.77%) ERwin
11 2 (0.77%) Mocha
11 2 (0.77%) Selenium
11 2 (0.77%) Travis CI
11 2 (0.77%) Xcode
12 1 (0.39%) FishEye
12 1 (0.39%) Gerrit
General
1 102 (39.38%) Finance
2 22 (8.49%) Banking
3 15 (5.79%) Retail
4 9 (3.47%) Front Office
5 6 (2.32%) Marketing
6 5 (1.93%) Financial Institution
7 4 (1.54%) Law
7 4 (1.54%) Telecoms
8 3 (1.16%) Investment Banking
8 3 (1.16%) Legal
8 3 (1.16%) Publishing
9 1 (0.39%) Corporate Banking
9 1 (0.39%) Electronics
9 1 (0.39%) Games
9 1 (0.39%) Manufacturing
Job Titles
1 88 (33.98%) Developer
2 58 (22.39%) Data Engineer
3 44 (16.99%) Big Data Engineer
4 37 (14.29%) Hadoop Engineer
5 36 (13.90%) Java Developer
6 30 (11.58%) Senior Developer
7 25 (9.65%) Senior Java Developer
8 18 (6.95%) Data Scientist
9 16 (6.18%) Java Engineer
9 16 (6.18%) Technical Leader
10 15 (5.79%) Big Data Developer
10 15 (5.79%) Senior Java Engineer
11 14 (5.41%) Architect
11 14 (5.41%) DevOps Engineer
11 14 (5.41%) Lead Developer
12 12 (4.63%) Data Architect
12 12 (4.63%) Elasticsearch Engineer
12 12 (4.63%) Lead Java Developer
12 12 (4.63%) Scala Developer
12 12 (4.63%) Technical Developer
Libraries, Frameworks & Software Standards
1 103 (39.77%) Kafka
2 31 (11.97%) AngularJS
3 23 (8.88%) Spring
4 22 (8.49%) OAuth
4 22 (8.49%) OAuth2
5 21 (8.11%) CSS
5 21 (8.11%) HTML
5 21 (8.11%) REST
6 19 (7.34%) SOAP
7 18 (6.95%) HTML5
7 18 (6.95%) Spring Boot
8 17 (6.56%) Dropwizard
8 17 (6.56%) Ember.js
8 17 (6.56%) Guice
8 17 (6.56%) Ratpack
9 14 (5.41%) PySpark
10 10 (3.86%) JSON
10 10 (3.86%) NumPy
11 9 (3.47%) Natural Language Processing
11 9 (3.47%) Pandas
Miscellaneous
1 26 (10.04%) Algorithms
2 24 (9.27%) Analytical Skills
3 11 (4.25%) Greenfield Project
4 10 (3.86%) Wiki
5 9 (3.47%) Fintech
6 6 (2.32%) Data Structures
6 6 (2.32%) Market Risk
7 5 (1.93%) Foreign Exchange (FX)
8 4 (1.54%) iPad
9 3 (1.16%) Equities
9 3 (1.16%) Management Information System
9 3 (1.16%) Self-Motivation
10 2 (0.77%) Linux Command Line
10 2 (0.77%) Reference Data
10 2 (0.77%) User Experience
10 2 (0.77%) Virtual Team
11 1 (0.39%) Animation
11 1 (0.39%) iSeries
11 1 (0.39%) Mobile App
11 1 (0.39%) Social Media
Operating Systems
1 34 (13.13%) Linux
2 17 (6.56%) Unix
3 12 (4.63%) Windows
4 2 (0.77%) Android
4 2 (0.77%) Apple iOS
5 1 (0.39%) HPUX
5 1 (0.39%) Red Hat Enterprise Linux
5 1 (0.39%) Solaris
5 1 (0.39%) Windows Server
5 1 (0.39%) zOS
Processes & Methodologies
1 77 (29.73%) Analytics
2 76 (29.34%) Agile Software Development
3 60 (23.17%) Data Science
4 53 (20.46%) Machine Learning
5 47 (18.15%) Data Modelling
6 38 (14.67%) DevOps
7 37 (14.29%) Scrum
8 35 (13.51%) Business Intelligence
9 34 (13.13%) ETL
10 33 (12.74%) Data Analysis
11 31 (11.97%) Microservices
12 23 (8.88%) Continuous Integration
13 22 (8.49%) Artificial Intelligence
14 21 (8.11%) SQL Optimisation
15 20 (7.72%) Visualisation
16 17 (6.56%) Domain-Driven Design
16 17 (6.56%) Open Source
16 17 (6.56%) OWASP
16 17 (6.56%) Test Automation
17 16 (6.18%) Software Engineering
Programming Languages
1 91 (35.14%) Python
2 89 (34.36%) SQL
3 87 (33.59%) Java
4 36 (13.90%) Java 8
5 32 (12.36%) Scala
6 31 (11.97%) JavaScript
7 22 (8.49%) Bash Shell
8 19 (7.34%) ES6
9 18 (6.95%) TypeScript
10 17 (6.56%) R
11 13 (5.02%) PowerShell
12 11 (4.25%) Shell Script
12 11 (4.25%) T-SQL
13 10 (3.86%) Korn
14 9 (3.47%) C#
15 8 (3.09%) PL/SQL
16 6 (2.32%) Groovy
17 3 (1.16%) Clojure
17 3 (1.16%) Kotlin
17 3 (1.16%) Ruby
Qualifications
1 17 (6.56%) Degree
2 8 (3.09%) Master's Degree
3 6 (2.32%) PhD
4 1 (0.39%) AWS Certification
4 1 (0.39%) CISA
4 1 (0.39%) CISSP
4 1 (0.39%) Computer Science Degree
4 1 (0.39%) IIBA
4 1 (0.39%) Numerate Degree
4 1 (0.39%) PMI Certification
4 1 (0.39%) SC Cleared
4 1 (0.39%) Security Cleared
Quality Assurance & Compliance
1 28 (10.81%) Data Quality
2 7 (2.70%) QA
3 2 (0.77%) EMIR
3 2 (0.77%) MiFID
System Software
1 42 (16.22%) Docker
2 21 (8.11%) HDFS
3 12 (4.63%) Apache Flume
4 6 (2.32%) Oracle RAC
5 1 (0.39%) VirtualBox
5 1 (0.39%) VMware Infrastructure
Systems Management
1 38 (14.67%) Kubernetes
2 28 (10.81%) Ansible
3 27 (10.42%) Oozie
4 17 (6.56%) Docker Swarm
4 17 (6.56%) Hadoop YARN
5 15 (5.79%) Opscode Chef
6 13 (5.02%) Terraform
7 12 (4.63%) Puppet
8 4 (1.54%) Prometheus
9 3 (1.16%) Ambari
10 1 (0.39%) Kibana
10 1 (0.39%) logstash
10 1 (0.39%) Packer
10 1 (0.39%) Tivoli
Vendors
1 29 (11.20%) Cloudera
2 27 (10.42%) Microsoft
3 26 (10.04%) Oracle
4 23 (8.88%) Hortonworks
5 20 (7.72%) Tableau
6 14 (5.41%) Google
7 7 (2.70%) IBM
7 7 (2.70%) Talend
8 6 (2.32%) MapR
8 6 (2.32%) Splunk
9 3 (1.16%) SAP
10 2 (0.77%) Alteryx
10 2 (0.77%) New Relic
10 2 (0.77%) Teradata
11 1 (0.39%) Adobe
11 1 (0.39%) Databricks
11 1 (0.39%) Palantir
11 1 (0.39%) ServiceNow
11 1 (0.39%) Sonatype
11 1 (0.39%) Unisys